A false-positive closure worked step by step: the backup job that looked like ransomware staging

Short answer

The records that explain how a false positive was handled are the alert with its rule version, the analyst's evidence and reasoning, the closure verdict with its reason, any tuning proposal and the review of it, the rule change that shipped, and a later check that the change held. The worked case below walks one hard closure through those records in order. A disposition label alone shows only that someone called the alert harmless; the sequence shows why.

Visual briefFull-size diagram
A case timeline that runs from a mass file read alert to triage, then branches at the exception: a broad exclusion proposal is rejected, a narrow exclusion for one signed binary and service account is approved, and a 30-day check confirms the rule still fires outside it.
Illustrative case. Each step on the timeline leaves its own record in a different system.

This worked case belongs to the false-positive investigation closure guide. Its job is specific: one case, every decision, and the record each decision left.

The case in one paragraph (Illustrative)

Illustrative. A 310-person managed security provider monitors a client's file servers. The client changes its backup product, and the new backup agent runs at 01:00 under a dedicated service account, reading about 180,000 files across six servers in forty minutes. A detection for mass file reads followed by archive creation, a common ransomware staging pattern, fires on every server. The activity is legitimate and approved. The hard part is not deciding that; it is deciding how to stop the noise without blinding the rule to a real attacker who might later use the same pattern.

Step by step: who decided what, and which record shows it

StepDecisionWho decidedRecord it leftSystem
1. AlertRule version 21 fires six times in ten minutesDetection logicAlerts with rule name, version, host, account, alert IDsDetection platform
2. TriageGroup the six alerts into one case and raise priorityTier 1 analystCase with linked alert IDs, priority change, timestampCase manager
3. EvidenceMatch service account, signed backup binary and the client's change ticket for the new productTier 2 analystCase notes, attached query results, change ticket referenceCase manager
4. VerdictClose as harmless: real activity, expected, not maliciousTier 2 analyst, approved by shift leadClassification and reason, closing comment, analyst and approver IDsCase manager or SIEM
5. ProposalExclude the six servers from the rule at nightDetection engineerPull request with the proposed changeRule repository
6. ReviewReject: a host-wide exclusion would hide a real staging attack on those serversDetection engineering leadReview comment and rejectionRule repository
7. FixNarrow exclusion to the signed binary hash plus the service account, with a 90-day expiryDetection engineer, approved by leadRule version 22, rationale, approval, expiry dateRule repository
8. Check30 days later: no repeat alerts from backups; a test archive job from another account still firesShift leadReview note and test resultCase manager

Steps 3, 6 and 8 carry the judgment. Step 3 is the reasoning that separated expected from malicious. Step 6 is the decision not to take the easy fix. Step 8 is evidence that the chosen fix worked and did not over-suppress. Many teams record step 4 and nothing else.

Why this sequence is useful evidence

A false positive has two possible failures: the noise continues, or the fix silences a real attack. The case above records how a team steered between them, and each record answers a question an outside reviewer would ask.

  • Was the verdict reasoned? The case notes in step 3 show the specific facts checked: account, binary signature, change ticket.
  • Was the label meaningful? Platforms use different vocabularies. Microsoft Sentinel closes incidents with a classification such as Benign Positive and a reason such as Suspicious But Expected, or a False Positive with Incorrect Alert Logic. This case is the first kind, not the second: the rule did what it was written to do.
  • Was the fix proportionate? The rejected proposal and the narrow approved change show a risk judgment. Where rules live in a repository, the review tool keeps that judgment: on GitHub, a reviewer can comment, approve, or request changes the author must address before merging.
  • Did it hold? The 30-day check with a negative test is the only record that proves the exclusion did not create a blind spot.
  • Was it time-limited? Sentinel automation rules, for example, can carry an expiration date. An expiry on the exclusion forces a later re-check, which leaves yet another record.

NIST's revised incident response guidance, SP 800-61 Revision 3 (April 2025), frames incident response as part of cybersecurity risk management rather than a separate activity. A closure history with proposals, reviews and checks is what that looks like in day-to-day records. For why AI developers value exactly this kind of exception reasoning, see exception handling data for AI agents.

Variations a partner will meet

The same shape repeats with different triggers. Recognizing it is more useful than memorizing one case.

Trigger that looks maliciousWhat made it legitimateThe hard decision
Backup agent reading thousands of filesApproved product change, signed binaryHow narrowly to exclude
Vulnerability scanner attempting logins across hostsScheduled authenticated scan from a known rangeWhether to exclude the range or the scanner account
Admin tool running remote commands at nightPatch window under a change ticketTime-boxed suppression or permanent tuning
Bulk mailbox exportLegal hold request from counselWho can confirm the request was genuine
Logins from two countries an hour apartTraveling consultant on a corporate VPN exitWhether travel data may be consulted at all

How to recognize similar cases at a client

Ask the SOC director or detection lead these questions. None requires seeing a case.

  1. Do closed cases link back to the alert IDs that opened them?
  2. Is the closing comment free text with reasoning, or only a label?
  3. Are rule changes kept in a repository with review comments, including rejected proposals?
  4. Do exclusions carry expiry dates and recorded re-checks?
  5. How many years do those records span, and in which systems?

If most answers are yes, the company may hold complete exception histories. The system map of closure records shows how the joins work, and the referral brief template turns the answers into a one-page introduction. The cybersecurity services fit page explains which security records are usually in scope; complaint handling records show the same problem, action and result pattern in a different function.

The introduced company needs 50+ full-time employees at peak (contractors excluded), a documented operating history, rights to license the records, and an authorized contact. Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 90% of the data is in English. What stays unknown until SourceX reviews it: which records the company has rights to license, how client-derived details would be removed, whether there is dataset demand, and any offer.

Next step

Refer a company. Earn up to $100,000. Default reward: 25% of Actual Supplier Payout, capped at $100,000 cumulatively per referred company. Eligibility and payment conditions apply, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

If a security client keeps its tuning proposals, reviews and post-closure checks alongside its cases, register as a partner, check the company against who qualifies, and read the program terms before you introduce its leadership.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardYour 25% of the actual supplier payout. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Why is a rejected tuning proposal worth keeping?

Because it records a judgment about risk. The rejected broad exclusion shows what the team considered too dangerous to suppress, which a closed-case count never reveals. Histories that keep proposals, reviews and outcomes together are the ones that explain how exceptions were handled.

Is the client's telemetry part of this history?

The raw logs from the client's hosts usually belong to the client relationship and are typically excluded. The provider's own case notes, rule versions and review comments are what a rights review looks at first, often in de-identified form.

How many cases like this does a company need?

There is no published threshold. What matters is that cases are complete: alert, evidence, verdict, fix and check joined together. A few hundred complete cases may say more than many thousands of bare dispositions.

Sources

  1. learn.microsoft.com/en-us/azure/sentinel/automate-incident-handl…
  2. nist.gov/news-events/news/2025/04/nist-revises-sp-800…
  3. docs.github.com/en/pull-requests/concepts/giving-reviews
  4. refer.sourcex.si/terms

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 90% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment