Long-horizon task data review packet: eight documents that describe a multi-step case before review

Short answer

A long-horizon task data review packet is eight metadata-only documents that describe how one type of multi-step case is recorded, so SourceX can judge whether whole cases survive across systems. In order: a cover sheet, the task specification, a step inventory, a join-key map, an outcome check, a break register, a volume and migration sheet, and rights notes. The join-key map and break register carry most of the weight, because long cases fail at the joins, not for lack of volume.

Visual briefFull-size diagram
Eight overlapping documents drop in sequence into a long folder, from cover sheet and step inventory through the join-key map, outcome check and break register to the rights notes, with the map and register highlighted.
Illustrative packet for a fictional cold-storage operator's warranty-recovery cases. The folder holds descriptions of the chain, never the claims, receipts or credit memos.

This packet is part of the guide to long-horizon task data in an ordinary workflow, which explains the idea through a parts order. To show that the packet works for any case type, this page fills it in for a different one: supplier warranty recovery on failed equipment, at a fictional cold-storage operator. The company's own team assembles a packet like this. Partners never assemble or handle packets; SourceX reviews records under its own agreement with the company.

Packet contents, from cover sheet to rights notes

#DocumentWhat it showsWho prepares it
1Cover sheetHeadcount, systems, years of history, named owner and contactOwner or CFO, with the introducer helping only on these metadata fields
2Task specificationThe end-to-end job a case represents, in plain wordsEngineering or asset manager
3Step inventoryEvery step in the case type, and the system or inbox that holds itAsset manager with the warranty administrator and accounts payable
4Join-key mapThe reference that links each step to the one before, and whether it is stored or typedSystems administrator for the maintenance platform and ERP
5Outcome checkThe test a closed case must pass, which only the full chain can satisfyController, reviewed by SourceX
6Break registerKnown places where chains split into separate recordsAsset manager and systems administrator
7Volume and migration sheetCases per year, years retained per system, cutover datesFinance systems lead
8Rights and sensitivity notesSupplier terms, personal data, contract limitsCounsel or CFO

Taken in order, the eight answer seven questions a reviewer brings: what the job is, where each part sits, what ties the parts together, how a correct ending looks, where ties fail, how much history exists, and whether it may be licensed.

The worked case behind this packet (Illustrative)

A fictional 600-person cold-storage operator loses a refrigeration compressor on a loading dock 14 months after installation. The unit carries an 18-month, parts-only supplier warranty. Every figure is invented.

DayEventWhere it is recorded
0Technician logs the failure against the asset IDMaintenance platform work order
1Replacement compressor ordered, $9,400ERP purchase order
2Warranty eligibility checked: install date and serial numberAsset register
4 to 6Replacement received, invoiced and matchedERP receipt, invoice, match
5Claim filed for $12,000: $9,400 parts and $2,600 laborSupplier warranty portal
9Supplier issues a return authorization with a 30-day deadlinePortal message, email
20Failed unit shipped backCarrier tracking, shipping log
47Teardown verdict: defect confirmed, parts covered, labor excludedSupplier email with attached report
58Credit memo for $9,400 posted against the supplier accountERP accounts payable

The packet never contains this table's records. It describes how cases like this one are stored across the operator's history.

Documents 2 and 3: the task and the step inventory

Document 2, task specification. A single testable instruction, for example: "Recover the supplier's share of a failed in-warranty asset. Confirm coverage from the asset register, file within the warranty window, return the failed part before the authorization expires, and book whatever the supplier declines." Each clause depends on a step days or weeks away, which is what makes the task long-horizon.

Document 3, step inventory. Each step, with where it lives: the failure in the maintenance platform; install dates and serials in the asset register; the replacement purchase in the ERP; the claim, return authorization and teardown verdict in the supplier's portal or in email; shipping in a carrier account or a dock log; the credit memo in accounts payable. Mark every step that lives outside a company system, such as a supplier portal account tied to one engineer's login, because those disappear first when people leave.

Document 4: the join-key map

Expect the first draft of this map to have gaps. Against each step it records the identifier that ties the step to the case, and whether software stores it or a person keys it in.

StepKey it carriesStored in a field or typed
Work orderAsset IDField
Eligibility checkAsset ID, serial numberField in the register
Replacement PO and receiptWork order numberField
Invoice and matchPO numberField
Warranty claimSerial number; work order numberField in the portal; typed in a note
Return authorizationClaim numberTyped in email
Shipment of the failed unitReturn authorization numberTyped on the label
Teardown verdictClaim numberIn an attached report
Credit memoClaim numberOften typed, sometimes missing

The replacement purchase is the strong segment. Microsoft's documentation describes three-way matching as comparing invoiced quantity with the product receipt quantity and treating a difference as a matching error, so the software itself polices that join. The fragile segment is everything the supplier controls: claim, authorization, verdict and credit, where a missing claim number on the credit memo leaves $9,400 that nobody can tie back to the failed compressor.

Document 5: an outcome check only the whole chain can pass

Write the check before anyone counts cases, and phrase it so a reviewer has to walk every join. For the Illustrative compressor:

  1. The credit memo equals the parts value the supplier approved, $9,400, and cites the claim number.
  2. The declined $2,600 of labor is booked as maintenance expense, not left sitting as a receivable.
  3. The failed unit shipped on day 20, inside the 30-day window that opened on day 9.
  4. The claim was filed inside the 18-month warranty measured from the install date in the asset register, not from the invoice date.

Booking the whole $12,000 as recoverable on day 5 fails, even if the books are tidied after day 58, because it ignored the verdict that only arrived on day 47. A check like this cannot be passed from any single record. That is also why evaluation tools judge whole attempts: micro1 says its flow product lets reviewers inspect an agent's steps, tool calls and outputs and score the attempt as a whole or criterion by criterion, which only works when the record holds the full case.

Documents 6 to 8: breaks, volume and rights

Document 6, break register. Where chains tend to split, and in which years. Typical entries for warranty recovery: claims filed from a personal portal login with no copy in company systems; return labels printed without the authorization number; teardown reports kept only as email attachments; credits netted against the next invoice with no claim reference. Every break turns one two-month case into scattered fragments. Listing them builds credibility.

Document 7, volume and migration sheet. Approximate warranty claims per year, years retained in each place (maintenance platform, asset register, ERP, supplier portal, email), and every cutover. Supplier portals and mailboxes may keep far less history than the ledger, which narrows the window in which whole cases still exist.

Document 8, rights and sensitivity notes. Warranty and supply agreements can restrict how supplier documents, prices and failure reports are reused; work orders name technicians. Counsel or the CFO records these as open questions. The company itself must qualify: 50 or more full-time employees at peak (contractors excluded), documented operating history, rights to license, and an authorized contact. Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 70% of the data is in English.

The effort goes into joins because a long case is only useful when it can be checked end to end. METR measures agent capability by the length of task, in human expert time, that agents finish half the time, and reports that length doubling roughly every seven months; as evaluated tasks get longer, so do the cases needed to test them. Background reading: long-horizon tasks and project records, agentic AI in the enterprise and agent trajectory data. The packet leaves open how many cases pass the check, what supplier agreements permit, what de-identification is needed, and whether any buyer wants this case type. Before starting a packet, test fit with the long-horizon task data scorecard. Advisors covering several companies can add it to a portfolio introduction plan; related records are covered in procurement and vendor workflows.

Next step

Refer a company. No cap on rewards. Default reward on a company's first qualifying transaction: the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no cap; further qualifying transactions first agreed within 12 months of the first Closing pay 15%. Eligibility and payment conditions apply, including the USD 100,000 Minimum Transaction, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

If a client's systems administrator could draft the join-key map above with most keys stored in fields, register as a partner, check who qualifies, and read the terms before introducing the CEO or owner.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardthe greater of $50,000 plus 5% and 15% of the actual supplier payout, with no cap. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Does the packet contain a real case?

No. It describes one case type and how its records link, using field names, counts and dates. The claims, receipts and credit memos stay inside the company until an agreement with SourceX covers them.

Why does the packet list where chains break?

Because breaks decide how many whole cases survive. A company that lists its known breaks up front, such as return authorizations tracked only in email, saves a review from discovering them later and makes its other claims more credible.

Who should own the join-key map?

Usually the administrator of the maintenance platform and ERP, or the finance systems lead, since they know which reference fields each module stores and which are typed by hand. The asset manager and warranty administrator confirm the steps held in supplier portals and email.

Sources

  1. micro1.ai/blog/introducing-flow
  2. learn.microsoft.com/en-us/dynamics365/finance/accounts-payable/t…
  3. arxiv.org/abs/2503.14499
  4. refer.sourcex.si/terms

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 70% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment