Does trajectory-level evaluation data qualify? An 18-point scorecard for step-by-step approval records

Short answer

Pass two gates first: 50 or more full-time employees at peak, and English share where the geography rule needs it. Then score five criteria from 0 to 3: operating history, rights and authority, step attribution (counted double), dated rules, and outcome linkage, for 18 points. Fourteen or more is strong, nine to thirteen borderline, eight or under weak for now. The deciding question is whether each approval is logged under the person who actually gave it.

Visual briefFull-size diagram
Two gates turn green, then five criteria tiles light up with their points while a dial needle sweeps across weak, borderline and strong bands and settles at 15 of 18 for a fictional 450-person outdoor gear retailer.
Illustrative score for a fictional retailer. The score sorts an introduction; it does not predict acceptance or a payout.

The scorecard extends the guide to trajectory-level evaluation in an ordinary workflow, which follows a $312 no-receipt refund that was correct in amount but approved with a shared override code. That guide explains why the path matters. This page helps an introducer judge whether a particular client's records could support grading the path at all.

Gates before any points

Two conditions are pass or fail. If either fails, stop; no score on the record criteria changes the answer.

GatePassFail
Headcount50+ full-time employees at peak, contractors excludedUnder 50, or mostly seasonal contractors
Geography and EnglishCompany in the U.S., Canada or the EU, or 70%+ of records in English elsewhereUnder 70% English outside those regions

The rule in full: Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 70% of the data is in English.

The five scored criteria

Criterion3 points2 points1 point0 points
Operating historyFive or more years in the same point-of-sale or ERP systemThree to five years, or one migration with history carried overOne to two yearsMonths, or history discarded at a migration
Rights and authorityThe company owns its transaction logs; a named CEO or owner can authorize a licensing discussionOwnership clear; vendor or processor terms uncheckedA franchise or parent may share ownershipRecords belong to a franchisee, processor or client
Step attribution (x2)Every step logged with the individual who took it, no shared codesShared codes ended on a known date; later years are cleanSome steps logged per person, others under shared or role accountsApprovals on paper, or under shared logins throughout
Dated rulesThresholds, approver lists and policy revisions carry effective datesMajor changes dated; minor ones notChanges known from memory onlyOnly the current policy exists
Outcome linkageReversals, chargebacks and re-refunds link to the original transactionLinkable by card, amount and dateOutcomes visible only in a processor portalNo outcome record

Step attribution is scored 0 to 3 and then doubled, so it can carry 6 of the 18 points. That reflects how trajectory grading works. Google Cloud's agent evaluation tools, for example, compare an agent's sequence of tool calls with a reference sequence, with exact, in-order and any-order matching. A business archive supports the same kind of comparison only when each step is attributable. The research benchmark τ-bench, by contrast, grades by comparing the final database state with a goal state, an outcome check that would pass a correctly sized refund approved by the wrong person.

Reading the total. With both gates passed: 14 to 18 is strong, 9 to 13 borderline (introduce with the low rows named), 8 or under weak for now. A zero on step attribution makes the result weak for now, whatever the total, because without attributable steps there is nothing for a trajectory grader to check that an outcome grader cannot.

Five questions that settle the score

Ask the head of operations, loss prevention or finance. None of them requires a screen or a file.

#QuestionCriterion
1Which routine task has a rule about how it is done, not just the result? Roughly how many a year?Sets the task; context for all rows
2Is every step logged with the person who took it, and in which system?Step attribution
3Can anyone approve under someone else's identity, through shared codes or assistant entries? If that changed, when?Step attribution
4Are thresholds and approver lists changed with effective dates recorded?Dated rules
5Who owns these records, and who can authorize a licensing discussion?Rights and authority

Add two follow-ups for the remaining rows: "How far back does the system go?" and "When a refund is later reversed or disputed, can you find the original transaction?"

Question 3 is the one that moves the score most, and it deserves a plain, unhurried tone. Security auditing has long treated shared accounts as an attribution problem: NIST's audit-content enhancement AU-3(1) lists the individual identities of group account users among the extra details a system may need to record. Many retailers know about shared override codes and have fixed them at some date, and that date is itself useful to record.

Three scored fits (Illustrative)

All three companies are fictional. The numbers illustrate the method only.

Strong: a 450-person outdoor gear retailer with 22 stores. No-receipt refunds over a threshold need a manager's own badge scan, logged in the point-of-sale system for eight years. Shared codes were removed in 2021, on a date the loss prevention lead knows. Threshold changes are dated in the policy library; chargebacks link to transactions by card, amount and date only. The company owns its transaction logs and the CEO can authorize a licensing discussion. Scores: history 3, rights 3, attribution 2 (x2 = 4, because the years before 2021 carry shared codes), rules 3, linkage 2, for a total of 15. Strong, with the pre-2021 period named.

Borderline: a 190-person furniture retailer. Delivery-damage credits need a manager signature on a paper slip that is scanned into the order later. The ERP records the credit under the clerk's login. Rule changes are announced by email. Scores: history 3, rights 3, attribution 1 (x2 = 2), rules 1, linkage 2 for 11. Worth introducing, with the paper approvals named as a gap.

Weak: an 85-person franchise group of quick-service restaurants. Each franchisee owns its point-of-sale data under the franchise agreement, voids use a shared manager code, and the menu-pricing rules carry no dates. Scores: history 2, rights 0, attribution 0, rules 0, linkage 1 for 3. Not ready.

Who owns the records, and what stays open after scoring

Store operations or loss prevention usually knows the approval process; finance owns refund and chargeback records; IT runs the point-of-sale and ERP systems. A licensing discussion is authorized by the CEO, or by the owner in an owner-run company. The company also needs documented operating history and an authorized contact.

The score cannot tell anyone how many cases are gradable, how card and employee data would be handled, what the point-of-sale vendor's terms allow, or whether a buyer wants the task type. Those questions belong to SourceX's review with the company. Partners stay at metadata level and never ask for receipts, logs or screenshots.

For what step records look like in general, see agent trajectory data; for company basics, the company qualification checklist. Low rows can be described with trajectory-level evaluation evidence gaps, and after an introduction the company prepares the trajectory-level evaluation review packet. Advisors in diligence work may find MCP for due diligence Q&A useful, and the introducer guide to operational data licensing covers the full process.

Next step

Refer a company. No cap on rewards. Default reward on a company's first qualifying transaction: the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no cap; further qualifying transactions first agreed within 12 months of the first Closing pay 15%. Eligibility and payment conditions apply, including the USD 100,000 Minimum Transaction, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

If both gates pass and the records score nine or more with step attribution above zero, register as a partner, confirm the basics on who qualifies, and read the terms before you introduce the COO, CFO or owner.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardthe greater of $50,000 plus 5% and 15% of the actual supplier payout, with no cap. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Why is step attribution worth double?

Because trajectory grading judges who took each step and in what order. If approvals sit under shared codes, the steps are recorded but the grader cannot tell an authorized approval from an unauthorized one, which is the failure the method exists to catch.

Does the company need clean compliance to score well?

No. Cases where a step was skipped or taken out of order are valuable, as long as the records show what actually happened and what the rule required at the time.

Is this only for retailers?

No. Any routine task governed by a rule about how it is done fits: purchase approvals, credit limit overrides, claims payments, dual sign-off on releases. Refunds are the running example because the steps are easy to name.

Sources

  1. docs.cloud.google.com/vertex-ai/generative-ai/docs/models/evaluati…
  2. arxiv.org/abs/2406.12045
  3. nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.800-53r…
  4. refer.sourcex.si/terms

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 70% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment