How to delegate referral screening without delegating judgment: ten training rows, named escalation triggers and a calibration check before the screener works alone

Short answer

Delegate the checks that have published answers and keep the calls that need a relationship or a judgment. An associate can screen a company's metadata against the published fit facts and decline the clear misses with a logged reason. The platform lead keeps every decision to ask, every edge case and anything touching consent, confidential sources, records or money. Train the screener on worked rows, escalate on named triggers, and let the screener decline alone only after a calibration round with no missed escalations.

Visual briefFull-size diagram
A decision tree in which the screener checks a company's metadata and sends it down one of three branches: fails a published fact leads to decline with a logged reason, hits a trigger leads to escalation to the platform lead, and clears every fact leads to the lead deciding the ask; a band beneath says only the lead and the relationship owner contact a CEO.
The split of decisions described on this page. Structure only; no real companies.

The fit facts need no judgment: 50+ full-time employees at peak (contractors excluded), years of records the company created, rights to license them, a location and language that fit, and a CEO who authorizes the discussion. A row that fails one needs nobody's relationship. Whether to spend a founder's goodwill, whether the records are really the company's own, whether something you know came in confidence: that is the work a head of platform keeps.

What the founder gains, and what each lead hour costs

Founders gain from delegation only if it makes the asks better: a founder should hear about the program only when the company has already passed the published facts. A careless screener does the opposite, producing more asks, more of them irrelevant, each spending goodwill that belongs to whoever holds the relationship.

The lead's hour is the constraint. Spending it on rows that fail a published fact is waste; spending it on the rows below that need judgment is the job. The base case books referral income at $0, because SourceX has not published conversion rates or typical payouts and whether any company is accepted is decided only in its review. Delegation has to pay for itself in lead hours saved and founder asks improved, or not at all.

Decision rights: what the screener may decide alone

Give the screener this table on day one; anything not on it goes to the lead.

DecisionScreenerPlatform leadWhy it sits there
Record metadata: headcount at peak, years, systems, location, language shareDecidesSpot-checksPublished criteria; no relationship involved
Decline a row that fails a published factDecides, logging the failed fact and a revisit triggerSamples weeklyThe fact settles it
Count a staffing firm's employeesDecides: the firm's own full-time staff only, placed workers listed separatelyReviewsSettled program rule
Pass a row that clears every factRecommendsDecides whether to askAsking spends a relationship
Records held for customers or inside customer systemsEscalatesDecidesClient-owned material is usually not a fit
Group structures and earlier contact with SourceXEscalatesDecides; SourceX settles credit in duplicate reviewCredit questions the terms leave to review
Anything learned under confidentiality, such as board materialsEscalatesDecidesConfidential knowledge is a reason to ask the CEO, not content to pass on
Any contact with a founder or CEONeverDecides, through the relationship ownerConsent
Any mention of money or acceptanceNeverDecides the wordingThe partner agreement bars implying a purchase or reward is assured

Two rules from the partner agreement make the bottom rows non-negotiable. The fund may share SourceX's confidential information only with people who need it and are bound by similar duties, and it is responsible for their compliance, so the screener is acting for the fund. And the agreement gives partners no authority over a supplier's records, so a screener who is offered files has only one move: stop and escalate.

Ten training rows with the right call (Illustrative)

Illustrative. Generic companies, invented facts. Teach the reason, not just the call; the screener should be able to say which rule decided each row.

RowWhat the screener seesRight callThe rule it teaches
145 full-time employees, never more; nine years of service ticketsDecline; revisit if full-time headcount passes 50Size is judged at peak, and this peak fails
2Peaked at 140 full-time employees in 2021, 38 today; twelve years of claim filesPass to the leadPeak counts, not today's number
3Staffing firm with 70 internal full-time staff and 900 placed workersPass to the lead with both numbersOnly the firm's own full-time staff count; placed workers are listed separately
4Distributor in Brazil whose records are about 60% EnglishDecline under the published language rule; note that program fit can changeOutside the U.S., Canada and the EU, at least 90% of the data must be in English
5Software company whose valuable records sit inside customer tenantsEscalate: rightsClient-owned material is usually not a fit
6Portfolio company in an active sale process, known from board materialsEscalate: confidential source and timingConfidential knowledge is never screening material
7Subsidiary whose sister company another partner introducedEscalate: group creditSourceX decides credit in duplicate review; one cap per group
8Founder said "not this quarter"Park; the lead decides when to revisitConsent belongs to the company
9A CFO emailed the screener a sample exportEscalate at once; do not open or forward itPartners never handle records
10600-person logistics firm; the only contact is a functional vice presidentPass to the lead, marked "no relationship owner"The CEO authorizes; the lead decides whether a path exists

Rows 1 to 4 have published answers, so the screener decides them. Rows 5 to 9 each hit a named trigger. Row 10 clears the facts but has no path, which the lead solves or drops. Getting row 3 wrong means rereading the rules; getting row 9 wrong means a conversation before the next row.

The triggers, for the screener's wall: rights unclear; customer-owned systems; a group or an earlier contact with SourceX; information from a confidential source; any records seen or offered; any request to talk money; the relationship owner's hesitation. Each escalation carries the row, the fact, the trigger and where the fact came from, nothing more.

Calibrate before the screener works alone

Before the screener declines anything unreviewed, both of you classify the same 20 rows independently, using four calls: decline, pass, escalate, park. Then compare. The model comes from evaluation practice: Anthropic's guide to evaluating AI agents says automated graders should be calibrated closely against human experts so that the two rarely diverge, and it defines a transcript as the complete record of a trial, with its outputs, reasoning and intermediate steps, not just the final score. Here the screener is the grader, the lead is the expert, and the screener's written reason for each call is the transcript.

Overall agreement is not enough, because chance alone produces some of it. Cohen's kappa, as McHugh's review explains, compares observed agreement with the agreement expected by chance and runs from -1 to +1, where 0 means no better than chance and 1 means perfect agreement. A worked Illustrative round:

Measure (Illustrative)Value
Rows agreed, out of 2018
Observed agreement0.90
Agreement expected by chance, from each person's call counts0.345
Cohen's kappa0.85
Trigger rows the screener escalated, out of 64

The lead called 8 declines, 6 passes and 6 escalations; the screener called 9 declines, 7 passes and 4 escalations, and both disagreements were rows the lead escalated. A kappa of 0.85 looks reassuring. The screener is still not ready, because the only two misses were exactly the rows that needed judgment. Make the gate two-part, fixed in advance: no missed trigger rows, then an agreement level you choose for the rest. Run a fresh 20-row set after any miss.

Work at each stage when no revenue is assumed

The planning figures are Illustrative, for one 25-company list; replace them with a time log after the first round.

StageScreenerPlatform leadReferral income booked
Build and source the list2 hoursNone$0
Metadata screen and decline log3 hours20 minutes sampling declines$0
Passes and escalations reviewed30 minutes preparing the rows1.5 hours deciding$0
Relationship-owner asksNone1.5 hours$0
CEO consent and introductionsNoneThrough the relationship owner$0
SourceX's questions about the introductionsDrafts answersApproves them$0
Outcome back to foundersNone1 hour$0

In this illustration the lead spends a little over four hours on 25 companies, plus approving answers, instead of screening every row. Delegation earns its place only if those hours go to better asks.

Widen, pause or take the screen back

Write the thresholds down before the first round.

  • Widen the screener's authority, so declines go out unreviewed and the lead samples one in five, after two consecutive calibration sets with zero missed trigger rows and agreement at or above your chosen level.
  • Pause after any trigger row passed without escalation, any decline that failed no published fact, or a change in program criteria. SourceX judges each company against the criteria of the specific program it is being considered for, and today's decline can become a fit for another program later, so rules on the screener's wall go stale.
  • Take the screen back if the screener contacted a founder or CEO without the lead's decision, opened or forwarded company records, or told anyone a company "qualifies".

A screen that should stop (Illustrative). An associate screens 48 companies in a week, passes 14 and emails four founders a template saying their companies "qualify". Every row was screened correctly on the facts. The delegation still fails: outreach happened without the lead's decision, and acceptance was implied to founders when only SourceX's review can decide it. The lead takes the screen back, writes to the four founders to correct the message, and restarts calibration.

Limits of a delegated screen

  • It checks published facts, not demand. SourceX checks relevance to current data needs in its own review, so a perfect screen still produces declines later. The company fit checker is preliminary and non-binding for the same reason.
  • Small calibration sets are noisy. Twenty rows teach a lot and prove little; treat one good round as a start.
  • Delegation does not move confidentiality. The fund stays responsible for everyone acting for it.
  • Turnover resets calibration. A new screener starts at row 1.
  • No published measurements. SourceX has not published conversion rates or payouts, and time logs and founder feedback from a permissioned pilot have not been published; the hours above are placeholders.

Method note. The decision rights and training rows were built on 2026-10-26 from the program terms (Version 2026-10-22.2), the unsigned Channel Partner Agreement sample (version 2026-10-19), SourceX's who-qualifies page and owner decisions on staffing firms and parent companies, with calibration borrowed from Anthropic's evaluation guidance and McHugh's review of kappa. It does not measure screener accuracy in any real fund.

Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 90% of the data is in English. For the screen itself, the portfolio screening workbook, the fit screening worksheet and the peak headcount decision tree give the screener its forms; the overview for venture platform teams covers the program from the fund's side.

Next step

Refer a company. Earn up to $100,000. Default reward: 25% of Actual Supplier Payout, capped at $100,000 cumulatively per referred company. Eligibility and payment conditions apply, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

Run the 20-row calibration before you hand over a single list, then register for a partner link, give the screener the criteria on who qualifies and keep the program terms with the lead, who makes every ask.

A fund weighing SourceX as an investment, rather than as a program to run, should treat that as its own diligence question; the SourceX investor overview takes requests for investor materials.

This article is for information only and is not an offer to sell or a solicitation of an offer to buy securities. Any offering by SourceX is made only to verified accredited investors through its offering documents.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardYour 25% of the actual supplier payout. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Can a screener decline a company without the platform lead seeing it?

Yes, when the row fails a published fact and the screener logs which fact failed and what would change the answer. The lead samples those declines each week and takes back the right to decline alone if a sample turns up a judgment call.

Should the screener ever contact a founder or a CEO?

No. Contact spends a relationship and needs the relationship owner's agreement and the CEO's knowledge, so it stays with the platform lead and the person who owns that relationship.

Why not judge the screener on overall agreement alone?

Because most rows are easy and the errors that matter cluster on the hard ones. A screener can agree with the lead on nearly every row and still miss the two rows that should have been escalated, which is why trigger rows are scored separately.

Sources

  1. refer.sourcex.si/terms
  2. refer.sourcex.si/who-qualifies
  3. sourcex.si/documents/partner/SourceX_Channel_Partner_Ag…
  4. anthropic.com/engineering/demystifying-evals-for-ai-agents
  5. pmc.ncbi.nlm.nih.gov/articles/PMC3900052
  6. sourcex.si/investors

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 90% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment