What happens when a referral page removes the headline figure? A three-arm test that counts qualified introductions, not clicks

Short answer

Nobody knows yet for this program: SourceX has not run the test, and no results exist. What is known is narrower. Readers can take a headline figure as a typical result: an FTC-commissioned study found that many consumers believe "up to" claims promise the maximum. Our thesis, untested, is that dropping "Earn $1,500,000+" would lower registrations but not qualified introductions. The three-arm design below would settle it on the outcome that matters: introductions that pass eligibility review.

Visual briefFull-size diagram
Illustrative. Diagram: Remove the maximum, then what?; Three arms, one qualified outcome (proposed test); A; No reward cap; B; $50K + 5% or 15%; C; Know a 50+ company?; Visitors; Registrations; Introductions; Passed eligibility; ?; ?; ?; ?; ?; ?; ?; ?; ?; ?; ?; ?; Not yet measured.
Illustrative, not a forecast, quote or completed deal. For a company's first qualifying transaction, the reward is the greater of USD 50,000 plus 5% and 15% of Actual Supplier Payout, with no cap. The Minimum Transaction is USD 100,000 unless SourceX agrees in writing. Qualifying repeats agreed within the 12-month Repeat Window pay 15%; the floor applies once per company.

Three kinds of statement run through this page, and they should not be confused.

  • Known. The reward on a company's first qualifying transaction is the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no cap, further qualifying transactions first agreed within the 12-month Repeat Window pay 15%, and SourceX's fees or revenue never enter the calculation. Nothing becomes payable on a lead, a meeting or a signed agreement by itself.
  • Conditional. Whether any introduction leads to a reward depends on SourceX's review, a completed handoff and the payment conditions in the terms.
  • Thesis. Everything this page says about how the headline changes behavior. It stays a question until a study answers it.

This page itself carries the program's standard offer block, and the live site's headline leads with "Earn $1,500,000+". That headline is the control arm.

Terms used in the three-arm headline test

TermMeaning here
Headline figureA headline that leads with a large reward number, such as "Earn $1,500,000+"
ArmOne version of the landing page, shown to a randomly assigned share of first-time visitors
Qualified introductionAn introduced company that submits a verified application and passes SourceX's eligibility review by the cutoff
Comprehension scoreCorrect answers, out of three, on what the reward is calculated on, when it becomes payable and whether the headline figure is typical
Open caseAn introduction with no final status at the cutoff; reported, never dropped

Why the headline is worth testing

A headline figure is not a typical amount. The program has no cap, and a company's first qualifying transaction pays the greater of $50,000 plus 5% and 15% of Actual Supplier Payout: USD 100,000 paid yields USD 55,000, USD 400,000 yields USD 70,000 and USD 1,000,000 yields USD 150,000 (illustrative arithmetic, not a forecast). SourceX has published no typical payouts, so nobody outside SourceX can say how often any figure is reached, and this page does not guess.

Readers can hear a maximum as a promise. In 2012 the FTC published a commissioned study of replacement-window advertising that claimed savings of up to 47%, and said the research showed many consumers are likely to believe they will achieve the maximum "up to" result. The FTC's position was that advertisers making such claims should be able to substantiate that consumers are likely to achieve the maximum under normal circumstances. That research concerned consumer savings claims, not referral programs. It is still the clearest public evidence that a headline figure can be read as a typical outcome, which is why comprehension is one of the outcomes below.

Two opposite risks, both plausible. A large headline figure may attract registrations from people whose networks hold no qualifying companies, which costs everyone screening time; the poor-fit guide lists the patterns that fail. Or removing it may lose the investors and advisors whose networks hold large, long-established companies, who notice the program because one introduction could justify their time. Neither risk has been measured.

Partner programs disagree about what to count. In PartnerStack and Wynter's survey of 100 senior B2B SaaS leaders, 42% said they use multi-touch attribution for partner revenue, 31% first-touch and 19% last-touch. A headline test judged on clicks answers a question nobody is paid on. Completed, paid handoffs are what the program rewards, but they arrive months later and are too rare for a page test. The primary outcome is therefore the earliest point that is both defined by the terms and screened by SourceX: a qualified introduction.

The qualified-conversion headline study

Three arms. Every arm is a true statement of the same terms, shows the calculation base, the no-cap rule and the payment trigger above the fold, links to the program terms and uses the same page body and registration form below the headline.

ArmHeadlineLine beneathWhat it tests
A, controlIntro a company. Earn $1,500,000+Default reward on a first qualifying transaction: the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no capThe current framing
B, formula firstEarn the greater of $50,000 plus 5% and 15% of what SourceX pays the company you referNo cap, the USD 50,000 floor once per company, and paid only after the company is paidWhether stating the calculation base first changes who registers
C, fit firstKnow a company with 50+ employees and years of records?Introduce its CEO; reward the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no capWhether leading with fit filters out poor-fit registrations

No arm may show a typical or expected reward, because none is published, and no arm may move the calculation base or the payment conditions out of sight.

ElementSpecification
QuestionDoes the headline change qualified introductions per visitor, and how well partners understand the reward?
Unit and allocationFirst-time visitors to the referral landing page, randomized in equal thirds; assignment sticks for 90 days, matching the attribution window
ExclusionsStaff and known bots, removed before assignment; nothing removed after assignment
Entry windowA fixed period set in advance, for example ten weeks
Primary outcomeQualified introductions per 1,000 assigned visitors at the cutoff
Secondary outcomesRegistrations per 1,000 visitors; introductions per registered partner; share of introductions failing the 50-employee test; duplicates; comprehension score
CutoffOne date, for example 150 days after the entry window closes, chosen to cover the 90-day window plus review time
AnalysisBy assigned arm (intention to treat); each arm against control with a 95% interval; Holm correction for the two comparisons
StoppingFixed duration; no stopping early because a result looks good
PreregistrationThis table, the analysis code and the launch date published before the first visitor

Consent and comprehension. After registering, partners are offered an optional three-question check, with consent asked first and answers stored against the arm, not against any company. Skipping is recorded as missing, not as wrong. The questions:

  1. The reward is calculated on (a) what SourceX actually pays the referred company, (b) SourceX's fees, (c) the buyer's price. Correct: (a).
  2. A reward becomes payable after (a) a meeting, (b) a signed agreement, (c) conditions that include the company being paid. Correct: (c).
  3. The $1,500,000+ figure is (a) the typical reward, (b) an illustration of what the uncapped program can pay, not a typical result, (c) a minimum. Correct: (b).

Nobody is deceived by the design: every arm describes the same terms, and every partner sees the same terms after registering, whichever headline they saw.

Complete outcomes, including the cases that went nowhere

The result is the whole table, per arm, at the cutoff. A study that reports only the winning ratio hides the cases that explain it. This shell is the reusable part: copy it, fill it, publish it with the cutoff date.

Count at cutoffArm AArm BArm C
Visitors assignedNot yet collectedNot yet collectedNot yet collected
Registered, never introduced a companyNot yet collectedNot yet collectedNot yet collected
Introductions submittedNot yet collectedNot yet collectedNot yet collected
Duplicates or outside the attribution windowNot yet collectedNot yet collectedNot yet collected
Verified applicationsNot yet collectedNot yet collectedNot yet collected
Passed eligibility reviewNot yet collectedNot yet collectedNot yet collected
Declined in reviewNot yet collectedNot yet collectedNot yet collected
Withdrawn by the companyNot yet collectedNot yet collectedNot yet collected
Still openNot yet collectedNot yet collectedNot yet collected
Comprehension check skipped or declinedNot yet collectedNot yet collectedNot yet collected

Two reporting rules. First, open cases stay in the denominator and the result is shown as a range they allow, as the conversion benchmark method sets out. Second, only the prespecified comparisons between arms are causal. Cuts by partner role, traffic source or company size are descriptive, labeled as such, and never used to declare a winner. Decline reasons belong in the separate rejection reasons study.

How many visitors the test needs

Illustrative inputs, invented to show the arithmetic; SourceX has published no conversion rates. Suppose the control arm produced 4 qualified introductions per 1,000 visitors and you wanted to detect an arm producing 6. With two-sided 5% significance and 80% power, the standard two-proportion formula gives about 19,500 visitors per arm, roughly 58,600 across three arms, before the correction for two comparisons. Halve the baseline rate and the requirement roughly doubles.

That arithmetic is the most important stress test in the design. If the site cannot reach the required traffic in the entry window, the primary outcome will be underpowered, and an honest preregistration says so in advance: report qualified introductions descriptively, with intervals, and power the test on comprehension, which every registering partner can answer. A small test that announces a winner on four qualified introductions is worse than no test.

Stress test: a counterexample, the limits and what would change the answer

The counterexample, as a question. Could removing the headline figure lose the partners who matter most? A PE operating partner with access to thousand-person portfolio companies may register precisely because one introduction could be worth the effort, while a partner with a small network may respond better to arm C's fit-first framing. If arm C produces fewer registrations but the same qualified introductions, the headline figure mostly attracted poor fit. If arm C produces fewer qualified introductions, the headline figure carries real signal for high-value introducers. The design can tell these apart; intuition cannot.

Limits.

  • Contamination. Partners copy headline wording into emails and posts, so visitors may meet another arm's message off the page. Record the referrer of each visit and report the share arriving from partner-shared links.
  • Traffic mix. A newsletter mention in week three changes who arrives. Randomization protects the comparison, not how far it generalizes.
  • Missing assignment. Visitors who return on a new device may be counted twice; report the estimated share.
  • Time. Qualified introductions take months; the cutoff is a compromise between speed and completeness.
  • One program. A result on refer.sourcex.si says little about other programs with different terms.

Disclosure travels with the wording. The FTC's endorsement guidance says affiliate relationships should be disclosed close to the links, treats "Paid link" as adequate and "Commissionable link" as probably not clear, and expects companies running affiliate networks to tell affiliates how to disclose. Whichever arm wins, partners who reuse its wording still disclose that they may earn a reward; see whether you have to disclose a referral fee.

Decision rule, fixed in advance.

ResultDecision
A matches or beats B and C on qualified introductions, and question 3 scores are no worseKeep the current headline
B or C matches or beats A on qualified introductions, with better question 3 scoresPropose the new headline to the owner
Intervals overlap on every outcomeInconclusive; keep the current block and say so
Registrations fall but qualified introductions do notReport that the headline figure mostly attracted poor-fit registrations

Changing the live offer block is the owner's decision. It stays on every page until a study like this has been run, published and reviewed.

A measurable next step. Before any split test, add only the three-question check to the current page for a set period. If nearly every registering partner already answers question 3 correctly, the headline matters less than this page assumes; if many answer (a), the test is worth its traffic.

Which introductions count as qualified

The eligibility pass in the primary outcome is SourceX's, applied to the published fit facts: a peak of 50+ full-time employees, not counting contractors; an operating history backed by documents; rights to license the records; and an authorized contact, the CEO, who wants the conversation. Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 70% of the data is in English.

Partners never handle a company's records; discovery stays at metadata level (which records, how many, how many years, which system, who administers it). What stays unknown until SourceX reviews a company: whether its records match current demand, what the rights review finds and what any license would cover. Paid handoffs are a follow-up outcome rather than the primary one: payment is due 60 calendar days from whichever is later, completed handoff or the day the Acquisition Partner gives its final written acceptance of the complete, validated dataset, and both events land far beyond any page test's cutoff. Estimates from the referral earnings calculator are projections, not promises, and the expected earnings worksheet asks you to supply your own odds rather than borrow a headline.

Next step

Refer a company. No cap on rewards. Default reward on a company's first qualifying transaction: the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no cap; further qualifying transactions first agreed within 12 months of the first Closing pay 15%. Eligibility and payment conditions apply, including the USD 100,000 Minimum Transaction, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

Read past the headline before you introduce anyone: open a partner account, measure the company against the qualifying criteria and work through the full program terms, so that your own introductions would count as qualified in any study of this page. Related methods sit in the guides hub.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardthe greater of $50,000 plus 5% and 15% of the actual supplier payout, with no cap. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Is a headline that says 'Earn $1,500,000+' misleading?

It states a figure, not a typical result, and the standard offer block gives the formula and the payment conditions in the same paragraph. Whether readers still take the figure as typical is exactly what the comprehension measure in this study tests; FTC research on consumer 'up to' claims shows the risk is real in other settings.

Why not judge the headline on clicks or registrations?

Because the program pays on completed, paid data handoffs, not on visits or sign-ups. A headline can raise registrations while lowering the share of introductions that qualify, so the primary outcome here is an introduction that reaches a verified application and passes eligibility review.

When will the headline test publish its results?

SourceX has not announced a date, and no study has been run. This page is the proposed design; if it runs, every arm's denominators, including declined, withdrawn and still-open cases, would be published with the result.

Sources

  1. refer.sourcex.si/terms
  2. refer.sourcex.si/who-qualifies
  3. ftc.gov/news-events/news/press-releases/2012/06/ftc-…
  4. ftc.gov/reports/effects-bristol-windows-advertisemen…
  5. ftc.gov/business-guidance/resources/ftcs-endorsement…
  6. partnerstack.com/resources/research-lab/charts/multi-touch-is…

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 70% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment