Enterprise exception handling training data: a six-class taxonomy tied to the records that prove each case

Short answer

Exception histories matter because an evaluation is only as hard as its hardest cases. Routine invoices, orders and tickets show that an agent can follow a rule; exceptions show whether it knows when the rule does not fit, who may authorize a departure, and how to confirm the fix worked. The useful unit is a chain of three records: the initial problem, the authorized action and the checked result. The taxonomy below sorts exceptions into six classes by what breaks.

Visual briefFull-size diagram
A taxonomy tree grows from one root, an exception, into six classes: rule conflict, missing input, out of tolerance, duplicate or mismatch, authority gap and deadline breach; each class then sprouts two leaves naming its authorized action record and its checked result record.
Illustrative taxonomy. Class names and record types are generic; no company's records are shown.

This page is a companion to exception handling records for AI agents, which works through entitlement, promotion and cold-chain cases. Here the job is different: a reusable classification a partner can carry into an unfamiliar business to recognize which exceptions it records, and whether each one leaves the full chain.

Why the hard cases carry the evaluation

A test made only of routine cases rewards an agent that memorizes the happy path. Most real operational cost sits elsewhere: the invoice that does not match its purchase order, the shipment that arrives out of range, the approval nobody with authority was around to give. Those are the moments when a person had to judge, act within limits and check the result.

That is also what the agent-data market says it wants, though no announcement proves demand for a particular company. On 2026-10-09 micro1 announced a commitment to spend $1 billion over 12 months acquiring enterprise operational data, saying it helps agents learn to navigate workflows and make decisions. Appen's agentic AI page (checked 2026-10-18) lists golden trajectories and failure-mode taxonomies among its services. A failure-mode taxonomy describes how agents go wrong; an exception taxonomy describes how businesses already went wrong and recovered, with records. The second is what a company can license.

The six-class exception taxonomy

Each class is defined by what breaks, not by industry. The two right-hand columns name the record that must exist for the case to be usable.

ClassWhat breaksTypical triggerAuthorized action recorded asChecked result recorded as
Rule conflictTwo valid rules give different answersA legacy contract term contradicts the current price listOverride with a named approver and reasonCorrected invoice, balance or entitlement after the fix
Missing inputA required document or reading is absentA delivery arrives without its certificateHold, or a substitute source with sign-offRelease, rejection or recovery once the input arrives
Out of toleranceA measured value leaves its allowed rangeA temperature, weight or dimension outside specDisposition with written reasoningInspection, test or customer acceptance
Duplicate or mismatchTwo records claim the same thingTwo invoices for one delivery; a customer with two accountsMerge, void or correction citing both recordsReconciliation that closes with no residual
Authority gapThe person allowed to decide is unavailable or the limit is exceededA refund above a clerk's limit with no manager on shiftEscalation or delegated approval with its own recordPost-review confirming or reversing the decision
Deadline breachA time commitment is missedA service-level clock or filing deadline expiresDocumented remedy: credit, waiver, expediteCustomer response, penalty applied or waived

Platforms already capture parts of this. Salesforce's classic approval history, for example, shows statuses including Submitted, Approved, Rejected, Reassigned and Recalled, along with the actual approver, which is the "authorized action" column for an authority gap. Regulated industries make some chains mandatory: under U.S. drug manufacturing rules, any unexplained discrepancy must be thoroughly investigated, extended to associated batches, and written up with conclusions and follow-up, which records the action and result for out-of-tolerance and mismatch cases.

Reading the taxonomy in an unfamiliar business (Illustrative)

The classes are generic on purpose. One fictional example per class shows how they map to different companies:

  • Rule conflict. A 400-person B2B software company merges an acquired customer base; some accounts carry legacy features their new plan excludes. Support grants an exception with a named approver.
  • Missing input. A 320-person building materials distributor receives steel without mill certificates. The yard holds the load; quality releases it when the certificate arrives two days later.
  • Out of tolerance. A 250-person pharmaceutical distributor's pallet reads above range after a truck transfer. Quality reviews stability data and decides per lot; the temperature excursion worked case walks through it step by step.
  • Duplicate or mismatch. A 600-person facilities services firm receives two invoices for one job. Accounts payable voids one, citing both; the vendor statement then reconciles. See accounts payable exception handling.
  • Authority gap. A 180-person clinic group needs a write-off above the billing lead's limit on a weekend. The on-call director approves by delegated authority; Monday's review confirms it.
  • Deadline breach. A 900-person managed IT provider misses a four-hour response commitment. The account manager issues a service credit; the client's renewal notes record acceptance.

When a partner hears a story like one of these, the follow-up is the same: does each of the three records exist, in which system, for how many years, and can the three be linked?

When a case falls short of the full chain

The taxonomy also makes gaps easy to name. Three shortfalls recur across classes:

  1. Problem without action. The alert or complaint is logged, but the decision was made by phone and never written down. Common in authority gaps.
  2. Action without approver. The override exists, but under a shared login or a generic "admin" account. Common in rule conflicts and duplicates.
  3. Action without result. The fix is recorded, but nobody linked it to what happened next. Common in deadline breaches, where the customer's reaction sits in email.

A class with only the first two records can still teach how people respond. It cannot show whether the response was right, which is what evaluation needs most.

Qualification: records, owners and authority

Exception records usually span systems owned by different teams: operations or quality for the problem, the approving function for the action, finance or customer success for the result. The decision to discuss licensing belongs to the CEO, often with the COO or CFO preparing the case, not to whoever administers the systems. Customer and supplier contracts, personal data in notes, and regulated records all affect what can be licensed; see why data rights matter.

The company needs 50+ full-time employees at peak (contractors excluded), documented operating history, rights to license and an authorized contact. Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 70% of the data is in English.

Partners establish metadata only: which exception classes the company sees often, which system records each link, how many years exist, and who owns them. Volumes, buyer interest, de-identification and any offer stay unknown until SourceX reviews the opportunity. For context on why operational records are sought, see why enterprise AI needs enterprise data, why operations data is valuable and vertical AI training data.

Next step

Refer a company. No cap on rewards. Default reward on a company's first qualifying transaction: the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no cap; further qualifying transactions first agreed within 12 months of the first Closing pay 15%. Eligibility and payment conditions apply, including the USD 100,000 Minimum Transaction, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

If a client can name two or more exception classes it records with all three links over several years, register as a partner, check who qualifies, and read the terms before you introduce the CEO.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardthe greater of $50,000 plus 5% and 15% of the actual supplier payout, with no cap. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Are exceptions more valuable than routine records?

For evaluation, usually yes, because routine cases rarely separate a capable agent from a weak one. Routine records still matter as context: an exception only makes sense next to the rule it broke.

Does every exception class need all three records?

Yes, for the case to be fully usable: the problem, the authorized action and the checked result. A class where the result is never recorded can still describe how people respond, but cannot show whether the response was right.

Does micro1's announcement mean exception data will sell?

No. It is a dated company announcement of planned spending. It shows operational data is being sought in the market, not that any company's records will be bought or at what price.

Sources

  1. micro1.ai/blog/micro1-commits-1b-to-enterprise-data-ac…
  2. appen.com/agentic-ai
  3. help.salesforce.com/s/articleView
  4. ecfr.gov/current/title-21/chapter-I/subchapter-C/part…
  5. refer.sourcex.si/terms

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 70% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment