Private data for model evaluation

Evaluations only measure what they claim if the model hasn’t seen the test data. Private enterprise data isn’t on the public web, so it’s far less likely to be in training sets, and the license can limit use to evaluation. It gives labs held-out material in real domains: private code, support tickets, contracts, finance work and internal documentation.

Last updated October 3, 2026

Request data

Why enterprise data

Public benchmarks leak into training data over time. Private company records aren’t on the open web, though a supplier may have licensed the same data before, so ask about earlier licenses.

Business records come with answers already attached: the resolution, the merged fix, the signed-off reconciliation, the clause that was agreed. That makes grading possible without writing every answer by hand.

Relevant data

Data	Category	Modality	Availability
Private codebases with full commit history Proprietary repositories with every commit, branch and tag, plus build and test setup.	Software engineering	Code	On request
Pull requests with code review threads Diffs, review comments, requested changes, approvals and CI results for each change.	Software engineering	Code and text	On request
Helpdesk ticket threads with resolutions Multi-turn tickets with internal notes, tags, status history and the final resolution.	Customer support	Text with structured metadata	On request
Executed commercial contracts with clause data Signed agreements with extracted clauses, key dates and obligations.	Legal and compliance	Documents and structured data	On request
Month-end close checklists, reconciliations and workpapers Close task lists, account reconciliations, journal entries and reviewer sign-offs.	Finance and accounting	Spreadsheets and structured data	On request
Internal wikis and knowledge bases Team wikis, internal help centers and decision records with links and edit history.	Documents and knowledge	Documents	On request
Incident, on-call and postmortem records Alerts, incident timelines, responder chat and the postmortems that followed.	Software engineering	Text and logs	On request

What to include in your request

Whether the data must stay out of all training (evaluation-only license)
How many items you need and how you will grade them
Domains, languages and time ranges
Exclusivity, if no other buyer may license the same snapshot

Questions

Can I license data for evaluation only?

Yes. Permitted use is set per agreement, and evaluation-only use can be specified.

Can I get exclusive rights to an evaluation set?

Exclusivity can be agreed for a dataset snapshot.

Need this data for a model?

Describe what you need: domain, volume, history, format and licensing terms. SourceX looks for companies that hold it and can license it.

Request data Talk to SourceX