Quality scoring disagreements system map: which system holds each record and which key joins them

Short answer

Rebuilding a quality scoring disagreement takes four joins: the contact center's interaction ID stored on each evaluation, the snippet timestamps that place reviewer comments on the recording, reviewer and adjudicator IDs that survive staff turnover, and the form version in force on the session date. A fifth link, from the interaction to the customer account, brings in the context a ruling may depend on. With those keys, one split decision can be followed from the call to the ruling to the changed form.

Visual briefFull-size diagram
Four system nodes, the contact center suite, QA platform, CRM and form library, with linking keys (interaction ID, snippet timestamps, account ID and form version) travelling along the connectors until one disputed case is joined in the center.
Illustrative. Real key names and coverage depend on each company's systems.

This map is part of the quality scoring disagreements guide, which covers the inventory before a QA vendor change. It does a narrower job: show which system holds what and which key gets you from one to the next.

Four systems and what each one knows

No single platform holds a full disagreement. Each system sees one slice.

  • Contact center suite. The interaction itself: recording, transcript where enabled, agent, queue, timestamps. It knows nothing about scores.
  • QA platform. Evaluations, calibration sessions, comments, adjudication notes, corrected scores and usually the forms. In Genesys Cloud, for instance, a calibration session bundles evaluations of a single interaction by several evaluators and flags one of them as the scoring index. The QA platform knows the judgment, not the context.
  • CRM or account system. Account notes, approvals recorded against the customer, case history. It often holds the fact a ruling turned on.
  • Form library or settings history. The wording of each scoring item on each date. Sometimes inside the QA platform, sometimes only in a document someone kept.

The linking-key table

The evidence asset for this page: each record, the system that holds it, the key that joins it to the next, and who usually owns it.

SystemRecordLinking keyTypical owner
Contact center suiteRecording and interaction metadataInteraction IDIT or contact center operations
QA platformEvaluation with item scores and commentsInteraction ID; evaluation IDQuality director
QA platformSnippet citation in a commentStart and end timestamps against the recordingQuality director
QA platformCalibration sessionSession ID; evaluation IDs; scoring indexQA calibration lead
QA platform or emailAdjudication noteSession ID or evaluation IDQA calibration lead
Form libraryForm versionForm ID and version dateQuality director
CRMAccount note or approvalAccount ID reached from the interactionCustomer service operations
DirectoryReviewer and agent identitiesEmployee or user IDHR and IT

One fully joined case (Illustrative)

A fictional 420-person home warranty contact center; every ID and date is invented. This case is different from the over-limit credit in the worked example: here the agent, not a second reviewer, raised the dispute.

  1. Evaluation E-60318 in the QA platform marks interaction 88-51904 as a fail on the "hold etiquette" item: the reviewer's comment says the customer sat silent for almost a minute without a check-back.
  2. Agent dispute. The agent contests the score through the platform's dispute queue, saying the hold was a warm transfer to the claims team.
  3. Interaction ID to the suite. 88-51904 opens the interaction record in the contact center suite. Its event log shows a consult at 04:10 and a transfer at 05:05, not a hold.
  4. Calibration session CS-2307. Two more reviewers score the call. Both mark the item as not applicable, citing the same 04:10 to 05:05 segment.
  5. Ruling. The QA lead overturns the fail: consult time before a warm transfer is not hold time. The ruling is written on the session.
  6. Form version 8, dated two weeks later, adds a line to the item's guidance separating consults from holds.

Here the explaining record is not a CRM note but the suite's own event log. Without the interaction ID on the evaluation, the dispute would read as an agent's word against a reviewer's. The worked exception example follows a split between two reviewers instead; together the two cases show why both the suite and the CRM links matter.

Where joins usually break

Each break below is named by the key that fails and what the joined case from the previous section would lose if it did.

Failing keyHow it happensWhat case E-60318 would lose
Interaction IDEvaluations were imported into a QA tool that kept only its own evaluation numberStep 3: the event log showing a consult and transfer, so the dispute becomes one person's word against another's
Snippet timestampsThe suite purges audio on a shorter clock than the QA platform purges evaluationsStep 4: the 04:10 to 05:05 segment both reviewers cited no longer plays
Reviewer and adjudicator IDsUser accounts are deleted when staff leaveSteps 1 and 5: who failed the call and who overturned it
Form ID and version dateThe item guidance is edited in place with no dated copyStep 6: proof that version 8 changed the rule, rather than the reviewers changing their minds
Session ID on the rulingThe overturn was agreed in a mailbox threadStep 5: the session shows a split with no recorded outcome
Account IDAccount notes live in a CRM the QA team never reachesNothing in this case, but the over-limit credit in the worked example would lose its explanation

The form row deserves a second look. McHugh's review of the kappa statistic treats interrater reliability as different raters scoring the same variables; when the wording of an item shifts between two dates, an apparent disagreement across those dates may only reflect the edit. The recordings row is covered from the retention side in the guide to recordings at platform retirement.

Questions for the quality director

Score each join pass, partial or unknown, from the director's own knowledge.

JoinQuestionAnswer format
Evaluation to recordingDoes each evaluation store the suite's interaction ID?Pass, partial, unknown
Comment to snippetDo comments cite timestamps, and do recordings still exist for those years?Years with both
Session to rulingIs the adjudication written on the session, or elsewhere?Platform, email, none
Score to rulebookAre form versions kept with dates?Yes, partly, no
Interaction to accountCan the account be reached from the interaction?Pass, partial, unknown

The data readiness survey gives the company a wider format for the same self-assessment, and the AI use case prioritization framework helps a client place this record set among other candidates.

The quality director knows the joins; the CEO decides whether to discuss licensing, often with the COO, CFO or general counsel advising. The introduced company needs 50+ full-time employees at peak (contractors excluded), a documented operating history, rights to license and an authorized contact. Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 90% of the data is in English. Buyer interest, the rights position on recordings and any offer stay unknown until SourceX's review. Partners sign the Channel Partner Agreement before submitting; the first valid introduction within the 90-day window is credited when the company submits a verified application. Records of this shape are what make exception handling data useful.

Next step

Refer a company. Earn up to $100,000. Default reward: 25% of Actual Supplier Payout, capped at $100,000 cumulatively per referred company. Eligibility and payment conditions apply, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

If the quality director can mark most joins as pass for several years of calibration, register as a partner, check the company on who qualifies and read the program terms, then fill in the referral brief template.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardYour 25% of the actual supplier payout. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Is the QA platform's own evaluation ID enough to join everything?

No. It joins records inside the QA platform. To reach the recording and the account note, the evaluation must also store the contact center's interaction ID, and the customer's account ID must be reachable from that interaction.

What if form versions were never kept?

Then old scores can still be read, but not always interpreted, because the wording of each item may have changed. A dated log of form changes, even an informal one, recovers much of that meaning.

Can a consultant test the joins on a sample?

The company's own QA administrator can, on its own systems, and report pass or fail. Partners never pull or receive the sample.

Sources

  1. help.mypurecloud.com
  2. pmc.ncbi.nlm.nih.gov/articles/PMC3900052
  3. refer.sourcex.si/terms

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 90% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment