Assessment appeal resolution records: how a company shows the way an exception was handled

Short answer

The records that explain an appeal are the ones that show the problem, the authorized action and the checked result: the candidate's response, the rubric version in force, the first and second markers' scores and comments, the appeal grounds, the panel decision with its reasoning, and any rubric change that followed. Together they show how a valid answer outside the original rubric was handled. An assessment systems advisor asks the head of academic operations about them at metadata level, then introduces the executive who can authorize a licensing discussion.

Visual briefFull-size diagram
Two swimlanes, assessment platform and case manager, trace one appeal from a criterion scored 2 of 4 under rubric v4 to a panel decision of 4 of 4 and a rubric v5, with the rubric, marker comments and panel reasoning marked as the exception record.
Illustrative: a fictional certification body's appeal. The records in between explain why the mark changed.

Which assessment appeal resolution records help a company explain how exceptions were handled?

The records that show the original mark, the evidence the candidate produced, the criteria in force at the time, and the reasoning that changed or upheld the mark. The hardest exception to explain later is a valid answer that falls outside the original rubric, because the rubric itself is what changed.

Regulated awarding bodies already work to a test that names those three inputs. Ofqual defines a Marking Error as a mark that could not reasonably have been awarded given the evidence generated by the learner, the criteria used to differentiate performance and the awarding organization's marking procedures. An appeal history is only explainable if all three survive: the candidate's response, the rubric version and the procedure.

Illustrative worked example: a fictional 180-person professional certification body, not a real case or a completed deal. Candidates write a case-study answer scored on a four-criterion analytic rubric, each criterion worth up to 4 points, 16 in total, with 12 needed to pass. As in Moodle's rubric model, the raw score is the sum of the level chosen for each criterion.

A candidate answers the costing question with an activity-based method. Criterion 3 in rubric v4 describes only the standard-costing approach, so the first marker scores it 2 of 4 and the candidate totals 11. The candidate appeals.

DateEventSystemRecord kept
Mar 3Exam sat; response storedAssessment platformCandidate response, timestamped
Apr 14Result released: 11 of 16, criterion 3 scored 2Assessment platformRubric v4 scores and first-marker comment
Apr 20Appeal filed: method is valid but not in the rubricCase managerAppeal form, grounds, case ID
May 2Second marker reviews blindAssessment platformSecond-marker scores and comment
May 16Panel accepts the method as valid; criterion 3 rescored 4Case managerPanel minute citing the marking procedure
May 20Result reissued: 13 of 16, passAssessment platformRevised score with audit entry
Jun 1Rubric v5 adds "any recognized costing method" to criterion 3Content repositoryNew rubric version and change note

The useful unit is not the final 13. It is the chain from the gap in rubric v4 to the panel's reasoning to the rubric change. An AI system trained or evaluated on records like these learns what a fair reviewer does when the rules did not anticipate a correct answer, the kind of judgment that benchmarks of real work try to measure; see what GDPval is. The same pattern appears outside education, as in documented logistics exceptions and quality scoring disagreements.

Map rubrics, reviewer comments and appeal outcomes to the exception

Each record answers one part of the exception: what went wrong, what was done about it, and whether the result held. If any column is missing, the appeal can still be closed, but it can no longer be explained.

RecordPart of the exception it showsWhat makes it usefulWhat weakens it
Candidate responseThe evidence the candidate producedStored as submitted, with a timestampOnly the final mark survives
Rubric version with effective datesThe criteria in force at the timeEach version kept, not overwrittenOnly the current rubric is stored
First-marker scores and commentThe original judgment and its reasonScore per criterion plus a written noteA total with no comment
Appeal groundsThe candidate's claimLinked to the criterion in disputeFree text with no criterion reference
Second-marker reviewAn independent checkBlind, with its own scores and noteOverwrites the first score
Panel decisionThe authorized action and its reasoningCites the marking procedure appliedRecords only "upheld" or "changed"
Revised result and audit entryThe checked outcomeShows who changed the mark and whenSilent edit to the score
Rubric change noteThe lesson carried forwardNames the appeal or issue that prompted itChange with no reason

Two features separate a strong appeal history from a weak one. First, versions: the panel's reasoning only makes sense against the rubric the first marker used, so a system that overwrites rubrics loses the exception. Second, links: the appeal, the second review and the rubric change need a shared case or candidate reference, or someone has to rebuild the chain by hand.

Ask the academic operations head about coverage and rights

The head of academic operations usually knows which of these records exist, in which systems and for how many years. Ask at metadata level only: which record types, rough appeal volumes a year, the years covered, which platforms and case tools hold them, and who owns them. Never ask for appeal files, candidate responses or marker comments.

Rights need care. Appeal records are about identifiable candidates. Where U.S. student-privacy law applies, FERPA lets a parent or eligible student ask a school to amend records believed inaccurate or misleading, and a refusal must come with notice of a right to a hearing; FERPA also generally requires signed, dated written consent, naming the records, purpose and recipients, before personally identifiable information from education records is disclosed. Whether rules like these, candidate terms or other laws govern a particular company's records is a question for its counsel and for SourceX's rights review. A professional certification body or training company is a different case from a school, and the partner's job is only to find the person who can decide.

The introduced company needs 50+ full-time employees at peak (contractors excluded), a documented operating history, rights to license the records, and an authorized contact. Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 70% of the data is in English. See who qualifies, the industries hub and education and training. For background on rights and record reviews, see why data rights matter and what a data audit is.

Until SourceX reviews it, nobody knows whether buyers want appeal histories, what rights review concludes about candidate terms and privacy law, how much de-identification is needed, or whether an offer follows. Partners sign the Channel Partner Agreement before submitting introductions; the first valid introduction within the 90-day window is credited when the company submits a verified application.

Go deeper on assessment appeal resolution

Next step

Refer a company. No cap on rewards. Default reward on a company's first qualifying transaction: the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no cap; further qualifying transactions first agreed within 12 months of the first Closing pay 15%. Eligibility and payment conditions apply, including the USD 100,000 Minimum Transaction, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

If a client can trace its appeals from rubric gap to panel reasoning to rubric change, register as a partner, check the company against who qualifies, and read the program terms before you brief the head of academic operations.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardthe greater of $50,000 plus 5% and 15% of the actual supplier payout, with no cap. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Is an appeal record different from an ordinary grade record?

Yes. A grade record holds the final mark. An appeal record holds the argument: what the candidate claimed, which criterion was in question, what a second reviewer saw and why the panel decided as it did. The argument is the part a platform migration is least likely to carry.

Does the company need to collect candidate consent before talking to SourceX?

Not for a first conversation, which stays at metadata level and involves no candidate records. Whether consent, de-identification or other conditions apply to any later licensing depends on the laws and contracts that govern the records, and SourceX's rights review addresses that before anything moves.

Can a school district be introduced?

The program is built for companies: 50+ full-time employees at peak, documented operating history, rights to license and an authorized contact. Public bodies and records held under student-privacy law raise separate questions, so check who qualifies before you raise it.

Sources

  1. refer.sourcex.si/terms
  2. gov.uk/guidance/ofqual-handbook-technical-qualifica…
  3. docs.moodle.org/402/en/Rubric
  4. ecfr.gov/current/title-34/subtitle-A/part-99/subpart-…
  5. govinfo.gov/content/pkg/CFR-2023-title34-vol1/pdf/CFR-20…

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 70% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment