Appeal-to-course-correction completeness scorecard: six metadata checks for identifiers, releases, propagation, regrading, timing and outcomes

Short answer

An appeal-to-course-correction trail breaks in six ways: no shared reference number between the help desk ticket, the panel decision and the scoring-guide change; releases that are implied rather than labeled; delivery copies that never receive the update; earlier marks left alone with no note of that choice; a panel decision written up after the change it justified; and nobody checking whether challenges fell afterward. This scorecard turns each into one plain question, marked pass, partial or fail, so a partner can grade the trail without seeing a ticket or a mark.

Visual briefFull-size diagram
Six scorecard tiles (identifier, release, propagation, regrading, timing, outcome) turn green, blue or orange one after another while a horizontal meter underneath fills to 6 of 12.
Illustrative score for a fictional language-teaching company. Each tile is answered by a question, not by opening a record.

It is part of the appeal-to-course-correction records guide. The record chain page explains the identifiers this scorecard tests.

Scoring rules

Each check earns 2 points for a pass, 1 for a partial and 0 for a fail, so the maximum is 12. Score with the assessment lead and the person who maintains course templates together; each knows half the answers.

  • Pass means the practice holds across the years in scope and someone can name when it started.
  • Partial means it holds for some programs, some years or some teams.
  • Fail means it does not hold, or no one can say. Unknown is a fail with a name beside it for who could find out.

Write the starting year beside every pass and partial. A practice that has held since 2023 and one that has held since 2017 are very different descriptions, even with identical points.

The scorecard

CheckMetadata questionPassPartialFail
1. IdentifierStarting from a scoring-guide change, can staff trace back to the panel decision and ticket behind it?Ticket number on the panel decision, panel decision number on the changeOne of the two references existsNeither; challenges retyped, changes unreferenced
2. ReleaseIs the course release named both in the panel decision and in the change?Named in bothNamed in oneTitle only; release guessed from dates
3. PropagationAfter a change, how do staff know each delivery copy received it?Guides locked in templates; push exceptions reviewedLocked in some programsUnknown; copies edited freely
4. RegradingWhen a criterion changes, are earlier marks revisited, and is that choice written down?Flag or register records itRecorded for major changes onlyNever recorded either way
5. TimingIs the panel decision a dated system entry made before the change?System entry, dated firstDated meeting minutesWritten up afterward, or not at all
6. OutcomeAre challenges counted per criterion after an update?Counted by criterion over timeCounted per course onlyNot counted

Checks 1 and 2 decide whether the trail can be joined at all. Checks 3 and 4 decide whether the fix's reach can be described. Checks 5 and 6 decide whether the order of events and the result can be trusted.

Some notes on scoring specific checks:

Check 1. In Zendesk, ticket audits are a read-only history of every update, so the ticket side of the link usually survives. The question is whether the appeal record carries the ticket ID, which depends on the appeal form, not the support desk.

Check 3. Instructure's documentation says a Canvas blueprint sync overwrites locked objects in associated courses, while unlocked items are left to instructors, later syncs are manual, and edits made in an associated course before a sync can produce exceptions. A company that locks rubrics and reviews sync exceptions can pass; one that leaves rubrics unlocked cannot know without comparing copies.

Check 4. Moodle's documentation describes a platform-level answer: after a significant grading form change, existing assessments may be flagged "Needs review" for re-assessment against the new version. A company using a feature like that has a recorded re-review; a company that edits rubrics in place usually does not. Ask which describes the client, and from which year.

The wrong-version test

Run one scenario through checks 2 and 4 before you total the card. Illustrative: an appeal from the March intake of a spoken-English course is upheld because the fluency band descriptor is vague; the curriculum team rewrites the descriptor in the September template; March speaking scores are left as they were.

Ask the client: "In a case like that, would your records show the fix went to September on purpose, and that March scores were deliberately left?" Three answers are possible, and they score differently:

Client's answerCheck 2Check 4How to describe it
Both versions are named, and the decision to leave past grades is loggedPassPassA recorded policy choice
Versions are named, but the re-review decision is not written downPassFailTraceable fix, unknown follow-up
Only course names appear, and nothing records the choiceFailFailCannot tell decision from oversight

The third answer is common and still describable. What matters is that the description says so plainly rather than implying a clean trail.

A scored example and what the total means (Illustrative)

A fictional 520-person language-teaching company, scored with its head of assessment and curriculum director.

CheckMarkPointsNote
1. IdentifierPartial1Ticket ID on appeals since 2022; edits unreferenced
2. ReleasePartial1Cohort code on appeals; edits name the blueprint only
3. PropagationPartial1Rubrics locked in two of five programs
4. RegradingFail0No record either way
5. TimingPass2Panel decisions are dated system records
6. OutcomePartial1Tracked per course, not per criterion
TotalSum of points6 of 12Joinable from 2022 with known gaps

Only one check passes outright, and that is fine. Five honest marks with years beside them say more than a confident total. The one-line description for a reviewer: "Appeals and decisions joinable from 2022; rubric edits not tied to appeals; reach of fixes known only for locked programs; no re-review record." The ERP replacement handoff checklist shows the same habit of stating gaps before a migration removes them.

Who answers, and what the score leaves open

The head of assessment answers checks 1, 4, 5 and 6; the curriculum director or LMS administrator answers 2 and 3. The CEO, usually the owner in an owner-run company, authorizes a licensing discussion; a COO or chief academic officer may sponsor it internally. The education screening worksheet helps confirm fit.

The company needs 50+ full-time employees at peak (contractors excluded, which usually includes freelance instructors), documented operating history, rights to license its curriculum and rubrics, and an authorized contact. Companies in the U.S., Canada and the EU qualify, as do companies in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia when at least 70% of the data is in English.

The score leaves open how learner identities would be removed, whether student-record rules apply (the FERPA vendor data use guide covers U.S. schools), whether a buyer wants this history, and what the company would be paid. SourceX settles those under the company's agreement. Partners never handle learner work, appeal letters or grades.

Next step

Refer a company. No cap on rewards. Default reward on a company's first qualifying transaction: the greater of $50,000 plus 5% and 15% of Actual Supplier Payout, with no cap; further qualifying transactions first agreed within 12 months of the first Closing pay 15%. Eligibility and payment conditions apply, including the USD 100,000 Minimum Transaction, and a signed Schedule A or addendum can differ. A lead, meeting or signature alone does not trigger payment.

If the scorecard shows a trail the client can describe honestly, wrong-version cases included, register as a partner, check who qualifies, and read the terms before you introduce the sponsor.

  1. Step 1Share your linkSend your personal link to a company you know.
  2. Step 2Company appliesThe company applies itself at /apply.
  3. Step 3Company signs and is paidThe company signs, delivers its data and is paid by SourceX under its agreement.
  4. Step 4You get your rewardthe greater of $50,000 plus 5% and 15% of the actual supplier payout, with no cap. A reward becomes payable after SourceX has paid the referred company under its signed agreement and the payout conditions in the program terms are met, including finance approval and your tax and payment details.

Common questions

Is fixing the next cohort instead of the appealing one always a fail?

No. Changing future runs and leaving past grades alone can be a sound policy. It scores a fail only when nobody recorded that choice, so a later reader cannot tell a decision from an oversight.

What if the company uses no blueprints at all?

Score the propagation check on how a rubric change reaches each live course. If every course is edited by hand, ask whether anyone records which courses were updated; if not, mark it partial or fail.

Can the score be shared with SourceX?

Yes, once the company agrees to an introduction. The scorecard describes configuration and habits, not learner records, so it can travel with the introduction as long as it contains no names, grades or appeal text.

Sources

  1. community.instructure.com/en/kb/articles/628548-blueprint-sync-functio…
  2. docs.moodle.org/36/en/Advanced_grading_methods
  3. developer.zendesk.com/api-reference/ticketing/tickets/ticket_audits
  4. refer.sourcex.si/terms

Free resources

Know a company with valuable proprietary data?

Become a referral partner, get your link and introduce the company’s CEO (in an owner-run company, usually the owner). Referral partners can join from most countries. We can't work with partners in countries or regions under U.S. sanctions or on U.S. restricted-party lists. The companies you introduce should be based in the U.S., Canada and the EU, or in the UK, Australia, New Zealand, India, Singapore, South Africa, Latin America, the UAE and Saudi Arabia with at least 70% of their data in English.

Refer a company →

I own a business

Explore licensing your company's data directly to SourceX for AI training and evaluation. Start a short assessment; no uploads needed.

Start an assessment