Red Shell · Common Errors

All mistakes/Section 6: The subjective block

6.1Subjective criteria that never name the file

Costs pointsRubric Criteria - Subjective Block Scope

The mistake

Subjective criteria describe features without naming the file that carries them, usually after the first one or two.

Do this instead

Open each one with “In <filename>,”.

Where it happened

One real task. Each shows the spot and what it should have been; click any line to open the task there.

the words at faultthe row or field at faultmissing from the taskwhat is righta task file

Example 29Operations & QA · 5 Leg A turns

What is wrongNone of the 10 subjective criteria names a file, though Leg A asks for three, so each leaves the grader to choose which file it grades.

Leg A turn 1 asks for hh_migration_manifest.csv and a running note, hh_migration_notes.md in the golden. Leg A turn 4 adds move_walkthrough.mp4, a video that shows the album table.

Where it shows

Subjective criterion 2+3
Passed and failed outcomes are distinguished by colour or a mark, not by wording alone.which file?
Subjective criteria
None of the 10 names a file, and the golden archive holds four.

What it should have been

Subjective criterion 2+3
In move_walkthrough.mp4, passed and failed outcomes are distinguished by colour or a mark, not by wording alone.

How it breaks the standardThe task ships more than one file, so each subjective criterion has to name the one it grades, and none does. Subjective criterion 2's pass and fail marks and subjective criterion 3's table columns also appear in hh_migration_notes.md, an album table with “✅ clean” rows, so the grader has to decide which file is meant. It costs points.

The rule it breaksGuidelines · 8.1 Writing Subjective Rubrics The element makes the criterion self-contained by telling the reviewer where to look. With more than one file, that includes the filename.

The full write up of Example 29

Catch it in your own task

With more than one file, every subjective criterion contains a filename.

Where the correct guidance is written

Section titles as they print, so you can search for them in the document.

Guidelines · 5.1 Rubric Fundamentals

Include the exact expected value, filename, classification, decision, or other fact needed to determine whether it is Present or Not Present.

8.1 applies it to the subjective block.

Guidelines · 8.1 Writing Subjective Rubrics

The element makes the criterion self-contained by telling the reviewer where to look.

With more than one file, that includes the filename.

Why it matters

The evaluation target only says Final Answer Artifact, not which file. Once a task ships two deliverables, or a revision turn produces a second file, “the table” or “each scene” stops identifying anything, and two graders can score the same run against different files. With a single deliverable the file is implied, and the QC appendix accepts a criterion that leaves it out as long as another criterion checks the file exists. Naming it anyway costs nothing, and it survives a revision turn that adds a second file.

Every example taken apart, with the task, how it breaks the standard and what it should have been: 6.1 Subjective criteria that never name the file, in the explanations →