All mistakes/Section 4: A rubric that separates two runs
4.1A rubric that can only reward, never penalise
Costs pointsRubric Criteria - Overall Rubric QualityMost common right now
The mistake
Too few negatives for the scenario's traps, so taking the bait costs nothing extra, or a negative worded as the virtue, which marks down correct runs.
Do this instead
After Leg A, write a negative for each worthwhile wrong turn Model A took, stating the flaw, never the virtue.
Where it happened
2 real tasks. Each shows the spot and what it should have been; click any line to open the task there.
the words at faultthe row or field at faultmissing from the taskwhat is righta task file
Example 14Visual Learning · 3 Leg A turns
What is wrongThe 34 criteria carry no negative, though Leg A turn 1 sets a trap: it says the clip's quiz picks are right, and basics.mp4 shows all three wrong.
Leg A turn 1 asks for the page shown in 2panels_demo.webm, built as cardio.html, and calls the clip's picks right. mod3_notes.txt says they “were fast ones”: go with the slides.
cardio.html keys the self check to the picks selected in 2panels_demo.webm.-3, since mod3_notes.txt points the right way
How it breaks the standardThe trap is real: Model B, Leg B turn 1, keyed the third item to the clip's ~80%. Yet a run that trusts all three picks loses only the two +3s of objective criteria 12 and 19, exactly what Model A lost without reading the clip at all. Taking the bait costs nothing extra.
The rule it breaksGuidelines · 5.2 Rubric WeightsThe negative slots are for attractive wrong paths the model has to resist.Start with the traps Leg A walked into.
What is wrongSubjective criterion 10 is a -3 negative worded as a virtue: the finished plate “remains legible”. The golden's plate is legible, so the golden is Present and loses three points.
In plate12_simplification_lesson.mp4, the finished teaching plate renders with its captions or labels below legible size at normal 1080p or full-window playback.
How it breaks the standardA negative takes its weight when Present, so subjective criterion 10 charges every legible video three points and spares an unreadable one. The golden, the reference the subjective block is graded against, is the video it penalises. Subjective criterion 3 has the right form: it names the flaw, a black or frozen frame.
Negatives should be about a quarter of the set. Present means failure, so a negative describing a good run is inverted.
Where the correct guidance is written
Section titles as they print, so you can search for them in the document.
Guidelines · 5.3 Positive and Negative Distribution
Negatives are the exception: They should usually make up around 25% of the rubric block and should generally stay below 30%. Use a negative criterion only when it captures a specific, plausible failure mode that the scenario or trajectory meaningfully exposes.
Guidelines · 5.2 Rubric Weights
The negative slots are for attractive wrong paths the model has to resist.
Start with the traps Leg A walked into.
1 more source
Guidelines · 5.5 Rating Model A and Justifying the Failures
For negative weight: The trajectory contains the undesirable behavior or boundary violation described by the criterion.
Why it matters
A scenario earns its difficulty from the wrong answers sitting next to the right ones: the superseded quote, the decoy invoice, the figure from a different part of the store. Without negatives the rubric cannot see any of them, so a run that walks into every trap and recovers scores the same as one that never went near a trap. They are also the cheapest criteria to write, because Leg A usually shows you which failure to write about.
The panels on `cardio.html` name all seven phases: all chambers relaxed, atrial systole, atrial diastole, ventricular systole first phase, ventricular systole second phase, early ventricular diastole, late ventricular diastole.
The five phase terms appear as callouts on `cardio.html`: atrial systole, isovolumetric contraction, ventricular ejection, isovolumetric relaxation, passive filling.
In `captions.pdf`, the slide 2 caption covers the four steps: all chambers relaxed, atrial systole, atrial diastole, and ventricular systole's first phase, in any wording.
In `captions.pdf`, the slide 8 caption covers cardiac output as heart rate times stroke volume and the narrator's reminder to be able to calculate it for the first test, in any wording.
The concerns block on `cardio.html` answers the third numbered concern from Harlan's 2026-03-03 mail "Module 3 (Cardio) draft, points for discussion", assessment alignment, as the quiz rewritten against the diagrams, in any wording.
cardio.html` carries a self check with the three items from `2panels_demo.webm`, options and keys deck-true: what closes to begin isovolumetric contraction (options the AV valves with S1, the semilunar valves with S2, the aortic valve with S1; key the AV valves with S1); which wave marks ventricular repolarization (options the P wave, the QRS complex, the T wave; key the T wave); how full the ventricles are at the end of passive filling (options about 30 percent, about 70 percent, 100 percent; key about 70 percent).
The chat reply identifies the missing half-time captioning assistant line as what separates the folder's `budget_fy27.xlsx` (175,600 personnel, 2.0 FTE) from the workbook of the May 15, 2026 mail "FY27 Visual Curriculum proposal" (190,400 personnel, 2.5 FTE).
The response identifies the handwritten sheet `IMG_5324.jpg` as her shorthand of the mail thread "Module 3 (Cardio) draft, points for discussion".
+3targetTrajectorycategoryAgent Behavior
19
The response identifies that all three quiz picks shown in `2panels_demo.webm` (the valve item, the wave item, the filling percentage) read wrong, in any wording.
The concerns block on `cardio.html` pairs the first two numbered concerns of Harlan's 2026-03-03 mail "Module 3 (Cardio) draft, points for discussion" with their answers: the single-loop cardiac cycle diagram answered by the split into two timed panels, along with the terminology load answered by the terms carried as labeled callouts.
No negative for keying the self check to the clip's picks.
From the taskLeg A prompt, turn 1, to Model A
Leg A turn 1
Im working in mod 3 with featherman, I added a video, a txt note and some other files of the page I want in the folder. Transform it into cardio.html for real, same panels same quiz options. I think selected the right answers in the clip for reference. And the slide captions never got typed, finish those into captions.pdf.
From the taskFrom the Leg B conversation, with Model B
Model B · Leg B turn 1
Both files are in `/app/outputs`. Here's the rundown.
## Deliverables
**`cardio.html`** — one self-contained file (no libraries), drops straight into Canvas. Rebuilt to match the clip exactly:
- Header, controls (**Pause/Play, Step phase, Slow ¼×/Full speed, live `t=` clock**) and the "75 bpm → 0.80 s" info line.
- **Two timed panels** (Systole "the heart empties" / Diastole "the heart refills") with animated heart diagrams and the 3+3 phase list under each, highlighting the active step by time.
- **"The same 0.8 s on the monitor"** ECG strip with a moving "now" dot, P/QRS/T + S1/S2 markers, legend, and the event-chip row that lights up in sync.
- **Quiz** — same 3 questions, same options, click-to-check with feedback.
- **Cardiac output** calculator (HR 75 × SV 70 = 5.25 L/min, editable).
**`captions.pdf`** — the deck's 8 slides with every empty `caption:` now filled from the `basics.mp4` narration (transcribed, lightly cleaned), key values kept for reference, with amber notes where the source differs from the legacy deck.
## Quiz answer key (your clip picks were "fast ones" — here's the deck-checked truth)
- **Q1** → **"the AV valves · S1"**. Your clip pick "the aortic valve · S1" showed red/wrong.
- **Q2** → **"the QRS complex"**. Your clip pick "the P wave" was red/wrong. The source ECG slide says *"atrial systole extends until the QRS complex, at which point the atria relax"* — atrial repolarization is masked inside the QRS.
- **Q3** → **"~80%"** (your clip pick, green/correct) — kept as the nearest listed option; see flag below.
## 🚩 Flags (deck/source beat the demo; I went with the deck and noted it in-file)
1. **T wave** — demo said "atrial repolarization"; it's **ventricular** repolarization (deck slide 4 + source). Fixed on the strip.
2. **Passive filling** — demo said 80%; deck **and the teacher's narration both say ~70%**. Panels/chips now say ~70%; Q3 stays ~80% only because there's no 70% option.
3. **Heart rate** — page's **75 bpm is correct** (source video literally says "for 75 bpm heart rate"); your **`mod3_slide_notes.pdf`'s "70 bpm" is a typo**.
4. **Tricuspid** — demo said "heard at 2LICS"; deck says **4LICS** (2LICS is the *pulmonary* point). Fixed.
5. **Deck slide 6 itself is wrong** — it lists S1=semilunar / S2=AV, which is backwards. Correct (and what's on the page): S1=AV valves close, S2=semilunar. Noted in captions.pdf.
A collapsible "Instructor/QA notes" block at the bottom of `cardio.html` repeats these — delete it before publishing to students.
## Your two questions
**When did the Section 02 pilot actually happen?** Your calendar settles it: the pilot ran **Wednesday, March 18, 2026, 1:00 PM** in the Lone Tree science lab (first of two sessions), with a **second observed session Wednesday, April 15, 2026**. The "different days" is a weekday-label slip: both you and Harlan wrote **"Tuesday the 18th,"** but the 18th is a **Wednesday** (Slack and the calendar agree). April 15 isn't a competing date for the same session — it's the follow-up look. So: **the 18th is right; "Tuesday" is the error.**
**Is `budget_fy27.xlsx` in the folder what went to Mateo?** **No.** The folder copy is an earlier *working draft*: 2.0 FTE, personnel $175,600, **TOTAL ASK $197,600**, no captioning assistant. What you actually emailed Mateo on **May 15** (subject "FY27 Visual Curriculum proposal," attaching `budget_fy27.xlsx` + `proposal_v3.docx`) was **$212,400 total / $190,400 personnel / 2.5 FTE**, adding the half-time student captioning assistant. The folder file is missing that 0.5 FTE line (a $14,800 gap on both personnel and total) — it's a pre-assistant draft, not the sent version.
Task filecardio.html
cardio.htmlgolden artifact
Example 15A rubric that can only reward, never penaliseCosts points
Visual Learning3 Leg A turnstask 6aa02f48755f41e02b014849
From the taskSubjective criterion 10
10
In plate12_simplification_lesson.mp4, the finished teaching plate remains legible at normal 1080p or full-window playback, with body captions and vessel labels readable at the size they are shown.
My students keep reading the finished plates as if they were photos, misreading every simplification I made. So I need a short explainer video (plate12_simplification_lesson.mp4) that walks through Plate 12 (plate12_drat_sketch.jpeg), then applies the real instructions from my notes to the finished drawing and explains, at each step, what I kept, what I simplified, and why. I have attached my desk notes (img_23232.jpg and img22223.jpg); you may need to cross-reference them with my data so they make sense, and don't invent general drawing tips.
Leg A turn 2
There is no separate finished Plate 12 scan to upload. plate12_draft_sketch.jpeg is the wrong draft; the finished teaching version is what you get after applying the real Plate 12 revision instructions from my desk notes and the trail in my Slack, and email with Yusuf and the unit. Do not ask me to retype the notes. Open the live Plate 12 record, map each kept vs simplified step onto the draft drawing, and produce plate12_simplification_lesson.mp4 with narration. Update that file in place if you already started one.
Leg A turn 3
You added a bunch of overlaid rectangles that cover the entire image; students need to see the corrected plate 12 drawing, not only the highlighted boxes over the wrong draft. Update the mp4 in place: apply the changes to the draft so they follow up the explanations. Keep only the narrated version of the video.
From the taskSubjective criterion 3
3
plate12_simplification_lesson.mp4 contains an unintended black or frozen frame between slides.
Look at The golden video, at 1080p. Stop on the finished plate: its captions and labels are legible, so the golden is Present on the -3 criterion and loses three points for getting it right.