Red Shell · Common Errors

All mistakes/Section 2: What you may not tell Model A or Model B

2.3A deferred asset that announces its own turn

Fails the taskInput Artifacts - Deferred Asset Handling

The mistake

Something in the input folder, open to both models from turn 1, previews a later turn: a file named for its turn, or a document carrying a later instruction. A file named only for its contents costs points.

Do this instead

Name deferred files as a phone or scanner would, and let the Leg A follow up that delivers each one say what it is; the Leg B turn repeats it.

Where it happened

One real task. Each shows the spot and what it should have been; click any line to open the task there.

the words at faultthe row or field at faultmissing from the taskwhat is righta task file

Example 6Small Business & Personal Docs · 4 Leg A turns

What is wrongThe deferred files IMG_0814_calendar.jpg and IMG_0819_travel_policy.jpg sit in the input folder from the start, and their names say what Leg A turns 2 and 3 will hand over.

Leg A turn 2 hands Model A Jaylen's marked school calendar, and Leg A turn 3 the Q3 travel directives.

Where it shows

IMG_0814_calendar.jpg
IMG_0819_travel_policy.jpg

What it should have been

IMG_0814.jpg
IMG_0819.jpg
I dug up Jaylen's school calendar for this year and marked it up (see attached IMG_0814.jpg).the turn that delivers it says what it is

How it breaks the standardFrom their first turn, Model A and Model B can see in the input folder that a school calendar and a travel policy are coming, before the turn that hands each over in either leg. Neither name states a requirement or a graded value, so this costs points.

The rule it breaksGuidelines · 1.2.2 Select the Multimodal Inputs use neutral filenames

Catch it in your own task

Read the input folder as both models will at turn 1, filenames included: price_sheet_for_turn3.pdf fails, price_sheet.pdf costs points, sheet_02.pdf is fine.

Where the correct guidance is written

Section titles as they print, so you can search for them in the document.

QC spec · Input Artifacts - Deferred Asset Handling

The file still ships in input_files/ at upload time, but neither its filename nor any manifest may preview the turn that delivers it.

Guidelines · 1.2.2 Select the Multimodal Inputs

All assets must be included in the input .zip folder from the start and use neutral filenames.
1 more source

Guidelines · 1.2.3 Create the Initial Prompt and the Follow-ups

The follow-up must name the asset being introduced so the model knows exactly what new evidence has become available.

Written for the Leg A follow ups.

Why it matters

A deferred asset tests whether each model can take in new evidence mid conversation: Model A at its Leg A turn, Model B at its Leg B turn. Told in advance that a file is coming and what it is for, either model can prepare, and the later turn no longer tests it. A filename or document that previews the later turn's purpose or requirement fails the task; a name that only says what the file holds costs points.

Every example taken apart, with the task, how it breaks the standard and what it should have been: 2.3 A deferred asset that announces its own turn, in the explanations →