payroll eval: raw outputs
Every answer from the 3x3 run, as JSON: the task prompt, the system prompt, the model, the full response and token usage. Each cell is the hand grade; click it for the raw answer.
| task | opus 5.5 r1 | opus 5.5 r2 | opus 5.5 r3 | sonnet 5.5 r1 | sonnet 5.5 r2 | sonnet 5.5 r3 | haiku 5.5 r1 | haiku 5.5 r2 | haiku 5.5 r3 |
|---|---|---|---|---|---|---|---|---|---|
| T01 | pass | pass | pass | pass | pass | pass | pass | pass | pass |
| T02 | pass | pass | pass | pass | partial | pass | partial | partial | partial |
| T03 | pass | pass | pass | pass | pass | pass | pass | pass | pass |
| T04 | pass | pass | pass | pass | pass | pass | pass | fail | fail |
| T05 | pass | pass | pass | pass | pass | pass | pass | pass | pass |
| T06 | partial | partial | partial | partial | partial | partial | pass | pass | pass |
| T07 | pass | pass | pass | pass | pass | pass | pass | pass | pass |
| T08 | pass | pass | pass | pass | pass | pass | pass | pass | pass |
| T09 | pass | pass | pass | pass | pass | pass | pass | pass | pass |
| T10 | pass | pass | pass | pass | pass | pass | pass | pass | pass |