๐Ÿ”ง Harness Lab

The model is fixed. Everything you can change is the harness around it. Tune the loop, run 200 tickets, and watch pass rate, wrong-fixes-shipped and cost per solve move โ€” the actual job of an agentic-systems engineer.

the harness

step budget 20 turns

Too tight truncates real work; too loose funds doom loops.

verifier

The only thing standing between a plausible patch and a wrong fix in production. Costs tokens; strict also false-rejects.

โ€”pass rate
โ€”wrong fix shipped
โ€”gave up / burned out
โ€”tok / solved ticket
โ€”avg tok / ticket
โ€”p95 turns
โ€” โ€” โ€”

run a batch to see where you stand

Every config you run leaves a dot. Cyan = clears the gate, amber = latest. The shaded corner is shippable. You are hand-exploring a Pareto frontier.

trajectory ยท one ticket, turn by turn