Note. Target passes are not all equivalent: unix and real anchor every wait on ingestion stamps, while the stampless wokwi serial log anchors interactive tasks on the line-fed input() echo only - a literal on the startup line is exempt, and output-only tasks, regex-only expectations and unechoed input remain unanchored there. Renode relies on paste-echo trimming alone. See the README anti-cheat boundary.

ironbench leaderboard - firmware-agent benchmark

Modelpass@kTaskscontrolfsmioprotocolresilience
openai/gpt-oss-20b90%102/2 (100%)2/2 (100%)4/4 (100%)7/8 (88%)6/7 (86%)
qwen/qwen3-30b-a3b70%102/2 (100%)2/2 (100%)4/4 (100%)3/8 (38%)5/8 (62%)