AIE
Why evals matter now?
Models improved. Choosing became harder.
Models improved. Choosing became harder.
Vibe checks do not scale
SWE performance grows rapidly
Options change every month
SWE performance grows rapidly
Options change every month
* SWE-rebench 2026_02 tasks
Google DeepMind