Blog
Notes on measuring AI models
Notes from StormEval on how the daily tests work and what they can and cannot tell you about an AI model.
-
How StormEval tells whether an AI model got worse
Fresh tasks every day, a fixed difficulty mix, a program as the grader, and each model compared with its own past. What the test does, and what it cannot tell you.