Understand this story
On October 24, 2026, regarding discussion that OpenAI fell out of the top five on the AA analysis leaderboard after the release of Kimi K3.1, Nathan Lambert offered this judgment: at the top-model level, real-world usability matters far more than a ±2-point gap on AA. He believes AA scores are more like a potential indicator; some models can deliver on it, such as opus 5 and 5.5, while others cannot, and 3.1 may lean toward the side that fails to deliver. This judgment is currently reported by a single source, with no subsequent factual developments yet.
AI-generated from public reports
Latest development · Report
Nathan Lambert: The practical usability of high-end models matters more than AA scoresDevelopments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 24
Nathan Lambert
Nathan Lambert: The practical usability of high-end models matters more than AA scores
Regarding the discussion that OpenAI fell out of the top five on the AA analysis leaderboard after the release of Kimi K3.1, Nathan Lambert believes that at the level of top-tier models, real usability matters far more than a ±2-point gap on AA; AA scores are more like a potential indicator—some models can deliver on it (such as opus 5 and 5.5), while others cannot, and 3.1 may lean more toward the side that fails to deliver.