AI Trends

GPT-6.2 Astra and GPT-6.2 Sol Reach the Code Arena WebDev Pareto Frontier

ArenaUpdated Nov 19 02:14

AI summary

In Code Arena: WebDev, GPT-6.2 Astra and GPT-6.2 Sol ranked #3 and #7 with 1781 pts and 1757 pts, respectively, placing both on the Pareto frontier. Astra scored 24 pts higher than Sol; Sol's median per-task cost was $1.45, 73% lower than Astra's $5.45.

Why read this

SelectedAI score 69

A comparison of scores, rankings, and per-task costs on the same benchmark illustrates the trade-offs between performance and cost for the two models.

Topics

Tags

Quoted post

OpenAI

@OpenAI

Some of you have been asking very politely. Some of you have just been asking. GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts—the real world. https://t.co/qr2iP0GpfX https://t.co/jLCyVIws2Y

View original

Some of you have been asking very politely. Some of you have just been asking. GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts—the real world. https://t.co/qr2iP0GpfX https://t.co/jLCyVIws2Y

View original post

Body

Real-world Arena scores are in for GPT-6.2 Astra and GPT-6.2 Sol by @OpenAI in the Code Arena: WebDev, and both have landed on the Pareto frontier! - #3 with 1781 pts: GPT-6.2 Astra (Max) - #7 with 1757 pts: GPT-6.2 Sol (Max)

GPT-6.2 Astra: #3 with 1781 pts - +18 pts vs previous variant GPT-6 Astra (Max) - #1 in Consumer Product, compared with #4 for GPT-6 Astra - Median cost per task: $5.45 vs. $9.46 for GPT-6 Astra, 42% lower - Lands on Pareto frontier (see placement in thread)

GPT-6.2 Sol: #7 with 1757 pts - +13 pts vs GPT-6.1 Sol (Max) - Median cost per task: $1.45 vs. $1.84 for GPT-6.1 Sol, 21% lower - Lands on Pareto frontier (see placement in thread)

6.2 Astra vs. Sol - Astra scores +24 pts above Sol - Sol’s median cost per task is 73% lower ($1.45 vs. $5.45)

Congrats to the @OpenAI team on this release. Agent score coming soon!

Source

Arena