AI News

Meta Muse Ember becomes the strongest small model with 1608 points on Code Arena WebDev

ArenaUpdated Nov 10 02:37

AI summary

Arena.ai states that Meta's Muse Ember (Max) has become the highest-scoring small model on the Code Arena WebDev leaderboard with 1608 points, surpassing Claude Haiku 5.5 (1595 points) and GPT-6 Luna (1578 points). Ember's median per-task cost is $0.03, lower than Luna's $0.06 and Haiku's $0.11, while all three models share the same API pricing of $0.10/$0.50 per million input/output tokens. In Arena's own testing, Ember completed 25 complex generations in 2 minutes per task, at a total cost of $1.

Why read this

SelectedAI score 68

Arena's WebDev leaderboard shows that Ember enters the Pareto frontier at a lower per-task cost, offering a comparison of coding cost-effectiveness against small models at the same price point.

Topics

Tags

Quoted post

AI at Meta

@AIatMeta

Today we're introducing Muse Ember, our smallest and most efficient model, built for complex reasoning execution and everyday agent work. Muse Ember can carry workflows across apps, call tools in sequence, run tests and make targeted code fixes. With a 1M-token context window and native understanding of text, images, audio and video, it can also work across large document sets and varied inputs.

View original

Today we're introducing Muse Ember, our smallest and most efficient model, built for complex reasoning execution and everyday agent work. Muse Ember can carry workflows across apps, call tools in sequence, run tests and make targeted code fixes. With a 1M-token context window and native understanding of text, images, audio and video, it can also work across large document sets and varied inputs.

View original post

Body

Exciting news: @AIatMeta's Muse Ember (Max) is the highest-performing small model in the Code Arena: WebDev with 1608 pts, outperforming two leading small models from Anthropic and OpenAI: - Claude Haiku 5.5 (High): #35, 1595 pts - GPT-6 Luna (Max): #42, 1578 pts

At a 1608 score at a median cost of $0.03 per task, this puts Ember on the Pareto frontier. Neither Haiku 5.5 nor Luna makes it. Despite all three models having the same API pricing of $0.10/$0.50 per million input/output tokens, Ember's median cost per task is 2× lower than Luna ($0.06) and 3.7× lower than Haiku ($0.11).

In our own testing, Ember demonstrated impressive speed and efficiency, completing 25 complex generations in 2 mins per task, at a total cost of just $1.

Huge congrats to @alexandr_wang and the @AIatMeta team on this impressive release! A major step forward for small models that deliver strong real-world coding capabilities at a fraction of the cost.

Source

Arena