←News detail

The DecoderUpdated Oct 30 14:09

Mistral Releases Mistral Large 4 Weights: Coding Ability Leads Open-Source Models but Overall Trails Chinese Models

AI summary

Mistral has released the weights of Mistral Large 4 on Hugging Face. The model, nicknamed Le Chonk, has approximately 1 trillion parameters with 52 billion activated per step, and supports text and image inputs. On Terminal-Bench 4.0, its score rose from 28% in the preview version to 41%, slightly above GLM-5.3's 40%, but on the new version of the Artificial Analysis Intelligence Index it scored only 26 points, below the 32 points of DeepSeek V4.1 Flash and GLM-5.3. API pricing is $0.70 per million input tokens and $2.10 per million output tokens, under a modified MIT license; using it as a commercial cloud service requires separate authorization.

Why read this

AI score 68

The original article uses independent benchmark data to compare Le Chonk with Chinese and U.S. open-source models in terms of coding, cybersecurity, and cost positioning.

Topics

Tags

Body

Key Points

Mistral has released the weights for Mistral Large 4, its largest model yet. The company says the model beats its open rivals at coding. In the first independent test, it turns out to be fast and fairly cheap, but it trails Chinese models in the overall rankings.

Three weeks after the public preview , Mistral has put the Large 4 weights on Hugging Face . The model's nickname is "Le Chonk." It takes text and images as input and outputs text and code. It has about one trillion parameters in total, with 52 billion active per step. Running it yourself takes a lot of hardware. According to the docs for the inference framework SGLang, the standard version runs on eight Nvidia B300 GPUs, and a more heavily compressed variant runs on four GB300 GPUs.

Since the preview, Mistral has kept training the model with reinforcement learning. The company says this brought big gains, especially in coding and cyber defense. Mistral researchers Pierre Stock and Corentin Petit walked through the process on a press call. The team built tasks in-house that got harder as training went on. They said the only limit on performance is how difficult a task the team can still create and verify. Mistral calls it a "two-year bet" that's now paying off.

Large 4 leads open models on coding but trails Claude by a wide margin

After three more weeks of training, Large 4's score on Terminal-Bench 4.0 rose from 28 to 41 percent. That puts it just ahead of GLM-5.3 at 40 percent. Mistral says Large 4 hits 48 percent on Artificial Analysis' Coding Agent Index. That's practically tied with GLM-5.3, but Large 4 uses 47 percent fewer tokens to get there. Claude Code with Claude Opus 5.5 tops the index at 62 points.

On Cognition's new FrontierCode 2.0 benchmark, Large 4 leads the open models at 19.7 percent. Claude Opus 5.5, however, scores 46 percent. In blind comparisons run by Surge, testers preferred Large 4's code over code from GLM-5.3, Kimi K3, and DeepSeek more often than not. Against Opus 5.5, Large 4 won only 22 percent of matchups.

Mistral's comparisons leave out Moonshot's Kimi K3.1 Pro. Technically that's fair, since its weights aren't public yet. Moonshot plans to release them by November 4, 2026. After that, Mistral probably won't have much of a lead left, because Kimi K3.1 Pro tops Terminal-Bench 4.0 at 67 percent.

Large 4 ranks third among open models in cyber defense, not first

Mistral calls Large 4 the leading open model for cyber defense. The company says the final version scores 51 percent on Artificial Analysis' Cyber Index. The index measures whether a model can find, reproduce, and patch security holes in a codebase without breaking existing features. Mistral's own chart, however, shows two open models ahead of it, with DeepSeek V4.1 Flash at 57 percent and MiMo-V2.6-Pro at 56 percent. That puts Large 4 third among open models, just ahead of GLM-5.3 Flash at 50 percent. Kimi K3.1 Pro leads the entire index at 64 percent.

The extra training barely moved the needle here. According to Artificial Analysis, the preview scored 50 points, and the final version is only one point higher.

Large 4 does better at refusing harmful requests. Mistral says it rejects 96.6 percent of malicious cyber requests on average, more than any other open model. It's still supposed to handle legitimate defensive tasks. Mistral admits the model could make real attacks easier, though, so it plans to tighten safeguards in the coming months. Select partners like Orange Cyberdefense are already testing a special version for penetration testing. Access requires a review and comes with contractual restrictions.

Mistral also sees progress on office work. The company says Large 4 trails only Kimi K3 among open models at editing financial spreadsheets and searching the web.

Mistral cuts the price but adds a license catch

Through the API, Large 4 costs $0.70 per million input tokens and $2.10 per million output tokens. During the preview, the list price was $1.36 and $4.18. Mistral cut it to $0.68 and $2.09 for two weeks at launch, so the new price roughly matches that old discount. For comparison, Kimi K3.1 Pro costs $2 for input and $10 for output.

Mistral released the model under a modified MIT license . Use, modification, and commercial deployment are free. Companies that offer Large 4 as a commercial cloud service, however, need a separate license from Mistral. The company mainly pitches the model as "sovereign" AI, since it was trained entirely in Europe and can run on your own servers. If you don't want to host it yourself, it's available on Microsoft Foundry, among other platforms.

Independent tests show Large 4 is fast and cheap but can't catch China's best

Artificial Analysis released version 5 of its Intelligence Index on Wednesday. It has since rated the final version of Large 4 in high mode, which scores 26 points. Three-fifths of the index now rely on tests whose tasks or solutions aren't public. The nine tests include Terminal-Bench 4.0 and FrontierCode 2.0.

The preview scored 25 points, so the three extra weeks of training added just one point overall. Artificial Analysis says Large 4 beats the average for open models of similar size, where the median is 23 points. It still falls short of the strongest open models from China. DeepSeek V4.1 Flash and GLM-5.3 each score 32 points, and MiMo-V2.6-Pro gets 30. That gap isn't new. In the old index, the preview scored 38 points and GLM-5.3 scored 45.

Large 4's strengths are speed and cost. The model generates 161 tokens per second, up from 111 for the preview. In Artificial Analysis' head-to-head comparison, only DeepSeek V4.1 Flash and Muse Wonder are faster. An index task costs $2.06 on average with Large 4, down from $5.54 for the preview. That makes Large 4 cheaper than GLM-5.3 ($5.01) and Kimi K3.1 Pro ($3.68), but much more expensive than DeepSeek V4.1 Flash ($0.60) and MiMo-V2.6-Pro ($0.26). Compared with other open models of similar size, Artificial Analysis still considers its per-token price on the high side.

Mistral also promises that Large 4 is efficient with tokens, and that claim can now be checked. The model generated 110 million output tokens across the full index, compared with 150 million for the preview. That's a big improvement. But the median for comparable models is 100 million, so Large 4 still sits slightly above it.

The gap at the top of the index is wide. Google's Gemini 4 Carbon leads with 59 points , one point ahead of Claude Opus 5.5. So far, though, only select cybersecurity partners can use Gemini 4 Carbon. The top open model is Kimi K3.1 Pro at 46 points, but its weights haven't been released yet.

Mistral still thinks it's on track. The team said on the press call that it works with a fraction of the resources US and Chinese labs have and would be at the top with ten times more capital. Large 4 is meant to serve as the base for specialized Mistral models. The company wouldn't comment yet on smaller versions built on it.

Source

The Decoder