←Story detail

Trending story

SGLang natively supports and powers the Beam production API

13 reports13 story updatesUpdated Oct 21 01:04

Understand this story

AI overview

On October 16, 2026, LMSYS announced that SGLang now natively supports Reflection's Beam model and is being used to power its production API. Beam is a 501B-parameter MoE model with 23B active parameters per token and a native 1M-token context window, planned for release under Apache 2.0; SGLang provides BF16, NVFP4, and dynamic FP8 support for it, along with DFlash2 speculative decoding and hybrid attention prefix caching. Running OpenHands multi-turn agentic coding replay with NVFP4 on 4 NVIDIA GB300 GPUs, it reached 127.6K tokens/sec per GPU and 185.87 tokens/sec per user (p50) at a concurrency of 32. On the same day, Reflection released the Beam model weights, with Ollama offering them free for a limited time as a day-zero partner with zero data retention; Beam has approximately 501 billion total parameters, about 23 billion active parameters per token, a 1 million-token context window, and is released under the Apache 2.0 license. Subsequent information from AWS states that the Beam weights have been released on Hugging Face, offering three checkpoints—BF16, FP8, and NVFP4—and are now available on Amazon SageMaker JumpStart, and can also be accessed via SageMa

AI-generated from public reports

Latest development · Report

English translation is being prepared.

Developments

2 confirmed developments

  1. Reflection releases its first open-weight model, Beam

    Source:Ollama Blog
  2. English translation is being prepared.

    Source:LMSYS Blog

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 21

  1. interconnects

    English translation is being prepared.

Oct 20

  1. the_elec

    English translation is being prepared.

Oct 17

  1. testingcatalog

    English translation is being prepared.

  2. latent_space

    English translation is being prepared.

  3. latent_space

    English translation is being prepared.

  4. siliconangle

    English translation is being prepared.

Oct 16

  1. aws_mlFirst-partySelected

    English translation is being prepared.

  2. reflection_blogFirst-partySelected

    English translation is being prepared.

  3. Unite.AISelected

    Reflection open-sources 501B-parameter MoE model Beam under Apache 2.0

    On October 16, Reflection released its first open-weight model Beam on Hugging Face under the Apache 2.0 license, and Baseten provided day-0 support the same day through Model APIs and Dedicated Inference. Beam is a 501B total-parameter MoE autoregressive Transformer with 23B activated per token, a context window of up to 1 million tokens, pretraining on 23.8 trillion tokens, and weights released in BF16, FP8, and NVFP4 precisions. The evaluation results given by Reflection are GPQA Diamond 90.5%, SWE-bench Verified 80.9%, AIME 2026 97.8%, Terminal-Bench 2.1 80.1%, and MCP Atlas 78.7%, and it also open-sourced the terminal agent tool Mirror CLI.

  4. Baseten Engineering BlogFirst-partySelected

    Reflection's Open-Weight Model Beam Launches on Baseten: 501B MoE with 1M Context

    Reflection's first open-weight model, Beam, is now available on the Baseten platform, with day-0 support through Baseten Model APIs and Dedicated Inference. Beam uses a MoE architecture with 501B total parameters and 23B activated per token, a context window of up to 1 million tokens, and is aimed at coding and agent workflows. During training, Reflection used longer RL rollouts and added a length penalty to encourage the model to complete tasks with fewer tokens; users can also adjust reasoning effort via a parameter to control how much reasoning the model invests.

  5. Hugging FaceFirst-partySelected

    Hugging Face Releases Beam: A 501B Open Source Model Supporting 1M Context and Self-Hosting

    Hugging Face has released Beam, a 501B-parameter sparse MoE open source model aimed at long-text reasoning and agent tasks with 1M context, activating only about 23B parameters per token. The model uses 52 layers of hybrid attention, with 43 layers using a 512-token sliding window and 9 layers using global attention; the KV cache grows by 36 KiB per token, about one-sixth that of a full-attention approach. The official release provides three checkpoints—BF16, FP8, and NVFP4; NVFP4 can compress the weights from about 1 TB to about 280 GB, and day-0 support is already available in transformers, vLLM, and SGLang.

  6. Ollama BlogFirst-partySelected

    Reflection's Open-Weight Model Beam Launches on Ollama, Free for a Limited Time

    Reflection's first open-weight model, Beam, is officially released, offered free for a limited time with Ollama as a day-zero partner and with zero data retention (ZDR). Beam is an MoE model with approximately 501 billion total parameters, about 23 billion activated per token, and a 1 million token context window. It targets software engineering, reasoning, and long-horizon agentic tasks, and is released under the Apache 2.0 license. Users can run beam:cloud via Ollama Cloud and connect it to tools such as Claude Code, Codex, and OpenCode.

  7. lmsys_blogFirst-party

    English translation is being prepared.

Heat trend for this story

Current
6
Period peak
37 Oct 17 08:00
24-hour change
—

Move the pointer or select the chart to inspect hourly heat. Use the left and right arrow keys with a keyboard.

Related stories

  1. Related storiesDeepSeek releases DeepSeek-V4.1-Flash-1017
  2. Related storiesMeta releases open-weight model Muse Spark Open
  3. Related storiesMistral releases Large 4 weights on Hugging Face
  4. Related storiesMeta launches Muse Wonder and Muse Wonder Full models