Meta 的 Muse Spark Open 上线 Amazon SageMaker JumpStart
Meta 的编码优化开源权重模型 Muse Spark Open 现已在 Amazon SageMaker JumpStart 上线,支持 100 万 token 上下文窗口,可在自己的 AWS 账户中部署到 SageMaker AI 端点。该模型采用 MoE 架构,总参数 816B、每 token 激活 42B,提供 BF16(Muse-Spark-Open-816B-A42B)和 NVFP4 量化(Muse-Spark-Open-816B-A42B-NVFP4)两个变体,分别运行在 ml.p6-b300.48xlarge 和 ml.p5e.48xlarge 实例上。文章给出了通过 SageMaker Studio 和 SageMaker Python SDK 部署、发送首次推理请求以及清理端点的步骤。

but serving still requires enough GPU memory to hold all 816 billion parameters, so the instance choice comes down to memory capacity. Second, the NVFP4 variant stores weights in NVIDIA’s 4-bit floating point format, which needs roughly a quarter of the memory of the BF16 weights. On SageMaker AI, that difference decides the instance: the NVFP4 variant runs on ml.p5e.48xlarge, and the BF16 variant runs on ml.p6-b300.48xlarge. That makes NVFP4 the variant to try first when you size for cost. Eva
匹配字段正文