←新闻详情

The Decoder更新于 10月21日 09:13

DeepSeek 开源推理框架 DeepInfer,支撑 V4.1-Flash 快速低成本推理

Deepseek open-sources the inference engine that powers its fastest and cheapest AI model

AI 导读

DeepSeek 以 Apache License 2.0 开源内部推理框架 DeepInfer,该框架是支撑 V4.1-Flash 模型大规模快速生成回答的服务软件。DeepInfer 基于 vLLM 构建,包含优化的计算内核、多芯片分布式处理和更快的文本生成技术,未来 DeepSeek 模型的代码也将开源。DeepSeek 同时发布 deepseek-recipe,可复现官方 API 的 token 处理,使自托管部署行为保持一致,官方称目标是帮助社区降低算力成本与能耗。

推荐理由

AI 评分 65

DeepSeek 开源内部推理框架,读者可了解其如何降低自托管成本并复现官方 API 的 token 处理。

主题

标签

正文

当前显示原文,中文全文译文尚未就绪。

Deepseek has open-sourced DeepInfer, its internal inference framework, under the Apache License 2.0. Inference is how a trained AI model handles requests and generates responses. DeepInfer is the serving software that lets Deepseek's V4.1-Flash model produce answers quickly at scale.

The framework builds on vLLM with optimized compute kernels, distributed processing across multiple chips, and faster text generation techniques. Code for future Deepseek models will also ship as open source. Deepseek is also releasing deepseek-recipe , which replicates the token processing of the official Deepseek API so self-hosted setups behave the same way.

Deepseek's models are already dirt cheap . DeepInfer fills the last gap for running them even more cheaply. The goal is "to help the community lower compute costs, reduce energy use, and make AI more affordable," the company said on X . But the release also adds pricing pressure on Western providers like OpenAI and Anthropic. Given the AI race between China and the US, the move could be politically motivated too. If Western AI companies miss their growth targets, that's a risk for the US economy and beyond.

来源

The Decoder