←Search results

Search “DeepSeek”

By relevance · Total 1346 results Clear search

Wednesday

  3. AYi AI Notes

    DeepSeek open-sources inference framework DeepInfer and codec components under Apache 2.0

    DeepSeek has open-sourced, under the Apache 2.0 license, the inference framework DeepInfer that powers its online services and the API-identical codec component deepseek-recipe, and the company says inference code for future new models will also continue to be merged into this repository. The framework includes high-performance operators, distributed inference, speculative decoding, SWA Bounded Replay, and structured output, but the README shows that this release only includes the offline inference engine; the KV cache system, prefill-decode disaggregated deployment, and multi-replica load balancing are not included. On hardware, it currently supports only NVIDIA's Blackwell architecture SM100 and Huawei Ascend 950, and the only supported model is V4.1-Flash.

    DeepSeek has open-sourced, under the Apache 2.0 license, the inference framework DeepInfer that powers its online services and the API-identical codec component deepseek-recipe, and the company says inference code for future new models will also continue to be merged into this repository. The framework includes high-performance operators, distributed inference, speculative decoding, SWA Bounded Replay, and structured output, but the README shows that this release only includes the offline infere

    Matched fieldsTitle、Summary、Body

    #hot-signal#English text is being prepared.#Reasoning#DeepSeek

Tuesday

  4. Tianyi Cui

    DeepSeek open-sources the inference framework DeepInfer and components such as deepseek-recipe

    DeepSeek has open-sourced its in-house inference framework DeepInfer, and simultaneously released key components for deploying DeepSeek models, including deepseek-recipe. DeepInfer already supports large-scale serving of DeepSeek-V4.1-Flash in production, with a focus on high throughput and low latency. DeepSeek said that publishing its production stack is intended to help the community lower compute costs, reduce energy consumption, and enable more organizations to deploy DeepSeek models.

    Matched fieldsTitle、Summary、Body

    #hot-signal#English text is being prepared.#English text is being prepared.#DeepSeek
  5. Yuchen Jin

    DeepSeek Open-Sources Internal Inference Framework DeepInfer

    DeepSeek announced the open-sourcing of its internal inference framework DeepInfer, which supports large-scale operation of DeepSeek-V4.1-Flash and focuses on high throughput and low latency. DeepSeek said it is making this production stack public to help the community lower compute costs, reduce energy consumption, and make AI more affordable, and included a link to the repository. Yuchen Jin reposted the news and commented "Real Open AI."

    Matched fieldsTitle、Summary

    #editorial#English text is being prepared.#Product updates#DeepSeek
  8. Nathan Lambert

    DeepSeek open-sources its inference framework DeepInfer

    DeepSeek announced that it is fully open-sourcing its self-developed inference framework DeepInfer, which is used to support large-scale, high-throughput, low-latency operation of DeepSeek-V4.1-Flash. The company said it is sharing its production stack to help the community lower compute costs and energy consumption and make AI more affordable. Nathan Lambert commented that this is a distinctive way to gain model adoption and is good for the community, and noted that the timing is delicate because the government has just banned DeepSeek in federal agencies.

    DeepSeek announced that it is fully open-sourcing its self-developed inference framework DeepInfer, which is used to support large-scale, high-throughput, low-latency operation of DeepSeek-V4.1-Flash. The company said it is sharing its production stack to help the community lower compute costs and energy consumption and make AI more affordable. Nathan Lambert commented that this is a distinctive way to gain model adoption and is good for the community, and noted that the timing is delicate becau

    Matched fieldsTitle、Summary、Body

    #editorial#English text is being prepared.#DeepSeek#English text is being prepared.
  10. 36Kr · AISelected

    DeepSeek open-sources inference framework DeepInfer and Token codec component deepseek-recipe

    DeepSeek open-sources its self-developed inference framework DeepInfer (Apache 2.0) and the production-grade Token codec component deepseek-recipe (MIT), supporting DeepSeek V4.1 Flash in serving 155 trillion Tokens per day on a single cluster. Official online statistics show an average of 77K Tokens input per request, a time to first token of about 400 milliseconds, 230 Tokens output per second during the generation phase, and an average of 96% of input hitting the cache. DeepInfer currently supports V4.1 Flash; the open-source version provides only offline inference, and the KV cache management and load balancing code has not yet been fully open-sourced because it is tied to internal infrastructure.

    DeepSeek open-sources its self-developed inference framework DeepInfer (Apache 2.0) and the production-grade Token codec component deepseek-recipe (MIT), supporting DeepSeek V4.1 Flash in serving 155 trillion Tokens per day on a single cluster. Official online statistics show an average of 77K Tokens input per request, a time to first token of about 400 milliseconds, 230 Tokens output per second during the generation phase, and an average of 96% of input hitting the cache. DeepInfer currently su

    Matched fieldsTitle、Summary、Body

    #hot-signal#English text is being prepared.#Reasoning#English text is being prepared.