←Search results

By relevance · Total 30 results Clear search

Saturday

  1. Huxiu

    Kimi K3.1 Pro Released: Capabilities Improved, but Price Is 16 Times That of DeepSeek and MiniMax Flash

    Moonshot AI released Kimi K3.1 Pro on October 24, retaining K3's 2.8 trillion parameters without redoing pretraining, and raised its Artificial Analysis composite intelligence index from about 44 to about 55 by increasing post-training compute and joint reinforcement learning across hundreds of domains. Its pricing is $2 and $10 per million input/output tokens, or $12 for 1 million tokens each, 16 times the $0.75 idle-time rate of MiniMax M3.1 Flash and DeepSeek V4.1 Flash-1017. The article also compares the three vendors' respective reinforcement in 3D modeling and financial research, full project development, and computer operation and cross-application workflows, and notes that some users report 3D tasks consume tokens so fast that they hit the quota limit.

    arning across hundreds of domains. Its pricing is $2 and $10 per million input/output tokens, or $12 for 1 million tokens each, 16 times the $0.75 idle-time rate of MiniMax M3.1 Flash and DeepSeek V4.1 Flash-1017. The article also compares the three vendors' respective reinforcement in 3D modeling and financial research, full project development, and computer operation and cross-application workflows, and notes that some users report 3D tasks consume tokens so fast that they hit the quota limit.

    Matched fieldsTitle

  2. Nathan Lambert

    Nathan Lambert: DeepSeek processes 150T tokens per day on a single cluster, more than the combined total of several open-source inference platforms

    Nathan Lambert says DeepSeek processes 150T tokens per day on a single cluster, more than the combined open-source model inference volume on OpenRouter, Fireworks, Together, and BaseTen. He also posted a reconstructed comparison chart of his own based on these companies' inference volume reports, and noted that this figure corresponds to only a single cluster; it remains unclear how many clusters DeepSeek actually has.

    Matched fieldsTitle

  3. Story3 reports · 3 facts

    DeepSeek open-sources inference framework DeepInfer

    On October 20, 2026, DeepSeek open-sourced its internal inference framework DeepInfer. According to Yuchen Jin, citing data disclosed by DeepSeek, a single cluster processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour (off-peak pricing); DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. A subsequent 36Kr report stated that its accompanying open-source deepseek-recipe supports NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs. On October 21, swyx, citing Latent.Space data, said a single cluster processes 155T tokens per day with a 96% input cache hit rate, and argued that the lifetime value of each sold GPU has risen by about 30%. On October 24, Nathan Lambert said DeepSeek's single cluster processes 150T tokens per day, exceeding the combined open-source model inference volume of OpenRouter, Fireworks, Together, and BaseTen, and noted that the actual number of clusters is unknown; on the same day, LMSYS published a same-hardware benchmark comparison, stating that SGLang meets or exceeds DeepInfer on DeepInfer's own benchmark, with prefill throughput up to 1.04x and decode step length shortened by 1.1%–7.4% on 64x GB300.

    On October 20, 2026, DeepSeek open-sourced its internal inference framework DeepInfer. According to Yuchen Jin, citing data disclosed by DeepSeek, a single cluster processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour (off-peak pricing); DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. A subsequent 36Kr report stated that its accompanying open-source deepseek-recipe supports NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs. On October 21, swyx, citing Latent.Spac

    Matched fieldsTitle

Friday

  1. 36Kr · AI

    Liang Wenfeng needs his own Tibo: DeepSeek product department integration and the Agent path

    DeepSeek has integrated the Harness with the web, App, and open platform teams into a product department, led by Cui Tianyi, and the official website has posted recruitment positions in two directions: AI product manager and Agent Harness. The article uses OpenAI Codex lead Tibo Sottiaux and the Anthropic Claude Code team as examples to explain how the execution capabilities of coding tools can be extended into a general work task entry point. DeepSeek, while open-sourcing Harness and the inference framework DeepInfer, is also facing cost pressure on caching and transmission brought by long tasks.

    DeepSeek has integrated the Harness with the web, App, and open platform teams into a product department, led by Cui Tianyi, and the official website has posted recruitment positions in two directions: AI product manager and Agent Harness. The article uses OpenAI Codex lead Tibo Sottiaux and the Anthropic Claude Code team as examples to explain how the execution capabilities of coding tools can be extended into a general work task entry point. DeepSeek, while open-sourcing Harness and the infere

    Matched fieldsTitle

Wednesday

  1. Swyx

    swyx on DeepSeek GPU revenue data: lifetime value per card up about 30%

    Citing DeepSeek production data disclosed by Latent.Space, swyx says a single cluster processes 155T tokens per day with a 96% input cache hit rate, yielding $38 in revenue per GPU-hour at off-peak prices. He believes this raises the lifetime value of every GPU sold by about 30%, corresponding to roughly $600 billion in market value potential, and jokes that the more you buy, the more you earn.

    Matched fieldsTitle

  2. Yuchen JinSelected

    DeepSeek's single cluster processes 155 trillion tokens per day, generating $38 in revenue per GPU-hour

    Yuchen Jin, citing data disclosed by DeepSeek, said that a single cluster currently processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour (off-peak pricing). He noted that DeepSeek has not only open-sourced its inference engine but also disclosed revenue figures, though it did not specify which GPU models were used; DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. Based on an estimated B300 rental price of $7 per GPU-hour, the gross margin is approximately 82%.

    Yuchen Jin, citing data disclosed by DeepSeek, said that a single cluster currently processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour (off-peak pricing). He noted that DeepSeek has not only open-sourced its inference engine but also disclosed revenue figures, though it did not specify which GPU models were used; DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. Based on an estimated B300 rental price of $7 per GPU-hour, the gross margin is approximately 82

    Matched fieldsTitle

Monday

Tuesday

Saturday

Wednesday

Sunday

Sunday

Sunday

Sunday

Thursday

Thursday

Friday

  1. Story1 reports · 0 facts

    DeepSeek open-sources the inference engine DeepInfer on GitHub

    On October 29, 2026, DeepSeek open-sourced the inference engine DeepInfer on GitHub; this engine is the inference engine behind DeepSeek-V4.1-Flash. Leiphone reported the same day that DeepInfer includes technologies such as MoE expert parallelism, asynchronous batch scheduling, custom kernels, and speculative decoding, and disclosed that a single cluster needs to process approximately 155 trillion tokens per day. Its Zero-Overhead Batch Scheduler lets the CPU schedule computation one round in advance, overlapping with GPU forward passes, and handles cross-round state misalignment through total_inflight_tokens accounting, Remap mapping, and DeferredRelease deferred reclamation. Currently, only offline inference capabilities are open; components such as online KV Cache storage and cross-replica load balancing have not yet been fully disclosed, and the official team has not separately published end-to-end speedup data for this scheduling mechanism relative to synchronous solutions.

    On October 29, 2026, DeepSeek open-sourced the inference engine DeepInfer on GitHub; this engine is the inference engine behind DeepSeek-V4.1-Flash. Leiphone reported the same day that DeepInfer includes technologies such as MoE expert parallelism, asynchronous batch scheduling, custom kernels, and speculative decoding, and disclosed that a single cluster needs to process approximately 155 trillion tokens per day. Its Zero-Overhead Batch Scheduler lets the CPU schedule computation one round in a

    Matched fieldsTitle

Sunday

  1. FactRelated story

    Nathan Lambert says DeepSeek processes 150T tokens per day on a single cluster

    On October 20, 2026, DeepSeek open-sourced its internal inference framework DeepInfer. According to Yuchen Jin, citing data disclosed by DeepSeek, a single cluster processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour (off-peak pricing); DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. A subsequent 36Kr report stated that its accompanying open-source deepseek-recipe supports NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs. On October 21, swyx, citing Latent.Space data, said a single cluster processes 155T tokens per day with a 96% input cache hit rate, and argued that the lifetime value of each sold GPU has risen by about 30%. On October 24, Nathan Lambert said DeepSeek's single cluster processes 150T tokens per day, exceeding the combined open-source model inference volume of OpenRouter, Fireworks, Together, and BaseTen, and noted that the actual number of clusters is unknown; on the same day, LMSYS published a same-hardware benchmark comparison, stating that SGLang meets or exceeds DeepInfer on DeepInfer's own benchmark, with prefill throughput up to 1.04x and decode step length shortened by 1.1%–7.4% on 64x GB300.

    Matched fieldsTitle

    View story:DeepSeek open-sources inference framework DeepInfer