←Search results

By relevance · Total 2011 results Clear search

Wednesday

  1. Analytics India Magazine

    Vultr to deploy a 20MW AMD MI355X GPU cluster in Chennai

    Cloud infrastructure company Vultr announced it will deploy a 20MW AMD MI355X GPU cluster in Chennai, India, which will be India's largest AMD Instinct GPU deployment and one of the largest in the world. The MI355X was released last June and features 288 GB of HBM3E memory, higher than the 180 GB of Nvidia B200. Vultr operates 34 cloud data center regions in 17 countries worldwide and plans to further expand next year, introducing next-generation MI455X GPUs and the Helios rack-scale AI architecture.

    infrastructure company Vultr announced it will deploy a 20MW AMD MI355X GPU cluster in Chennai, India, which will be India's largest AMD Instinct GPU deployment and one of the largest in the world. The MI355X was released last June and features 288 GB of HBM3E memory, higher than the 180 GB of Nvidia B200. Vultr operates 34 cloud data center regions in 17 countries worldwide and plans to further expand next year, introducing next-generation MI455X GPUs and the Helios rack-scale AI architecture.

    Matched fieldsSummary、Body

  2. X.PINSelected

    DeepSeek Open-Sources Its Internal Inference Framework DeepInfer

    DeepSeek has open-sourced its internal inference framework DeepInfer, which it says powers the high-throughput, low-latency inference of DeepSeek-V4.1-Flash. The framework supports both Nvidia and Huawei Ascend hardware, and offers capabilities such as distributed inference, speculative decoding, SWA Bounded Replay, and structured output. DeepSeek also released deepseek-recipe, a production-grade tokenization component fully aligned with the official API.

    Matched fieldsSummary、Body

  3. Tech.eu

    Scaleup Europe Fund Leads $250 Million Funding Round for Pigment

    French enterprise software startup Pigment has completed a $250 million funding round at a valuation of $2.3 billion, led by the Scaleup Europe Fund managed by EQT, with participation from Nvidia and new and existing investors including Greenoaks, Iconiq, IVP, and Meritech. Pigment provides an enterprise business planning platform, and its customers include Siemens, Unilever, Anthropic, and ElevenLabs. The funds from this round will be used to accelerate R&D and expand its engineering team.

    Matched fieldsSummary、Body

  4. Latent SpaceSelected

    DeepSeek open-sources the DeepInfer inference framework, processing 155 trillion tokens per day in a single cluster

    DeepSeek has open-sourced DeepInfer, its self-developed inference framework that supports DeepSeek-V4.1-Flash, and published production data: a single cluster processes 155 trillion tokens per day, 96% input cache hit rate, 400ms first-token latency, and 230 tokens/s generation speed. The framework is customized based on vLLM and supports distributed inference, speculative decoding, SWA Bounded Replay, and structured output, with target platforms NVIDIA SM100 and Huawei Ascend 950. DeepSeek also states that components such as KV cache management and load balancing are not yet fully open-sourced, while the vLLM team says that under a matching GB200 configuration, decoding throughput is within 6% of the results published by DeepInfer.

    latency, and 230 tokens/s generation speed. The framework is customized based on vLLM and supports distributed inference, speculative decoding, SWA Bounded Replay, and structured output, with target platforms NVIDIA SM100 and Huawei Ascend 950. DeepSeek also states that components such as KV cache management and load balancing are not yet fully open-sourced, while the vLLM team says that under a matching GB200 configuration, decoding throughput is within 6% of the results published by DeepInfer.

    Matched fieldsSummary、Body

  5. Latent Space

    DeepSeek open-sources the DeepInfer inference framework, processing 155 trillion tokens per day on a single cluster

    DeepSeek has open-sourced DeepInfer, the production inference framework supporting V4.1 Flash, and published production data including 155 trillion tokens processed per day on a single cluster, a 96% input cache hit rate, an average 400ms time to first token, and 230 tokens/s generation. The framework is customized based on vLLM and uses the Apache 2.0 license, supports distributed inference, speculative decoding, SWA Bounded Replay and structured output, and targets NVIDIA SM100 and Huawei Ascend 950. DeepSeek says components such as KV cache management and load balancing are not fully open-sourced because they are coupled with internal infrastructure, while the vLLM team reports that under matched GB200 configurations, decoding throughput differs from DeepInfer's published results by less than 6%.

    framework is customized based on vLLM and uses the Apache 2.0 license, supports distributed inference, speculative decoding, SWA Bounded Replay and structured output, and targets NVIDIA SM100 and Huawei Ascend 950. DeepSeek says components such as KV cache management and load balancing are not fully open-sourced because they are coupled with internal infrastructure, while the vLLM team reports that under matched GB200 configurations, decoding throughput differs from DeepInfer's published result

    Matched fieldsSummary、Body

  6. Rohan PaulSelected

    WSJ sees Anthropic IPO draft: half-year revenue $16.3 billion, compute commitments about $450 billion

    The Anthropic IPO draft seen by WSJ shows half-year revenue of $16.3 billion, a book loss of $80.7 billion, and compute commitments of about $450 billion. The draft discloses fixed payments of $252 billion to three major cloud providers over the next 7 to 10 years, including $111 billion to Google, $110 billion to AWS, and $31 billion to Microsoft, payable whether or not used. There is also over $160 billion in Google chip leasing (via Broadcom) and up to $86 billion in Nvidia GPU rental, plus $150 billion in deals under negotiation.

    ws half-year revenue of $16.3 billion, a book loss of $80.7 billion, and compute commitments of about $450 billion. The draft discloses fixed payments of $252 billion to three major cloud providers over the next 7 to 10 years, including $111 billion to Google, $110 billion to AWS, and $31 billion to Microsoft, payable whether or not used. There is also over $160 billion in Google chip leasing (via Broadcom) and up to $86 billion in Nvidia GPU rental, plus $150 billion in deals under negotiation.

    Matched fieldsSummary、Body

  7. Yuchen JinSelected

    DeepSeek's single cluster processes 155 trillion tokens per day, generating $38 in revenue per GPU-hour

    Yuchen Jin, citing data disclosed by DeepSeek, said that a single cluster currently processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour (off-peak pricing). He noted that DeepSeek has not only open-sourced its inference engine but also disclosed revenue figures, though it did not specify which GPU models were used; DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. Based on an estimated B300 rental price of $7 per GPU-hour, the gross margin is approximately 82%.

    chen Jin, citing data disclosed by DeepSeek, said that a single cluster currently processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour (off-peak pricing). He noted that DeepSeek has not only open-sourced its inference engine but also disclosed revenue figures, though it did not specify which GPU models were used; DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. Based on an estimated B300 rental price of $7 per GPU-hour, the gross margin is approximately 82%.

    Matched fieldsSummary、Body

  8. Fortune Tech

    Billionaires Oppose California Tax Increase, Jensen Huang Says Paying $8 Billion in Taxes Over Five Years Is a "Privilege"

    Nvidia CEO Jensen Huang said that paying $8 billion in taxes over five years is a "privilege," and that he isn't afraid of paying taxes—only of becoming poor. As California battles over Prop 40, a one-time 5% tax on residents with assets over $1 billion, and some tech billionaires move out, he publicly called on people to "move to California, don't leave." He also opposes taxing robots and AI tokens.

    Matched fieldsSummary

Tuesday

  1. Tech.eu

    Daytona raises $60M Series B at a $1B valuation

    Daytona, which provides cloud infrastructure for AI agents, has raised a $60 million Series B at a $1 billion valuation, bringing its total funding to $91 million, with FirstMark leading the round. Its platform provides agents with isolated Linux, Windows, and macOS compute environments through a single API, supports pausing, resuming, and continuing exploration of tasks, and its customers include Anthropic, OpenAI, NVIDIA, Cursor, and Cognition. The company says its revenue run rate grew 25x from January to September, and the new funds will be used to expand its agent cloud platform, scale compute capacity, and hire in San Francisco, Croatia, and Singapore.

    th FirstMark leading the round. Its platform provides agents with isolated Linux, Windows, and macOS compute environments through a single API, supports pausing, resuming, and continuing exploration of tasks, and its customers include Anthropic, OpenAI, NVIDIA, Cursor, and Cognition. The company says its revenue run rate grew 25x from January to September, and the new funds will be used to expand its agent cloud platform, scale compute capacity, and hire in San Francisco, Croatia, and Singapore.

    Matched fieldsSummary、Body