Inception 的 Mercury 扩散 LLM 上线 Azure AI Foundry

Today, we're thrilled to announce that Mercury is available on Azure AI Foundry, bringing the first commercial-scale diffusion large language model (dLLM) to enterprise developers. This release combines Inception's breakthrough diffusion architecture with Azure's enterprise-ready infrastructure, giving developers access to a model that delivers both exceptional speed and quality.

Built by the team behind foundational AI technologies including Flash Attention, Direct Preference Optimization, and the original diffusion models for images, Mercury represents a fundamental shift in how language models generate text. Developers on Azure AI Foundry now have access to a model that redefines what's possible in real-time AI applications.

Traditional language models generate text sequentially, one token at a time. This creates an inherent bottleneck where each token must wait for all previous tokens to be generated. Mercury uses a diffusion-based architecture to generate multiple tokens in parallel, enabling dramatically faster inference. The result: Mercury runs up to 10x faster than comparable autoregressive models.

Performance: Speed & Quality

Mercury provides frontier quality with unparalleled speeds. Across knowledge, coding, instruction following, and mathematical benchmarks, Mercury performs on par with models like Gemini 2.5 Flash and Claude 4.5 Haiku, while running up to 10x faster.

Enterprise-Ready on Azure

Mercury on Azure AI Foundry is production-ready out of the box. It features a 128K token context window for processing large documents and maintaining extensive conversations, with native tool calling and structured output support using JSON schemas for building agentic workflows. The API is OpenAI-compatible, making integration with existing codebases seamless.

Azure AI Foundry provides enterprise-grade infrastructure, including network isolation, data privacy guarantees ensuring your data stays in your Azure environment and is never used for training, Azure compliance standards including SOC2 and HIPAA, and comprehensive observability through Azure Monitor and Application Insights.

Real-World Use Cases

Mercury's speed-quality combination makes applications faster and more responsive:

Coding assistants: Stay in flow with responsive autocomplete, intelligent tab suggestions, fast chat responses, and more; Real-time voice agents: Engage naturally with AI for customer support, translation, and beyond; Seamless enterprise workflows: Automate complex routing, analytics, and decision processes with ultra-responsive AI; Rapid enterprise search: Instantly surface the right data from across your organization’s knowledge base

Deploy on Azure AI Foundry

Mercury is available in the US and Canada regions through Azure AI Foundry. Deployment is straightforward—provision your model endpoint and configure your infrastructure through Azure AI Foundry's unified catalog. The Mercury software license costs $0.78/hour, with compute costs billed separately through your Azure account based on the resources you provision.

Azure AI Foundry Integration:

Mercury integrates seamlessly with the broader Azure ecosystem. Deploy using Azure AI Foundry's model catalog, apply Azure AI Content Safety for content filtering, monitor performance and costs in real-time, manage access with Azure RBAC and managed identities, and build multi-model applications using Azure's agent framework.

Navigate to Azure AI Foundry’s Model Catalog, search for Mercury, and click on the model card. Alternatively, you can visit our model card here; Click on Use this model, choose a project, and follow along the UI prompts to provision your desired capacity; While the default configuration should work for most developers, we recommend choosing ND-H100-v5 instances for optimal speeds. The deployment should take a few minutes to finish

That’s it! You should now be able to start building with your newly provisioned API endpoint:

In Python:

The launch of Mercury on Azure AI Foundry marks a turning point for production AI applications. Developers no longer have to choose between speed and quality, between real-time responsiveness and frontier-model capabilities.

For detailed documentation, benchmarks, and integration guides, visit the Mercury model card in Azure AI Foundry.

Mercury 2 for Search: Fast enough to run a hundred times per query