Hugging Face 与 OpenRouter 合作,语言模型请求改由 OpenRouter 路由
Hugging Face and OpenRouter join forces to make open-weight models easy to run
Hugging Face 与 OpenRouter 合作,语言模型请求改经 OpenRouter 路由,并按其价格计费到 Hugging Face 账户。新路由按价格、速度和可靠性综合选择供应商,失败请求会在同一次调用中换供应商重试,OpenRouter 测得容量错误下降 46%、首 token 时间改善 16.9%、吞吐提升 16.3%。同时不再支持为这些模型使用自有供应商 API key,图像、视频和音频生成仍走 Hugging Face Inference Providers。
推荐理由
精选AI 评分 68
原文给出路由改造后的错误率与延迟变化,并说明开源权重模型在成本上的取舍空间。
主题
正文
Run them with the tools you already use
The router supports OpenAI's Chat Completions and Responses APIs and Anthropic's Messages API for every chat model, whatever the provider behind it. Pick your coding agent or SDK and a model, then copy the steps, or copy the whole setup as a prompt for your agent:
The same Hugging Face token also gives you storage with Storage Buckets , compute with Jobs and dedicated inference with Inference Endpoints . PRO, Team and Enterprise plans include monthly credits for compute and inference.
How open-weight models are used
On OpenRouter, open-weight models went from 26.8% of the tokens served in October 2025 to 71.7% at the end of September 2026, after peaking at 77.5% in July ( OpenRouter, October 2026 ). Over the same period, weekly open-weight volume grew more than 60-fold, against almost tenfold for closed models. This week, the most used model on OpenRouter is an open-weight one, DeepSeek V4.1 Flash 1017, with 59.2 trillion tokens ( rankings ).
Open-weight models cost about four times less on average: $0.28 per million input tokens and $1.62 per million output tokens, against $1.27 and $6.36 for closed models.
The best open-weight models still trail the best proprietary ones on the hardest benchmarks. On the Artificial Analysis Intelligence Index , Kimi K3.1 Pro, the best open-weight model, scores 46 against 65 for Claude Fable 5.2, at about a seventh of the cost per task ($3.68 against $26.54). For a lot of workloads, that trade-off is worth it.
Routing powered by OpenRouter
OpenRouter serves more than 800 trillion tokens a month to over 10 million users, across 600+ models from 80+ providers. Its routing is based on live measurements of every provider across that traffic.
OpenRouter recently rebuilt its provider routing : instead of only looking at the lowest list price, it sends each request to the provider with the best mix of price, speed and reliability.
When a provider slows down or starts failing, traffic moves away from it until it recovers, and a failed try is retried on the next best provider inside the same call. In OpenRouter's measurements, the new routing cut capacity errors by 46% and improved time to first token by 16.9% and throughput by 16.3%.
Before, Inference Providers picked one provider for your request and returned its error if it failed. Now, the request is retried on another provider. You can still choose a policy or a provider with a suffix on the model id:
Routing is also cache-aware: a conversation stays on the provider that holds its prompt cache. To make it explicit, send a stable UUID per conversation in the X-HF-Session-Id header (see the prompt caching guide ).
Pricing doesn't change: you pay the provider's price on your Hugging Face bill, and Hugging Face doesn't add a markup on top of it. PRO users get $2 of credits every month, and Team and Enterprise organizations get $2 per seat. See Pricing and Billing for the details.
Image, video and audio generation
Image, video, and audio generation continue to work exactly as before, directly through Hugging Face Inference Providers without going through OpenRouter. You can keep using the same token and API, and access tens of thousands of LoRAs .
See where your requests go
On model pages, you can chat with the model right away in the widget. Two new tabs show what's behind it: Providers lists every provider OpenRouter can route the model to, with its input and output price, speed and uptime over the last 24 hours, and Metrics shows the best price, throughput, time to first token, context length and uptime among them:
Your usage overview breaks your spend down by the provider each request went to:
In your settings , you can turn off any provider you don't want: the router never sends your requests there. Organizations have the same settings, and they apply to every request billed to the organization.
Breaking change: custom provider keys
Requests to language models now go through OpenRouter and are billed to your Hugging Face account or organization, so you can no longer use your own API key for a provider with these models. You can still pick a provider with a suffix on the model id ( model:provider ) or turn providers off in your settings, and your code stays the same. Custom keys for image and video providers keep working.
What's next
This is the first step of our partnership with OpenRouter. Next:
Connect your OpenRouter account to Hugging Face.
More tasks routed through OpenRouter.
More Articles from our Blog
+4