MiniCPM-V 4.7 获 vLLM v0.32.0 支持
🚀 MiniCPM-V 4.7 is now supported in vLLM v0.32.0! Thanks @vllm_project for the support. This makes it easier to serve MiniCPM-V 4.7 with high throughput and low
面壁智能宣布 MiniCPM-V 4.7 已在 vLLM v0.32.0 中获得支持，并感谢 vLLM 项目。其表示这将更便于以高吞吐、低延迟的方式部署 MiniCPM-V 4.7。
查看原帖🚀 vLLM v0.32.0 is out! 814 commits · 363 contributors · 121 first-timers 🧭 New /v1/systemone structured-decision endpoint + generic hf tool/reasoning parser 🗜️ Low-precision KV everywhere: NVFP4 on SM8x/90/12x, FP8 KV default for GLM-5.x, 4-bit KV on ROCm 🛠️ Model Runner V2: GPU n-gram speculator, Elastic EP, PP+CP for MLA, now default on ROCm ⚡ Faster…
展开完整原文
🚀 vLLM v0.32.0 is out! 814 commits · 363 contributors · 121 first-timers 🧭 New /v1/systemone structured-decision endpoint + generic hf tool/reasoning parser 🗜️ Low-precision KV everywhere: NVFP4 on SM8x/90/12x, FP8 KV default for GLM-5.x, 4-bit KV on ROCm 🛠️ Model Runner V2: GPU n-gram speculator, Elastic EP, PP+CP for MLA, now default on ROCm ⚡ Faster startup & serving: precompiled kernel downloads, autotune preload, +43–85% req/s with multi-API workers 🆕 EmbeddingGemma 2, MiniCPM-V 4.7, Nemotron 3.5 ASR 🔒 3 security fixes + CORS hardening Full notes → https://t.co/ysTlctnYNn
正文
当前显示原文，中文全文译文尚未就绪。
🚀 MiniCPM-V 4.7 is now supported in vLLM v0.32.0! Thanks @vllm_project for the support. This makes it easier to serve MiniCPM-V 4.7 with high throughput and low latency.