English translation is being prepared.

English translation is being prepared.

View original

🚀 vLLM v0.32.0 is out! 814 commits · 363 contributors · 121 first-timers 🧭 New /v1/systemone structured-decision endpoint + generic hf tool/reasoning parser 🗜️ Low-precision KV everywhere: NVFP4 on SM8x/90/12x, FP8 KV default for GLM-5.x, 4-bit KV on ROCm 🛠️ Model Runner V2: GPU n-gram speculator, Elastic EP, PP+CP for MLA, now default on ROCm ⚡ Faster startup & serving: precompiled kernel downloads, autotune preload, +43–85% req/s with multi-API workers 🆕 EmbeddingGemma 2, MiniCPM-V 4.7, Nemotron 3.5 ASR 🔒 3 security fixes + CORS hardening Full notes → https://t.co/ysTlctnYNn