←新闻详情

Ollama Blog更新于 10月14日 09:02

Ollama 0.30 发布:NVIDIA 性能提升 20%,默认启用 Vulkan 并增强 GGUF 支持

Improved performance and model support with GGUF · Ollama Blog

AI 导读

Ollama 0.30 发布,通过 llama.cpp 增强 GGUF 模型兼容性,并补充 Apple silicon 上的 MLX 引擎。NVIDIA 硬件性能最高提升 20%,实测使用 Gemma 4 26B 模型在 NVIDIA RTX 5090 上以 Q4_K_M 量化运行。Vulkan 现默认启用,将 GPU 加速扩展至 AMD 和 Intel 设备;同时新增对 LFM、Prism 及 Unsloth 微调模型的支持,并可直接运行 Hugging Face 上的 GGUF 模型。

正文

当前显示原文,中文全文译文尚未就绪。

June 5, 2026

Ollama 0.30 is now available with improved performance and GGUF model compatibility through llama.cpp. This augments Ollama’s MLX engine on Apple silicon, bringing support to more models on a wider range of hardware.

Performance across more GPUs

Faster throughput on NVIDIA hardware

With Ollama 0.30, performance on NVIDIA hardware is now up to 20% faster, leveraging optimizations contributed by the NVIDIA and llama.cpp teams.

Tested with the Gemma 4 26B model running on an NVIDIA RTX 5090 using the Q4_K_M quantization.

Wider hardware support with Vulkan

Vulkan is now enabled by default, extending Ollama’s GPU acceleration to a wider range of hardware, including AMD and Intel devices. More users can now run models on the GPU out of the box, without installing vendor-specific libraries.

Support for more models

Ollama 0.30 expands compatibility with the GGUF ecosystem, so more models run out of the box—including model families such as LFM and Prism, as well as fine-tuned models published by Unsloth.

Run GGUF models from Hugging Face

To use a model, first download the GGUF file or a directory containing GGUF files. Next, create a Modelfile with the FROM command pointing to the path of the GGUF file (or directory):

Then create and run the model:

Coding agents and assistants

If a model supports tool calling, that capability carries over to Ollama. You can use these models with your favorite coding agents and personal assistants in a single command.

To verify that a GGUF file supports tool calling, look for the tools capability with ollama show:

Acknowledgements

We’d like to acknowledge the work done by Georgi Gerganov and the llama.cpp maintainer teams, as well as hardware partners including NVIDIA, AMD, Qualcomm, and Intel, who have worked hard to optimize performance with the GGML ecosystem on their respective platforms.

If you have any feedback, join Ollama’s Discord or reach out at hello@ollama.com.

来源

Ollama Blog