Hugging Face 发布 Llama Windows 本地推理桌面应用
Hugging Face Releases Llama Windows - Thurrott.com
Hugging Face 发布免费开源的 Windows 11 桌面应用 Llama Windows，把 llama.cpp 本地推理库带到 Windows，类似 Mac 上的 llama.app。用户可从 Hugging Face Hub 一键下载模型并在本地运行，无需终端、构建步骤或管理员权限，应用以系统托盘形式运行，也可用 Alt + Space 打开助手窗口。该应用原生支持 Windows 11 on Arm 和新的 Nvidia RTX Spark 平台，使用 WinUI3 编写，并内置 llama.cpp 服务器、Hugging Face Hub 客户端和模型目录的 .NET 库。
推荐理由
AI 评分 67
Hugging Face 把 llama.cpp 的本地推理封装成 Windows 桌面应用，读者可了解本地模型在 Windows 上的使用门槛变化。
主题
正文
当前显示原文，中文全文译文尚未就绪。
Google Tag Manager (noscript)
End Google Tag Manager (noscript)
Llama Windows is a free, open source desktop app that brings the llama.cpp local AI inferencing library to Windows 11, similar to the llama.app on Mac.
“With Llama Windows, you can pick a model from the Hugging Face Hub, download it in one click, and run it locally from the notification area,” the Hugging Face announcement explains. “No terminal, no build step, no admin rights.”
Llama Windows launches with native support for Windows 11 on Arm and the new Nvidia RTX Spark computer platform. And if you’ve ever used local AI on Windows, which means you’ve struggled to use local AI on Windows, you may understand why this app is so important: It removes the complexity and makes interacting with locally installed AI models relatively seamless.
As Hugging Face describes it, llama.cpp is a de facto standard for running open weight AI models locally on a computer, and it’s the source of the GGUF format for interacting with local models hosted on the Hugging Face Hub. And one of the nicer things about it is that it will recommend local AI models that are optimized for your PC’s hardware capabilities.
Llama Windows installs as a system tray app, so you typically interact with it via a system tray icon and a small pop-up window that lets you browse the local models installed on your PC. Or, you can type Alt + Space, arguably the most overused keyboard shortcut in Windows, to access a more traditional AI assistant-type app window. It was written as a native Windows app using WinUI3, and it includes .NET libraries for the llama.cpp server, the Hugging Face Hub client, and the model catalog.
You can learn more and download Llama Windows from the Hugging Face website.