Ollama 发布官方 Docker 镜像
Ollama is now available as an official Docker image · Ollama Blog
Ollama 成为 Docker 官方赞助的开源镜像，用户可在 Docker 容器中运行大语言模型，所有交互在本地完成，不向第三方服务发送私有数据。在 Linux 上，Ollama 可在容器内借助 Nvidia GPU 加速运行，需先安装 Nvidia container toolkit；在 Mac 上则需以独立应用方式运行，因为 Docker Desktop 不支持 GPU。容器内可直接运行 Llama 2 等模型，更多模型见 Ollama library。
正文
当前显示原文，中文全文译文尚未就绪。
October 5, 2023
We are excited to share that Ollama is now available as an official Docker sponsored open-source image, making it simpler to get up and running with large language models using Docker containers.
With Ollama, all your interactions with large language models happen locally without sending private data to third-party services.
On the Mac
Ollama handles running the model with GPU acceleration. It provides both a simple CLI as well as a REST API for interacting with your applications.
On the Mac, please run Ollama as a standalone application outside of Docker containers as Docker Desktop does not support GPUs.
On Linux
Ollama can run with GPU acceleration inside Docker containers for Nvidia GPUs.
CPU only
Nvidia GPU
Install the Nvidia container toolkit; Run Ollama inside a Docker container
Run a model
Now you can run a model like Llama 2 inside the container.
More models can be found on the Ollama library.
Join Ollama’s Discord to chat with other community members, maintainers, and contributors.
Follow Ollama on Twitter for updates.