goose 上线 Mesh LLM，可点对点共享算力运行开源模型
Mesh LLM in goose: routing across models | goose | Your open source AI agent
goose 官方博客宣布 Mesh LLM 已作为 goose 的一个选项上线，用于访问和共享开源 LLM。它复用本地模式的 llama.cpp 基础设施运行模型，让用户把算力（哪怕只是一台笔记本）点对点连接起来，访问自己难以自托管的模型。官方还提供了一个公共 mesh，用户也可以自建私有网络汇集算力，mesh 会自行判断运行模型的最佳位置并按需下载，甚至以多种方式拆分计算。该项目仍处于早期阶段，官方希望获得反馈。
正文
当前显示原文，中文全文译文尚未就绪。
Quick note: Mesh LLM is now in goose as an option for accessing and sharing (open) LLMs with friends and family.
It uses the same llama.cpp infra as local mode to run models, with a twist.
What is Mesh LLM?
Mesh LLM is an associated project we're trying out that lets people connect their compute capacity (which may just be a laptop) peer-to-peer, so they can access models they may not otherwise be able to self-host.
There is a demo public "mesh" which at any point has some capacity in it, but you can also make your own private networks and pool compute together. The mesh will try to work out the best places to run models (downloading them as needed) and can even split the compute in various ways.
This is a pretty early-stage project, so we'd love any feedback on it.
Check out the project docs and the live public mesh.