Apple 提出 Minions：用闲置 Apple Silicon 设备构建分布式虚拟 GPU 云
Minions: A Dynamic and Distributed Virtual GPU Cloud Built on Idle Apple Silicon Devices - Apple Machine Learning Research
Apple 论文提出 Minions，一个动态分布式虚拟 GPU 云，将多台 macOS 设备上闲置的 Apple Silicon GPU 聚合起来执行大规模机器学习推理任务，让团队无需额外采购 GPU 即可利用现有硬件。系统提供灵活的 GPU 推理任务执行、容错能力和高效资源利用率，在集中式 GPU 资源受限的环境中，闲置 macOS 设备可被转化为实用的分布式 GPU 推理平台。
正文
当前显示原文，中文全文译文尚未就绪。
View publication
Copy Bibtex
The increasing demand for GPU-accelerated machine learning inference has exposed limitations in centralized GPU infrastructures, including high cost, limited elasticity, and long wait times under resource constraints. At the same time, modern Apple Silicon–based macOS devices are equipped with powerful GPUs that remain largely idle during normal usage. This paper presents Minions, a dynamic and distributed virtual GPU cloud that aggregates idle Apple Silicon GPUs across macOS devices to execute large-scale machine learning inference workloads. Minions enables teams to leverage existing hardware without requiring additional GPU procurement. The system provides flexible GPU inference task execution, fault tolerance, and efficient resource utilization. Our experience shows that idle macOS devices can be transformed into a practical distributed GPU inference platform in environments where centralized GPU resources are constrained.
Related readings and updates.
Exploring LLMs with MLX and the Neural Accelerators in the M5 GPU
November 19, 2025
Mac with Apple silicon is increasingly popular among AI developers and researchers interested in using their Mac to experiment with the latest models and techniques. With MLX, users can explore and run LLMs efficiently on Mac. It allows researchers to experiment with new inference or fine-tuning techniques, or investigate AI techniques in a private environment, on their own hardware. MLX works with all Apple silicon systems, and with the latest…
December 18, 2024
Accelerating LLM inference is an important ML research problem, as auto-regressive token generation is computationally expensive and relatively slow, and improving inference efficiency can reduce latency for users. In addition to ongoing efforts to accelerate inference on Apple silicon, we have recently made significant progress in accelerating LLM inference for the NVIDIA GPUs widely used for production applications across the industry…
Discover opportunities in Machine Learning.
Our research in machine learning breaks new ground every day.
Work with us