GGUF 模型可直接在 transformers 中运行
Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility and performance. More
AI 导读
直接在 transformers 中运行 GGUF 模型。这项工作将 ggml 的 Metal kernel 引入 transformers 生态，提升了兼容性与性能。更多信息见下文
查看原帖Millions of GGUF downloads later, those same llama.cpp checkpoints can now run in 🤗 transformers. Same models, more ways to use them, and fast local inference on Mac powered by ggml kernels! Blog: https://t.co/AiD8iBRYmx ggml kernels: https://t.co/tkR5RraSbf https://t.co/OQs38mdthR
正文
当前显示原文，中文全文译文尚未就绪。
Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility and performance. More info below