阶跃星辰参与 vLLM AFD 插件开源
Proud to be part of this collaboration! 🎉 Huge thanks to the vLLM team, Ant Group, and FastAFD. Excited to bring AFD to the open-source community.
很荣幸参与这次合作！🎉 非常感谢 vLLM 团队、蚂蚁集团和 FastAFD。很高兴将 AFD 带给开源社区。
查看原帖🎉 Congrats to the teams behind vLLM AFD Plugin (Ascend & vLLM, @StepFun_ai, @AntGroup, FastAFD): a new experimental plugin under vllm-project that brings Attention-FFN Disaggregation to MoE serving. Attention and the expert/FFN path are two very different workloads that normally share one topology. AFD runs them as separate services, so you can scale…
展开完整原文
🎉 Congrats to the teams behind vLLM AFD Plugin (Ascend & vLLM, @StepFun_ai, @AntGroup, FastAFD): a new experimental plugin under vllm-project that brings Attention-FFN Disaggregation to MoE serving. Attention and the expert/FFN path are two very different workloads that normally share one topology. AFD runs them as separate services, so you can scale attention and experts independently. Same vLLM serving surface, no fork. @NVIDIA GPU and Ascend NPU.
正文
当前显示原文，中文全文译文尚未就绪。
Proud to be part of this collaboration! 🎉 Huge thanks to the vLLM team, Ant Group, and FastAFD. Excited to bring AFD to the open-source community.