张小珺建议联看本集与昇腾廖恒博士访谈，理解跨层级 co-design
建议把这集和上一集（对话昇腾廖恒博士）一起收看，能够收获打通各个层级，融会贯通的co-design知识，对当下模型训练也应该有启发！📖
张小珺建议将本集与上一集对话昇腾廖恒博士的内容一同观看，以理解贯通不同层级的 co-design 知识。这些内容可能为当前的模型训练提供启发。
查看原帖This episode dives systematically into the co-design of models and infrastructure. Kaichao You shared a vivid analogy: comparing tokens to electricity. Hardware represents natural resources such as wind and water power. Models are power generators, including wind turbines and hydroelectric generators. The inference engine acts as the power grid system.…
展开完整原文
This episode dives systematically into the co-design of models and infrastructure. Kaichao You shared a vivid analogy: comparing tokens to electricity. Hardware represents natural resources such as wind and water power. Models are power generators, including wind turbines and hydroelectric generators. The inference engine acts as the power grid system. The depth of co-design dictates power generation efficiency. For areas with rapid water currents, what generator design can best harness this energy? You Kaichao: vLLM, Open-Source Infra, Model Co-Design & Journey from Com... https://t.co/V5SYBtNeYj 来自 @YouTube
正文
建议把这集和上一集（对话昇腾廖恒博士）一起收看，能够收获打通各个层级，融会贯通的co-design知识，对当下模型训练也应该有启发！📖