FastVideo 融合 DiT kernel 优化
(7/13) Fused DiT kernels:
AI 导读
(7/13) 融合 DiT kernel： - Q/K RMSNorm、RoPE、tile pooling 和 packing 一次完成，直接写入 attention kernel 的缓冲区 - fine 与 gated coarse attention 直接合并进 all-to-all 发送缓冲区 - AdaLN modulation、RMSNorm 和 gated residuals 融合
正文
当前显示原文，中文全文译文尚未就绪。
(7/13) Fused DiT kernels: - Q/K RMSNorm, RoPE, tile pooling and packing in one pass, written straight into the attention kernels' buffers - fine and gated coarse attention combined directly into the all-to-all send buffer - AdaLN modulation, RMSNorm and gated residuals fused