Marvell 光子模块让 HBM 内存远离 GPU 达 50 米
Marvell’s Dave Lazovsky is holding a tiny module that uses photonics to move high-bandwidth memory (HBM + DDR) as far as 50 meters away from the GPU.
Marvell 的 Dave Lazovsky 展示了一个光子模块，可将 HBM + DDR 高带宽内存搬到距 GPU 最远 50 米处，而传统距离仅 1.5 mm。延迟保持在数百纳秒级，接近实用内存访问水平。内存与算力由此可独立扩展，AI 集群无需再把大容量内存锁在加速器封装内。
正文
Marvell’s Dave Lazovsky is holding a tiny module that uses photonics to move high-bandwidth memory (HBM + DDR) as far as 50 meters away from the GPU.
this can sit up to 50 meters from a GPU instead of the usual 1.5 mm.
For the first time, memory no longer has to live right next to compute, letting AI clusters share massive capacity without being locked to the accelerator package.
Latency stays in the hundreds of nanoseconds, close enough for practical memory use. Basically, Memory and compute now scale on separate axes instead of being locked together. https://t.co/jl7wyH9gfd