Marvell's photonic module puts HBM memory up to 50 meters away from the GPU
Marvell's Dave Lazovsky demonstrated a photonic module that can move HBM + DDR high-bandwidth memory up to 50 meters away from the GPU, compared with the traditional distance of just 1.5 mm. Latency stays in the hundreds of nanoseconds, close to practical memory access levels. Memory and compute can thus scale independently, and AI clusters no longer need to lock large-capacity memory inside the accelerator package.
Body
Marvell’s Dave Lazovsky is holding a tiny module that uses photonics to move high-bandwidth memory (HBM + DDR) as far as 50 meters away from the GPU.
this can sit up to 50 meters from a GPU instead of the usual 1.5 mm.
For the first time, memory no longer has to live right next to compute, letting AI clusters share massive capacity without being locked to the accelerator package.
Latency stays in the hundreds of nanoseconds, close enough for practical memory use. Basically, Memory and compute now scale on separate axes instead of being locked together. https://t.co/jl7wyH9gfd