Understand this story
Story summary
The English summary is being updated. See the reporting timeline below.
Latest development · Report
How Marvell and Penguin Use Photonic Technology and Shared Memory Pools to Alleviate AI Memory BottlenecksDevelopments
1 confirmed developments
- Source:SiliconANGLE
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 18
SiliconANGLE
How Marvell and Penguin Use Photonic Technology and Shared Memory Pools to Alleviate AI Memory Bottlenecks
Marvell and Penguin are using photonic interconnects and shared memory pools to alleviate data-waiting delays and low GPU utilization in AI inference. The MemoryAI Photonic Appliance can provide 16 terabytes of HBM and DDR5 tens of meters away from GPUs for sharing across multi-rack servers. More than 80 percent of scale-up network traffic consists of memory transactions, and the energy consumed by this data movement can be reduced to one-quarter of that required by copper-based solutions.
AI Trends