Home / Technology / Meta's Memory Magic: Old RAM Gets New Life
Meta's Memory Magic: Old RAM Gets New Life
30 Jun
Summary
- Meta recycles retired DDR4 memory, bypassing expensive new DRAM.
- CXL technology enables reuse of discarded server memory capacity.
- Meta reported 25% fewer servers for machine learning inference workloads.
Meta has developed a groundbreaking method to reuse retired DDR4 memory from decommissioned servers, circumventing the need to purchase expensive new DRAM.
This strategy, enabled by Compute Express Link (CXL) technology, allows older memory modules to function alongside newer DDR5 pools, effectively expanding server capacity at a near-zero cost.
The company's internal ASIC, Vistara, is optimized for low latency and power efficiency, overcoming limitations of commercial CXL products.
This hardware-software co-design approach automatically manages memory ratios and disables expanded memory where latency is a concern.
Meta reported substantial benefits, including up to a 25% reduction in server counts for disaggregated machine learning inference workloads and significant latency improvements in distributed cache systems.
