Nvidia's Vera Rubin Platform Drives Up TLC NAND Prices
The expanded production of Nvidia's Vera Rubin platform is now influencing spot prices for TLC NAND memory. Specifically, prices for 512Gb TLC NAND have risen back above $21.
The significant expansion in production of Nvidia's new Vera Rubin platform is now impacting previously less-connected segments of the supply chain, specifically the spot market for TLC NAND memory.
Spot prices for 512Gb TLC NAND have rebounded above $21, after dipping below this mark in June. This price increase is largely attributed to Nvidia's Context Memory eXtension (CMX) technology integrated into the Vera Rubin platform, which substantially boosts NAND memory consumption. Simultaneously, rising demand for enterprise-grade SSDs is contributing to tighter supply.
The Vera Rubin platform utilizes CMX technology to enhance AI model performance by creating a large buffer of TLC flash memory. This buffer connects to Rubin GPU clusters via Nvidia's Spectrum-X Ethernet and is managed by the BlueField-4 DPU. A single 2U CMX server can accommodate up to 600 terabytes of TLC flash memory.
The surge in demand, coupled with performance requirements for enterprise SSDs, is tightening the supply of TLC NAND. While Nvidia typically secures its NAND supply through long-term contracts, the price movement in the spot market indicates increased demand pressure. Bank of America has also refuted rumors of reduced HBM memory in the Vera Rubin Ultra version, suggesting it might only be a temporary measure to address supply constraints.