Meta custom AMD GPU has half compute units, 1/3 memory of standard MI450
Research firm SemiAnalysis reports that Meta has received a custom version of the AMD Instinct MI450 architecture GPU accelerator with significant differences from the standard model.
Research firm SemiAnalysis states that Meta has received a customized version of the AMD Instinct MI450 architecture GPU accelerator. This custom variant features a design that significantly diverges from the standard MI455.
The standard Instinct MI455 includes eight compute chips on TSMC's N2 process and twelve 12-Hi 36GB HBM4 memory stacks, totaling 432GB. In contrast, Meta's custom version incorporates only four compute chips and six 8-Hi 24GB HBM4 memory stacks. Consequently, Meta's customized version possesses half the compute units and one-third the memory capacity of the standard MI455.
SemiAnalysis suggests this custom design aims to improve the CPU:GPU compute ratio in rack-level systems and enhance memory bandwidth cost-efficiency. These adjustments are intended to boost performance for Meta's RecSys recommendation systems.
However, the analysis firm notes that this modified design is not conducive to Large Language Model (LLM) training or inference workloads.