AMD Introduces The Most Powerful AI Accelerator MI325X
AMD Instinct 300 AI accelerators offer a market-record memory capacity of up to 192 GB, and now the company has announced that it will release a model with 288 GB of memory this year.
The Instinct MI325X will offer 288GB of memory, which is 96GB more than the MI300X. More importantly, the use of the new HBM3e memory provides an increase in bandwidth to 6.0 TB/s – 700 GB/s more than the MI300X with HBM3. AMD notes that the transition to new memory will provide the MI325X with 1.3 times higher inference performance (the work of an already trained neural network) and token generation compared to the Nvidia H200.
MI350X should provide a 35x increase in AI performance compared to CDNA3, while CDNA3 only provided an 8x increase.
The MI325X is scheduled for release in the fourth quarter of this year, while the MI350 is expected in 2025. In addition, AMD announced that the MI400 with CDNA-Next architecture will appear in 2026.
