AMD has introduced a series of new AMD Instinct AI accelerators for data centers. In addition, the chip giant also announced the new Ryzen 8040 series for AI PCs and laptops.
For data centers, AMD is introducing two new AI accelerator processors within the Instinct line: the AMD Instinct MI300X and MI300A. The AMD Instinct MI300X runs on the new AMD CDNA 3 architecture. This architecture offers more compute power units, 1.5 times more memory capacity and 1.7 times more theoretical memory bandwidth than previous AMD Instinct AI accelerators. It also supports new formats such as FO8 and Sparsity for AI and HPC workloads.
According to the chip manufacturer, the new AI accelerators can be used primarily to support ever-expanding LLMs. An AI platform consisting of eight AMD MI300X accelerators provides 1.5 TB of HBM3 memory capacity for this purpose.
OEM providers can additionally easily build the new AI accelerator into existing AI products, simplifying and accelerating the rollout of AMD Instinct AI accelerator-based servers.
AMD MI300 Accelerators
The also unveiled AMD Instinct MI300A APUs run on a fourth-generation AMD Infinity architecture and feature AMD CDNA 3 processor cores, the latest generation AMD Zen 4 CPU cores and 128 GB of next-generation HBM3 memory. Again, these AI accelerators offer more and higher performance for HPC and AI workloads than previous models.
Furthermore, AMD introduced the ROCm 6 open software platform for the new AI accelerators. This software should help accelerate AI acceleration and also provides capabilities to support generative AI tooling.
New Ryzen processors for AI PCs
In addition to the new products in the AMD Instinct series of AI accelerators, the chip giant also introduced Ryzen 8084 processors. These processors should soon form the basis of AI PCs and especially laptops that OEM manufacturers will release. They are a competitor to the previously announced Intel Meteor Lake processors.
According to AMD, these AMD Ryzen processors should make especially large AI models run faster. For example, the new processor would allow Meta’s Llama 2 to run up to 1.4 times faster compared to previous AMD Ryzen AI processors announced in the second quarter of this year.
AMD additionally announced that in early 2024 it will launch the “Strix Point” processors that should further improve AI computing power. This is based on its own XDNA 2 architecture.
Tip: AMD responds to ‘industrial mega-trends’ with powerful embedded chips
17 hours ago
