MENU

AMD’s Helios AI Rack Challenges NVIDIA with HBM4 Memory Edge, Securing Microsoft as Customer; 2nm Process CPU Also Noted

TrendForce Taiwan
Overview
AMD’s ‘Helios AI Rack’ is challenging NVIDIA’s dominance in the AI market with its HBM4 memory advantage, securing Microsoft as a new key customer. The Helios rack is optimized for AI model training and inference, potentially offering a strong alternative to NVIDIA’s solutions. While SK Hynix is expected to supply a significant share of HBM4 for NVIDIA’s Rubin, there’s also potential for expansion within AMD’s ecosystem. Additionally, according to Commercial Times, ‘Venice’ will be one of the first enterprise CPUs built on TSMC’s 2nm process, with the Instinct MI450, MI455, and next-gen MI550 series also garnering significant attention.
In Depth

Key Findings

AMD’s ‘Helios AI Rack,’ leveraging the superiority of HBM4 memory, is challenging NVIDIA’s dominant position in the AI market, having secured Microsoft, a major cloud provider, as a new customer. This development signals an intensifying competition in the AI infrastructure market and offers a wider array of solutions for diverse customer needs.

Technical & Product Details

The Helios AI Rack is a rack-scale AI system that integrates AMD’s latest-generation AI accelerators with HBM4 memory. HBM4 offers higher bandwidth and greater capacity compared to its predecessor, HBM3, aiming to deliver performance that rivals or even surpasses NVIDIA’s GPU solutions for large-scale AI model training and inference. Microsoft’s adoption of the Helios AI Rack clearly indicates the high regard for AMD’s AI solutions in the market.

Regarding HBM4 supply, SK Hynix is expected to supply the majority of HBM4 for NVIDIA’s next-generation AI GPU, ‘Rubin.’ However, the increasing demand for HBM4 within AMD’s ecosystem could create further opportunities for SK Hynix’s supply expansion. Furthermore, AMD is also advancing the development of ‘Venice,’ an enterprise CPU built on TSMC’s 2nm process, slated to be one of the first CPUs to utilize this cutting-edge process node. The Instinct MI450, MI455, and next-generation MI550 series of AI accelerators are also attracting significant attention for their high performance and energy efficiency. These products are anticipated to play a crucial role in AMD’s increasing presence in the AI chip market.

  • **HBM4 Advantage:** High bandwidth and capacity of HBM4 are key differentiators for the Helios AI Rack against NVIDIA.
  • **Microsoft Adoption:** A major cloud provider’s integration of AMD’s AI rack proves its competitiveness in the market.
  • **2nm Process CPU:** The ‘Venice’ enterprise CPU, based on TSMC’s 2nm process, will strengthen AMD’s position in the high-end market.

Background & Context

The rapid advancement of AI is driving an explosive increase in demand for high-performance AI accelerators and their supporting infrastructure. While NVIDIA has historically held a dominant share in the AI GPU market, AMD is challenging this by offering comprehensive AI solutions that integrate its own CPU, GPU, and HBM technologies. Large cloud providers like Microsoft procuring AI hardware from multiple suppliers aim to diversify their supply chains and reduce vendor lock-in risks, fostering healthy competition across the industry.Strategic Significance & Outlook

AMD’s success in securing Microsoft as a customer for its Helios AI Rack significantly enhances its competitiveness in the AI infrastructure market. While competition with NVIDIA is expected to intensify, AMD is poised to expand its market share, leveraging its HBM4 technological superiority and diverse product portfolio (CPUs, GPUs, integrated systems). The success of the ‘Venice’ CPU, built on TSMC’s cutting-edge process node, and the Instinct series of AI accelerators are indispensable for AMD to establish itself as a major player in the AI era. This competition is expected to be a driving force for further innovation in AI technology and the evolution of data center infrastructure.

Source: https://www.trendforce.com/news/2026/07/21/news-amds-first-rack-scale-ai-system-helios-challenges-nvidia-with-hbm4-memory-edge-but-reportedly-comes-at-a-higher-price/

Get our weekly technology intelligence — free

Receive an infographic that lets you judge at a glance whether each field’s analysis report is worth reading.

Subscribe Free — Weekly Tech Intelligence

By subscribing, you’ll receive Troy-Technical’s weekly technology intelligence newsletter.

  • Your email and selected fields are used only to deliver the newsletter.
  • We never share your information with third parties.
  • You can unsubscribe anytime via the link in each email.

See our Privacy Policy for details.

Takes about a minute · Unsubscribe anytime

Let's share this post !

Author of this article

Comments

To comment

TOC