NVIDIA’s $4 Billion Optical Strategy: Co-Packaged Optics (CPO) to Fundamentally Transform AI Data Center Connectivity

IO Fund USA

Overview

NVIDIA is accelerating its transition to Co-Packaged Optics (CPO) for AI data center networking, investing $2 billion each in Coherent and Lumentum to secure its optical component supply chain. CPO offers significant advantages over traditional copper and pluggable optical transceivers in terms of power efficiency and bandwidth. Broadcom is already shipping its third-generation CPO product, Tomahawk 6, having achieved 36 million hours of uptime in reliability testing with Meta. The widespread adoption of CPO is expected to be driven by ongoing reliability validation and the strategic use of bridge solutions like NPO/LPO.

In Depth

AI Data Center’s Next Bottleneck: Networking

AI workloads, especially for large language model training and inference, demand ultra-high-speed and efficient data movement between GPUs. While traditional data centers were bottlenecked by compute capacity, the AI era sees networking—the connectivity between GPUs, switches, and storage—emerging as the new bottleneck. To address this challenge, optical interconnects, particularly Co-Packaged Optics (CPO), are becoming strategically critical.

NVIDIA’s $4 Billion Optical Strategy and CPO Commitment

NVIDIA is making substantial strategic investments to accelerate the transition to CPO in AI data center networking. Specifically, it has invested $2 billion in equity in each of the optical component suppliers, Coherent and Lumentum, to secure its future optical component supply. NVIDIA CEO Jensen Huang has hailed CPO as a “game-changer” and is pushing for the early adoption of the company’s Quantum-X and Spectrum-X CPO switches. This massive investment clearly indicates that the entire optical stack is considered indispensable for AI infrastructure buildout.

Technical Advantages and Industrialization Progress of CPO

CPO offers dramatic advantages over traditional pluggable optical transceivers and copper interconnects in several key areas:

• Improved Power Efficiency: By integrating optics closer to the ASIC, CPO can reduce power consumption for signal transmission by up to 5 times, lowering data center operational costs and environmental impact. Broadcom’s Tomahawk 6, for instance, achieves 3.5 times better power efficiency compared to pluggable optics.
• Expanded Bandwidth: Enables high-density optical connections, delivering the ultra-high-bandwidth data transfer required by AI workloads.
• Enhanced Signal Integrity: Shortens electrical signal path lengths, preventing signal degradation and ensuring high reliability.

The industrialization of CPO is steadily advancing, with Broadcom already shipping its third-generation CPO product, Tomahawk 6. Furthermore, joint reliability testing with Meta has demonstrated 36 million hours of uptime, validating CPO’s reliability. However, in the short term, factors such as the availability of lower-cost copper solutions, completion of reliability validation, and the utilization of intermediate solutions like NPO (Near-Packaged Optics) and LPO (Less-Power Optics) will determine the pace of CPO adoption.