Key Findings
In the evolving roadmap for AI hardware, industry stakeholders are actively discussing a phased approach for transitioning from current pluggable optical modules to Near-Package Optics (NPO) by 2027-2028, and subsequently moving towards Co-Packaged Optics (CPO) by 2029. Leading technology companies such as Astera Labs, Credo, and Lumentum are underscoring the significance of this transition, with CPO widely recognized as the ‘holy grail’ for achieving ultimate performance and power efficiency in AI data centers. This clear roadmap strongly indicates the future direction of AI infrastructure.
Technical / Clinical Details
NPO technology involves placing optical interconnect modules in physically close proximity to Application-Specific Integrated Circuit (ASIC) chips. This shortens the electrical path from the ASIC before conversion to optical signals, thereby reducing signal loss and power consumption. NPO is expected to be introduced ahead of CPO, as it presents fewer manufacturing and thermal management challenges. CPO, on the other hand, is a more advanced integration technology that fully embeds optical interconnect components within the same package as the ASIC. This extremely dense integration further shortens electrical pathways, maximizing power efficiency and dramatically increasing bandwidth density. While CPO introduces new technical challenges such as thermal management, heterogeneous integration, and complexities in testing and repair, its performance advantages are substantial.
Background & Context
The explosive growth of AI workloads places unprecedented demands on data movement between GPUs in data centers. Traditional electrical interconnects and pluggable optical transceivers are struggling to meet the combined requirements of bandwidth, low latency, and low power consumption. Consequently, the industry is accelerating its shift towards more efficient optoelectronic integration solutions. NPO is positioned as a pragmatic step in the transition to CPO, offering many of CPO’s benefits while enabling relatively faster market adoption. This technological transition is crucial for sustainable AI growth and for reducing data center operational costs.
Strategic Significance & Outlook
The roadmap for AI hardware’s phased transition from NPO to CPO will profoundly impact data center design and operation. In the short term, NPO will be a primary means of improving the power efficiency and performance of AI infrastructure, providing critical experience and a technological foundation for CPO’s maturity. Once CPO becomes widespread around 2029, AI clusters will become even denser, with significantly enhanced computational and data transmission capabilities. This technological evolution is indispensable for shaping the future of AI, and close collaboration among hyperscalers, semiconductor manufacturers, and optical component providers will be key to the successful implementation of this roadmap. Ultimately, it will contribute to the realization of a more powerful and sustainable AI ecosystem.
Get our weekly technology intelligence — free
Receive an infographic that lets you judge at a glance whether each field’s analysis report is worth reading.
Subscribe Free — Weekly Tech Intelligence
By subscribing, you’ll receive Troy-Technical’s weekly technology intelligence newsletter.
- Your email and selected fields are used only to deliver the newsletter.
- We never share your information with third parties.
- You can unsubscribe anytime via the link in each email.
See our Privacy Policy for details.
Takes about a minute · Unsubscribe anytime
Comments