Broadcom Unveils VMware Cloud Foundation 9.1 to Enhance Cost-Efficiency and Security for Production AI in Private Clouds

Storage Newsletter USA

Overview

Broadcom has announced VMware Cloud Foundation (VCF) 9.1, a secure and cost-effective infrastructure platform engineered for production AI workloads. VCF 9.1 provides an AI and Kubernetes-native private cloud platform that supports mixed computing infrastructures across AMD, Intel, and NVIDIA hardware. This solution enables enterprises to deploy AI inference and agent AI applications with significantly reduced costs, enhanced security, and flexible GPU/CPU hardware choices. Research indicates private clouds remain the preferred platform for AI inference.

In Depth

Challenges of AI Workloads and the Role of Private Clouds

The proliferation of generative AI models and the execution of AI workloads in production environments pose new challenges for enterprises in terms of computing power, storage, and networking. Especially for AI inference, where data privacy, security, and cost-effectiveness are paramount, private clouds have emerged as the preferred platform. Broadcom’s research indicates that 56% of respondents are either already running or planning to run AI inference in private clouds, highlighting their increasing importance.

Key Features and Benefits of VMware Cloud Foundation 9.1

To address these challenges, Broadcom has unveiled VMware Cloud Foundation (VCF) 9.1, an integrated infrastructure platform optimized for AI workloads. VCF 9.1 offers several key benefits:

• Multi-Hardware Support: It supports mixed computing infrastructures across leading vendor GPUs and CPUs from AMD, Intel, and NVIDIA, providing enterprises with hardware selection flexibility.
• AI/Kubernetes-Native: As an AI and Kubernetes-native private cloud platform, it enables efficient deployment and management of AI workloads and containerized applications.
• Cost Reduction: The solution promises up to a 40% reduction in server costs, up to a 39% reduction in storage TCO, and up to a 46% reduction in Kubernetes operational costs.
• Operational Efficiency: It significantly enhances operational efficiency by accelerating cluster upgrades by 4x and doubling fleet capacity.
• Enhanced Security: Provides robust security features essential for production AI environments.

Technical Significance and Data Center Impact

The enhancements in VCF 9.1 reflect Broadcom’s comprehensive approach to addressing the integrated challenges of computing, storage, and networking in AI data centers. Efficient AI workload execution necessitates not only high-performance computing resources but also the optimization of the entire supporting infrastructure. Optical connectivity technologies will play an indirectly critical role in this high-performance and efficient foundation, particularly for high-speed interconnects within data centers and for Data Center Interconnect (DCI). The adoption of integrated platforms like VCF 9.1 will provide a holistic solution to the cost, security, and flexibility challenges in AI data centers, further accelerating the proliferation of AI workloads in private cloud environments.