AMD unveils data center rack with 32,768 cores
The new Helion reference solution accommodates up to 128 EPYC 9996 processors and supports both air and liquid cooling
AMD has introduced the Helion reference rack design for data centers. The solution is standardized according to the ORv4 specification and is designed for 44 OpenU modules. The rack is compatible with the OCP DC-MHS standard, which ensures compatibility between data center infrastructure and enterprise systems.
Helion supports the installation of up to 128 EPYC 9996 Venice processors based on the Zen 6 architecture. In a CPU-only configuration, the rack provides up to 32,768 cores. The solution also allows for the installation of up to 16 MI350P graphics processors, but with a reduction in the number of CPUs. Network throughput reaches 102 Tbit/s.
The project is targeted at hyperscalers and the enterprise sector. AMD positions Helion as an all-in-one solution for data management, networking, and AI workloads. The rack can be used for isolated AI agent environments ("sandboxes"), similar to Meta's Muse and OpenAI's Dots projects.
AMD will not sell ready-made racks—this is a reference design for OEM and ODM manufacturers. The company will announce its list of partners at the OCP Global Summit. Likely, the first customers will be those already using the Helios racks introduced last year.
Helion supports both air and direct liquid cooling. The market launch of the racks is scheduled for the first half of 2027. This aligns with the widespread adoption of processors based on the Zen 6 architecture, which will debut as early as late 2024.