Arm Unveils AGI Server CPU Architecture: 136 Cores, 2TB/s Interconnect, 300W TDP
At Hot Chips 2026, Arm disclosed technical details of its upcoming AGI data center CPU, which uses two chiplets with up to 136 Neoverse V3 cores. Each chiplet contains 70 cores, a six-channel memory controller supporting DDR5-8800, and a 16x16 UCIe link providing 2TB/s bandwidth. The processor, rated at 300W TDP, is on track for commercial shipments in late 2026, though performance figures remain undisclosed.
Arm's AGI processor relies on two identical TSMC N3P chiplets, each holding 70 Neoverse V3 cores, a six-channel DDR5-8800 memory controller, and a 16×16 UCIe link running at 32 GT/s for a combined 2 TB/s chip-to-chip fabric. Each chiplet packs 50 billion transistors and a 128 MB distributed system-level cache, connected through an 8×9 CMN-S3 mesh. The full package supports up to 136 cores, 272 MB of system-level cache, 6 TB of DDR5 memory per socket, and 96 PCIe 6.0 lanes with CXL 3.0. Arm positions the design around sub-100-ns DRAM latency and 844.8 GB/s memory bandwidth, targeting latency-sensitive and agentic AI workloads. Commercial shipments are slated for late 2026, though no performance figures have been released.
This architecture could reshape data center economics by offering a 300W, high-core-count alternative to x86 and proprietary AI accelerators, potentially lowering energy costs for cloud operators and expanding access to AI inference capacity. Enterprises running latency-sensitive workloads, such as real-time agentic AI or database services, may benefit from reduced memory latency and higher throughput per watt. However, adoption depends on software ecosystem maturity and real-world benchmarks, which remain undisclosed. If performance matches expectations, Arm could intensify competition among server CPU vendors, influencing pricing and innovation across the broader semiconductor market.