Arm takes on Intel with proprietary server CPU

The processor, designated Arm AGI CPU,  is targeted at agentic AI infrastructure. Arm says it delivers more than 2x performance per rack compared with x86 platforms.

“Today marks the next phase of the Arm compute platform and a defining moment for our company,” says CEO Rene Haas, “with the expansion into delivering production silicon with our Arm AGI CPU, we are giving partners more choices.”

Arm expects that selling proprietary discrete chips will boost annual revenues 5x in five years to $25 billion. By that time IP sales are expected to be $10 billion.

The chip has a 300W TDP. 136 of its Neoverse V3 cores are clocked at up to 3.7 GHz (3.2 GHz base), on two die fabbed on TSMC’s 3 nm process. It has 2 MB of L2 cache per core along with 128 MB of shared system-level cache (SLC).

Agent-driven applications in datacentres could need more than 4x the current CPU capacity per GW  within the same power envelope requiring “a simplified architecture built without the overhead and complexity of x86 processors”, says Arm

The Arm AGI CPU delivers:

• Performance: Up to 136 Arm Neoverse V3cores per CPU, delivering leading performance per core, SoC, blade and rack*, with 6GB/s memory bandwidth per core at sub-100ns latency.
• Scale: 300-watt TDP with a dedicated core per program thread enables deterministic performance under sustained load, eliminating throttling and idle threads.
• Efficiency: Supports high-density 1U server chassis that supports air-cooled deployments with up to 8,160 cores per rack, and liquid-cooled systems delivering 45,000+ cores per rack.

Arm designed the chip with Meta and partners including Cerebras, Cloudflare, F5, OpenAI, Positron, Rebellions, SAP, and SK Telecom.

These customers will deploy the Arm AGI CPU for key agentic CPU use-cases including accelerator management, control plane processing, and cloud and enterprise-based API, task and application hosting.

OEM/ODM partners are ASRock Rack, oEM/ODMLenovo, Quanta Computer, and Supermicro, with early systems available now and broader availability expected in the second half of the year.