Graviton5 boosts speed and energy efficiency with improved design — beyond Moore's Law

Amazon announced general availability of the M9g and M9gd EC2 instances powered by its next-generation CPU, Graviton5. This generation is notable for introducing a 3nm process, which increases circuit density and improves on-chip communication speed.

The key technical changes in Graviton5 are as follows:

• Four-chiplet architecture: Custom die-to-die connections provide up to 420 GB/s of bandwidth between chiplets and reduce memory latency.
• Expanded cores and cache: The core count has doubled to 192 cores compared to the previous generation (96 cores), and the L3 cache has grown more than 5x to 192MB.
• Memory and interconnect: Support for DDR5-8800 memory and the latest PCIe gen6 delivers the fastest memory performance in the cloud.

In addition, the Neoverse V3 cores, co-designed with Arm, have improved branch prediction capability. This has boosted performance by up to 30% in real-world workloads such as databases. On the security side, isolation between VMs has been strengthened through the Nitro Isolation Engine, a mathematically verified hypervisor.