Intel 5th generation Xeon 'Emerald Rapids' Platinum 8592+ review & benchmark released



On December 14, 2023, Intel released the 5th generation Xeon processor (codename: Emerald Rapids). Emerald Rapids is a processor designed for AI, delivering up to 42% increased inference processing performance compared to the previous generation. Tom's Hardware, a technology media, summarized the performance of Emerald Rapids and also reviewed the flagship model 'Platinum 8592 +' scheduled to be sold for $ 11,600 (about 1.6 million yen) among the lineup.

New 5th Gen Intel Xeon Processors are Built with AI Acceleration in...

https://www.intel.com/content/www/us/en/newsroom/news/5th-gen-xeon-data-center-news.html#gs.264qe5

Intel 'Emerald Rapids' 5th-Gen Xeon Platinum 8592+ Review: 64 Cores, Tripled L3 Cache and Faster Memory Deliver Impressive AI Performance | Tom's Hardware
https://www.tomshardware.com/pc-components/cpus/intel-emerald-rapids-5th-gen-xeon-platinum-8592-review-64-cores-320mb-of-l3-and-350w-tdp

The Emerald Rapids flagship adds four cores, bringing it up to 128 cores 256 threads per dual-socket server. The L3 cache has been tripled and the flagship features faster DDR5-5600 memory. Other enhancements, including a significant redesign of the die architecture, are said to deliver 42% performance-per-watt improvements for AI inference processing, 21% performance-per-watt improvements for general compute workloads, and 36% performance-per-watt improvements.



Like the previous generation Sapphire Rapids processor, the Emerald Rapids processor leverages the Intel 7 process and slightly enhanced Raptor Cove microarchitecture. Intel has moved from the complex quad-chiplet design of its top-of-the-line Sapphire Rapids chips to a simpler two-die design with a total of 61 billion transistors, ensuring a more consistent latency profile. Despite the design changes, Emerald Rapids remains backward compatible with the existing Sapphire Rapids 'Eagle Stream' platform, allowing new processors to be brought to market quickly.

Emerald Rapids still lags behind in overall core count, for example AMD's Genoa has a 32 core advantage with up to 96 cores on EPYC 9654. Therefore, Emerald Rapids may not be as good as Genoa for the most dense computational workloads.

The lineup includes 32 models divided into six main purposes, including processors designed for cloud, networking, storage, long-life, single-socket, and liquid-cooled systems.

Among these, Intel Xeon Platinum 8592+ is a 64 core 128 thread model. The suffix '+' indicates that each of the built-in accelerators is enabled one by one, and each accelerator can be upgraded to up to four by paying an additional fee.

The cores of the 8592+ operate at a base speed of 2.0GHz, but can be boosted to 3.0GHz for all cores or 3.8GHz for a single core. This chip features 320MB of L3 cache, which is more than three times that of its predecessor in its class.

The results of the AI workload performance test using the TensorFlow ResNet-50 model are as follows. Emerald Rapids 8592+ is 18% faster than the same 64-core EPYC Genoa 9554.



On the other hand, AlexNet has almost the same score.



The same goes for GoogleNet.



Benchmarks for molecular dynamics/parallel calculation are below. In terms of NAMD code results, the 96-core Genoa 9654 is by far the best, and the 64-core 9554 also beats Emerald Rapids.



Supercomputing benchmark. AMD still leads Intel based on core count.



Other benchmark test results can be found below.

Intel Fifth-Gen Xeon Emerald Rapids Server Benchmarks - Intel 'Emerald Rapids' 5th-Gen Xeon Platinum 8592+ Review: 64 Cores, Tripled L3 Cache and Faster Memory Deliver Impressive AI Performance - Page 3 | Tom's Hardware
https://www.tomshardware.com/pc-components/cpus/intel-emerald-rapids-5th-gen-xeon-platinum-8592-review-64-cores-320mb-of-l3-and-350w-tdp/ 3

Tom's Hardware says, 'Emerald Rapids posted solid performance metrics across every workload tested. Intel and AMD price comparisons are almost impossible to compare, but Intel is very competitive on price. AMD still leads in core count, but as we've seen in many benchmarks, high core count isn't a panacea. 'It leverages its built-in acceleration engine to provide a distinct advantage across a wide range of workloads.'

PC equipment manufacturer Supermicro immediately announced a server that uses Emerald Rapids, claiming that AI inference performance will improve by up to 67% compared to the 4th generation.

CEO Launch Keynote: Supermicro X13 Servers with 5th Gen Intel® Xeon® - YouTube


in Hardware, Posted by log1p_kr