Revisiting DDR5-6400 vs. MRDIMM-8800 Performance With Intel Xeon 6 "Granite Rapids"
The MRDIMM modules hadn't helped in the timed code compilation benchmarks. At least in these cases we see the server power consumption between the MRDIMM-8800 and DDR5-6400 modules being quite similar with the overall server power consumption numbers.
ClickHouse had slightly favored the DDR5-6400 memory.
TensorFlow also saw some benefits of the MRDIMM-8800 modules installed on this Giga Computing 2U Xeon 6 Granite Rapids server.
AI is one of the areas where the MRDIMM modules can be beneficial and enhancing the overall performance of the Intel Xeon 6 Granite Rapids platforms.
With large language models is where the MRDIMM-8800 modules can prove valuable and worth the +$100 premium per DIMM over DDR5-6400 memory. With Llama.cpp LocalScore and using Meta's Llama 3.1 8B Instruct model, the server power consumption was up by around 70 Watts when replacing the twelve DDR5-6400 modules with MRDIMM-8800.
