AMD EPYC Turin 128 Core Comparison: EPYC 9745 "Zen 5C" vs. EPYC 9755 "Zen 5"
The EPYC 9745 power efficiency story played out well too with OpenVINO and other CPU-based AI workloads. Getting much of the performance of the EPYC 9755 but at much lower power consumption via the EPYC 9745 processor.
OpenVino GenAI
For many of the AI workloads, the 320 Watt cTDP didn't end up resulting in much of a power/performance difference.
For vLLM the latency was similar whether using the EPYC 9755 or EPYC 9745.