gpu-server-2u
2 x Intel Xeon E5-2697 v4 testing with a Dell PowerEdge R730 [0WCJNT] (2.19.0 BIOS) and NVIDIA GA102GL [RTX A5000] 24GB on Ubuntu 22.04 via the Phoronix Test Suite.


GPU-SERVER-2U-2xA5000: 

	Processor: 2 x Intel Xeon E5-2697 v4 @ 3.60GHz (36 Cores / 72 Threads), Motherboard: Dell PowerEdge R730 [0WCJNT] (2.19.0 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 8 x 32 GB DDR4-2400MT/s M393A4K40CB1-CRC, Disk: 2 x 1920GB SAMSUNG MZ7LH1T9, Graphics: NVIDIA GA102GL [RTX A5000] 24GB, Audio: NVIDIA GA102 HD Audio, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350

	OS: Ubuntu 22.04, Kernel: 5.15.0-102-generic (x86_64), Display Driver: NVIDIA, Vulkan: 1.3.277, Compiler: GCC 12.3.0, File-System: ext4, Screen Resolution: 1024x768

2 x Intel Xeon E5-2697 v4 - NVIDIA GA102GL [RTX: 

	Processor: 2 x Intel Xeon E5-2697 v4 @ 3.60GHz (36 Cores / 72 Threads), Motherboard: Dell PowerEdge R730 [0WCJNT] (2.19.0 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 8 x 32 GB DDR4-2400MT/s M393A4K40CB1-CRC, Disk: 2 x 1920GB SAMSUNG MZ7LH1T9, Graphics: NVIDIA GA102GL [RTX A5000] 24GB, Audio: NVIDIA GA102 HD Audio, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350

	OS: Ubuntu 22.04, Kernel: 5.15.0-102-generic (x86_64), Display Driver: NVIDIA, Vulkan: 1.3.277, Compiler: GCC 12.3.0, File-System: ext4, Screen Resolution: 1024x768

NVIDIA GA102GL: 

	Processor: 2 x Intel Xeon E5-2697 v4 @ 3.60GHz (36 Cores / 72 Threads), Motherboard: Dell PowerEdge R730 [0WCJNT] (2.19.0 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 8 x 32 GB DDR4-2400MT/s M393A4K40CB1-CRC, Disk: 2 x 1920GB SAMSUNG MZ7LH1T9, Graphics: NVIDIA GA102GL [RTX A5000] 24GB, Audio: NVIDIA GA102 HD Audio, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350

	OS: Ubuntu 22.04, Kernel: 5.15.0-102-generic (x86_64), Display Driver: NVIDIA, OpenCL: OpenCL 3.0 CUDA 12.4.125, Vulkan: 1.3.277, Compiler: GCC 12.3.0, File-System: ext4, Screen Resolution: 1024x768


AI Benchmark Alpha 0.1.2

Score > Higher Is Better


PyTorch 2.2.1
Device: CPU - Batch Size: 1 - Model: ResNet-50
batches/sec > Higher Is Better
2 x Intel Xeon E5-2697 v4 - NVIDIA GA102GL [RTX . 27.48 |======================


PyTorch 2.2.1
Device: CPU - Batch Size: 1 - Model: ResNet-152
batches/sec > Higher Is Better
2 x Intel Xeon E5-2697 v4 - NVIDIA GA102GL [RTX . 10.39 |======================


PyTorch 2.2.1
Device: CPU - Batch Size: 16 - Model: ResNet-50
batches/sec > Higher Is Better
2 x Intel Xeon E5-2697 v4 - NVIDIA GA102GL [RTX . 23.10 |======================


PyTorch 2.2.1
Device: CPU - Batch Size: 32 - Model: ResNet-50
batches/sec > Higher Is Better
2 x Intel Xeon E5-2697 v4 - NVIDIA GA102GL [RTX . 22.57 |======================


PyTorch 2.2.1
Device: CPU - Batch Size: 64 - Model: ResNet-50
batches/sec > Higher Is Better
2 x Intel Xeon E5-2697 v4 - NVIDIA GA102GL [RTX . 23.84 |======================


PyTorch 2.2.1
Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152
batches/sec > Higher Is Better
2 x Intel Xeon E5-2697 v4 - NVIDIA GA102GL [RTX . 33.72 |======================


Hashcat 6.2.4
Benchmark: SHA-512
H/s > Higher Is Better
NVIDIA GA102GL . 3986400000 |==================================================