Benchmarks

The results of these benchmarks are influenced by node, filesystem, and network utilization at the time they were executed. In addition, the benchmarks were run using different software versions, which may also affect performance. Therefore, the results should be considered indicative rather than a controlled hardware-only comparison.

Nevertheless, the benchmarks provide a useful indication of the performance difference between the NVIDIA A100-SXM4-80GB and NVIDIA GH200 120GB GPUs.

Benchmark Job

The benchmark was run using a single GPU on both the A100 and GH200 nodes. The job on the A100 node was executed with version 4.7.1, while the job on the Grace Hopper node was executed with version 5.1.0-privatebeta.2.

Because the software versions differ, some of the observed performance difference may be attributable to software changes rather than GPU hardware alone. A direct hardware comparison would ideally use the same software version and configuration on both nodes.