SPECaccel(R)2023 Result Supermicro Intel Xeon Gold 5520+ GPU SuperServer SYS-741GE-TNRT accel2023 License: 6569 Test date: Feb-2024 Test sponsor: Supermicro Hardware availability: Dec-2023 Tested by: Supermicro Software availability: Nov-2023 Base Base Base Base Peak Peak Peak Peak Benchmarks Model Ref. Run Time Ratio Model Ref. Run Time Ratio -------------- ------ ------ --------- --------- ------ ------ --------- --------- 403.stencil LOP 440 699 0.630 S LOP 440 701 0.627 S 403.stencil LOP 440 703 0.626 S LOP 440 702 0.627 * 403.stencil LOP 440 699 0.629 * LOP 440 703 0.626 S 404.lbm LOP 455 98.0 4.64 * LOP 455 96.3 4.73 S 404.lbm LOP 455 97.2 4.68 S LOP 455 92.5 4.92 S 404.lbm LOP 455 98.1 4.64 S LOP 455 94.6 4.81 * 450.md LOP 600 1102 0.544 S LOP 600 1102 0.544 S 450.md LOP 600 1103 0.544 * LOP 600 1103 0.544 * 450.md LOP 600 1105 0.543 S LOP 600 1105 0.543 S 452.ep LOP 415 505 0.821 S LOP 415 505 0.821 S 452.ep LOP 415 504 0.823 S LOP 415 504 0.823 S 452.ep LOP 415 505 0.822 * LOP 415 505 0.822 * 453.clvrleaf LOP 1000 693 1.44 S LOP 1000 695 1.44 S 453.clvrleaf LOP 1000 688 1.45 S LOP 1000 692 1.45 * 453.clvrleaf LOP 1000 692 1.45 * LOP 1000 687 1.46 S 455.seismic LOP 780 751 1.04 S LOP 780 751 1.04 S 455.seismic LOP 780 731 1.07 S LOP 780 731 1.07 S 455.seismic LOP 780 744 1.05 * LOP 780 744 1.05 * 456.spF LOP 475 431 1.10 S LOP 475 456 1.04 S 456.spF LOP 475 435 1.09 * LOP 475 444 1.07 * 456.spF LOP 475 453 1.05 S LOP 475 438 1.09 S 457.spC LOP 540 693 0.779 * LOP 540 681 0.793 S 457.spC LOP 540 698 0.774 S LOP 540 683 0.791 * 457.spC LOP 540 689 0.784 S LOP 540 702 0.769 S 459.miniGhost LOP 590 935 0.631 * LOP 590 935 0.631 * 459.miniGhost LOP 590 933 0.632 S LOP 590 933 0.632 S 459.miniGhost LOP 590 942 0.626 S LOP 590 942 0.626 S 460.ilbdc LOP 555 1098 0.505 S LOP 555 1098 0.505 S 460.ilbdc LOP 555 1094 0.507 S LOP 555 1094 0.507 S 460.ilbdc LOP 555 1096 0.507 * LOP 555 1096 0.507 * 463.swim LOP 440 143 3.07 S LOP 440 144 3.06 S 463.swim LOP 440 144 3.06 * LOP 440 144 3.07 * 463.swim LOP 440 146 3.02 S LOP 440 143 3.07 S 470.bt LOP 1055 864 1.22 S LOP 1055 901 1.17 S 470.bt LOP 1055 950 1.11 S LOP 1055 938 1.12 S 470.bt LOP 1055 901 1.17 * LOP 1055 923 1.14 * ============================================================================================ 403.stencil LOP 440 699 0.629 * LOP 440 702 0.627 * 404.lbm LOP 455 98.0 4.64 * LOP 455 94.6 4.81 * 450.md LOP 600 1103 0.544 * LOP 600 1103 0.544 * 452.ep LOP 415 505 0.822 * LOP 415 505 0.822 * 453.clvrleaf LOP 1000 692 1.45 * LOP 1000 692 1.45 * 455.seismic LOP 780 744 1.05 * LOP 780 744 1.05 * 456.spF LOP 475 435 1.09 * LOP 475 444 1.07 * 457.spC LOP 540 693 0.779 * LOP 540 683 0.791 * 459.miniGhost LOP 590 935 0.631 * LOP 590 935 0.631 * 460.ilbdc LOP 555 1096 0.507 * LOP 555 1096 0.507 * 463.swim LOP 440 144 3.06 * LOP 440 144 3.07 * 470.bt LOP 1055 901 1.17 * LOP 1055 923 1.14 * SPECaccel 2023_base 1.06 SPECaccel 2023_peak 1.06 HARDWARE -------- CPU Name: INTEL Xeon Gold 5520+ Max MHz.: 4000 Nominal: 2200 Enabled: 56 cores, 2 chips, 2 threads/core Orderable: 1,2 chips Cache L1: 32 KB I + 48 KB D on chip per core L2: 2 MB I+D on chip per core L3: 52.5 MB I+D on chip per chip Other: None Memory: 1 TB (16 x 64 GB 2Rx4 PC5-5600B-R, running at 4800) Storage: 1 x 512 GB M.2 NVMe SSD Other: None Base Threads Run: 112 Min. Peak Threads: 112 Max. Peak Threads: 112 ACCELERATOR ----------- Accel Model Name: Intel Xeon Gold 5520+ Accel Vendor: Intel Accel Name: Intel Xeon Gold 5520+ Type of Accel: CPU Accel Connection: N/A Does Accel Use ECC: Yes Accel Description: 2 x Intel Xeon Gold 5520+ Accel Driver: N/A SOFTWARE -------- OS: SUSE Linux Enterprise Server 15 SP5 Kernel 5.14.21-150500.53-default Compiler: C/C++/Fortran: Version 2024.0.0.20231017 of Intel oneAPI DPC++/C++ Firmware: Version 2.1 released Dec-2023 File System: xfs System State: Run level 3 (multi-user) Other: None Base Parallel Model: LOP Base Threads Run: 112 Peak Parallel Models: LOP Max. Peak Threads: 112 Min. Peak Threads: 112 Operating System Notes ---------------------- Stack size set to unlimited using "ulimit -s unlimited" General Notes ------------- Environment variables set by runaccel before the start of the run: FORT_BUFFERED = "true" KMP_AFFINITY = "compact,0" KMP_BLOCKTIME = "infinite" KMP_HW_SUBSET = "2S,28C,2T" KMP_LIBRARY = "turnaround" OMP_DYNAMIC = "FALSE" OMP_NUM_THREADS = "56" OMP_WAIT_POLICY = "active" NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented. Yes: The test sponsor attests, as of date of publication, the CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented. Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented. Platform Notes -------------- Sysinfo program /home/accel2023/bin/sysinfo Rev: r6622 of 2021-04-07 b1a7d5f8f71be5aff70a755cad7211a0 running on 135-172-248 Sat Feb 3 07:27:21 2024 SUT (System Under Test) info as seen by some common utilities. For more information on this section, see https://www.spec.org/cpu2017/Docs/config.html#sysinfo From /proc/cpuinfo model name : INTEL(R) XEON(R) GOLD 5520+ 2 "physical id"s (chips) 112 "processors" cores, siblings (Caution: counting these is hw and system dependent. The following excerpts from /proc/cpuinfo might not be reliable. Use with caution.) cpu cores : 28 siblings : 56 physical 0: cores 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 physical 1: cores 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 From lscpu from util-linux 2.37.4: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 46 bits physical, 57 bits virtual Byte Order: Little Endian CPU(s): 112 On-line CPU(s) list: 0-111 Vendor ID: GenuineIntel Model name: INTEL(R) XEON(R) GOLD 5520+ CPU family: 6 Model: 207 Thread(s) per core: 2 Core(s) per socket: 28 Socket(s): 2 Stepping: 2 BogoMIPS: 4400.00 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3 invpcid_single cdp_l2 ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local avx_vnni avx512_bf16 wbnoinvd dtherm ida arat pln pts avx512vbmi umip pku ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid bus_lock_detect cldemote movdiri movdir64b enqcmd fsrm md_clear serialize tsxldtrk pconfig arch_lbr avx512_fp16 amx_tile flush_l1d arch_capabilities Virtualization: VT-x L1d cache: 2.6 MiB (56 instances) L1i cache: 1.8 MiB (56 instances) L2 cache: 112 MiB (56 instances) L3 cache: 105 MiB (2 instances) NUMA node(s): 4 NUMA node0 CPU(s): 0-13,56-69 NUMA node1 CPU(s): 14-27,70-83 NUMA node2 CPU(s): 28-41,84-97 NUMA node3 CPU(s): 42-55,98-111 Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Enhanced IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected From lscpu --cache: NAME ONE-SIZE ALL-SIZE WAYS TYPE LEVEL SETS PHY-LINE COHERENCY-SIZE L1d 48K 2.6M 12 Data 1 64 1 64 L1i 32K 1.8M 8 Instruction 1 64 1 64 L2 2M 112M 16 Unified 2 2048 1 64 L3 52.5M 105M 15 Unified 3 57344 1 64 /proc/cpuinfo cache data cache size : 53760 KB From numactl --hardware WARNING: a numactl 'node' might or might not correspond to a physical chip. available: 4 nodes (0-3) node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 56 57 58 59 60 61 62 63 64 65 66 67 68 69 node 0 size: 257678 MB node 0 free: 256468 MB node 1 cpus: 14 15 16 17 18 19 20 21 22 23 24 25 26 27 70 71 72 73 74 75 76 77 78 79 80 81 82 83 node 1 size: 258040 MB node 1 free: 257360 MB node 2 cpus: 28 29 30 31 32 33 34 35 36 37 38 39 40 41 84 85 86 87 88 89 90 91 92 93 94 95 96 97 node 2 size: 258040 MB node 2 free: 257340 MB node 3 cpus: 42 43 44 45 46 47 48 49 50 51 52 53 54 55 98 99 100 101 102 103 104 105 106 107 108 109 110 111 node 3 size: 257985 MB node 3 free: 257448 MB node distances: node 0 1 2 3 0: 10 12 21 21 1: 12 10 21 21 2: 21 21 10 12 3: 21 21 12 10 From /proc/meminfo MemTotal: 1056507444 kB HugePages_Total: 0 Hugepagesize: 2048 kB From /etc/*release* /etc/*version* os-release: NAME="SLES" VERSION="15-SP5" VERSION_ID="15.5" PRETTY_NAME="SUSE Linux Enterprise Server 15 SP5" ID="sles" ID_LIKE="suse" ANSI_COLOR="0;32" CPE_NAME="cpe:/o:suse:sles:15:sp5" uname -a: Linux 135-172-248 5.14.21-150500.53-default #1 SMP PREEMPT_DYNAMIC Wed May 10 07:56:26 UTC 2023 (b630043) x86_64 x86_64 x86_64 GNU/Linux Kernel self-reported vulnerability status: CVE-2018-12207 (iTLB Multihit): Not affected CVE-2018-3620 (L1 Terminal Fault): Not affected Microarchitectural Data Sampling: Not affected CVE-2017-5754 (Meltdown): Not affected mmio_stale_data: Not affected retbleed: Not affected CVE-2018-3639 (Speculative Store Bypass): Mitigation: Speculative Store Bypass disabled via prctl and seccomp CVE-2017-5753 (Spectre variant 1): Mitigation: usercopy/swapgs barriers and __user pointer sanitization CVE-2017-5715 (Spectre variant 2): Mitigation: Enhanced IBRS, IBPB: conditional, RSB filling, PBRSB-eIBRS: SW sequence CVE-2020-0543 (Special Register Buffer Data Sampling): Not affected CVE-2019-11135 (TSX Asynchronous Abort): Not affected run-level 3 Feb 2 17:33 SPEC is set to: /home/accel2023 Filesystem Type Size Used Avail Use% Mounted on /dev/nvme0n1p2 xfs 475G 55G 420G 12% / From /sys/devices/virtual/dmi/id Vendor: Supermicro Product: X13DEG-QT Product Family: Family Serial: 1234567890 Additional information from dmidecode 3.4 follows. WARNING: Use caution when you interpret this section. The 'dmidecode' program reads system data which is "intended to allow hardware to be accurately determined", but the intent may not be met, as there are frequent changes to hardware, firmware, and the "DMTF SMBIOS" standard. Memory: 14x SK Hynix HMCG94AGBRA181N 64 GB 2 rank 5600, configured at 4800 2x SK Hynix HMCG94AGBRA184N 64 GB 2 rank 5600, configured at 4800 BIOS: BIOS Vendor: American Megatrends International, LLC. BIOS Version: 2.1 BIOS Date: 12/12/2023 BIOS Revision: 5.32 (End of data from sysinfo program) Compiler Version Notes ---------------------- ============================================================================== C | 403.stencil(base, peak) 404.lbm(base, peak) 452.ep(base, peak) | 457.spC(base, peak) 470.bt(base, peak) ------------------------------------------------------------------------------ Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) Target: x86_64-unknown-linux-gnu Thread model: posix InstalledDir: /opt/intel/oneapi/compiler/2024.0/bin/compiler Configuration file: /opt/intel/oneapi/compiler/2024.0/bin/compiler/../icx.cfg ------------------------------------------------------------------------------ ============================================================================== Fortran | 450.md(base, peak) 455.seismic(base, peak) 456.spF(base, peak) | 460.ilbdc(base, peak) 463.swim(base, peak) ------------------------------------------------------------------------------ ifx (IFX) 2024.0.0 20231017 Copyright (C) 1985-2023 Intel Corporation. All rights reserved. ------------------------------------------------------------------------------ ============================================================================== Fortran, C | 453.clvrleaf(base, peak) 459.miniGhost(base, peak) ------------------------------------------------------------------------------ ifx (IFX) 2024.0.0 20231017 Copyright (C) 1985-2023 Intel Corporation. All rights reserved. Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) Target: x86_64-unknown-linux-gnu Thread model: posix InstalledDir: /opt/intel/oneapi/compiler/2024.0/bin/compiler Configuration file: /opt/intel/oneapi/compiler/2024.0/bin/compiler/../icx.cfg ------------------------------------------------------------------------------ Base Compiler Invocation ------------------------ C benchmarks: icx Fortran benchmarks: ifx Benchmarks using both Fortran and C: ifx icx Base Portability Flags ---------------------- 450.md: -80 457.spC: -Wl,--no-relax(icx)(*) -mcmodel=medium -shared-intel -Wl,--no-relax(icx) 459.miniGhost: -nofor-main (*) Indicates portability flags found in non-portability variables Base Optimization Flags ----------------------- C benchmarks: -Ofast -O3 -xsapphirerapids -mprefer-vector-width=512 -qopt-multiple-gather-scatter-by-shuffles -flto -ffast-math -fiopenmp -qopt-dynamic-align -fvec-peel-loops -qopt-streaming-stores always -Xclang -fopenmp-declare-target-scalar-defaultmap-firstprivate -fimf-precision=low Fortran benchmarks: -Ofast -O3 -xsapphirerapids -mprefer-vector-width=512 -qopt-multiple-gather-scatter-by-shuffles -flto -ffast-math -fiopenmp -qopt-dynamic-align -fvec-peel-loops -qopt-streaming-stores always -nostandard-realloc-lhs -align array32byte -auto -fimf-accuracy-bits-sqrt=14 -fimf-precision=low Benchmarks using both Fortran and C: -Ofast -O3 -xsapphirerapids -mprefer-vector-width=512 -qopt-multiple-gather-scatter-by-shuffles -flto -ffast-math -fiopenmp -qopt-dynamic-align -fvec-peel-loops -qopt-streaming-stores always -Xclang -fopenmp-declare-target-scalar-defaultmap-firstprivate -fimf-precision=low -nostandard-realloc-lhs -align array32byte -auto -fimf-accuracy-bits-sqrt=14 Peak Compiler Invocation ------------------------ C benchmarks: icx Fortran benchmarks: ifx Benchmarks using both Fortran and C: ifx icx Peak Portability Flags ---------------------- 450.md: -80 457.spC: -Wl,--no-relax(icx)(*) -mcmodel=medium -shared-intel -Wl,--no-relax(icx) 459.miniGhost: -nofor-main (*) Indicates portability flags found in non-portability variables Peak Optimization Flags ----------------------- C benchmarks: 403.stencil: -Ofast -O3 -xsapphirerapids -mprefer-vector-width=512 -qopt-multiple-gather-scatter-by-shuffles -flto -ffast-math -fiopenmp -qopt-dynamic-align -fvec-peel-loops -qopt-streaming-stores always -Xclang -fopenmp-declare-target-scalar-defaultmap-firstprivate -fimf-precision=low 404.lbm: Same as 403.stencil 452.ep: basepeak = yes 457.spC: Same as 403.stencil 470.bt: Same as 403.stencil Fortran benchmarks: 450.md: basepeak = yes 455.seismic: basepeak = yes 456.spF: -Ofast -O3 -xsapphirerapids -mprefer-vector-width=512 -qopt-multiple-gather-scatter-by-shuffles -flto -ffast-math -fiopenmp -qopt-dynamic-align -fvec-peel-loops -qopt-streaming-stores always -nostandard-realloc-lhs -align array32byte -auto -fimf-accuracy-bits-sqrt=14 -fimf-precision=low 460.ilbdc: basepeak = yes 463.swim: Same as 456.spF Benchmarks using both Fortran and C: 453.clvrleaf: -Ofast -O3 -xsapphirerapids -mprefer-vector-width=512 -qopt-multiple-gather-scatter-by-shuffles -flto -ffast-math -fiopenmp -qopt-dynamic-align -fvec-peel-loops -qopt-streaming-stores always -Xclang -fopenmp-declare-target-scalar-defaultmap-firstprivate -fimf-precision=low -nostandard-realloc-lhs -align array32byte -auto -fimf-accuracy-bits-sqrt=14 459.miniGhost: basepeak = yes The flags files that were used to format this result can be browsed at http://www.spec.org/accel2023/flags/Intel_compiler_flags.2024-03-06.html http://www.spec.org/accel2023/flags/Supermicro-Platform-Settings-V1.2-SPR-revG.html You can also download the XML flags sources by saving the following links: http://www.spec.org/accel2023/flags/Intel_compiler_flags.2024-03-06.xml http://www.spec.org/accel2023/flags/Supermicro-Platform-Settings-V1.2-SPR-revG.xml SPECaccel is a registered trademark of the Standard Performance Evaluation Corporation. All other brand and product names appearing in this result are trademarks or registered trademarks of their respective holders. ------------------------------------------------------------------------------------------------------------ For questions about this result, please contact the tester. For other inquiries, please contact info@spec.org. Copyright 2023-2024 Standard Performance Evaluation Corporation Tested with SPECaccel2023 v2.0.17 on 2024-02-02 18:27:21-0500. Report generated on 2024-03-06 18:08:45 by accel2023 ASCII formatter v112. Originally published on 2024-03-06.