SPEC® CPU2017 Floating Point Rate Result

Copyright 2017-2018 Standard Performance Evaluation Corporation

Cisco Systems

Cisco UCS C125 (AMD EPYC 7401)

SPECrate2017_fp_base = 22800

SPECrate2017_fp_peak = 22900

CPU2017 License: 9019 Test Date: Jun-2018
Test Sponsor: Cisco Systems Hardware Availability: Aug-2018
Tested by: Cisco Systems Software Availability: Aug-2018

Benchmark result graphs are available in the PDF report.

Hardware
CPU Name: AMD EPYC 7401
  Max MHz.: 3000
  Nominal: 2000
Enabled: 48 cores, 2 chips, 2 threads/core
Orderable: 1,2 chip
Cache L1: 64 KB I + 32 KB D on chip per core
  L2: 512 KB I+D on chip per core
  L3: 64 MB I+D on chip per chip, 8 MB shared / 3 cores
  Other: None
Memory: 1 TB (16 x 64 GB 4Rx4 PC4-2667V-R)
Storage: 600 GB SAS HDD, 15K RPM
Other: None
Software
OS: SUSE Linux Enterprise Server 12 SP3 x86_64
kernel 4.4.143-94.47-default

Compiler: C/C++: Version 1.0.0 of AOCC
Fortran: Version 4.8.2 of GCC
Parallel: No
Firmware: Cisco Systems, Inc. BIOS Version C125.4.0.0.16.0511180518 released May-2018
File System: xfs
System State: Run level 3 (multi-user)
Base Pointers: 64-bit
Peak Pointers: 64-bit
Other: jemalloc general purpose malloc implementation
v4.5.0

Results Table

Benchmark Base Peak
Copies Seconds Ratio Seconds Ratio Seconds Ratio Copies Seconds Ratio Seconds Ratio Seconds Ratio
SPECrate2017_fp_base 22800
SPECrate2017_fp_peak 22900
Results appear in the order in which they were run. Bold underlined text indicates a median measurement.
503.bwaves_r 96 1546 623 1545 623 1543 624 96 1547 622 1545 623 1548 622
507.cactuBSSN_r 96 536 227 530 229 533 228 96 544 224 543 224 541 225
508.namd_r 96 502 182 503 181 502 182 96 461 198 459 199 459 199
510.parest_r 96 1595 157 1599 157 1595 157 96 1620 155 1618 155 1618 155
511.povray_r 96 958 234 960 234 962 233 96 923 243 919 244 921 243
519.lbm_r 96 668 151 670 151 667 152 96 671 151 670 151 675 150
521.wrf_r 96 827 260 825 260 855 252 96 855 252 859 250 869 247
526.blender_r 96 563 260 558 262 557 262 96 567 258 563 260 549 266
527.cam4_r 96 767 219 764 220 766 219 96 773 217 768 219 772 217
538.imagick_r 96 684 349 684 349 688 347 96 672 355 679 352 672 355
544.nab_r 96 546 296 545 296 540 299 96 541 299 541 299 540 299
549.fotonik3d_r 96 1995 188 1983 189 1993 188 96 1986 188 1993 188 1988 188
554.roms_r 96 1424 107 1429 107 1434 106 96 1419 108 1426 107 1420 107

Submit Notes

The config file option 'submit' was used.
'numactl' was used to bind copies to the cores.
See the configuration file for details.

Operating System Notes

'ulimit -s unlimited' was used to set environment stack size
'ulimit -l 2097152' was used to set environment locked pages in memory limit

runspec command invoked through numactl i.e.:
numactl --interleave=all runspec <etc>

Set dirty_ratio=8 to limit dirty cache to 8% of memory
Set swappiness=1 to swap only if necessary
Set zone_reclaim_mode=1 to free local node memory and avoid remote memory
sync then drop_caches=3 to reset caches before invoking runcpu

dirty_ratio, swappiness, zone_reclaim_mode and drop_caches were
all set using privileged echo (e.g. echo 1 > /proc/sys/vm/swappiness).

Transparent huge pages were enabled for this run (OS default)

Huge pages were not configured for this run.

General Notes

Environment variables set by runcpu before the start of the run:
LD_LIBRARY_PATH = "/opt/cpu2017/amd1704-rate-libs-revC/64;/opt/cpu2017/amd1704-rate-libs-revC/32:"
MALLOC_CONF = "lg_chunk:28"

The AMD64 AOCC Compiler Suite is available at
http://developer.amd.com/amd-aocc/

Binaries were compiled on a system with 2x AMD EPYC 7601 CPU + 512GB Memory using RHEL 7.4

jemalloc, a general purpose malloc implementation, was obtained at
https://github.com/jemalloc/jemalloc/releases/download/4.5.0/jemalloc-4.5.0.tar.bz2
jemalloc was built with GCC v4.8.5 in RHEL v7.2 under default conditions.
jemalloc uses environment variable MALLOC_CONF with values narenas and lg_chunk:
  narenas: sets the maximum number of arenas to use for automatic multiplexing
           of threads and arenas.
  lg_chunk: set the virtual memory chunk size (log base 2). For example,
            lg_chunk:21 sets the default chunk size to 2^21 = 2MiB.

The AOCC Gold Linker plugin was installed and used for the link stage.

The AOCC Fortran Plugin version 1.0 was used to leverage AOCC optimizers
with gfortran. It is available here:
http://developer.amd.com/amd-aocc/
NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown)
is mitigated in the system as tested and documented.
Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1)
is mitigated in the system as tested and documented.
Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2)
is mitigated in the system as tested and documented.

Platform Notes

BIOS Settings:
Performance Determinism set to Power Deterministic
 Sysinfo program /opt/cpu2017/bin/sysinfo
 Rev: r5797 of 2017-06-14 96c45e4568ad54c135fd618bcc091c0f
 running on linux-7bdx Fri Sep  7 10:58:11 2018

 SUT (System Under Test) info as seen by some common utilities.
 For more information on this section, see
    https://www.spec.org/cpu2017/Docs/config.html#sysinfo

 From /proc/cpuinfo
    model name : AMD EPYC 7401 24-Core Processor
       2  "physical id"s (chips)
       96 "processors"
    cores, siblings (Caution: counting these is hw and system dependent. The following
    excerpts from /proc/cpuinfo might not be reliable.  Use with caution.)
       cpu cores : 24
       siblings  : 48
       physical 0: cores 0 1 2 4 5 6 8 9 10 12 13 14 16 17 18 20 21 22 24 25 26 28 29 30
       physical 1: cores 0 1 2 4 5 6 8 9 10 12 13 14 16 17 18 20 21 22 24 25 26 28 29 30

 From lscpu:
      Architecture:          x86_64
      CPU op-mode(s):        32-bit, 64-bit
      Byte Order:            Little Endian
      CPU(s):                96
      On-line CPU(s) list:   0-95
      Thread(s) per core:    2
      Core(s) per socket:    24
      Socket(s):             2
      NUMA node(s):          8
      Vendor ID:             AuthenticAMD
      CPU family:            23
      Model:                 1
      Model name:            AMD EPYC 7401 24-Core Processor
      Stepping:              2
      CPU MHz:               2000.000
      CPU max MHz:           2000.0000
      CPU min MHz:           1200.0000
      BogoMIPS:              3992.55
      Virtualization:        AMD-V
      L1d cache:             32K
      L1i cache:             64K
      L2 cache:              512K
      L3 cache:              8192K
      NUMA node0 CPU(s):     0-5,48-53
      NUMA node1 CPU(s):     6-11,54-59
      NUMA node2 CPU(s):     12-17,60-65
      NUMA node3 CPU(s):     18-23,66-71
      NUMA node4 CPU(s):     24-29,72-77
      NUMA node5 CPU(s):     30-35,78-83
      NUMA node6 CPU(s):     36-41,84-89
      NUMA node7 CPU(s):     42-47,90-95
      Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
      pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm
      constant_tsc rep_good nopl nonstop_tsc extd_apicid amd_dcm aperfmperf eagerfpu pni
      pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c
      rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch
      osvw skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_l2 mwaitx arat
      hw_pstate ssbd ibpb retpoline retpoline_amd npt lbrv svm_lock nrip_save tsc_scale
      vmcb_clean flushbyasid decodeassists pausefilter pfthreshold vmmcall avic fsgsbase
      bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec xgetbv1 clzero
      irperf overflow_recov succor smca

 /proc/cpuinfo cache data
    cache size : 512 KB

 From numactl --hardware  WARNING: a numactl 'node' might or might not correspond to a
 physical chip.
   available: 8 nodes (0-7)
   node 0 cpus: 0 1 2 3 4 5 48 49 50 51 52 53
   node 0 size: 128831 MB
   node 0 free: 128599 MB
   node 1 cpus: 6 7 8 9 10 11 54 55 56 57 58 59
   node 1 size: 129020 MB
   node 1 free: 128869 MB
   node 2 cpus: 12 13 14 15 16 17 60 61 62 63 64 65
   node 2 size: 129020 MB
   node 2 free: 128821 MB
   node 3 cpus: 18 19 20 21 22 23 66 67 68 69 70 71
   node 3 size: 129020 MB
   node 3 free: 128873 MB
   node 4 cpus: 24 25 26 27 28 29 72 73 74 75 76 77
   node 4 size: 129020 MB
   node 4 free: 128895 MB
   node 5 cpus: 30 31 32 33 34 35 78 79 80 81 82 83
   node 5 size: 129020 MB
   node 5 free: 128878 MB
   node 6 cpus: 36 37 38 39 40 41 84 85 86 87 88 89
   node 6 size: 129020 MB
   node 6 free: 128893 MB
   node 7 cpus: 42 43 44 45 46 47 90 91 92 93 94 95
   node 7 size: 116923 MB
   node 7 free: 116795 MB
   node distances:
   node   0   1   2   3   4   5   6   7
     0:  10  16  16  16  32  32  32  32
     1:  16  10  16  16  32  32  32  32
     2:  16  16  10  16  32  32  32  32
     3:  16  16  16  10  32  32  32  32
     4:  32  32  32  32  10  16  16  16
     5:  32  32  32  32  16  10  16  16
     6:  32  32  32  32  16  16  10  16
     7:  32  32  32  32  16  16  16  10

 From /proc/meminfo
    MemTotal:       1044357860 kB
    HugePages_Total:       0
    Hugepagesize:       2048 kB

 From /etc/*release* /etc/*version*
    SuSE-release:
       SUSE Linux Enterprise Server 12 (x86_64)
       VERSION = 12
       PATCHLEVEL = 3
       # This file is deprecated and will be removed in a future service pack or release.
       # Please check /etc/os-release for details about this release.
    os-release:
       NAME="SLES"
       VERSION="12-SP3"
       VERSION_ID="12.3"
       PRETTY_NAME="SUSE Linux Enterprise Server 12 SP3"
       ID="sles"
       ANSI_COLOR="0;32"
       CPE_NAME="cpe:/o:suse:sles:12:sp3"

 uname -a:
    Linux linux-7bdx 4.4.143-94.47-default #1 SMP Thu Aug 9 12:47:15 UTC 2018 (6bff971)
    x86_64 x86_64 x86_64 GNU/Linux

 run-level 3 Dec 31 16:02

 SPEC is set to: /opt/cpu2017
    Filesystem     Type  Size  Used Avail Use% Mounted on
    /dev/sda3      xfs   450G   20G  431G   5% /

 Additional information from dmidecode follows.  WARNING: Use caution when you interpret
 this section. The 'dmidecode' program reads system data which is "intended to allow
 hardware to be accurately determined", but the intent may not be met, as there are
 frequent changes to hardware, firmware, and the "DMTF SMBIOS" standard.
   BIOS Cisco Systems, Inc. C125.4.0.0.16.0511180518 05/11/2018
   Memory:
    16x 0xCE00 M386A8K40BM2-CTD 64 GB 4 rank 2667

 (End of data from sysinfo program)

Compiler Version Notes

==============================================================================
 CC  519.lbm_r(base, peak) 538.imagick_r(base, peak) 544.nab_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.4.0.0.B35.2017_04_26 clang version 4.0.0 (CLANG:) (based on LLVM
  AOCC.LLVM.4.0.0.B35.2017_04_26)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /root/work/compilers/AOCC-1.0-Compiler/bin
------------------------------------------------------------------------------

==============================================================================
 CXXC 508.namd_r(base, peak) 510.parest_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.4.0.0.B35.2017_04_26 clang version 4.0.0 (CLANG:) (based on LLVM
  AOCC.LLVM.4.0.0.B35.2017_04_26)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /root/work/compilers/AOCC-1.0-Compiler/bin
------------------------------------------------------------------------------

==============================================================================
 CC  511.povray_r(base, peak) 526.blender_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.4.0.0.B35.2017_04_26 clang version 4.0.0 (CLANG:) (based on LLVM
  AOCC.LLVM.4.0.0.B35.2017_04_26)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /root/work/compilers/AOCC-1.0-Compiler/bin
AOCC.LLVM.4.0.0.B35.2017_04_26 clang version 4.0.0 (CLANG:) (based on LLVM
  AOCC.LLVM.4.0.0.B35.2017_04_26)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /root/work/compilers/AOCC-1.0-Compiler/bin
------------------------------------------------------------------------------

==============================================================================
 FC  507.cactuBSSN_r(base, peak)
------------------------------------------------------------------------------
AOCC.LLVM.4.0.0.B35.2017_04_26 clang version 4.0.0 (CLANG:) (based on LLVM
  AOCC.LLVM.4.0.0.B35.2017_04_26)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /root/work/compilers/AOCC-1.0-Compiler/bin
AOCC.LLVM.4.0.0.B35.2017_04_26 clang version 4.0.0 (CLANG:) (based on LLVM
  AOCC.LLVM.4.0.0.B35.2017_04_26)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /root/work/compilers/AOCC-1.0-Compiler/bin
GNU Fortran (GCC) 4.8.2
Copyright (C) 2013 Free Software Foundation, Inc.
GNU Fortran comes with NO WARRANTY, to the extent permitted by law.
You may redistribute copies of GNU Fortran
under the terms of the GNU General Public License.
For more information about these matters, see the file named COPYING
------------------------------------------------------------------------------

==============================================================================
 FC  503.bwaves_r(base, peak) 549.fotonik3d_r(base, peak) 554.roms_r(base,
      peak)
------------------------------------------------------------------------------
GNU Fortran (GCC) 4.8.2
Copyright (C) 2013 Free Software Foundation, Inc.
GNU Fortran comes with NO WARRANTY, to the extent permitted by law.
You may redistribute copies of GNU Fortran
under the terms of the GNU General Public License.
For more information about these matters, see the file named COPYING
------------------------------------------------------------------------------

==============================================================================
 CC  521.wrf_r(base, peak) 527.cam4_r(base, peak)
------------------------------------------------------------------------------
GNU Fortran (GCC) 4.8.2
Copyright (C) 2013 Free Software Foundation, Inc.
GNU Fortran comes with NO WARRANTY, to the extent permitted by law.
You may redistribute copies of GNU Fortran
under the terms of the GNU General Public License.
For more information about these matters, see the file named COPYING
AOCC.LLVM.4.0.0.B35.2017_04_26 clang version 4.0.0 (CLANG:) (based on LLVM
  AOCC.LLVM.4.0.0.B35.2017_04_26)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /root/work/compilers/AOCC-1.0-Compiler/bin
------------------------------------------------------------------------------

Base Compiler Invocation

C benchmarks:

 clang 

C++ benchmarks:

 clang++ 

Fortran benchmarks:

 clang   gfortran 

Benchmarks using both Fortran and C:

 clang   gfortran 

Benchmarks using both C and C++:

 clang++   clang 

Benchmarks using Fortran, C, and C++:

 clang++   clang   gfortran 

Base Portability Flags

503.bwaves_r:  -DSPEC_LP64 
507.cactuBSSN_r:  -DSPEC_LP64 
508.namd_r:  -DSPEC_LP64 
510.parest_r:  -DSPEC_LP64 
511.povray_r:  -DSPEC_LP64 
519.lbm_r:  -DSPEC_LP64 
521.wrf_r:  -DSPEC_CASE_FLAG   -fconvert=big-endian   -DSPEC_LP64 
526.blender_r:  -funsigned-char   -D__BOOL_DEFINED   -DSPEC_LP64 
527.cam4_r:  -DSPEC_CASE_FLAG   -DSPEC_LP64 
538.imagick_r:  -DSPEC_LP64 
544.nab_r:  -DSPEC_LP64 
549.fotonik3d_r:  -DSPEC_LP64 
554.roms_r:  -DSPEC_LP64 

Base Optimization Flags

C benchmarks:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -disable-vect-cmp   -O3   -ffast-math   -march=znver1   -fstruct-layout=2   -mllvm   -unroll-threshold=100   -fremap-arrays   -mno-avx2   -inline-threshold=1000   -z muldefs   -ljemalloc 

C++ benchmarks:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -disable-vect-cmp   -O3   -march=znver1   -mllvm   -unroll-threshold=100   -finline-aggressive   -fremap-arrays   -inline-threshold=1000   -z muldefs   -ljemalloc 

Fortran benchmarks:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -disable-vect-cmp   -O3   -mavx   -madx   -funroll-loops   -ffast-math   -z muldefs   -fplugin=dragonegg.so   -fplugin-arg-dragonegg-llvm-option="   -disable-vect-cmp"   -ljemalloc   -lgfortran    -lamdlibm  

Benchmarks using both Fortran and C:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -disable-vect-cmp   -O3   -ffast-math   -march=znver1   -fstruct-layout=2   -mllvm   -unroll-threshold=100   -fremap-arrays   -mno-avx2   -inline-threshold=1000   -mavx   -madx   -funroll-loops   -z muldefs   -fplugin=dragonegg.so   -fplugin-arg-dragonegg-llvm-option="   -disable-vect-cmp"   -ljemalloc   -lgfortran    -lamdlibm  

Benchmarks using both C and C++:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -disable-vect-cmp   -O3   -ffast-math   -march=znver1   -fstruct-layout=2   -mllvm   -unroll-threshold=100   -fremap-arrays   -mno-avx2   -inline-threshold=1000   -finline-aggressive   -z muldefs   -ljemalloc 

Benchmarks using Fortran, C, and C++:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -disable-vect-cmp   -O3   -ffast-math   -march=znver1   -fstruct-layout=2   -mllvm   -unroll-threshold=100   -fremap-arrays   -mno-avx2   -inline-threshold=1000   -finline-aggressive   -mavx   -madx   -funroll-loops   -z muldefs   -fplugin=dragonegg.so   -fplugin-arg-dragonegg-llvm-option="   -disable-vect-cmp"   -ljemalloc 

Peak Compiler Invocation

C benchmarks:

 clang 

C++ benchmarks:

 clang++ 

Fortran benchmarks:

 clang   gfortran 

Benchmarks using both Fortran and C:

 clang   gfortran 

Benchmarks using both C and C++:

 clang++   clang 

Benchmarks using Fortran, C, and C++:

 clang++   clang   gfortran 

Peak Portability Flags

Same as Base Portability Flags

Peak Optimization Flags

C benchmarks:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -Ofast   -march=znver1   -fstruct-layout=3   -mllvm   -vectorize-memory-aggressively   -mno-avx2   -unroll-threshold=100   -fremap-arrays   -inline-threshold=1000   -ljemalloc 

C++ benchmarks:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -Ofast   -march=znver1   -finline-aggressive   -mllvm   -unroll-threshold=100   -fremap-arrays   -inline-threshold=1000   -ljemalloc 

Fortran benchmarks:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -O3   -mavx2   -madx   -funroll-loops   -ffast-math   -fplugin=dragonegg.so   -fplugin-arg-dragonegg-llvm-option="   -inline-threshold:1000"   -ljemalloc   -lgfortran    -lamdlibm  

Benchmarks using both Fortran and C:

521.wrf_r:  -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -O3   -mavx   -ffast-math   -funroll-loops   -fplugin=dragonegg.so   -fplugin-arg-dragonegg-llvm-option="   -inline-threshold:1000"   -ljemalloc   -lgfortran    -lamdlibm  
527.cam4_r:  -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -Ofast   -march=znver1   -fstruct-layout=3   -mllvm   -vectorize-memory-aggressively   -mno-avx2   -unroll-threshold=100   -fremap-arrays   -inline-threshold=1000   -O3   -mavx2   -madx   -funroll-loops   -ffast-math   -fplugin=dragonegg.so   -fplugin-arg-dragonegg-llvm-option="   -inline-threshold:1000"   -ljemalloc   -lgfortran    -lamdlibm  

Benchmarks using both C and C++:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -Ofast   -march=znver1   -fstruct-layout=3   -mllvm   -vectorize-memory-aggressively   -mno-avx2   -unroll-threshold=100   -fremap-arrays   -inline-threshold=1000   -finline-aggressive   -ljemalloc 

Benchmarks using Fortran, C, and C++:

 -flto   -Wl,   -plugin-opt=   -merge-constant   -lsr-in-nested-loop   -Ofast   -march=znver1   -fstruct-layout=3   -mllvm   -vectorize-memory-aggressively   -mno-avx2   -unroll-threshold=100   -fremap-arrays   -inline-threshold=1000   -finline-aggressive   -O3   -mavx2   -madx   -funroll-loops   -ffast-math   -fplugin=dragonegg.so   -fplugin-arg-dragonegg-llvm-option="   -inline-threshold:1000"   -ljemalloc 

The flags files that were used to format this result can be browsed at
http://www.spec.org/cpu2017/flags/aocc100-flags-revC-I.2018-02-16.html,
http://www.spec.org/cpu2017/flags/gcc.2018-02-16.html,
http://www.spec.org/cpu2017/flags/Cisco-Platform-Settings-AMD-V1-revA.html.

You can also download the XML flags sources by saving the following links:
http://www.spec.org/cpu2017/flags/aocc100-flags-revC-I.2018-02-16.xml,
http://www.spec.org/cpu2017/flags/gcc.2018-02-16.xml,
http://www.spec.org/cpu2017/flags/Cisco-Platform-Settings-AMD-V1-revA.xml.