SPEC(R) MPIM2007 Summary Cray Big Red II (AMD Opteron 6380, 2.5 GHz) Thu Apr 2 10:28:13 2015 MPI2007 License: 3440A Test date: Mar-2015 Test sponsor: Indiana University Hardware availability: Apr-2013 Tested by: Indiana University Software availability: Jun-2013 Base Base Base Peak Peak Peak Benchmarks Ranks Run Time Ratio Ranks Run Time Ratio -------------- ------ --------- --------- ------ --------- --------- 104.milc 128 82.6 19.0 * 104.milc 128 82.6 18.9 S 104.milc 128 82.5 19.0 S 107.leslie3d 128 274 19.0 S 107.leslie3d 128 274 19.0 S 107.leslie3d 128 274 19.0 * 113.GemsFDTD 128 297 21.3 * 113.GemsFDTD 128 296 21.3 S 113.GemsFDTD 128 297 21.2 S 115.fds4 128 198 9.85 * 115.fds4 128 198 9.86 S 115.fds4 128 199 9.82 S 121.pop2 128 444 9.29 S 121.pop2 128 444 9.30 * 121.pop2 128 444 9.31 S 122.tachyon 128 218 12.9 * 122.tachyon 128 217 12.9 S 122.tachyon 128 218 12.8 S 126.lammps 128 182 16.0 S 126.lammps 128 182 16.0 * 126.lammps 128 182 16.0 S 127.wrf2 128 233 33.5 S 127.wrf2 128 232 33.6 S 127.wrf2 128 233 33.5 * 128.GAPgeofem 128 96.1 21.5 S 128.GAPgeofem 128 96.3 21.4 S 128.GAPgeofem 128 96.1 21.5 * 129.tera_tf 128 238 11.6 S 129.tera_tf 128 239 11.6 S 129.tera_tf 128 238 11.6 * 130.socorro 128 174 21.9 S 130.socorro 128 174 22.0 S 130.socorro 128 174 22.0 * 132.zeusmp2 128 281 11.0 S 132.zeusmp2 128 280 11.1 * 132.zeusmp2 128 278 11.1 S 137.lu 128 130 28.4 * 137.lu 128 130 28.4 S 137.lu 128 130 28.3 S ============================================================================== 104.milc 128 82.6 19.0 * 107.leslie3d 128 274 19.0 * 113.GemsFDTD 128 297 21.3 * 115.fds4 128 198 9.85 * 121.pop2 128 444 9.30 * 122.tachyon 128 218 12.9 * 126.lammps 128 182 16.0 * 127.wrf2 128 233 33.5 * 128.GAPgeofem 128 96.1 21.5 * 129.tera_tf 128 238 11.6 * 130.socorro 128 174 22.0 * 132.zeusmp2 128 280 11.1 * 137.lu 128 130 28.4 * SPECmpiM_base2007 16.8 SPECmpiM_peak2007 Not Run BENCHMARK DETAILS ----------------- Type of System: Homogeneous Total Compute Nodes: 8 Total Chips: 16 Total Cores: 256 Total Threads: 256 Total Memory: 512 GB Base Ranks Run: 128 Minimum Peak Ranks: -- Maximum Peak Ranks: -- C Compiler: Intel C Composer XE 2013 for Linux, Version 13.1.3.192 Build 20130607 C++ Compiler: Intel C++ Composer XE 2013 for Linux, Version 13.1.3.192 Build 20130607 Fortran Compiler: Intel Fortran Composer XE 2013 for Linux, Version 13.1.3.192 Build 20130607 Base Pointers: 64-bit Peak Pointers: 64-bit MPI Library: Cray MPI (MPT) 7.1.2 Other MPI Info: None Pre-processors: No Other Software: None Node Description: Big Red II Node ================================= HARDWARE -------- Number of nodes: 8 Uses of the node: compute Vendor: Cray Model: XE6 CPU Name: AMD Opteron 6380 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 32 Cores per chip: 16 Threads per core: 1 CPU Characteristics: AMD Turbo CORE technology up to 3.40 GHz CPU MHz: 2500 Primary Cache: 512 KB I on chip per chip, 64 KB I shared / 2 cores; 16 KB D on chip per core Secondary Cache: 16 MB I+D on chip per chip, 2 MB shared / 2 cores L3 Cache: 16 MB I+D on chip per chip, 8 MB shared / 8 cores Other Cache: None Memory: 64 GB (8 x 8 GB 2Rx4 PC3L-12800R-11, ECC running at 1600 MHz and CL11) Disk Subsystem: None Other Hardware: None Adapter: Mellanox ConnectX MHQH29-XTC Number of Adapters: 1 Slot Type: PCIe x8 Gen 2 Data Rate: 40Gbps Ports Used: 1 Interconnect Type: 40 Gigabit Infiniband (QDR) Adapter: Cray Gemini Number of Adapters: 1 Slot Type: AMD HyperTransport 3 Data Rate: 76.8Gbps Ports Used: 1 Interconnect Type: Gemini SOFTWARE -------- Adapter: Mellanox ConnectX MHQH29-XTC Adapter Driver: 1.0-ofed1.5.4 Adapter Firmware: 2.9.1000 Adapter: Cray Gemini Adapter Driver: Proprietary Cray_kgni Adapter Firmware: 0.17 Operating System: SUSE Linux Enterprise Server 11 (x86_64), Cray Linux Environment 4.2 Kernel 2.6.32.59-0.7.1_1.0402.7496-cray_gem_c Local File System: None Shared File System: lustre System State: Multi-User Other Software: TORQUE-2.5.7 Node Description: Data Capacitor II =================================== HARDWARE -------- Number of nodes: 2 Uses of the node: fileserver Vendor: DDN Model: DDN SFA12K CPU Name: Intel Xeon CPU E5-2620 CPU(s) orderable: 1-2 chips Chips enabled: 2 Cores enabled: 12 Cores per chip: 6 Threads per core: 1 CPU Characteristics: Intel Turbo Boost Technology up to 2.50 GHz CPU MHz: 2000 Primary Cache: 32 KB I + 32 KB D on chip per core Secondary Cache: 256 KB I+D on chip per core L3 Cache: 15 MB I+D on chip per chip Other Cache: None Memory: 96 GB Disk Subsystem: 30 TB RAID 6, 10 (8 + 2) x 3 TB SATA (Hitachi, 7200RPM, 6.0Gbps) Other Hardware: None Adapter: Mellanox ConnectX MHQH29-XTC Number of Adapters: 1 Slot Type: PCIe x8 Gen 2 Data Rate: 40Gbps Ports Used: 1 Interconnect Type: 40 Gigabit Infiniband (QDR) SOFTWARE -------- Adapter: Mellanox ConnectX MHQH29-XTC Adapter Driver: 1.0-ofed1.5.4 Adapter Firmware: 2.9.1000 Operating System: CentOS 6.2 Local File System: Linux/ext4 Shared File System: lustre System State: Multi-User Other Software: None Interconnect Description: Infiniband (QDR) ========================================== HARDWARE -------- Vendor: DDN Model: Mellanox SX6506 Switch Model: Mellanox SX6506 Number of Switches: 1 Number of Ports: 108 Data Rate: 56 Gbps Firmware: mellanox SX6506 Topology: switched Primary Use: Lustre fileserver Interconnect Description: Cray Gemini ===================================== HARDWARE -------- Vendor: Cray Model: Cray Gemini Switch Model: Cray Gemini Number of Switches: 264 Number of Ports: 48 Data Rate: 9.36 GB/s Firmware: 0.17 Topology: 3D Torus Primary Use: MPI traffic Submit Notes ------------ The config file option 'submit' was used. General Notes ------------- 130.socorro (base): "nullify_ptrs" src.alt was used. MPI startup command: aprun command was used to start MPI jobs. A flag below is used to place processes onto 16 cores out of 32 on a node: -cc 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30 export MPICH_NO_BUFFER_ALIAS_CHECK=true If set, the buffer alias error check for collectives is disabled. The MPI standard does not allow aliasing of type OUT or INOUT parameters on the same collective function call. The default is false. Network: 3D Torus Job placement: PBS is used for job placement. Compute nodes are selected by PBS. No specific node selection is used. Base Compiler Invocation ------------------------ C benchmarks: cc C++ benchmarks: 126.lammps: CC Fortran benchmarks: ftn Benchmarks using both Fortran and C: cc ftn Base Portability Flags ---------------------- 121.pop2: -DSPEC_MPI_CASE_FLAG 126.lammps: -DMPICH_IGNORE_CXX_SEEK 127.wrf2: -DSPEC_MPI_CASE_FLAG -DSPEC_MPI_LINUX 130.socorro: -assume nostd_intent_in Base Optimization Flags ----------------------- C benchmarks: -O3 -no-prec-div C++ benchmarks: 126.lammps: -O3 -no-prec-div Fortran benchmarks: -O3 -no-prec-div Benchmarks using both Fortran and C: -O3 -no-prec-div The flags file that was used to format this result can be browsed at http://www.spec.org/mpi2007/flags/EM64T_Intel140_flags.20150429.html You can also download the XML flags source by saving the following link: http://www.spec.org/mpi2007/flags/EM64T_Intel140_flags.20150429.xml SPEC and SPEC MPI are registered trademarks of the Standard Performance Evaluation Corporation. All other brand and product names appearing in this result are trademarks or registered trademarks of their respective holders. ----------------------------------------------------------------------------- For questions about this result, please contact the tester. For other inquiries, please contact webmaster@spec.org. Copyright 2006-2010 Standard Performance Evaluation Corporation Tested with SPEC MPI2007 v2.0.1. Report generated on Wed Apr 29 12:32:31 2015 by MPI2007 ASCII formatter v1463. Originally published on 29 April 2015.