SPECjbb2015
Copyright © 2015-2021 Standard Performance Evaluation Corporation
Super Micro Computer, Inc Supermicro SuperBlade A+ Blade Server SBA-4119S-C2N 2919887 SPECjbb2015-Distributed max-jOPS
2561044 SPECjbb2015-Distributed critical-jOPS
Tested by: Super Micro Computer, Inc Test Sponsor: Super Micro Computer, Inc Test location: San Jose, California Test date: February 24, 2021
SPEC license #: 001176 Hardware Availability: Mar-2021 Software Availability: Jan-2021 Publication: Mon Mar 15 12:05:07 EDT 2021
Benchmark Results Summary
 
SPECjbb2015-Distributed: Distributed JVMs/Single or Multi Hosts
(# of groups: 80)
Overall Throughput RT curve
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes20
All Nodes IdenticalYES
Nodes Per System20
Total Chips20
Total Cores1280
Total Threads2560
Total Memory Amount (GB)10240
Total OS Images20
SW EnvironmentNon-virtual
  
SUT Description
Hardware hw_1
NameSupermicro SuperBlade A+ Blade Server SBA-4119S-C2N
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
AvailableMar-2021
ModelBH12SSi
Form Factor8U
CPU NameAMD EPYC 7763
CPU Characteristics64 core, 2.45GHz, 256MB L3 Cache (Max Boost Clock up to 3.5GHz)
Number of Systems1
Nodes Per System20
Chips Per System20
Cores Per System1280
Cores Per Chip64
Threads Per System2560
Threads Per Core2
Version2.0 02/23/2021
CPU Frequency (MHz)2450
Primary Cache32KB(I)+32KB(D) per core
Secondary Cache512KB (I+D) per core
Tertiary Cache256MB (I+D) on chip per chip
Other CacheNone
Disk20 x 1TB M.2 PCIe Gen3
File Systembtrfs
Memory Amount (GB)10240
# and size of DIMM(s)160 x 64GB
Memory Details64GB 2Rx4 PC4-25600
# and type of Network Interface Cards (NICs)Onboard 1x25GbE dual-port NIC
Power Supply Quantity and Rating (W)8 x 2200W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise High Performance Computing 15 SP2
VendorSUSE
Vendor URLhttp://suse.com/
Version5.3.18-22-default
AvailableJuly-2020
Bitness64
NotesNone
Operating System os_2
NameSUSE Linux Enterprise High Performance Computing 15 SP2
VendorSUSE
Vendor URLhttp://suse.com/
Version5.3.18-22-default
AvailableJuly-2020
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 15.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 15.0.2
AvailableJan-2021
Bitness64
Notesnote
Java Virtual Machine jvm_1
NameOracle Java SE 15.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 15.0.2
AvailableJan-2021
Bitness64
Notesnote
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Driver Description
Hardware hw_2
NameSupermicro A+ Server 2014TP-HTR
VendorSuper Micro Computer, Inc
Vendor URLhttps://www.supermicro.com
AvailableAug-2019
ModelH12SST-PS
Form Factor2U
CPU NameAMD EPYC 7742
CPU Characteristics64 Core, 2.25 GHz, 256 MB L3 cache (Max Boost Clock up to 3.4 GHz)
Number of Systems1
Nodes Per System2
Chips Per System2
Cores Per System128
Cores Per Chip64
Threads Per System256
Threads Per Core2
Version1.1 02/21/2020
CPU Frequency (MHz)2250
Primary Cache32KB(I)+32KB(D) per core
Secondary Cache512KB (I+D) per core
Tertiary Cache256MB (I+D) on chip per chip
Other CacheNone
Disk2 x 512GB M.2 PCIe Gen3
File Systembtrfs
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64GB
Memory Details64GB 2RX4 PC4-25600
# and type of Network Interface Cards (NICs)2 x 25GbE NIC
Power Supply Quantity and Rating (W)1 x 2000W
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Topology
SUT config_1 Configuration
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • NUMA nodes per socket = NPS2
  • Determinism Control = Manual
  • Determinism Slider = Power
  • L1 Stream HW Prefetcher = Disable
  • L2 Stream HW Prefetcher = Disable
Notes notes
OS Image os_Image_1
JVM Instances jvm_Backend_1(80)
OS Image Description os_1
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 100000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 600000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 100000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/vm/numa_stat
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms122g -Xmx122g -Xmn119g -server -XX:MetaspaceSize=256m -XX:AllocatePrefetchInstr=2 -XX:LargePageSizeInBytes=2m -XX:-UsePerfData -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:+UseParallelGC -XX:SurvivorRatio=75 -XX:TargetSurvivorRatio=80 -XX:ParallelGCThreads=64 -XX:MaxTenuringThreshold=15 -XX:InitialCodeCacheSize=25m -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=200 -XX:+UseCompressedOops -XX:ObjectAlignmentInBytes=32 -XX:+UseTransparentHugePages -XX:+UseUnalignedLoadStores -XX:-UseFastStosb -XX:+UseXMMForArrayCopy -XX:+UseXMMForObjInit -XX:+UseFPUForSpilling
Tuning None
Notes

Used numactl to affinitize two Backend JVM to one NUMA node in every BH12SSi node in SuT

    • Group1:numactl --cpunodebind=0 --membind=0
    • Group2:numactl --cpunodebind=0 --membind=0
    • Group3:numactl --cpunodebind=1 --membind=1
    • Group4:numactl --cpunodebind=1 --membind=1
Driver config_2 Configuration
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • NUMA nodes per socket = NPS4
  • Determinism Control = Manual
  • Determinism Slider = Power
Notes notes
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(80)
OS Image Description os_2
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 40000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 800000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 200000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-Xms10g -Xmx10g -Xmn8g -XX:+UseParallelGC -XX:CICompilerCount=4 -XX:ParallelGCThreads=4
Tuning None
Notes

Used numactl to interleave memory on all Nodes in Driver system

  • numactl --interleave=all
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line

-Xms3g -Xmx3g -Xmn2g -XX:+UseParallelGC -XX:CICompilerCount=2 -XX:ParallelGCThreads=2
Tuning None
Notes

Used numactl to affinitize 20 Transaction Injector JVM to one NUMA node in Driver system

  • Group1:numactl --cpunodebind=0 --membind=0
  • Group2:numactl --cpunodebind=0 --membind=0
  • Group3:numactl --cpunodebind=0 --membind=0
  • GroupN:numactl --cpunodebind=0 --membind=0
  • ...
  • Group20:numactl --cpunodebind=0 --membind=0
  • Group21:numactl --cpunodebind=1 --membind=1
  • Group22:numactl --cpunodebind=1 --membind=1
  • ...
  • Group40:numactl --cpunodebind=1 --membind=1
  • ...
  • Group60:numactl --cpunodebind=2 --membind=2
  • ...
  • Group80:numactl --cpunodebind=3 --membind=3
max-jOPS and critical-jOPS Details
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Pass Fail Fail
jOPS 2840972 2880430 2919887 2959345 2998803
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 2189916 2623953 2663411 2663411 2702869 2561044
Last Success jOPS/First Failure jOPS for SLA points
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 39458 / 78916 - / 39458 - / 39458 - / 39458 - / 39458 - / 39458
1000us 1183738 / 197290 78916 / 118374 39458 / 78916 - / 39458 - / 39458 - / 39458
5000us 2919887 / - 2801514 / 2840972 2170187 / 2209645 1854523 / 1893981 1381028 / 710243 - / 39458
10000us 2919887 / - 2840972 / 2880430 2683140 / 2722598 2643682 / 2683140 2170187 / 2209645 - / 39458
25000us 2919887 / - 2840972 / 2880430 2722598 / 2762056 2683140 / 2722598 2604224 / 2643682 - / 39458
50000us 2919887 / - 2880430 / 2919887 2722598 / 2762056 2683140 / 2722598 2643682 / 2683140 197290 / 78916
75000us 2919887 / - 2880430 / 2919887 2722598 / 2762056 2683140 / 2722598 2643682 / 2683140 315664 / 118374
100000us 2919887 / - 2880430 / 2919887 2722598 / 2762056 2683140 / 2722598 2683140 / 2722598 1183738 / 118374
200000us 2919887 / - 2919887 / - 2722598 / 2762056 2683140 / 2722598 2683140 / 2722598 2485850 / 2406934
500000us 2919887 / - 2919887 / - 2762056 / 2801514 2722598 / 2762056 2683140 / 2722598 2643682 / 2683140
1000000us 2919887 / - 2919887 / - 2801514 / 2840972 2762056 / 2801514 2722598 / 2762056 2683140 / 2722598
Number of probes
Probes jOPS / Total jOPS
Request Mix Accuracy
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
Rate of Non-Critical Failures
There were no non-critical failures in Response Time curve building
Delay between performance status pings during RT Curve (Response-Throughput Curve)
Delay between status pings
IR/PR Accuracy
IR/PR Accuracy
Run Properties
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group10.Backend.beJVM Group10.TxInjector.txiJVM1 Group11.Backend.beJVM Group11.TxInjector.txiJVM1 Group12.Backend.beJVM Group12.TxInjector.txiJVM1 Group13.Backend.beJVM Group13.TxInjector.txiJVM1 Group14.Backend.beJVM Group14.TxInjector.txiJVM1 Group15.Backend.beJVM Group15.TxInjector.txiJVM1 Group16.Backend.beJVM Group16.TxInjector.txiJVM1 Group17.Backend.beJVM Group17.TxInjector.txiJVM1 Group18.Backend.beJVM Group18.TxInjector.txiJVM1 Group19.Backend.beJVM Group19.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group20.Backend.beJVM Group20.TxInjector.txiJVM1 Group21.Backend.beJVM Group21.TxInjector.txiJVM1 Group22.Backend.beJVM Group22.TxInjector.txiJVM1 Group23.Backend.beJVM Group23.TxInjector.txiJVM1 Group24.Backend.beJVM Group24.TxInjector.txiJVM1 Group25.Backend.beJVM Group25.TxInjector.txiJVM1 Group26.Backend.beJVM Group26.TxInjector.txiJVM1 Group27.Backend.beJVM Group27.TxInjector.txiJVM1 Group28.Backend.beJVM Group28.TxInjector.txiJVM1 Group29.Backend.beJVM Group29.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group30.Backend.beJVM Group30.TxInjector.txiJVM1 Group31.Backend.beJVM Group31.TxInjector.txiJVM1 Group32.Backend.beJVM Group32.TxInjector.txiJVM1 Group33.Backend.beJVM Group33.TxInjector.txiJVM1 Group34.Backend.beJVM Group34.TxInjector.txiJVM1 Group35.Backend.beJVM Group35.TxInjector.txiJVM1 Group36.Backend.beJVM Group36.TxInjector.txiJVM1 Group37.Backend.beJVM Group37.TxInjector.txiJVM1 Group38.Backend.beJVM Group38.TxInjector.txiJVM1 Group39.Backend.beJVM Group39.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group40.Backend.beJVM Group40.TxInjector.txiJVM1 Group41.Backend.beJVM Group41.TxInjector.txiJVM1 Group42.Backend.beJVM Group42.TxInjector.txiJVM1 Group43.Backend.beJVM Group43.TxInjector.txiJVM1 Group44.Backend.beJVM Group44.TxInjector.txiJVM1 Group45.Backend.beJVM Group45.TxInjector.txiJVM1 Group46.Backend.beJVM Group46.TxInjector.txiJVM1 Group47.Backend.beJVM Group47.TxInjector.txiJVM1 Group48.Backend.beJVM Group48.TxInjector.txiJVM1 Group49.Backend.beJVM Group49.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group50.Backend.beJVM Group50.TxInjector.txiJVM1 Group51.Backend.beJVM Group51.TxInjector.txiJVM1 Group52.Backend.beJVM Group52.TxInjector.txiJVM1 Group53.Backend.beJVM Group53.TxInjector.txiJVM1 Group54.Backend.beJVM Group54.TxInjector.txiJVM1 Group55.Backend.beJVM Group55.TxInjector.txiJVM1 Group56.Backend.beJVM Group56.TxInjector.txiJVM1 Group57.Backend.beJVM Group57.TxInjector.txiJVM1 Group58.Backend.beJVM Group58.TxInjector.txiJVM1 Group59.Backend.beJVM Group59.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1 Group60.Backend.beJVM Group60.TxInjector.txiJVM1 Group61.Backend.beJVM Group61.TxInjector.txiJVM1 Group62.Backend.beJVM Group62.TxInjector.txiJVM1 Group63.Backend.beJVM Group63.TxInjector.txiJVM1 Group64.Backend.beJVM Group64.TxInjector.txiJVM1 Group65.Backend.beJVM Group65.TxInjector.txiJVM1 Group66.Backend.beJVM Group66.TxInjector.txiJVM1 Group67.Backend.beJVM Group67.TxInjector.txiJVM1 Group68.Backend.beJVM Group68.TxInjector.txiJVM1 Group69.Backend.beJVM Group69.TxInjector.txiJVM1 Group7.Backend.beJVM Group7.TxInjector.txiJVM1 Group70.Backend.beJVM Group70.TxInjector.txiJVM1 Group71.Backend.beJVM Group71.TxInjector.txiJVM1 Group72.Backend.beJVM Group72.TxInjector.txiJVM1 Group73.Backend.beJVM Group73.TxInjector.txiJVM1 Group74.Backend.beJVM Group74.TxInjector.txiJVM1 Group75.Backend.beJVM Group75.TxInjector.txiJVM1 Group76.Backend.beJVM Group76.TxInjector.txiJVM1 Group77.Backend.beJVM Group77.TxInjector.txiJVM1 Group78.Backend.beJVM Group78.TxInjector.txiJVM1 Group79.Backend.beJVM Group79.TxInjector.txiJVM1 Group8.Backend.beJVM Group8.TxInjector.txiJVM1 Group80.Backend.beJVM Group80.TxInjector.txiJVM1 Group9.Backend.beJVM Group9.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 256 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128
specjbb.comm.connect.selector.runner.count 0 8
specjbb.comm.connect.timeouts.connect 60000 900000
specjbb.comm.connect.timeouts.read 60000 800000
specjbb.comm.connect.timeouts.write 60000 800000
specjbb.comm.connect.worker.pool.max 256 256 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128 128
specjbb.comm.connect.worker.pool.min 1 1 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
specjbb.controller.host localhost 172.27.33.201
specjbb.controller.maxir.maxFailedPoints 3 1
specjbb.forkjoin.workers 128 {Tier1=100, Tier2=1, Tier3=15}
specjbb.group.count 1 80
specjbb.heartbeat.period 10000 400000
specjbb.heartbeat.threshold 100000 4000000
specjbb.txi.pergroup.count 1 1
View table in csv format
Validation Details
Validation Reports
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
Other Checks
High-bound (max attempted) is 3945794 IR
High-bound (settled) is 3289494 IR
Copyright © 2015-2021 Standard Performance Evaluation Corporation
http://www.spec.org - info@spec.org
SPECjbb2015 Version: [SPECjbb2015 1.03, Nov 14, 2019]