Hewlett Packard Enterprise ProLiant DL560 Gen10 373935 SPECjbb2015-Distributed max-jOPS
27054 SPECjbb2015-Distributed critical-jOPS
Tested by: Hewlett Packard Enterprise Test Sponsor: Hewlett Packard Enterprise Test location: Houston, TX Test date: March 07, 2019
SPEC license #: 3 Hardware Availability: Apr-2019 Software Availability: Jan-2019 Publication: Tue Apr 2 15:05:14 EDT 2019
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYes
Total Nodes1
All Nodes IdenticalYes
Nodes Per System1
Total Chips4
Total Cores112
Total Threads224
Total Memory Amount (GB)768
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameProLiant DL560 Gen10
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableApr-2019
ModelProLiant DL560 Gen10
Form Factor2U Rack
CPU NameIntel Xeon Platinum 8280L
CPU Characteristics28 Core, 2.7 GHz, 38.5 MB L3 Cache (Turbo Boost Technology up to 4.0 GHz)
Number of Systems1
Nodes Per System1
Chips Per System4
Cores Per System112
Cores Per Chip28
Threads Per System224
Threads Per Core2
VersionU34 2.00 02/02/2019
CPU Frequency (MHz)2700
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache1024 KB I+D on chip per core
Tertiary Cache38.5 MB I+D on chip per chip
Other CacheNone
Disk2 x 400 GB SSD SATA
File SystemXFS
Memory Amount (GB)768
# and size of DIMM(s)48 x 16 GB
Memory Details16 GB 2Rx8 PC4-2933Y-R
# and type of Network Interface Cards (NICs)HPE Ethernet 1Gb 4-port
Power Supply Quantity and Rating (W)4 x 1600
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15
VendorSUSE
Vendor URLhttp://suse.com/
Version4.12.14-23-default
AvailableJul-2018
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 11.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 11.0.2
AvailableJan-2019
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameSynergy 660 Gen10
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableApr-2019
ModelSynergy 660 Gen10
Form FactorFull-Height Compute Module
CPU NameIntel Xeon Platinum 8280
CPU Characteristics28 Core, 2.7 GHz, 38.5 MB L3 Cache (Turbo Boost Technology up to 4.0 GHz)
Number of Systems1
Nodes Per System1
Chips Per System4
Cores Per System112
Cores Per Chip28
Threads Per System224
Threads Per Core2
VersionI43 2.00 02/02/2019
CPU Frequency (MHz)2700
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache1024 KB I+D on chip per core
Tertiary Cache38.5 MB I+D on chip per chip
Other CacheNone
Disk2 x 400 GB SSD SATA
File SystemXFS
Memory Amount (GB)768
# and size of DIMM(s)48 x 16 GB
Memory Details16 GB 2Rx8 PC4-2933Y-R
# and type of Network Interface Cards (NICs)Synergy 3820C 10/20Gb CNA
Power Supply Quantity and Rating (W)6 x 2650
Other HardwareNone
Cabinet/Housing/EnclosureSynergy 12000 Frame
Shared DescriptionNone
Shared CommentNone
Notes
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15
VendorSUSE
Vendor URLhttp://suse.com/
Version4.12.14-23-default
AvailableJul-2018
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 11.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 11.0.2
AvailableJan-2019
Bitness64
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning
  • Workload Profile=High Performance Compute
  • Sub-NUMA Clustering=Enabled
  • Thermal Configuration=Maximum Cooling
  • Memory Partrol Scrubbing=Disabled
  • Enhanced Processor Performance=Enabled
  • LLC Prefetcher=Enabled
  • Process Jitter Control=Manual-tuned
  • Process Jitter Control Frequency=3200
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(8)
OS Image Description os_1
Tuning
  • tuned-adm profile=throughput-performance
  • ulimit -n 65535
  • echo 16 > /proc/sys/kernel/sched_nr_migrate
  • echo 16000000 > /proc/sys/kernel/sched_latency_ns
  • echo 30000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • Added 'processor.max_cstate=1 intel_idle.max_cstate=0' to GRUB_CMDLINE_LINUX_DEFAULT
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-showversion -server -XX:AllocatePrefetchInstr=2 -XX:+UseParallelOldGC -XX:ParallelGCThreads=28 -XX:LargePageSizeInBytes=2m -XX:+AggressiveOpts -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseLargePages -Xms30g -Xmx30g -Xmn27g -XX:SurvivorRatio=28 -XX:TargetSurvivorRatio=95 -XX:MaxTenuringThreshold=15 -Xnoclassgc -XX:+UseRTMLocking -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=300 -XX:+UseRTMDeopt -XX:UseAVX=0 -XX:LoopUnrollLimit=20 -XX:AdaptiveSizeMajorGCDecayTimeScale=12 -XX:AdaptiveSizeDecrementScaleFactor=2

Tuning None
Notes

Used numactl to affinitize each Backend JVM to physical cores in a NUMA node.

  • numactl --physcpubind=0-13,56-69 --membind=0
  • numactl --physcpubind=14-27,70-83 --membind=1
  • numactl --physcpubind=28-41,84-97 --membind=2
  • numactl --physcpubind=42-55,98-111 --membind=3
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning
  • Workload Profile=High Performance Compute
  • Sub-NUMA Clustering=Enabled
  • Thermal Configuration=Maximum Cooling
  • Memory Partrol Scrubbing=Disabled
  • Enhanced Processor Performance=Enabled
  • LLC Prefetcher=Enabled
  • Process Jitter Control=Manual-tuned
  • Process Jitter Control Frequency=3200
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(8)
OS Image Description os_2
Tuning
  • tuned-adm profile=throughput-performance
  • ulimit -n 65535
  • echo 16 > /proc/sys/kernel/sched_nr_migrate
  • echo 16000000 > /proc/sys/kernel/sched_latency_ns
  • echo 30000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 990000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 1000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • Added 'processor.max_cstate=1 intel_idle.max_cstate=0' to GRUB_CMDLINE_LINUX_DEFAULT
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-server -Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelOldGC

Tuning None
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line

-Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelOldGC

Tuning None
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 369201 373935 378668 383401 388135
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 26033 26033 26033 26033 31555 27054
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us - / 4733 - / 4733 - / 4733 - / 4733 - / 4733 - / 4733
1000us 80467 / 85200 14200 / 18933 4733 / 9467 4733 / 9467 - / 4733 - / 4733
5000us 293468 / 298201 198801 / 203534 71000 / 75734 47333 / 52067 23667 / 28400 4733 / 9467
10000us 307668 / 312401 246134 / 250868 108867 / 94667 47333 / 52067 23667 / 28400 4733 / 9467
25000us 317134 / 321868 274534 / 279268 127800 / 132534 52067 / 56800 23667 / 28400 4733 / 9467
50000us 326601 / 331334 288734 / 293468 160934 / 132534 104134 / 75734 23667 / 28400 4733 / 9467
75000us 336068 / 340801 298201 / 302934 165667 / 170401 104134 / 94667 23667 / 28400 4733 / 9467
100000us 336068 / 340801 302934 / 307668 208267 / 213001 127800 / 132534 37867 / 28400 4733 / 9467
200000us 355001 / 359735 326601 / 321868 288734 / 284001 265068 / 255601 104134 / 94667 9467 / 14200
500000us 369201 / 373935 359735 / 364468 331334 / 336068 317134 / 321868 312401 / 307668 85200 / 66267
1000000us 373935 / - 373935 / - 364468 / 369201 364468 / 369201 359735 / 364468 165667 / 132534
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller
specjbb.comm.connect.client.pool.size 256 192
specjbb.comm.connect.selector.runner.count 0 4
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 80
specjbb.controller.host localhost 10.10.0.80
specjbb.customerDriver.threads 64 {probe=64, saturate=64}
specjbb.forkjoin.workers 224 {Tier1=210, Tier2=70, Tier3=28}
specjbb.group.count 1 8
specjbb.mapreducer.pool.size 224 28
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 473335 IR
High-bound (settled) is 394579 IR