Supermicro Hyper A+ Server AS -2126HS-TN 1178605 SPECjbb2015-Distributed max-jOPS
120700 SPECjbb2015-Distributed critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: September 18, 2024
SPEC license #: 001176 Hardware Availability: Oct-2024 Software Availability: Jul-2024 Publication: Thu Oct 10 13:03:35 EDT 2024
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips2
Total Cores384
Total Threads768
Total Memory Amount (GB)1536
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameHyper A+ Server AS -2126HS-TN
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableOct-2024
ModelH14DSH
Form Factor2U
CPU NameAMD EPYC 9965
CPU Characteristics192 core, 2.25GHz, 384MB L3 Cache (Max. Boost Clock up to 3.7GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System384
Cores Per Chip192
Threads Per System768
Threads Per Core2
Version1.1 09/09/2024
CPU Frequency (MHz)2250
Primary Cache32KB(I)+48KB(D) per core
Secondary Cache1MB (I+D) per core
Tertiary Cache384MB (I+D) on chip per chip
Other CacheNone
Disk1 x 3.84 TB NVMe PCIe Gen5.0
File Systembtrfs
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64GB
Memory Details64GB 2Rx4 DDR5 6400 MHz, running at 6000 MHz.
# and type of Network Interface Cards (NICs)1 x 1 GbE NIC
Power Supply Quantity and Rating (W)2 x 1600w
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP6
VendorSUSE
Vendor URLhttp://suse.com/
Version6.4.0-150600.23.17-default
AvailableJun-2024
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 22.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 22.0.2
AvailableJul-2024
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameHyper A+ Server AS -2126HS-TN
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableOct-2024
ModelH14DSH
Form Factor2U
CPU NameAMD EPYC 9755
CPU Characteristics128 core, 2.7GHz, 512MB L3 Cache (Max. Boost Clock up to 4.1GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System256
Cores Per Chip128
Threads Per System512
Threads Per Core2
Version1.1 09/09/2024
CPU Frequency (MHz)2700
Primary Cache32KB(I)+48KB(D) per core
Secondary Cache1MB (I+D) per core
Tertiary Cache512MB (I+D) on chip per chip
Other CacheNone
Disk1 x 3.84 TB NVMe PCIe Gen5.0
File Systembtrfs
Memory Amount (GB)1536
# and size of DIMM(s)24 x 64GB
Memory Details64GB 2Rx4 DDR5 6400 MHz, running at 6000 MHz.
# and type of Network Interface Cards (NICs)1 x 1 GbE NIC
Power Supply Quantity and Rating (W)2 x 1600w
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP6
VendorSUSE
Vendor URLhttp://suse.com/
Version6.4.0-150600.23.17-default
AvailableJun-2024
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 22.0.2
VendorOracle
Vendor URLhttp://oracle.com/
VersionJava HotSpot 64-bit Server VM, version 22.0.2
AvailableJul-2024
Bitness64
NotesNone
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • NUMA nodes per socket = NPS4
  • Determinism Control = Manual
  • Determinism Enable = Power
  • xGMI Link Configuration = 4 xGMI Links
  • 4 Link xGMI max speed = 32Gbps
  • TDP Control = Manual
  • TDP = 500
  • Package Power Limit Control = Manual
  • Package Power Limit = 500

Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(24)
OS Image Description os_1
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance
  • ulimit -n 1024000

  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 999000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 999000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 999000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms31g -Xmx31g -Xmn28g -XX:AllocatePrefetchInstr=2 -XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=2m -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:SurvivorRatio=20 -XX:TargetSurvivorRatio=95 -XX:MaxTenuringThreshold=15 -XX:InlineSmallCode=11k -XX:MaxGCPauseMillis=100 -XX:LoopUnrollLimit=200 -XX:+UseTransparentHugePages -XX:TLABAllocationWeight=2 -XX:CompileThresholdScaling=120 -XX:CICompilerCount=4 -XX:AutoBoxCacheMax=32 -XX:OnStackReplacePercentage=100 -XX:TLABSize=64k -XX:MinTLABSize=64k -XX:-ResizeTLAB -XX:TLABWasteTargetPercent=1 -XX:TLABWasteIncrement=1 -XX:YoungPLABSize=64k -XX:OldPLABSize=64k

Tuning

Used numactl to affinitize each Backend JVM to 16 Core / 32 Threads

  • Group1: --physcpubind=0-15,384-399 --localalloc
  • Group2: --physcpubind=16-31,400-415 --localalloc
  • Group3: --physcpubind=32-47,416-431 --localalloc
  • Group4: --physcpubind=48-63,432-447 --localalloc
  • Group5: --physcpubind=64-79,448-463 --localalloc
  • Group6: --physcpubind=80-95,464-479 --localalloc
  • Group7: --physcpubind=96-111,480-495 --localalloc
  • Group8: --physcpubind=112-127,496-511 --localalloc
  • Group9: --physcpubind=128-143,512-527 --localalloc
  • Group10: --physcpubind=144-159,528-543 --localalloc
  • Group11: --physcpubind=160-175,544-559 --localalloc
  • Group12: --physcpubind=176-191,560-575 --localalloc
  • Group13: --physcpubind=192-207,576-591 --localalloc
  • Group14: --physcpubind=208-223,592-607 --localalloc
  • Group15: --physcpubind=224-239,608-623 --localalloc
  • Group16: --physcpubind=240-255,624-639 --localalloc
  • Group17: --physcpubind=256-271,640-655 --localalloc
  • Group18: --physcpubind=272-287,656-671 --localalloc
  • Group19: --physcpubind=288-303,672-687 --localalloc
  • Group20: --physcpubind=304-319,688-703 --localalloc
  • Group21: --physcpubind=320-335,704-719 --localalloc
  • Group22: --physcpubind=336-351,720-735 --localalloc
  • Group23: --physcpubind=352-367,736-751 --localalloc
  • Group24: --physcpubind=368-383,752-767 --localalloc

Notes None
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • NUMA nodes per socket = NPS2
  • Determinism Control = Manual
  • Determinism Enable = Power
  • xGMI Link Configuration = 4 xGMI Links
  • 4 Link xGMI max speed = 32Gbps
  • TDP Control = Manual
  • TDP = 500
  • Package Power Limit Control = Manual
  • Package Power Limit = 500

Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(24)
OS Image Description os_2
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance
  • ulimit -n 1024000

  • echo 960000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 999000000 > /proc/sys/kernel/sched_latency_ns
  • echo 40000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 999000000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 999000000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 9000 > /proc/sys/kernel/sched_nr_migrate
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo 0 > /proc/sys/vm/numa_stat
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-Xms25g -Xmx25g -Xmn20g -XX:+UseParallelGC -XX:ParallelGCThreads=10 -XX:CICompilerCount=2

Tuning None
Notes

Used numactl to interleave memory on all Nodes in Driver system

  • numactl --interleave=all

JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-Xms10g -Xmx10g -Xmn8g -XX:+UseParallelGC -XX:ParallelGCThreads=10 -XX:CICompilerCount=2

Tuning None
Notes

Used numactl to affinitize 6 Transaction Injector JVM to one NUMA node in Driver system

  • Group1:numactl --cpunodebind=0 --membind=0
  • Group2:numactl --cpunodebind=0 --membind=0
  • Group3:numactl --cpunodebind=0 --membind=0
  • ...
  • Group7:numactl --cpunodebind=1 --membind=1
  • ...
  • Group24:numactl --cpunodebind=3 --membind=3

max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Pass Fail Fail
jOPS 1150205 1164405 1178605 1192805 1207005
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 120700 120700 120700 120700 120700 120700
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us - / 14200 - / 14200 - / 14200 - / 14200 - / 14200 - / 14200
1000us 99400 / 113600 28400 / 42600 - / 14200 - / 14200 - / 14200 - / 14200
5000us 113600 / 127801 113600 / 127801 99400 / 71000 56800 / 71000 56800 / 71000 - / 14200
10000us 113600 / 127801 113600 / 127801 113600 / 127801 113600 / 127801 113600 / 127801 - / 14200
25000us 127801 / 142001 113600 / 127801 113600 / 127801 113600 / 127801 113600 / 127801 28400 / 14200
50000us 142001 / 156201 127801 / 142001 113600 / 127801 113600 / 127801 113600 / 127801 28400 / 14200
75000us 142001 / 156201 127801 / 142001 127801 / 142001 113600 / 127801 113600 / 127801 28400 / 42600
100000us 411802 / 198801 142001 / 156201 127801 / 142001 127801 / 142001 113600 / 127801 99400 / 42600
200000us 1036604 / 880404 170401 / 184601 142001 / 156201 142001 / 156201 142001 / 156201 113600 / 85200
500000us 1164405 / 1178605 1065004 / 1050804 710003 / 724203 624803 / 610603 454402 / 340801 156201 / 170401
1000000us 1178605 / - 1164405 / 1178605 1136005 / 1150205 1107605 / 1121805 994004 / 979804 482802 / 326601
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group10.Backend.beJVM Group10.TxInjector.txiJVM1 Group11.Backend.beJVM Group11.TxInjector.txiJVM1 Group12.Backend.beJVM Group12.TxInjector.txiJVM1 Group13.Backend.beJVM Group13.TxInjector.txiJVM1 Group14.Backend.beJVM Group14.TxInjector.txiJVM1 Group15.Backend.beJVM Group15.TxInjector.txiJVM1 Group16.Backend.beJVM Group16.TxInjector.txiJVM1 Group17.Backend.beJVM Group17.TxInjector.txiJVM1 Group18.Backend.beJVM Group18.TxInjector.txiJVM1 Group19.Backend.beJVM Group19.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group20.Backend.beJVM Group20.TxInjector.txiJVM1 Group21.Backend.beJVM Group21.TxInjector.txiJVM1 Group22.Backend.beJVM Group22.TxInjector.txiJVM1 Group23.Backend.beJVM Group23.TxInjector.txiJVM1 Group24.Backend.beJVM Group24.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1 Group7.Backend.beJVM Group7.TxInjector.txiJVM1 Group8.Backend.beJVM Group8.TxInjector.txiJVM1 Group9.Backend.beJVM Group9.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 256 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320
specjbb.comm.connect.selector.runner.count 0 8 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5
specjbb.comm.connect.timeouts.connect 60000 900000
specjbb.comm.connect.timeouts.read 60000 800000
specjbb.comm.connect.timeouts.write 60000 800000
specjbb.comm.connect.worker.pool.max 256 256 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320 320
specjbb.comm.connect.worker.pool.min 1 1 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16 32 16
specjbb.controller.host localhost 10.216.177.63
specjbb.controller.maxir.maxFailedPoints 3 1
specjbb.customerDriver.threads 64 {probe=80, saturate=120, service=90}
specjbb.forkjoin.workers 512 {Tier1=360, Tier2=20, Tier3=70}
specjbb.group.count 1 24
specjbb.heartbeat.period 10000 400000
specjbb.heartbeat.threshold 100000 4000000
specjbb.mapreducer.pool.size 512 24
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 1420006 IR
High-bound (settled) is 1247634 IR