Hewlett Packard Enterprise ProLiant DL345 Gen10 Plus 205814 SPECjbb2015-Distributed max-jOPS
74833 SPECjbb2015-Distributed critical-jOPS
Tested by: Hewlett Packard Enterprise Test Sponsor: Hewlett Packard Enterprise Test location: Houston, TX Test date: Feb 23, 2021
SPEC license #: 3 Hardware Availability: Apr-2021 Software Availability: Jan-2021 Publication: Mon Mar 15 12:05:07 EDT 2021
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorHewlett Packard Enterprise
Vendor URLhttp://www.hpe.com/
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips1
Total Cores64
Total Threads128
Total Memory Amount (GB)1024
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameProLiant DL345 Gen10 Plus
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableApr-2021
ModelProLiant DL345 Gen10 Plus
Form Factor2U Rack
CPU NameAMD EPYC 7763
CPU Characteristics64 Core, 2.45 GHz, 256 MB L3 Cache(Max Boost Clock up to 3.50 GHz)
Number of Systems1
Nodes Per System1
Chips Per System1
Cores Per System64
Cores Per Chip64
Threads Per System128
Threads Per Core2
VersionA43 02/15/2021
CPU Frequency (MHz)2450
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache512 KB I+D on chip per core
Tertiary Cache256 MB (I+D) on chip per chip
Other CacheNone
Disk2 x 400 GB SSD SAS
File SystemXFS
Memory Amount (GB)1024
# and size of DIMM(s)8 x 128 GB
Memory Details128 GB 4Rx4 PC4-3200AA-L
# and type of Network Interface Cards (NICs)HPE Ethernet 10Gb 2-port
Power Supply Quantity and Rating (W)2 x 800
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameSUSE Linux Enterprise Server 15 SP2
VendorSUSE
Vendor URLhttp://suse.com/
Version5.3.18.22-default
AvailableJul-2020
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 15.0.2
VendorOracle
Vendor URLhttp://www.oracle.com
VersionJava HotSpot 64-bit Server VM, version 15.0.2
AvailableJan-2021
Bitness64
NotesNone
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware hw_2
NameProLiant DL365 Gen10 Plus
VendorHewlett Packard Enterprise
Vendor URLhttp://hpe.com/
AvailableApr-2021
ModelProLiant DL365 Gen10 Plus
Form Factor1U Rack
CPU NameAMD EPYC 7713
CPU Characteristics64 Core, 2.0 GHz, 256 MB L3 Cache(Max Boost Clock up to 3.50 GHz)
Number of Systems1
Nodes Per System1
Chips Per System2
Cores Per System128
Cores Per Chip64
Threads Per System256
Threads Per Core2
VersionA42 02/15/2021
CPU Frequency (MHz)2000
Primary Cache32 KB I + 32 KB D on chip per core
Secondary Cache512 KB I+D on chip per core
Tertiary Cache256 MB (I+D) on chip per chip
Other CacheNone
Disk2 x 400 GB SSD SATA
File SystemXFS
Memory Amount (GB)1024
# and size of DIMM(s)16 x 64 GB
Memory Details64 GB 2Rx4 PC4-3200AA-R
# and type of Network Interface Cards (NICs)Intel Eth Adptr I350T4 OCPv3 4-port
Power Supply Quantity and Rating (W)2 x 800
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_2
NameSUSE Linux Enterprise Server 15 SP2
VendorSUSE
Vendor URLhttp://suse.com/
Version5.3.18.22-default
AvailableJul-2020
Bitness64
NotesNone
Java Virtual Machine jvm_2
NameOracle Java SE 15.0.2
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 15.0.2
AvailableJan-2021
Bitness64
Notesnote
Other Software other_2
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment Non-virtual
Tuning
  • Workload Profile=High Performance Compute(HPC)
  • Thermal Configuration=Maximum Cooling
  • Determinism Control=Manual
  • Performance Determinism=Power Deterministic
  • Memory Patrol Scrubbing=Disabled
  • Numa Memory Domains Per Socket(NPS)=Four Memory Domains Per Socket
  • Memory Interleaving Mode=Disabled
  • Last-Level Cache(LLC) As NUMA Node=Enabled
  • L1 Stream HW Prefetcher=Disabled
  • L2 Stream HW Prefetcher=Disabled
  • Minimum Processor Idle Power Core C-State=No C-states
Notes None
OS Image os_Image_1
JVM Instances jvm_Backend_1(8)
OS Image Description os_1
Tuning
  • ulimit -n 655350
  • tuned-adm profile throughput-performance
  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 10000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 600000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 100000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms30g -Xmx30g -Xmn27g -XX:AllocatePrefetchInstr=2 -XX:+UseParallelGC -XX:LargePageSizeInBytes=2m -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseLargePages -XX:SurvivorRatio=30 -XX:TargetSurvivorRatio=99 -XX:MaxTenuringThreshold=15 -XX:ParallelGCThreads=32 -XX:+UseTransparentHugePages -XX:MaxInlineSize=900 -XX:FreqInlineSize=900 -XX:LoopUnrollLimit=30 -XX:InlineSmallCode=3k -XX:AutoBoxCacheMax=5000

Tuning

Used numactl to affinitize each Backend JVM to a NUMA node.

  • numactl --cpunodebind=0 --localalloc
  • numactl --cpunodebind=1 --localalloc
  • numactl --cpunodebind=2 --localalloc
  • numactl --cpunodebind=3 --localalloc
  • numactl --cpunodebind=4 --localalloc
  • numactl --cpunodebind=5 --localalloc
  • numactl --cpunodebind=6 --localalloc
  • numactl --cpunodebind=7 --localalloc
Notes "Notes here"
Hardware
OS Images os_Image_2(1)
Hardware Description hw_2
Number of Systems 1
SW Environment Non-virtual
Tuning
  • Workload Profile=High Performance Compute(HPC)
  • Thermal Configuration=Maximum Cooling
  • Determinism Control=Manual
  • Performance Determinism=Power Deterministic
  • Memory Patrol Scrubbing=Disabled
  • Numa Memory Domains Per Socket(NPS)=Four Memory Domains Per Socket
  • Memory Interleaving Mode=Disabled
  • Last-Level Cache(LLC) As NUMA Node=Enabled
  • L1 Stream HW Prefetcher=Disabled
  • L2 Stream HW Prefetcher=Disabled
  • Minimum Processor Idle Power Core C-State=No C-states
Notes None
OS Image os_Image_2
JVM Instances jvm_Ctr_1(1), jvm_TxInjector_1(8)
OS Image Description os_2
Tuning
  • ulimit -n 655350
  • tuned-adm profile throughput-performance
  • echo 950000 > /proc/sys/kernel/sched_rt_runtime_us
  • echo 10000000 > /proc/sys/kernel/sched_latency_ns
  • echo 80000 > /proc/sys/kernel/sched_migration_cost_ns
  • echo 600000 > /proc/sys/kernel/sched_min_granularity_ns
  • echo 100000 > /proc/sys/kernel/sched_wakeup_granularity_ns
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 10 > /proc/sys/vm/swappiness
  • echo 0 > /proc/sys/kernel/numa_balancing
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_2
Command Line

-Xms3g -Xmx3g -Xmn2g -XX:+UseParallelGC -XX:ParallelGCThreads=1 -XX:CICompilerCount=2

Tuning

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all
Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_2
Command Line

-Xms4g -Xmx4g -Xmn3g -XX:+UseParallelGC -XX:ParallelGCThreads=3 -XX:CICompilerCount=2

Tuning None
Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 203527 205814 208101 210387 212674
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 58694 64793 74321 83469 99476 74833
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 2287 / 4574 - / 2287 - / 2287 - / 2287 - / 2287 - / 2287
1000us 6860 / 9147 2287 / 4574 2287 / 4574 2287 / 4574 - / 2287 - / 2287
5000us 182946 / 185232 146356 / 148643 41163 / 43450 41163 / 43450 18295 / 20581 - / 2287
10000us 187519 / 189806 169225 / 171511 123488 / 125775 107481 / 109767 61744 / 57170 - / 2287
25000us 189806 / 192093 180659 / 182946 155504 / 157791 137209 / 139496 68605 / 57170 - / 2287
50000us 192093 / 194380 182946 / 185232 164651 / 166938 146356 / 148643 75465 / 73178 9147 / 2287
75000us 194380 / 196667 185232 / 187519 169225 / 171511 155504 / 157791 84612 / 82326 9147 / 2287
100000us 194380 / 196667 187519 / 189806 171511 / 173798 160077 / 162364 98333 / 100620 9147 / 2287
200000us 196667 / 198953 189806 / 192093 180659 / 182946 173798 / 176085 155504 / 157791 34302 / 4574
500000us 203527 / 205814 196667 / 198953 192093 / 194380 189806 / 192093 187519 / 189806 157791 / 160077
1000000us 205814 / - 203527 / 205814 198953 / 201240 196667 / 198953 194380 / 196667 187519 / 189806
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1 Group7.Backend.beJVM Group7.TxInjector.txiJVM1 Group8.Backend.beJVM Group8.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 128 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256 256
specjbb.comm.connect.selector.runner.count 0 4 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
specjbb.comm.connect.timeouts.connect 60000 800000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000
specjbb.comm.connect.timeouts.read 60000 800000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000
specjbb.comm.connect.timeouts.write 60000 800000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000 700000
specjbb.comm.connect.worker.pool.max 256 128 111 111 111 111 111 111 111 111 111 111 111 111 111 111 111 111
specjbb.comm.connect.worker.pool.min 1 32 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64
specjbb.controller.host localhost 10.10.56.44
specjbb.customerDriver.threads 64 {=64, probe=64, saturate=64}
specjbb.forkjoin.workers 256 {Tier1=224, Tier2=72, Tier3=32}
specjbb.group.count 1 8
specjbb.mapreducer.pool.size 256 32
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 228682 IR
High-bound (settled) is 215440 IR