SPEC Cloud IaaS 2018 Benchmark
Copyright © 2018 Standard Performance Evaluation Corporation
Cloud Vendor: KYLINSOFT Co.,Ltd ; PengCheng Laboratory .
Cloud Type / SUT Type: private/whitebox
Hardware Platform: Kunpeng 920-4826
Hypervisor: KVM
Cloud Infrastructure: KylinCloud V5
Replicated Application Instances: 38 copies
        Performance Score: 28.8
        Relative Scalability: 92.8%
        Mean Instance Provisioning Time: 45s
Tested by: KYLINSOFT Co.,Ltd ; PengCheng Laboratory . SPEC Licence Number : 999 Test Date : Oct 13, 2020
Performance Sections
Performance Summary
Performance Details
Validation, Errors, and Issues
Glossary of Terms
SUT Configuration Sections
Instance Configuration
Cloud Configuration
Network Configuration
Storage Configuration
Scale-out Phase Date/Time and Test Region
Scale-out Start Time: 2020-10-20_06:14:07_UTC
Scale-out End Time: 2020-10-20_08:42:43_UTC
Test Region: CN Central Standard Time
Cloud Informational Metrics
AI Provisioning Success: 100.00%
AI Run Success: 100.00
Total Instances: 246
Reference ID: RAID5_all_10200949_KP_4c4g38p

Performance Summary

Baseline Summary Results for YCSB
Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) AI Provisioning Time (s)
Average 24820.6 2.967 10.669 137.6

Baseline Summary Results for KMeans
Completion Time (s) AI Provisioning Time (s)
Average 186.20 125.0

Scale-out Summary Results for YCSB for 18 Valid AIs
Av. Throughput (ops/s) Av. Insert Latency 99% (ms) Av. Read Latency 99% (ms) Av. Provisioning Time (s) Performance Score Relative Scalability (%)
24730.3 3.062 11.730 171.9 13.31 92.60

Scale-out Summary Results for KMeans for 20 Valid AIs
Av. Completion Time (s) Av. Provisioning Time (s) Performance Score Relative Scalability (%)
182.2 155.8 15.47 93.09

YCSB Summary Results by AI
AI name Run count Run codes Av. Throughput (ops/s) Av. Insert Latency 99% (ms) Av. Read Latency 99% (ms) AI. Provisioning time (s) AI. Prov. Initiated from Scale-out Start (s)
ai_1 29 0 24438.8 3.063 12.079 129.0 5.0
ai_3 28 0 24661.9 3.033 12.686 136.0 375.0
ai_6 25 0 26000.7 2.786 11.732 132.0 938.0
ai_8 26 0 27133.0 2.675 10.397 143.0 1469.0
ai_10 23 0 25724.6 2.736 11.511 133.0 2054.0
ai_12 23 0 25429.9 2.719 11.666 136.0 2471.0
ai_15 18 0 23786.4 3.370 11.123 137.0 3009.0
ai_17 18 0 25683.3 2.730 11.468 133.0 3529.0
ai_19 15 0 25873.7 3.024 11.229 175.0 3991.0
ai_21 14 0 25489.1 3.142 11.172 141.0 4519.0
ai_23 13 0 26073.2 2.725 10.787 152.0 4869.0
ai_25 11 0 25029.8 2.846 11.899 134.0 5319.0
ai_27 7 0 21055.7 3.746 13.546 190.0 5643.0
ai_29 8 0 23418.3 3.428 12.763 172.0 6140.0
ai_31 6 0 24493.6 3.190 11.356 177.0 6683.0
ai_33 4 0 23433.1 3.323 12.017 206.0 7233.0
ai_35 3 0 23407.7 3.248 11.834 303.0 7630.0
ai_37 1 0 24012.2 3.337 11.871 365.0 8027.0
ai_39 0 2 0.0 0.000 0.000 358.0 8488.0

KMeans Summary Results by AI
AI name Run count Run code Av. Completion Time (s) Av. Provisioning time (s) AI. Prov. Initiated from Scale-out Start (s)
ai_2 37 0 187.00 124.0 14.0
ai_4 38 0 170.18 127.0 408.0
ai_5 34 0 177.85 153.0 747.0
ai_7 34 0 170.82 131.0 1094.0
ai_9 28 0 199.61 113.0 1653.0
ai_11 30 0 169.77 121.0 2112.0
ai_13 27 0 180.26 132.0 2533.0
ai_14 25 0 181.92 122.0 2948.0
ai_16 24 0 180.92 189.0 3267.0
ai_18 19 0 205.42 121.0 3802.0
ai_20 20 0 179.85 116.0 4143.0
ai_22 17 0 193.12 119.0 4562.0
ai_24 15 0 172.80 126.0 4943.0
ai_26 13 0 199.38 129.0 5390.0
ai_28 11 0 182.36 176.0 5878.0
ai_30 9 0 190.33 207.0 6469.0
ai_32 7 0 180.14 130.0 6930.0
ai_34 4 0 210.50 284.0 7434.0
ai_36 3 0 172.00 280.0 7963.0
ai_38 1 0 177.00 215.0 8453.0
ai_40 0 4 0 0.0 8762.0


Validation, Errors, and Issues

Glossary of "Run code":


Instance Configuration

Instance Configuration Hadoop Master
Parameter Value
instance_type_name m1.4c4g
cpu 4
memory 4GB
disk_size 80GB
disk_backed block storage
image_name kmeans_hadoop
Notes None

Instance Configuration Hadoop Slave
Parameter Value
instance_type_name m1.4c4g
cpu 4
memory 4GB
disk_size 80GB
disk_backed block storage
image_name kmeans_hadoop
Notes None

Instance Configuration YCSB
Parameter Value
instance_type_name m1.4c4g
cpu 4
memory 4GB
disk_size 80GB
disk_backed block storage
image_name ycsb_cassandra
Notes None

Instance Configuration Cassandra
Parameter Value
instance_type_name m1.4c4g
cpu 4
memory 4GB
disk_size 80GB
disk_backed block storage
image_name ycsb_cassandra
Notes None


Cloud Configuration

Cloud High Level Information and Availability
Parameter Value
Name KYLINCLOUD
Type private
Sut_Type whitebox
Virtualized KVM
Manager_Protocol KylinCloud
Manager_Version V5
Hardware_Availability Sep-2020
Software/Service_Availability Sep-2020
Geographic_Distribution 1
Notes None

Cloud Under Test Software Levels
Parameter Value
Python_version 2.7.12
JVM_version 1.8.0_265
Hadoop_version 2.7.5
Cassandra_version 2.1.20
Notes All software compiled locally from git source archives Compiler options - debug, 128bits, optimized Internal database set to emulate Cassandra API.

Benchmark Harness Node
Parameter Value
Vendor Huawei Corp.
Platform TaiShan 200 mode 2280
CPU_Description Kunpeng 920-4826
CPU_Frequency_MHz 2600
RAM_Memory 8 GB, ECC, DDR4, 2933 MHz
Local_Storage 1x 80GB, SATA3, 7200 RPM
Quantity 1
Availability_Date Sep-2020
OS_Version Ubuntu 16.04.4 LTS
OS_Availability_Date Sep-2020
Network_Adapter_1 1 x Inc Virtio network device
Network_Adapter_2 1 x Inc Virtio network device
Network_port_type_1 1000BASE-T
Network_port_type_2 10GBASE-SR
Network_speed_port_1 1 Gb/s
Network_speed_port_2 10 Gb/s
Notes The control machine is KVM virtual machine.

Cloud Manager Node
Parameter Value
Hw_Vendor Huawei Corp.
Hw_Platform TaiShan 200 mode 2280
CPU_Type Kunpeng 920-4826
CPU_Count 2
CPU_Cores_Per 48
CPU_Frequency_MHz 2600
RAM_Memory_GB 512
Primary_Cache_KB 6 M
Secondary_Cache_KB 24 M
Tertiary_Cache_KB 48 M
RAM_Memory_Type ECC DDR4 2933 MHz
Hw_Availability_Date Sep-2020
Local_Storage 1 x 450 GB SSD
Quantity 1
Virtualized KVM
Network_Adapter_1 Intel Corporation Gigabit Network Connection
Network_Adapter_2 Intel Corporation 10-Gigabit SFI/SFP+ Network Connection
Network_port_type_1 1000BASE-T
Network_port_type_2 10GBASE-SR
Network_speed_port_1 1 Gb/s
Network_speed_port_2 10 Gb/s
OS_Version kylin v10
OS_Availability_Date Sep-2020
Notes None

Cloud Computes Nodes
Parameter Value
type 1_Compute_nodes 9
type 1_Hw_Vendor Huawei Corp.
type 1_Hw_Platform TaiShan 200 mode 2280
type 1_Quantity 9
type 1_CPU_Type Kunpeng 920-4826
type 1_CPU_Count 2
type 1_CPU_Cores_Per 48
type 1_CPU_Frequency_MHz 2600
type 1_RAM_Memory_GB 512
type 1_Primary_Cache_KB 6 M
type 1_Secondary_Cache_KB 24 M
type 1_Tertiary_Cache_KB 48 M
type 1_RAM_Memory_Type ECC DDR4 1800 MHz
type 1_Hw_Availability_Date Sep-2020
type 1_Local_Storage 1 x 450 GB SSD ; 5 x 3.7 TB HDD , 7200 RPM
type 1_Virtualized KVM
type 1_Network_Adapter_1 Intel Corporation Gigabit Network Connection
type 1_Network_Adapter_2 Intel Corporation 10-Gigabit SFI/SFP+ Network Connection
type 1_Network_port_type_1 1000BASE-T
type 1_Network_port_type_2 10GBASE-SR
type 1_Network_speed_port_1 1 Gb/s
type 1_Network_speed_port_2 10 Gb/s
type 1_OS_Version kylin v10
type 1_OS_Availability_Date Sep-2020
type 1_Notes None

Cloud Network Information

Cloud Network Information
Parameter Value
network 1_Technology ethernet
network 1_Protocol TCP/IP
network 1_Protocol_version IPV4
network 1_Speed_Mbps 10000
network 1_Function data
network 1_Notes None
network 2_Technology ethernet
network 2_Protocol TCP/IP
network 2_Protocol_version IPV4
network 2_Speed_Mbps 1000
network 2_Function management
network 2_Notes None

Cloud Schematic


Storage Configuration

Cloud Storage
Parameter Value
Storage 1_Attach_Type local
Storage 1_Capacity 135 TB
Storage 1_Technology HDD
Storage 1_Notes Each node has 5 HDD RAID 5 for storage. Each node has 1 SSD for OS.



Performance Details

YCSB Detailed Results for Application Instance Runs
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_1 1 23848.0 3.619 12.431 107.00 0 0
2 21708.0 4.411 12.543 107.00 0 0
3 25298.4 2.877 12.559 99.00 0 0
4 23867.9 3.621 12.463 98.00 0 0
5 23539.0 3.317 12.567 106.00 0 0
6 22692.8 3.745 12.943 99.00 0 0
7 24133.3 3.303 11.735 120.00 0 0
8 24587.5 3.159 11.943 93.00 0 0
9 26773.8 2.839 12.415 90.00 0 0
10 27344.8 2.997 11.239 96.00 0 0
11 21363.6 4.655 11.391 85.00 0 0
12 26120.6 2.731 12.183 96.00 0 0
13 24977.7 2.909 11.839 112.00 0 0
14 25196.2 2.901 12.455 103.00 0 0
15 25771.5 2.763 11.055 96.00 0 0
16 23646.5 2.973 12.255 97.00 0 0
17 25919.2 2.495 11.727 83.00 0 0
18 24603.9 2.685 11.519 79.00 0 0
19 25223.7 2.479 11.511 89.00 0 0
20 24803.4 2.613 12.111 90.00 0 0
21 23990.0 2.763 12.271 95.00 0 0
22 24369.3 2.631 12.127 92.00 0 0
23 25949.9 2.529 11.239 86.00 0 0
24 23685.5 3.031 12.959 90.00 0 0
25 24203.1 2.963 11.863 101.00 0 0
26 24415.4 3.051 12.407 121.00 0 0
27 23993.5 2.755 13.039 129.00 0 0
28 22784.8 3.087 12.439 116.00 0 0
29 23913.0 2.923 11.055 126.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_3 1 24140.0 3.545 14.679 98.00 0 0
2 22734.8 3.761 14.159 95.00 0 0
3 25619.7 2.745 12.911 89.00 0 0
4 25197.5 3.023 12.255 85.00 0 0
5 25342.6 2.891 13.895 89.00 0 0
6 24049.3 3.403 14.671 88.00 0 0
7 25854.0 2.765 14.175 93.00 0 0
8 25978.7 2.767 13.367 106.00 0 0
9 23222.6 3.745 12.327 96.00 0 0
10 23635.6 3.209 13.111 101.00 0 0
11 25465.1 3.007 13.111 94.00 0 0
12 22178.0 3.481 13.543 106.00 0 0
13 24030.1 3.543 12.775 99.00 0 0
14 25899.0 2.743 12.935 94.00 0 0
15 25881.3 2.581 12.031 90.00 0 0
16 26784.3 2.641 10.551 72.00 0 0
17 23672.3 2.877 12.815 102.00 0 0
18 24041.6 2.703 12.407 97.00 0 0
19 23692.2 2.927 12.039 88.00 0 0
20 24028.2 2.661 12.175 91.00 0 0
21 23672.6 3.265 13.431 92.00 0 0
22 27026.8 2.435 9.855 79.00 0 0
23 25459.4 2.883 12.551 86.00 0 0
24 25423.8 2.837 11.735 91.00 0 0
25 26114.8 2.785 9.615 78.00 0 0
26 24415.4 3.085 12.487 131.00 0 0
27 24187.6 3.087 13.031 131.00 0 0
28 22785.1 3.533 12.575 132.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_6 1 26012.9 2.907 12.319 92.00 0 0
2 28570.8 2.947 10.471 86.00 0 0
3 25908.6 3.191 10.919 84.00 0 0
4 27250.0 2.667 10.543 87.00 0 0
5 27072.4 2.575 11.751 83.00 0 0
6 26898.5 2.599 11.407 91.00 0 0
7 27617.6 2.635 11.303 83.00 0 0
8 26670.6 3.005 10.511 85.00 0 0
9 25584.4 3.111 12.279 85.00 0 0
10 26883.9 2.475 11.767 85.00 0 0
11 26128.9 2.709 11.703 80.00 0 0
12 26598.8 2.547 12.103 88.00 0 0
13 24720.2 2.827 12.575 87.00 0 0
14 26136.1 2.585 11.415 90.00 0 0
15 25849.3 2.677 11.879 84.00 0 0
16 25506.8 2.705 12.335 89.00 0 0
17 24782.2 2.895 12.423 84.00 0 0
18 26195.2 2.645 11.391 86.00 0 0
19 24855.8 2.745 12.639 83.00 0 0
20 24483.6 3.187 12.559 88.00 0 0
21 25606.1 2.655 12.375 95.00 0 0
22 25399.1 2.857 12.391 91.00 0 0
23 25550.8 2.689 10.943 85.00 0 0
24 25673.8 2.567 11.639 85.00 0 0
25 24062.2 3.239 11.671 113.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_8 1 26988.4 2.931 11.767 99.00 0 0
2 27655.4 2.859 10.231 84.00 0 0
3 29828.7 2.569 9.887 82.00 0 0
4 28765.4 2.737 11.015 78.00 0 0
5 29334.3 2.519 9.847 91.00 0 0
6 28690.3 2.483 10.479 96.00 0 0
7 27049.3 2.651 10.607 80.00 0 0
8 27171.0 2.515 10.191 121.00 0 0
9 27619.7 2.489 10.383 79.00 0 0
10 27361.3 2.587 10.631 93.00 0 0
11 26299.0 2.869 10.447 98.00 0 0
12 25691.3 2.815 9.247 87.00 0 0
13 27140.9 2.409 11.439 96.00 0 0
14 27637.7 2.687 11.239 94.00 0 0
15 26787.6 2.667 10.575 87.00 0 0
16 30632.3 2.157 8.055 118.00 0 0
17 28745.1 2.543 8.567 105.00 0 0
18 28935.0 2.641 7.711 122.00 0 0
19 25413.3 3.023 11.167 97.00 0 0
20 28057.0 2.409 7.895 79.00 0 0
21 25661.8 2.585 11.143 100.00 0 0
22 26893.8 2.549 10.551 107.00 0 0
23 25055.0 3.737 10.039 150.00 0 0
24 22784.5 2.913 12.087 121.00 0 0
25 24725.7 2.615 12.871 155.00 0 0
26 24535.2 2.595 12.239 113.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_10 1 25421.2 3.011 12.487 88.00 0 0
2 25055.4 2.629 11.567 78.00 0 0
3 25162.1 2.753 11.071 91.00 0 0
4 27034.2 2.461 11.143 83.00 0 0
5 25191.9 2.795 11.711 81.00 0 0
6 26400.2 2.409 11.551 84.00 0 0
7 27983.4 2.441 11.103 92.00 0 0
8 28275.3 2.509 11.151 79.00 0 0
9 27266.7 2.575 10.359 87.00 0 0
10 26650.7 2.459 10.839 80.00 0 0
11 27457.1 2.407 10.815 84.00 0 0
12 26793.5 2.473 10.935 85.00 0 0
13 24819.7 2.711 10.839 82.00 0 0
14 26534.0 2.589 11.079 78.00 0 0
15 25785.7 2.401 12.127 85.00 0 0
16 24305.6 3.061 12.111 110.00 0 0
17 24792.5 3.145 11.959 82.00 0 0
18 25524.5 2.921 11.487 90.00 0 0
19 25772.9 2.633 12.463 88.00 0 0
20 24764.9 3.015 12.207 127.00 0 0
21 24242.0 2.829 10.983 111.00 0 0
22 23248.4 3.007 12.535 135.00 0 0
23 23183.0 3.693 12.231 128.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_12 1 27348.9 2.685 12.055 101.00 0 0
2 26952.9 2.481 11.359 95.00 0 0
3 27684.5 2.381 11.103 76.00 0 0
4 26213.2 2.539 11.247 82.00 0 0
5 25896.0 2.907 11.087 90.00 0 0
6 26172.5 2.499 10.631 79.00 0 0
7 26738.3 2.683 11.135 76.00 0 0
8 26346.5 2.831 11.455 82.00 0 0
9 25910.1 2.661 11.239 82.00 0 0
10 26580.5 2.509 11.319 80.00 0 0
11 25961.6 2.407 11.359 82.00 0 0
12 25314.2 2.625 10.935 81.00 0 0
13 25898.5 2.653 10.943 83.00 0 0
14 25305.9 2.577 11.895 81.00 0 0
15 24104.7 2.721 12.951 84.00 0 0
16 24806.8 2.675 12.079 78.00 0 0
17 23338.9 3.285 11.799 78.00 0 0
18 24327.3 2.791 11.767 83.00 0 0
19 25057.5 2.663 11.095 83.00 0 0
20 24684.8 2.553 13.023 86.00 0 0
21 23172.3 2.989 13.583 88.00 0 0
22 23692.8 3.235 12.719 85.00 0 0
23 23378.8 3.189 11.535 90.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_15 1 25423.0 2.769 12.159 83.00 0 0
2 24547.4 3.665 8.943 104.00 0 0
3 26887.5 2.657 10.855 79.00 0 0
4 24871.3 3.663 11.255 96.00 0 0
5 20413.6 4.203 11.303 120.00 0 0
6 23746.9 3.375 10.807 86.00 0 0
7 24246.1 3.567 8.895 105.00 0 0
8 22387.8 4.079 10.551 112.00 0 0
9 21731.2 4.057 12.031 86.00 0 0
10 18222.0 4.203 12.591 83.00 0 0
11 23718.2 3.517 12.095 91.00 0 0
12 25332.0 3.035 8.055 91.00 0 0
13 26530.8 2.359 9.479 83.00 0 0
14 25566.8 2.505 10.383 120.00 0 0
15 23840.9 3.143 12.639 115.00 0 0
16 23196.1 3.715 12.511 179.00 0 0
17 24741.0 2.891 11.423 99.00 0 0
18 22752.4 3.249 14.247 126.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_17 1 25642.3 2.777 12.527 92.00 0 0
2 25984.3 2.561 12.039 83.00 0 0
3 23637.2 2.761 11.471 91.00 0 0
4 25131.6 2.639 11.695 94.00 0 0
5 26475.2 2.973 11.191 84.00 0 0
6 23471.0 3.799 11.727 83.00 0 0
7 25230.4 2.957 11.791 90.00 0 0
8 24880.7 2.973 11.359 83.00 0 0
9 26620.3 2.501 10.751 97.00 0 0
10 25520.8 2.543 11.295 83.00 0 0
11 26430.2 2.755 11.447 90.00 0 0
12 24926.0 2.599 11.647 93.00 0 0
13 26017.6 2.605 10.999 83.00 0 0
14 27830.2 2.395 9.415 77.00 0 0
15 26433.5 2.741 11.687 87.00 0 0
16 26395.3 2.363 11.143 83.00 0 0
17 25486.3 2.705 12.871 103.00 0 0
18 26186.8 2.487 11.375 87.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_19 1 23496.9 3.741 12.263 85.00 0 0
2 26151.7 2.763 12.031 93.00 0 0
3 26308.2 2.687 10.743 129.00 0 0
4 27828.2 2.705 10.943 100.00 0 0
5 27655.4 2.931 11.015 82.00 0 0
6 28227.9 2.653 10.903 89.00 0 0
7 26509.6 2.885 11.607 86.00 0 0
8 26767.7 2.839 11.511 88.00 0 0
9 25397.8 3.095 10.535 92.00 0 0
10 26730.6 2.799 11.751 96.00 0 0
11 28725.1 2.593 7.239 97.00 0 0
12 23546.6 3.337 11.687 86.00 0 0
13 22715.9 4.023 11.759 160.00 0 0
14 23257.7 3.147 11.935 143.00 0 0
15 24785.8 3.161 12.519 164.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_21 1 23628.8 3.513 11.871 93.00 0 0
2 26018.8 2.641 12.007 109.00 0 0
3 25553.7 3.485 10.791 93.00 0 0
4 24485.3 3.837 11.359 83.00 0 0
5 25755.3 3.051 11.415 79.00 0 0
6 24913.3 3.725 10.871 82.00 0 0
7 26425.3 2.641 11.071 90.00 0 0
8 26507.1 2.477 11.711 87.00 0 0
9 25595.9 2.857 11.687 86.00 0 0
10 26490.1 2.815 8.927 117.00 0 0
11 25330.4 3.007 11.743 91.00 0 0
12 24805.7 3.721 10.615 112.00 0 0
13 25906.9 2.747 12.183 133.00 0 0
14 25431.1 3.465 10.151 111.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_23 1 25715.2 3.213 12.503 84.00 0 0
2 26318.6 2.519 11.359 85.00 0 0
3 26204.8 2.455 10.943 82.00 0 0
4 25453.2 2.747 11.095 75.00 0 0
5 25131.2 3.039 10.783 91.00 0 0
6 26851.8 2.545 10.711 79.00 0 0
7 26546.9 2.361 10.743 82.00 0 0
8 26383.0 2.385 10.599 86.00 0 0
9 26063.4 2.801 10.895 104.00 0 0
10 27401.8 2.353 8.247 86.00 0 0
11 25040.5 3.193 11.415 122.00 0 0
12 26669.7 2.817 9.743 87.00 0 0
13 25172.3 2.997 11.191 158.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_25 1 25068.5 3.117 13.119 86.00 0 0
2 26360.2 2.817 11.071 93.00 0 0
3 26153.2 2.483 12.127 82.00 0 0
4 25706.4 2.467 12.055 100.00 0 0
5 24177.8 2.981 11.823 91.00 0 0
6 23291.8 3.469 12.255 97.00 0 0
7 22722.0 3.157 11.439 94.00 0 0
8 26015.6 2.541 12.543 79.00 0 0
9 25628.7 2.701 11.927 143.00 0 0
10 25968.8 2.629 10.871 105.00 0 0
11 24235.2 2.945 11.655 121.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_27 1 21095.5 4.467 15.287 89.00 0 0
2 23443.5 3.201 14.287 146.00 0 0
3 23855.7 2.983 13.927 102.00 0 0
4 22866.6 3.613 13.967 112.00 0 0
5 20640.3 3.447 13.639 116.00 0 0
6 17548.1 4.215 12.863 179.00 0 0
7 17940.5 4.299 10.855 205.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_29 1 22468.4 4.011 14.583 95.00 0 0
2 23495.3 3.297 13.015 88.00 0 0
3 25548.0 2.979 12.847 93.00 0 0
4 22768.4 3.063 11.943 108.00 0 0
5 22757.7 3.265 11.543 95.00 0 0
6 24403.8 3.243 11.591 154.00 0 0
7 23137.6 3.897 12.839 98.00 0 0
8 22767.4 3.667 13.743 128.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_31 1 24032.3 3.459 13.687 118.00 0 0
2 23252.4 3.581 11.903 90.00 0 0
3 25626.2 3.001 9.927 89.00 0 0
4 24700.5 3.265 12.087 174.00 0 0
5 23646.3 2.975 10.855 132.00 0 0
6 25703.8 2.859 9.679 160.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_33 1 22825.2 3.583 14.047 110.00 0 0
2 24240.4 3.185 12.543 101.00 0 0
3 24661.4 3.023 11.215 122.00 0 0
4 22005.3 3.499 10.263 106.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_35 1 21559.2 3.731 13.783 102.00 0 0
2 24315.8 3.279 10.887 117.00 0 0
3 24348.2 2.733 10.831 98.00 0 0
AI name Run id Throughput (ops/s) Insert Latency 99% (ms) Read Latency 99% (ms) Data gen time (s) AI Run Errors NTP Error
ai_37 1 24012.2 3.337 11.871 140.00 0 0

KMeans Detailed Results for Application Instance Runs
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_2 1 389 3 39.00 0 0
2 147 3 34.00 0 0
3 224 5 35.00 0 0
4 213 5 36.00 0 0
5 106 2 34.00 0 0
6 122 2 39.00 0 0
7 143 3 39.00 0 0
8 278 5 34.00 0 0
9 113 2 35.00 0 0
10 143 3 33.00 0 0
11 145 3 34.00 0 0
12 212 5 36.00 0 0
13 194 4 42.00 0 0
14 221 5 32.00 0 0
15 221 5 43.00 0 0
16 238 5 35.00 0 0
17 185 4 37.00 0 0
18 152 3 34.00 0 0
19 119 2 36.00 0 0
20 210 4 36.00 0 0
21 143 3 34.00 0 0
22 239 5 39.00 0 0
23 243 5 46.00 0 0
24 219 4 34.00 0 0
25 223 5 34.00 0 0
26 191 4 33.00 0 0
27 218 5 32.00 0 0
28 203 4 34.00 0 0
29 112 2 34.00 0 0
30 197 4 37.00 0 0
31 193 4 34.00 0 0
32 124 2 35.00 0 0
33 181 4 38.00 0 0
34 229 5 35.00 0 0
35 119 2 35.00 0 0
36 156 3 34.00 0 0
37 154 3 40.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_4 1 118 2 39.00 0 0
2 152 3 38.00 0 0
3 127 2 34.00 0 0
4 161 3 34.00 0 0
5 210 5 42.00 0 0
6 187 4 33.00 0 0
7 146 3 35.00 0 0
8 224 5 42.00 0 0
9 111 2 35.00 0 0
10 156 2 36.00 0 0
11 145 3 32.00 0 0
12 167 3 34.00 0 0
13 145 3 37.00 0 0
14 247 5 34.00 0 0
15 144 2 38.00 0 0
16 128 2 36.00 0 0
17 151 3 35.00 0 0
18 115 2 35.00 0 0
19 231 5 35.00 0 0
20 187 4 39.00 0 0
21 167 3 36.00 0 0
22 217 5 34.00 0 0
23 150 3 37.00 0 0
24 234 5 38.00 0 0
25 116 2 35.00 0 0
26 253 5 36.00 0 0
27 160 3 35.00 0 0
28 164 3 40.00 0 0
29 116 2 39.00 0 0
30 190 4 38.00 0 0
31 116 2 42.00 0 0
32 153 3 36.00 0 0
33 230 5 38.00 0 0
34 177 3 42.00 0 0
35 260 5 37.00 0 0
36 83 1 46.00 0 0
37 192 3 36.00 0 0
38 237 5 43.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_5 1 205 4 36.00 0 0
2 120 2 43.00 0 0
3 164 3 38.00 0 0
4 209 5 35.00 0 0
5 232 5 34.00 0 0
6 118 2 43.00 0 0
7 118 2 37.00 0 0
8 249 5 38.00 0 0
9 108 2 39.00 0 0
10 180 4 38.00 0 0
11 217 5 45.00 0 0
12 219 5 34.00 0 0
13 231 5 34.00 0 0
14 180 4 35.00 0 0
15 125 2 33.00 0 0
16 186 3 43.00 0 0
17 113 2 36.00 0 0
18 150 3 38.00 0 0
19 146 3 42.00 0 0
20 112 2 35.00 0 0
21 216 5 35.00 0 0
22 154 3 37.00 0 0
23 266 5 39.00 0 0
24 237 5 34.00 0 0
25 160 3 40.00 0 0
26 165 3 36.00 0 0
27 124 2 42.00 0 0
28 176 3 44.00 0 0
29 164 3 36.00 0 0
30 156 3 51.00 0 0
31 251 5 55.00 0 0
32 194 3 41.00 0 0
33 227 4 52.00 0 0
34 175 3 49.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_7 1 113 2 38.00 0 0
2 210 5 38.00 0 0
3 244 5 99.00 0 0
4 194 2 34.00 0 0
5 189 4 35.00 0 0
6 111 2 32.00 0 0
7 125 2 38.00 0 0
8 222 3 37.00 0 0
9 118 2 35.00 0 0
10 142 3 40.00 0 0
11 203 4 34.00 0 0
12 151 3 38.00 0 0
13 235 5 38.00 0 0
14 113 2 39.00 0 0
15 214 4 44.00 0 0
16 119 2 35.00 0 0
17 241 5 38.00 0 0
18 210 5 35.00 0 0
19 115 2 40.00 0 0
20 163 3 38.00 0 0
21 243 5 36.00 0 0
22 122 2 35.00 0 0
23 125 2 43.00 0 0
24 173 3 39.00 0 0
25 219 5 37.00 0 0
26 187 4 36.00 0 0
27 219 5 37.00 0 0
28 174 3 41.00 0 0
29 185 3 41.00 0 0
30 185 3 37.00 0 0
31 160 3 40.00 0 0
32 117 2 40.00 0 0
33 129 2 35.00 0 0
34 138 2 52.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_9 1 78 1 40.00 0 0
2 315 5 39.00 0 0
3 154 3 35.00 0 0
4 222 5 42.00 0 0
5 213 5 35.00 0 0
6 114 2 35.00 0 0
7 252 5 39.00 0 0
8 189 4 36.00 0 0
9 114 2 37.00 0 0
10 233 5 39.00 0 0
11 307 5 35.00 0 0
12 136 2 38.00 0 0
13 298 5 39.00 0 0
14 185 4 37.00 0 0
15 205 4 41.00 0 0
16 171 3 36.00 0 0
17 127 2 37.00 0 0
18 233 5 38.00 0 0
19 157 2 47.00 0 0
20 203 4 40.00 0 0
21 159 3 37.00 0 0
22 132 2 40.00 0 0
23 228 5 40.00 0 0
24 253 5 48.00 0 0
25 236 4 43.00 0 0
26 271 5 44.00 0 0
27 159 2 43.00 0 0
28 245 4 56.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_11 1 152 3 39.00 0 0
2 178 4 34.00 0 0
3 157 3 37.00 0 0
4 219 5 33.00 0 0
5 146 3 35.00 0 0
6 211 5 36.00 0 0
7 140 3 39.00 0 0
8 183 4 36.00 0 0
9 151 3 31.00 0 0
10 144 3 34.00 0 0
11 148 3 35.00 0 0
12 215 5 37.00 0 0
13 181 4 36.00 0 0
14 176 3 34.00 0 0
15 108 2 31.00 0 0
16 170 3 34.00 0 0
17 148 3 35.00 0 0
18 152 3 35.00 0 0
19 143 3 35.00 0 0
20 199 4 32.00 0 0
21 155 3 35.00 0 0
22 238 5 37.00 0 0
23 238 5 35.00 0 0
24 208 4 42.00 0 0
25 111 2 37.00 0 0
26 219 5 33.00 0 0
27 186 4 36.00 0 0
28 154 3 43.00 0 0
29 84 1 35.00 0 0
30 179 3 41.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_13 1 132 2 42.00 0 0
2 212 5 32.00 0 0
3 224 5 37.00 0 0
4 147 3 33.00 0 0
5 119 2 34.00 0 0
6 204 4 39.00 0 0
7 112 2 34.00 0 0
8 149 3 35.00 0 0
9 145 3 35.00 0 0
10 130 2 38.00 0 0
11 224 5 40.00 0 0
12 186 3 42.00 0 0
13 113 2 37.00 0 0
14 231 5 43.00 0 0
15 113 2 36.00 0 0
16 115 2 35.00 0 0
17 239 5 36.00 0 0
18 165 3 36.00 0 0
19 191 4 37.00 0 0
20 268 5 46.00 0 0
21 154 3 37.00 0 0
22 152 3 42.00 0 0
23 249 5 42.00 0 0
24 197 3 38.00 0 0
25 208 4 48.00 0 0
26 248 5 41.00 0 0
27 240 5 41.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_14 1 109 2 40.00 0 0
2 193 4 43.00 0 0
3 126 2 41.00 0 0
4 269 5 36.00 0 0
5 179 4 33.00 0 0
6 230 5 38.00 0 0
7 112 2 33.00 0 0
8 123 2 33.00 0 0
9 118 2 34.00 0 0
10 152 3 35.00 0 0
11 195 4 36.00 0 0
12 227 5 36.00 0 0
13 118 2 38.00 0 0
14 121 2 34.00 0 0
15 220 5 36.00 0 0
16 240 5 47.00 0 0
17 151 3 35.00 0 0
18 219 5 35.00 0 0
19 103 1 43.00 0 0
20 213 4 40.00 0 0
21 146 2 40.00 0 0
22 275 5 50.00 0 0
23 262 5 59.00 0 0
24 134 2 41.00 0 0
25 313 5 53.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_16 1 185 4 41.00 0 0
2 196 4 35.00 0 0
3 113 2 36.00 0 0
4 217 5 35.00 0 0
5 212 5 34.00 0 0
6 130 2 34.00 0 0
7 226 5 35.00 0 0
8 180 4 35.00 0 0
9 123 2 33.00 0 0
10 274 5 34.00 0 0
11 149 3 38.00 0 0
12 155 3 34.00 0 0
13 143 3 34.00 0 0
14 220 5 41.00 0 0
15 199 4 35.00 0 0
16 144 3 36.00 0 0
17 237 5 34.00 0 0
18 232 4 38.00 0 0
19 128 2 35.00 0 0
20 113 2 34.00 0 0
21 213 5 37.00 0 0
22 109 2 35.00 0 0
23 266 5 35.00 0 0
24 178 4 41.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_18 1 395 4 39.00 0 0
2 109 2 34.00 0 0
3 129 2 34.00 0 0
4 285 5 37.00 0 0
5 239 5 35.00 0 0
6 217 5 33.00 0 0
7 217 5 38.00 0 0
8 226 5 33.00 0 0
9 144 3 34.00 0 0
10 248 5 34.00 0 0
11 181 4 40.00 0 0
12 128 2 37.00 0 0
13 198 4 43.00 0 0
14 123 2 35.00 0 0
15 208 4 36.00 0 0
16 161 3 35.00 0 0
17 217 5 39.00 0 0
18 248 5 42.00 0 0
19 230 5 35.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_20 1 119 2 39.00 0 0
2 160 3 42.00 0 0
3 211 5 32.00 0 0
4 210 3 34.00 0 0
5 179 4 36.00 0 0
6 152 3 35.00 0 0
7 215 5 35.00 0 0
8 128 2 36.00 0 0
9 249 5 36.00 0 0
10 219 5 35.00 0 0
11 151 2 45.00 0 0
12 227 5 35.00 0 0
13 201 4 43.00 0 0
14 131 2 64.00 0 0
15 116 2 36.00 0 0
16 164 3 36.00 0 0
17 168 3 44.00 0 0
18 128 2 52.00 0 0
19 245 5 36.00 0 0
20 224 5 42.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_22 1 238 5 47.00 0 0
2 213 4 35.00 0 0
3 284 5 37.00 0 0
4 110 2 33.00 0 0
5 109 2 33.00 0 0
6 220 5 35.00 0 0
7 192 4 46.00 0 0
8 220 5 35.00 0 0
9 143 3 34.00 0 0
10 225 5 34.00 0 0
11 144 3 34.00 0 0
12 190 4 38.00 0 0
13 216 5 40.00 0 0
14 121 2 48.00 0 0
15 199 4 37.00 0 0
16 179 4 38.00 0 0
17 280 5 41.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_24 1 116 2 344.00 0 0
2 228 5 36.00 0 0
3 229 5 103.00 0 0
4 88 1 41.00 0 0
5 229 5 41.00 0 0
6 229 5 39.00 0 0
7 126 2 35.00 0 0
8 148 2 54.00 0 0
9 141 2 37.00 0 0
10 173 3 36.00 0 0
11 124 2 36.00 0 0
12 167 3 45.00 0 0
13 211 4 46.00 0 0
14 194 3 47.00 0 0
15 189 4 41.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_26 1 180 3 40.00 0 0
2 252 5 37.00 0 0
3 237 4 41.00 0 0
4 186 3 37.00 0 0
5 142 2 44.00 0 0
6 244 5 47.00 0 0
7 171 3 41.00 0 0
8 172 3 36.00 0 0
9 148 2 44.00 0 0
10 150 2 55.00 0 0
11 233 4 36.00 0 0
12 261 4 38.00 0 0
13 216 4 43.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_28 1 164 3 40.00 0 0
2 153 3 36.00 0 0
3 285 5 38.00 0 0
4 123 2 38.00 0 0
5 164 3 48.00 0 0
6 227 4 34.00 0 0
7 123 2 36.00 0 0
8 194 3 48.00 0 0
9 146 2 39.00 0 0
10 199 4 49.00 0 0
11 228 5 54.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_30 1 275 5 43.00 0 0
2 114 2 42.00 0 0
3 170 3 36.00 0 0
4 141 2 37.00 0 0
5 228 4 43.00 0 0
6 232 4 45.00 0 0
7 111 2 38.00 0 0
8 252 5 49.00 0 0
9 190 4 40.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_32 1 121 2 41.00 0 0
2 182 4 43.00 0 0
3 154 3 44.00 0 0
4 185 4 37.00 0 0
5 116 2 40.00 0 0
6 236 5 47.00 0 0
7 267 5 47.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_34 1 251 3 73.00 0 0
2 129 2 56.00 0 0
3 256 4 60.00 0 0
4 206 3 54.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_36 1 220 4 56.00 0 0
2 168 3 36.00 0 0
3 128 2 46.00 0 0
AI name Run id Completion Times (s) Hadoop Iterations Data gen time (s) AI Run Errors NTP Error
ai_38 1 177 3 50.00 0 0


Glossary

Glossary of Terms


SPEC and SPEC Cloud are registered trademarks of the Standard Performance Evaluation Corporation.

All other brand and product names appearing in this result are trademarks or registered trademarks of their respective holders.

For questions about this result, please contact the tester. For other inquiries, please contact info@spec.org