SPECstorage™ Solution 2020_eda_blended Result

Copyright © 2016-2024 Standard Performance Evaluation Corporation

WekaIO, Inc. SPECstorage Solution 2020_eda_blended = 7700 Job_Sets
Weka - Azure Public Cloud Reference Overall Response Time = 0.65 msec


Performance

Business
Metric
(Job_Sets)
Average
Latency
(msec)
Job_Sets
Ops/Sec
Job_Sets
MB/Sec
7700.2413465195591
15400.26669304011183
23100.291103955716773
30800.314138607622365
38500.346173259527956
46200.374207911433548
53900.405242563639139
61600.476277215744729
69300.647311867950325
77005.284346519455916
Performance Graph


Product and Test Information

Weka - Azure Public Cloud Reference
Tested byWekaIO, Inc.
Hardware AvailableSeptember 2024
Software AvailableSeptember 2024
Date TestedOctober 2024
License Number4553
Licensee LocationsCampbell, CA USA

The WEKA Data Platform is purpose-built to seamlessly and sustainably deliver speed, simplicity, and scale that meets the needs of modern enterprises and research organizations without compromise. Its advanced, software-defined architecture supports next-generation workloads in virtually any location with cloud simplicity and on-premises performance.

Solution Under Test Bill of Materials

Item NoQtyTypeVendorModel/NameDescription
1100Azure Virtual MachineAzureStandard L32s v3WEKA storage backends - Azure Standard L32s v3 Virtual Machine (32 vCPUs, 256 GiB memory, 16 Gbps networking, 4 x 1.92TB NVMe)
264Azure Virtual MachineAzureStandard E32s v5Ubuntu clients with Weka POSIX-compliant file system driver - Azure Standard E32s v5 Virtual Machine (32 vCPUs, 256 GiB memory, 16 Gbps networking)

Configuration Diagrams

  1. WEKA in Azure

Component Software

Item NoComponentTypeName and VersionDescription
1WekaFSFile SystemVersion 4.3.5.109-azureThe WEKA filesystem (WekaFS) redefines storage solutions with its software-only approach, WekaFS addresses common storage challenges by removing performance bottlenecks, making it suitable for environments requiring low latency, high performance, and cloud scalability.
2Weka ServerStorage OSUbuntu 20.04Operating System (OS) for 100 storage virtual machines using Azure L32s v3 instances
3ClientsClient OSUbuntu 20.04Operating System (OS) for 64 client virtual machines using Azure E32s v5 instances

Hardware Configuration and Tuning - Virtual

Component Name
Parameter NameValueDescription
Accelerated NetworkingEnabledL32s and E32s virtual machines have 16 Gbps connectivity

Hardware Configuration and Tuning Notes

None

Software Configuration and Tuning - Virtual

Networking
Parameter NameValueDescription
Jumbo Frames3900Enables Ethernet jumbo frames up to 3900 bytes

Software Configuration and Tuning Notes

The single filesystem was attached via a single mount per client. Four WEKA front ends (cores) were used on the clients. Note that this system was deployed entirely using WEKA's Terraform Module. You can create a Terraform template from WEKA's Cloud Deployment Manager at https://cloud.weka.io. Clients automount the WekaFS filesystem when the Terraform deployment completes.

Service SLA Notes

None

Storage and Filesystems

Item NoDescriptionData ProtectionStable StorageQty
1Weka Filesystem with 682TB of usable storageWEKA 16+2 distributed data protectionLocal 1.92TB NVMe Disk400
Number of Filesystems1
Total Capacity682 TB
Filesystem TypeWekaFS

Filesystem Creation Notes

Each storage backend has four Azure SSDs attached to it, which are dedicated to the WEKA filesystem created. The storage cluster consisted of 100 storage servers with a single WEKA filesystem created in the cluster. Each client mounted the WEKA filesystem with a single mount.

Storage and Filesystem Notes

Three cores assigned to the FE clients, which is specified in the Terraform configuration file.

Transport Configuration - Virtual

Item NoTransport TypeNumber of Ports UsedNotes
116 Gbps Virtual Nic100Used by Weka Backend Server Nodes
216 Gbps Virtual Nic64Used by Weka Frontend Client Nodes

Transport Configuration Notes

None

Switches - Virtual

Item NoSwitch NameSwitch TypeTotal Port CountUsed Port CountNotes
1Azure16 Gbps Ethernet with Accelerated Networking100100Used by Weka Backend Server Nodes
2Azure16 Gbps Ethernet with Accelerated Networking6464Used by Weka Frontend Client Nodes

Processing Elements - Virtual

Item NoQtyTypeLocationDescriptionProcessing Function
13200vCPUL32s v3 Weka Backend2.8 GHz Intel(R) Xeon(R) Platinum 8370C processorsWekaFS, Network Communications, Storage Functions
22048vCPUE32s v5 Weka Frontend2.8 GHz Intel(R) Xeon(R) Platinum 8370C processorsWekaFS, Network Communications, Storage Functions

Processing Element Notes

None

Memory - Virtual

DescriptionSize in GiBNumber of InstancesNonvolatileTotal GiB
Azure L32s v3 Virtual Machine Memory256100V25600
Azure E32s v5 Virtual Machine Memory25664V16384
Grand Total Memory Gibibytes41984

Memory Notes

None

Stable Storage

WekaFS does not use any internal memory to temporarily cache write data to the underlying storage system. All writes are committed directly to the storage disks and protected via WekaFS Distributed Data Protection (16+2 in this case). There is no need for any RAM battery protection. In an event of a power failure a write in transit would not be acknowledged.

Solution Under Test Configuration Notes

The solution under test was a standard distributed cluster built with Weka software. Weka clusters can handle large and small file I/O with intensive metadata operations for HPC applications with no tuning required.

Other Solution Notes

None

Dataflow

None

Other Notes

None

Other Report Notes

None


Generated on Fri Oct 18 03:32:54 2024 by SpecReport
Copyright © 2016-2024 Standard Performance Evaluation Corporation