SPECstorage™ Solution 2020_ai_image Result

Copyright © 2016-2022 Standard Performance Evaluation Corporation

Samsung Datacenter Technology and Cloud Solutions Lab SPECstorage Solution 2020_ai_image = 1400 AI_Jobs
Samsung PM9A3 NVMe and WekaFS Overall Response Time = 0.84 msec


Performance

Business
Metric
(AI_Jobs)
Average
Latency
(msec)
AI_Jobs
Ops/Sec
AI_Jobs
MB/Sec
1000.495435059780
2000.4908701119560
3000.49713051729340
4000.49517402239119
5000.49721752848899
6000.49426103458675
7000.49630454068459
8000.55234804578248
9000.64439155188020
10000.73143505797800
11000.858478562107584
12001.060522068117362
13001.497565574127138
14004.674608967136899
Performance Graph


Product and Test Information

Samsung PM9A3 NVMe and WekaFS
Tested bySamsung Datacenter Technology and Cloud Solutions Lab
Hardware AvailableDecember 2021
Software AvailableDecember 2021
Date TestedDecember 2021
License Number6309
Licensee LocationsSan Diego, California

Our performance results show that the Weka high performance filesystem paired with Samsung’s latest datacenter NVMe SSD, the PM9A3, delivers exceptional performance optimal for a wide variety of demanding workloads found in today’s datacenters. With the Samsung PM9A3, users benefit from a combination of high performance and enterprise functionality built especially for datacenters.

Solution Under Test Bill of Materials

Item NoQtyTypeVendorModel/NameDescription
16Storage ServerDellR7515The Dell EMC PowerEdge R7515 Rack Server is a highly scalable Single-socket 2U rack server. The CPU is a single AMD EPYC 7702P 64-Core Processor @ 3.9 GHz. 512 GiB of system memory. Each storage server has 2x Mellanox ConnectX-6 200GbE dual-port network cards as well as an embedded Broadcom 1GbE Ethernet card. A Micron Technology 240GB SATA SSD is used for the Linux OS and boot. There are 15 Samsung PM9A3 3.84TB NVMe U.2 drives being used for WekaFS.
28Client ServerDellR7525The Dell EMC PowerEdge R7525 is a two socket, 2U rack servers that is designed to run workloads using flexible I/O and network configurations. The CPUs are two AMD EPYC 7702P 64-Core Processor @ 3.9 GHz. 1 TiB of system memory. Each client server has 1x Mellanox ConnectX-6 200GbE dual-port network card as well as an embedded Broadcom 1GbE Ethernet card. A Micron Technology 240GB SATA SSD is used for the Linux OS and boot.
320200GbE HBA CardMellanoxConnectX-6 VP 200GbE Dual-PortConnectX-6 Virtual Protocol Interconnect® (VPI) cards are a groundbreaking addition to the Mellanox ConnectX series of industry-leading adapter cards. Providing two ports of 200Gb/s for InfiniBand and Ethernet connectivity, sub-600ns latency and 215 million messages per second, ConnectX-6 VPI cards enable the highest performance and most flexible solution aimed at meeting the continually growing demands of data center applications.
490SSDSamsungPM9A3PM9A3 offers tremendous performance for Read-Intensive data centers by applying PCIe® Gen 4, achieving 1000K IOPS in Random Read and 6800 MB/s in sequential read speed. Using impressively low power in small form factors (E1.S, U.2, M.2), PM9A3 delivers an efficient SSD solution for mixed data workloads. Samsung PM9A3 3.84TB NVMe U.2 drives were used in this test.
52SwitchMellanoxSN3700Mellanox SN3700 spine/super-spine offers 32 ports of 200GbE in a compact 1U form factor. It enables connectivity to endpoints at different speeds and carries a throughput of 12.8Tb/s, with a landmark 8.33Bpps processing capacity. As an ideal spine solution, the SN3700 allows maximum flexibility, with port speeds spanning from 10GbE to 200GbE per port.

Configuration Diagrams

  1. Samsung SUT Diagram

Component Software

Item NoComponentTypeName and VersionDescription
1WekaFSFile System3.12.2WekaFS is a fully-distributed, parallel file system that was written entirely from scratch to deliver the highest-performance file services by leveraging NVMe flash. The software also includes integrated tiering that seamlessly expands the namespace to and from hard disk drive (HDD) object storage, without the need for special data migration software or complex scripts; all data resides in a single namespace for easy access and management.
2Storage NodeStorage OSUbuntu 20.04Operating System (OS) for 6 storage servers in Dell R7515.
3ClientsStorage OSUbuntu 20.04Operating System (OS) for 8 clients in Dell R7525.

Hardware Configuration and Tuning - Physical

Storage Server
Parameter NameValueDescription
Port speed200GbEach storage server has 4x 200GbE ethernet ports connected to the switch.
MTU9000Jumbo frames of MTU 9000 bytes have been configured on the 200GbE connections.
Clients
Parameter NameValueDescription
Port speed200GbEach client has 2x 200GbE ethernet ports connected to the switch.
MTU9000Jumbo frames of MTU 9000 bytes have been configured on the 200GbE connections.

Hardware Configuration and Tuning Notes

None

Software Configuration and Tuning - Physical

Clients
Parameter NameValueDescription
num_cores8WekaFS mount option to designate the number of frontend cores to allocate for the client.
memory_mb30720WekaFS mount option to designate amount of memory to be used by the client (for huge pages).
netens3f0,ens3f1WekaFS mount option to designate both client 200GbE network ports be used for the mount.

Software Configuration and Tuning Notes

The single filesystem was attached via a single mount per client. The mount string used was "sudo mount -t wekafs -o net=ens3f0,net=ens3f1 -o num_cores=8,memory_mb=30720 11.11.208.72/weka_perf /mnt/wekamount/"

Service SLA Notes

None

Storage and Filesystems

Item NoDescriptionData ProtectionStable StorageQty
1Total of 90x Samsung PM9A3 3.84TB SSDs used for Weka File-System.Yes90
2Total of 6x Micron Technology 240GB SATA SSD used for boot.Yes6
Number of Filesystems1
Total Capacity188 TiB
Filesystem TypeWekaFS

Filesystem Creation Notes

Each storage server has 15x Samsung PM9A3 attached to it, which are dedicated to the Weka filesystem. Each storage server has 1x Micron Technology 240GB SATA SSD used as the boot drive. The storage cluster consisted of 6 storage servers with a single WekaFS filesystem created in the cluster.

Storage and Filesystem Notes

WekaFS is a fully containerized storage OS, in this configuration 3 LXC containers containing WekaFS storage processing were deployed per storage server.

Transport Configuration - Physical

Item NoTransport TypeNumber of Ports UsedNotes
1200GbE Network16Each client server is connected to the switch via a dual-port 200GbE HBA.
2200GbE Network24Each storage server is connected to the switch via 2x dual-port 200GbE HBA.

Transport Configuration Notes

None

Switches - Physical

Item NoSwitch NameSwitch TypeTotal Port CountUsed Port CountNotes
1Mellanox SN3700200GbE64402x Mellanox SN3700 switches connected together with a 600Gb LAG. Each switch has 8 ports used for client connections and 12 ports used for target server connections.

Processing Elements - Physical

Item NoQtyTypeLocationDescriptionProcessing Function
116CPUClient ServerAMD EPYC 7702P 64-Core ProcessorEach client Dell R7525 has a dual socket AMD EPYC 7702P 64-Core 3.9GHz processor.
26CPUStorage ServerAMD EPYC 7702P 64-Core ProcessorEach Dell R7515 storage server has a single socket AMD EPYC 7702P 64-Core 3.9GHz processor.

Processing Element Notes

None

Memory - Physical

DescriptionSize in GiBNumber of InstancesNonvolatileTotal GiB
8x client servers Dell R7525 with 1024GB of memory.10248V8192
6x storage servers Dell R7515 with 512GB of memory.5126V3072
Grand Total Memory Gibibytes11264

Memory Notes

None

Stable Storage

WekaFS does not use any internal memory to temporarily cache write data to the underlying storage system. All writes are commited directly to the storage disk, and protected via WekaFS Distributed Data Protection (4+2 in this case). There is no need for any RAM battery protection. In an event of a power failure a write in transit would not be acknowledged.

Solution Under Test Configuration Notes

The system under test consisted of the 8 client servers and 6 storage servers. The 6 storage servers each have 2x dual-port network interfaces connected to a 200GbE switch. The 8 load generating client servers each have a dual-port network interface also connected to a 200GbE switch.

Other Solution Notes

None

Dataflow

One of the 8 client servers acted as benchmark's prime client to initiate the tests. The benchmark load is distributed accross the 8 Dell R7525 client servers using a single mount point per client.

Other Notes

None

Other Report Notes

The solution under test was a standard WekaFS cluster in dedicated server mode. The solution will handle both large file I/O as well as small file random I/O and metadata intensive applications. No specialized tuning is required for different or mixed use workloads. None of the components used to perform the test were patched with Spectre or Meltdown patches (CVE-2017-5754, CVE-2017-5753, CVE-2017-5715).


Generated on Mon Jan 10 17:54:06 2022 by SpecReport
Copyright © 2016-2022 Standard Performance Evaluation Corporation