SPECstorage(TM) Solution 2020_ai_image Result SPEC Storage(TM) : Reference Submission Subcommittee SPECstorage Solution = 12 AI_Jobs (Overall Response Time = 6.77 msec) 2020_ai_image =============================================================================== Performance =========== Business Average Metric Latency AI_Jobs AI_Jobs (AI_Jobs) (msec) Ops/Sec MB/Sec ------------ ------------ ------------ ------------ 1 4.3 435 94 2 3.0 870 188 3 3.3 1305 282 4 3.1 1740 377 5 3.5 2175 471 6 3.6 2610 565 7 4.1 3045 660 8 4.0 3480 754 9 10.5 3915 848 10 11.2 4345 942 11 18.0 4784 1036 12 15.8 5219 1130 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | Reference Submission | +---------------------------------------------------------------+ Tested by SPEC Storage(TM) Subcommittee Hardware Available 12/2020 Software Available 12/2020 Date Tested 12/2020 License Number 0 Licensee Locations Newton, Massachusetts The SPEC Storage(TM) Solution 2020 Reference Solution consists of an FreeNAS - Xeon - 256 GB, based on Xeon - 20 core processor, connected to VMware 8 nodes cluster using the NFSv3 protocol over a 10GbE Ethernet network. The FreeNAS server, provides IO/s from 2 file systems, and 2 volumes. The FreeNAS is running in iozone.org lab. The FreeNAS server uses a dual socket storage processor, full 12 Gb SAS back end connectivity and includes 40 SAS 10020 RPM Disk Drives 8 TB - SAS 12Gb/s. The storage server is running FreeOS 11.3-RELEASE-p14 using NFSv3 server and 2 10GbE Ethernet networking. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 1 NFSv3 FreeNAS FreeNAS 1: 200GB SSD device for logging; freenas 2: 2x200 GB SSD devices (ARC cache); 3: 2xSAS controllers; 4: 40x450GB SAS 12GBps, 10k RPM HDD 2 1 Load Generic Dual Generic Server - Dual Quad core Generator Socket AMD Opteron Server1 Server 3GHz-32GB-2x10GbE 3 1 Load Generic Dual Generic Server - Dual Xeon Generator Socket E5-2603V3 Server2 Xeon 1.7GHz32GB-2x10GbE Server 4 1 Ethernet Quanta Quanta 24 Port 10GbE Ethernet Switch Switch Configuration Diagrams ====================== 1) storage2020-20201105-00001.config1.jpg (see SPECstorage Solution 2020 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 FreeNAS FreeOS 11.3-RELEASE Software running on the FreeNAS -p14 hardware and external Acme disk enclosure 2 VMware ESXi Server 5.5 (VM The 2 ESX servers were running Hypervisor version 9) VMware ESXi 5.5 Hypervisor and were configured with 4 VM's EA 3 Load Linux CentOS 7.2 Each of the 2 VMware ESXi 5.5 Generators 64-bit Hypervisor was configured to run 4 VM's running Linux OS total 8 VM's Hardware Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | Load Generator Virtual Machines | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- MTU 1500 Maximum Transfer Unit Hardware Configuration and Tuning Notes --------------------------------------- The Ports' MTU on the Load Generators, Network Switch and Storage Servers were set to default MTU=1500 Software Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | N/A | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- N/A N/A N/A Software Configuration and Tuning Notes --------------------------------------- No software tunings were used - default NFS mount options were used. Service SLA Notes ----------------- No opaque services were in use. Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 FreeNAS server: 10kRPM 450GB SAS RAID1 Yes 40 Drives 2 Virtual Machine: 16GB SAS Drives for None Yes 8 OS Number of Filesystems 2 Total Capacity 8 TiB Filesystem Type NFSv3 Filesystem Creation Notes ------------------------- The file systems were created on the FreeNAS using all default parameters. Storage and Filesystem Notes ---------------------------- The VM's storage was configured on the ESXi servers and shared from a single 450GB SAS 10K RPM HDD. Every two drives were mirrored (across enclosures) then aggregated into a pool. The two filesystems came from this pool. Transport Configuration - Physical ================================== Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 10 Gbit on 2 2 ports were connected and used for the test Storage Node 2 10 Gbit on Load 4 2 ports were connected on each ESXi server and Generators split into 8 VM's using an internal Private network Transport Configuration Notes ----------------------------- All the load generator VM clients were connected to an internal SW switch inside each ESXi server. This internal switch was connected to the 10 GbE switch. Switches - Physical =================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 Quanta LB6M 10 GbE Ethernet 24 6 The VM's were connected ESXi Servers to to the 10 Gbit switch Storage nodes using a Private network interconnect on the ESXi Processing Elements - Physical ============================== Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 2 Xeon CPU Xeon Processor v4 with 20 NFSv3 Server cores 2 8 vCPU CPU Dual AMD Opteron v4 each Load Generators with 4 cores Processing Element Notes ------------------------ The 2 ESXi servers were using the dual socket Xeon and AMD Opteron processors and the Load Generators VM's were configured with 2 cores each without hyperthreading. Memory - Physical ================= Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ FreeNAS main memory 256 1 V 256 NVRAM module 16 1 NV 16 Load generator VM memory 6 8 V 48 Grand Total Memory Gibibytes 320 Memory Notes ------------ The FreeNAS storage controller has main memory that is used for the operating system and for caching filesystem data. It uses a 241 GiB partition to provide stable storage for writes that have not yet been written to disk. Stable Storage ============== The FreeNAS storage controller has main memory that is used for the operating system and for caching filesystem data. It uses a 241 GiB partition to provide stable storage for writes that have not yet been written to disk. Solution Under Test Configuration Notes ======================================= The system under test consisted of one FreeNAS storage node, connected by 2 10 GbE ports of a dual port NIC. Each storage node was configured with 2 10GbE network interfaces connected to a 10GbE switch. There were 8 load generating clients, each connected to the same Quanta Ethernet switch as the FreeNAS storage node. Other Solution Notes ==================== None Dataflow ======== Each load generating client mounted all the 2 file systems using NFSv3. All the clients mounted 2 file systems from the storage node. The order of the clients as used by the benchmark was round-robin distributed such that as the load scaled up, each additional process used the next file system. This ensured an even distribution of load over the network and among the 2 file systems configured on the storage node. Other Notes =========== None. Other Report Notes ================== None. =============================================================================== Generated on Wed Dec 16 14:09:30 2020 by SpecReport Copyright (C) 2016-2020 Standard Performance Evaluation Corporation