SPECstorage(TM) Solution 2020_genomics Result SPEC Storage(TM) : Reference Submission Subcommittee SPECstorage Solution = 12 Jobs (Overall Response Time = 1.33 msec) 2020_genomics =============================================================================== Performance =========== Business Average Metric Latency (Jobs) (msec) Jobs Ops/Sec Jobs MB/Sec ------------ ------------ ------------ ------------ 1 0.9 1000 85 2 0.7 2000 169 3 0.8 3000 254 4 0.8 4000 339 5 1.1 5000 424 6 1.1 6000 509 7 1.2 7000 595 8 1.2 8000 679 9 1.9 8884 755 10 2.0 9729 825 11 2.3 10859 922 12 2.5 11717 994 =============================================================================== Product and Test Information ============================ +---------------------------------------------------------------+ | Reference Submission | +---------------------------------------------------------------+ Tested by SPEC Storage(TM) Subcommittee Hardware Available 12/2020 Software Available 12/2020 Date Tested 12/2020 License Number 0 Licensee Locations Newton, Massachusetts The SPEC Storage(TM) Solution 2020 Reference Solution consists of an FreeNAS - Xeon - 256 GB, based on Xeon - 20 core processor, connected to VMware 8 nodes cluster using the NFSv3 protocol over a 10GbE Ethernet network. The FreeNAS server, provides IO/s from 2 file systems, and 2 volumes. The FreeNAS is running in iozone.org lab. The FreeNAS server uses a dual socket storage processor, full 12 Gb SAS back end connectivity and includes 40 SAS 10020 RPM Disk Drives 8 TB - SAS 12Gb/s. The storage server is running FreeOS 11.3-RELEASE-p14 using NFSv3 server and 2 10GbE Ethernet networking. Solution Under Test Bill of Materials ===================================== Item No Qty Type Vendor Model/Name Description ---- ---- ---------- ---------- ---------- ----------------------------------- 1 1 NFSv3 FreeNAS FreeNAS 1: 200GB SSD device for logging; freenas 2: 2x200 GB SSD devices (ARC cache); 3: 2xSAS controllers; 4: 40x450GB SAS 12GBps, 10k RPM HDD 2 1 Load Generic Dual Generic Server - Dual Quad core Generator Socket AMD Opteron Server1 Server 3GHz-32GB-2x10GbE 3 1 Load Generic Dual Generic Server - Dual Xeon Generator Socket E5-2603V3 Server2 Xeon 1.7GHz32GB-2x10GbE Server 4 1 Ethernet Quanta Quanta 24 Port 10GbE Ethernet Switch Switch Configuration Diagrams ====================== 1) storage2020-20201210-00002.config1.jpg (see SPECstorage Solution 2020 results webpage) Component Software ================== Item Name and No Component Type Version Description ---- ------------ ------------ ------------ ----------------------------------- 1 FreeNAS FreeOS 11.3-RELEASE Software running on the FreeNAS -p14 hardware and external Acme disk enclosure 2 VMware ESXi Server 5.5 (VM The 2 ESX servers were running Hypervisor version 9) VMware ESXi 5.5 Hypervisor and were configured with 4 VM's EA 3 Load Linux CentOS 7.2 Each of the 2 VMware ESXi 5.5 Generators 64-bit Hypervisor was configured to run 4 VM's running Linux OS total 8 VM's Hardware Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | Load Generator Virtual Machines | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- MTU 1500 Maximum Transfer Unit Hardware Configuration and Tuning Notes --------------------------------------- The Ports' MTU on the Load Generators, Network Switch and Storage Servers were set to default MTU=1500 Software Configuration and Tuning - Virtual =========================================== +----------------------------------------------------------------------+ | N/A | +----------------------------------------------------------------------+ Parameter Name Value Description --------------- --------------- ---------------------------------------- N/A N/A N/A Software Configuration and Tuning Notes --------------------------------------- No software tunings were used - default NFS mount options were used. Service SLA Notes ----------------- No opaque services were in use. Storage and Filesystems ======================= Item Stable No Description Data Protection Storage Qty ---- ------------------------------------- ------------------ -------- ----- 1 FreeNAS server: 10kRPM 450GB SAS RAID1 Yes 40 Drives 2 Virtual Machine: 16GB SAS Drives for None Yes 8 OS Number of Filesystems 2 Total Capacity 8 TiB Filesystem Type NFSv3 Filesystem Creation Notes ------------------------- The file systems were created on the FreeNAS using all default parameters. Storage and Filesystem Notes ---------------------------- The VM's storage was configured on the ESXi servers and shared from a single 450GB SAS 10K RPM HDD. Every two drives were mirrored (across enclosures) then aggregated into a pool. The two filesystems came from this pool. Transport Configuration - Physical ================================== Item Number of No Transport Type Ports Used Notes ---- --------------- ---------- ----------------------------------------------- 1 10 Gbit on 2 2 ports were connected and used for the test Storage Node 2 10 Gbit on Load 4 2 ports were connected on each ESXi server and Generators split into 8 VM's using an internal Private network Transport Configuration Notes ----------------------------- All the load generator VM clients were connected to an internal SW switch inside each ESXi server. This internal switch was connected to the 10 GbE switch. Switches - Physical =================== Total Used Item Port Port No Switch Name Switch Type Count Count Notes ---- -------------------- --------------- ------ ----- ------------------------ 1 Quanta LB6M 10 GbE Ethernet 24 6 The VM's were connected ESXi Servers to to the 10 Gbit switch Storage nodes using a Private network interconnect on the ESXi Processing Elements - Physical ============================== Item No Qty Type Location Description Processing Function ---- ---- -------- -------------- ------------------------- ------------------- 1 2 Xeon CPU Xeon Processor v4 with 20 NFSv3 Server cores 2 8 vCPU CPU Dual AMD Opteron v4 each Load Generators with 4 cores Processing Element Notes ------------------------ The 2 ESXi servers were using the dual socket Xeon and AMD Opteron processors and the Load Generators VM's were configured with 2 cores each without hyperthreading. Memory - Physical ================= Size in Number of Description GiB Instances Nonvolatile Total GiB ------------------------- ---------- ---------- ------------ ------------ FreeNAS main memory 256 1 V 256 NVRAM module 16 1 NV 16 Load generator VM memory 6 8 V 48 Grand Total Memory Gibibytes 320 Memory Notes ------------ The FreeNAS storage controller has main memory that is used for the operating system and for caching filesystem data. It uses a 241 GiB partition to provide stable storage for writes that have not yet been written to disk. Stable Storage ============== The FreeNAS storage controller has main memory that is used for the operating system and for caching filesystem data. It uses a 241 GiB partition to provide stable storage for writes that have not yet been written to disk. Solution Under Test Configuration Notes ======================================= The system under test consisted of one FreeNAS storage node, connected by 2 10 GbE ports of a dual port NIC. Each storage node was configured with 2 10GbE network interfaces connected to a 10GbE switch. There were 8 load generating clients, each connected to the same Quanta Ethernet switch as the FreeNAS storage node. Other Solution Notes ==================== None Dataflow ======== Each load generating client mounted all the 2 file systems using NFSv3. All the clients mounted 2 file systems from the storage node. The order of the clients as used by the benchmark was round-robin distributed such that as the load scaled up, each additional process used the next file system. This ensured an even distribution of load over the network and among the 2 file systems configured on the storage node. Other Notes =========== None. Other Report Notes ================== None. =============================================================================== Generated on Wed Dec 16 14:10:23 2020 by SpecReport Copyright (C) 2016-2020 Standard Performance Evaluation Corporation