SPECsfs2008_nfs.v3 Result

Exanet Inc. : ExaStore Eight Nodes Clustered NAS System
SPECsfs2008_nfs.v3 = 119550 Ops/Sec (Overall Response Time = 2.07 msec)


Performance

Throughput
(ops/sec)
Response
(msec)
11795 1.4
23625 1.3
35436 1.5
47284 1.6
59136 1.8
71013 1.8
82871 2.2
94584 2.5
106374 3.6
117077 5.0
119243 6.0
119550 6.4
Performance Graph


Product and Test Information

Tested By Exanet Inc.
Product Name ExaStore Eight Nodes Clustered NAS System
Hardware Available April 2008
Software Available Sep 2008
Date Tested Aug 2008
SFS License Number 1909
Licensee Locations Ra'anana, Israel

The ExaStore Eight Node Clustered NAS System is a highly scalable cluster of 8 EX1500 Clustered NAS Servers and associated fibre channel storage. The EX1500 is the basic building block of an ExaStore Clustered NAS system. These systems can contain 2, 4, 6, 8, or more EX1500 File Servers along with over a petabyte of storage, all presented to users and administrators as a single file system. An Exanet Clustered NAS System is the ideal choice for environments requiring scalable capacity or performance in an easy to administer system.

Configuration Bill of Materials

Item No Qty Type Vendor Model/Name Description
1 8 Server Exanet EX1500 Exanet EX1500 Clustered NAS Server
2 8 NIC Exanet NC020 Chelsio 10Gb dual port (CX4)
3 8 NIC Exanet NC017 Intel PRO/1000 PT Quad Port PCIe Low Profile Server Adaptor
4 16 HBA Exanet SA030 Emulex LPe1102 4Gb Fibre Channel Dual Host Bus Adaptor PCI-e
5 2 Ethernet Switch Exanet MG007 Linksys 24 port 10/100 Ethernet switch (Managment Network)
6 2 10Gb Ethernet Switch Exanet IC035 Fujitsu XG700 10Gbe CX4 Copper Switch 12 Port
7 8 UPS Exanet PW009 APC Smart-UPS 1500VA USB & Serial RM 2U
8 16 Storage Controller Exanet DX12 Exanet DX12 12-Bay 4G FC to SAS/SATA (3G) High-Performance Dual RAID Controller 3.5" (2U) Rackmount
9 32 Storage Expansion Exanet DX12 EXP Expansion Bay for Exanet DX12 12 Bay SAS to SAS/SATA 2U Rackmount RAID Expansion system with Dual disk IO module
10 576 Disk Exanet DX12 146GB-15K 146G Seagate X15-5 SAS disk drive in carrier

Server Software

OS Name and Version ExaStore v3.5.500
Other Software N/A
Filesystem Software ExaFS

Server Tuning

Name Value Description
Default parameters None The system was tested using the default parameters

Server Tuning Notes

ExaStore system default configuration was used

Disks and Filesystems

Description Number of Disks Usable Size
Mirrored boot disks 2 73GB HDDs per node for system use only 16 584.0 GB
36 Disks per DX12 RAID unit, bound into 6 5+1 RAID5 LUNs, all 96 LUNs assembled into a single file system 576 63.0 TB
Total 592 63.5 TB
Number of Filesystems 1
Total Exported Capacity 64483 GB
Filesystem Type ExaFS
Filesystem Creation Options default
Filesystem Config ExaFS default single clustered file system utilizing all 96 LUNs, served on all 8 nodes
Fileset Size 14530.4 GB

Network Configuration

Item No Network Type Number of Ports Used Notes
1 Gigabit Ethernet (Client Network) 32 Each node uses 4 Gigabit Ethernet ports towards the Client network
2 10 Gigabit Ethernet 16 Each node uses two 10 Gigabit Ethernet ports for the dual 10 Gigabit interconnect network

Network Configuration Notes

Client network connected to two 48 port stacked Gigabit switches. Two 10 Gigabit switches were used for the inteconnect network

Benchmark Network

All clients and system nodes are connected to a flat network using the same subnet

Processing Elements

Item No Qty Type Description Processing Function
1 16 CPU Intel Quad-Core Xeon Processor E5405 80W 2.0GHz/1333MHz/12MB L2 ExaStore, ExaFS, NFS, TCP/IP

Processing Element Notes

None

Memory

Description Size in GB Number of Instances Total GB Nonvolatile
Server memory protected indefinitely using mirroring to pair node each node protected by UPS allowing dump to local disk in case of power failure 24 8 192 NV
Storage controller memory protected by battery for 72 hours 2 16 32 NV
Grand Total Memory Gigabytes     224  

Memory Notes

The RAID unit mirrored write cache is backed up with a battery unit able to retain the write cache for 72 hours in the event of a power failure. Server memory is protected using UPS and mirroring to pair node.

Stable Storage

All memory in the ExaStore was used by the system for general-purpose memory and dynamically sized data cache.There is an integral UPS for each ExaStore node, which guarantees sufficient power in the event of power failure to dump the write cache to its local on-server RAID. In case of unsafe situations (e.g. low battery condition), the system uses a journal mechanism to synchronously log all write-type operations to the DX12 Storage System which are connected to all nodes. When power is restored, the ExaStore system is able to recover all committed data and metadata operations from journal files or dump files accordingly

System Under Test Configuration Notes

Default configuration

Other System Notes

Test Environment Bill of Materials

Item No Qty Vendor Model/Name Description
1 16 IBM X3650 Server IBM X3650 Server (2*E5405 QuadCore, 8GB RAM - 2*73GB HDD)
2 16 Intel Quad NIC Intel PRO/1000 PT Quad Port PCIe Low Profile Server Adapter
3 2 Nortel 5510 Nortel 5510 48 ports Gigabit Ethernet switch

Load Generators

LG Type Name LG
BOM Item # 1
Processor Name Intel Quad-Core Xeon Processor E5405 80W 2.0GHz/1333MHz/12MB L2
Processor Speed 2.0GHz
Number of Processors (chips) 2
Number of Cores/Chip 4
Memory Size 8 GB
Operating System CentOS 4.4
Network Type 1 NIC Gigabit Ethernet

Load Generator (LG) Configuration

Benchmark Parameters

Network Attached Storage Type NFS V3
Number of Load Generators 16
Number of Processes per LG 64
Biod Max Read Setting 2
Biod Max Write Setting 2
Block Size AUTO

Testbed Configuration

LG No LG Type Network Target Filesystems Notes
1..16 LG Client Network ExaFS 16 LGs accessing ExaFS (single file system) via the 10.64.0.0/12 network

Load Generator Configuration Notes

None

Uniform Access Rule Compliance

Every client mounts the same file system from the ExaStore cluster

Other Notes

None

None

Config Diagrams


Generated on Mon Aug 25 09:22:19 2008 by SPECsfs2008 HTML Formatter
Copyright © 1997-2008 Standard Performance Evaluation Corporation

First published at SPEC.org on 19-Sep-2008