SPECsfs97_R1.v3 Result

EMC Corp. :	Celerra 514x4+1 Failover Cluster / Symmetrix DMX1000-P
SPECsfs97_R1.v3 =	100940 Ops/Sec (Overall Response Time = 1.86 msec)

Performance

Throughput (ops/sec)	Response (msec)
9936	0.8
19968	1.0
29936	1.1
40024	1.2
49991	1.3
60119	1.6
70312	2.1
80290	2.6
90529	3.5
100940	6.4

Configuration

Server Configuration and Availability
Vendor	EMC Corp.
Hardware Available	November 2003
Software Available	November 2003
Date Tested	November 2003
SFS License Number	47
Licensee Locations	Hopkinton, MA

CPU, Memory and Power

Model Name Celerra 514x4+1 Failover Cluster / Symmetrix DMX1000-P

Processor 1.6 GHz Pentium 4

# of Processors 8 (2 per node)

Primary Cache 16KBI+16KBD on chip

Secondary Cache 512KB(I+D) on chip

Other Cache N/A

UPS N/A

Other Hardware N/A

Memory Size 16 GB (4GB per node)

NVRAM Size N/A

NVRAM Type N/A

NVRAM Description N/A

Server Software

OS Name and Version Dart 5.1.20.99

Other Software Redhat Linux 7.2 on Control Station

File System fs1,fs2,fs3,fs4

NFS version 3

Server Tuning

Buffer Cache Size Dynamic

# NFS Processes 4 per node

Fileset Size 957.4 GB

Network Subsystem
Network Type	Jumbo Gigabit Ethernet
Network Controller Desc.	Intel 4-port card
Number Networks	1
Number Network Controllers	8 (2 per node)
Protocol Type	TCP

Switch Type Cisco 6509 Gbit Switch

Bridge Type N/A

Hub Type N/A

Other Network Hardware N/A

Disk Subsystem and Filesystems

Number Disk Controllers 4 (1 per node, 2 ports per card)

Number of Disks 143

Number of Filesystems 4 (1 per node)

File System Creation Ops N/A

File System Config Striped across 133 disk LUNs with a 32K stripe unit

Disk Controller Emulex LP9000DC Fibre Channel

# of Controller Type 1

Number of Disks 143

Disk Type Seagate Cheetah 146GB 10K RPM

File Systems on Disks OS (2) UxFS log (8), Filesystems fs1..fs4 (133)

Special Config Notes 64GB memory on Symmetrix DMX1000-P

Load Generator (LG) Configuration
Number of Load Generators	24
Number of Processes per LG	24
Biod Max Read Setting	5
Biod Max Write Setting	5

LG Type LG1

LG Model Sun Sparc 220R

Number and Type Processors 2 x 450 MHz Sparc

Memory Size 512 MB

Operating System Solaris 2.8

Compiler Sun Forte 6.2

Compiler Options None

Network Type Intraserver Gbe

LG Type LG2

LG Model Sun Sparc 420R

Number and Type Processors 2 x 450 MHz Sparc

Memory Size 1 GB

Operating System Solaris 2.8

Compiler Sun Forte 6.2

Compiler Options None

Network Type Intraserver Gbe

LG Type LG3

LG Model Sun Sparc 220R

Number and Type Processors 2 x 360 MHz Sparc

Memory Size 512 MB

Operating System Solaris 2.8

Compiler Sun Forte 6.2

Compiler Options None

Network Type Intraserver Gbe

Testbed Configuration

LG # LG Type Network Target File Systems Notes

1..10 LG1 1 /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4, /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4 N/A

11..23 LG2 1 /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4, /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4 N/A

24 LG3 1 /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4, /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4 N/A

Testbed Configuration
LG #	LG Type	Network	Target File Systems	Notes
1..10	LG1	1	/fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4, /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4	N/A
11..23	LG2	1	/fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4, /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4	N/A
24	LG3	1	/fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4, /fs1, /fs1, /fs1, /fs2, /fs2, /fs2, /fs3, /fs3, /fs3, /fs4, /fs4, /fs4	N/A

Other Notes

Failover is supported by an additional Celerra 514 Data Mover that operates in
standby mode. In the event of a Data Mover failure, this unit takes over the
function of the failed unit. The standby Data Mover does not contribute to
the performance of the system and is not included in the processor, memory,
or other components listed above.
Server tuning:
param ufs inoBlkHashSize=170669 (inode block hash size)
param ufs inoHashTableSize=1218761 (inode hash table size)
param ufs updateAccTime=0 (disable access-time updates)
param nfs withoutCollector=1 (enable NFS-to-CPU thread affinity)
param file prefetch=0 (disable Dart read prefetch)
file initialize nodes=980000 dnlc=1056000 (Number of inodes, number of
dynamic name lookup cache entries)
nfs start openfiles=722462 nfsd=4 (no. of open files and 4 NFS daemons)
param kernel outerLoop=8 (8 consecutive iterations of network packets processing)
param kernel maxStrToBeProc=16 (no. of network streams to process at once)
ians cge0 packetburst=16 (maximum no. of packets to be processed at once)
ians cge1 packetburst=16 (maximum no. of packets to be processed at once)
Storage array notes:
The DMX1000-P used for storage exposes LUNs across multiple Fibre ports.
Each LUN is 14386MB in size and resides on a single disk. Four of the fibre
ports are connected to the Fibre switch and zoned along with the two ports
on the node. Each UFS log was configured on a 1GB slice taken from a 32K striped
volume that spans across 8 disk LUNs. The filesystem is built on a stripe that
spans across the filesystem LUNs.
The DMX1000-P was configured with 64GB memory. The memory is backed up with
sufficient battery power to safely destage all cached data onto the disk
in the event of a power failure.
Client tuning:
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_cwnd_max 2097152
ndd -set /dev/tcp tcp_max_buf 4194304

First published at SPEC.org on 10-Dec-2003

LG Type	LG1
LG Model	Sun Sparc 220R
Number and Type Processors	2 x 450 MHz Sparc
Memory Size	512 MB
Operating System	Solaris 2.8
Compiler	Sun Forte 6.2
Compiler Options	None
Network Type	Intraserver Gbe

LG Type	LG2
LG Model	Sun Sparc 420R
Number and Type Processors	2 x 450 MHz Sparc
Memory Size	1 GB
Operating System	Solaris 2.8
Compiler	Sun Forte 6.2
Compiler Options	None
Network Type	Intraserver Gbe