SPECvirt_sc2010 Result: IBM Corporation

SPECvirt_sc2010 Result
Copyright © 2010-2011 Standard Performance Evaluation Corporation

IBM Corporation: IBM BladeCenter HS22V
Red Hat: Enterprise Linux 6.0 (KVM)

SPECvirt_sc2010 1367 @ 84 VMs

Tested By:

IBM Corporation

SPEC License #:

Test Date:

Feb-2011

Performance Section
Performance Summary
Performance Details
Validation Errors

SUT Configuration Section
Physical Configuration
Virtual Configuration

Power Section

N/A

Notes Section
Physical System Notes
Virtualization SW Notes
Hosted VM Notes

Performance Summary:

Performance
Tile #	Pct Load	Application Server	Web Server	Mail Server	Idle Server	Per-Tile Score	Overall Score
1	100%	33.50	53.68	88.27	N/A	97.78	1367
2	100%	33.48	53.78	87.89	N/A	97.68
3	100%	33.47	53.61	88.22	N/A	97.69
4	100%	33.40	53.87	87.83	N/A	97.64
5	100%	33.54	53.55	88.28	N/A	97.74
6	100%	33.36	53.76	87.81	N/A	97.53
7	100%	33.40	53.53	88.09	N/A	97.53
8	100%	33.48	53.76	87.89	N/A	97.67
9	100%	33.53	53.49	88.13	N/A	97.64
10	100%	33.50	53.76	87.56	N/A	97.57
11	100%	33.43	53.64	88.23	N/A	97.68
12	100%	33.37	53.72	87.86	N/A	97.53
13	100%	33.49	53.65	88.14	N/A	97.71
14	100%	33.54	53.79	87.85	N/A	97.73

Quality Of Service (QOS)
Tile #	Pct Load	Application Server	Web Server	Mail Server	Idle Server	Per-Tile Score	Overall Score
1	100%	0.99	1.00	1.00	1.00	1.00	99.91%
2	100%	0.99	1.00	1.00	1.00	1.00
3	100%	1.00	1.00	1.00	1.00	1.00
4	100%	1.00	1.00	1.00	1.00	1.00
5	100%	0.99	1.00	1.00	1.00	1.00
6	100%	1.00	1.00	1.00	1.00	1.00
7	100%	1.00	1.00	1.00	1.00	1.00
8	100%	1.00	1.00	1.00	1.00	1.00
9	100%	1.00	1.00	1.00	1.00	1.00
10	100%	0.99	1.00	1.00	1.00	1.00
11	100%	1.00	1.00	1.00	1.00	1.00
12	100%	1.00	1.00	1.00	1.00	1.00
13	100%	1.00	1.00	1.00	1.00	1.00
14	100%	0.99	1.00	1.00	1.00	1.00

Performance Details:

Tile 1

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.32	1.51	6.87	2.50	5
Dealer	20.18	0.22/0.48/0.16	5.25/14.43/4.78	0.50/1.10/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.68	385420	704	336	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.14	101812	101811	1	100.00
Fetch	36.14	260174	260174	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.15	2	111

Tile 2

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.35	1.29	8.93	1.75	5
Dealer	20.13	0.15/0.31/0.13	9.18/19.98/6.58	0.30/0.70/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.78	386791	432	26	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.14	101842	101812	30	99.97
Fetch	35.82	257907	257906	1	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.71	2	67

Tile 3

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.41	5.32	2.00	5
Dealer	20.10	0.18/0.41/0.12	2.73/7.55/2.21	0.40/1.00/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.61	384909	704	379	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.25	102569	102569	0	100.00
Fetch	36.07	259687	259687	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.40	2	106

Tile 4

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.31	1.22	2.74	1.50	5
Dealer	20.09	0.11/0.25/0.10	1.14/4.90/1.17	0.30/0.60/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.87	387353	451	32	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.14	101821	101676	145	99.86
Fetch	35.84	258023	258017	6	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.87	2	64

Tile 5

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.41	1.50	6.09	2.25	5
Dealer	20.13	0.21/0.50/0.14	3.97/11.58/2.72	0.50/1.20/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.55	384482	636	428	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.23	102469	102468	1	100.00
Fetch	36.00	259214	259214	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.83	2	70

Tile 6

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.36	1.25	4.29	1.75	5
Dealer	19.99	0.13/0.28/0.11	1.83/9.85/2.39	0.30/0.70/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.76	386603	475	19	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.14	101809	101750	59	99.94
Fetch	35.87	258297	258296	1	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	8.61	2	47

Tile 7

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.36	1.41	4.81	2.00	5
Dealer	20.04	0.17/0.40/0.12	2.24/6.53/2.08	0.40/0.90/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.53	384070	721	630	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.17	102017	102017	0	100.00
Fetch	35.99	259097	259097	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	10.08	2	166

Tile 8

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.43	1.33	4.15	1.75	5
Dealer	20.05	0.15/0.37/0.12	1.87/7.69/2.58	0.30/0.90/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.76	386521	509	26	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.17	102017	102009	8	99.99
Fetch	35.90	258492	258492	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.17	2	123

Tile 9

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.38	1.24	3.83	1.50	5
Dealer	20.15	0.12/0.28/0.10	1.92/5.19/1.66	0.30/0.70/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.49	383908	771	430	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.22	102409	102393	16	99.98
Fetch	36.05	259530	259530	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.63	2	65

Tile 10

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.35	1.45	9.52	2.00	5
Dealer	20.15	0.19/0.46/0.14	4.36/20.58/4.85	0.40/1.10/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.76	386532	478	30	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.14	101831	101573	258	99.75
Fetch	35.77	257557	257555	2	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.63	2	133

Tile 11

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.36	1.22	3.03	1.50	5
Dealer	20.07	0.11/0.26/0.09	1.28/3.61/1.30	0.30/0.60/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.64	384791	1089	360	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.19	102200	102184	16	99.98
Fetch	36.05	259549	259549	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	7.98	2	55

Tile 12

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.34	1.37	5.86	2.00	5
Dealer	20.03	0.17/0.40/0.12	2.67/12.47/2.32	0.40/0.90/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.72	386186	525	37	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.16	101974	101935	39	99.96
Fetch	35.89	258433	258433	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.59	2	144

Tile 13

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.37	1.28	4.11	1.75	5
Dealer	20.12	0.12/0.28/0.10	2.12/4.94/1.93	0.30/0.60/0.20	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.65	385095	789	418	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.17	102004	102004	0	100.00
Fetch	35.92	258627	258627	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	9.27	2	255

Tile 14

Application Server
Req. Type	Req/sec	Avg Resp. Time	Max Resp. Time	90th%	Required 90th%
Manufacturing	13.40	1.38	5.88	2.00	5
Dealer	20.15	0.18/0.42/0.13	5.81/15.35/5.73	0.40/1.00/0.30	2/2/2

Web Server
Web Wkload	Req/sec	Good	Tolerable	Fail	Valid. Errors
Support	53.79	386784	478	32	0

Mail Server
Req. Type	Req/sec	Total Count	Pass Count	Fail Count	Pass Pct
Append	14.20	102247	102220	27	99.97
Fetch	35.86	258178	258178	0	100.00

Idle Server
Req. Type	Total	Avg. Resp. Msec	Min Resp. Msec	Max Resp. Msec
Heartbeats	719	8.48	2	89

Validation Errors:

No Validation Errors Found

Physical Configuration:

System Under Test (SUT)
Virt. Vendor/Product	Red Hat Enterprise Linux 6.0 (KVM)
# of SUTs	1
Server Vendor	IBM Corporation
Server Model	IBM BladeCenter HS22V
Processor	Intel X5690
Processor Speed (MHz)	3460
Processor Cores	12 cores, 2 chips, 6 cores/chip, 2 threads/core
Primary Cache	32 KB I + 32 KB D on chip per core
Secondary Cache	256 KB I+D on chip per core
Other Cache	12 MB I+D on chip per chip
Memory	288 GB VLP DDR-3 (18 x 16GB DIMMs at 800 MHz)
Operating System	Red Hat Enterprise Linux 6.0
File System	ext4
Other Hardware	1 IBM BladeCenter H Chassis 2 IBM Cisco Catalyst Switch 3110G for IBM BladeCenter 2 Qlogic 8Gb Fibre Channel Switch Module (1 unused) 1 BNT Virtual Fabric 10Gb Switch Module for IBM BladeCenter 1 Cisco Catalyst 6500 switch with 1 48-port Gbit Ethernet blade and 1 dual port 10Gbit Ethernet blade
Other Software	N/A

SUT Storage
Storage Controllers	1 x QLogic 8Gb Fibre Channel Expansion Card (CIOv) for IBM BladeCenter 1 x LSI 1064E SAS/SATA
Storage Enclosure	1 x IBM DS4800 FC Disk Controller 10 x IBM EXP810
Disk Description	64 x 73 GB 15k RPM FC 80 x 146 GB 15k RPM FC 2 x IBM 50GB SATA 1.8 in NHS SSD
RAID Level	RAID 5 RAID 1
UPS Required?	No No

SUT Network
Network Adapters	Broadcom 5709S onboard NIC with dual Gigabit Ethernet ports with TOE Broadcom 10Gb Gen2 2-port Ethernet Exp Cd (CFFh) for IBM BladeCenter
SUT Ports Total	2 2
SUT Ports Used	1 2
Network Type	1000BASE-T 10GBASE-SR
Network Speed	1 Gb/s 10 Gb/s

Clients
Model	x3550M2
# of Clients	4
Processor	Intel E5520
Processor Speed (MHz)	2270
# Processors	2
Memory	32 GB SDRAM
Network Controller	Broadcom Gbit Ethernet Dual Port Adapter (onboard) Intel PRO1000 PT Dual Port Adapter
Operating System	Red Hat Enterprise Linux 6.0 (64-bit)
JVM Version	Java HotSpot(TM) Server VM (build 16.3-b01,mixed mode)
Other Hardware	N/A
Other Software	N/A

Availability Dates
SUT Hardware	Feb-2011
Virt. Software	Mar-2011
Other Components	N/A

Virtual Configuration:

Web Server

VM Configuration Details
# VCPUS	2
VCPU Speed (MHz)	3460 MHz
Memory (MB)	11264
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15630
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Web Server Configuration Details
Web Server Vendor	Red Hat
Web Server Name/Version	Apache 2.2.15
Availability Date	Nov-2010
Script Vendor	Red Hat
Script Name/Version	PHP 5.3.2
Script Availability Date	Nov-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	Alternative PHP Cache APC 3.1.3 (Red Hat) Smarty Template Engine 2.6.26

Application Server

VM Configuration Details
# VCPUS	2
VCPU Speed (MHz)	3460 MHz
Memory (MB)	2560
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

App Server Configuration Details
Application Server Vendor	IBM
App. Server Name/Version	WebSphere Application Server 7.0.0.7
Availability Date	Jan-2009
Emulator Vendor	IBM
Emulator Name/Version	WebSphere Application Server 7.0.0.7
Emulator Availability Date	Jan-2009
JVM Description	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
JVM Availability	Apr-2010
Other Software	N/A

Mail Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	3460 MHz
Memory (MB)	2048
# VNICs	2
VNIC Description	1 x virtio_net 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	40960
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Mail Server Configuration Details
Mail Server Vendor	dovecot.org
Mail Server Name/Version	Dovecot 2.0.7
Availability Date	Nov-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	N/A

Database Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	3460 MHz
Memory (MB)	2048
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Database Configuration Details
Database Vendor	IBM
Database Name/Version	DB2 v9.7
Availability Date	Mar-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	N/A

Infraserver

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	3460 MHz
Memory (MB)	1024
# VNICs	2
VNIC Description	1 x virtio_net, 1 x ixgbevf
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	61440
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Infraserver Configuration Details
Web Server Vendor	Red Hat
Web Server Name/Version	Apache 2.2.5
Availability Date	Nov-2010
Script Vendor	Fedora Project, release 14 (fedoraproject.org)
Script Name/Version	fcgi-2.4.0
Script Availability Date	Nov-2010
JVM Version	IBM JRE 1.6.0 J9 2.4 Linux x86-32 jvmxi3260sr8-20100401_55940
Other Software	N/A

Idle Server

VM Configuration Details
# VCPUS	1
VCPU Speed (MHz)	3460 MHz
Memory (MB)	1024
# VNICs	1
VNIC Description	1 x virtio_net
Storage Description	2 x virtio_blk
Virtual Disk Size (MB)	15360
Datastore Size (MB)	20480
VM OS	Red Hat Enterprise Linux 6.0 (64-bit)
VM OS Availability	Nov-2010

Idle Server Configuration Details
JVM Version	1.6.0 IBM J9 2.4 Linux amd64-64 jvmxa6460sr8-20100401_55940
Other Software	N/A

Notes:

Physical System Notes

Firmware settings used:
TurboModeEnable=Enable
TurboBoost=Traditional
HardwarePrefetcher=Disable
Virtualization VTDx=Enable
MemorySpeed=MaxPerformance
ThermalMode=Performance
Power=CappingDisabled
OperatingModes=Custom
TurboBoostPowerOptimization=Traditional

Storage Notes

All storage is accessed with 1 x 8Gb Fibre Channel link. Channel A of DS4800 FC Controller was attached to 5 EXP810 enclosures containing 16 146GB FC disks, 3 EXP810 enclosures containing 16 73GB FC disks each and 2 EXP810 enclosures containing 8 73GB FC disks each. Total FC drive count is 144. There are 14 FC RAID5 LUNS, each consisting of 8 drives. Each LUN contains the VM image and data for one tile, with one exception. Mail Data for all 14 tiles is located on one 32 disk RAID10 array. The hypervisor boot disk is located inside the HS22V and consists of a 2 disk RAID1 array of 50GB SSD disks. Each LUN defined for a Tile is divided into 11 logical volumes (2 per VM, with the exception of the mail-data logical volume) using LVM. The Mail Data LUN is divided into 14 logical volumes. The HS22V connects to the SAN via 1 port on a IBM Qlogic 8Gb Fibre Channel Switch Module. A second connection is configured but is not used.

Virtualization Software Notes

The following boot options were used:
intel_iommu=on iommu=pt
The following services are disabled:
dnsmasq, iptables, ip6tables
Network configuration is as follows:
One software bridge is created, br0 and the second Broadcom
Ethernet port is assigned to the bridge (eth1 to br0). First Broadcom
port is for host access. Every VM's virtIO network device is assigned to br0.
Kernel module for Intel x520 10 Gigabit Server adapter is loaded with
these options to create 124 virtual functions: max_vfs=62,62.
70 of these virtual functions are assigned (one per VM) to the Web, App
DB, Mail and Infra VMs. When a virtual function is present on a VM, a script
is executed to shut down the first virtio_net device and migrate the IP
settings to the virtual function device. This is done to facilitate
easy IP/dns management when using a mix of VMs with and without
virtual functions. The script, convert_to_vf.sh is available in the
disclosure archive. On the host, Ethernet devices eth0 to eth1 are the two physical
functions for the active Intel 10Gbps Ethernet ports. These
are only used by the host to provide physical transport for the virtual functions.
Web, App, Idle, Infra and Mail VMs are launched with nice utility (-1,-6,10,4,4, respectively) to adjust their scheduling priority
All VMs of odd tiles are bound to NUMA node 1 and have a preferred memory allocation node of 1
All VMs of even tiles are bound to NUMA node 0 and have a preferred memory allocation node of 0
All VMs are created with the following command line format (options in [] are for VMs which have PCI device assignment):
/usr/libexec/qemu-kvm -name $name -M rhel6.0.0 -enable-kvm -drive file=$dev1,if=virtio,boot=on,cache=none
-drive file=$dev2,if=virtio,boot=off,cache=none -netdev tap,id=$name,ifname=$name,script=/etc/kvm/qemu-ifup-br0,vhost=off
-device virtio-net-pci,netdev=$name,mac=$macaddr [-pcidevice host=$pcidev] -m $mem -vnc $vnc_port -cpu qemu64,+x2apic
-no-kvm-pit-reinjection -smp $cpus,sockets=$cpus,cores=1,threads=1 -monitor telnet::$monitor_port,server,nowait
-serial telnet::$serial_port,server,nowait -daemonize
After boot, all block I/O devices changed to use deadline I/O scheduler via sysfs interface

Web Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
httpd.conf changes:
KeepAlive on
MaxKeepAliveRequest 0
ServerLimit 10240
MaxClients 10240
MaxRequestsPerChild 1000
CustomLog logs/access_log common
Web VM used NFS to access files from infra VM
No options were specified in the NFS mount
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Application Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
There are two WebSphere profiles, AppSrv01 for SPECjAppServer2004 and AppSrv02 for SPEC Emulator
Heap size for AppSrv01 has been changed to 1280 MB
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Mail Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
Dovecot was compiled with default options and the following dovecot.conf was used:
base_dir = /var/run/dovecot/
ssl = no
disable_plaintext_auth = no
listen = *
log_path = /var/log/dovecot
mail_debug = yes
mail_location = dbox:/mailstore/dovecot/maildir/%u
mdbox_rotate_size = 2048
passdb {
args = /etc/passwd.dovecot
driver = passwd-file
}
protocols = imap
service auth {
user = root
}
service imap-login {
inet_listener imap {
port = 143
}
process_min_avail = 10
}
userdb {
driver = passwd
driver = passwd
}
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Database Server VM Notes

The following boot options were used:
hugepages=416 selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
Database tuning options:
db2 update db cfg for specdb using DATABASE_MEMORY 200000
db2set DB2_LARGE_PAGE_MEM=DB; db2set DB2_PINNED_BP=ON
alter bufferpool IBMDEFAULTBP size 160000
alter tablespace roll_space NO FILE SYSTEM CACHING
alter tablespace C_cust_space NO FILE SYSTEM CACHING
alter tablespace C_supp_space NO FILE SYSTEM CACHING
alter tablespace C_site_space NO FILE SYSTEM CACHING
alter tablespace C_parts_space NO FILE SYSTEM CACHING
alter tablespace C_custinv_space NO FILE SYSTEM CACHING
alter tablespace M_parts_space NO FILE SYSTEM CACHING
alter tablespace M_bom_space NO FILE SYSTEM CACHING
alter tablespace M_wo_space NO FILE SYSTEM CACHING
alter tablespace M_lo_space NO FILE SYSTEM CACHING
alter tablespace M_inv_space NO FILE SYSTEM CACHING
alter tablespace O_cust_space NO FILE SYSTEM CACHING
alter tablespace O_ords_space NO FILE SYSTEM CACHING
alter tablespace O_ordl_space NO FILE SYSTEM CACHING
alter tablespace O_item_space NO FILE SYSTEM CACHING
alter tablespace S_comp_space NO FILE SYSTEM CACHING
alter tablespace S_sc_space NO FILE SYSTEM CACHING
alter tablespace S_po_space NO FILE SYSTEM CACHING
alter tablespace S_site_space NO FILE SYSTEM CACHING
alter tablespace S_supp_space NO FILE SYSTEM CACHING
alter tablespace U_space NO FILE SYSTEM CACHING
update db cfg for specdb using logprimary 64
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000

Infraserver VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
httpd.conf changes:
Listen port to 81
ServerLimit 10240
MaxClients 10240
CustomLog logs/access_log common
/etc/httpd/conf.d/fcgi.conf added:
LoadModule fastcgi_module modules/mod_fastcgi.so
ScriptAlias /fcgi-bin/ /var/www/fcgi-bin/
FastCgiIpcDir /etc/httpd/fastcgi
<Directory /var/www/fcgi-bin>
AllowOverride None
Options +ExecCGI -Includes
SetHandler fastcgi-script
Order allow,deny
Allow from all
</Directory>
AddHandler fastcgi-script fcgi
FastCgiServer /var/www/fcgi-bin/besim_fcgi.fcgi -processes 50
Standard Linux NFS server is enabled to serve files to Web VM
/etc/exports file contains:
/support-download *(rw,no_subtree_check,crossmnt,no_root_squash)
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback
ixgbevf module option used: InterruptThrottleRate=2000
Fcgi package built from Fedora 14 source RPM, which includes patch to compile with GCC 4.4

Idle Server VM Notes

The following boot options were used:
selinux=0 elevator=deadline
The following services are disabled:
atd, avahi-daemon, cgconfig, cron, iptables, ip6tables, iscsi, iscsid, postfix, rhnsd, sysstat
ulimits for nofile and noproc set to 102400
root file-system options: barrier=0
datastore file-system options: noatime,barrier=0,data=writeback

Client Driver Notes

All prime clients are VMs hosted with Red Hat Enterprise Linux 6.0. The first two client systems each host client VMs 1-5 and 6-10, respectively. The third client system hosts prime client VMs 11-14. The fourth client hosts the prime controller. Each VM has 2 vCPUs, and prime client VMs' vCPUs are bound to sibling threads in a processor core. Paravirtual clock is used for all client VMs. 1 virtio_net device, and 1 virtio_blk device are used in all client VMs. For the host systems, there are 6 1Gbps Ethernet ports (Clients 1-3 have 5 ports active, the Prime Controller client has 1 port active) on each physical client. On all clients, the first Ethernet port is used for host access and NFS. The remaining 4 active ports are used for software bridges, up to 1 VMs per bridge. Client VM images are located on a 2 disk RAID1 Array of 73GB SAS disks located inside the host. The Client ports connect into the Network via a CISCO Catalyst 6500 switch, containing a 48-port, Gigabit Ethernet Catalyst 6500 blade.

Other Notes

A CISCO Catalyst 6500 switch containing 2 blades( 1Gb and 10Gb) is used to provide ethernet connectivity between the HS22V and the client systems. The HS22V connects to the Catalyst 6500 switch using 2 10Gb Ethernet ports. Two BNT Virtual Fabric 10Gb Switch Modules provide access to the 10gb adapter ports inside the HS22V. The clients connect to the Catalyst 6500 switch using 15 Gbit Ethernet ports. Two Cisco Catalyst Switch 3110G for IBM BladeCenter switches provide access to the 1Gb on-board Ethernet port in the HS22V.

For questions about this result, please contact the submitter: IBM Corporation

First published at SPEC.org on 23-Feb-2011