Performance

Configuration

Common Workload Notes

SUT Notes

• 1xSmart Array P800 with 512MB cache
• 4xModular Smart Array 50 Enclosures, 1+1 configuration per port
• 1 drive RAID 0 for OS Drive, 7 drives RAID 0 for Log, 40 Drives RAID 0 for fileset
• 8 client subnets connected through 3400cl switch, BeSim directly connected to SUT

Operating System Notes

• net.ipv4.conf.all.rp_filter = 1 #enables source route verification, default 0
• net.ipv4.tcp_timestamps = 0 #turns TCP timestamp support off, default on
• net.ipv4.tcp_max_tw_buckets = 2000000 #set TCP time-wait buckets pool size, default 180000
• net.core.rmem_max = 10000000 #maximum receive socket buffer size, default 131071
• net.core.rmem_default = 10000000 #default receive socket buffer size, default 135168
• net.core.wmem_max = 10000000 #maximum send socket buffer size, default 131071
• net.core.wmem_default = 10000000 #default send socket buffer size, default 135168
• net.core.optmem_max = 10000000 #default 10240, maximum amount of option memory buffers, default 20480
• net.ipv4.tcp_rmem = 30000000 30000000 30000000 #maximum receive socket buffer size, default 131071
• net.ipv4.tcp_wmem = 30000000 30000000 30000000 #maximum TCP write-buffer space allocatable, default 4096 16384 131072
• net.ipv4.tcp_mem=30000000 30000000 30000000 #maximum TCP buffer space allocatable, default 392192 392704 393216
• net.ipv4.tcp_dsack=0 #turns DSACK support off, default on
• net.ipv4.tcp_sack=0 #turns SACK support off, default on
• net.ipv4.tcp_window_scaling=0 #turns TCP window scaling support off, default on
• net.core.somaxconn=40960 #size of listen que for accepting new TCP connections, default 128
• net.core.netdev_max_backlog=300000 #maximum length of the input queues for the processors, default 300
• echo 01 > /proc/irq/82/smp_affinity # bind eth1 irq to processor 1
• echo 02 > /proc/irq/90/smp_affinity # bind eth2 irq to processor 2
• echo 04 > /proc/irq/201/smp_affinity # bind eth3 irq to processor 3
• echo 08 > /proc/irq/209/smp_affinity # bind eth4 irq to processor 4
• echo 05 > /proc/irq/217/smp_affinity # bind eth5,7 irq to processors 1, 3
• echo 0A > /proc/irq/225/smp_affinity # bind eth6,8 irq to processors 4, 4
• TSO enabled on client-data interfaces, default enabled
• txqueuelen set to 60000 on all NIC ports
• ulimit -n 1024000 #sets number of open files, default 1024
• ulimit -u 1000000 #sets number of max user processes, default 131710

Web Server Software Notes

• server_log /var/log/httpd/httpd.log
• validate_static 604800 #static file modification validation, default 0
• vailidate_httpmod -1 #disables HTTP module modification validation, default 0
• keepalive_max 100000 #max keepalive requests on a connection, default 100
• header_etag_on 0 #disables etag header in HTTP replies, default 1
• header_server_on 0 #disables server ehader in HTTP replies, default 1
• tcp_send_buf_size 1048576 #sets socket send buffer size
• direct_io 1 #uses direct IO when possible

JSP Script Engine Notes

• JAVA_OPT=-Xms4g -Xmx4g -Xcompactexplicitgc -Xss512k -d64 -server
• 1 JRock instance to deploy JSP scripts on port 8080
• JRock configuration file (server.xml)
• server_log /var/log/jrock/server.log
• listener 8080 # port to listen for requests
• keepalive_max 0 #max number keepalive requests (0 = unlimited), default 100
• connection_timeout 0 #time a connector will wait to be present (0 = unlimited), default 60sec
• session_timeout 600

HTTP Script Notes

• SPEC-provided JSP scripts used without modification

Client Notes

• TCP/IP registry tuning parameters [HKLMSystemCurrentControlSetServicesTcpipParameters]:
• TcpTimedWaitDelay=0x3c, sets TIME_WAIT parameter to 60 seconds (non-RFC 1122), default is 240
• MaxFreeTwTcbs=400000, sets maximum number of TIME_WAIT tcbs to 400,000
• TcpWindowSize=65535, sets TCP send/receive window size, default 8192

BESIM Notes

• Web Server Configuration
• user nobody #configures the user under which httpd runs
• server_log /var/log/httpd/httpd.log #configures the location of the httpd server log file
• validate_static -1 #defines the modification checking interval for static pages. If -1, no checking is done
• validate_httpmod -1 #disables HTTP module modification validation, default 0
• header_etag_on 0 #disables etag header in HTTP replies, default 1
• header_server_on 0 #disables server header in HTTP replies, Default 1
• accept_max 1 #maximum number of client connections httpd can accept at a time, default 50
• log_buf_size 1048576 #sets access log buffer size, default 65536
• tcp_send_buf_size 1048576 #sets socket send buffer size
• keepalive_max 1000000 #max keepalive requests on a connection, default 100
• connection_timeout 86400 #The number of connection reclaims because they time out.
• worker */81
• worker */81
• worker */81
• worker */81
• host besim:81
• document_root /web
• access_log /var/log/httpd/access_besim.log
• error_log /var/log/httpd/error_besim.log
• access_log_format commonlog
• file /
• index_directory yes
• /file
• file /isapi-bin
• cgi_type isapi
• cgi_where internal
• index_directory yes
• /file
• /host
• BESIM OS Configuration
• ifconfig eth0 txqueuelen 40000
• ulimit -n 1000000 #sets number of open files, default 1024
• ulimit -u 1000000 #sets number of user processes, default 1024
• net.ipv4.ip_forward = 0 # Controls IP packet forwarding
• net.ipv4.conf.default.rp_filter = 1 # Controls source route verification
• net.ipv4.conf.default.accept_source_route = 0 # Do not accept source routing
• kernel.sysrq = 0 # Controls the System Request debugging functionality of the kernel
• kernel.core_uses_pid = 1 # Controls whether core dumps will append the PID to the core filename
• net.ipv4.icmp_echo_ignore_broadcasts = 1 #To enable protection against ICMP ECHO requests
• net.ipv4.conf.all.rp_filter = 1 # Enable IP spoofing protection, turn on source route verification
• net.ipv4.tcp_timestamps = 0 # Turn off the tcp_timestamps
• echo 2000000 > /proc/sys/net/ipv4/tcp_max_tw_buckets #sets TCP time-wait buckets pool size, default 180000
• echo 10000000 > /proc/sys/net/core/rmem_max #maximum receive socket buffer size, default 65535
• echo 10000000 > /proc/sys/net/core/rmem_default #default receive socket buffer size, default 65535
• echo 10000000 > /proc/sys/net/core/wmem_max #maximum send socket buffer size, default 65535
• echo 10000000 > /proc/sys/net/core/wmem_default #default send socket buffer size, default 65535
• echo 10000000 > /proc/sys/net/core/optmem_max #default 10240
• net.core.netdev_max_backlog = 300000 #number of unprocessed input packets before kernel starts dropping them, default 300
• echo 30000000 30000000 30000000 > /proc/sys/net/ipv4/tcp_rmem #maximum TCP write-buffer space allocatable, default 4096 16384 131072
• echo 30000000 30000000 30000000 > /proc/sys/net/ipv4/tcp_wmem #maximum TCP write-buffer space allocatable, default 4096 16384 131072
• echo 30000000 30000000 30000000 > /proc/sys/net/ipv4/tcp_mem #maximum TCP buffer space allocatable, default 31744 32256 32768
• net.core.somaxconn = 40960 #size of listen que for accepting new TCP connections, default 128
• echo 442961 > /proc/sys/fs/file-max #maximum number of open files, default 1024
• Besim ISAPI compile instructions see HP-2006109.txt

Notes for Banking Workload

Operating System Notes

• options e1000 RxDescriptors=4096,4096,4096,4096,4096,4096,4096,4096 TxDescriptors=4096,4096,4096,4096,4096,4096,4096,4096 InterruptThrottleRate=3000,3000,3000,3000,3000,3000,3000,3000 FlowControl=0,0,0,0,0,0,0,0

Web Server Software Notes

• connection_timeout 120 #connection inactivity timeout, default 60
• cache_memory_size 8192 #cache manager memory, default half system memory
• cache_replacement random #random cache replacement
• log_buf_size 1048576 #sets access log buffer size, default 65536
• port_getn 256 #IO evente retrieve from the OS at one time, default 1
• gateway_connection_max 2000 #configures the maximum number of TCP connections between Rock Web Server and a back-end gateway process, default 0
• worker 131.100.100.160/443
• worker 131.101.100.160/443
• worker 131.102.100.160/443
• worker 131.103.100.160/443
• worker 131.104.100.160/443
• worker 131.105.100.160/443
• worker 131.106.100.160/443
• worker 131.107.100.160/443
• host server:443
• ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
• ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
• default_mime_type text/html
• document_root /web
• access_log /var/log/httpd/access443.log
• access_log_format commonlog_binary
• error_log /var/log/httpd/error443.log
• ssl_session_max 847931
• ssl_session_timeout 600
• file /bank
• cgi_type gateway
• cgi_regex .*jsp
• cgi_listener 127.0.0.1/8080
• /file
• /host

JSP Script Engine Notes

• docroot /web/bank
• context_path /bank

Errors for Banking Workload

Quality of Service Errors

•   No QOS Errors Found

Validation Errors

• 4 Validation Errors for Iteration 3  :   130.168.86.1 - login   

• 1 Validation Errors for Iteration 3  :   130.168.86.3 - login   

• 1 Validation Errors for Iteration 3  :   130.168.86.5 - login   

• 8 Validation Errors for Iteration 3  :   130.168.86.13 - login   

• 8 Validation Errors for Iteration 3  :   130.168.86.14 - login   

• 6 Validation Errors for Iteration 3  :   130.168.86.15 - login   

• 1 Validation Errors for Iteration 3  :   130.168.86.16 - login   

• 2 Validation Errors for Iteration 3  :   130.168.86.17 - login   

• 1 Validation Errors for Iteration 3  :   130.168.86.18 - login   

• 5 Validation Errors for Iteration 3  :   130.168.86.19 - login   

• 1 Validation Errors for Iteration 3  :   130.168.86.20 - login   

• 2 Validation Errors for Iteration 3  :   130.168.86.21 - login   

• 3 Validation Errors for Iteration 3  :   130.168.86.22 - login   

• 1 Validation Errors for Iteration 3  :   130.168.86.24 - login   

• 1 Validation Errors for Iteration 3  :   130.168.86.4 - account_summary   

• 2 Validation Errors for Iteration 3  :   130.168.86.5 - account_summary   

• 1 Validation Errors for Iteration 3  :   130.168.86.13 - account_summary   

• 2 Validation Errors for Iteration 3  :   130.168.86.14 - account_summary   

• 4 Validation Errors for Iteration 3  :   130.168.86.15 - account_summary   

• 1 Validation Errors for Iteration 3  :   130.168.86.19 - account_summary   

• 1 Validation Errors for Iteration 3  :   130.168.86.21 - account_summary   

• 1 Validation Errors for Iteration 3  :   130.168.86.24 - account_summary   

• 1 Validation Errors for Iteration 3  :   130.168.86.4 - check_detail_html   

• 2 Validation Errors for Iteration 3  :   130.168.86.6 - check_detail_html   

• 1 Validation Errors for Iteration 3  :   130.168.86.16 - check_detail_html   

• 1 Validation Errors for Iteration 3  :   130.168.86.19 - check_detail_html   

• 2 Validation Errors for Iteration 3  :   130.168.86.21 - check_detail_html   

• 1 Validation Errors for Iteration 3  :   130.168.86.22 - check_detail_html   

• 2 Validation Errors for Iteration 3  :   130.168.86.23 - check_detail_html   

• 1 Validation Errors for Iteration 3  :   130.168.86.1 - bill_pay   

• 2 Validation Errors for Iteration 3  :   130.168.86.2 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.4 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.5 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.9 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.11 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.13 - bill_pay   

• 2 Validation Errors for Iteration 3  :   130.168.86.14 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.15 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.17 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.19 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.21 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.22 - bill_pay   

• 2 Validation Errors for Iteration 3  :   130.168.86.24 - bill_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.1 - payee_info   

• 1 Validation Errors for Iteration 3  :   130.168.86.20 - payee_info   

• 1 Validation Errors for Iteration 3  :   130.168.86.5 - quick_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.14 - quick_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.18 - quick_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.19 - quick_pay   

• 2 Validation Errors for Iteration 3  :   130.168.86.20 - quick_pay   

• 2 Validation Errors for Iteration 3  :   130.168.86.23 - quick_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.24 - quick_pay   

• 1 Validation Errors for Iteration 3  :   130.168.86.15 - billpay_status   

• 1 Validation Errors for Iteration 3  :   130.168.86.23 - billpay_status   

• 1 Validation Errors for Iteration 3  :   130.168.86.14 - chg_profile   

• 1 Validation Errors for Iteration 3  :   130.168.86.19 - chg_profile   

• 1 Validation Errors for Iteration 3  :   130.168.86.21 - chg_profile   

• 1 Validation Errors for Iteration 3  :   130.168.86.22 - chg_profile   

• 1 Validation Errors for Iteration 3  :   130.168.86.6 - post_profile   

• 1 Validation Errors for Iteration 3  :   130.168.86.21 - post_profile   

• 1 Validation Errors for Iteration 3  :   130.168.86.3 - req_checks   

• 1 Validation Errors for Iteration 3  :   130.168.86.16 - req_checks   

• 1 Validation Errors for Iteration 3  :   130.168.86.20 - req_checks   

• 1 Validation Errors for Iteration 3  :   130.168.86.21 - req_checks   

• 1 Validation Errors for Iteration 3  :   130.168.86.5 - post_chk_order   

• 1 Validation Errors for Iteration 3  :   130.168.86.14 - post_chk_order   

• 1 Validation Errors for Iteration 3  :   130.168.86.24 - req_xfer_form   

• 1 Validation Errors for Iteration 3  :   130.168.86.19 - post_fund_xfer   

• 1 Validation Errors for Iteration 3  :   130.168.86.1 - check_image   

• 3 Validation Errors for Iteration 3  :   130.168.86.2 - check_image   

• 1 Validation Errors for Iteration 3  :   130.168.86.3 - check_image   

• 1 Validation Errors for Iteration 3  :   130.168.86.5 - check_image   

• 4 Validation Errors for Iteration 3  :   130.168.86.9 - check_image   

• 3 Validation Errors for Iteration 3  :   130.168.86.13 - check_image   

• 2 Validation Errors for Iteration 3  :   130.168.86.14 - check_image   

• 2 Validation Errors for Iteration 3  :   130.168.86.15 - check_image   

• 1 Validation Errors for Iteration 3  :   130.168.86.18 - check_image   

Notes for Ecommerce Workload

Operating System Notes

• options e1000 RxDescriptors=4096,4096,4096,4096,4096,4096,4096,4096 TxDescriptors=4096,4096,4096,4096,4096,4096,4096,4096 InterruptThrottleRate=1000,1000,1000,1000,1000,1000,1000,1000 FlowControl=0,0,0,0,0,0,0,0

Web Server Software Notes

• connection_timeout 9200 #connection inactivity timeout, default 60
• cache_memory_size 12288 #cache manager memory, default half system memory
• cache_replacement lru #least recent used cache management, default lru
• log_buf_size 1048576 #sets access log buffer size, default 65536
• cache_file_count 128000 # defines the estimated number of static pages for all web server instances, default 27179
• gateway_connection_max 2000 #configures the maximum number of TCP connections between Rock Web Server and a back-end gateway process, default 0
• worker 131.100.100.160/443 131.100.100.160/80
• worker 131.101.100.160/443 131.101.100.160/80
• worker 131.102.100.160/443 131.102.100.160/80
• worker 131.103.100.160/443 131.103.100.160/80
• worker 131.104.100.160/443 131.104.100.160/80
• worker 131.105.100.160/443 131.105.100.160/80
• worker 131.106.100.160/443 131.106.100.160/80
• worker 131.107.100.160/443 131.107.100.160/80
• host server:443
• ssl_key_file /usr/local/httpd/etc/key-cert/ssl.key (RSA 1024Bit length)
• ssl_cert_file /usr/local/httpd/etc/key-cert/ssl.cer (created via admin http)
• default_mime_type text/html
• document_root /web
• access_log /var/log/httpd/access443.log
• access_log_format commonlog_binary
• error_log /var/log/httpd/error443.log
• ssl_session_max 847931
• ssl_session_timeout 600
• file /bank
• cgi_type gateway
• cgi_regex .*jsp
• cgi_listener 127.0.0.1/8080
• /file
• /host
• host server:80
• index_directory yes
• default_mime_type text/html
• document_root /web
• access_log /var/log/httpd/access80.log
• access_log_format commonlog_binary
• error_log /var/log/httpd/error80.log
• file /ecommjsp
• cgi_type gateway
• cgi_listener 127.0.0.1/8080
• /file
• /host

JSP Script Engine Notes

• docroot /web/ecommerce
• context_path /ecommjsp

Errors for Ecommerce Workload

Quality of Service Errors

•   No QOS Errors Found

Validation Errors

•   No Validation Errors Found

Notes for Support Workload

Operating System Notes

• options e1000 RxDescriptors=4096,4096,4096,4096,4096,4096,4096,4096 TxDescriptors=4096,4096,4096,4096,4096,4096,4096,4096 InterruptThrottleRate=1000,1000,1000,1000,1000,1000,1000,1000

Web Server Software Notes

• connection_timeout 9600 #connection inactivity timeout, default 60
• cache_memory_size 16384 #cache manager memory, default half system memory
• cache_replacement lru #least recent used cache management, default lru
• log_buf_size 1048576 #sets access log buffer size, default 65536
• port_getn 256 #IO evente retrieve from the OS at one time, default 1
• direct_io_size 204800 #read buffer size for direckt IO, default 65535
• write_chunk_size 204800 #controls how files in the cache manager are sent to web clients, default 0
• cache_file_max_size 4194304 #The largest static file that can be cached in the cache manager, default 2097152
• gateway_connection_max 2000 #configures the maximum number of TCP connections between Rock Web Server and a back-end gateway process, default 0
• disk_worker_count 68 #number of worker threads used for handling big files outside the cache manager, default 20
• fast_read 1
• worker 131.100.100.160/80
• worker 131.101.100.160/80
• worker 131.102.100.160/80
• worker 131.103.100.160/80
• worker 131.104.100.160/80
• worker 131.105.100.160/80
• worker 131.106.100.160/80
• worker 131.107.100.160/80
• host server:80
• default_mime_type text/html
• document_root /web
• access_log /var/log/httpd/access80.log
• access_log_format commonlog_binary
• error_log /var/log/httpd/error80.log
• file /suppjsp
• cgi_type gateway
• cgi_regex .*jsp
• cgi_listener 127.0.0.1/8080
• /file
• /host

JSP Script Engine Notes

• docroot /web/support
• context_path /suppjsp
• session_count 1

Errors for Support Workload

Quality of Service Errors

•   No QOS Errors Found

Validation Errors

•   No Validation Errors Found