-------------------------------------------------------------------------------- SPECjAppServer(R)2004 Result Copyright (C) 2004 Standard Performance Evaluation Corporation -------------------------------------------------------------------------------- Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition on HP-UX Integrity BL870c Server Blade Cluster -------------------------------------------------------------------------------- 17,046.40 SPECjAppServer2004 JOPS@Standard -------------------------------------------------------------------------------- Submitter: Oracle Corporation SPEC license # 73 Test date: Aug-2008 -------------------------------------------------------------------------------- SUT CONFIGURATION -------------------------------------------------------------------------------- J2EE Server Nodes: 12 DB Server Nodes: 1 J2EE Server CPUs: 96 cores, 48 chips, 2 cores/chip DB Server CPUs: 112 cores, 56 chips, 2 cores/chip J2EE Instances: 48 DB Instances: 1 Other SUT Components: 2 x HP Integrity rx2660 as DNS server for load balancing HP ProCurve 5304xl (64 RJ-45 10/100/1000 Ports) -------------------------------------------------------------------------------- BENCHMARK SETTINGS -------------------------------------------------------------------------------- Dealer Injection Rate: 10,300 Ramp Up Time: 900 sec # of Dealer Agents: 58 Ramp Down Time: 300 sec # of Manufacturing Agents: 58 Steady State Time: 3,600 sec DB Load Injection Rate: 20,000 Trigger Time: 2,700 sec -------------------------------------------------------------------------------- Detailed Results -------------------------------------------------------------------------------- Dealer Transaction Mix Count Tx. Mix Purchase 9,284,540 25.00% Manage 9,288,038 25.01% Browse 18,571,215 50.00% Total # Dealer Transactions 37,143,793 Total # Manufacturing Transactions 24,223,237 Response Times Average Maximum 90th% Reqd Purchase 0.26 25.02 0.30 2.00 Manage 0.24 27.29 0.40 2.00 Browse 0.30 25.52 0.30 2.00 Manufacturing 1.85 25.31 2.75 5.00 Reproducibility Run (SPECjAppServer2004 JOPS) 17,050.77 -------------------------------------------------------------------------------- SOFTWARE PRODUCTS -------------------------------------------------------------------------------- Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition Vendor: Oracle Corporation Availability Date: Feb-2008 Date Passed CTS: Jan-2006 CTS Version: 1.4 EJB Protocol: ORMI OS Name: HP-UX 11i v3 March 2008 -------------------------------------------------------------------------------- Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0.14) 64 bit Vendor: HP Availability Date: Aug-2008 OS Name: HP-UX 11i v3 March 2008 -------------------------------------------------------------------------------- Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_06 Vendor: Sun Microsystems Availability Date: May-2008 OS Name: Red Hat Enterprise Linux 5 EM64T -------------------------------------------------------------------------------- Oracle JDBC Driver 10.2.0.3 (Thin) Vendor: Oracle Corporation Availability Date: Feb-2007 OS Name: HP-UX 11i v3 March 2008 -------------------------------------------------------------------------------- Oracle Database 11g Enterprise Edition Release 11.1.0.6 with patch for 7254300 Vendor: Oracle Corporation Availability Date: Oct-2008 OS Name: HP-UX 11i v3 March 2008 -------------------------------------------------------------------------------- SOFTWARE CONFIGURATIONS -------------------------------------------------------------------------------- J2EE Application Servers J2EE Product: Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition JVM Product: Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0.14) 64 bit JDBC Product: Oracle JDBC Driver 10.2.0.3 (Thin) Hardware: J2EE AppServer HW # of Instances: 48 Interfaces: Web Interface for the Dealer Domain Web Interface for the Supplier Domain EJB Interface for the Dealer Domain EJB Interface for the Manufacturing Domain EJB Interface for the Supplier Domain Notes / Tuning Information -d64 -XX:+AggressiveHeap -Xmx8g -Xms8g -Xmn2g -XX:PermSize=128m -XX:SurvivorRatio=14 -XX:+ForceMmapReserved -XX:+UseSpinning -XX:CICompilerCount=1 -XX:SchedulerPriorityRange=SCHED_NOAGE -Xverbosegc:file=stdout -XX:-UseHighResolutionTimer -XX:-ZeroTLAB -XX:+ResizeTLAB -XX:AllocatePrefetchStyle=1 -XX:AllocatePrefetchDistance=256 -Doracle.dms.sensors=none -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Djava.nio.channels.spi.SelectorProvider=sun.nio.ch.DevPollSelectorProvider -Doc4j.jms.implementation=oc4j.j2ee.jms -------------------------------------------------------------------------------- Emulator SW Config JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_06 Web Product: Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition Hardware: Primary Load Driver, Satellite Drivers #1-#14 and Emulator # of Instances: 1 Notes / Tuning Information -server -Xms20g -Xmx20g -Xmn800m -Xss128k -XX:MaxPermSize=512M -XX:+AggressiveHeap -XX:+UseParallelGC -XX:ParallelGCThreads=4 -XX:MaxTenuringThreshold=3 -XX:SurvivorRatio=20 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:-TraceClassUnloading -Dsun.net.inetaddr.ttl=1 -Dnetworkaddress.cache.ttl=1 -Doracle.dms.sensors=none -------------------------------------------------------------------------------- Database SW Config DB Product: Oracle Database 11g Enterprise Edition Release 11.1.0.6 with patch for 7254300 Hardware: Database Server HW # of Instances: 1 Notes / Tuning Information Oracle tuning in init.ora: db_name = oc4j control_files = ?/dbs/cntrl_oc4j compatible=10.1.0.0.0 aq_tm_processes=0 cursor_space_for_time = TRUE db_8k_cache_size = 30G db_4k_cache_size = 20G db_keep_cache_size = 6G db_block_checking = FALSE db_block_checksum = FALSE db_block_size = 2048 db_cache_advice = OFF db_cache_size = 60G db_file_multiblock_read_count = 128 db_files = 256 dml_locks = 1000 fast_start_mttr_target=0 hpux_sched_noage=180 java_pool_size=0 job_queue_processes=0 disk_asynch_io=true lock_sga=true log_buffer=100663296 log_checkpoint_interval=0 log_checkpoint_timeout=1500 log_checkpoints_to_alert=TRUE open_cursors = 3000 parallel_max_servers = 128 pga_aggregate_target=0 processes = 8000 query_rewrite_enabled=FALSE replication_dependency_tracking=FALSE sessions = 9000 session_cached_cursors=2000 shared_pool_size =8G sort_area_size=52428800 transactions = 10000 transactions_per_rollback_segment = 1 trace_enabled=FALSE undo_management = AUTO undo_retention = 900 undo_tablespace = undo_ts2 timed_statistics = false statistics_level = basic _array_update_vector_read_enabled=true _collect_undo_stats=false _ksmg_granule_size=33554432 _db_cache_pre_warm=FALSE _db_writer_flush_imu=FALSE _log_event_queues = 4 _rollback_segment_count=6000 _ktu_latches=89 Log writer put into realtime class with /usr/bin/rtprio 127 -PID and put in its own processor set with /usr/sbin/psrset -b Listener was started with Round robin policy to distribute the Oracle client processes to different cells. _hang_detection=0 _diag_adr_enabled=false -------------------------------------------------------------------------------- Driver SW Config Primary and Satellites JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_06 Hardware: Primary Load Driver, Satellite Drivers #1-#14 and Emulator # of Instances: 15 Notes / Tuning Information -Xms2000M -Xmx2000M -Xverify:none -Xloggc:gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+DisableExplicitGC -XX:+UseParallelGC -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Djava.nio.channels.spi.SelectorProvider=sun.nio.ch.DevPollSelectorProvider -------------------------------------------------------------------------------- HARDWARE SYSTEMS -------------------------------------------------------------------------------- J2EE AppServer HW (SUT hardware) Hardware Vendor: HP Model Name: HP BL870c Processor: Dual-core Intel Itanium 9100 MHz: 1600 # of CPUs: 8 cores, 4 chips, 2 cores/chip Memory (MB): 98272 L1 Cache: 16KB(I)+16KB(D) L2 Cache: 1024KB(I)+256KB(D) Other Cache: 2 x 12MB (L3 Cache) OS Vendor: HP OS Name: HP-UX 11i v3 March 2008 Disks: see notes Network Interface: (2) HP PCI-X 1000Mbps Dual-port Built-in Other Hardware: (1) HP 4Gb Dual Port PCIe Fibre Channel Mezzanine # of Systems: 12 H/W Available: Jan-2008 O/S Available: Mar-2008 Notes / Tuning Information Kernel Tunable Entries: TRMSGSZ 65535 create_fastlinks 1 default_disk_ir 1 fs_async 1 hires_timeout_enable 0 lcpu_attr 1 max_async_ports 4096 max_thread_proc 2048 maxdsiz 3221225472 maxfiles 2048 maxfiles_lim 32768 maxssiz 100610048 maxssiz_64bit 1073741824 maxtsiz 1073741824 maxtsiz_64bit 4294967296 maxuprc 2040 msgmnb 65536 msgtql 5120 ninode 150000 nkthread 20000 nproc 5000 npty 200 nstrpty 200 nswapdev 25 semmni 4096 semmns 8192 semmnu 4092 semume 512 shmmax 15000000000 shmmni 520 shmseg 512 swchunk 8192 tcphashsz 32768 vps_ceiling 64 Disk Configuration: Each server has 2 x HP 146GB 10K SAS HDD And 1 x HP StorageWorks EVA for server and JMS logging Each of the AppServer systems connected to EVA Storage Array -------------------------------------------------------------------------------- Database Server HW (SUT hardware) Hardware Vendor: HP Model Name: Superdome Processor: Dual-core Intel Itanium 9000 MHz: 1600 # of CPUs: 112 cores, 56 chips, 2 cores/chip Memory (MB): 523246 L1 Cache: 16KB(I)+16KB(D) L2 Cache: 1024KB(I)+256KB(D) Other Cache: 2x12MB (L3 Cache) OS Vendor: HP OS Name: HP-UX 11i v3 March 2008 Disks: 4x36Gb 15K RPM U320 Network Interface: (7) HP PCI/PCI-X 1000Base-T Dual-port Adapter Other Hardware: See notes # of Systems: 1 H/W Available: Sep-2006 O/S Available: Mar-2008 Notes / Tuning Information Kernel tunable entries: STRMSGSZ 65535 create_fastlinks 1 default_disk_ir 1 fs_async 1 ksi_alloc_max 32768 lcpu_attr 0 max_async_ports 16384 max_thread_proc 32768 maxdsiz 1073741824 maxdsiz_64bit 2147483648 maxfiles 130000 maxfiles_lim 130000 maxssiz 134217728 maxssiz_64bit 1073741824 maxtsiz 1073741824 maxuprc 16384 msgmnb 65536 msgmni 4096 msgtql 4096 ncsize 34816 nflocks 16384 ninode 34816 nkthread 130000 nproc 60000 npty 200 nstrpty 200 nswapdev 25 semmni 8192 semmns 16384 semmnu 8192 semmsl 8192 semume 1024 semvmx 32767 shmmax 4398046511104 shmmni 512 shmseg 512 swchunk 8192 tcphashsz 32768 vps_ceiling 64 Network Tuning: Used default ndd parms (4) HP StorageWorks EVA8100 2C6D Array Each with 112 x 146GB 15K FC HDD and HP StorageWorks SAN Swicth (8) HP 4Gb Dual Port PCI/PCI-X Fibre Channel Adapter -------------------------------------------------------------------------------- Primary Load Driver, Satellite Drivers #1-#14 and Emulator (non-SUT hardware) Hardware Vendor: HP Model Name: Bl685c Processor: Dual-Core AMD Opteron(tm) Processor 8218 MHz: 2600 # of CPUs: 8 cores, 4 chips, 2 cores/chip Memory (MB): 65536 L1 Cache: 64KB(I)+64KB(D) L2 Cache: 1024KB Other Cache: None OS Vendor: Red Hat OS Name: Red Hat Enterprise Linux 5 EM64T Disks: 1x73Gb 15K RPM U320 Network Interface: (2) HP PCI-X 1000Mbps Dual-port Built-in , (1) HP PCI-X 1000Mbps Quad-Port Other Hardware: None # of Systems: 16 H/W Available: Feb-2008 O/S Available: Feb-2008 Notes / Tuning Information Added to /etc/sysctl.conf: fs.file-max = 262144 kernel.sem = 250 32000 100 128 net.core.netdev_max_backlog = 400000 net.core.optmem_max = 30000000 net.core.rmem_default = 30000000 net.core.rmem_max = 30000000 net.core.somaxconn = 40000 net.core.wmem_default = 30000000 net.core.wmem_max = 30000000 net.ipv4.ip_local_port_range = 1024 65000 net.ipv4.tcp_fin_timeout = 10 net.ipv4.tcp_max_syn_backlog = 30000 net.ipv4.tcp_max_tw_buckets = 2000000 net.ipv4.tcp_mem = 30000000 30000000 30000000 net.ipv4.tcp_rmem = 30000000 30000000 30000000 net.ipv4.tcp_timestamps = 0 net.ipv4.tcp_wmem = 30000000 30000000 30000000 For each of the NICs: set arp_announce = 2 set arp_ignore = 1 set txqueuelen 60000 enable tso and gso Configure 12000 hugepages on Emulator. -------------------------------------------------------------------------------- DNS Load Balancer Hardware (SUT hardware) Hardware Vendor: HP Model Name: rx2660 Processor: Intel Itanium 9100 MHz: 1667 # of CPUs: 4 cores, 2 chips, 2 cores/chip Memory (MB): 32746 L1 Cache: 16KB(I)+16KB(D) L2 Cache: 256KB Other Cache: 2 x 9MB (L3 Cache) OS Vendor: HP OS Name: HP-UX 11i v3 March 2008 Disks: 1x73Gb 15K RPM U320 Network Interface: (2) HP PCI/PCI-X 1000Base-T Dual-port Adapter Other Hardware: null # of Systems: 3 H/W Available: Sep-2006 O/S Available: Mar-2008 Notes / Tuning Information Started named -n 16 and put into realtime class with /usr/bin/rtprio 127 -PID -------------------------------------------------------------------------------- BENCHMARK MODIFICATIONS -------------------------------------------------------------------------------- Schema Modifications: Tablespace sizes were increased to support the Injection rate. Scripts to create the DB are included in the FDA. Table and index initrans were modified. The C_CUSTOMER, C_CUSTOMERINVENTORY, M_INVENTORY, M_WORKORDER, O_ORDERLINE, O_ORDERS, S_COMPONENT, S_PURCHASEORDER and S_PURCHASEORDERLINE tables were horizontally partitioned. M_PARTS and M_BOM were hash clustered. Automatic segment space management was used for all tablespaces. System managed undo was used. Table locks were disabled during the run using disable_lock.sql -------------------------------------------------------------------------------- Load Program Modifications: The load program was not modified. BENCHMARK CONFIGURATION INFORMATION -------------------------------------------------------------------------------- Isolation Requirement Info: The following Beans were deployed in READ_COMMITTED mode as per the benchmark requirement: Mfg - AssemblyEnt, BomEnt, ComponentEnt, LargeOrderEnt, PartEnt Orders - ItemEnt Supplier - SupplierCompEnt, SupplierEnt All other beans were deployed using pessimistic locking mode such that all selects including finders are issued with a FOR UPDATE clause in select statement: Corp - CustomerEnt, CustomerInventoryEnt Mfg - InventoryEnt, WorkOrderEnt Orders - OrderEnt, OrderLineEnt Supplier - POEnt, POLineEnt, SComponentEnt Util - SequenceEnt The ItemEnt bean was cached for 20 minute intervals by setting: read-only to true, and time-to-live to 1200000 (ms) in orders-toplink-ejb-jar.xml deployment descriptor. -------------------------------------------------------------------------------- Durability Requirement Info: To ensure database durability, RAID 1 (mirroring) was used for the database Redo logs and datafiles. The application server was using mirrored disks to provide durability for server logs and JMS persistence filestore. The RAID controller on the database and application server machines were configured with Write-Back cache policy supported with battery backed up unit on the controller. -------------------------------------------------------------------------------- Storage Requirement Info: An 80 minute run at an injection rate of 10,300 increased storage by 32.0 GB This extrapolates to 504GB of storage for a 24 hour run. The database is configured with 16TB of durable storage. -------------------------------------------------------------------------------- Argument Passing Semantics: Oracle Application Server 10g uses pass-by-value as required by the EJB specification. BILL OF MATERIALS -------------------------------------------------------------------------------- Supplier Description Product # Qty -------- ------------------------------------------- ---------------- --- HP Integrity BL870c Blade Server AH232A 12 HP 1.60GHz 24MB Itanium Processors AH320A 48 HP 4GB (2 x 2GB) PC2-4200 DDR2 SDRAM DIMMs AD344A 144 HP 146GB SAS 10,000rpm disk drive 418367-B21 24 HP QLogic QMH2462 4Gb FC HBA 403619-B21 12 HP C7000 Enclosure AD361B 3 HP 4Gb Fibre Channel Pass-thru Module 403626-B21 3 HP 1Gb Ethernet Pass-Thru Module 406740-B21 6 HP BladeSystem c7000 Active Cool Fan 412140-B21 30 HP BladeSystem c7000 Power Module 413379-B21 18 HP HP-UX FOE BA531AC 48 HP 3 year 24x7 hardware and software support HA110A3 HP HP Superdome Server Solution A5200A 2 HP 32 processor Superdome Enterprise Server A9834A-429 2 HP 200-240VAC 3 phase, 4 wires, 8 gage cord A9834A-006 2 HP Superdome sx2000 Cell Board for Montecito A9837A-0D1 14 HP 1.6GHz 24MB Itanium 2 9000 A9840A-0D1 56 Itanium dual-core module HP Memory - 16GB high performance DDR2 A9846A-0D1 28 (8x2GB DIMM) HP HP 12 Slot PCI-X Chassis for sx2000 A9836A-0D1 6 HP 4Gb PCI-X DC 64 bit FC HBA A6826A-0D1 16 HP PCI-X 2 port 1000Base-T Gigabit Adptr A7012A-0D1 7 HP HP-UX OE LTU B9429CA-UMG,0D1,AJR 56 HP HP rx2620 1.0G 1.5MB CPU server Solution AB332A 1 Admin console HP 3y 24x7 HW SW Support HA110A3 HP EVA8100 2C6D Array AG701A 4 HP StorageWorks 4/16 Full SAN Switch AG757A 4 HP CV EVA 8k Series Unlimited Lic T5183A 4 HP M5314C FC Drive Enclosure AD542C 8 HP StorageWorks 146GB 15K FC HDD 364621-B23 448 HP 4GB SW Single Pack SFP Transceiver A7446B 64 HP Storage Works LC/LC 2m Cable 221692-B21 54 HP 24A High Voltage US/JP Modular PDU 252663-D72 8 HP Universal Rack 10642 G2 Shock Rack AF002A 4 HP 10K G2 600W Stabilizer Kit AF062A 4 HP 10642 G2 Sidepanel Kit AF054A 4 HP CV EVA 7.0 Rep Sol Mgr 3.0 Media Kit T3724E 1 HP Stor Essen Std Ed SRM Media Kit T5314AA 1 HP Stor Essen Std Ed SRM LTU T5315AA 1 HP 3y Proactive 24 Service HA111A 4 HP EVA 6100 - Model 2C4D Base AD556C 1 2 x HSV200-B controllers 4 x M5314C Disk Enclosures HP StorageWorks 146GB 15K FC HDD 364621-B23 56 HP HP rx2660 1.6GHz/18MB 4-core AD245A-003 3 HP rx2660 PCI-X 3 slot cage option AD246A 3 HP 4GB DDR2 memory pair (2 x 2GB DIMMs) AD275A 12 HP 36GB 10K RPM drives AD140A 3 HP Dual port 1000BaseT LAN adapter card A7012A 3 HP HP-UX Integrity FOE w/Sys 2 Proc PCL LTU B9430AC 12 HP 3 year 24x7 hardware and software support HA110A3 HP HP ProCurve 5304xl Switch 24 Port Module J8702-61001 3 Oracle Oracle Database 11g Enterprise Edition, 56* Per Processor, Unlimited Users for 3 years Oracle Partitioning, Per Processor, Unlimited Users for 3 years 56* Oracle Oracle Database Server Support Package for 3 years 1 Incident Server Support -(24x7x4) Oracle Oracle Application Server 10g - Java Edition, Per Processor 48* Oracle Oracle Application Server Support Package for 3 years 12 - Incident Server Support -Package - (24x7x4) (* 56 = 0.50 * 112) & (48= 0.50*96). Explanation: For the purposes of counting the number of processors which require licensing, an Intel multicore chip with "n" cores shall be determined by multiplying "n" cores by a factor of 0.50). -------------------------------------------------------------------------------- OTHER BENCHMARK INFORMATION -------------------------------------------------------------------------------- The xerces implementation version 2.6.2 from xml.apache.org was used as it comes packaged with Oracle Application Server 10g. Requests were sent to different Appservers using DNS round robin, with DNS servers running on the DNS load balancer hardware. The driver used the following jndi.properties: java.naming.factory.initial=com.evermind.server.rmi.RMIInitialContextFactory java.naming.provider.url=ormi://main.specj.com:23791/SPECjAppServer java.naming.security.principal=oc4jadmin java.naming.security.credentials=welcome oracle.j2ee.rmi.loadBalance=lookup -------------------------------------------------------------------------------- General Notes -------------------------------------------------------------------------------- The only errors in the driver error logs are the application errors generated by this benchmark and those caused by network contention during the benchmark's initial ramp up period. On the database, incremental checkpointing ensured that no buffer will remain dirty (in the cache) for more than the allowed time. Oracle Application Server 10g Release 10.1.3.3.2 implements Recoverable Last Resource Commit optimization where one and only one SinglePhaseResource participates in a global transaction with one or more XAResources. This is accomplished by emulating an XAResource to represent the 1PC resource. The transaction manager takes the following steps when it receives a request to commit a global transaction that includes one emulated XAResource: 1. It invokes a prepare call on each of the 2PC resources. 2. If all of the 2PC resources are successfully prepared, then commit (one-phase) is called and the commit record is written to the commit-log, on the emulated XA resource (database) as part of the local transaction. 3. If the 1PC on the emulated XA resource completes successfully, then the transaction manager calls commit on each of the 2PC resources. or: If the 1PC on the emulated XA resource fails, then the transaction manager queries the commit-log for transaction outcome. If the record exists, 2PC resources are committed, otherwise 2PC Resources are aborted. Transaction outcome after a single point of failure is guaranteed by the presence of the commit-record in the commit log, indicating a successful transaction completion; while a missing commit-record signifies abort. The commit record is deleted lazily after the global transaction has committed. -------------------------------------------------------------------------------- For questions about this result, please contact the submitter: Oracle Corporation For other inquiries, please contact SPEC - Benchmark run on Tue Aug 26 21:02:32 PDT 2008 by SPECjAppServer2004 v1.08 - Result submitted on Wed Aug 27 03:33:02 EDT 2008 - Report generated by SPECjAppServer2004 Reporter v1.03 Copyright (C) 2004 Standard Performance Evaluation Corporation