SPEC Seal of Reviewal SPECjEnterprise®2010 Result
Copyright © 2009-2013 Standard Performance Evaluation Corporation
Oracle Weblogic Server Standard Edition Release 12.1.2 and Oracle Database 12c on Oracle Sun Server X4-2
11,259.88 SPECjEnterprise2010 EjOPS
Submitter:
Oracle Corporation		 SPEC license # 73 Test date:
Sep-2013
Software Products
Oracle WebLogic Server Standard Edition Release 12.1.2
Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_40
Oracle JDBC Driver 12.1.0.1(Thin)
Oracle Database 12c Enterprise Edition Release 12.1.0.1
Oracle Grid Infrastructure 12c Release 12.1.0.1 		Software Configurations
Java EE Application Server
Emulator Software Config
Database Software Config
Driver Software Config 		Hardware Systems
Java EE AppServer HW
Database Server HW
Load Driver & Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
JEE Server Nodes: 1   DB Server Nodes: 1
JEE Server CPUs: 24 cores, 2 chips   DB Server CPUs: 24 cores, 2 chips
JEE Instances: 4   DB Instances: 1
Other SUT Components:
   

Benchmark Settings
Dealer Injection Rate: 7,100   Ramp Up Time: 600 seconds
DB Load Injection Rate: 8,000   Steady State Time: 3,600 seconds
# of Dealer Agents: 71,000   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 21,300  

Detailed Results
Dealer Transaction Mix Count Tx. Mix Failure Count
Purchase 6,430,867 24.99% 0
Manage 6,432,800 25.00% 1
Browse 12,869,222 50.01% 0
Total # Dealer Transactions 25,732,889
Manufacturing Transaction Mix Count Tx. Mix Failure Count
CreateVehicleEJB 7,400,830 50.00% 698
CreateVehicleWS 7,401,854 50.00% 678
Total # Manufacturing Transactions 14,802,684
Response Times Average Standard Deviation Maximum 90th% Reqd
Purchase 0.075 0.24 5.415 0.110 2.000
Manage 0.050 0.12 4.744 0.090 2.000
Browse 0.091 0.27 4.414 0.140 2.000
CreateVehicleEJB 0.605 0.42 5.791 0.975 5.000
CreateVehicleWS 0.380 0.24 4.974 0.675 5.000
Reproducibility Run (SPECjEnterprise2010 EjOPS) 11,309.21

Oracle WebLogic Server Standard Edition Release 12.1.2
Vendor: Oracle Corporation Availability: Jul-2013
CTS Version: 6.0 Date Passed CTS: Dec-2011
OS Name: Oracle Linux 5 Update 9 x86_64
EJB Protocol: RMI/T3

Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_40
Vendor: Oracle Corporation Availability: Sep-2013
OS Name: Oracle Linux 5 Update 9 x86_64

Oracle JDBC Driver 12.1.0.1(Thin)
Vendor: Oracle Corporation Availability: Jun-2013
OS Name: Oracle Linux 5 Update 9 x86_64

Oracle Database 12c Enterprise Edition Release 12.1.0.1
Vendor: Oracle Corporation Availability: Jun-2013
OS Name: Oracle Linux 5 Update 9 x86_64

Oracle Grid Infrastructure 12c Release 12.1.0.1
Vendor: Oracle Corporation Availability: Jun-2013
Description: Grid Infrastructure for Automatic Storage Management (ASM)

Java EE Application Server
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.2
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_40
JDBC Product: Oracle JDBC Driver 12.1.0.1(Thin)
Hardware: Java EE AppServer HW
# of Instances: 4
Interfaces:
Web Interface for the Order Domain
Web Services Interface for the Supplier Domain
EJB Interface for the Manufacturing Domain
Web Services Interface for the Manufacturing Domain
Notes / Tuning Information 
-showversion -server -Xms15000m -Xmx15000m -Xmn11000m -Xss256k
-XX:+AggressiveOpts -XX:+UseLargePages -XX:-UseBiasedLocking
-XX:+DisableExplicitGC -XX:+UseParallelOldGC -XX:MaxTenuringThreshold=3
-XX:ParallelGCThreads=12  -XX:+PrintGCTimeStamps -XX:+PrintGCDetails
-XX:PermSize=200m -XX:MaxPermSize=200m -Djava.net.preferIPv4Stack=true
-Djaxws.transport.streaming=true -Dweblogic.ProductionModeEnabled=true
-Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer -Dweblogic.SocketReaders=3
-Dweblogic.management.discover=false -Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Doracle.jdbc.defaultRowPrefetch=200 -Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory

 Server instances were started using numactl to bind 2 instances per chip, then chrt -p 89 was used to run the instances in real time.

Emulator Software Config
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.2
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_40
Hardware: Load Driver & Emulator HW
# of Instances: 4
Notes / Tuning Information 
-showversion -server -Xms10g -Xmx10g -Xmn5g -Xss272k
-XX:PermSize=95m -XX:MaxPermSize=512M -XX:+UseLargePages
-XX:+AggressiveOpts -XX:+DisableExplicitGC -verbosegc -Xloggc:emugc.log
-XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintCommandLineFlags
-XX:-TraceClassUnloading -Djava.net.preferIPv4Stack=true
-Dweblogic.MuxerClass=weblogic.socket.NIOSocketMuxer -Dweblogic.SocketReaders=1
-Dhttp.keepAlive=true -Dhttp.keepAliveCache.lifeTime=6000000 -Dweblogic.management.discover=false
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0

Server instances were started using numactl binding 2 instances per chip.

Database Software Config
DB Product: Oracle Database 12c Enterprise Edition Release 12.1.0.1
Hardware: Database Server HW
# of Instances: 1
Character Set: US7ASCII
Notes / Tuning Information 

db_name                       = specdb
compatible                    = 11.2.0
control_files                 = +DATA/cntrlspecdb
db_4k_cache_size              = 23000M
db_8k_cache_size              = 40000M
db_cache_size                 = 95000M
db_keep_cache_size            = 6000M
shared_pool_size              = 10000M
aq_tm_processes               = 0
db_block_checking             = FALSE
db_block_checksum             = FALSE
db_block_size                 = 2048
db_cache_advice               = OFF
db_file_multiblock_read_count = 128
db_files                      = 256
dml_locks                     = 2200
filesystemio_options          = DirectIO
log_buffer                    = 67108864
log_checkpoint_interval       = 0
log_checkpoints_to_alert      = TRUE
open_cursors                  = 4000
parallel_max_servers          = 100
pga_aggregate_target          = 0
processes                     = 4000
query_rewrite_enabled         = FALSE
replication_dependency_tracking = FALSE
session_cached_cursors        = 4000
sessions                      = 4000
statistics_level              = BASIC
timed_statistics              = FALSE
trace_enabled                 = FALSE
transactions                  = 15000
transactions_per_rollback_segment = 1
undo_management               = AUTO
undo_retention                = 10
undo_tablespace               = undo_ts

Grid Infrastructure was installed to use Oracle ASM for DATA and LOG disk groups

Driver Software Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.7.0_40
Hardware: Load Driver & Emulator HW
# of Instances: 6
Notes / Tuning Information 
-server -Xms2048M -Xmx2048M -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Dhttp.keepAliveCache.lifeTime=600000 -Djava.net.preferIPv4Stack=true
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory

Java EE AppServer HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Server X4-2 OS Name: Oracle Linux 5 Update 9 x86_64
Processor: Intel Xeon processor E5-2697 v2 (Intel Turbo Boost Technology up to 3.5 GHz) Filesystem: ext3
MHz: 2700 Disks: 2x 300GB SAS-2 HDD and 2x 400GB SSD
# of CPUs: 24 cores, 2 chips, 12 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 2x 10Gbit onboard and 2x 10GBit Dual-port NICs
Memory (MB): 262144 Other Hardware:
DIMM[0] Count: 16 DIMM[0] Size: 16384
L1 Cache: 32KB I + 32KB D on chip per core # of Systems: 1
L2 Cache: 256KB(I+D) on chip, per core H/W Available: Sep-2013
Other Cache: 30MB (I+D) on chip per chip OS Available: Jan-2013
Notes / Tuning Information 
Added to /etc/sysctl.conf:
kernel.shmall = 10737418240
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso
Bind interrupt to a core corresponding to the server instance

Server instances were started using numactl binding 1 instance per chip.
Stop iptables.
Stop irqbalance.
Configure 60000 hugepages.

SSDs were used for JMS and server log files.

Database Server HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Server X4-2L OS Name: Oracle Linux 5 Update 9 x86_64
Processor: Intel Xeon processor E5-2697 v2 (Intel Turbo Boost Technology up to 3.5 GHz) Filesystem: ext3
MHz: 2700 Disks: 2x 300GB SAS-2 and 3x Sun Storage 2540 M2 Array
# of CPUs: 24 cores, 2 chips, 12 cores/chip, 2 threads/core (Hyper-Threading) Network Interface: 2x 10GBit onboard and 1x 10Gbit Dual Port NIC
Memory (MB): 262144 Other Hardware: 3x Sun 8Gb FC Dual GbE HBA ExpressModule
DIMM[0] Count: 16 DIMM[0] Size: 16384
L1 Cache: 32KB I + 32KB D on chip per core # of Systems: 1
L2 Cache: 256KB(I+D) on chip, per core H/W Available: Sep-2013
Other Cache: 30MB (I+D) on chip per chip OS Available: Jan-2013
Notes / Tuning Information 
Added to /etc/sysctl.conf:
kernel.shmall = 10737418240
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65535
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso
bind interrupts to all cores in a round-robin mode.

2 Oracle listener processes were started, and each bound to a processor.
Stop iptables.
Stop irqbalance.
Configure 90000 hugepages.

External storage configuration:
3.2 TB on 2x Sun Storage 2540 M2 Array for data files
1.6 TB on 1x Sun Storage 2540 M2 Array for log files

Load Driver & Emulator HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Blade X6270 M2 Server Module OS Name: Oracle Linux 5 Update 7 x86_64
Processor: Intel Xeon X5680 Filesystem: ext3
MHz: 3333 Disks: 2 x 146GB 15K RPM SAS
# of CPUs: 12 cores, 2 chips, 6 cores/chip (2 threads/core) Network Interface: See notes
Memory (MB): 73728 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) per core # of Systems: 7
L2 Cache: 256KB per core H/W Available: Jul-2010
Other Cache: 12 MB I+D L3 on chip per chip OS Available: Jul-2011
Notes / Tuning Information 
Added to /etc/sysctl.conf:
fs.file-max = 524288
kernel.shmall = 10737418240
kernel.shmmax = 68719476736
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
vm.zone_reclaim_mode=1

For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso

6 Systems were used as drivers, each with 1x 10Gbit NIC
1 System was used as Emulator, with 2x 10Gbit NIC and configured with 22500 hugepages

Benchmark Modifications
Schema Modifications: 
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  Table M_WORKORDER, O_ORDERLINE, O_CUSTINVENTORY, S_PURCH_ORDER, and S_PURCH_ORDERLINE were horizontally partitioned.
  Table M_BOM, M_INVENTORY and M_PARTS were hash clustered.
  System managed undo was used.
Load Program Modifications: 
  No modifications to the load programs were made.

Benchmark Configuration Information
Isolation Requirement Info: 
  The ItemEnt bean was cached for 20 minute intervals by setting:
  eclipselink.query-results-cache.expiry=1200000
  in the ord-orm.xml deployment descriptor.
  
  The benchmark meets the isolation level requirements by
  version column checking on entities against
  the database.
Durability Requirement Info: 
  To ensure database durability, RAID 1 was used for the
  database files and database redo logs maintained
  on the Sun Storage 2540 M2 Arrays.
  
  The application server was configured with 2 SSD drives
  configured with RAID 1 for jms and server logs.
Storage Requirement Info: 
  A 75 minute run at an injection rate of 7100 increased storage by 14 GB
  This extrapolates to 268 GB storage for a 24 hour run.
  The database was configured with 4.8 TB of mirrored storage.

Bill of Materials 
Supplier  Description                                   Product #          Qty
--------  -------------------------------------------   ----------------   ---
Application Server
Oracle	   Sun Server X4-2 Base Assembly                 7106599	     1
Oracle	   2.7GHz Intel 12-Core Xeon E5-2697 v2		 7106541	     2
Oracle	   4 by 2.5'' and 1 DVD Disk Cage		 7102740	     1
Oracle	   16GB DDR3-1600 DIMM				 7100733	    16
Oracle	   300GB 10K RPM SAS-2 HDD			 RB-SS2CF-300G10K2   2
Oracle	   400GB 2.5'' SSD 				 7107549	     2
Oracle	   Sun Dual 10 GigE SFP+ PCIe 2.0 NIC		 X1109A-Z	     2
Oracle	   10 GigE Dual Rate SFP+ SR Transceiver, MM	 X2129A		     4
Oracle     Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1

Database Server
Oracle	   Sun Server X4-2L Base Assembly                7106601	     1
Oracle	   2.7GHz Intel 12-Core Xeon E5-2697 v2		 7106541	     2
Oracle	   24 by 2.5'' Disk Cage			 7102742	     1
Oracle     16GB DDR3-1600 DIMM				 7100733	    16
Oracle	   300GB 10K RPM SAS-2 HDD			 RB-SS2CF-300G10K2   2
Oracle	   Sun StorageTek 8Gb FC PCI-E HBA Dual Port	 SG-XPCIE2FC-QF8-N   2
Oracle	   Sun Dual 10 GigE SFP+ PCIe 2.0 NIC		 X1109A-Z	     1
Oracle	   10 GigE Dual Rate SFP+ SR Transceiver, MM	 X2129A		     2
Oracle     Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1

Storage
Oracle     Sun Storage 2540 M2 Array                     7100183	     3
Oracle     300GB 15K RPM SAS-2 HDD			 7100414 	    36
Oracle     AC Power Supply   		                 7100021	     6
Oracle     Power Cords - 2.5m			 	 333A-25-15-NEMA     6
Oracle     Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1

Oracle     Oracle Grid Infrastructure 12c                                    **
Oracle     Oracle Database 12c Enterprise Edition
-          Per Processor for 3 years                                        12*
Oracle     Partitioning, Per Processor for 3 years                          12*
Oracle     Oracle Premium Support for 3 years                                2

Oracle     Oracle WebLogic Server Standard Edition Release 12.1.2
-          Per Processor for 3 years                                        12*
Oracle     Oracle Premium Support for 3 years                                1

(* 12 = 0.5 * 24) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' cores
shall be determined by multiplying 'n' cores by a factor of 0.5.

** Included with Oracle Database 12c Enterprise Edition

Other Benchmark Information 
  DNS round robin load balancing was used. DNS server ran on DB node.
  
  All network connections were 10 Gbps.

General Notes 
The only errors in the driver log files were those that are
normally generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.

For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2009-2013 Standard Performance Evaluation Corporation

First published at SPEC.org on 20-Sep-2013