SPEC Seal of Reviewal SPECjEnterprise®2010 Result
Copyright © 2009-2013 Standard Performance Evaluation Corporation
Oracle Weblogic Server Standard Edition Release 12.1.2 and Oracle Database 12c on Oracle SPARC T5-8 using Oracle VM Server for SPARC
36,571.36 SPECjEnterprise2010 EjOPS
Submitter:
Oracle Corporation
SPEC license # 73 Test date:
Sep-2013
Software Products
Oracle WebLogic Server Standard Edition Release 12.1.2
Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_25
Oracle JDBC Driver 12.1.0.1(Thin)
Oracle Database 12c Enterprise Edition Release 12.1.0.1
Oracle Grid Infrastructure 12c Release 12.1.0.1
Software Configurations
Java EE Application Server
Emulator Software Config
Database Software Config
Driver Software Config
Hardware Systems
Java EE AppServer & Database Server HW
Load Driver & Emulator HW

System Configuration Diagram

Benchmark
Modifications
Configuration
Bill of Materials
Other Info
General Notes
Full Disclosure Archive

SUT Configuration
JEE Server Nodes: 1   DB Server Nodes: 1
JEE Server CPUs: 80 cores, 5 chips   DB Server CPUs: 48 cores, 3 chips
JEE Instances: 10   DB Instances: 1
Other SUT Components:
   1x Sun 10 Gigabit Ethernet 72-port Switch

Benchmark Settings
Dealer Injection Rate: 23,000   Ramp Up Time: 900 seconds
DB Load Injection Rate: 30,000   Steady State Time: 3,600 seconds
# of Dealer Agents: 230,000   Ramp Down Time: 300 seconds
# of Manufacturing Agents: 69,000  

Detailed Results
Dealer Transaction Mix Count Tx. Mix Failure Count
Purchase 20,791,731 24.99% 16
Manage 20,802,502 25.01% 7
Browse 41,592,956 50.00% 0
Total # Dealer Transactions 83,187,189
Manufacturing Transaction Mix Count Tx. Mix Failure Count
CreateVehicleEJB 24,229,338 49.99% 6,412
CreateVehicleWS 24,240,384 50.01% 6,357
Total # Manufacturing Transactions 48,469,722
Response Times Average Standard Deviation Maximum 90th% Reqd
Purchase 0.279 0.64 13.306 0.600 2.000
Manage 0.178 0.32 15.225 0.390 2.000
Browse 0.342 0.72 13.105 0.800 2.000
CreateVehicleEJB 0.341 0.30 7.297 0.750 5.000
CreateVehicleWS 0.227 0.15 6.400 0.400 5.000
Reproducibility Run (SPECjEnterprise2010 EjOPS) 36,623.50

Oracle WebLogic Server Standard Edition Release 12.1.2
Vendor: Oracle Corporation Availability: Jul-2013
CTS Version: 6.0 Date Passed CTS: Dec-2011
OS Name: Solaris 11.1 64-bit
EJB Protocol: RMI/T3

Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_25
Vendor: Oracle Corporation Availability: Jun-2013
OS Name: Solaris 11.1 64-bit

Oracle JDBC Driver 12.1.0.1(Thin)
Vendor: Oracle Corporation Availability: Jun-2013
OS Name: Solaris 11.1 64-bit

Oracle Database 12c Enterprise Edition Release 12.1.0.1
Vendor: Oracle Corporation Availability: Jun-2013
OS Name: Solaris 11.1 64-bit

Oracle Grid Infrastructure 12c Release 12.1.0.1
Vendor: Oracle Corporation Availability: Jun-2013
Description: Grid Infrastructure for Automatic Storage Management (ASM)

Java EE Application Server
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.2
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_25
JDBC Product: Oracle JDBC Driver 12.1.0.1(Thin)
Hardware: Java EE AppServer & Database Server HW
# of Instances: 10
Interfaces:
Web Interface for the Order Domain
Web Services Interface for the Supplier Domain
EJB Interface for the Manufacturing Domain
Web Services Interface for the Manufacturing Domain
Notes / Tuning Information
JVM Options:
-d64 -server -XX:AllocatePrefetchDistance=256 -XX:AllocatePrefetchStyle=1
-Xms14g -Xmx14g -Xmn11g -Xss256k -XX:MaxPermSize=256m -XX:+AggressiveOpts
-XX:+UseParallelGC -XX:ParallelGCThreads=24 -verbose:gc -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps -XX:-TraceClassUnloading -XX:+UseParallelOldGC
-XX:ReservedCodeCacheSize=64m -XX:CICompilerCount=8 -XX:+UseCompressedOops
-XX:-UseBiasedLocking -XX:+AlwaysPreTouch -XX:InitialSurvivorRatio=4
-XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:-UseAdaptiveSizePolicy
-XX:LargePageSizeInBytes=2g
-Dweblogic.MuxerClass=weblogic.socket.DevPollSocketMuxer -Dweblogic.SocketReaders=16
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true -Doracle.jdbc.defaultRowPrefetch=200
-Dweblogic.management.discover=false -Dweblogic.llr.table.specjds=wl_llr_jent31
-Djavax.xml.parsers.DocumentBuilderFactory=weblogic.xml.jaxp.RegistryDocumentBuilderFactory
-Dweblogic.threadpool.MinPoolSize=30 -Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/sparcv9/libumem.so


Emulator Software Config
JEE Product: Oracle WebLogic Server Standard Edition Release 12.1.2
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_25
Hardware: Load Driver & Emulator HW
# of Instances: 10
Notes / Tuning Information
JVM Options:
-d64 -server -Xms20g -Xmx20g -Xmn3g -Xss256k -XX:+AggressiveOpts
-XX:+UseParallelGC -XX:ParallelGCThreads=32 -XX:LargePageSizeInBytes=4m
-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:-TraceClassUnloading
-XX:PermSize=256m -XX:MaxPermSize=512M -XX:+UseCompressedOops
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0 -Dhttp.keepAliveCache.lifeTime=600000
-Dweblogic.management.discover=false -Dweblogic.SocketReaders=1
-Dweblogic.diagnostics.debug.DebugLogger.DISABLED=true

Java process started in FX class using /usr/bin/priocntl -e -c FX
Java process started with LD_PRELOAD_64=/usr/lib/amd64/libumem.so


Database Software Config
DB Product: Oracle Database 12c Enterprise Edition Release 12.1.0.1
Hardware: Java EE AppServer & Database Server HW
# of Instances: 1
Character Set: US7ASCII
Notes / Tuning Information
Database Options:

db_name                         = spec
control_files                   = +DATA/cntrlspec
cpu_count                       = 128
aq_tm_processes                 = 0
compatible                      = 12.1.0.1.0.0
db_block_size                   = 2048
db_block_checksum               = FALSE
db_block_checking               = FALSE
db_cache_size                   = 14G
db_cache_advice                 = off
db_4k_cache_size                = 10G
db_8k_cache_size                = 4G
db_keep_cache_size              = 10G
db_recycle_cache_size           = 1G
db_file_multiblock_read_count   = 128
db_files                        = 256
db_writer_processes             = 32
deferred_segment_creation       = false
ddl_lock_timeout                = 30
disk_asynch_io                  = TRUE
dml_locks                       = 1000
filesystemio_options            = setall
log_buffer                      = 100663296
log_checkpoint_interval         = 0
log_checkpoints_to_alert        = TRUE
open_cursors                    = 2400
parallel_max_servers            = 100
processes                       = 8000
query_rewrite_enabled           = FALSE
replication_dependency_tracking = FALSE
sessions                        = 12000
shared_pool_size                = 16G
statistics_level                = BASIC
timed_statistics                = false
trace_enabled                   = false
transactions                    = 12000
transactions_per_rollback_segment = 1
undo_management                 = AUTO
undo_retention                  = 600
undo_tablespace                 = undo_ts

Grid Infrastructure was installed to use Oracle ASM for DATA and LOG disk groups.
Oracle database processes run in 5 processors sets within a
logical domain configured on 3 cpu chips (47 cores)
using Oracle VM for SPARC. One core from the first
cpu chip was reserved for the primary domain.
Each processor set was configured with 8 cores (64 strands).
Each process run in the FX class using /usr/bin/priocntl -s -c FX -i pid PID.
Oracle Log Writer run in a single core by executing
in FX class at priority 60 using the command
/usr/bin/priocntl -s -c FX -p 60 -m 60 -i PID.
The remaining cores were used for HBA and Network interrupts.
The Solaris 11.1 logical domain configuration is in the FDA.

Driver Software Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Solaris, version 1.7.0_25
Hardware: Load Driver & Emulator HW
# of Instances: 16
Notes / Tuning Information
JVM Options
-d64 -server -Xms6400M -Xmx6400M -Xss256k -Dsun.net.inetaddr.ttl=0
-Dnetworkaddress.cache.ttl=0 -Djava.net.preferIPv4Stack=true -verbosegc
-Dhttp.keepAliveCache.lifeTime=600000 -XX:+PrintFlagsFinal
-Dcom.sun.xml.ws.spi.db.BindingContextFactory=com.sun.xml.ws.db.glassfish.JAXBRIContextFactory
-Djavax.xml.bind.JAXBContext=com.sun.xml.bind.v2.ContextFactory


Java EE AppServer & Database Server HW (SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: SPARC T5-8 OS Name: Oracle Solaris 11.1 64-bit SRU 10.5
Processor: SPARC T5 Filesystem: ZFS
MHz: 3600 Disks: 4x 300GB 10K RPM SAS, 4x 100GB SDD
# of CPUs: 128 cores, 8 chips, 16 cores/chip (128 HW threads/chip) Network Interface: 9x 10 Gbit dual-port NICs
Memory (MB): 2097152 Other Hardware: 6x Sun 8Gb FC dual-Port HBA
DIMM[0] Count: 128 DIMM[0] Size: 16384
L1 Cache: 16KB(I)+16KB(D) per core # of Systems: 1
L2 Cache: 128 KB (I+D) per core H/W Available: Mar-2013
Other Cache: 8 MB (I+D) per chip OS Available: Aug-2013
Notes / Tuning Information
Tuning in Primary Domain:
Network Tuning:
ndd -set /dev/udp udp_recv_hiwat 2097152
ndd -set /dev/udp udp_xmit_hiwat 2097152
1x 10 Gbit NIC port was used for DNS requests.
Stop intrd.
Solaris 11.1 Support Repository Update 10.5
Configuration Notes:
Application Servers were configured on 5 processors (80 cores) running 10 Solaris zones.
DB server was configured using 47 cores from 3 processors
One core from one processor ran the primary domain.

Tuning in Appserver Domain:
/etc/system:
set autoup = 345600
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000
Tuning in /kernel/drv/ixgbe.conf:
ixgbe[4/5/6/7/12]: intr_throttling=3000
ixgbe[0/1/10/11/13]: intr_throttling=1000
Configuration Notes:
10 application server instances were hosted in 10 separate Solaris Zones.
On each chip, 2 zones were bound to a single processor set where
each processor set consisted of 116 HW strands.
The default processor set consisting of 60 HW strands from all 5 chips
was used for network processing.
The Solaris Zone and processor set configuration is in the FDA.
Each Solaris Zone on the system was configured with 2 subnets.
5x 10 Gbit NIC ports were used by 10 zones for driver requests.
5x 10 Gbit NIC ports were used by 10 zones for database access.
Interrupts from the Network controllers were configured across the
processors in the appserver zones using the /usr/sbin/pcitool utility.
Stop intrd.
Solaris 11.1 Support Repository Update 10.5

Tuning in Database Domain:
/etc/system:
set autoup = 345600
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 10000
Configuration Notes:
Oracle database runs in a logical domain configured with 3 cpu chips (47 cores).
External Disk configuration:
6x Sun Server X3-2L each configured with 4x F40 Flash PCI Cards
and COMSTAR software used for database files.
2x 2540 M2 Storage Arrays each configured with 12x 600GB disks
and 2x RAID controllers
The COMSTAR configuration for the database files is in the FDA
5x 10 Gbit NIC ports were used for database access.
Interrupts from the HBAs and Network controllers were configured across
the processors using the /usr/sbin/pcitool utility.
Stop intrd.
Solaris 11.1 Support Repository Update 10.5


Load Driver & Emulator HW (non-SUT hardware)
Hardware Vendor: Oracle Corporation OS Vendor: Oracle Corporation
Model Name: Sun Fire X4170 M2 OS Name: Solaris 10 9/10 64-bit
Processor: Intel Xeon X5670 Filesystem: UFS
MHz: 2930 Disks: 2 x 146GB 15K RPM SAS
# of CPUs: 12 cores, 2 chips, 6 cores/chip (2 threads/core) Network Interface: 1x 10 Gbit NIC
Memory (MB): 98304 Other Hardware: none
L1 Cache: 32KB(I)+32KB(D) per core # of Systems: 21
L2 Cache: 256KB per core H/W Available: Jul-2010
Other Cache: 8 MB I+D L3 on chip per chip OS Available: Sep-2010
Notes / Tuning Information
Tuning in /etc/system:
set ddi_msix_alloc_limit=8
set ip:ip_soft_rings_cnt=16
Network Tuning:
ndd -set /dev/tcp tcp_conn_req_max_q 40000
ndd -set /dev/tcp tcp_conn_req_max_q0 40000
ndd -set /dev/tcp tcp_xmit_hiwat 524288
ndd -set /dev/tcp tcp_recv_hiwat 524288
ndd -set /dev/tcp tcp_smallest_anon_port 4096
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_time_wait_interval 10000
Configuration Notes:
16 Driver instances ran on 16 systems.
10 Emulator instances ran on 5 systems.


Benchmark Modifications
Schema Modifications:
  Tablespace sizes were increased to support the Injection rate.
  Scripts to create the DB are included in the FDA.
  Table and index initrans were modified.
  Table M_WORKORDER, O_CUSTINVENTORY, O_CUSTOMER, O_ORDERLINE and O_ORDERS were horizontally partitioned.
  Table M_BOM, M_INVENTORY and M_PARTS were hash clustered.
  System managed undo was used.
Load Program Modifications:
  No modifications to the load programs were made.

Benchmark Configuration Information
Isolation Requirement Info:
  The ItemEnt bean was cached for 20 minute intervals by setting:
  eclipselink.query-results-cache.expiry=1200000
  in the ord-orm.xml deployment descriptor.
  
  The benchmark meets the isolation level requirements by
  version column checking on entities against
  the database.
Durability Requirement Info:
  To ensure database durability, RAID 1 was used for the
  database files and database redo logs maintained
  on the Sun Server 3X-2L storage servers and 2540 M2 arrays.
  
  The application server domain was configured with 2
  mirrored SSDs for jms and server logs.
Storage Requirement Info:
  An 80 minute run at an injection rate of 23000 increased storage by 60 GB
  This extrapolates to 1088 GB storage for a 24 hour run.
  The database was configured with 11.6 TB of mirrored storage.
  

Bill of Materials
Supplier  Description                                   Product #          Qty
--------  -------------------------------------------   ----------------   ---
Application & Database Server:
Oracle    SPARC T5-8 Server, Base Chassis               7104192             1
Oracle    SPARC T5 Processor Module 2xT5 16C 3.6GHz	7104194		    4
Oracle    16GB DDR3 Memory DIMM				7104198		  128
Oracle    300 GB 10K RPM SAS HDD                        7105211		    4
Oracle    100 GB SSD                                    7101422             4
Oracle    8GB PCI-E Dual FC/GbE Host Adapter            SG-PCIE2FC-EM8-Z    6
Oracle    10GBE Dual Port SFP+                          1109A-Z             9
Oracle    10 GigE Dual Rate SFP+ SR Transceiver, MMF    2129A              15
Oracle    Power Cord: North America, 4 meter		SELY9P11Z	    4

Storage Servers:
Oracle    Sun Server X3-2L, base chassis                7102750		    6
Oracle    12 Slot Disk cage                             7102743             6
Oracle    2.4 Ghz Intel Xeon E5-2609                    7100604            12
Oracle    8 GB DIMM DDR3                                7100790            12
Oracle    600 GB 10K RPM SAS HDD                        XRA-SS2CF-600G10K2 12
Oracle    Sun Storage 6 Gb SAS PCIe HBA                 SGX-SAS6-INT-Z      6
Oracle    Sun StorageTek 8 Gb FC PCIe HBA               SG-PCIE2FC-EM8-N    6
Oracle    Sun Flash Accelerator F40 PCIe Card		7104482		   24
Oracle    Power Cords - 2.5m				333A-25-15-NEMA	   12
Oracle    Solaris 11.1                                  7100734             1

Oracle    Sun Storage 2540-M2 Array			7100183		    2
Oracle    AC Power Supply   		                7100021		    4
Oracle    600 GB 15K RPM SAS2 HDD			7100415		   24
Oracle    Power Cords - 2.5m				333A-25-15-NEMA	    4

Switch Hardware:
Oracle    Sun 10 Gigabit Ethernet Switch with 72 ports  X2074A-F            1
Oracle    QSFP to 4x SFP+ Splitter Cable                2125A-3M            4

Oracle    Oracle Premier Support for Systems 3 years    Q-PREM-SPRT-SYS     1

Oracle    Oracle Grid Infrastructure 12c                                    **
Oracle    Oracle Database 12c Enterprise Edition
-         Per Processor, for 3 years                                       24*
Oracle    Oracle Partitioning
-         Per Processor, for 3 years                                       24*
Oracle    Oracle Premium Support for 3 years                                2

Oracle    Oracle WebLogic Server Standard Edition Release 12.1.2
-         Per Processor for 3 years                                        40*
Oracle    Oracle Premium Support for 3 years                                1

(* 24 = 0.5 * 48) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' core
shall be determined by multiplying 'n' cores by a factor of 0.5.

(* 40 = 0.5 * 80) Explanation:  For the purposes of counting
the number of processors which require licensing, a multicore chip with 'n' core
shall be determined by multiplying 'n' cores by a factor of 0.5.

** Included with Oracle Database 12c Enterprise Edition


Other Benchmark Information
  DNS round robin load balancing was used with the DNS server running
  on the primary domain of the T5-8 server. The DNS named processes
  was run in the RT class using /usr/bin/priocntl -s -c RT -p 1 -i pid.
  All network connections were 10 Gbit.
  

General Notes
The only errors in the driver log files were those that are
normally generated by this benchmark.

On the database, incremental checkpointing ensured that no buffer will
remain dirty (in the cache) for more than the allowed time.



For questions about this result, please contact the submitter: Oracle Corporation
For other inquiries, please contact webmaster@spec.org

Copyright © 2009-2013 Standard Performance Evaluation Corporation

First published at SPEC.org on 20-Sep-2013