--------------------------------------------------------------------------------
SPECjAppServer(R)2004 Result
Copyright (C) 2004 Standard Performance Evaluation Corporation
--------------------------------------------------------------------------------
Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition on HP-UX
Integrity BL870c Server Blade Cluster
--------------------------------------------------------------------------------
17,046.40 SPECjAppServer2004 JOPS@Standard
--------------------------------------------------------------------------------
Submitter: Oracle Corporation
SPEC license # 73
Test date: Aug-2008
--------------------------------------------------------------------------------
SUT CONFIGURATION
--------------------------------------------------------------------------------
J2EE Server Nodes: 12 DB Server Nodes: 1
J2EE Server CPUs: 96 cores, 48 chips, 2 cores/chip DB Server CPUs: 112 cores, 56 chips, 2 cores/chip
J2EE Instances: 48 DB Instances: 1
Other SUT Components:
2 x HP Integrity rx2660 as DNS server for load balancing
HP ProCurve 5304xl (64 RJ-45 10/100/1000 Ports)
--------------------------------------------------------------------------------
BENCHMARK SETTINGS
--------------------------------------------------------------------------------
Dealer Injection Rate: 10,300 Ramp Up Time: 900 sec
# of Dealer Agents: 58 Ramp Down Time: 300 sec
# of Manufacturing Agents: 58 Steady State Time: 3,600 sec
DB Load Injection Rate: 20,000 Trigger Time: 2,700 sec
--------------------------------------------------------------------------------
Detailed Results
--------------------------------------------------------------------------------
Dealer Transaction Mix Count Tx. Mix
Purchase 9,284,540 25.00%
Manage 9,288,038 25.01%
Browse 18,571,215 50.00%
Total # Dealer Transactions 37,143,793
Total # Manufacturing Transactions 24,223,237
Response Times Average Maximum 90th% Reqd
Purchase 0.26 25.02 0.30 2.00
Manage 0.24 27.29 0.40 2.00
Browse 0.30 25.52 0.30 2.00
Manufacturing 1.85 25.31 2.75 5.00
Reproducibility Run (SPECjAppServer2004 JOPS) 17,050.77
--------------------------------------------------------------------------------
SOFTWARE PRODUCTS
--------------------------------------------------------------------------------
Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition
Vendor: Oracle Corporation
Availability Date: Feb-2008
Date Passed CTS: Jan-2006
CTS Version: 1.4
EJB Protocol: ORMI
OS Name: HP-UX 11i v3 March 2008
--------------------------------------------------------------------------------
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0.14) 64 bit
Vendor: HP
Availability Date: Aug-2008
OS Name: HP-UX 11i v3 March 2008
--------------------------------------------------------------------------------
Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_06
Vendor: Sun Microsystems
Availability Date: May-2008
OS Name: Red Hat Enterprise Linux 5 EM64T
--------------------------------------------------------------------------------
Oracle JDBC Driver 10.2.0.3 (Thin)
Vendor: Oracle Corporation
Availability Date: Feb-2007
OS Name: HP-UX 11i v3 March 2008
--------------------------------------------------------------------------------
Oracle Database 11g Enterprise Edition Release 11.1.0.6 with patch for 7254300
Vendor: Oracle Corporation
Availability Date: Oct-2008
OS Name: HP-UX 11i v3 March 2008
--------------------------------------------------------------------------------
SOFTWARE CONFIGURATIONS
--------------------------------------------------------------------------------
J2EE Application Servers
J2EE Product: Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition
JVM Product: Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0.14) 64 bit
JDBC Product: Oracle JDBC Driver 10.2.0.3 (Thin)
Hardware: J2EE AppServer HW
# of Instances: 48
Interfaces:
Web Interface for the Dealer Domain
Web Interface for the Supplier Domain
EJB Interface for the Dealer Domain
EJB Interface for the Manufacturing Domain
EJB Interface for the Supplier Domain
Notes / Tuning Information
-d64 -XX:+AggressiveHeap -Xmx8g -Xms8g -Xmn2g -XX:PermSize=128m -XX:SurvivorRatio=14
-XX:+ForceMmapReserved -XX:+UseSpinning -XX:CICompilerCount=1
-XX:SchedulerPriorityRange=SCHED_NOAGE -Xverbosegc:file=stdout
-XX:-UseHighResolutionTimer -XX:-ZeroTLAB -XX:+ResizeTLAB
-XX:AllocatePrefetchStyle=1 -XX:AllocatePrefetchDistance=256
-Doracle.dms.sensors=none -Dsun.net.inetaddr.ttl=0
-Dnetworkaddress.cache.ttl=0
-Djava.nio.channels.spi.SelectorProvider=sun.nio.ch.DevPollSelectorProvider
-Doc4j.jms.implementation=oc4j.j2ee.jms
--------------------------------------------------------------------------------
Emulator SW Config
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_06
Web Product: Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition
Hardware: Primary Load Driver, Satellite Drivers #1-#14 and Emulator
# of Instances: 1
Notes / Tuning Information
-server -Xms20g -Xmx20g -Xmn800m -Xss128k -XX:MaxPermSize=512M -XX:+AggressiveHeap
-XX:+UseParallelGC -XX:ParallelGCThreads=4 -XX:MaxTenuringThreshold=3
-XX:SurvivorRatio=20 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
-XX:-TraceClassUnloading -Dsun.net.inetaddr.ttl=1 -Dnetworkaddress.cache.ttl=1
-Doracle.dms.sensors=none
--------------------------------------------------------------------------------
Database SW Config
DB Product: Oracle Database 11g Enterprise Edition Release 11.1.0.6 with patch for 7254300
Hardware: Database Server HW
# of Instances: 1
Notes / Tuning Information
Oracle tuning in init.ora:
db_name = oc4j
control_files = ?/dbs/cntrl_oc4j
compatible=10.1.0.0.0
aq_tm_processes=0
cursor_space_for_time = TRUE
db_8k_cache_size = 30G
db_4k_cache_size = 20G
db_keep_cache_size = 6G
db_block_checking = FALSE
db_block_checksum = FALSE
db_block_size = 2048
db_cache_advice = OFF
db_cache_size = 60G
db_file_multiblock_read_count = 128
db_files = 256
dml_locks = 1000
fast_start_mttr_target=0
hpux_sched_noage=180
java_pool_size=0
job_queue_processes=0
disk_asynch_io=true
lock_sga=true
log_buffer=100663296
log_checkpoint_interval=0
log_checkpoint_timeout=1500
log_checkpoints_to_alert=TRUE
open_cursors = 3000
parallel_max_servers = 128
pga_aggregate_target=0
processes = 8000
query_rewrite_enabled=FALSE
replication_dependency_tracking=FALSE
sessions = 9000
session_cached_cursors=2000
shared_pool_size =8G
sort_area_size=52428800
transactions = 10000
transactions_per_rollback_segment = 1
trace_enabled=FALSE
undo_management = AUTO
undo_retention = 900
undo_tablespace = undo_ts2
timed_statistics = false
statistics_level = basic
_array_update_vector_read_enabled=true
_collect_undo_stats=false
_ksmg_granule_size=33554432
_db_cache_pre_warm=FALSE
_db_writer_flush_imu=FALSE
_log_event_queues = 4
_rollback_segment_count=6000
_ktu_latches=89
Log writer put into realtime class with /usr/bin/rtprio 127 -PID
and put in its own processor set with /usr/sbin/psrset -b
Listener was started with Round robin policy to distribute the Oracle client processes to different cells.
_hang_detection=0
_diag_adr_enabled=false
--------------------------------------------------------------------------------
Driver SW Config Primary and Satellites
JVM Product: Java HotSpot(TM) 64-Bit Server VM on Linux, version 1.6.0_06
Hardware: Primary Load Driver, Satellite Drivers #1-#14 and Emulator
# of Instances: 15
Notes / Tuning Information
-Xms2000M -Xmx2000M -Xverify:none
-Xloggc:gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
-XX:+DisableExplicitGC -XX:+UseParallelGC
-Dsun.net.inetaddr.ttl=0 -Dnetworkaddress.cache.ttl=0
-Djava.nio.channels.spi.SelectorProvider=sun.nio.ch.DevPollSelectorProvider
--------------------------------------------------------------------------------
HARDWARE SYSTEMS
--------------------------------------------------------------------------------
J2EE AppServer HW (SUT hardware)
Hardware Vendor: HP
Model Name: HP BL870c
Processor: Dual-core Intel Itanium 9100
MHz: 1600
# of CPUs: 8 cores, 4 chips, 2 cores/chip
Memory (MB): 98272
L1 Cache: 16KB(I)+16KB(D)
L2 Cache: 1024KB(I)+256KB(D)
Other Cache: 2 x 12MB (L3 Cache)
OS Vendor: HP
OS Name: HP-UX 11i v3 March 2008
Disks: see notes
Network Interface: (2) HP PCI-X 1000Mbps Dual-port Built-in
Other Hardware: (1) HP 4Gb Dual Port PCIe Fibre Channel Mezzanine
# of Systems: 12
H/W Available: Jan-2008
O/S Available: Mar-2008
Notes / Tuning Information
Kernel Tunable Entries:
TRMSGSZ 65535
create_fastlinks 1
default_disk_ir 1
fs_async 1
hires_timeout_enable 0
lcpu_attr 1
max_async_ports 4096
max_thread_proc 2048
maxdsiz 3221225472
maxfiles 2048
maxfiles_lim 32768
maxssiz 100610048
maxssiz_64bit 1073741824
maxtsiz 1073741824
maxtsiz_64bit 4294967296
maxuprc 2040
msgmnb 65536
msgtql 5120
ninode 150000
nkthread 20000
nproc 5000
npty 200
nstrpty 200
nswapdev 25
semmni 4096
semmns 8192
semmnu 4092
semume 512
shmmax 15000000000
shmmni 520
shmseg 512
swchunk 8192
tcphashsz 32768
vps_ceiling 64
Disk Configuration:
Each server has 2 x HP 146GB 10K SAS HDD
And 1 x HP StorageWorks EVA for server and JMS logging
Each of the AppServer systems connected to EVA Storage Array
--------------------------------------------------------------------------------
Database Server HW (SUT hardware)
Hardware Vendor: HP
Model Name: Superdome
Processor: Dual-core Intel Itanium 9000
MHz: 1600
# of CPUs: 112 cores, 56 chips, 2 cores/chip
Memory (MB): 523246
L1 Cache: 16KB(I)+16KB(D)
L2 Cache: 1024KB(I)+256KB(D)
Other Cache: 2x12MB (L3 Cache)
OS Vendor: HP
OS Name: HP-UX 11i v3 March 2008
Disks: 4x36Gb 15K RPM U320
Network Interface: (7) HP PCI/PCI-X 1000Base-T Dual-port Adapter
Other Hardware: See notes
# of Systems: 1
H/W Available: Sep-2006
O/S Available: Mar-2008
Notes / Tuning Information
Kernel tunable entries:
STRMSGSZ 65535
create_fastlinks 1
default_disk_ir 1
fs_async 1
ksi_alloc_max 32768
lcpu_attr 0
max_async_ports 16384
max_thread_proc 32768
maxdsiz 1073741824
maxdsiz_64bit 2147483648
maxfiles 130000
maxfiles_lim 130000
maxssiz 134217728
maxssiz_64bit 1073741824
maxtsiz 1073741824
maxuprc 16384
msgmnb 65536
msgmni 4096
msgtql 4096
ncsize 34816
nflocks 16384
ninode 34816
nkthread 130000
nproc 60000
npty 200
nstrpty 200
nswapdev 25
semmni 8192
semmns 16384
semmnu 8192
semmsl 8192
semume 1024
semvmx 32767
shmmax 4398046511104
shmmni 512
shmseg 512
swchunk 8192
tcphashsz 32768
vps_ceiling 64
Network Tuning:
Used default ndd parms
(4) HP StorageWorks EVA8100 2C6D Array
Each with 112 x 146GB 15K FC HDD and HP StorageWorks SAN Swicth
(8) HP 4Gb Dual Port PCI/PCI-X Fibre Channel Adapter
--------------------------------------------------------------------------------
Primary Load Driver, Satellite Drivers #1-#14 and Emulator (non-SUT hardware)
Hardware Vendor: HP
Model Name: Bl685c
Processor: Dual-Core AMD Opteron(tm) Processor 8218
MHz: 2600
# of CPUs: 8 cores, 4 chips, 2 cores/chip
Memory (MB): 65536
L1 Cache: 64KB(I)+64KB(D)
L2 Cache: 1024KB
Other Cache: None
OS Vendor: Red Hat
OS Name: Red Hat Enterprise Linux 5 EM64T
Disks: 1x73Gb 15K RPM U320
Network Interface: (2) HP PCI-X 1000Mbps Dual-port Built-in , (1) HP PCI-X 1000Mbps Quad-Port
Other Hardware: None
# of Systems: 16
H/W Available: Feb-2008
O/S Available: Feb-2008
Notes / Tuning Information
Added to /etc/sysctl.conf:
fs.file-max = 262144
kernel.sem = 250 32000 100 128
net.core.netdev_max_backlog = 400000
net.core.optmem_max = 30000000
net.core.rmem_default = 30000000
net.core.rmem_max = 30000000
net.core.somaxconn = 40000
net.core.wmem_default = 30000000
net.core.wmem_max = 30000000
net.ipv4.ip_local_port_range = 1024 65000
net.ipv4.tcp_fin_timeout = 10
net.ipv4.tcp_max_syn_backlog = 30000
net.ipv4.tcp_max_tw_buckets = 2000000
net.ipv4.tcp_mem = 30000000 30000000 30000000
net.ipv4.tcp_rmem = 30000000 30000000 30000000
net.ipv4.tcp_timestamps = 0
net.ipv4.tcp_wmem = 30000000 30000000 30000000
For each of the NICs:
set arp_announce = 2
set arp_ignore = 1
set txqueuelen 60000
enable tso and gso
Configure 12000 hugepages on Emulator.
--------------------------------------------------------------------------------
DNS Load Balancer Hardware (SUT hardware)
Hardware Vendor: HP
Model Name: rx2660
Processor: Intel Itanium 9100
MHz: 1667
# of CPUs: 4 cores, 2 chips, 2 cores/chip
Memory (MB): 32746
L1 Cache: 16KB(I)+16KB(D)
L2 Cache: 256KB
Other Cache: 2 x 9MB (L3 Cache)
OS Vendor: HP
OS Name: HP-UX 11i v3 March 2008
Disks: 1x73Gb 15K RPM U320
Network Interface: (2) HP PCI/PCI-X 1000Base-T Dual-port Adapter
Other Hardware: null
# of Systems: 3
H/W Available: Sep-2006
O/S Available: Mar-2008
Notes / Tuning Information
Started named -n 16 and put into realtime class with /usr/bin/rtprio 127 -PID
--------------------------------------------------------------------------------
BENCHMARK MODIFICATIONS
--------------------------------------------------------------------------------
Schema Modifications:
Tablespace sizes were increased to support the Injection rate.
Scripts to create the DB are included in the FDA.
Table and index initrans were modified.
The C_CUSTOMER, C_CUSTOMERINVENTORY, M_INVENTORY, M_WORKORDER, O_ORDERLINE,
O_ORDERS, S_COMPONENT, S_PURCHASEORDER and S_PURCHASEORDERLINE tables were
horizontally partitioned. M_PARTS and M_BOM were hash clustered.
Automatic segment space management was used for all tablespaces.
System managed undo was used.
Table locks were disabled during the run using disable_lock.sql
--------------------------------------------------------------------------------
Load Program Modifications:
The load program was not modified.
BENCHMARK CONFIGURATION INFORMATION
--------------------------------------------------------------------------------
Isolation Requirement Info:
The following Beans were deployed in READ_COMMITTED mode as per the
benchmark requirement:
Mfg - AssemblyEnt, BomEnt, ComponentEnt, LargeOrderEnt, PartEnt
Orders - ItemEnt
Supplier - SupplierCompEnt, SupplierEnt
All other beans were deployed using pessimistic locking mode such that all
selects including finders are issued with a FOR UPDATE clause in select
statement:
Corp - CustomerEnt, CustomerInventoryEnt
Mfg - InventoryEnt, WorkOrderEnt
Orders - OrderEnt, OrderLineEnt
Supplier - POEnt, POLineEnt, SComponentEnt
Util - SequenceEnt
The ItemEnt bean was cached for 20 minute intervals by setting:
read-only to true, and
time-to-live to 1200000 (ms)
in orders-toplink-ejb-jar.xml deployment descriptor.
--------------------------------------------------------------------------------
Durability Requirement Info:
To ensure database durability, RAID 1 (mirroring) was used for the
database Redo logs and datafiles.
The application server was using mirrored disks to
provide durability for server logs and JMS persistence filestore.
The RAID controller on the database and application server machines were
configured with Write-Back cache policy supported with battery backed up unit
on the controller.
--------------------------------------------------------------------------------
Storage Requirement Info:
An 80 minute run at an injection rate of 10,300 increased storage by 32.0 GB
This extrapolates to 504GB of storage for a 24 hour run.
The database is configured with 16TB of durable storage.
--------------------------------------------------------------------------------
Argument Passing Semantics:
Oracle Application Server 10g uses pass-by-value as required by the EJB
specification.
BILL OF MATERIALS
--------------------------------------------------------------------------------
Supplier Description Product # Qty
-------- ------------------------------------------- ---------------- ---
HP Integrity BL870c Blade Server AH232A 12
HP 1.60GHz 24MB Itanium Processors AH320A 48
HP 4GB (2 x 2GB) PC2-4200 DDR2 SDRAM DIMMs AD344A 144
HP 146GB SAS 10,000rpm disk drive 418367-B21 24
HP QLogic QMH2462 4Gb FC HBA 403619-B21 12
HP C7000 Enclosure AD361B 3
HP 4Gb Fibre Channel Pass-thru Module 403626-B21 3
HP 1Gb Ethernet Pass-Thru Module 406740-B21 6
HP BladeSystem c7000 Active Cool Fan 412140-B21 30
HP BladeSystem c7000 Power Module 413379-B21 18
HP HP-UX FOE BA531AC 48
HP 3 year 24x7 hardware and software support HA110A3
HP HP Superdome Server Solution A5200A 2
HP 32 processor Superdome Enterprise Server A9834A-429 2
HP 200-240VAC 3 phase, 4 wires, 8 gage cord A9834A-006 2
HP Superdome sx2000 Cell Board for Montecito A9837A-0D1 14
HP 1.6GHz 24MB Itanium 2 9000 A9840A-0D1 56
Itanium dual-core module
HP Memory - 16GB high performance DDR2 A9846A-0D1 28
(8x2GB DIMM)
HP HP 12 Slot PCI-X Chassis for sx2000 A9836A-0D1 6
HP 4Gb PCI-X DC 64 bit FC HBA A6826A-0D1 16
HP PCI-X 2 port 1000Base-T Gigabit Adptr A7012A-0D1 7
HP HP-UX OE LTU B9429CA-UMG,0D1,AJR 56
HP HP rx2620 1.0G 1.5MB CPU server Solution AB332A 1
Admin console
HP 3y 24x7 HW SW Support HA110A3
HP EVA8100 2C6D Array AG701A 4
HP StorageWorks 4/16 Full SAN Switch AG757A 4
HP CV EVA 8k Series Unlimited Lic T5183A 4
HP M5314C FC Drive Enclosure AD542C 8
HP StorageWorks 146GB 15K FC HDD 364621-B23 448
HP 4GB SW Single Pack SFP Transceiver A7446B 64
HP Storage Works LC/LC 2m Cable 221692-B21 54
HP 24A High Voltage US/JP Modular PDU 252663-D72 8
HP Universal Rack 10642 G2 Shock Rack AF002A 4
HP 10K G2 600W Stabilizer Kit AF062A 4
HP 10642 G2 Sidepanel Kit AF054A 4
HP CV EVA 7.0 Rep Sol Mgr 3.0 Media Kit T3724E 1
HP Stor Essen Std Ed SRM Media Kit T5314AA 1
HP Stor Essen Std Ed SRM LTU T5315AA 1
HP 3y Proactive 24 Service HA111A 4
HP EVA 6100 - Model 2C4D Base AD556C 1
2 x HSV200-B controllers
4 x M5314C Disk Enclosures
HP StorageWorks 146GB 15K FC HDD 364621-B23 56
HP HP rx2660 1.6GHz/18MB 4-core AD245A-003 3
HP rx2660 PCI-X 3 slot cage option AD246A 3
HP 4GB DDR2 memory pair (2 x 2GB DIMMs) AD275A 12
HP 36GB 10K RPM drives AD140A 3
HP Dual port 1000BaseT LAN adapter card A7012A 3
HP HP-UX Integrity FOE w/Sys 2 Proc PCL LTU B9430AC 12
HP 3 year 24x7 hardware and software support HA110A3
HP HP ProCurve 5304xl Switch 24 Port Module J8702-61001 3
Oracle Oracle Database 11g Enterprise Edition, 56*
Per Processor, Unlimited Users for 3 years
Oracle Partitioning, Per Processor, Unlimited Users for 3 years 56*
Oracle Oracle Database Server Support Package for 3 years 1
Incident Server Support -(24x7x4)
Oracle Oracle Application Server 10g - Java Edition, Per Processor 48*
Oracle Oracle Application Server Support Package for 3 years 12
- Incident Server Support -Package - (24x7x4)
(* 56 = 0.50 * 112) & (48= 0.50*96). Explanation: For the purposes
of counting the number of processors which require licensing, an Intel
multicore chip with "n" cores shall be determined by multiplying "n" cores
by a factor of 0.50).
--------------------------------------------------------------------------------
OTHER BENCHMARK INFORMATION
--------------------------------------------------------------------------------
The xerces implementation version 2.6.2 from xml.apache.org was used as it
comes packaged with Oracle Application Server 10g.
Requests were sent to different Appservers using DNS round robin,
with DNS servers running on the DNS load balancer hardware.
The driver used the following jndi.properties:
java.naming.factory.initial=com.evermind.server.rmi.RMIInitialContextFactory
java.naming.provider.url=ormi://main.specj.com:23791/SPECjAppServer
java.naming.security.principal=oc4jadmin
java.naming.security.credentials=welcome
oracle.j2ee.rmi.loadBalance=lookup
--------------------------------------------------------------------------------
General Notes
--------------------------------------------------------------------------------
The only errors in the driver error logs are the application errors
generated by this benchmark and those caused by network contention during
the benchmark's initial ramp up period.
On the database, incremental checkpointing ensured that no buffer will remain
dirty (in the cache) for more than the allowed time.
Oracle Application Server 10g Release 10.1.3.3.2 implements Recoverable Last
Resource Commit optimization where one and only one SinglePhaseResource
participates in a global transaction with one or more XAResources. This is
accomplished by emulating an XAResource to represent the 1PC resource. The
transaction manager takes the following steps when it receives a request to commit
a global transaction that includes one emulated XAResource:
1. It invokes a prepare call on each of the 2PC resources.
2. If all of the 2PC resources are successfully prepared, then commit (one-phase)
is called and the commit record is written to the commit-log, on the emulated XA
resource (database) as part of the local transaction.
3. If the 1PC on the emulated XA resource completes successfully, then the
transaction manager calls commit on each of the 2PC resources.
or:
If the 1PC on the emulated XA resource fails, then the transaction manager queries
the commit-log for transaction outcome. If the record exists, 2PC resources are
committed, otherwise 2PC Resources are aborted.
Transaction outcome after a single point of failure is guaranteed by the presence of
the commit-record in the commit log, indicating a successful transaction completion;
while a missing commit-record signifies abort. The commit record is deleted lazily
after the global transaction has committed.
--------------------------------------------------------------------------------
For questions about this result, please contact the submitter: Oracle
Corporation
For other inquiries, please contact SPEC
- Benchmark run on Tue Aug 26 21:02:32 PDT 2008
by SPECjAppServer2004 v1.08
- Result submitted on Wed Aug 27 03:33:02 EDT 2008
- Report generated by SPECjAppServer2004 Reporter v1.03
Copyright (C) 2004 Standard Performance Evaluation Corporation