SPECweb99_SSL Result =============================================================================== || IBM : xSeries 360 || CD SPECweb99_SSL Zeus : Zeus V4.1R1 || || =============================================================================== SPEC has discovered a code defect in the SPECweb99_SSL test harness run on the client systems used in this result. The bug prevents these client systems from generating the correct SPECweb99_SSL workload. Specifically, the bug in the SPECweb99_SSL code results in the clients not generating any of the required SSL ClientKeyExchanges during the benchmark. Therefore, the results presented here are not comparable with any other SPECweb99_SSL results. =============================================================================== PERFORMANCE | Conforming Simultaneous Iteration | Connections ---------------+---------------------------- 1 | CD 2 | CD 3 | CD ---------------+---------------------------- Median | CD =============================================================================== Availability Dates All Hardware Nov-2002 HTTPS Software Mar-2002 Operating System Dec-2000 Supplemental System May-2002 Hardware Vendor IBM Model xSeries 360 Processor 2.0 GHz Intel Xeon MP # Processors 4 cores, 4 chips, 1 core/chip Primary Cache 12KBI+8KBD on chip Secondary Cache 256KB L2 Other Cache 2MB L3 cache Memory 8 GB Disk Subsystem 14 x 18GB ST318451LC Disk Controllers 1 IBM ServeRaid 4Lx Other Hardware 2 x Alteon ACEswitch 180, 1 IBM EXP-300 Drive Bay Software Operating System Red Hat Linux 7.3 File System Ext. 2 Other Software None HTTPS Software Vendor Zeus HTTPS Software Zeus V4.1R1 API Zeus PEPP 0.8 ISAPI used for dynamic content Server Cache None Log Mode Zeus Binary CLF Test Sponsor Test Date Oct-2002 Tested By IBM SPEC License 11 Network # of Controllers 2 Network Controllers Intel Pro 1000 # of Nets 2 Type of Nets 2 Network Speed 1 Gb/s MSL (sec) 30 (Non RFC1122) Time-Wait (sec) 60 (Non RFC1122) MTU 1500 Clients # of Clients 10 Model IBM xSeries 330 Processor 1.13GHz Pentium III # of Processors 1 Memory 256MB Network Controller Alteon ACENIC Operating System Windows 2000 Compiler Visual C++ 6.0 Benchmark Configuration Requested Connections 1650 Fileset Size (MB) 5397.28 =============================================================================== Notes/Tuning information SUT Notes 12 Disk Hardware RAID 0 for O/S and fileset, 2 disk RAID 0 for logfiles Operating System Notes Tuning parameters: -net.ipv4.ip_forward = 1, default 0 -net.ipv4.conf.all.rp_filter = 1, enables source route verification, default 0 -net.core.optmem_max=10000000, default 10240 -net.core.rmem_default=10000000,default recieve socket buffer size, default 65535 -net.core.rmem_max=10000000, maximum receive socket buffer size, default 65535 -net.core.wmem_default=10000000, default send socket buffer size, default 65535 -net.core.wmem_max=10000000, maximum send socket buffer size, default 65535 -net.core.hot_list_length=10000, maximum number of skb-heads to be cached, default 128 -net.core.netdev_max_backlog=10000 -net.ipv4.tcp_max_tw_buckets=150000, sets TCP time-wait buckets pool size, default 180000 -net.ipv4.tcp_rmem=30000000 30000000 30000000, maximum TCP read-buffer space allocatable, default 4096 87380 174760 -net.ipv4.tcp_wmem=30000000 30000000 30000000, maximum TCP write-buffer space allocatable, default 4096 16384 131072 -net.ipv4.tcp_mem=30000000 30000000 30000000, maximum TCP buffer space, default 31744 32256 32768 -net.ipv4.tcp_timestamps=0, turns TCP timestamp support off, default 1 HTTPS Software Notes Zeus Configuration -tuning!so_wbuff_size 1048576 -tuning!softservers no -tuning!cbuff_size 65536 -tuning!ssl_sessioncache_size 4951 -tuning!keepalive_timeout 20 -tuning!keepalive_max 1700 -tuning!sendfile_minsize 1 -tuning!listen_queue_size 8192 -tuning!so_rbuff_size 0 -tuning!modules!cgi!cleansize 0 -tuning!clientfirst_optimise yes -tuning!maxaccept 64 =============================================================================== Test Run Details Run Conforming Percent | Throughput Response ops/sec/ Kbits/ Num Connections Conform | ops/sec msec loadgen sec 1 CD CD | CD CD CD CD => 2 CD CD | CD CD CD CD 3 CD CD | CD CD CD CD Cumulative Conformance % Chart Run Conforming | Percent of connections conforming at various speeds Num Connections | 380000 360000 340000 320000 300000 280000 -----------------------+--------------------------------------------------- 1 1643 | 0.00 0.00 0.73 99.58 100.00 100.00 => 2 1643 | 0.00 0.00 0.30 99.58 100.00 100.00 3 1642 | 0.00 0.00 0.36 99.52 100.00 100.00 Results From Iteration 1 -------------------------+-----------------+--------------------------+------ M I X | O P C O U N T | MEAN RESPONSE TIME Ms/Op | Total Class Target Actual | Success Error | Mean StdDev 95% CI | Time -------------------------+-----------------+--------------------------+------ class0 0.350 0.350 | 1904870 0 | 84.06 46.30 0.01 | 8.1% class1 0.500 0.500 | 2721182 0 | 159.43 58.76 0.01 | 21.9% class2 0.140 0.140 | 761810 0 | 1081.60 388.29 0.06 | 41.6% class3 0.010 0.010 | 54343 0 | 10315.80 3853.05 0.75 | 28.3% -------------------------+-----------------+--------------------------+------ | 5442205 0 | 363.55 1131.90 0.04 | -------+--------------------------------+------------------+-------------------- |Individual OP Bit Rate(bits/sec)| Aggregate Bit | Weighted ABR Class | Mean StdDev 95% CI | Rate (bits/sec) | (%) -------+--------------------------------+------------------+-------------------- class0 | 92312.47 42611.15 0.42 | 76831.65 | 6218.12(1.88) class1 | 274545.40 66995.86 0.44 | 267110.89 | 58568.82(17.70) class2 | 372098.96 28590.32 0.54 | 373316.76 | 155471.80(47.00) class3 | 390887.94 17989.73 1.62 | 390222.84 | 110565.59(33.42) -------+--------------------------------+------------------+-------------------- | | | 330824.33(100.00) | | total | ops/sec/| |SPECweb99_SSL| ops/sec | loadgen | msec/op -------------+-------------+---------+---------+--------- RESULTS | 1643 | 4535 | 2.75 | 363.6 | | | | conforming* | requested | valid | invalid | (conf %) -------------+-----------+-----------+-----------+---------------- SIMULTANEOUS | 1650 | 1650 | 0 | 1643 ( 99.58%) CONNECTIONS | | | | * a conforming connection is one that operates faster than 320K bit/sec | mean | min | max -------------+---------+---------+-------- AGGREGATE | | | BITRATES | 330824 | 310926 | 342819 (bits/sec) | | | ------------------------------------------------------------------------- Percentage of simultaneous connections conforming at various speed limits --------------------------+---------------------------------------------- Successive Speed Limits : | 380000 360000 340000 320000 300000 280000 Cumulative Conformance %: | 0.00 0.00 0.73 99.58 100.00 100.00 --------------------------+---------------------------------------------- Results From Iteration 2 -------------------------+-----------------+--------------------------+------ M I X | O P C O U N T | MEAN RESPONSE TIME Ms/Op | Total Class Target Actual | Success Error | Mean StdDev 95% CI | Time -------------------------+-----------------+--------------------------+------ class0 0.350 0.350 | 1902804 0 | 84.85 46.65 0.01 | 8.2% class1 0.500 0.500 | 2718338 0 | 160.20 59.11 0.01 | 22.0% class2 0.140 0.140 | 761052 0 | 1083.05 389.21 0.06 | 41.6% class3 0.010 0.010 | 54304 0 | 10284.84 3847.40 0.75 | 28.2% -------------------------+-----------------+--------------------------+------ | 5436498 0 | 364.15 1129.21 0.04 | -------+--------------------------------+------------------+-------------------- |Individual OP Bit Rate(bits/sec)| Aggregate Bit | Weighted ABR Class | Mean StdDev 95% CI | Rate (bits/sec) | (%) -------+--------------------------------+------------------+-------------------- class0 | 91515.49 42442.68 0.42 | 76114.31 | 6207.47(1.88) class1 | 273559.84 67194.78 0.44 | 265944.50 | 58500.01(17.73) class2 | 371577.52 28908.98 0.55 | 372778.50 | 155208.85(47.05) class3 | 390431.03 18386.96 1.63 | 389759.73 | 109958.21(33.33) -------+--------------------------------+------------------+-------------------- | | | 329874.54(100.00) | | total | ops/sec/| |SPECweb99_SSL| ops/sec | loadgen | msec/op -------------+-------------+---------+---------+--------- RESULTS | 1643 | 4530 | 2.75 | 364.1 | | | | conforming* | requested | valid | invalid | (conf %) -------------+-----------+-----------+-----------+---------------- SIMULTANEOUS | 1650 | 1650 | 0 | 1643 ( 99.58%) CONNECTIONS | | | | * a conforming connection is one that operates faster than 320K bit/sec | mean | min | max -------------+---------+---------+-------- AGGREGATE | | | BITRATES | 329874 | 315350 | 341407 (bits/sec) | | | ------------------------------------------------------------------------- Percentage of simultaneous connections conforming at various speed limits --------------------------+---------------------------------------------- Successive Speed Limits : | 380000 360000 340000 320000 300000 280000 Cumulative Conformance %: | 0.00 0.00 0.30 99.58 100.00 100.00 --------------------------+---------------------------------------------- Results From Iteration 3 -------------------------+-----------------+--------------------------+------ M I X | O P C O U N T | MEAN RESPONSE TIME Ms/Op | Total Class Target Actual | Success Error | Mean StdDev 95% CI | Time -------------------------+-----------------+--------------------------+------ class0 0.350 0.350 | 1898879 0 | 85.43 44.84 0.01 | 8.2% class1 0.500 0.500 | 2712740 0 | 160.44 57.66 0.01 | 22.0% class2 0.140 0.140 | 759513 0 | 1083.86 387.26 0.06 | 41.6% class3 0.010 0.010 | 54180 0 | 10306.77 3843.37 0.75 | 28.2% -------------------------+-----------------+--------------------------+------ | 5425312 0 | 364.79 1130.73 0.04 | -------+--------------------------------+------------------+-------------------- |Individual OP Bit Rate(bits/sec)| Aggregate Bit | Weighted ABR Class | Mean StdDev 95% CI | Rate (bits/sec) | (%) -------+--------------------------------+------------------+-------------------- class0 | 90232.17 41515.20 0.42 | 75608.42 | 6197.18(1.88) class1 | 272422.73 66874.22 0.44 | 265416.81 | 58370.35(17.71) class2 | 371291.95 28010.83 0.54 | 372728.56 | 155037.73(47.04) class3 | 390412.88 17700.03 1.60 | 389820.23 | 109992.77(33.37) -------+--------------------------------+------------------+-------------------- | | | 329598.03(100.00) | | total | ops/sec/| |SPECweb99_SSL| ops/sec | loadgen | msec/op -------------+-------------+---------+---------+--------- RESULTS | 1642 | 4521 | 2.74 | 364.8 | | | | conforming* | requested | valid | invalid | (conf %) -------------+-----------+-----------+-----------+---------------- SIMULTANEOUS | 1650 | 1650 | 0 | 1642 ( 99.52%) CONNECTIONS | | | | * a conforming connection is one that operates faster than 320K bit/sec | mean | min | max -------------+---------+---------+-------- AGGREGATE | | | BITRATES | 329598 | 317704 | 341040 (bits/sec) | | | ------------------------------------------------------------------------- Percentage of simultaneous connections conforming at various speed limits --------------------------+---------------------------------------------- Successive Speed Limits : | 380000 360000 340000 320000 300000 280000 Cumulative Conformance %: | 0.00 0.00 0.36 99.52 100.00 100.00 --------------------------+----------------------------------------------