SPECmail2001 Result Copyright © 1999-2001 Standard Performance Evaluation Corporation |
Mirapoint MSR 2.9 - DS300/MD300/M2500 | SPECmail2001 msgs/min = 2,500 |
SPEC license # 69 | Tested by: Mirapoint |
Test date: Jun-2001 |
Hardware Avail: Jun-2001 |
Software Avail: Apr-2001 |
2,500 SPECmail2001 messages per minute is equivalent to 500,000 SPECmail2001_users.
Summary Results |
||||||
---|---|---|---|---|---|---|
Function | Response time limit (seconds) |
Required Percentage Compliant |
Percentage Compliant | |||
80% | 100% | 120% | ||||
SMTP Connect | 5 | >95% | 100.00% | 100.00% | 76.53% | |
SMTP Data | 5 | >95% | 100.00% | 100.00% | 95.74% | |
POP Connect | 5 | >95% | 100.00% | 100.00% | 100.00% | |
POP Status | 5 | >95% | 100.00% | 100.00% | 100.00% | |
POP Retrieve | 5 | >95% | 100.00% | 100.00% | 100.00% | |
POP Delete | 5 | >95% | 100.00% | 100.00% | 100.00% | |
Delivery Time | 60 | >95% | 98.82% | 98.99% | 78.62% | |
Error Rate | NA | <1% | 0.00% | 0.00% | 5.04% |
Internet Directory - LDAP Server (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Message Director - Access Switch (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Message Director - Router (5 systems) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Internet Message Server - Message Store (7 systems) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Benchmark Manager (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Load Generator (7 systems) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
SMTP Sink (1 system) | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||
|
Detailed Results -- 80% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 400,000 | 2,000 | |
Actual | 400,000 | 2,000 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 228,304 | 228,304 | 100.00% |
SMTP Hello | 228,305 | 228,305 | 100.00% |
SMTP Mail From | 228,307 | 228,307 | 100.00% |
SMTP Rcpt To | 456,876 | 456,876 | 100.00% |
SMTP Data | 228,324 | 228,324 | 100.00% |
SMTP Quit | 226,031 | 226,031 | 100.00% |
POP Connect | 239,746 | 239,746 | 100.00% |
POP User ID | 239,745 | 239,745 | 100.00% |
POP Password | 239,742 | 239,742 | 100.00% |
POP Status | 239,742 | 239,742 | 100.00% |
POP Retrieve | 241,091 | 241,091 | 100.00% |
POP Delete | 240,408 | 240,408 | 100.00% |
POP Quit | 239,066 | 239,066 | 100.00% |
Delivery Time | 2,280 | 2,253 | 98.82% |
SMTP Data Response Time | 228,324 | 226,030 | 99.00% |
POP Retrieve Response Time | 241,091 | 240,746 | 99.86% |
Remote Message Delivery | 215,887 | 213,709 | 98.99% |
Counter |
Value |
||
SMTP Connect Error | 0 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 2,295 | ||
SMTP Session | 226,031 | ||
SMTP To Local | 240,988 | ||
SMTP To Remote | 215,887 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 0 | ||
POP Protocol Error | 0 | ||
POP Disconnect | 684 | ||
POP Session | 239,066 | ||
Delivery Time Connect Error | 0 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 0 | 811 | 20.29 |
SMTP Hello | 0 | 461 | 25.81 |
SMTP Mail From | 0 | 511 | 26.04 |
SMTP Rcpt To | 0 | 450 | 20.32 |
SMTP Data | 0 | 571 | 32.94 |
SMTP Quit | 0 | 1,482 | 4.04 |
POP Connect | 0 | 992 | 8.56 |
POP User ID | 0 | 3,004 | 19.64 |
POP Password | 0 | 1,563 | 53.03 |
POP Status | 0 | 371 | 4.46 |
POP Retrieve | 0 | 1,622 | 26.10 |
POP Delete | 0 | 420 | 6.30 |
POP Quit | 0 | 1,052 | 14.04 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.60 |
POP Retrieve (KB down) | 1 | 2,675 | 24.14 |
Detailed Results -- 100% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 500,000 | 2,500 | |
Actual | 500,200 | 2,501 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 284,617 | 284,617 | 100.00% |
SMTP Hello | 284,616 | 284,616 | 100.00% |
SMTP Mail From | 284,621 | 284,621 | 100.00% |
SMTP Rcpt To | 568,978 | 568,978 | 100.00% |
SMTP Data | 284,639 | 284,639 | 100.00% |
SMTP Quit | 281,768 | 281,768 | 100.00% |
POP Connect | 300,597 | 300,597 | 100.00% |
POP User ID | 300,594 | 300,594 | 100.00% |
POP Password | 300,591 | 300,591 | 100.00% |
POP Status | 300,591 | 300,591 | 100.00% |
POP Retrieve | 299,224 | 299,224 | 100.00% |
POP Delete | 298,451 | 298,451 | 100.00% |
POP Quit | 299,828 | 299,828 | 100.00% |
Delivery Time | 2,860 | 2,831 | 98.99% |
SMTP Data Response Time | 284,639 | 281,768 | 98.99% |
POP Retrieve Response Time | 299,224 | 298,802 | 99.86% |
Remote Message Delivery | 269,853 | 267,085 | 98.97% |
Counter |
Value |
||
SMTP Connect Error | 0 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 2,871 | ||
SMTP Session | 281,768 | ||
SMTP To Local | 299,118 | ||
SMTP To Remote | 269,853 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 3 | ||
POP Protocol Error | 3 | ||
POP Disconnect | 774 | ||
POP Session | 299,831 | ||
Delivery Time Connect Error | 0 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 0 | 961 | 36.12 |
SMTP Hello | 0 | 711 | 41.86 |
SMTP Mail From | 0 | 1,101 | 55.29 |
SMTP Rcpt To | 0 | 792 | 31.27 |
SMTP Data | 0 | 921 | 44.82 |
SMTP Quit | 0 | 1,502 | 4.33 |
POP Connect | 0 | 861 | 9.72 |
POP User ID | 0 | 531 | 23.15 |
POP Password | 0 | 1,813 | 82.87 |
POP Status | 0 | 430 | 6.12 |
POP Retrieve | 0 | 561 | 32.68 |
POP Delete | 0 | 560 | 8.47 |
POP Quit | 0 | 1,161 | 24.28 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.48 |
POP Retrieve (KB down) | 1 | 2,675 | 24.56 |
Detailed Results -- 120% Load |
|||
---|---|---|---|
Load | User Count | Message Rate (msg/min) |
|
Attempted | 600,000 | 3,000 | |
Actual | 567,800 | 2,839 | |
Function | Attempts | # Pass QoS |
% Pass QoS |
SMTP Connect | 305,512 | 233,804 | 76.53% |
SMTP Hello | 305,511 | 272,530 | 89.20% |
SMTP Mail From | 305,470 | 288,324 | 94.39% |
SMTP Rcpt To | 605,715 | 605,715 | 100.00% |
SMTP Data | 305,418 | 292,407 | 95.74% |
SMTP Quit | 302,357 | 302,357 | 100.00% |
POP Connect | 359,907 | 359,907 | 100.00% |
POP User ID | 359,879 | 359,879 | 100.00% |
POP Password | 359,856 | 359,836 | 99.99% |
POP Status | 359,854 | 359,854 | 100.00% |
POP Retrieve | 352,949 | 352,949 | 100.00% |
POP Delete | 352,016 | 352,016 | 100.00% |
POP Quit | 358,932 | 358,909 | 99.99% |
Delivery Time | 3,443 | 2,707 | 78.62% |
SMTP Data Response Time | 305,418 | 294,167 | 96.32% |
POP Retrieve Response Time | 352,949 | 352,388 | 99.84% |
Remote Message Delivery | 286,571 | 282,445 | 98.56% |
Counter |
Value |
||
SMTP Connect Error | 35,317 | ||
SMTP Protocol Error | 0 | ||
SMTP Disconnect | 3,062 | ||
SMTP Session | 337,674 | ||
SMTP To Local | 319,153 | ||
SMTP To Remote | 286,571 | ||
SINK Connect Error | 0 | ||
POP Connect Error | 26 | ||
POP Protocol Error | 26 | ||
POP Disconnect | 934 | ||
POP Session | 358,958 | ||
Delivery Time Connect Error | 375 | ||
Function | Minimum Time (millisec) |
Maximum Time (millisec) |
Average Time (millisec) |
SMTP Connect | 0 | 28,261 | 3,246.59 |
SMTP Hello | 0 | 19,758 | 1,748.10 |
SMTP Mail From | 0 | 26,908 | 1,326.18 |
SMTP Rcpt To | 0 | 2,274 | 157.17 |
SMTP Data | 0 | 30,985 | 985.44 |
SMTP Quit | 0 | 972 | 6.15 |
POP Connect | 0 | 2,984 | 10.94 |
POP User ID | 0 | 2,123 | 31.11 |
POP Password | 0 | 10,705 | 184.95 |
POP Status | 0 | 1,693 | 9.00 |
POP Retrieve | 0 | 1,523 | 39.80 |
POP Delete | 0 | 1,772 | 12.27 |
POP Quit | 0 | 11,356 | 72.63 |
Function | Minimum Size (KB) |
Maximum Size (KB) |
Average Size (KB) |
SMTP Data (KB up) | 1 | 2,674 | 24.41 |
POP Retrieve (KB down) | 1 | 2,675 | 25.14 |
General Notes / Tuning Information |
---|
Network hardware: Foundry Network ServerIronXL (2x 1000Base-SX ports and 24x 10/100 BaseT ports) The Foundry switch is configured to perform SMTP server load balancing (SLB) for virtual host vmr1.p.net. Accesses to the SMTP port of vmr1.p.net are load balanced across the SMTP ports of real hosts mperf19, mperf20, mperf21, mperf22 and mperf23 using the round-robin SLB algorithm. Configuration commands: server real mperf19 10.5.1.19 port smtp server real mperf20 10.5.1.20 port smtp server real mperf21 10.5.1.21 port smtp server real mperf22 10.5.1.22 port smtp server real mperf23 10.5.1.23 port smtp server virtual vmr1 10.5.10.1 predictor round-robin port smtp bind smtp mperf19 smtp mperf20 smtp mperf21 smtp mperf22 smtp bind smtp mperf23 smtp DNS configuration: "A" records for every host on the network (to map hostnames to IP addresses). "PTR" records for every host on the network (to reverse map IP addresses to hostnames). "PTR" and "A" records for the "virtual" host vmr1.p.net. Host alias "smtp.p.net" is mapped to vmr1.p.net (the virtual message router pool) with a CNAME record. Host alias "pop.p.net" is mapped to mperf18.p.net (the access switch) with a CNAME record. Specify operf4.p.net as the only mail exchange for domain remote.p.net with an MX record of preference level 10. Testing performed at Mirapoint Headquarters (Performance Lab) in Sunnyvale, CA. |
First published at SPEC.org on 05-Jul-2001
Benchmark run on Tue Jun 12 17:22:57 PDT 2001 by SPECmail2001 v1.01