SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
Mirapoint MSR 2.9 - DS300/MD300/M2500 SPECmail2001 msgs/min = 2,500
SPEC license # 69 Tested by:
Mirapoint
Test date:
Jun-2001
Hardware Avail:
Jun-2001
Software Avail:
Apr-2001

2,500 SPECmail2001 messages per minute is equivalent to 500,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: Internet Directory - LDAP Server | Message Director - Access Switch | Message Director - Router | Internet Message Server - Message Store | Benchmark Manager | Load Generator | SMTP Sink | Configuration diagram
Detailed results: Detailed Results 80% load | Detailed Results 100% load | Detailed Results 120% load


Summary Results
Function Response
time limit
(seconds)
Required
Percentage
Compliant
Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 76.53%
SMTP Data 5 >95% 100.00% 100.00% 95.74%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 98.82% 98.99% 78.62%
Error Rate NA <1% 0.00% 0.00% 5.04%

Internet Directory - LDAP Server (1 system)
Software
System Release: MSR 2.9 Operating System: MOS
Availability: Apr-2001 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: DS300 CPU MHz: 1000
Availability: Jun-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 3 x 36GB 10K RPM SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 768 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: 1xRAID1 + Hot-spare
Notes / Tuning Information
Hostname: mperf17

Licenses: User-limit 20, SSH Licensed, Directory Server Access

LDAP Server configuration:

   Truncated LDIF contents (500k.ldif) used to populate the ldap database:

	dn: c=us
	objectclass: top
	objectclass: country
	c: us

	dn: o=spec500k,c=us
	objectclass: organization
	o: spec500k

	dn: miLoginid=u1,o=spec500k,c=us
	objectclass: top
	objectclass: mirapointUser
	objectclass: mirapointMailUser
	miLoginid: u1
	sn: u1
	cn: u1
	mail: u1@local.p.net
	maillocaladdress: u1
	mailhost: mperf5.p.net
	userPassword: u1

	...


  CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Create index for the miLoginid attribute
    dir addindex "" miLoginid eq,pres

    # Populate the LDAP database
    dir importldif "" ftp://ftp.p.net/pub/500k.ldif

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Message Director - Access Switch (1 system)
Software
System Release: MSR 2.9 Operating System: MOS
Availability: Apr-2001 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: MD300 CPU MHz: 1000
Availability: Mar-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 3 x 36GB SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 768 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: 1xRAID1 + Hot-spare
Notes / Tuning Information
Hostname: mperf18

Licenses: User-limit 20, LDAP Routing, POP 20 users

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Enable per-user access switching
    pop set mode ldapproxy

    # Configure LDAP
    ldap add 10.5.1.17
    ldap setquery user:publishedname o=spec500k,c=us (mail=$(login)) mail
    ldap setquery user:mailhost o=spec500k,c=us (mail=$(login)) mailhost

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Message Director - Router (5 systems)
Software
System Release: MSR 2.9 Operating System: MOS
Availability: Apr-2001 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: MD300 CPU MHz: 1000
Availability: Mar-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 3 x 36GB SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 768 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 5 Other: 1xRAID1 + Hot-spare
Notes / Tuning Information
Hostnames: mperf19, mperf20, mperf21, mperf22, mperf23

Licenses: User-limit 20, LDAP Routing

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Relay mail for remote domains
    relay add remote.p.net

    # Perform per-user routing using LDAP mailhost lookups
    smtp set ldaprouting on

    # Configure LDAP
    ldap add 10.5.1.17
    ldap setquery user:publishedname o=spec500k,c=us (miLoginid=$(mbox)) mail
    ldap setquery user:mailhost o=spec500k,c=us (miLoginid=$(mbox)) mailhost

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Internet Message Server - Message Store (7 systems)
Software
System Release: MSR 2.9 Operating System: MOS
Availability: Apr-2001 File System: MessageBase (tm)
Hardware
Vendor: Mirapoint CPU: Intel PIII
Model Name: M2500 CPU MHz: 1000
Availability: Apr-2001 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 7 x 36GB 10K RPM FCAL Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 1024 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 7 Other: 3xRAID1 + Hot-spare
Notes / Tuning Information
Hostnames: mperf5, mperf6, mperf7, mperf8, mperf10, mperf11, and mperf12.

Licenses: User-limit unlimited, UPS Removal, POP unlimited users

CLI configuration commands:

    # Don't send system alerts, etc. to customercare@mirapoint.com
    conf disable customercare

    # Accept mail for the local domain
    maildom add local.p.net

    # Configure LDAP (for authentication)
    ldap add 10.5.1.17
    ldap setquery user:publishedname o=spec500k,c=us (miLoginid=$(mbox)) mail
    auth set default plaintext:ldap

MSL is 30 seconds (not configurable)

TIME_WAIT is 60 seconds (not configurable)

MSS is 1460 bytes (not configurable)

Benchmark Manager (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: FAT
Hardware
Vendor: Hewlett-Packard CPU: AMD-K6-2
Model Name: Pavilion 4440 CPU MHz: 333
Availability: Jan-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 4GB EIDE Primary Cache: 32KB(I) + 32KB(D) on chip
Memory (MB): 156 Secondary Cache: 512KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information
Hostname: operf9

MaxUserPort set to value 65534

Load Generator (7 systems)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: FIT CPU: Intel PIII
Model Name: Server-1000 CPU MHz: 800
Availability: Jun-2000 CPUs Enabled: 1 core, 1 chip, 1 core/chip
Disk Subsystem: 1 x 30GB EIDE Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 256 Secondary Cache: 256KB
Network: Intel 10/100 Pro Other Cache: N/A
# of Systems: 7 Other: N/A
Notes / Tuning Information
Hostnames: operf10, operf11, operf12, operf13, operf14, operf16, operf17

MaxUserPort set to value 65534

SMTP Sink (1 system)
Software
JVM: Sun Java 2 SDK, Standard Edition, v1.2.2_008 (symcjit) Operating System: Microsoft Windows NT Workstation 4.0 (service pack 5)
Availability: Apr-2001 File System: NTFS
Hardware
Vendor: Dell CPU: Intel PIII
Model Name: PowerEdge 1400 CPU MHz: 933
Availability: Jun-2000 CPUs Enabled: 2 cores, 2 chips, 1 core/chip
Disk Subsystem: 2 x 36GB U160 SCSI Primary Cache: 16KB(I) + 16KB(D) on chip
Memory (MB): 768 Secondary Cache: 256KB
Network: 3COM 3C985B-SX (Gigabit EtherLink) Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information
Hostname: operf4

Comment out line for SMTP in /WINNT/system32/drivers/etc/SERVICES
(required to allow the mail sink to bind to port 25)

MaxUserPort set to value 65534


Detailed Results -- 80% Load
Load User Count Message Rate
(msg/min)
Attempted 400,000 2,000
Actual 400,000 2,000
Function Attempts # Pass
QoS
% Pass
QoS
SMTP Connect 228,304 228,304 100.00%
SMTP Hello 228,305 228,305 100.00%
SMTP Mail From 228,307 228,307 100.00%
SMTP Rcpt To 456,876 456,876 100.00%
SMTP Data 228,324 228,324 100.00%
SMTP Quit 226,031 226,031 100.00%
POP Connect 239,746 239,746 100.00%
POP User ID 239,745 239,745 100.00%
POP Password 239,742 239,742 100.00%
POP Status 239,742 239,742 100.00%
POP Retrieve 241,091 241,091 100.00%
POP Delete 240,408 240,408 100.00%
POP Quit 239,066 239,066 100.00%
Delivery Time 2,280 2,253 98.82%
SMTP Data Response Time 228,324 226,030 99.00%
POP Retrieve Response Time 241,091 240,746 99.86%
Remote Message Delivery 215,887 213,709 98.99%

Counter

Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 2,295
SMTP Session 226,031
SMTP To Local 240,988
SMTP To Remote 215,887
SINK Connect Error 0
POP Connect Error 0
POP Protocol Error 0
POP Disconnect 684
POP Session 239,066
Delivery Time Connect Error 0
Function Minimum Time
(millisec)
Maximum Time
(millisec)
Average Time
(millisec)
SMTP Connect 0 811 20.29
SMTP Hello 0 461 25.81
SMTP Mail From 0 511 26.04
SMTP Rcpt To 0 450 20.32
SMTP Data 0 571 32.94
SMTP Quit 0 1,482 4.04
POP Connect 0 992 8.56
POP User ID 0 3,004 19.64
POP Password 0 1,563 53.03
POP Status 0 371 4.46
POP Retrieve 0 1,622 26.10
POP Delete 0 420 6.30
POP Quit 0 1,052 14.04
Function Minimum Size
(KB)
Maximum Size
(KB)
Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.60
POP Retrieve (KB down) 1 2,675 24.14


Detailed Results -- 100% Load
Load User Count Message Rate
(msg/min)
Attempted 500,000 2,500
Actual 500,200 2,501
Function Attempts # Pass
QoS
% Pass
QoS
SMTP Connect 284,617 284,617 100.00%
SMTP Hello 284,616 284,616 100.00%
SMTP Mail From 284,621 284,621 100.00%
SMTP Rcpt To 568,978 568,978 100.00%
SMTP Data 284,639 284,639 100.00%
SMTP Quit 281,768 281,768 100.00%
POP Connect 300,597 300,597 100.00%
POP User ID 300,594 300,594 100.00%
POP Password 300,591 300,591 100.00%
POP Status 300,591 300,591 100.00%
POP Retrieve 299,224 299,224 100.00%
POP Delete 298,451 298,451 100.00%
POP Quit 299,828 299,828 100.00%
Delivery Time 2,860 2,831 98.99%
SMTP Data Response Time 284,639 281,768 98.99%
POP Retrieve Response Time 299,224 298,802 99.86%
Remote Message Delivery 269,853 267,085 98.97%

Counter

Value
SMTP Connect Error 0
SMTP Protocol Error 0
SMTP Disconnect 2,871
SMTP Session 281,768
SMTP To Local 299,118
SMTP To Remote 269,853
SINK Connect Error 0
POP Connect Error 3
POP Protocol Error 3
POP Disconnect 774
POP Session 299,831
Delivery Time Connect Error 0
Function Minimum Time
(millisec)
Maximum Time
(millisec)
Average Time
(millisec)
SMTP Connect 0 961 36.12
SMTP Hello 0 711 41.86
SMTP Mail From 0 1,101 55.29
SMTP Rcpt To 0 792 31.27
SMTP Data 0 921 44.82
SMTP Quit 0 1,502 4.33
POP Connect 0 861 9.72
POP User ID 0 531 23.15
POP Password 0 1,813 82.87
POP Status 0 430 6.12
POP Retrieve 0 561 32.68
POP Delete 0 560 8.47
POP Quit 0 1,161 24.28
Function Minimum Size
(KB)
Maximum Size
(KB)
Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.48
POP Retrieve (KB down) 1 2,675 24.56


Detailed Results -- 120% Load
Load User Count Message Rate
(msg/min)
Attempted 600,000 3,000
Actual 567,800 2,839
Function Attempts # Pass
QoS
% Pass
QoS
SMTP Connect 305,512 233,804 76.53%
SMTP Hello 305,511 272,530 89.20%
SMTP Mail From 305,470 288,324 94.39%
SMTP Rcpt To 605,715 605,715 100.00%
SMTP Data 305,418 292,407 95.74%
SMTP Quit 302,357 302,357 100.00%
POP Connect 359,907 359,907 100.00%
POP User ID 359,879 359,879 100.00%
POP Password 359,856 359,836 99.99%
POP Status 359,854 359,854 100.00%
POP Retrieve 352,949 352,949 100.00%
POP Delete 352,016 352,016 100.00%
POP Quit 358,932 358,909 99.99%
Delivery Time 3,443 2,707 78.62%
SMTP Data Response Time 305,418 294,167 96.32%
POP Retrieve Response Time 352,949 352,388 99.84%
Remote Message Delivery 286,571 282,445 98.56%

Counter

Value
SMTP Connect Error 35,317
SMTP Protocol Error 0
SMTP Disconnect 3,062
SMTP Session 337,674
SMTP To Local 319,153
SMTP To Remote 286,571
SINK Connect Error 0
POP Connect Error 26
POP Protocol Error 26
POP Disconnect 934
POP Session 358,958
Delivery Time Connect Error 375
Function Minimum Time
(millisec)
Maximum Time
(millisec)
Average Time
(millisec)
SMTP Connect 0 28,261 3,246.59
SMTP Hello 0 19,758 1,748.10
SMTP Mail From 0 26,908 1,326.18
SMTP Rcpt To 0 2,274 157.17
SMTP Data 0 30,985 985.44
SMTP Quit 0 972 6.15
POP Connect 0 2,984 10.94
POP User ID 0 2,123 31.11
POP Password 0 10,705 184.95
POP Status 0 1,693 9.00
POP Retrieve 0 1,523 39.80
POP Delete 0 1,772 12.27
POP Quit 0 11,356 72.63
Function Minimum Size
(KB)
Maximum Size
(KB)
Average Size
(KB)
SMTP Data (KB up) 1 2,674 24.41
POP Retrieve (KB down) 1 2,675 25.14

General Notes / Tuning Information

Network hardware:

   Foundry Network ServerIronXL (2x 1000Base-SX ports and 24x 10/100 BaseT ports)

   The Foundry switch is configured to perform SMTP server load balancing (SLB)
   for virtual host vmr1.p.net.  Accesses to the SMTP port of vmr1.p.net are
   load balanced across the SMTP ports of real hosts mperf19, mperf20, mperf21,
   mperf22 and mperf23 using the round-robin SLB algorithm.

   Configuration commands:

        server real mperf19 10.5.1.19 port smtp

        server real mperf20 10.5.1.20 port smtp

        server real mperf21 10.5.1.21 port smtp

        server real mperf22 10.5.1.22 port smtp

        server real mperf23 10.5.1.23 port smtp

        server virtual vmr1 10.5.10.1 predictor round-robin
          port smtp
          bind smtp mperf19 smtp mperf20 smtp mperf21 smtp mperf22 smtp
          bind smtp mperf23 smtp

DNS configuration:

   "A" records for every host on the network (to map hostnames to IP
   addresses).

   "PTR" records for every host on the network (to reverse map IP
   addresses to hostnames).

   "PTR" and "A" records for the "virtual" host vmr1.p.net.

   Host alias "smtp.p.net" is mapped to vmr1.p.net (the virtual message
   router pool) with a CNAME record.

   Host alias "pop.p.net" is mapped to mperf18.p.net (the access
   switch) with a CNAME record.

   Specify operf4.p.net as the only mail exchange for domain remote.p.net
   with an MX record of preference level 10.


Testing performed at Mirapoint Headquarters (Performance Lab) in Sunnyvale, CA.


For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 05-Jul-2001

Benchmark run on Tue Jun 12 17:22:57 PDT 2001 by SPECmail2001 v1.01
Report generated on Mon Apr 25 17:24:25 EDT 2005 by SPECmail2001 v1.05 HTML Formatter