SPEC Seal of Reviewal SPECmail2001 Result
Copyright © 1999-2001 Standard Performance Evaluation Corporation
CommuniGate Pro Dynamic Cluster with BlueArc & Intel SPECmail2001 msgs/min = 12,500
SPEC license # 000078 Tested by:
CommuniGate Systems
Test date:
Jul-2005
Hardware Avail:
Feb-2005
Software Avail:
Jun-2005

12,500 SPECmail2001 messages per minute is equivalent to 2,500,000 SPECmail2001_users.

Detail Summary | General Notes
System configurations: CommuniGate Pro Dynamic Cluster - Backend Servers | High Speed Network File Server for Main Mail Storage | CommuniGate Pro Dynamic Cluster - Frontend Servers | Load generator | Sink | Benchmark Manager/DNS Servers | Configuration diagram


Summary Results
Function Response
time limit
(seconds)
Required
Percentage
Compliant
Percentage Compliant
80% 100% 120%
SMTP Connect 5 >95% 100.00% 100.00% 100.00%
SMTP Data 5 >95% 99.98% 99.98% 99.93%
POP Connect 5 >95% 100.00% 100.00% 100.00%
POP Status 5 >95% 100.00% 100.00% 100.00%
POP Retrieve 5 >95% 100.00% 100.00% 100.00%
POP Delete 5 >95% 100.00% 100.00% 100.00%
Delivery Time 60 >95% 99.05% 99.09% 63.73%
Error Rate NA <1% 0.00% 0.00% 0.00%

CommuniGate Pro Dynamic Cluster - Backend Servers (4 systems)
Software
CommuniGate Pro: CommuniGate Pro v4.3.6 Operating System: Sun Solaris 10 x86
Availability: Jun-2005 File System: UFS for the OS, NFS for the message store
Hardware
Vendor: Intel CPU: Intel Xeon x86_64 (Potomac)
Model Name: Intel SR6850HW4 4CPU Xeon (Potomac) CPU MHz: 3325
Availability: Feb-2005 CPUs Enabled: 4
Disk Subsystem: Internal 36GB SCSI disk for the OS, NFS file server for the message store Primary Cache: 16K
Memory (MB): 16384 Secondary Cache: 1024K
Network: Intel NetXtreme BCM5704 Gigabit Ethernet Other Cache: 8MB
# of Systems: 4 Other: HyperThreading is disabled in the BIOS
Notes / Tuning Information
CommuniGate Pro Backend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/CommuniGate on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700008 on Wed Jun 29 22:16:54 2005
Backend Server temporary directory mounted on a 2GB /tmpfs partition.
This is a temporary partition on the Backend Servers for temporary files that, in a failure,
would be stored to stable storage on the Frontend Servers. This method is a fully safe and RFC-compliant setup for production use.
swap on /tmpfs type tmpfs read/write/setuid/devices/xattr/size=2048m/dev=4480005 on Tue Jun 21 16:51:29 2005

High Speed Network File Server for Main Mail Storage (1 system)
Software
BOS: BlueArc OS 4.0.824n Operating System: Firmware 4.0.824n
Availability: May-2005 File System: SiliconFS
Hardware
Vendor: BlueArc CPU: One MPC 7457B + 7 FPGAs (CPU manufacturer is Freescale/Motorola)
Model Name: BlueArc Titan32 Silicon Server CPU MHz: 1264
Availability: Jan-2004 CPUs Enabled: 1
Disk Subsystem: 140 146GB 10kRPM FC disks Primary Cache: 32KBI + 32KBD on chip
Memory (MB): 14GB Secondary Cache: 512KB(I+D) on chip
Network: 4x 1 Gb Ethernet Other Cache: N/A
# of Systems: 1 Other: N/A
Notes / Tuning Information
Five (5) 2882 controller modules (each with two (2) redundant Raid Controllers) and
112 10kRPM FC disks in eight (8) RAID5 stripes including eight (8) hot spares for the
CGPro Backend Servers shared storage, exported as 192.168.64.112:/CommuniGate.
28 10kRPM FC disks in two (2) RAID5 stripes including two (2) hot spares for the
CGPro Frontend Servers shared storage, exported as 192.168.64.112:/vol1.

CommuniGate Pro Dynamic Cluster - Frontend Servers (5 systems)
Software
CommuniGate Pro: CommuniGate Pro v4.3.6 Operating System: Sun Solaris 10 x86
Availability: Jun-2005 File System: UFS for the OS, NFS for the message store
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: Internal 40GB 7200RPM IDE for the OS, NFS file server for the message store Primary Cache: 8K
Memory (MB): 2048 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 5 Other: HyperThreading is disabled in the BIOS
Notes / Tuning Information
CommuniGate Pro Frontend Servers
Sun Solaris 10 x86, patched to current
Tuning:
ulimit -n 65535
ndd -set /dev/tcp tcp_recv_hiwat 65536
ndd -set /dev/tcp tcp_xmit_hiwat 65536
ndd -set /dev/tcp tcp_conn_req_max_q 512
ndd -set /dev/tcp tcp_conn_req_max_q0 5120
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 135000
ndd -set /dev/tcp tcp_time_wait_interval 60000
ndd -set /dev/tcp tcp_naglim_def 1
ndd -set /dev/tcp tcp_keepalive_interval 30000
/etc/system:
set rlim_fd_cur=8192
set rlim_fd_max=65536
set maxusers=4096
NFS mount options:
192.168.64.112:/vol1 on /data type nfs remote/read/write/setuid/devices/bg/hard/intr/proto=tcp/rsize=32768/wsize=32768/timeo=600/vers=3/xattr/dev=4700003 on Wed Jun 29 22:16:53 2005

Load generator (10 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: SunOS 5.8 Generic_108528-18
Availability: Apr-2001 File System: UFS
Hardware
Vendor: Sun CPU: UltraSPARC IIIi
Model Name: Sun v210 CPU MHz: 1002
Availability: Aug-2002 CPUs Enabled: 2
Disk Subsystem: Ultra160 SCSI 36GB Primary Cache: 32K
Memory (MB): 2048 Secondary Cache: 1MB
Network: Gb Ethernet Other Cache: N/A
# of Systems: 10 Other: N/A
Notes / Tuning Information
N/A

Sink (3 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: Fedora Core 1
Availability: Apr-2001 File System: ext3
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: Diskless systems, booted from NFS server Primary Cache: 8K
Memory (MB): 1024 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 3 Other: N/A
Notes / Tuning Information
N/A

Benchmark Manager/DNS Servers (2 systems)
Software
JVM: Sun Java J2RE 1.4.2_08 (no JIT) Operating System: RedHat Release 9
Availability: Apr-2001 File System: ext3
Hardware
Vendor: Amax CPU: Intel Xeon x86
Model Name: Amax Rackplex 1U 2x Xeon U320 Server CPU MHz: 2800
Availability: Mar-2004 CPUs Enabled: 2
Disk Subsystem: 1 x 40GB 7200RPM IDE, ReiserFS filesystem Primary Cache: 8K
Memory (MB): 1024 Secondary Cache: 512K
Network: Gb Ethernet Other Cache: N/A
# of Systems: 2 Other: N/A
Notes / Tuning Information
BIND 9.2.1 DNS Server on both systems

General Notes / Tuning Information
CommuniGate Pro configuration:
Queue Foldering: 100
Enqueuer Processors: 50
Dequeuer Processors: 10
TextMailBox mailbox option (default)
Index Mailboxes larger than: 300 Kbytes
SMTP Channels: 7500
SMTP Channels/Host: 50
LOCAL Processes: 10 (Backends)
LOCAL Processes: 500 (Frontends)
LOCAL Flow Control: unlimited
POP Channels: 50000
IMAP Channels: 50000
PWD Channels: 50
Cluster Domains->Account Storage->Foldering Method: Hashed 2 Levels
Cluster Domains->Account Storage->Generate Index: Yes
Backend Servers: Queue Processing->Submit Messages: Remotely (all SMTP submitted to Frontend queues)
Frontend Servers: Queue Processing->Submit Messages: Locally for Others (all SMTP delivered from Frontend queues)

CommuniGate Pro startup options:
--DefaultStackSize 131072 --useNonBlockingSockets --closeStuckSockets --CreateTempFilesDirectly 10
--ClusterBackend  # Backends
--ClusterFrontend # Frontends

Networking:
Cisco 3750 Switch for server connectivity
Cisco 6506 Switch with Sup 720 for BlueArc Titan connectivity

This benchmark was performed at the BlueArc lab in San Jose, California.


For questions about this result, please contact the tester.
For other inquiries, please contact webmaster@spec.org
Copyright © 1999-2001 Standard Performance Evaluation Corporation

First published at SPEC.org on 29-Jul-2005

Benchmark run on Thu Jul 07 03:29:09 PDT 2005 by SPECmail2001 v1.01
Report generated on Mon Aug 15 17:30:30 EDT 2005 by SPECmail2001 v1.05 HTML Formatter