| MPI2007 license: | 4 | Test date: | Apr-2010 |
|---|---|---|---|
| Test sponsor: | SGI | Hardware Availability: | May-2010 |
| Tested by: | SGI | Software Availability: | Feb-2010 |
| Benchmark | Base | Peak | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | Ranks | Seconds | Ratio | Seconds | Ratio | Seconds | Ratio | |
| Results appear in the order in which they were run. Bold underlined text indicates a median measurement. | ||||||||||||||
| 121.pop2 | 1536 | 145 | 26.9 | 140 | 27.7 | 143 | 27.2 | |||||||
| 122.tachyon | 1536 | 278 | 6.99 | 189 | 10.3 | 189 | 10.3 | |||||||
| 125.RAxML | 1536 | 191 | 15.3 | 192 | 15.2 | 191 | 15.3 | |||||||
| 126.lammps | 1536 | 68.0 | 36.2 | 68.2 | 36.1 | 68.0 | 36.1 | |||||||
| 128.GAPgeofem | 1536 | 144 | 41.2 | 144 | 41.3 | 144 | 41.2 | |||||||
| 129.tera_tf | 1536 | 71.4 | 15.4 | 69.3 | 15.8 | 69.5 | 15.8 | |||||||
| 132.zeusmp2 | 1536 | 53.6 | 39.6 | 51.7 | 41.0 | 50.9 | 41.7 | |||||||
| 137.lu | 1536 | 51.5 | 81.5 | 51.1 | 82.3 | 51.1 | 82.3 | |||||||
| 142.dmilc | 1536 | 48.2 | 76.5 | 46.0 | 80.1 | 46.1 | 80.0 | |||||||
| 143.dleslie | 1536 | 60.8 | 51.0 | 60.9 | 50.9 | 63.0 | 49.2 | |||||||
| 145.lGemsFDTD | 1536 | 108 | 41.0 | 109 | 40.5 | 108 | 41.0 | |||||||
| 147.l2wrf2 | 1536 | 202 | 40.6 | 213 | 38.4 | 211 | 38.9 | |||||||
| Hardware Summary | |
|---|---|
| Type of System: | Homogeneous |
| Compute Node: | SGI Altix ICE 8400EX Compute Node |
| Interconnects: | InfiniBand (MPI) InfiniBand (I/O) |
| File Server Node: | SGI InfiniteStorage Nexis 2000 NAS |
| Total Compute Nodes: | 128 |
| Total Chips: | 256 |
| Total Cores: | 1536 |
| Total Threads: | 3072 |
| Total Memory: | 3 TB |
| Base Ranks Run: | 1536 |
| Minimum Peak Ranks: | -- |
| Maximum Peak Ranks: | -- |
| Software Summary | |
|---|---|
| C Compiler: | Intel C Compiler for Linux Version 11.1, Build 20100203 |
| C++ Compiler: | Intel C++ Compiler for Linux Version 11.1, Build 20100203 |
| Fortran Compiler: | Intel Fortran Compiler for Linux Version 11.1, Build 20100203 |
| Base Pointers: | 64-bit |
| Peak Pointers: | 64-bit |
| MPI Library: | SGI MPT 1.26 |
| Other MPI Info: | OFED 1.4.1 |
| Pre-processors: | None |
| Other Software: | None |
| Hardware | |
|---|---|
| Number of nodes: | 128 |
| Uses of the node: | compute |
| Vendor: | SGI |
| Model: | SGI Altix ICE 8400EX (Intel Xeon X5670, 2.93 GHz) |
| CPU Name: | Intel Xeon X5670 |
| CPU(s) orderable: | 1-2 chips |
| Chips enabled: | 2 |
| Cores enabled: | 12 |
| Cores per chip: | 6 |
| Threads per core: | 2 |
| CPU Characteristics: | Intel Turbo Boost Technology up to 3.33 GHz Hyper-Threading Technology enabled |
| CPU MHz: | 2933 |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 256 KB I+D on chip per core |
| L3 Cache: | 12 MB I+D on chip per chip |
| Other Cache: | None |
| Memory: | 24 GB (6*4GB DDR3-1333 CL9 RDIMMs) |
| Disk Subsystem: | None |
| Other Hardware: | None |
| Adapter: | Mellanox MT26428 ConnectX IB QDR (PCIe x8 Gen2 5 GT/s) |
| Number of Adapters: | 1 |
| Slot Type: | PCIe x8 Gen2 |
| Data Rate: | InfiniBand 4x QDR |
| Ports Used: | 2 |
| Interconnect Type: | InfiniBand |
| Software | |
|---|---|
| Adapter: | Mellanox MT26428 ConnectX IB QDR (PCIe x8 Gen2 5 GT/s) |
| Adapter Driver: | OFED-1.4.1 |
| Adapter Firmware: | 2.7.0 |
| Operating System: | SUSE Linux Enterprise Server 10 (x86_64) SP3 Kernel 2.6.16.60-0.54.5-smp |
| Local File System: | NFSv3 |
| Shared File System: | NFSv3 IPoIB |
| System State: | Multi-user, run level 3 |
| Other Software: | SGI ProPack 6 for Linux Service Pack 6, SGI Tempo V 1.10 |
| Hardware | |
|---|---|
| Number of nodes: | 1 |
| Uses of the node: | fileserver |
| Vendor: | SGI |
| Model: | SGI Altix XE 240 (Intel Xeon 5140, 2.33 GHz) |
| CPU Name: | Intel Xeon 5140 |
| CPU(s) orderable: | 1-2 chips |
| Chips enabled: | 2 |
| Cores enabled: | 4 |
| Cores per chip: | 2 |
| Threads per core: | 1 |
| CPU Characteristics: | 1333 MHz FSB |
| CPU MHz: | 2333 |
| Primary Cache: | 32 KB I + 32 KB D on chip per core |
| Secondary Cache: | 4 MB I+D on chip per chip |
| L3 Cache: | None |
| Other Cache: | None |
| Memory: | 16 GB (8*2GB DDR2-667MHz DIMMS) |
| Disk Subsystem: | 4.3 TB RAID 5 48 x 146 GB SAS (Seagate Cheetah 15K.5) |
| Other Hardware: | None |
| Adapter: | Mellanox MT25208 InfiniHost III Ex (PCIe x8 Gen1 2.5 GT/s) |
| Number of Adapters: | 2 |
| Slot Type: | PCIe x8 Gen1 |
| Data Rate: | InfiniBand 4x DDR |
| Ports Used: | 2 |
| Interconnect Type: | InfiniBand |
| Software | |
|---|---|
| Adapter: | Mellanox MT25208 InfiniHost III Ex (PCIe x8 Gen1 2.5 GT/s) |
| Adapter Driver: | OFED-1.3 |
| Adapter Firmware: | 5.3.0 |
| Operating System: | SUSE Linux Enterprise Server 10 (x86_64) SP1 Kernel 2.6.16.54-0.2.5-smp |
| Local File System: | xfs |
| Shared File System: | -- |
| System State: | Multi-user, run level 5 |
| Other Software: | SGI ProPack 5 for Linux Service Pack 5 |
| Hardware | |
|---|---|
| Vendor: | Mellanox Technologies |
| Model: | MT26428 ConnectX |
| Switch Model: | Mellanox MT48436 InfiniScale-IV |
| Number of Switches: | 128 |
| Number of Ports: | 36 |
| Data Rate: | InfiniBand 4x QDR |
| Firmware: | 5030004 |
| Topology: | Bristle hypercube |
| Primary Use: | MPI traffic |
| Hardware | |
|---|---|
| Vendor: | Mellanox Technologies |
| Model: | MT26428 ConnectX |
| Switch Model: | Mellanox MT48436 InfiniScale-IV |
| Number of Switches: | 64 |
| Number of Ports: | 36 |
| Data Rate: | InfiniBand 4x QDR |
| Firmware: | 5030004 |
| Topology: | Bristle hypercube |
| Primary Use: | I/O traffic |
The config file option 'submit' was used.
Software environment:
export MPI_REQUEST_MAX=65536
export MPI_TYPE_MAX=32768
export MPI_BUFS_THRESHOLD=1
export MPI_DSM_DISTRIBUTE=yes
export MPI_IB_RAILS=2
ulimit -s unlimited
BIOS settings:
AMI BIOS version 8.16
Hyper-Threading Technology enabled (default)
Intel Turbo Boost Technology enabled (default)
Intel Turbo Boost Technology activated in the OS via
/etc/init.d/acpid start
/etc/init.d/powersaved start
powersave -f
Job Placement:
Each MPI job was assigned to a topologically compact set
of nodes, i.e. the minimal needed number of switches was
used for each job: 2 switches for 96 ranks,
4 switches for 192 ranks, 8 switches for 384 ranks,
16 switches for 768 ranks, 32 switches for 1536 ranks,
64 switches for 3072 ranks.
| icc |
| 126.lammps: | icpc |
| ifort |
| icc ifort |
| 121.pop2: | -DSPEC_MPI_CASE_FLAG |