SPEC® CFP2006 Result

Hewlett Packard Enterprise (Test Sponsor: HPE)

ProLiant DL580 Gen9
(2.80 GHz, Intel Xeon E7-8891 v4)

SPECfp®_rate2006 = 1740

SPECfp_rate_base2006 = 1680

CPU2006 license:	3	Test date:	Sep-2016
Test sponsor:	HPE	Hardware Availability:	Aug-2016
Tested by:	HPE	Software Availability:	Dec-2015

Hardware
CPU Name:	Intel Xeon E7-8891 v4
CPU Characteristics:	Intel Turbo Boost Technology up to 3.50 GHz
CPU MHz:	2800
FPU:	Integrated
CPU(s) enabled:	40 cores, 4 chips, 10 cores/chip, 2 threads/core
CPU(s) orderable:	2,4 chip
Primary Cache:	32 KB I + 32 KB D on chip per core
Secondary Cache:	256 KB I+D on chip per core
L3 Cache:	60 MB I+D on chip per chip
Other Cache:	None
Memory:	512 GB (32 x 16 GB 2Rx4 PC4-2400T-R, running at 1600 MHz)
Disk Subsystem:	1 x 800 GB NVMe PCIe SSD, RAID 0
Other Hardware:	DL580 Gen9 NVMe SSD Express Bay Enablement Kit

Software
Operating System:	SUSE Linux Enterprise Server 12 (x86_64) SP1, Kernel 3.12.49-11-default
Compiler:	C/C++: Version 16.0.0.101 of Intel C++ Studio XE for Linux; Fortran: Version 16.0.0.101 of Intel Fortran Studio XE for Linux
Auto Parallel:	No
File System:	xfs
System State:	Run level 3 (multi-user)
Base Pointers:	32/64-bit
Peak Pointers:	32/64-bit
Other Software:	None

Results Table

Benchmark	Base							Peak
Benchmark	Copies	Seconds	Ratio	Seconds	Ratio	Seconds	Ratio	Copies	Seconds	Ratio	Seconds	Ratio	Seconds	Ratio
Results appear in the order in which they were run. Bold underlined text indicates a median measurement.
410.bwaves	80	672	1620	673	1620	672	1620	80	672	1620	673	1620	672	1620
416.gamess	80	876	1790	875	1790	876	1790	80	847	1850	846	1850	848	1850
433.milc	80	484	1520	483	1520	483	1520	80	484	1520	483	1520	483	1520
434.zeusmp	80	387	1880	387	1880	387	1880	80	387	1880	387	1880	387	1880
435.gromacs	80	270	2120	270	2120	273	2090	80	260	2200	258	2210	259	2210
436.cactusADM	80	505	1890	502	1910	498	1920	80	505	1890	502	1910	498	1920
437.leslie3d	80	831	905	834	902	835	900	40	311	1210	312	1210	311	1210
444.namd	80	437	1470	434	1480	434	1480	80	432	1490	431	1490	432	1490
447.dealII	80	322	2840	322	2840	323	2830	80	322	2840	322	2840	323	2830
450.soplex	80	611	1090	612	1090	611	1090	40	307	1090	307	1090	308	1080
453.povray	80	184	2320	183	2330	182	2340	80	157	2720	157	2710	157	2720
454.calculix	80	266	2480	265	2490	262	2520	80	266	2480	265	2490	262	2520
459.GemsFDTD	80	1098	773	1098	773	1096	775	80	1098	773	1098	773	1096	775
465.tonto	80	385	2040	385	2040	384	2050	80	357	2200	357	2210	359	2190
470.lbm	80	711	1550	711	1550	711	1550	80	711	1550	711	1550	711	1550
481.wrf	80	502	1780	508	1760	501	1780	80	500	1790	500	1790	497	1800
482.sphinx3	80	842	1850	842	1850	834	1870	80	842	1850	842	1850	834	1870

Submit Notes

 The numactl mechanism was used to bind copies to processors. The config file option 'submit'
 was used to generate numactl commands to bind each copy to a specific processor.
 For details, please see the config file.

Operating System Notes

 Stack size set to unlimited using "ulimit -s unlimited"
 Transparent Huge Pages enabled with:
  echo always > /sys/kernel/mm/transparent_hugepage/enabled
 Filesystem page cache cleared with:
  echo 1 >       /proc/sys/vm/drop_caches
 runspec command invoked through numactl i.e.:
  numactl --interleave=all runspec <etc>

Platform Notes

 BIOS Configuration:
   HP Power Profile set to Custom
   HP Power Regulator to HP Static High Performance Mode
   Minimum Processor Idle Power Core C-State set to C6 State
   Minimum Processor Idle Power Package C-State set to No Package State
   QPI Snoop Configuration set to Cluster On Die
   Collaborative Power Control set to Disabled
   Thermal Configuration set to Maximum Cooling
   Processor Power and Utilization Monitoring set to Disabled

 Sysinfo program /home/hp_binary/cpu2006/config/sysinfo.rev6914
 $Rev: 6914 $ $Date:: 2014-06-25 #$ e3fbb8667b5a285932ceab81e28219e1
 running on linux-vi0i Fri Sep  9 01:24:57 2016

 This section contains SUT (System Under Test) info as seen by
 some common utilities.  To remove or add to this section, see:
   http://www.spec.org/cpu2006/Docs/config.html#sysinfo

 From /proc/cpuinfo
    model name : Intel(R) Xeon(R) CPU E7-8891 v4 @ 2.80GHz
       4 "physical id"s (chips)
       80 "processors"
    cores, siblings (Caution: counting these is hw and system dependent.  The
    following excerpts from /proc/cpuinfo might not be reliable.  Use with
    caution.)
       cpu cores : 10
       siblings  : 20
       physical 0: cores 5 9 10 11 13 18 24 26 28 29
       physical 1: cores 5 9 10 11 13 18 24 26 28 29
       physical 2: cores 5 9 10 11 13 18 24 26 28 29
       physical 3: cores 5 9 10 11 13 18 24 26 28 29
    cache size : 30720 KB

 From /proc/meminfo
    MemTotal:       529315636 kB
    HugePages_Total:       0
    Hugepagesize:       2048 kB

 From /etc/*release* /etc/*version*
    SuSE-release:
       SUSE Linux Enterprise Server 12 (x86_64)
       VERSION = 12
       PATCHLEVEL = 1
       # This file is deprecated and will be removed in a future service pack or
       release.
       # Please check /etc/os-release for details about this release.
    os-release:
       NAME="SLES"
       VERSION="12-SP1"
       VERSION_ID="12.1"
       PRETTY_NAME="SUSE Linux Enterprise Server 12 SP1"
       ID="sles"
       ANSI_COLOR="0;32"
       CPE_NAME="cpe:/o:suse:sles:12:sp1"

 uname -a:
    Linux linux-vi0i 3.12.49-11-default #1 SMP Wed Nov 11 20:52:43 UTC 2015
    (8d714a0) x86_64 x86_64 x86_64 GNU/Linux

 run-level 3 Sep 9 01:20

 SPEC is set to: /home/hp_binary/cpu2006
    Filesystem     Type  Size  Used Avail Use% Mounted on
    /dev/nvme0n1p4 xfs   703G  120G  584G  17% /home
 Additional information from dmidecode:

    Warning: Use caution when you interpret this section. The 'dmidecode' program
    reads system data which is "intended to allow hardware to be accurately
    determined", but the intent may not be met, as there are frequent changes to
    hardware, firmware, and the "DMTF SMBIOS" standard.

   BIOS HP U17 08/06/2016
   Memory:
    64x UNKNOWN NOT AVAILABLE
    32x UNKNOWN NOT AVAILABLE 16 GB 2 rank 2400 MHz, configured at 1600 MHz

 (End of data from sysinfo program)
 Regarding the sysinfo display about the memory installed, the correct amount of
 memory is 512 GB and the dmidecode description should have one line reading as:
 32x UNKNOWN NOT AVAILABLE 16 GB 2 rank 2400 MHz, configured at 1600 MHz

General Notes

Environment variables set by runspec before the start of the run:
LD_LIBRARY_PATH = "/home/hp_binary/cpu2006/libs/32:/home/hp_binary/cpu2006/libs/64:/home/hp_binary/cpu2006/sh"

 Binaries compiled on a system with 1x Intel Xeon E5-2660 v4 CPU + 128GB
 memory using RedHat EL 7.2

Base Compiler Invocation

C benchmarks:

icc -m64

C++ benchmarks:

icpc -m64

Fortran benchmarks:

ifort -m64

Benchmarks using both Fortran and C:

icc -m64 ifort -m64

Base Portability Flags

410.bwaves:	-DSPEC_CPU_LP64
416.gamess:	-DSPEC_CPU_LP64
433.milc:	-DSPEC_CPU_LP64
434.zeusmp:	-DSPEC_CPU_LP64
435.gromacs:	-DSPEC_CPU_LP64 -nofor_main
436.cactusADM:	-DSPEC_CPU_LP64 -nofor_main
437.leslie3d:	-DSPEC_CPU_LP64
444.namd:	-DSPEC_CPU_LP64
447.dealII:	-DSPEC_CPU_LP64
450.soplex:	-DSPEC_CPU_LP64
453.povray:	-DSPEC_CPU_LP64
454.calculix:	-DSPEC_CPU_LP64 -nofor_main
459.GemsFDTD:	-DSPEC_CPU_LP64
465.tonto:	-DSPEC_CPU_LP64
470.lbm:	-DSPEC_CPU_LP64
481.wrf:	-DSPEC_CPU_LP64 -DSPEC_CPU_CASE_FLAG -DSPEC_CPU_LINUX
482.sphinx3:	-DSPEC_CPU_LP64

Base Optimization Flags

Peak Compiler Invocation

C benchmarks:

icc -m64

C++ benchmarks (except as noted below):

	icpc -m64
450.soplex:	icpc -m32 -L/opt/intel/compilers_and_libraries_2016/linux/lib/ia32_lin

Fortran benchmarks:

ifort -m64

Benchmarks using both Fortran and C:

icc -m64 ifort -m64

Peak Portability Flags

410.bwaves:	-DSPEC_CPU_LP64
416.gamess:	-DSPEC_CPU_LP64
433.milc:	-DSPEC_CPU_LP64
434.zeusmp:	-DSPEC_CPU_LP64
435.gromacs:	-DSPEC_CPU_LP64 -nofor_main
436.cactusADM:	-DSPEC_CPU_LP64 -nofor_main
437.leslie3d:	-DSPEC_CPU_LP64
444.namd:	-DSPEC_CPU_LP64
447.dealII:	-DSPEC_CPU_LP64
450.soplex:	-D_FILE_OFFSET_BITS=64
453.povray:	-DSPEC_CPU_LP64
454.calculix:	-DSPEC_CPU_LP64 -nofor_main
459.GemsFDTD:	-DSPEC_CPU_LP64
465.tonto:	-DSPEC_CPU_LP64
470.lbm:	-DSPEC_CPU_LP64
481.wrf:	-DSPEC_CPU_LP64 -DSPEC_CPU_CASE_FLAG -DSPEC_CPU_LINUX
482.sphinx3:	-DSPEC_CPU_LP64

Peak Optimization Flags

C benchmarks:

433.milc:	basepeak = yes
470.lbm:	basepeak = yes
482.sphinx3:	basepeak = yes

C++ benchmarks:

444.namd:	-xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -static(pass 2) -opt-mem-layout-trans=3(pass 2) -prof-use(pass 2) -fno-alias -auto-ilp32
447.dealII:	basepeak = yes
450.soplex:	-xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -static(pass 2) -opt-mem-layout-trans=3(pass 2) -prof-use(pass 2) -opt-malloc-options=3
453.povray:	-xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -static(pass 2) -opt-mem-layout-trans=3(pass 2) -prof-use(pass 2) -unroll4 -ansi-alias

Fortran benchmarks:

410.bwaves:	basepeak = yes
416.gamess:	-xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -static(pass 2) -prof-use(pass 2) -unroll2 -inline-level=0 -scalar-rep-
434.zeusmp:	basepeak = yes
437.leslie3d:	-xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -static(pass 2) -prof-use(pass 2) -opt-malloc-options=3 -opt-prefetch
459.GemsFDTD:	basepeak = yes
465.tonto:	-xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -static(pass 2) -prof-use(pass 2) -unroll4 -auto -inline-calloc -opt-malloc-options=3

Benchmarks using both Fortran and C:

435.gromacs:	-xCORE-AVX2(pass 2) -prof-gen:threadsafe(pass 1) -ipo(pass 2) -O3(pass 2) -no-prec-div(pass 2) -par-num-threads=1(pass 1) -static(pass 2) -opt-mem-layout-trans=3(pass 2) -prof-use(pass 2) -opt-prefetch -auto-ilp32
436.cactusADM:	basepeak = yes
454.calculix:	basepeak = yes
481.wrf:	-xCORE-AVX2 -ipo -O3 -no-prec-div -static -auto-ilp32

The flags files that were used to format this result can be browsed at
http://www.spec.org/cpu2006/flags/HP-Compiler-Flags-Intel-V1.2-HSW-revF.html,
http://www.spec.org/cpu2006/flags/HP-Platform-Flags-Intel-V1.2-HSW-revE.html.

You can also download the XML flags sources by saving the following links:
http://www.spec.org/cpu2006/flags/HP-Compiler-Flags-Intel-V1.2-HSW-revF.xml,
http://www.spec.org/cpu2006/flags/HP-Platform-Flags-Intel-V1.2-HSW-revE.xml.