Skip navigation

Standard Performance Evaluation Corporation

Facebook logo LinkedIn logo Twitter logo Google+ logo

The Standard Performance Evaluation Corporation (SPEC) is a non-profit corporation formed to establish, maintain and endorse standardized benchmarks and tools to evaluate performance and energy efficiency for the newest generation of computing systems. SPEC develops benchmark suites and also reviews and publishes submitted results from our member organizations and other benchmark licensees.

What's New:

01/16/2019: The SPECjbb 2015 benchmark has been updated to version 1.02. This update adds support for Java SE 11. Licensees of versions 1.0 and 1.01 are entitled to a complimentary V1.02 upgrade. SPEC will be retiring SPECjbb2015 V1.01 in April 2019, after which time all result submissions must be made with V1.02.

01/16/2019: SPEC Cloud IaaS 2016 is being retired in favor of its successor, SPEC Cloud IaaS 2018. The last date for submitting benchmark results to SPEC for publication on its website is March 6, 2019. On March 6, 2019, the product will no longer be actively supported by SPEC.

12/20/2018: The Kaivalya Dixit Distinguished Dissertation Selection committee has chosen this year to select two winners based on the high quality of both submissions. Matteo Nardelli of the University of Rome and Nikolas Herbst of the Julius-Maximilians-Universität Würzburg. The awards will be presented at the ICPE 2019 conference in Mumbai, India.

12/18/2018: SPEC releases SPEC Cloud IaaS 2018, new benchmark software that measures the performance of infrastructure-as-a-service (IaaS) cloud implementations. It measures replicated application instances, overall performance, relative scalability, and mean instance provisioning time of IaaS cloud implementations, both public and private. It replaces the 2016 version, which will be retired in three months. Licensees of SPEC Cloud IaaS 2016 are eligible for a free upgrade to the 2018 version.

12/04/2018: U.S. EPA adopts SPEC SERT 2.0.1: The United States Department of Energy's (DOE) Environmental Protection Agency (EPA) released the final version of the "ENERGY STAR Version 3.0 Computer Servers Program Requirements" which defines the Active State Efficiency Thresholds that will determine ENERGY STAR eligibility effective June 17, 2019. The new thresholds have been determined using data collected by running the SPEC Server Efficiency Rating Tool (SERT).

11/14/2018: November 2018 marks the 30th anniversary of SPEC. Take a look back at milestones from the last 30 years, from incorporation in 1988 and our first benchmark (SPEC CPU89) to our current 20+ active benchmarks and tools.

10/31/2018: The SPEC Workstation Performance Characterization (SPECwpc) group has released SPECworkstation 3, an all-new version of the benchmark formerly known as SPECwpc. SPECworkstation 3 includes new and updated workloads throughout the benchmark suite; it is free of charge to users.

09/12/2018: SPEC releases SPECjEnterprise2018 Web Profile, a new benchmark measuring full-system performance of Java EE 7 Web Profile application servers and their supporting infrastructure such as JVM, Database, CPU, disk and servers.

08/15/2018: SPEC's Application Performance Characterization (SPECapc) project group has updated its performance evaluation software for systems running Dassault Systemes' Solidworks CAD/CAM application. The new SPECapc for Solidworks 2017 benchmark is designed to run on Microsoft Windows 10 64-bit platforms.

06/25/2018: The 10th ACM/SPEC International Conference on Performance Engineering (ICPE 2019) has issued a call for contributions and it will be held April 7-11, 2019 in Mumbai, India. ICPE brings together researchers and practitioners to report state-of-the-art and in-progress research on performance engineering of software and systems, including performance measurement, modeling, benchmark design, and run-time performance management.

This year's main theme is "performance engineering in the Artificial Intelligence era." The ICPE program committee is looking for contributions that use AI techniques to enhance the performance modeling, estimation, and optimization of complex systems. At the same time, contributions that analyze and improve AI systems are invited for submission.

05/30/2018: SPEC's Research Group has issued a call for nominations for the Kaivalya Dixit Distinguished Dissertation Award recognizing outstanding doctoral dissertations in the field of computer benchmarking, performance evaluation, and experimental system analysis. The award is open to dissertations that have been defended between October 2017 and September 2018.

05/23/2018: The SPEC Graphics Performance Characterization Group (SPECgpc) has released an all-new version of its SPECviewperf graphics performance benchmark. SPECviewperf 13 features new volume visualization viewsets for energy and medical applications, a redesigned GUI, improved scoring and reporting methods, and updated viewsets to support more recent versions of the applications on which they are based.

03/01/2018: As of March 1, 2018, SPEC offers HPG benchmarks (ACCEL, MPI2007, OMP2012) free of charge to qualified non-profit organizations worldwide. Qualified organizations can request a license and software download.


[Older items can be found in the archive.]