Skip navigation

Standard Performance Evaluation Corporation

Facebook logo LinkedIn logo Twitter logo Google+ logo
 
 

The SPECjbb®2015 benchmark has been developed from the ground up to measure performance based on the latest Java application features. It is relevant to all audiences who are interested in Java server performance, including JVM vendors, hardware developers, Java application developers, researchers and members of the academic community.

January 16, 2019: The SPECjbb® 2015 benchmark V1.02 is now available, which implements support for Java SE 11 and later. Documentation has been updated, specifically:

  • Run and Reporting Rules
    • Updated section 2.6
  • Result File Field Descriptions
    • Added CVE reporting requirements (5.1.33)
    • Disclosure of BIOS version (5.1.16)
    • Notes section for each component of the SUT should give a brief description of how this component is supported
      • 5.1.33 Notes
      • 5.2.7 Notes
      • 5.3.7 OS Notes
      • 5.4.7 JVM Notes
  • FAQ
    • Various updates and new entries
  • Known Issues
    • Various updates and new entries

While Java SE 10 (and earlier) results using V1.02 remain comparable to V1.01 results, V1.01 will not work with Java SE 11 or later. This makes it important to move ahead to V1.02. As of April 25, 2019, all result submissions must be made using V1.02 and V1.01 has been retired.

Licensees of version 1.0 and 1.01 are entitled to a complimentary V1.02 upgrade.


For a list of changes in the SPECjbb®2015 benchmark relative to the retired SPECjbb®2013 benchmark, please see the release notes.

Benchmark architecture diagram

Features include:

  • A usage model based on a world-wide supermarket company with an IT infrastructure that handles a mix of point-of-sale requests, online purchases and data-mining operations.
  • Both a pure throughput metric and a metric that measures critical throughput under service level agreements (SLAs) specifying response times ranging from 10ms to 100ms.
  • Support for multiple run configurations, enabling users to analyze and overcome bottlenecks at multiple layers of the system stack, including hardware, OS, JVM and application layers.
  • Exercising new Java 7 features and other important performance elements, including the latest data formats (XML), communication using compression, and messaging with security.
  • Support for virtualization and cloud environments.

Results

Submitted Results
Includes all of the results submitted to SPEC from licensees of the benchmark.

Information

Press Release
Benchmark Documentation