Skip navigation

Standard Performance Evaluation Corporation

 
 

The Standard Performance Evaluation Corporation (SPEC) is a non-profit corporation formed to establish, maintain and endorse a standardized set of relevant benchmarks that can be applied to the newest generation of high-performance computers. SPEC develops benchmark suites and also reviews and publishes submitted results from our member organizations and other benchmark licensees.

What's New:

04/16/2014: - Call for contributions to ICPE 2015: The 6th ACM/SPEC International Conference on Performance Engineering (ICPE 2015) has issued a call for contributions on topics related to performance engineering of software and systems. ICPE 2015 will take place from January 31 to February 4, 2015 in Austin, Texas, USA.

03/27/2014: - SPEC has released a new version of PTDaemon v1.6.3 which is now available to all licensees of SPECpower_ssj2008 and SERT. This release adds support for the Chroma 66203 and 66204. All SPECpower_ssj2008 submissions on or after November 25th, 2014 must be made with v1.6.3 (or higher) of PTDaemon.

03/25/2014: - The Storage Performance Analyzer (SPA) framework just became the newest member of the SPEC RG's repository of peer-reviewed tools for quantitative system evaluation and analysis.

03/25/2014: - The third issue of the SPEC Research Group newsletter is now available. This regular publication provides information on the latest developments, news, and announcements relevant to the benchmarking and quantitative system evaluation communities.

03/18/2014: - SPEC/HPG announces the release of SPEC ACCEL V1.0, a benchmark suite which measures performance with computationally intensive parallel applications running under the OpenCL and OpenACC APIs. The suite exercises the performance of the accelerator, host CPU, memory transfer between host and accelerator, support libraries and drivers, and compilers.

03/18/2014: - SPEC announces the availability of the Chauffer Worklet Development Kit (WDK), designed for use in creating new workloads for use in the Chauffeur framework. Chauffeur was designed to simplify the development of workloads for measuring both performance and energy efficiency.

03/10/2014: - Updates to the SPECviewperf 12 (V12.0.1) and SPECwpc (SPECwpc V1.0.4) have been posted. These updates address a bug that affects performance in the energy-01 and medical-01 viewsets and correct a problem with reporting of screen resolution. Results are not comparable to earlier versions of the SPECviewperf 12 and SPECwpc benchmarks, and going forward all testing should be performed using these updated versions. If you have purchased a commercial license for SPECviewperf or SPECwpc, please contact SPEC for information on obtaining the updates.

02/05/2014: - Registration is now open for ICPE 2014, the 5th ACM/SPEC International Conference on Performance Engineering. The conference takes place in Dublin, Ireland March 22-26. Discounted advance registration rates are available through February 21, 2014.

01/08/2014: - Anshul Gandhi (Carnegie Mellon University, now at IBM T. J. Watson Research Center) has been selected as the winner of the 2013 SPEC Distinguished Dissertation Award for his work on "Dynamic Server Provisioning for Data Center Power Management". The prize will be awarded at the ICPE 2014 International Conference in Dublin, Ireland. The SPEC Distinguished Dissertation Award was established in 2011 to recognize outstanding dissertations within the scope of the SPEC Research Group.

12/18/2013: - SPEC's Graphics Performance Characterization group (SPECgpc) has released SPECviewperf 12, an all-new version of the worldwide standard for measuring graphics performance on systems running under the OpenGL and Direct X application programming interfaces.

12/16/2013: - An updated release of PTDaemon, v1.6.2 is now available to all licensees of SPECpower_ssj2008 and SERT. This release adds support for the Newtons4th PPA5x0. All SPEC benchmark and tool submissions that are made using PTDaemon will require V1.6.2 from June 10th, 2014 onwards.

11/14/2013: - SPEC's Workstation Performance Characterization group has released SPECwpc V1.0, designed to measure all key aspects of workstation performance based on diverse professional applications. A first set of results is available, and the benchmark is available for download in versions for both commercial and non-commercial use.

09/19/2013: - SERT V1.0.2 is now available. This is a point release which includes several enhancements, including support for 32-bit ARM processors, updated documentation and general bugfixes. Current licensees are entitled to a free update.

08/08/2013: - SPECvirt_sc2010 will be retired on February 26, 2014 in favor of its successor, SPECvirt_sc2013. New result submissions will be accepted through February 26, 2014. After that time, no further submissions will be accepted and support will be terminated. As SPECvirt_sc2010 results must be reviewed by SPEC before publication, independent publication of results post-benchmark retirement is not allowed.

07/24/2013: - SPEC's Application Performance Characterization project group has released an updated SPECapc benchmark for Siemens NX 8.5. New features in SPECapc for NX 8.5 include quality control improvements, faster runtimes and automatic collection of system information for result submissions for publication on the SPEC website.

07/24/2013: - An updated release of PTDaemon, V1.6.1, is now available. This release includes support for the Newtons4th PPA5530 power analyzer, together with some optimizations in support of the SERT V1.0.1 release, All SPEC benchmark and tool submissions that are made while using PTDaemon will require V1.6.1 from January 14th , 2014 onwards.

07/24/2013: - An update to the SERT, V1.0.1 is now available. This release includes significant enhancements to simplify selecting appropriate JVM options and counts as part of SERT configuration. The GUI has been significantly updated to support this new feature, together with other usability enhancements suggested by early adopters. Support for PowerLinux has been added, and significant documentation updates are also included. Existing users of SERT V1.0.0 are strongly encouraged to download this update and begin testing with it.

07/08/2013: - The second issue of the SPEC Research Group newsletter is now available. This regular publication provides information on the latest developments, news, and announcements relevant to the benchmarking and quantitative system evaluation communities.

07/01/2013: - SPECjbb2005 will be retired on October 1, 2013 in favor of its successor, SPECjbb2013. New result submissions will be accepted through October 1, 2013. After that time, no further submissions will be accepted and support will be terminated. Please see the SPECjbb2005 benchmark information page for further information regarding independent publication of results post-benchmark retirement.

06/20/2013: - The 5th ACM/SPEC International Conference on Performance Engineering (ICPE 2014) has issued a call for papers on topics related to performance engineering of software and systems.

06/06/2013: - Call for Nominations: SPEC Distinguished Dissertation Award 2013. SPEC's Distinguished Dissertation Award aims to recognize outstanding doctoral dissertations in the field of computer benchmarking, performance evaluation, and experimental system analysis in general. The award is open to dissertations that have been defended between October 1, 2012, and September 30, 2013, and the nomination submission deadline is September 30, 2013.

05/22/2013: - SPEC announces the release of SPECvirt_sc2013, the latest benchmark suite for performance evaluation of datacenter servers used in virtualized server consolidation. While sharing the general architecture of SPECvirt_sc2010, the new benchmark utilizes heavier and more bursty workloads that require virtual machines with more memory and vCPUs and further stress the system's ability to meet the benchmark's quality of service requirements. Changes include modified workloads and the replacement of the Idle Server with the Batch Server.

[Older items can be found in the archive.]