SPEC's Benchmarks and Published Results
CPU
- SPEC CPU2006
[benchmark info] [published
results] [support] [order
benchmark]
Designed to provide performance measurements that can be used
to compare compute-intensive workloads on different computer
systems, SPEC CPU2006 contains two benchmark suites: CINT2006
for measuring and comparing compute-intensive integer performance,
and CFP2006 for measuring and comparing compute-intensive floating
point performance.
- SPEC CPU2000
[Retired]
- SPEC CPU95
[Retired]
- SPEC CPU92
[Retired]
Graphics and Workstation
Performance
High Performance Computing,
OpenMP, MPI
- SPEC MPI2007
[benchmark info] [published
results] [support] [order
benchmark]
MPI2007 is SPEC's benchmark suite for evaluating MPI-parallel,
floating point, compute intensive performance across a wide range
of cluster and SMP hardware.
- SPEC OMP2001
[benchmark info] [published
results] [support] [order
benchmark]
SPEC's benchmark suite that measures performance using applications
based on the OpenMP standard for shared-memory parallel processing.
The suite consists of OMPM2001 and OMPL2001, which contains larger
working sets and longer run times than OMPM2001.
- SPEC HPC2002
[Retired]
- SPEC HPC96
[Retired]
Java Client/Server
- SPECjAppServer2004
[benchmark info] [published
results] [support]
[order benchmark]
SPECjAppServer2004 is designed to measure the performance of
J2EE 1.3 application servers. This benchmark includes an enhanced
workload by adding a web tier, JMS, and other changes to SPECjAppServer2002.
- SPECjAppServer2002
[Retired]
- SPECjAppServer2001
[Retired]
- SPECjbb2005
[benchmark info] [published
results] [support] [order
benchmark]
A benchmark for evaluating the performance of servers running
typical Java business applications, JBB2005 represents an order
processing application for a wholesale supplier. The benchmark
can be used to evaluate performance of hardware and software
aspects of Java Virtual Machine (JVM) servers.
- SPECjbb2000
[Retired]
- SPECjms2007
[benchmark info] [published
results] [support] [order
benchmark]
SPECjms2007 is the first industry-standard benchmark for evaluating
the performance of enterprise message-oriented middleware servers
based on JMS (Java Message Service). It provides a standard workload
and performance metrics for competitive product comparisons,
as well as a framework for indepth performance analysis of enterprise
messaging platforms.
- SPECjvm2008
[benchmark info] [published
results] [support]
[download benchmark]
SPECjvm2008 is a benchmark suite for measuring the performance
of a Java Runtime Environment (JRE), containing several real
life applications and benchmarks focusing on core java functionality.
The SPECjvm2008 workload mimics a variety of common general purpose
application computations.
- SPEC JVM98
[Retired]
Mail Servers
- SPECmail2008
[benchmark info] [published
results] [support] [order
benchmark]
SPECmail2008 measures performance of enterprise mail servers compliant with
SMTP and IMAP4 protocols. The benchmark uses real-world workloads to simulate
the typical activities of mail servers operating in business enterprises.
- SPECmail2001
[benchmark info] [published
results] [support] [order
benchmark]
A standardized mail server benchmark designed to measure a system's
ability to act as a mail server servicing email requests, based
on the Internet standard protocols SMTP and POP3. The benchmark
characterizes throughput and response time of a mail server system
under test with realistic network connections, disk storage,
and client workloads.
Network File System
Power
- SPECpower_ssj2008
[benchmark info]
SPECpower_ssj2008 is the first industry-standard SPEC benchmark
that evaluates the power and performance characteristics of volume
server class computers. The initial benchmark addresses the performance
of server-side Java, and additional workloads are planned.
SIP
- SPECsip
[info]
SPEC has formed a new subcommittee to develop standard methods
of comparing performance for servers using the Session Initiation
Protocol (SIP).
Virtualization
- Virtualization
[info]
SPEC has formed a new subcommittee to develop standard methods
of comparing virtualization performance for data center servers.
The group is investigating the use of heterogeneous workloads
that are spread across multiple virtual machines on a single
server, and the methods and metrics used by the benchmark will
be defined as part of the working group's efforts.
Web Servers
- SPECweb2005
[benchmark info] [published
results] [support] [order
benchmark]
SPECweb2005 emulates users sending browser requests over broadband
Internet connections to a web server. It provides three new workloads:
a banking site (HTTPS), an e-commerce site (HTTP/HTTPS mix),
and a support site (HTTP). Dynamic content is implemented in
PHP and JSP. The current version is 1.20.
- SPECweb96
[Retired]
- SPECweb99
[Retired]
- SPECweb99_SSL
[Retired]
