ABC-Benchmarking Web Page

Hit Counter

Application Notes

Introduction

Dec 26, 2004: Firing Squad HL2 shootout

July 4, 2003: Itanium2 vs "Beefed P4" html   (also .XLS for details)

Jan.17, 2003: TomsHardware: How do their data scale?

Dec.28, 2002: Two-Point Trend Estimations - Are They any Good?

Dec.22, 2002: Performance Scaling of Individual SPECint2000 results for Pentium-4 

Dec.15,2002: Scalability of SPECint2000 on Pentium-4 Williamette

Dec.15,2002: ClawHammer Performance Estimates (from c't data)

Nov.10,2002: AMD gives Opteron SPEC score trends. How do they scale?

Oct.24, 2002: Opteron: SPECint2k of 1400 must be a challenge (revised)

Oct.23, 2002: Performance Trends in Pentium-4 SPECint2000 Scores

SPEC2k_int_banias

SPEC2k_int_all

For Historical Reference: SPEC_Workshop Presentation Slides, Jan.1999

The goal of this website is to demonstrate that it is possible to learn much more from how benchmarks “scale.” The technique is not entirely new; it is based on an old idea to "profile" a computer with a particular benchmark by varying independently the CPU core and system bus frequencies. However, unlike traditional representations where benchmark scores are charted as a function of core clock frequency, this method looks for functional dependencies ("profiles'') of the benchmark runtime vs. CPU core clock, or in "time domain". In the time domain, the corresponding dependencies appear to be significantly more linear for most statistically representative benchmarks (like SPEC or Winstone). As result, the simple functional form makes the extrapolation of the benchmark results much more reliable when trying to predict system performance into extended frequency ranges that may not be currently attainable. More important, the technique allows to separate effects of internal performance of a processor from the time wasted in off-chip traffic to main memory. To learn more about details of the technique, with multitude of examples, both from web-published and home-grown data, please read the main article Benchmark Scaling Analysis . The author hopes that the technique will be adopted by most advanced benchmarking websites, to facilitate more in-depth analysis of modern personal computers and evaluate overall performance of different computing platforms.

 This page is maintained by Alexei Predtechenski.

Example: Scalability of Pentium-4 Williamette on SPECint2000, i850GB platform

 

Data from: http://www.spec.org/cpu2000/results/cint2000.html