Skip to content

IT-4776/IT CPU benchmark

Requirements

The CPU performance tests shall be conducted on the proposed CPU server that will be given to CERN as a sample. SPEC CPU2006 and all of its configuration and result files shall remain on the sample server(s) if and when handed over to CERN.

All tests shall be performed with the required RHEL 9.5 installation. The results of the HS06 measurements shall be reported to CERN in the technical questionnaire (Annex A). In addition, an archive of all the produced files of the benchmark shall be created and provided to CERN (see point 9. below).

These benchmarks require SPEC CPU2006 v1.2. It is the vendor's responsibility to obtain a copy of this benchmark suite. For information on how to obtain it, please visit www.spec.org.

Running the HS06 benchmark

  1. This is a preparation step which needs to be performed only once. Mount the official SPEC CPU2006 v1.2 DVD and copy the entire disk contents into a local directory called SPEC_CPU2006_v1.2. Create a tar.bz2 archive of the directory called SPEC2006_v12.tar.bz2. Inside the archive there should be only one top level directory called SPEC_CPU2006_v1.2 and inside this directory the contents of the SPEC CPU2006 installation DVD. The next steps need to be followed on each of the system units being benchmarked.

  2. Create the directory HEPSPEC06 under /pool/. Copy the archive obtained from the previous step under /pool/HEPSPEC06.

  3. Unpack the tar ball in the benchmark directory (/pool/HEPSPEC06).
  4. Download the script run_HS06_32bits.sh available at this link. This script contains all the configurations which are required to run the benchmark.
  5. Edit the script and in particular the SITE and PURPOSE fields. It is important to specify the name of the Bidder (more info can be found inside run_HS06_32bits.sh).
  6. Make sure that the script is executable by doing chmod +x run_HS06_32bits.sh.

Info

Please notice that the benchmark will take several hours to complete, it is suggested to launch it from a tmux or screen session

  1. Run the benchmark like this: ./run_HS06_32bits.sh.

  2. Once it is finished, the results will be found in the workdir/suite_results/run_* folders located in the same directory from where the run_HS06_32bits.sh script was launched.

  3. The result of the run(s) is located in the hep-spec_hs06.log file for each run. It can be quickly filtered out for example running grep -r "Final result" from workdir/suite_results/
  4. IMPORTANT: it is mandatory to create an archive of the workdir/suite_results/run_* folders and provide its full content to CERN.

It is important to make sure that enough space is available to host the benchmark image, its produced files and the final results. By default the script assumes that the benchmark image is in /pool and the rest of the data in the same location from where the script is launched. It is permitted to adapt accordingly the script (and the instructions above) to point to a different mount with enough space.