Skip to content

IT-4996/IT/LT Storage benchmark

Requirements

The storage performance of the proposed equipment shall be measured according to the instructions of this document.

All tests shall be performed with the required Red Hat Enterprise Linux 9.5 installation. The results of the storage measurements shall be reported to CERN in the technical questionnaire (Annex A).

Storage benchmark on the storage expansion unit

The system unit shall be connected to the storage expansion unit through one Mini-SAS SFF-8644 cable.

All available block devices in the attached storage expansion unit shall be used for this test. None of the solid-state drives in the server shall be used. This test shall be run independently from the one above.

  1. Get the list of available block devices (e.g.: /dev/sdb, /dev/sdc, etc...) using lsscsi and keep only the ones corresponding to the storage drives physically located in the storage expansion unit.

  2. Run:

  3. Sequential write test with 1MB record size (full write on all disks, duration: 1h)
fio --direct=1 --ioengine=libaio --rw=write --bs=1m --time_based --runtime=1h --group_reporting --write_bw_log=storage-expansion-write.bw.log --log_avg_msec=10000 --output=storage-expansion-write.log --name=/dev/sd{a..x}
  • Sequential read test with 1MB record size (duration: 1h)
fio --direct=1 --ioengine=libaio --rw=read --bs=1m --time_based --runtime=1h --group_reporting --output=storage-expansion-read.log --name=/dev/sd{a..x}
  • Random read test with record size from 4 to 128 kB (duration: 1h)
fio --direct=1 --ioengine=libaio --rw=randread --bsrange=4k-128k --time_based --runtime=1h --group_reporting --output=storage-expansion-randread.log --name=/dev/sd{a..x}
  • Random write test with record size from 4 to 128 kB (duration: 1h)
fio --direct=1 --ioengine=libaio --rw=randwrite --bsrange=4k-128k --time_based --runtime=1h --group_reporting --output=storage-expansion-randwrite.log --name=/dev/sd{a..x}

Results reporting

Once the tests are over, extract the results with the following command:

for i in storage-expansion-read.log storage-expansion-write.log storage-expansion-randread.log storage-expansion-randwrite.log; do 
  echo -n $i; grep -hE 'READ|WRITE' $i;
done

and report the values in the "Performance measurements" of the Annex A, as shown in the following example:

  • Output
storage-expansion-read.log   READ: bw=2272MiB/s (2383MB/s), 2272MiB/s-2272MiB/s (2383MB/s-2383MB/s), io=133GiB (143GB), run=60001-60001msec
storage-expansion-write.log  WRITE: bw=2589MiB/s (2714MB/s), 2589MiB/s-2589MiB/s (2714MB/s-2714MB/s), io=758GiB (814GB), run=300001-300001msec
storage-expansion-randread.log   READ: bw=283MiB/s (297MB/s), 283MiB/s-283MiB/s (297MB/s-297MB/s), io=16.6GiB (17.8GB), run=60001-60001msec
storage-expansion-randwrite.log  WRITE: bw=2308MiB/s (2420MB/s), 2308MiB/s-2308MiB/s (2420MB/s-2420MB/s), io=135GiB (145GB), run=60001-60001msec
  • Values to report in 4.15
    • 2383MB/s
    • 2714MB/s
    • 297MB/s
    • 2420MB/s