Spectre and Meltdown Testing on a E3-1270 v3

Following on from the previous post concerning OpenFOAM benchmarks against spectre and meltdown fixes, the next set come from a Dell T1700 (E3-1270 v3, 16GB RAM) but this time we’ve looked at more applications, specifically:

  1. MATLAB 2017b
  2. CFD-ACE+ 2015
  3. ANSYS 18.2

The methodology for the tests was to run the benchmarks three or four times to get an average reading (with standard deviation) for three cases:

  1. Base system as it was;
  2. Fully patched system but with RedHat tuneables off, and;
  3. Fully patched system with RedHat tuneables on.

For refernce the base system was running Dell’s A19 BIOS and RedHat’s kernel 3.10.0-514.6.1.el7.x86_64.  Whereas the final system was running A24 and 3.10.0-693.11.6.el7.x86_64, respectively.  The results are all relative to the base case with the “Relative Difference” column computed as:





t

new





t

base





with the standard deviation column being a normalise sample standard deviation.

Interestingly, the results indicated that patching a very old BIOS may increase the performance of your code.  For example, the MATLAB benchmarks ran faster across the board after applying both the BIOS patches and the OS patches.

Alternatively, both CFD-ACE+ and ANSYS, in general, saw a speed increase with the BIOS patches, as would be expected with the more efficient microcode updates in place, but then decreased after applying RedHat’s suggested mitigation tunables.

Again, the conclusion is that for these workloads there is relatively little hit for applying the BIOS and OS patches, especially if you are already running an older BIOS without modern microcode updates.

The full results are listed below.

First up were the MATLAB 2017B results, as shown in the table below.

BaseBIOS OnlyBIOS + Kernel
RefSTD DevRel DiffSTD DevRel DiffSTD Dev
Matrix12.058%0.9650.823%0.9030.028%
FFT10.577%0.8310.193%0.8272.061%
Wavelet10.071%0.9970.061%0.9750.028%

Followed with the CFD-ACE+ results, as listed below.

BaseBIOS OnlyBIOS + Kernel
RefSTD DevRel DiffSTD DevRel DiffSTD Dev
VOF10.841%0.9840.031%1.0230.111%
Multi410.219%0.9940.233%1.0090.253%

Finally the ANSYS 18.2 results, as listed below.

BaseBIOS OnlyBIOS + Kernel
RefSTD DevRel DiffSTD DevRel DiffSTD Dev
Couple12.000%1.0071.147%0.9931.162%
V18sp-112.244%0.9481.624%0.9672.030%

Finally, thanks for reading this article and please leave a comment below. If you are interested in being updated when similar items are posted then either subscribe via RSS or sign up to my mailing list below.

Site Footer