lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite for Android: free password hash cracker in your pocket
[<prev] [next>] [day] [month] [year] [list]
Date:   Sat, 31 Aug 2019 17:02:17 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Prarit Bhargava <prarit@...hat.com>
Cc:     Jessica Yu <jeyu@...nel.org>, Barret Rhoden <brho@...gle.com>,
        David Arcari <darcari@...hat.com>,
        Heiko Carstens <heiko.carstens@...ibm.com>,
        LKML <linux-kernel@...r.kernel.org>,
        Linus Torvalds <torvalds@...ux-foundation.org>, lkp@...org
Subject: [kernel/module.c]  6e6de3dee5:  blogbench.read_score 50.6%
 improvement

Greeting,

FYI, we noticed a 50.6% improvement of blogbench.read_score due to commit:


commit: 6e6de3dee51a439f76eb73c22ae2ffd2c9384712 ("kernel/module.c: Only return -EEXIST for modules that have finished loading")
https://kernel.googlesource.com/pub/scm/linux/kernel/git/torvalds/linux.git master

in testcase: blogbench
on test machine: 96 threads Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory
with following parameters:

	disk: 1HDD
	fs: ext4
	cpufreq_governor: performance
	ucode: 0x400001c

test-description: Blogbench is a portable filesystem benchmark that tries to reproduce the load of a real-world busy file server.
test-url: https://www.pureftpd.org/project/blogbench





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/rootfs/tbox_group/testcase/ucode:
  gcc-7/performance/1HDD/ext4/x86_64-rhel-7.2-clear/clear-ota-25590-x86_64-2018-10-18.cgz/lkp-csl-2sp4/blogbench/0x400001c

commit: 
  v5.2-rc2
  6e6de3dee5 ("kernel/module.c: Only return -EEXIST for modules that have finished loading")

        v5.2-rc2 6e6de3dee51a439f76eb73c22ae 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
          1:4          -25%            :4     dmesg.WARNING:at#for_ip_interrupt_entry/0x
          1:4          -25%            :4     dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
          2:4          -50%            :4     dmesg.WARNING:stack_recursion
         %stddev     %change         %stddev
             \          |                \  
   1119184           +50.6%    1685320 ±  4%  blogbench.read_score
    235411           +64.0%     385995 ±  4%  blogbench.time.involuntary_context_switches
      3884           +63.0%       6332        blogbench.time.percent_of_cpu_this_job_got
     11882 ±  2%     +61.6%      19198 ±  3%  blogbench.time.system_time
     84.47 ±  2%     +47.2%     124.33 ±  4%  blogbench.time.user_time
     20949 ±  3%     +17.4%      24588 ±  7%  blogbench.time.voluntary_context_switches
     58.14            +1.8%      59.18        boot-time.boot
      5112            +2.6%       5243        boot-time.idle
     35.69 ±  5%     -74.8%       9.01 ± 18%  iostat.cpu.idle
     40.48           +62.1%      65.62 ±  2%  iostat.cpu.system
     35.34 ±  5%     -26.9        8.43 ± 20%  mpstat.cpu.all.idle%
      0.37 ± 21%      +0.2        0.60 ± 19%  mpstat.cpu.all.soft%
     40.36           +25.1       65.44 ±  2%  mpstat.cpu.all.sys%
      0.30 ±  2%      +0.1        0.44 ±  2%  mpstat.cpu.all.usr%
      1288           +60.5%       2067 ±  2%  turbostat.Avg_MHz
     42.73           +24.6       67.35 ±  2%  turbostat.Busy%
     54.88 ±  5%     -42.0%      31.81 ±  4%  turbostat.CPU%c1
     50.75 ±  2%     +18.7%      60.25 ±  4%  turbostat.CoreTmp
     50.50 ±  2%     +19.8%      60.50 ±  4%  turbostat.PkgTmp
    162.50           +31.7%     214.01        turbostat.PkgWatt
     58.63           +16.1%      68.08        turbostat.RAMWatt
     35.50 ±  5%     -76.1%       8.50 ± 17%  vmstat.cpu.id
     40.00           +61.9%      64.75 ±  2%  vmstat.cpu.sy
     30470 ±  2%     -53.6%      14126 ±  4%  vmstat.io.bo
    350646 ±  5%     +32.1%     463362        vmstat.memory.buff
  36419623 ±  5%     +29.9%   47316972        vmstat.memory.cache
  93718292 ±  2%     -11.8%   82692636        vmstat.memory.free
     32.25 ±  7%     +18.6%      38.25 ±  8%  vmstat.procs.b
     40.75 ±  2%     +65.0%      67.25 ±  2%  vmstat.procs.r
      2630           +17.0%       3078 ±  2%  vmstat.system.cs
   9804347 ± 11%     +57.4%   15433533 ± 24%  numa-meminfo.node0.Active
   9653213 ± 11%     +58.4%   15291848 ± 24%  numa-meminfo.node0.Active(file)
  10110626 ± 13%     +81.7%   18368560 ± 24%  numa-meminfo.node0.Dirty
  14713245 ±  9%     +48.2%   21798582 ± 21%  numa-meminfo.node0.FilePages
   2848610 ± 11%     +50.2%    4278326 ± 23%  numa-meminfo.node0.Inactive
    508.50 ± 13%    +144.9%       1245 ± 56%  numa-meminfo.node0.Inactive(anon)
   2848100 ± 11%     +50.2%    4277080 ± 23%  numa-meminfo.node0.Inactive(file)
   1352359 ± 10%     +52.7%    2065678 ± 25%  numa-meminfo.node0.KReclaimable
  16703019 ±  8%     +46.7%   24498838 ± 22%  numa-meminfo.node0.MemUsed
   1352359 ± 10%     +52.7%    2065678 ± 25%  numa-meminfo.node0.SReclaimable
    184523 ±  9%     +17.8%     217437 ± 12%  numa-meminfo.node0.SUnreclaim
   1536882 ±  8%     +48.6%    2283117 ± 24%  numa-meminfo.node0.Slab
     38616 ± 15%     -94.0%       2322 ±  8%  numa-meminfo.node0.Writeback
     41888 ±  8%     -98.7%     530.00 ± 51%  numa-meminfo.node1.Writeback
  22777347 ±  6%     +36.1%   31004296        meminfo.Active
  22491524 ±  6%     +36.5%   30701488        meminfo.Active(file)
    349971 ±  5%     +32.5%     463538        meminfo.Buffers
  33232464 ±  5%     +30.1%   43226409        meminfo.Cached
    178508 ±  4%     +33.8%     238924 ±  9%  meminfo.DirectMap4k
  24734383 ±  7%     +52.7%   37757502        meminfo.Dirty
   6644926 ±  6%     +28.3%    8524831        meminfo.Inactive
      1344 ± 12%     +99.2%       2678 ±  9%  meminfo.Inactive(anon)
   6643581 ±  6%     +28.3%    8522153        meminfo.Inactive(file)
   3125659 ±  5%     +31.5%    4109844        meminfo.KReclaimable
  93780301 ±  2%     -11.8%   82673358        meminfo.MemFree
  37906661 ±  5%     +29.3%   49013609        meminfo.Memused
   3125659 ±  5%     +31.5%    4109844        meminfo.SReclaimable
   3501655 ±  5%     +28.9%    4514065        meminfo.Slab
     80502 ±  4%     -96.5%       2824 ±  6%  meminfo.Writeback
   2414752 ± 12%     +58.4%    3824207 ± 24%  numa-vmstat.node0.nr_active_file
   3408517 ±  7%     +53.9%    5246630 ± 22%  numa-vmstat.node0.nr_dirtied
   2529331 ± 13%     +81.6%    4593409 ± 24%  numa-vmstat.node0.nr_dirty
   3680205 ±  9%     +48.1%    5451128 ± 21%  numa-vmstat.node0.nr_file_pages
    126.75 ± 13%    +145.4%     311.00 ± 56%  numa-vmstat.node0.nr_inactive_anon
    712477 ± 11%     +50.1%    1069501 ± 23%  numa-vmstat.node0.nr_inactive_file
    338266 ± 10%     +52.7%     516584 ± 25%  numa-vmstat.node0.nr_slab_reclaimable
     46102 ±  9%     +17.9%      54339 ± 12%  numa-vmstat.node0.nr_slab_unreclaimable
      9634 ± 15%     -94.1%     573.00 ±  8%  numa-vmstat.node0.nr_writeback
    808239 ± 11%     -28.1%     580734 ±  8%  numa-vmstat.node0.nr_written
   2414751 ± 12%     +58.4%    3824207 ± 24%  numa-vmstat.node0.nr_zone_active_file
    126.75 ± 13%    +145.4%     311.00 ± 56%  numa-vmstat.node0.nr_zone_inactive_anon
    712476 ± 11%     +50.1%    1069500 ± 23%  numa-vmstat.node0.nr_zone_inactive_file
   2538986 ± 13%     +80.9%    4594032 ± 24%  numa-vmstat.node0.nr_zone_write_pending
   6729657 ±  7%     +39.8%    9404734 ± 14%  numa-vmstat.node0.numa_hit
   6713514 ±  7%     +39.9%    9389324 ± 14%  numa-vmstat.node0.numa_local
     10426 ±  8%     -98.7%     132.00 ± 53%  numa-vmstat.node1.nr_writeback
    579388 ± 18%     -86.5%      78057 ± 45%  numa-vmstat.node1.nr_written
     71447 ±  2%      +5.9%      75687 ±  3%  proc-vmstat.nr_active_anon
   5620797 ±  5%     +36.6%    7675374        proc-vmstat.nr_active_file
   6181432 ±  7%     +52.7%    9439745        proc-vmstat.nr_dirty
   8392991 ±  5%     +30.1%   10922655        proc-vmstat.nr_file_pages
  23448012 ±  2%     -11.9%   20668103        proc-vmstat.nr_free_pages
    335.50 ± 12%    +101.9%     677.25 ±  6%  proc-vmstat.nr_inactive_anon
   1660364 ±  6%     +28.3%    2130703        proc-vmstat.nr_inactive_file
      5341            +5.0%       5608        proc-vmstat.nr_mapped
    781146 ±  5%     +31.5%    1027461        proc-vmstat.nr_slab_reclaimable
     93909            +7.6%     101083        proc-vmstat.nr_slab_unreclaimable
     20032 ±  5%     -96.5%     707.25 ±  6%  proc-vmstat.nr_writeback
   1970380 ±  3%     -61.8%     752776 ±  3%  proc-vmstat.nr_written
     71447 ±  2%      +5.9%      75687 ±  3%  proc-vmstat.nr_zone_active_anon
   5620797 ±  5%     +36.6%    7675374        proc-vmstat.nr_zone_active_file
    335.50 ± 12%    +101.9%     677.25 ±  6%  proc-vmstat.nr_zone_inactive_anon
   1660364 ±  6%     +28.3%    2130703        proc-vmstat.nr_zone_inactive_file
   6201523 ±  7%     +52.2%    9440557        proc-vmstat.nr_zone_write_pending
  16896949            +5.9%   17888935 ±  2%  proc-vmstat.numa_hit
  16878087            +5.9%   17870127 ±  2%  proc-vmstat.numa_local
      1274 ± 85%    +186.7%       3655 ± 51%  proc-vmstat.numa_pages_migrated
  21054725 ±  2%      +9.0%   22953622 ±  2%  proc-vmstat.pgalloc_normal
   1294920 ±  2%      -3.1%    1254258        proc-vmstat.pgfault
   7398121           +25.3%    9269203 ±  6%  proc-vmstat.pgfree
      1274 ± 85%    +186.7%       3655 ± 51%  proc-vmstat.pgmigrate_success
   9299145 ±  3%     -53.4%    4333338 ±  6%  proc-vmstat.pgpgout
 3.426e+09           +53.3%  5.251e+09 ±  2%  perf-stat.i.branch-instructions
      1.30 ± 55%      -0.6        0.70 ±  9%  perf-stat.i.branch-miss-rate%
  14493070 ±  9%     +19.6%   17331750 ±  2%  perf-stat.i.branch-misses
     55.66 ±  6%      +6.3       61.97 ±  2%  perf-stat.i.cache-miss-rate%
   1.7e+08           +49.3%  2.539e+08 ±  3%  perf-stat.i.cache-misses
 2.166e+08 ±  2%     +45.0%   3.14e+08 ±  2%  perf-stat.i.cache-references
      2588           +18.0%       3055 ±  2%  perf-stat.i.context-switches
      6.43 ±  3%     +12.7%       7.25        perf-stat.i.cpi
 1.237e+11           +61.0%  1.992e+11 ±  2%  perf-stat.i.cpu-cycles
     91.23 ±  2%     +25.9%     114.88 ±  4%  perf-stat.i.cpu-migrations
 4.022e+09           +51.0%  6.073e+09 ±  2%  perf-stat.i.dTLB-loads
 1.214e+09           +38.4%  1.681e+09 ±  3%  perf-stat.i.dTLB-stores
     75.15            +9.0       84.18 ±  2%  perf-stat.i.iTLB-load-miss-rate%
   6549214 ±  3%     +30.0%    8514368 ±  2%  perf-stat.i.iTLB-load-misses
    965678 ±  8%     -38.6%     592444 ± 12%  perf-stat.i.iTLB-loads
 1.505e+10           +51.8%  2.285e+10 ±  2%  perf-stat.i.instructions
      1677 ±  3%     +32.4%       2220 ±  2%  perf-stat.i.instructions-per-iTLB-miss
     76.20            +2.8       78.96        perf-stat.i.node-load-miss-rate%
  41718456           +49.5%   62380744 ±  3%  perf-stat.i.node-load-misses
  13354003 ±  3%     +42.0%   18963934 ±  3%  perf-stat.i.node-loads
   5820753           +48.4%    8637977 ±  3%  perf-stat.i.node-store-misses
    904711 ±  2%     +34.7%    1218812 ±  3%  perf-stat.i.node-stores
     14.40 ±  3%      -4.5%      13.74        perf-stat.overall.MPKI
      0.42 ± 11%      -0.1        0.33        perf-stat.overall.branch-miss-rate%
     78.54 ±  3%      +2.3       80.83        perf-stat.overall.cache-miss-rate%
      8.22            +6.1%       8.72        perf-stat.overall.cpi
    727.84            +7.8%     784.88        perf-stat.overall.cycles-between-cache-misses
      0.03 ± 12%      -0.0        0.02 ±  8%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ± 38%      -0.0        0.00 ± 13%  perf-stat.overall.dTLB-store-miss-rate%
     87.17            +6.3       93.50        perf-stat.overall.iTLB-load-miss-rate%
      2300 ±  2%     +16.7%       2683        perf-stat.overall.instructions-per-iTLB-miss
      0.12            -5.7%       0.11        perf-stat.overall.ipc
     86.55            +1.1       87.63        perf-stat.overall.node-store-miss-rate%
 3.414e+09           +53.3%  5.234e+09 ±  2%  perf-stat.ps.branch-instructions
  14444319 ±  9%     +19.6%   17273976 ±  2%  perf-stat.ps.branch-misses
 1.694e+08           +49.3%   2.53e+08 ±  3%  perf-stat.ps.cache-misses
 2.159e+08 ±  2%     +45.0%   3.13e+08 ±  2%  perf-stat.ps.cache-references
      2579           +18.0%       3044 ±  2%  perf-stat.ps.context-switches
 1.233e+11           +61.0%  1.985e+11 ±  2%  perf-stat.ps.cpu-cycles
     90.91 ±  2%     +25.9%     114.49 ±  4%  perf-stat.ps.cpu-migrations
 4.009e+09           +51.0%  6.053e+09 ±  2%  perf-stat.ps.dTLB-loads
  1.21e+09           +38.4%  1.675e+09 ±  3%  perf-stat.ps.dTLB-stores
   6526828 ±  3%     +30.0%    8485953 ±  2%  perf-stat.ps.iTLB-load-misses
    962531 ±  8%     -38.7%     590489 ± 12%  perf-stat.ps.iTLB-loads
   1.5e+10           +51.8%  2.277e+10 ±  2%  perf-stat.ps.instructions
  41573956           +49.5%   62171570 ±  3%  perf-stat.ps.node-load-misses
  13307696 ±  3%     +42.0%   18900307 ±  3%  perf-stat.ps.node-loads
   5800639           +48.4%    8609039 ±  3%  perf-stat.ps.node-store-misses
    901613 ±  2%     +34.7%    1214750 ±  3%  perf-stat.ps.node-stores
  4.59e+12           +50.9%  6.926e+12 ±  4%  perf-stat.total.instructions
     65776 ±  8%     +69.5%     111477 ±  3%  sched_debug.cfs_rq:/.exec_clock.avg
     67838 ±  9%     +67.6%     113722 ±  3%  sched_debug.cfs_rq:/.exec_clock.max
     63736 ±  8%     +72.3%     109792 ±  3%  sched_debug.cfs_rq:/.exec_clock.min
      2170 ± 47%    +103.8%       4423 ± 16%  sched_debug.cfs_rq:/.load.min
   6230433 ±  8%     +77.4%   11051087 ±  3%  sched_debug.cfs_rq:/.min_vruntime.avg
   6405782 ±  8%     +76.5%   11308609 ±  3%  sched_debug.cfs_rq:/.min_vruntime.max
   5792737 ± 10%     +68.5%    9758094 ±  6%  sched_debug.cfs_rq:/.min_vruntime.min
    100007 ± 27%    +100.5%     200501 ± 36%  sched_debug.cfs_rq:/.min_vruntime.stddev
      0.38 ± 25%     +52.7%       0.58 ± 11%  sched_debug.cfs_rq:/.nr_running.avg
      0.23 ± 44%    +103.7%       0.46 ± 15%  sched_debug.cfs_rq:/.nr_running.min
      1398 ±  8%     +92.2%       2688 ±  4%  sched_debug.cfs_rq:/.nr_spread_over.avg
      2452 ± 11%     +73.5%       4253 ±  9%  sched_debug.cfs_rq:/.nr_spread_over.max
      1106 ± 10%     +84.5%       2040 ± 14%  sched_debug.cfs_rq:/.nr_spread_over.min
    238.96 ±  8%     +71.2%     409.11 ± 11%  sched_debug.cfs_rq:/.nr_spread_over.stddev
    235.20 ± 29%     -49.0%     120.04 ± 32%  sched_debug.cfs_rq:/.runnable_load_avg.max
      1.73 ± 56%    +110.1%       3.62 ± 18%  sched_debug.cfs_rq:/.runnable_load_avg.min
      2170 ± 47%    +103.6%       4419 ± 16%  sched_debug.cfs_rq:/.runnable_weight.min
    100022 ± 27%    +100.4%     200431 ± 36%  sched_debug.cfs_rq:/.spread0.stddev
    414.96 ± 23%     +51.0%     626.68 ±  9%  sched_debug.cfs_rq:/.util_avg.avg
    989.46 ±  9%     +25.0%       1237 ± 10%  sched_debug.cfs_rq:/.util_avg.max
    150.12 ± 51%     +99.8%     300.00 ± 13%  sched_debug.cfs_rq:/.util_avg.min
    232.13 ± 22%    +116.9%     503.56 ± 12%  sched_debug.cfs_rq:/.util_est_enqueued.avg
    678.56 ± 20%     +81.6%       1231 ±  7%  sched_debug.cfs_rq:/.util_est_enqueued.max
     47.02 ± 19%    +144.9%     115.17 ± 32%  sched_debug.cfs_rq:/.util_est_enqueued.min
    127.39 ± 39%     +78.2%     227.02 ±  3%  sched_debug.cfs_rq:/.util_est_enqueued.stddev
     46769 ±  4%     +16.8%      54610 ±  5%  sched_debug.cpu.avg_idle.min
      4.65 ±  6%     +45.9%       6.78 ±  7%  sched_debug.cpu.clock.stddev
      4.65 ±  6%     +45.9%       6.78 ±  7%  sched_debug.cpu.clock_task.stddev
      6.52 ± 12%     +26.0%       8.21 ±  4%  sched_debug.cpu.cpu_load[0].avg
      1.73 ± 56%    +115.0%       3.71 ± 16%  sched_debug.cpu.cpu_load[0].min
      6.74 ± 15%     +24.0%       8.36        sched_debug.cpu.cpu_load[1].avg
    186.97 ± 33%     -33.5%     124.25 ± 32%  sched_debug.cpu.cpu_load[1].max
      1.77 ± 53%    +112.3%       3.75 ± 16%  sched_debug.cpu.cpu_load[1].min
     21.11 ± 29%     -28.0%      15.19 ± 31%  sched_debug.cpu.cpu_load[1].stddev
    187.50 ± 30%     -36.0%     120.04 ± 13%  sched_debug.cpu.cpu_load[2].max
      1.81 ± 50%    +107.4%       3.75 ± 16%  sched_debug.cpu.cpu_load[2].min
    156.08 ± 23%     -35.1%     101.38 ±  7%  sched_debug.cpu.cpu_load[3].max
      1.81 ± 50%    +107.4%       3.75 ± 16%  sched_debug.cpu.cpu_load[3].min
      5.78 ± 22%     +32.5%       7.66 ±  4%  sched_debug.cpu.cpu_load[4].avg
    116.19 ± 24%     -33.9%      76.75 ± 13%  sched_debug.cpu.cpu_load[4].max
      1.81 ± 50%    +107.4%       3.75 ± 16%  sched_debug.cpu.cpu_load[4].min
      7930 ± 26%     +59.5%      12651 ± 11%  sched_debug.cpu.curr->pid.avg
      2170 ± 47%    +103.8%       4423 ± 16%  sched_debug.cpu.load.min
      0.41 ± 26%     +52.3%       0.62 ± 11%  sched_debug.cpu.nr_running.avg
      0.23 ± 44%    +103.7%       0.46 ± 15%  sched_debug.cpu.nr_running.min
      0.29 ± 13%     +19.7%       0.34 ±  7%  sched_debug.cpu.nr_running.stddev
      7074 ±  4%     +14.3%       8088 ±  2%  sched_debug.cpu.nr_switches.avg
      2712 ± 12%     +32.4%       3590 ± 10%  sched_debug.cpu.nr_switches.min
      0.63 ± 17%     -36.3%       0.40 ± 16%  sched_debug.cpu.nr_uninterruptible.avg
      4219 ±  7%     +26.8%       5351 ±  3%  sched_debug.cpu.sched_count.avg
      2243 ±  9%     +49.0%       3341 ±  6%  sched_debug.cpu.sched_count.min
    848.81 ±  8%     -46.7%     452.09 ±  6%  sched_debug.cpu.sched_goidle.avg
      6532 ± 75%     -50.5%       3233 ± 10%  sched_debug.cpu.sched_goidle.max
    238.65 ±  8%     -63.4%      87.46 ± 12%  sched_debug.cpu.sched_goidle.min
    899.09 ± 44%     -39.3%     545.53 ±  7%  sched_debug.cpu.sched_goidle.stddev
      1959 ±  8%     +24.4%       2437 ±  3%  sched_debug.cpu.ttwu_count.avg
      1017 ±  8%     +47.5%       1501 ±  8%  sched_debug.cpu.ttwu_count.min
      1468 ±  8%     +41.1%       2072 ±  3%  sched_debug.cpu.ttwu_local.avg
    864.17 ±  9%     +55.0%       1339 ± 13%  sched_debug.cpu.ttwu_local.min
      5036 ±  2%     -69.1%       1558 ±  5%  slabinfo.biovec-max.active_objs
    765.00 ±  2%     -73.5%     203.00 ±  5%  slabinfo.biovec-max.active_slabs
      6124 ±  2%     -73.4%       1628 ±  5%  slabinfo.biovec-max.num_objs
    765.00 ±  2%     -73.5%     203.00 ±  5%  slabinfo.biovec-max.num_slabs
   7294258 ±  6%     +34.6%    9816853        slabinfo.buffer_head.active_objs
    187148 ±  6%     +34.6%     251861        slabinfo.buffer_head.active_slabs
   7298799 ±  6%     +34.6%    9822591        slabinfo.buffer_head.num_objs
    187148 ±  6%     +34.6%     251861        slabinfo.buffer_head.num_slabs
   1513221 ±  5%     +29.6%    1961860        slabinfo.dentry.active_objs
     36152 ±  5%     +29.4%      46789        slabinfo.dentry.active_slabs
   1518411 ±  5%     +29.4%    1965201        slabinfo.dentry.num_objs
     36152 ±  5%     +29.4%      46789        slabinfo.dentry.num_slabs
     31924 ±  9%     -42.6%      18324 ± 22%  slabinfo.dmaengine-unmap-16.active_objs
    785.00 ±  8%     -43.9%     440.50 ± 22%  slabinfo.dmaengine-unmap-16.active_slabs
     32993 ±  8%     -43.9%      18521 ± 22%  slabinfo.dmaengine-unmap-16.num_objs
    785.00 ±  8%     -43.9%     440.50 ± 22%  slabinfo.dmaengine-unmap-16.num_slabs
      1768 ±  6%     -39.4%       1071 ± 34%  slabinfo.dquot.active_objs
      1768 ±  6%     -39.4%       1071 ± 34%  slabinfo.dquot.num_objs
   2343839 ±  5%     +32.6%    3108884        slabinfo.ext4_extent_status.active_objs
     22978 ±  5%     +32.6%      30478        slabinfo.ext4_extent_status.active_slabs
   2343839 ±  5%     +32.6%    3108884        slabinfo.ext4_extent_status.num_objs
     22978 ±  5%     +32.6%      30478        slabinfo.ext4_extent_status.num_slabs
   1171672 ±  5%     +32.6%    1553422        slabinfo.ext4_inode_cache.active_objs
     39056 ±  5%     +32.6%      51781        slabinfo.ext4_inode_cache.active_slabs
   1171726 ±  5%     +32.6%    1553451        slabinfo.ext4_inode_cache.num_objs
     39056 ±  5%     +32.6%      51781        slabinfo.ext4_inode_cache.num_slabs
    115486 ±  3%     +36.9%     158113        slabinfo.filp.active_objs
      3681 ±  3%     +36.5%       5025        slabinfo.filp.active_slabs
    117826 ±  3%     +36.5%     160843        slabinfo.filp.num_objs
      3681 ±  3%     +36.5%       5025        slabinfo.filp.num_slabs
     34936 ± 13%     -61.9%      13325 ± 21%  slabinfo.fscrypt_info.active_objs
    562.50 ± 12%     -63.0%     208.00 ± 21%  slabinfo.fscrypt_info.active_slabs
     36014 ± 12%     -62.9%      13360 ± 21%  slabinfo.fscrypt_info.num_objs
    562.50 ± 12%     -63.0%     208.00 ± 21%  slabinfo.fscrypt_info.num_slabs
   1168159 ±  5%     +32.4%    1547172        slabinfo.ftrace_event_field.active_objs
     13742 ±  5%     +32.4%      18201        slabinfo.ftrace_event_field.active_slabs
   1168159 ±  5%     +32.4%    1547172        slabinfo.ftrace_event_field.num_objs
     13742 ±  5%     +32.4%      18201        slabinfo.ftrace_event_field.num_slabs
     83866 ±  4%     +24.4%     104314        slabinfo.jbd2_journal_head.active_objs
      2485 ±  4%     +28.8%       3200        slabinfo.jbd2_journal_head.active_slabs
     84511 ±  4%     +28.8%     108846        slabinfo.jbd2_journal_head.num_objs
      2485 ±  4%     +28.8%       3200        slabinfo.jbd2_journal_head.num_slabs
      6262 ±  2%      +6.2%       6649 ±  3%  slabinfo.kmalloc-rcl-64.active_objs
      6666 ±  3%     -15.4%       5639 ±  5%  slabinfo.mbcache.active_objs
      6666 ±  3%     -15.4%       5639 ±  5%  slabinfo.mbcache.num_objs
    865.50 ±  3%     +14.8%     993.25 ±  3%  slabinfo.names_cache.active_objs
    865.50 ±  3%     +14.8%     993.25 ±  3%  slabinfo.names_cache.num_objs
   1310852 ±  5%     +29.0%    1691583        slabinfo.nsproxy.active_objs
     17956 ±  5%     +29.0%      23172        slabinfo.nsproxy.active_slabs
   1310871 ±  5%     +29.0%    1691626        slabinfo.nsproxy.num_objs
     17956 ±  5%     +29.0%      23172        slabinfo.nsproxy.num_slabs
      1596 ±  5%     -15.5%       1348 ±  7%  slabinfo.pool_workqueue.active_objs
      1596 ±  5%     -15.4%       1350 ±  7%  slabinfo.pool_workqueue.num_objs
   1116918 ±  5%     +31.6%    1469809        slabinfo.radix_tree_node.active_objs
     19944 ±  5%     +31.6%      26246        slabinfo.radix_tree_node.active_slabs
   1116940 ±  5%     +31.6%    1469821        slabinfo.radix_tree_node.num_objs
     19944 ±  5%     +31.6%      26246        slabinfo.radix_tree_node.num_slabs
      4848           -81.0%     920.00        slabinfo.scsi_sense_cache.active_objs
    151.50           -81.0%      28.75        slabinfo.scsi_sense_cache.active_slabs
      4848           -81.0%     920.00        slabinfo.scsi_sense_cache.num_objs
    151.50           -81.0%      28.75        slabinfo.scsi_sense_cache.num_slabs
    720.50 ± 11%     -26.5%     529.50 ± 12%  slabinfo.skbuff_fclone_cache.active_objs
    720.50 ± 11%     -26.5%     529.50 ± 12%  slabinfo.skbuff_fclone_cache.num_objs
      8.31 ± 28%      -5.9        2.42 ± 42%  perf-profile.calltrace.cycles-pp.secondary_startup_64
      8.25 ± 28%      -5.9        2.39 ± 42%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
      8.25 ± 28%      -5.9        2.39 ± 42%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
      8.25 ± 28%      -5.9        2.39 ± 42%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
      7.88 ± 30%      -5.6        2.27 ± 42%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
      7.80 ± 30%      -5.6        2.25 ± 43%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      6.68 ± 32%      -4.9        1.79 ± 49%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      7.52 ± 11%      -1.0        6.56        perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7.30 ± 11%      -0.9        6.37        perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7.15 ± 11%      -0.9        6.23        perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7.07 ± 11%      -0.9        6.16        perf-profile.calltrace.cycles-pp.generic_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64
      5.14 ± 10%      -0.6        4.56        perf-profile.calltrace.cycles-pp.copy_page_to_iter.generic_file_read_iter.new_sync_read.vfs_read.ksys_read
      5.01 ± 10%      -0.6        4.43        perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.generic_file_read_iter.new_sync_read.vfs_read
      4.97 ± 10%      -0.6        4.40        perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.generic_file_read_iter.new_sync_read
      0.58 ±  7%      -0.2        0.40 ± 57%  perf-profile.calltrace.cycles-pp.alloc_empty_file.path_openat.do_filp_open.do_sys_open.do_syscall_64
      6.16 ±  3%      +0.7        6.89        perf-profile.calltrace.cycles-pp.put_unused_fd.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.14 ±  3%      +0.7        6.87        perf-profile.calltrace.cycles-pp._raw_spin_lock.put_unused_fd.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.11 ±  3%      +0.7        6.84        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.put_unused_fd.do_sys_open.do_syscall_64
     33.31 ±  3%      +2.7       35.99        perf-profile.calltrace.cycles-pp.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
     33.12 ±  3%      +2.7       35.81        perf-profile.calltrace.cycles-pp.__close_fd.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
     32.96 ±  3%      +2.7       35.69        perf-profile.calltrace.cycles-pp._raw_spin_lock.__close_fd.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
     32.78 ±  3%      +2.7       35.52        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__close_fd.__x64_sys_close.do_syscall_64
     39.93 ±  3%      +3.5       43.45        perf-profile.calltrace.cycles-pp.__alloc_fd.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     39.51 ±  3%      +3.6       43.09        perf-profile.calltrace.cycles-pp._raw_spin_lock.__alloc_fd.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     39.31 ±  3%      +3.6       42.91        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__alloc_fd.do_sys_open.do_syscall_64
     48.49 ±  3%      +4.1       52.58        perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     90.43 ±  2%      +5.8       96.22        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
     90.46 ±  2%      +5.8       96.25        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      8.32 ± 28%      -5.9        2.42 ± 42%  perf-profile.children.cycles-pp.do_idle
      8.31 ± 28%      -5.9        2.42 ± 42%  perf-profile.children.cycles-pp.secondary_startup_64
      8.31 ± 28%      -5.9        2.42 ± 42%  perf-profile.children.cycles-pp.cpu_startup_entry
      8.25 ± 28%      -5.9        2.39 ± 42%  perf-profile.children.cycles-pp.start_secondary
      7.94 ± 29%      -5.6        2.30 ± 42%  perf-profile.children.cycles-pp.cpuidle_enter
      7.94 ± 29%      -5.6        2.30 ± 42%  perf-profile.children.cycles-pp.cpuidle_enter_state
      6.72 ± 32%      -4.9        1.82 ± 48%  perf-profile.children.cycles-pp.intel_idle
      7.52 ± 11%      -1.0        6.56        perf-profile.children.cycles-pp.ksys_read
      7.30 ± 11%      -0.9        6.38        perf-profile.children.cycles-pp.vfs_read
      7.16 ± 11%      -0.9        6.23        perf-profile.children.cycles-pp.new_sync_read
      7.08 ± 11%      -0.9        6.17        perf-profile.children.cycles-pp.generic_file_read_iter
      1.68 ± 18%      -0.7        0.96 ± 13%  perf-profile.children.cycles-pp.apic_timer_interrupt
      1.56 ± 18%      -0.7        0.89 ± 13%  perf-profile.children.cycles-pp.smp_apic_timer_interrupt
      5.15 ± 10%      -0.6        4.57        perf-profile.children.cycles-pp.copy_page_to_iter
      5.01 ± 10%      -0.6        4.43        perf-profile.children.cycles-pp.copyout
      5.05 ± 10%      -0.6        4.48        perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.90 ± 19%      -0.3        0.57 ± 13%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.60 ± 22%      -0.3        0.29 ± 15%  perf-profile.children.cycles-pp.irq_exit
      0.29 ± 22%      -0.2        0.09 ± 62%  perf-profile.children.cycles-pp.menu_select
      0.52 ± 12%      -0.2        0.34 ± 12%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.26 ± 41%      -0.1        0.13 ± 31%  perf-profile.children.cycles-pp.clockevents_program_event
      0.18 ± 33%      -0.1        0.05 ± 63%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.15 ± 31%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.36 ± 12%      -0.1        0.26 ± 12%  perf-profile.children.cycles-pp.tick_sched_timer
      0.29 ± 11%      -0.1        0.20 ± 14%  perf-profile.children.cycles-pp.tick_sched_handle
      0.29 ± 12%      -0.1        0.20 ± 14%  perf-profile.children.cycles-pp.update_process_times
      0.51 ±  9%      -0.1        0.43 ±  7%  perf-profile.children.cycles-pp.__alloc_file
      0.58 ±  7%      -0.1        0.52 ±  6%  perf-profile.children.cycles-pp.alloc_empty_file
      0.09 ± 31%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.native_write_msr
      0.09 ± 12%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.30 ±  8%      -0.0        0.25 ±  4%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.23 ± 12%      -0.0        0.18 ±  8%  perf-profile.children.cycles-pp.find_next_zero_bit
      0.18 ± 11%      -0.0        0.13 ±  9%  perf-profile.children.cycles-pp.scheduler_tick
      0.36 ± 10%      -0.0        0.32 ±  4%  perf-profile.children.cycles-pp.exit_to_usermode_loop
      0.11 ± 14%      +0.1        0.18 ± 11%  perf-profile.children.cycles-pp.__slab_free
      6.16 ±  3%      +0.7        6.89        perf-profile.children.cycles-pp.put_unused_fd
     33.31 ±  3%      +2.7       35.99        perf-profile.children.cycles-pp.__x64_sys_close
     33.12 ±  3%      +2.7       35.81        perf-profile.children.cycles-pp.__close_fd
     39.93 ±  3%      +3.5       43.45        perf-profile.children.cycles-pp.__alloc_fd
     48.49 ±  3%      +4.1       52.59        perf-profile.children.cycles-pp.do_sys_open
     90.46 ±  2%      +5.8       96.25        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     90.43 ±  2%      +5.8       96.22        perf-profile.children.cycles-pp.do_syscall_64
     78.66 ±  3%      +7.0       85.69        perf-profile.children.cycles-pp._raw_spin_lock
     78.25 ±  3%      +7.1       85.31        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      6.72 ± 32%      -4.9        1.82 ± 48%  perf-profile.self.cycles-pp.intel_idle
      5.01 ± 10%      -0.6        4.45        perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      1.21 ± 17%      -0.2        0.96        perf-profile.self.cycles-pp.generic_file_read_iter
      0.09 ± 31%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.native_write_msr
      0.43 ±  8%      -0.0        0.39 ±  6%  perf-profile.self.cycles-pp._raw_spin_lock
      0.23 ± 12%      -0.0        0.18 ±  8%  perf-profile.self.cycles-pp.find_next_zero_bit
      0.11 ± 11%      +0.1        0.17 ± 13%  perf-profile.self.cycles-pp.__slab_free
     77.77 ±  3%      +7.0       84.78        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
     69.00 ±169%    -100.0%       0.00        interrupts.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
     70391 ±  3%     -20.2%      56156 ±  4%  interrupts.295:PCI-MSI.376832-edge.ahci[0000:00:17.0]
      0.50 ±173%   +6300.0%      32.00 ±162%  interrupts.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
      4151 ± 20%     +57.1%       6519 ± 10%  interrupts.CPU0.NMI:Non-maskable_interrupts
      4151 ± 20%     +57.1%       6519 ± 10%  interrupts.CPU0.PMI:Performance_monitoring_interrupts
      3680 ± 34%     +77.3%       6526 ± 10%  interrupts.CPU1.NMI:Non-maskable_interrupts
      3680 ± 34%     +77.3%       6526 ± 10%  interrupts.CPU1.PMI:Performance_monitoring_interrupts
      3962 ± 18%     +66.3%       6588 ±  9%  interrupts.CPU10.NMI:Non-maskable_interrupts
      3962 ± 18%     +66.3%       6588 ±  9%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
     57.50 ± 19%     +47.0%      84.50 ± 11%  interrupts.CPU10.RES:Rescheduling_interrupts
      4102 ± 14%     +58.4%       6500 ± 12%  interrupts.CPU11.NMI:Non-maskable_interrupts
      4102 ± 14%     +58.4%       6500 ± 12%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
      1028 ±  9%     +14.7%       1179 ±  5%  interrupts.CPU11.TLB:TLB_shootdowns
      3954 ± 18%     +64.2%       6493 ±  9%  interrupts.CPU12.NMI:Non-maskable_interrupts
      3954 ± 18%     +64.2%       6493 ±  9%  interrupts.CPU12.PMI:Performance_monitoring_interrupts
    939.50 ± 11%     +23.8%       1162 ±  7%  interrupts.CPU12.TLB:TLB_shootdowns
      4068 ± 19%     +59.3%       6479 ± 11%  interrupts.CPU13.NMI:Non-maskable_interrupts
      4068 ± 19%     +59.3%       6479 ± 11%  interrupts.CPU13.PMI:Performance_monitoring_interrupts
    970.75 ± 10%     +21.8%       1182 ±  6%  interrupts.CPU13.TLB:TLB_shootdowns
      3979 ± 21%     +62.7%       6474 ± 10%  interrupts.CPU14.NMI:Non-maskable_interrupts
      3979 ± 21%     +62.7%       6474 ± 10%  interrupts.CPU14.PMI:Performance_monitoring_interrupts
      1003 ±  5%     +13.0%       1134 ±  7%  interrupts.CPU14.TLB:TLB_shootdowns
      3994 ± 15%     +65.5%       6612 ± 10%  interrupts.CPU15.NMI:Non-maskable_interrupts
      3994 ± 15%     +65.5%       6612 ± 10%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
      4119 ± 19%     +57.4%       6482 ± 11%  interrupts.CPU16.NMI:Non-maskable_interrupts
      4119 ± 19%     +57.4%       6482 ± 11%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
     70.25 ± 15%    +215.3%     221.50 ± 52%  interrupts.CPU16.RES:Rescheduling_interrupts
    971.25 ±  9%     +20.3%       1168 ±  8%  interrupts.CPU16.TLB:TLB_shootdowns
      4000 ± 13%     +62.6%       6507 ± 10%  interrupts.CPU17.NMI:Non-maskable_interrupts
      4000 ± 13%     +62.6%       6507 ± 10%  interrupts.CPU17.PMI:Performance_monitoring_interrupts
      1055 ±  9%      +9.7%       1158 ±  8%  interrupts.CPU17.TLB:TLB_shootdowns
      3917 ± 15%     +66.4%       6518 ± 10%  interrupts.CPU18.NMI:Non-maskable_interrupts
      3917 ± 15%     +66.4%       6518 ± 10%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
      4079 ± 19%     +60.1%       6532 ±  9%  interrupts.CPU19.NMI:Non-maskable_interrupts
      4079 ± 19%     +60.1%       6532 ±  9%  interrupts.CPU19.PMI:Performance_monitoring_interrupts
      3726 ± 36%     +76.8%       6588 ± 10%  interrupts.CPU2.NMI:Non-maskable_interrupts
      3726 ± 36%     +76.8%       6588 ± 10%  interrupts.CPU2.PMI:Performance_monitoring_interrupts
      4064 ± 16%     +60.9%       6539 ± 11%  interrupts.CPU20.NMI:Non-maskable_interrupts
      4064 ± 16%     +60.9%       6539 ± 11%  interrupts.CPU20.PMI:Performance_monitoring_interrupts
    975.25 ±  7%     +20.5%       1175 ±  6%  interrupts.CPU20.TLB:TLB_shootdowns
      4014 ± 17%     +61.2%       6469 ± 11%  interrupts.CPU21.NMI:Non-maskable_interrupts
      4014 ± 17%     +61.2%       6469 ± 11%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
      4134 ± 16%     +56.8%       6482 ±  9%  interrupts.CPU22.NMI:Non-maskable_interrupts
      4134 ± 16%     +56.8%       6482 ±  9%  interrupts.CPU22.PMI:Performance_monitoring_interrupts
      3961 ± 17%     +65.1%       6540 ± 10%  interrupts.CPU23.NMI:Non-maskable_interrupts
      3961 ± 17%     +65.1%       6540 ± 10%  interrupts.CPU23.PMI:Performance_monitoring_interrupts
    993.50 ±  9%     +19.7%       1189 ±  7%  interrupts.CPU23.TLB:TLB_shootdowns
      4013 ± 14%     +64.5%       6604 ± 11%  interrupts.CPU24.NMI:Non-maskable_interrupts
      4013 ± 14%     +64.5%       6604 ± 11%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
      3955 ± 14%     +64.8%       6520 ± 12%  interrupts.CPU25.NMI:Non-maskable_interrupts
      3955 ± 14%     +64.8%       6520 ± 12%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
    997.25 ± 10%     +18.0%       1176 ±  5%  interrupts.CPU25.TLB:TLB_shootdowns
      3997 ± 16%     +61.0%       6433 ± 11%  interrupts.CPU26.NMI:Non-maskable_interrupts
      3997 ± 16%     +61.0%       6433 ± 11%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
      4051 ± 15%     +59.4%       6455 ± 11%  interrupts.CPU27.NMI:Non-maskable_interrupts
      4051 ± 15%     +59.4%       6455 ± 11%  interrupts.CPU27.PMI:Performance_monitoring_interrupts
      3912 ± 15%     +67.9%       6568 ± 11%  interrupts.CPU28.NMI:Non-maskable_interrupts
      3912 ± 15%     +67.9%       6568 ± 11%  interrupts.CPU28.PMI:Performance_monitoring_interrupts
      1022 ± 10%     +13.2%       1157 ±  7%  interrupts.CPU28.TLB:TLB_shootdowns
      6900 ± 15%     -25.0%       5178 ±  2%  interrupts.CPU29.CAL:Function_call_interrupts
    981.00 ±  6%     +17.0%       1147 ± 10%  interrupts.CPU29.TLB:TLB_shootdowns
      3706 ± 37%     +76.6%       6546 ± 10%  interrupts.CPU3.NMI:Non-maskable_interrupts
      3706 ± 37%     +76.6%       6546 ± 10%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    996.50 ± 13%     +16.9%       1165 ±  8%  interrupts.CPU3.TLB:TLB_shootdowns
      4270 ± 20%     +52.4%       6508 ± 10%  interrupts.CPU30.NMI:Non-maskable_interrupts
      4270 ± 20%     +52.4%       6508 ± 10%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
      4126 ± 16%     +59.7%       6588 ±  9%  interrupts.CPU31.NMI:Non-maskable_interrupts
      4126 ± 16%     +59.7%       6588 ±  9%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
      3953 ± 18%     +64.6%       6507 ± 10%  interrupts.CPU32.NMI:Non-maskable_interrupts
      3953 ± 18%     +64.6%       6507 ± 10%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
      1033 ± 10%     +12.9%       1166 ±  5%  interrupts.CPU32.TLB:TLB_shootdowns
      1000 ± 10%     +13.3%       1134 ±  9%  interrupts.CPU33.TLB:TLB_shootdowns
      3842 ± 16%     +70.3%       6543 ± 11%  interrupts.CPU35.NMI:Non-maskable_interrupts
      3842 ± 16%     +70.3%       6543 ± 11%  interrupts.CPU35.PMI:Performance_monitoring_interrupts
    997.25 ± 12%     +19.3%       1190 ±  6%  interrupts.CPU35.TLB:TLB_shootdowns
      1006 ± 11%     +15.6%       1164 ±  8%  interrupts.CPU36.TLB:TLB_shootdowns
      1014 ±  7%     +16.3%       1179 ±  5%  interrupts.CPU37.TLB:TLB_shootdowns
      1027 ±  9%     +15.5%       1186 ±  5%  interrupts.CPU39.TLB:TLB_shootdowns
      3392 ± 35%     +92.5%       6528 ± 10%  interrupts.CPU4.NMI:Non-maskable_interrupts
      3392 ± 35%     +92.5%       6528 ± 10%  interrupts.CPU4.PMI:Performance_monitoring_interrupts
    976.25 ±  8%     +18.4%       1156 ±  7%  interrupts.CPU4.TLB:TLB_shootdowns
    993.25 ±  9%     +18.1%       1173 ±  8%  interrupts.CPU40.TLB:TLB_shootdowns
    992.75 ±  7%     +19.6%       1187 ±  6%  interrupts.CPU41.TLB:TLB_shootdowns
      1012 ± 10%     +17.2%       1186 ±  6%  interrupts.CPU42.TLB:TLB_shootdowns
    980.50 ±  9%     +19.5%       1172 ±  8%  interrupts.CPU45.TLB:TLB_shootdowns
    729.50 ± 34%     +98.8%       1450 ±  9%  interrupts.CPU47.RES:Rescheduling_interrupts
      1025 ± 10%     +12.8%       1157 ±  7%  interrupts.CPU47.TLB:TLB_shootdowns
      1021 ± 11%     +13.7%       1161 ±  8%  interrupts.CPU48.TLB:TLB_shootdowns
    995.25 ± 10%     +17.8%       1172 ±  5%  interrupts.CPU49.TLB:TLB_shootdowns
      0.25 ±173%  +12600.0%      31.75 ±164%  interrupts.CPU5.41:PCI-MSI.31981574-edge.i40e-eth0-TxRx-5
      3497 ± 35%     +86.0%       6504 ± 11%  interrupts.CPU5.NMI:Non-maskable_interrupts
      3497 ± 35%     +86.0%       6504 ± 11%  interrupts.CPU5.PMI:Performance_monitoring_interrupts
      1001 ±  6%     +18.3%       1184 ±  7%  interrupts.CPU5.TLB:TLB_shootdowns
     28.75 ± 22%    +252.2%     101.25 ± 54%  interrupts.CPU50.RES:Rescheduling_interrupts
    999.50 ±  6%     +19.2%       1191 ±  6%  interrupts.CPU50.TLB:TLB_shootdowns
      1004 ±  6%     +16.4%       1169 ±  5%  interrupts.CPU51.TLB:TLB_shootdowns
    965.50 ± 11%     +17.6%       1135 ±  8%  interrupts.CPU52.TLB:TLB_shootdowns
      4085 ± 14%     +60.0%       6537 ± 10%  interrupts.CPU54.NMI:Non-maskable_interrupts
      4085 ± 14%     +60.0%       6537 ± 10%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
      1015 ±  8%     +16.5%       1183 ±  7%  interrupts.CPU54.TLB:TLB_shootdowns
      1016 ± 12%     +15.9%       1178 ±  7%  interrupts.CPU55.TLB:TLB_shootdowns
      1004 ±  5%     +18.2%       1187 ±  7%  interrupts.CPU56.TLB:TLB_shootdowns
    146.00 ± 61%     -56.8%      63.00 ± 17%  interrupts.CPU57.RES:Rescheduling_interrupts
      1027 ± 11%     +13.8%       1169 ±  6%  interrupts.CPU57.TLB:TLB_shootdowns
    998.25 ± 12%     +17.7%       1175 ±  5%  interrupts.CPU58.TLB:TLB_shootdowns
      1019 ± 10%     +15.1%       1172 ±  5%  interrupts.CPU59.TLB:TLB_shootdowns
      3528 ± 33%     +86.5%       6582 ± 10%  interrupts.CPU6.NMI:Non-maskable_interrupts
      3528 ± 33%     +86.5%       6582 ± 10%  interrupts.CPU6.PMI:Performance_monitoring_interrupts
      1036 ±  8%     +13.5%       1176 ±  6%  interrupts.CPU60.TLB:TLB_shootdowns
    955.00 ± 10%     +22.4%       1169 ±  7%  interrupts.CPU61.TLB:TLB_shootdowns
    973.75 ± 11%     +18.7%       1156 ±  6%  interrupts.CPU62.TLB:TLB_shootdowns
      1025 ±  9%     +15.7%       1186 ±  7%  interrupts.CPU63.TLB:TLB_shootdowns
      1010 ±  8%     +17.0%       1181 ±  7%  interrupts.CPU64.TLB:TLB_shootdowns
    989.25 ± 11%     +20.0%       1187 ±  4%  interrupts.CPU65.TLB:TLB_shootdowns
      1024 ± 12%     +15.8%       1186 ±  5%  interrupts.CPU66.TLB:TLB_shootdowns
      1034 ±  8%     +13.4%       1173 ±  4%  interrupts.CPU67.TLB:TLB_shootdowns
      1023 ± 12%     +13.6%       1163 ±  8%  interrupts.CPU68.TLB:TLB_shootdowns
      3677 ± 34%     +76.0%       6473 ± 10%  interrupts.CPU7.NMI:Non-maskable_interrupts
      3677 ± 34%     +76.0%       6473 ± 10%  interrupts.CPU7.PMI:Performance_monitoring_interrupts
    977.25 ± 14%     +19.7%       1169 ±  5%  interrupts.CPU7.TLB:TLB_shootdowns
      1016 ± 10%     +16.9%       1188 ±  6%  interrupts.CPU70.TLB:TLB_shootdowns
    986.25 ± 10%     +18.6%       1169 ±  4%  interrupts.CPU72.TLB:TLB_shootdowns
      1021 ± 11%     +16.0%       1184 ±  7%  interrupts.CPU73.TLB:TLB_shootdowns
    993.25 ± 10%     +15.6%       1148 ±  6%  interrupts.CPU74.TLB:TLB_shootdowns
    993.50 ± 11%     +17.5%       1167 ±  6%  interrupts.CPU75.TLB:TLB_shootdowns
      1005 ±  4%     +15.1%       1157 ±  7%  interrupts.CPU76.TLB:TLB_shootdowns
    993.50 ±  5%     +15.4%       1146 ±  7%  interrupts.CPU78.TLB:TLB_shootdowns
    998.75 ±  9%     +15.5%       1153 ±  7%  interrupts.CPU79.TLB:TLB_shootdowns
      3712 ± 33%     +76.3%       6544 ± 11%  interrupts.CPU8.NMI:Non-maskable_interrupts
      3712 ± 33%     +76.3%       6544 ± 11%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
     57.25 ± 14%     +60.3%      91.75 ± 15%  interrupts.CPU8.RES:Rescheduling_interrupts
      1032 ±  8%     +13.1%       1167 ±  8%  interrupts.CPU8.TLB:TLB_shootdowns
    972.50 ±  9%     +17.5%       1142 ±  7%  interrupts.CPU80.TLB:TLB_shootdowns
      1008 ± 11%     +15.3%       1162 ±  6%  interrupts.CPU81.TLB:TLB_shootdowns
    976.25 ± 11%     +18.7%       1159 ±  7%  interrupts.CPU83.TLB:TLB_shootdowns
      1033 ±  7%     +11.9%       1155 ±  8%  interrupts.CPU84.TLB:TLB_shootdowns
      3457 ± 34%     +90.0%       6567 ± 11%  interrupts.CPU86.NMI:Non-maskable_interrupts
      3457 ± 34%     +90.0%       6567 ± 11%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
      1014 ±  7%     +14.3%       1159 ±  6%  interrupts.CPU86.TLB:TLB_shootdowns
      3628 ± 34%     +81.8%       6595 ± 10%  interrupts.CPU87.NMI:Non-maskable_interrupts
      3628 ± 34%     +81.8%       6595 ± 10%  interrupts.CPU87.PMI:Performance_monitoring_interrupts
    973.50 ± 11%     +19.4%       1162 ±  2%  interrupts.CPU87.TLB:TLB_shootdowns
      3524 ± 36%     +86.8%       6584 ± 10%  interrupts.CPU88.NMI:Non-maskable_interrupts
      3524 ± 36%     +86.8%       6584 ± 10%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
    984.50 ±  9%     +19.9%       1180 ±  4%  interrupts.CPU88.TLB:TLB_shootdowns
      3586 ± 37%     +82.3%       6538 ±  9%  interrupts.CPU89.NMI:Non-maskable_interrupts
      3586 ± 37%     +82.3%       6538 ±  9%  interrupts.CPU89.PMI:Performance_monitoring_interrupts
    960.50 ± 10%     +20.8%       1160 ±  7%  interrupts.CPU89.TLB:TLB_shootdowns
      3798 ± 36%     +70.9%       6491 ± 11%  interrupts.CPU9.NMI:Non-maskable_interrupts
      3798 ± 36%     +70.9%       6491 ± 11%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
    992.75 ± 10%     +18.5%       1176 ±  6%  interrupts.CPU9.TLB:TLB_shootdowns
      3574 ± 35%     +84.7%       6603 ± 10%  interrupts.CPU90.NMI:Non-maskable_interrupts
      3574 ± 35%     +84.7%       6603 ± 10%  interrupts.CPU90.PMI:Performance_monitoring_interrupts
      3749 ± 36%     +73.9%       6520 ± 10%  interrupts.CPU91.NMI:Non-maskable_interrupts
      3749 ± 36%     +73.9%       6520 ± 10%  interrupts.CPU91.PMI:Performance_monitoring_interrupts
    954.00 ± 14%     +22.2%       1165 ±  4%  interrupts.CPU91.TLB:TLB_shootdowns
      3236 ± 42%    +101.6%       6523 ± 11%  interrupts.CPU92.NMI:Non-maskable_interrupts
      3236 ± 42%    +101.6%       6523 ± 11%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
    994.50 ± 11%     +19.2%       1185 ±  3%  interrupts.CPU92.TLB:TLB_shootdowns
      3184 ± 45%    +107.8%       6618 ± 10%  interrupts.CPU93.NMI:Non-maskable_interrupts
      3184 ± 45%    +107.8%       6618 ± 10%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
      1008 ± 10%     +16.1%       1171 ±  6%  interrupts.CPU93.TLB:TLB_shootdowns
      3237 ± 41%    +102.4%       6552 ± 11%  interrupts.CPU94.NMI:Non-maskable_interrupts
      3237 ± 41%    +102.4%       6552 ± 11%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
     84.00 ± 14%     -34.8%      54.75 ± 30%  interrupts.CPU95.RES:Rescheduling_interrupts
     96544 ±  9%     +15.9%     111876 ±  6%  interrupts.TLB:TLB_shootdowns
     37864 ±  2%     -18.8%      30744 ±  3%  softirqs.BLOCK
     77550           +41.5%     109733 ±  7%  softirqs.CPU0.RCU
     43105 ±  4%     -19.6%      34658 ±  6%  softirqs.CPU0.SCHED
     75885 ±  3%     +41.5%     107373 ±  6%  softirqs.CPU1.RCU
     26448 ±  8%     -35.9%      16964 ± 14%  softirqs.CPU1.SCHED
     75310 ±  2%     +43.5%     108075 ±  4%  softirqs.CPU10.RCU
     24983 ±  3%     -36.6%      15829 ±  5%  softirqs.CPU10.SCHED
     78503 ±  3%     +37.7%     108090 ±  4%  softirqs.CPU11.RCU
     24963           -37.5%      15597 ±  2%  softirqs.CPU11.SCHED
     83394 ± 12%     +28.4%     107097 ±  5%  softirqs.CPU12.RCU
     25121 ±  3%     -37.0%      15839 ±  4%  softirqs.CPU12.SCHED
     76137           +41.7%     107914 ±  4%  softirqs.CPU13.RCU
     24873 ±  2%     -37.4%      15583 ±  2%  softirqs.CPU13.SCHED
     79620 ±  6%     +34.8%     107328 ±  5%  softirqs.CPU14.RCU
     25157 ±  2%     -37.6%      15690 ±  4%  softirqs.CPU14.SCHED
     75830           +41.7%     107440 ±  4%  softirqs.CPU15.RCU
     24825 ±  2%     -38.2%      15331 ±  3%  softirqs.CPU15.SCHED
     75656 ±  2%     +44.7%     109512 ±  7%  softirqs.CPU16.RCU
     24772           -38.7%      15190 ±  3%  softirqs.CPU16.SCHED
     75163 ±  2%     +42.0%     106768 ±  4%  softirqs.CPU17.RCU
     24670           -37.1%      15514 ±  3%  softirqs.CPU17.SCHED
     73532 ±  2%     +46.4%     107679 ±  4%  softirqs.CPU18.RCU
     24441           -37.2%      15353 ±  2%  softirqs.CPU18.SCHED
     74572           +52.3%     113580 ± 14%  softirqs.CPU19.RCU
     24447 ±  2%     -36.3%      15574 ±  2%  softirqs.CPU19.SCHED
     75348           +44.9%     109177 ±  4%  softirqs.CPU2.RCU
     24823 ±  2%     -32.2%      16827 ±  2%  softirqs.CPU2.SCHED
     75647           +41.2%     106797 ±  5%  softirqs.CPU20.RCU
     24519 ±  2%     -37.6%      15309        softirqs.CPU20.SCHED
     74354 ±  2%     +41.9%     105529 ±  6%  softirqs.CPU21.RCU
     24759           -37.4%      15511 ±  2%  softirqs.CPU21.SCHED
     75019 ±  2%     +44.5%     108392 ±  4%  softirqs.CPU22.RCU
     24675           -37.4%      15455 ±  2%  softirqs.CPU22.SCHED
     74125 ±  2%     +45.2%     107632 ±  5%  softirqs.CPU23.RCU
     24551           -37.9%      15251        softirqs.CPU23.SCHED
     79305 ±  2%     +32.3%     104929 ± 10%  softirqs.CPU24.RCU
     25690 ±  5%     -42.9%      14676 ±  3%  softirqs.CPU24.SCHED
     77153 ±  2%     +41.5%     109165 ±  4%  softirqs.CPU25.RCU
     25204 ±  4%     -41.9%      14637 ±  2%  softirqs.CPU25.SCHED
     77818 ±  5%     +40.0%     108939 ±  5%  softirqs.CPU26.RCU
     26076 ±  7%     -42.8%      14905 ±  2%  softirqs.CPU26.SCHED
     77412 ±  2%     +37.0%     106089 ±  5%  softirqs.CPU27.RCU
     25538 ±  5%     -41.8%      14863 ±  3%  softirqs.CPU27.SCHED
     76946 ±  3%     +40.4%     107996 ±  5%  softirqs.CPU28.RCU
     25341 ±  3%     -41.8%      14749 ±  2%  softirqs.CPU28.SCHED
     77370 ±  2%     +35.3%     104683 ±  8%  softirqs.CPU29.RCU
     25038 ±  3%     -40.3%      14938 ±  2%  softirqs.CPU29.SCHED
     76345 ±  5%     +51.9%     115952 ±  7%  softirqs.CPU3.RCU
     24605           -35.6%      15852        softirqs.CPU3.SCHED
     76553 ±  3%     +39.9%     107128 ±  5%  softirqs.CPU30.RCU
     24700           -41.0%      14579 ±  2%  softirqs.CPU30.SCHED
     76154           +40.9%     107281 ±  4%  softirqs.CPU31.RCU
     24634 ±  2%     -40.2%      14725 ±  2%  softirqs.CPU31.SCHED
     76971 ±  2%     +39.7%     107538 ±  5%  softirqs.CPU32.RCU
     24480           -40.4%      14580 ±  3%  softirqs.CPU32.SCHED
     75777 ±  2%     +38.3%     104822 ±  8%  softirqs.CPU33.RCU
     24200 ±  2%     -39.8%      14571 ±  3%  softirqs.CPU33.SCHED
     75087           +44.0%     108117 ±  5%  softirqs.CPU34.RCU
     24807           -41.8%      14439 ±  2%  softirqs.CPU34.SCHED
     75566 ±  2%     +41.8%     107147 ±  5%  softirqs.CPU35.RCU
     24302 ±  2%     -39.6%      14682 ±  3%  softirqs.CPU35.SCHED
     75051 ±  3%     +46.4%     109902 ±  3%  softirqs.CPU36.RCU
     24196           -39.0%      14754 ±  3%  softirqs.CPU36.SCHED
     74146 ±  2%     +44.4%     107099 ±  5%  softirqs.CPU37.RCU
     24276           -39.4%      14714 ±  3%  softirqs.CPU37.SCHED
     74462 ±  2%     +36.5%     101627 ± 13%  softirqs.CPU38.RCU
     24492           -39.1%      14920 ±  3%  softirqs.CPU38.SCHED
     75869 ±  3%     +42.3%     107989 ±  4%  softirqs.CPU39.RCU
     24282 ±  2%     -39.4%      14704 ±  3%  softirqs.CPU39.SCHED
     78365 ±  7%     +37.7%     107914 ±  5%  softirqs.CPU4.RCU
     24705           -35.1%      16041 ±  2%  softirqs.CPU4.SCHED
     73960           +44.9%     107133 ±  7%  softirqs.CPU40.RCU
     24240           -38.8%      14828 ±  4%  softirqs.CPU40.SCHED
     75648           +43.1%     108237 ±  6%  softirqs.CPU41.RCU
     24484           -39.5%      14821 ±  5%  softirqs.CPU41.SCHED
     73285 ±  2%     +44.3%     105733 ±  4%  softirqs.CPU42.RCU
     24395 ±  2%     -39.1%      14859 ±  6%  softirqs.CPU42.SCHED
     74913 ±  3%     +41.8%     106199 ±  8%  softirqs.CPU43.RCU
     24248           -40.0%      14555 ±  3%  softirqs.CPU43.SCHED
     75833 ±  3%     +43.5%     108803 ±  5%  softirqs.CPU44.RCU
     24489 ±  2%     -40.5%      14582 ±  2%  softirqs.CPU44.SCHED
     76078 ±  3%     +42.1%     108118 ±  5%  softirqs.CPU45.RCU
     24248 ±  2%     -39.9%      14585 ±  3%  softirqs.CPU45.SCHED
     74254 ±  2%     +45.7%     108172 ±  4%  softirqs.CPU46.RCU
     24358 ±  2%     -40.2%      14555 ±  3%  softirqs.CPU46.SCHED
     76019 ±  2%     +44.0%     109489 ±  5%  softirqs.CPU47.RCU
     24312 ±  2%     -40.0%      14594 ±  3%  softirqs.CPU47.SCHED
     74545           +43.8%     107217 ±  4%  softirqs.CPU48.RCU
     24053 ±  2%     -37.5%      15025 ±  2%  softirqs.CPU48.SCHED
     74969           +43.5%     107547 ±  3%  softirqs.CPU49.RCU
     24027 ±  3%     -37.1%      15106        softirqs.CPU49.SCHED
     74857 ±  2%     +44.4%     108087 ±  5%  softirqs.CPU5.RCU
     24830 ±  2%     -35.0%      16139 ±  2%  softirqs.CPU5.SCHED
     75273           +42.1%     106942 ±  5%  softirqs.CPU50.RCU
     24383           -38.2%      15079 ±  2%  softirqs.CPU50.SCHED
     83434 ± 17%     +56.3%     130388 ± 10%  softirqs.CPU51.RCU
     24172           -34.7%      15792 ±  2%  softirqs.CPU51.SCHED
     82037 ± 12%     +31.9%     108183 ±  5%  softirqs.CPU52.RCU
     24326 ±  2%     -35.9%      15602 ±  2%  softirqs.CPU52.SCHED
     74229           +44.9%     107536 ±  4%  softirqs.CPU53.RCU
     24389 ±  2%     -36.2%      15551        softirqs.CPU53.SCHED
     75381 ±  2%     +42.7%     107578 ±  5%  softirqs.CPU54.RCU
     24242           -38.2%      14978 ±  3%  softirqs.CPU54.SCHED
     76220           +41.8%     108107 ±  3%  softirqs.CPU55.RCU
     25071 ±  3%     -35.4%      16190 ±  7%  softirqs.CPU55.SCHED
     78063 ±  2%     +39.2%     108650 ±  3%  softirqs.CPU56.RCU
     25398 ±  5%     -37.1%      15963 ±  7%  softirqs.CPU56.SCHED
     77078 ±  2%     +40.5%     108272 ±  4%  softirqs.CPU57.RCU
     24995 ±  4%     -35.3%      16171 ±  6%  softirqs.CPU57.SCHED
     75861           +41.6%     107450 ±  4%  softirqs.CPU58.RCU
     24915 ±  3%     -37.1%      15680 ±  6%  softirqs.CPU58.SCHED
     78420 ±  4%     +37.4%     107729 ±  3%  softirqs.CPU59.RCU
     24596           -37.4%      15390 ±  5%  softirqs.CPU59.SCHED
     77182           +46.1%     112752 ±  9%  softirqs.CPU6.RCU
     25500 ±  4%     -36.6%      16165 ± 10%  softirqs.CPU6.SCHED
     75817           +42.3%     107854 ±  5%  softirqs.CPU60.RCU
     24960 ±  2%     -38.0%      15477 ±  3%  softirqs.CPU60.SCHED
     74945           +43.9%     107838 ±  5%  softirqs.CPU61.RCU
     24565           -37.4%      15381 ±  4%  softirqs.CPU61.SCHED
     81772 ± 14%     +31.8%     107777 ±  3%  softirqs.CPU62.RCU
     24938 ±  2%     -37.8%      15517        softirqs.CPU62.SCHED
     75860           +39.4%     105743 ±  6%  softirqs.CPU63.RCU
     24645 ±  2%     -39.2%      14992 ±  3%  softirqs.CPU63.SCHED
     75258           +43.1%     107691 ±  4%  softirqs.CPU64.RCU
     24495           -38.4%      15090 ±  4%  softirqs.CPU64.SCHED
     74550 ±  4%     +36.6%     101872 ± 12%  softirqs.CPU65.RCU
     24725 ±  2%     -38.9%      15116 ±  3%  softirqs.CPU65.SCHED
     72594 ±  3%     +45.9%     105926 ±  5%  softirqs.CPU66.RCU
     23765 ±  2%     -36.4%      15109 ±  3%  softirqs.CPU66.SCHED
     73455 ±  2%     +49.2%     109591 ± 10%  softirqs.CPU67.RCU
     24235 ±  2%     -37.6%      15127 ±  3%  softirqs.CPU67.SCHED
     74251 ±  2%     +43.5%     106582 ±  6%  softirqs.CPU68.RCU
     24601           -37.8%      15311 ±  3%  softirqs.CPU68.SCHED
     74174 ±  2%     +44.3%     107032 ±  4%  softirqs.CPU69.RCU
     24461           -37.0%      15404 ±  2%  softirqs.CPU69.SCHED
     78035           +39.4%     108770 ±  4%  softirqs.CPU7.RCU
     25312 ±  2%     -36.0%      16203 ±  6%  softirqs.CPU7.SCHED
     75399           +41.9%     106971 ±  5%  softirqs.CPU70.RCU
     24437 ±  2%     -37.2%      15357 ±  2%  softirqs.CPU70.SCHED
     73558 ±  2%     +46.0%     107387 ±  4%  softirqs.CPU71.RCU
     24139           -36.0%      15455 ±  4%  softirqs.CPU71.SCHED
     75609 ±  2%     +41.6%     107086 ±  8%  softirqs.CPU72.RCU
     24454 ±  2%     -41.4%      14323 ±  3%  softirqs.CPU72.SCHED
     76216           +41.6%     107887 ±  5%  softirqs.CPU73.RCU
     24755 ±  4%     -42.4%      14269 ±  3%  softirqs.CPU73.SCHED
     77096 ±  2%     +39.7%     107713 ±  4%  softirqs.CPU74.RCU
     25171 ±  4%     -40.5%      14972 ±  6%  softirqs.CPU74.SCHED
     77340 ±  3%     +40.0%     108312 ±  4%  softirqs.CPU75.RCU
     25018 ±  5%     -41.2%      14706 ±  3%  softirqs.CPU75.SCHED
     76163 ±  3%     +43.0%     108890 ±  4%  softirqs.CPU76.RCU
     25236 ±  5%     -42.3%      14561 ±  4%  softirqs.CPU76.SCHED
     76563 ±  4%     +41.3%     108207 ±  4%  softirqs.CPU77.RCU
     24691 ±  3%     -41.9%      14352 ±  3%  softirqs.CPU77.SCHED
     76879 ±  2%     +39.7%     107401 ±  5%  softirqs.CPU78.RCU
     25343 ±  3%     -43.1%      14427 ±  3%  softirqs.CPU78.SCHED
     75932 ±  3%     +39.3%     105781 ±  5%  softirqs.CPU79.RCU
     24366 ±  2%     -40.5%      14491 ±  2%  softirqs.CPU79.SCHED
     75997           +44.4%     109775 ±  5%  softirqs.CPU8.RCU
     25221 ±  3%     -34.5%      16522 ±  5%  softirqs.CPU8.SCHED
     75213 ±  2%     +42.2%     106983 ±  4%  softirqs.CPU80.RCU
     24287           -40.7%      14403 ±  3%  softirqs.CPU80.SCHED
     75279           +43.2%     107833 ±  5%  softirqs.CPU81.RCU
     23953 ±  2%     -40.4%      14271 ±  3%  softirqs.CPU81.SCHED
     74504           +43.1%     106646 ±  4%  softirqs.CPU82.RCU
     24201 ±  2%     -40.2%      14467 ±  2%  softirqs.CPU82.SCHED
     74016 ±  2%     +50.1%     111068 ±  5%  softirqs.CPU83.RCU
     24249 ±  3%     -41.3%      14246 ±  3%  softirqs.CPU83.SCHED
     74887 ±  4%     +38.3%     103598 ±  9%  softirqs.CPU84.RCU
     24563 ±  5%     -41.1%      14474 ±  4%  softirqs.CPU84.SCHED
     74072 ±  3%     +43.8%     106496 ±  7%  softirqs.CPU85.RCU
     24005           -40.3%      14342 ±  3%  softirqs.CPU85.SCHED
     74564           +38.4%     103218 ± 13%  softirqs.CPU86.RCU
     24337           -40.7%      14443 ±  3%  softirqs.CPU86.SCHED
     74956 ±  2%     +43.7%     107729 ±  4%  softirqs.CPU87.RCU
     23984 ±  2%     -39.8%      14443 ±  3%  softirqs.CPU87.SCHED
     75782           +41.7%     107384 ±  5%  softirqs.CPU88.RCU
     23939 ±  2%     -40.0%      14355 ±  3%  softirqs.CPU88.SCHED
     76180 ±  2%     +35.7%     103405 ± 11%  softirqs.CPU89.RCU
     24225 ±  2%     -38.3%      14940 ±  4%  softirqs.CPU89.SCHED
     77051           +41.3%     108855 ±  4%  softirqs.CPU9.RCU
     25147 ±  3%     -36.5%      15967 ±  5%  softirqs.CPU9.SCHED
     73787 ±  2%     +45.9%     107681 ±  5%  softirqs.CPU90.RCU
     24237 ±  3%     -40.2%      14502 ±  5%  softirqs.CPU90.SCHED
     75361 ±  3%     +43.3%     107974 ±  3%  softirqs.CPU91.RCU
     23831           -39.8%      14347 ±  3%  softirqs.CPU91.SCHED
     74688 ±  3%     +43.4%     107068 ±  5%  softirqs.CPU92.RCU
     24046 ±  2%     -40.4%      14334 ±  2%  softirqs.CPU92.SCHED
     74424 ±  2%     +45.3%     108105 ±  5%  softirqs.CPU93.RCU
     24027 ±  2%     -40.3%      14344 ±  2%  softirqs.CPU93.SCHED
     75293 ±  3%     +42.4%     107231 ±  5%  softirqs.CPU94.RCU
     23842 ±  2%     -39.5%      14413 ±  2%  softirqs.CPU94.SCHED
     74294           +38.3%     102766 ± 13%  softirqs.CPU95.RCU
     24173           -40.3%      14422 ±  2%  softirqs.CPU95.SCHED
   7291409           +41.9%   10346938 ±  5%  softirqs.RCU
   2382009           -38.4%    1467947 ±  2%  softirqs.SCHED


                                                                                
                             blogbench.time.user_time                           
                                                                                
  160 +-+-------------------------------------------------------------------+   
      |                                                                     |   
  140 +-+         O       O           O     O     O     O             O     |   
  120 O-+      O     O  O    O  O              O                   O     O  |   
      |  O  O                            O           O     O O  O           O   
  100 +-+                                                                   |   
      |..            +..+.     .+..  .+..  .+..        .+..       .+..      |   
   80 +-++     +     :    +..+.    +.    +.    +..+..+.    +.+..+.    +..+  |   
      |  :     :    :                                                       |   
   60 +-+ :   : :   :                                                       |   
   40 +-+ :   : :   :                                                       |   
      |    : :   : :                                                        |   
   20 +-+  : :   : :                                                        |   
      |     :     :                                                         |   
    0 +-+--------------------------O----------------------------------------+   
                                                                                
                                                                                                                                                                
                             blogbench.time.system_time                         
                                                                                
  25000 +-+-----------------------------------------------------------------+   
        |                                                                   |   
        |                                                                   |   
  20000 O-+O       O  O  O  O     O    O     O  O    O     O  O     O O     |   
        |     O  O             O          O        O    O        O       O  O   
        |                                                                   |   
  15000 +-+           +..                                                   |   
        | .+     +    :  +..     .+.  .+..+..+..  .+.+..+..+..  .+..+.+..   |   
  10000 +-+:     :   :      +..+.   +.          +.            +.         +  |   
        |   :   : :  :                                                      |   
        |   :   : :  :                                                      |   
   5000 +-+  : :  : :                                                       |   
        |    : :  : :                                                       |   
        |     :    :                                                        |   
      0 +-+-------------------------O---------------------------------------+   
                                                                                
                                                                                                                                                                
                    blogbench.time.percent_of_cpu_this_job_got                  
                                                                                
  7000 +-+---------O-------------------O------------------------------------+   
       O                O  O     O             O     O     O  O    O  O     |   
  6000 +-+O  O  O    O        O           O O     O     O        O       O  O   
       |                                                                    |   
  5000 +-+                                                                  |   
       |             +..        .+..                                        |   
  4000 +-++     +    :  +..+..+.      .+..+.+..+..+..+..+..+..+..+.+..+..+  |   
       |. :     :    :              +.                                      |   
  3000 +-+ :   : :  :                                                       |   
       |   :   : :  :                                                       |   
  2000 +-+  :  :  : :                                                       |   
       |    : :   : :                                                       |   
  1000 +-+  : :   ::                                                        |   
       |     :     :                                                        |   
     0 +-+--------------------------O---------------------------------------+   
                                                                                
                                                                                                                                                                
                     blogbench.time.involuntary_context_switches                
                                                                                
  450000 +-+----------------------------------------------------------------+   
         |          O                                                 O     |   
  400000 O-+O  O O     O  O  O O  O     O    O  O  O  O O  O  O     O       O   
  350000 +-+                               O                     O       O  |   
         |                                                                  |   
  300000 +-+           +..                                                  |   
  250000 +-+     +     :  +..    .+..  .+.. .+..                            |   
         |..+    :    :      +.+.    +.    +    +..+..+.+..+..+..+..+.+..+  |   
  200000 +-+:    ::   :                                                     |   
  150000 +-+ :  : :   :                                                     |   
         |   :  :  : :                                                      |   
  100000 +-+  : :  : :                                                      |   
   50000 +-+  : :  : :                                                      |   
         |     :    :                                                       |   
       0 +-+-------------------------O--------------------------------------+   
                                                                                
                                                                                                                                                                
                                 blogbench.read_score                           
                                                                                
    2e+06 +-+---------------------------------------------------------------+   
  1.8e+06 +-+        O       O          O          O     O             O    |   
          O       O     O  O       O          O  O                  O       |   
  1.6e+06 +-+O  O               O          O          O     O O  O       O  O   
  1.4e+06 +-+                                                               |   
          |             +..       .+..                                      |   
  1.2e+06 +-++    +     :  +.+..+.    +.+..+..+.. .+..+..+..+.+..+..+..+.+  |   
    1e+06 +-+:    :    :                         +                          |   
   800000 +-+ :   ::   :                                                    |   
          |   :  : :   :                                                    |   
   600000 +-+  : :  : :                                                     |   
   400000 +-+  : :  : :                                                     |   
          |    : :  : :                                                     |   
   200000 +-+   :    :                                                      |   
        0 +-+-------------------------O-------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Oliver Sang


View attachment "config-5.2.0-rc2-00001-g6e6de3d" of type "text/plain" (175594 bytes)

View attachment "job-script" of type "text/plain" (7511 bytes)

View attachment "job.yaml" of type "text/plain" (5111 bytes)

View attachment "reproduce" of type "text/plain" (412 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ