lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Wed, 25 Mar 2020 10:33:55 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Christoph Hellwig <hch@....de>
Cc:     "Darrick J. Wong" <darrick.wong@...cle.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org
Subject: [xfs] 542951592c: aim7.jobs-per-min 22.9% improvement

Greeting,

FYI, we noticed a 22.9% improvement of aim7.jobs-per-min due to commit:


commit: 542951592c99ff7b15c050954c051dd6dd6c0f97 ("xfs: remove the icdinode di_uid/di_gid members")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master

in testcase: aim7
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:

	disk: 4BRD_12G
	md: RAID1
	fs: xfs
	test: disk_cp
	load: 3000
	cpufreq_governor: performance
	ucode: 0x500002c

test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-7/performance/4BRD_12G/xfs/x86_64-rhel-7.6/3000/RAID1/debian-x86_64-20191114.cgz/lkp-csl-2ap2/disk_cp/aim7/0x500002c

commit: 
  3d8f282150 ("xfs: ensure that the inode uid/gid match values match the icdinode ones")
  542951592c ("xfs: remove the icdinode di_uid/di_gid members")

3d8f2821502d0b60 542951592c99ff7b15c050954c0 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
          1:5          -20%            :5     dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
         %stddev     %change         %stddev
             \          |                \  
    143177 ±  2%     +22.9%     176019        aim7.jobs-per-min
    126.00 ±  2%     -18.7%     102.48        aim7.time.elapsed_time
    126.00 ±  2%     -18.7%     102.48        aim7.time.elapsed_time.max
     76286 ±  6%     -55.1%      34244 ±  2%  aim7.time.involuntary_context_switches
    238507 ±  2%     -13.6%     206086        aim7.time.minor_page_faults
     16947           -44.7%       9364        aim7.time.system_time
     41.79 ±  7%     -17.6%      34.42        aim7.time.user_time
    985843           -10.8%     879812        aim7.time.voluntary_context_switches
     31139           -59.6%      12570 ±120%  numa-numastat.node3.other_node
  3.95e+09 ± 52%    +105.9%  8.133e+09 ± 14%  cpuidle.C6.time
   4557104 ± 50%    +120.3%   10039608 ±  2%  cpuidle.C6.usage
     30.00 ±  6%     +22.4       52.38        mpstat.cpu.all.idle%
     69.76 ±  2%     -22.4       47.37        mpstat.cpu.all.sys%
     31.05 ±  5%     +71.4%      53.23        iostat.cpu.idle
     68.71 ±  2%     -32.3%      46.53        iostat.cpu.system
    242.62 ± 15%     -47.0%     128.70 ±  4%  iostat.md0.w/s
      4322 ± 12%     -39.1%       2632 ±  4%  iostat.md0.wkB/s
     30.60 ±  5%     +72.5%      52.80        vmstat.cpu.id
     68.20 ±  2%     -32.6%      46.00        vmstat.cpu.sy
      4322 ± 12%     -39.1%       2632 ±  3%  vmstat.io.bo
    131.40 ±  3%     -32.3%      89.00 ±  2%  vmstat.procs.r
     18359 ±  3%      +7.0%      19648        vmstat.system.cs
    107177 ±  8%     -15.4%      90681 ±  7%  meminfo.AnonHugePages
     78252 ±  3%     -36.5%      49677 ±  4%  meminfo.Dirty
    115078 ±  3%     -28.9%      81775 ±  3%  meminfo.Inactive
     77292 ±  3%     -36.4%      49194 ±  4%  meminfo.Inactive(file)
    177320 ±  9%     -22.7%     137102 ±  4%  meminfo.Shmem
     31291 ±  4%     +17.4%      36739        meminfo.max_used_kB
     13898 ±  2%     -11.3%      12330        slabinfo.kmalloc-192.active_objs
     13902 ±  2%     -11.2%      12339        slabinfo.kmalloc-192.num_objs
     30086 ±  7%     -41.4%      17624 ±  2%  slabinfo.skbuff_ext_cache.active_objs
    715.80 ±  7%     -41.4%     419.20 ±  2%  slabinfo.skbuff_ext_cache.active_slabs
     30086 ±  7%     -41.4%      17624 ±  2%  slabinfo.skbuff_ext_cache.num_objs
    715.80 ±  7%     -41.4%     419.20 ±  2%  slabinfo.skbuff_ext_cache.num_slabs
    131752 ±  2%      -7.0%     122510        proc-vmstat.nr_active_anon
     19364 ±  5%     -34.3%      12722 ±  3%  proc-vmstat.nr_dirty
    338248            -4.4%     323204        proc-vmstat.nr_file_pages
     19108 ±  5%     -34.0%      12618 ±  3%  proc-vmstat.nr_inactive_file
     44339 ±  9%     -22.7%      34276 ±  4%  proc-vmstat.nr_shmem
    131752 ±  2%      -7.0%     122510        proc-vmstat.nr_zone_active_anon
     19108 ±  5%     -34.0%      12618 ±  3%  proc-vmstat.nr_zone_inactive_file
     17599 ±  4%     -33.9%      11625 ±  2%  proc-vmstat.nr_zone_write_pending
     98567 ±  4%     -39.0%      60160 ±  7%  proc-vmstat.numa_hint_faults
     57157 ±  7%     -50.7%      28192 ± 13%  proc-vmstat.numa_hint_faults_local
     40492 ±  8%     -21.1%      31952 ±  3%  proc-vmstat.numa_pages_migrated
    125869 ± 21%     -42.0%      73062 ± 18%  proc-vmstat.numa_pte_updates
     41250 ± 11%     -23.6%      31509 ±  5%  proc-vmstat.pgactivate
    746602 ±  2%     -16.5%     623549        proc-vmstat.pgfault
     40492 ±  8%     -21.1%      31952 ±  3%  proc-vmstat.pgmigrate_success
    555936 ± 10%     -50.1%     277264 ±  3%  proc-vmstat.pgpgout
     19252 ±  5%     -32.1%      13070 ±  2%  numa-meminfo.node0.Dirty
     19220 ±  5%     -32.7%      12936 ±  3%  numa-meminfo.node0.Inactive(file)
      9619 ± 12%     -16.0%       8083 ±  6%  numa-meminfo.node0.Mapped
     19210 ±  4%     -33.8%      12711 ±  3%  numa-meminfo.node1.Dirty
     18959 ±  4%     -34.3%      12450 ±  3%  numa-meminfo.node1.Inactive(file)
     14018 ± 18%     -26.4%      10320 ± 28%  numa-meminfo.node1.Mapped
    935385 ± 18%     -26.1%     691537 ±  3%  numa-meminfo.node1.MemUsed
     18978 ±  5%     -33.0%      12723 ±  2%  numa-meminfo.node2.Dirty
     18776 ±  6%     -33.6%      12469 ±  3%  numa-meminfo.node2.Inactive(file)
    835.60 ±199%   +2420.1%      21057 ±114%  numa-meminfo.node3.AnonHugePages
     39234 ±  6%    +220.1%     125579 ± 58%  numa-meminfo.node3.AnonPages
     19134 ±  6%     -32.4%      12927 ±  2%  numa-meminfo.node3.Dirty
     18665 ±  6%     -30.0%      13070 ±  4%  numa-meminfo.node3.Inactive(file)
     25364 ±  5%     +88.9%      47907 ± 32%  numa-meminfo.node3.KReclaimable
      6173 ±  6%    +456.5%      34353 ± 66%  numa-meminfo.node3.KernelStack
     25364 ±  5%     +88.9%      47907 ± 32%  numa-meminfo.node3.SReclaimable
     66270 ±  3%     +98.0%     131240 ± 31%  numa-meminfo.node3.SUnreclaim
    151915 ± 10%     -21.5%     119312 ±  6%  numa-meminfo.node3.Shmem
     91635 ±  3%     +95.5%     179148 ± 25%  numa-meminfo.node3.Slab
      4783 ±  4%     -32.9%       3207 ±  2%  numa-vmstat.node0.nr_dirty
      4766 ±  4%     -33.3%       3180 ±  2%  numa-vmstat.node0.nr_inactive_file
      2466 ± 12%     -16.7%       2054 ±  7%  numa-vmstat.node0.nr_mapped
      4763 ±  3%     -33.3%       3178 ±  2%  numa-vmstat.node0.nr_zone_inactive_file
      4370 ±  4%     -32.6%       2943 ±  2%  numa-vmstat.node0.nr_zone_write_pending
      4832 ±  5%     -34.3%       3174 ±  3%  numa-vmstat.node1.nr_dirty
      4772 ±  4%     -35.0%       3101 ±  3%  numa-vmstat.node1.nr_inactive_file
      3591 ± 19%     -27.3%       2612 ± 29%  numa-vmstat.node1.nr_mapped
      4767 ±  4%     -34.9%       3104 ±  3%  numa-vmstat.node1.nr_zone_inactive_file
      4407 ±  4%     -33.7%       2921 ±  3%  numa-vmstat.node1.nr_zone_write_pending
      4763 ±  4%     -33.8%       3155 ±  2%  numa-vmstat.node2.nr_dirty
      4711 ±  5%     -33.9%       3113 ±  3%  numa-vmstat.node2.nr_inactive_file
      4711 ±  5%     -33.8%       3121 ±  3%  numa-vmstat.node2.nr_zone_inactive_file
      4389 ±  4%     -34.1%       2893 ±  2%  numa-vmstat.node2.nr_zone_write_pending
      9829 ±  6%    +219.9%      31441 ± 57%  numa-vmstat.node3.nr_anon_pages
      4826 ±  5%     -33.6%       3204 ±  2%  numa-vmstat.node3.nr_dirty
      4711 ±  6%     -31.2%       3242 ±  5%  numa-vmstat.node3.nr_inactive_file
      6173 ±  6%    +457.6%      34417 ± 66%  numa-vmstat.node3.nr_kernel_stack
     37939 ± 10%     -21.6%      29751 ±  6%  numa-vmstat.node3.nr_shmem
      6340 ±  5%     +89.0%      11980 ± 32%  numa-vmstat.node3.nr_slab_reclaimable
     16566 ±  3%     +98.1%      32823 ± 31%  numa-vmstat.node3.nr_slab_unreclaimable
      4714 ±  5%     -31.3%       3240 ±  5%  numa-vmstat.node3.nr_zone_inactive_file
      4412 ±  4%     -34.1%       2908 ±  2%  numa-vmstat.node3.nr_zone_write_pending
 3.962e+09 ±  2%      +8.8%  4.312e+09        perf-stat.i.branch-instructions
  36512206 ±  4%     +15.3%   42113999 ±  2%  perf-stat.i.branch-misses
     35.57 ±  2%      -3.7       31.89 ±  4%  perf-stat.i.cache-miss-rate%
 1.443e+08           -12.5%  1.263e+08 ±  2%  perf-stat.i.cache-misses
 3.875e+08 ±  2%      -4.1%  3.717e+08        perf-stat.i.cache-references
     18300 ±  3%      +6.7%      19529        perf-stat.i.context-switches
     19.47           -37.7%      12.13 ±  2%  perf-stat.i.cpi
 4.101e+11 ±  2%     -31.5%  2.808e+11        perf-stat.i.cpu-cycles
      2973 ±  4%     -14.4%       2545        perf-stat.i.cpu-migrations
      2748           -19.3%       2218 ±  4%  perf-stat.i.cycles-between-cache-misses
  5.67e+09 ±  2%     +11.3%  6.308e+09        perf-stat.i.dTLB-loads
 2.795e+09 ±  2%     +19.4%  3.337e+09        perf-stat.i.dTLB-stores
     83.16 ±  2%      -4.5       78.65        perf-stat.i.iTLB-load-miss-rate%
   4084223 ±  6%     +43.4%    5855729 ±  2%  perf-stat.i.iTLB-loads
 1.969e+10 ±  2%     +10.4%  2.174e+10        perf-stat.i.instructions
    856.27           +14.5%     980.67 ±  3%  perf-stat.i.instructions-per-iTLB-miss
      0.08 ±  5%     +29.7%       0.11 ±  3%  perf-stat.i.ipc
      5826            +2.5%       5973        perf-stat.i.minor-faults
  25895454           -25.2%   19376725 ±  2%  perf-stat.i.node-load-misses
   2144000 ±  3%     -19.3%    1730458        perf-stat.i.node-loads
     76.47            -7.1       69.35        perf-stat.i.node-store-miss-rate%
   5292288 ±  2%     -21.1%    4177052 ±  3%  perf-stat.i.node-store-misses
   1713785 ±  2%     +11.4%    1908498        perf-stat.i.node-stores
      5826            +2.5%       5973        perf-stat.i.page-faults
     19.75           -13.6%      17.08        perf-stat.overall.MPKI
      0.90 ±  2%      +0.0        0.95 ±  2%  perf-stat.overall.branch-miss-rate%
     37.25            -3.1       34.15 ±  2%  perf-stat.overall.cache-miss-rate%
     20.91           -37.9%      12.97        perf-stat.overall.cpi
      2842           -21.6%       2227 ±  3%  perf-stat.overall.cycles-between-cache-misses
      0.05 ±  3%      -0.0        0.04 ±  8%  perf-stat.overall.dTLB-load-miss-rate%
     86.59            -5.0       81.63        perf-stat.overall.iTLB-load-miss-rate%
    755.92 ±  2%     +10.8%     837.44 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.05           +61.2%       0.08        perf-stat.overall.ipc
     75.55            -7.0       68.58        perf-stat.overall.node-store-miss-rate%
 3.974e+09 ±  2%      +8.6%  4.317e+09        perf-stat.ps.branch-instructions
  35898918 ±  4%     +14.5%   41102054 ±  2%  perf-stat.ps.branch-misses
 1.453e+08           -12.6%  1.269e+08 ±  2%  perf-stat.ps.cache-misses
 3.901e+08 ±  2%      -4.7%  3.717e+08        perf-stat.ps.cache-references
     18335 ±  3%      +6.7%      19567        perf-stat.ps.context-switches
  4.13e+11 ±  2%     -31.6%  2.824e+11        perf-stat.ps.cpu-cycles
      2972 ±  4%     -14.4%       2543        perf-stat.ps.cpu-migrations
   2587334 ±  2%     -12.6%    2260398 ±  8%  perf-stat.ps.dTLB-load-misses
 5.695e+09 ±  2%     +11.0%  6.324e+09        perf-stat.ps.dTLB-loads
 2.811e+09 ±  2%     +19.2%   3.35e+09        perf-stat.ps.dTLB-stores
   4040456 ±  6%     +44.8%    5850306 ±  2%  perf-stat.ps.iTLB-loads
 1.976e+10 ±  2%     +10.2%  2.177e+10        perf-stat.ps.instructions
  26069367           -25.3%   19476794 ±  2%  perf-stat.ps.node-load-misses
   2143901 ±  4%     -19.1%    1733465        perf-stat.ps.node-loads
   5349887 ±  2%     -21.6%    4192949 ±  4%  perf-stat.ps.node-store-misses
   1731281 ±  2%     +10.9%    1919145        perf-stat.ps.node-stores
 2.506e+12           -10.6%   2.24e+12        perf-stat.total.instructions
     40448 ±  2%     -67.9%      12972        sched_debug.cfs_rq:/.exec_clock.avg
     42438 ±  3%     -65.1%      14822 ±  4%  sched_debug.cfs_rq:/.exec_clock.max
     37007 ±  3%     -67.7%      11958        sched_debug.cfs_rq:/.exec_clock.min
    525.02 ±  2%     -18.3%     428.68 ±  8%  sched_debug.cfs_rq:/.exec_clock.stddev
   6539781 ±  5%     -77.8%    1450640        sched_debug.cfs_rq:/.min_vruntime.avg
   6739879 ±  5%     -76.0%    1614748 ±  3%  sched_debug.cfs_rq:/.min_vruntime.max
   5895997 ±  5%     -77.4%    1330405 ±  2%  sched_debug.cfs_rq:/.min_vruntime.min
     82852 ±  6%     -44.7%      45854 ±  7%  sched_debug.cfs_rq:/.min_vruntime.stddev
      0.52 ±  8%     -39.9%       0.31 ±  9%  sched_debug.cfs_rq:/.nr_running.avg
      0.50 ± 11%     -70.4%       0.15 ± 25%  sched_debug.cfs_rq:/.nr_spread_over.avg
      3.53 ± 11%     -43.4%       2.00 ± 27%  sched_debug.cfs_rq:/.nr_spread_over.max
      0.68 ±  7%     -52.7%       0.32 ± 12%  sched_debug.cfs_rq:/.nr_spread_over.stddev
      2.62 ±  4%     -26.3%       1.93 ± 10%  sched_debug.cfs_rq:/.runnable_load_avg.avg
    237482 ± 14%     -29.6%     167097 ± 27%  sched_debug.cfs_rq:/.spread0.max
   -620977           -80.8%    -119152        sched_debug.cfs_rq:/.spread0.min
     83201 ±  6%     -45.2%      45563 ±  7%  sched_debug.cfs_rq:/.spread0.stddev
    554.97 ±  5%     -39.3%     336.78 ±  4%  sched_debug.cfs_rq:/.util_avg.avg
    336.61 ± 10%     -56.8%     145.33 ±  9%  sched_debug.cfs_rq:/.util_est_enqueued.avg
    944.60 ± 10%     -23.2%     725.40        sched_debug.cfs_rq:/.util_est_enqueued.max
    225.69 ±  2%     -27.7%     163.09 ±  4%  sched_debug.cfs_rq:/.util_est_enqueued.stddev
    282521 ± 11%     -24.1%     214316 ± 12%  sched_debug.cpu.avg_idle.min
    101861           -29.7%      71593        sched_debug.cpu.clock.avg
    101975           -29.7%      71678        sched_debug.cpu.clock.max
    101728           -29.7%      71493        sched_debug.cpu.clock.min
    101861           -29.7%      71593        sched_debug.cpu.clock_task.avg
    101975           -29.7%      71678        sched_debug.cpu.clock_task.max
    101728           -29.7%      71493        sched_debug.cpu.clock_task.min
      2448 ±  8%     -39.5%       1481 ± 11%  sched_debug.cpu.curr->pid.avg
      7201           -20.6%       5718        sched_debug.cpu.curr->pid.max
      0.52 ±  9%     -40.6%       0.31 ±  9%  sched_debug.cpu.nr_running.avg
      7818 ±  2%     -34.6%       5114        sched_debug.cpu.nr_switches.avg
     21484 ± 10%     -24.8%      16163 ± 17%  sched_debug.cpu.nr_switches.max
      6582 ±  2%     -43.5%       3718 ±  4%  sched_debug.cpu.nr_switches.min
    -63.40           -46.1%     -34.20        sched_debug.cpu.nr_uninterruptible.min
     21.20 ±  3%     -17.2%      17.54 ±  2%  sched_debug.cpu.nr_uninterruptible.stddev
      5604 ±  3%     -49.0%       2860        sched_debug.cpu.sched_count.avg
     10338 ±  7%     -32.5%       6980 ± 14%  sched_debug.cpu.sched_count.max
      5061 ±  3%     -52.5%       2406 ±  2%  sched_debug.cpu.sched_count.min
    659.40 ±  5%     -24.6%     497.13 ± 12%  sched_debug.cpu.sched_count.stddev
      2549 ±  3%     -46.6%       1360        sched_debug.cpu.sched_goidle.avg
      4910 ±  7%     -30.3%       3422 ± 14%  sched_debug.cpu.sched_goidle.max
      2262 ±  2%     -50.0%       1131 ±  3%  sched_debug.cpu.sched_goidle.min
    324.92 ±  5%     -23.5%     248.54 ± 12%  sched_debug.cpu.sched_goidle.stddev
      3072 ±  3%     -47.1%       1626        sched_debug.cpu.ttwu_count.avg
      5719 ±  5%     -31.8%       3898 ± 12%  sched_debug.cpu.ttwu_count.max
      2586 ±  2%     -47.3%       1363        sched_debug.cpu.ttwu_count.min
    402.69 ±  3%     -31.3%     276.69 ± 11%  sched_debug.cpu.ttwu_count.stddev
    282.67 ±  3%     -57.2%     120.89 ±  2%  sched_debug.cpu.ttwu_local.avg
    615.53 ±  5%     -50.3%     305.80 ± 16%  sched_debug.cpu.ttwu_local.max
    195.07 ±  6%     -61.9%      74.40 ±  4%  sched_debug.cpu.ttwu_local.min
     49.88 ±  7%     -33.4%      33.21 ±  8%  sched_debug.cpu.ttwu_local.stddev
    101727           -29.7%      71492        sched_debug.cpu_clk
    100845           -30.0%      70608        sched_debug.ktime
      2.52           -25.0%       1.89        sched_debug.rt_rq:/.rt_runtime.stddev
    102193           -29.5%      72004        sched_debug.sched_clk
      9.70 ±  8%      -8.5        1.18 ±  6%  perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.82 ±  5%      +0.2        0.98        perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply
      0.85 ±  5%      +0.2        1.01        perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
      0.45 ± 50%      +0.2        0.69 ±  3%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.45 ± 50%      +0.2        0.69 ±  3%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      0.45 ± 50%      +0.2        0.69 ±  3%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat
      0.45 ± 50%      +0.2        0.69 ±  3%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat
      0.45 ± 50%      +0.2        0.70 ±  3%  perf-profile.calltrace.cycles-pp.creat
      0.45 ± 50%      +0.3        0.70 ±  3%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat
      0.45 ± 50%      +0.3        0.70 ±  3%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat
      0.93 ± 11%      +0.3        1.19 ±  2%  perf-profile.calltrace.cycles-pp.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
      0.42 ± 50%      +0.3        0.70 ±  2%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close
      0.41 ± 50%      +0.3        0.69 ±  2%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.42 ± 50%      +0.3        0.70 ±  2%  perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close
      0.42 ± 50%      +0.3        0.71 ±  2%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.close
      0.42 ± 50%      +0.3        0.71 ±  2%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.close
      0.43 ± 50%      +0.3        0.72        perf-profile.calltrace.cycles-pp.close
      0.21 ±122%      +0.4        0.59 ±  7%  perf-profile.calltrace.cycles-pp.copy_page_to_iter.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read
      1.65 ±  9%      +0.5        2.14        perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
      0.00            +0.5        0.54 ±  3%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
      0.21 ±122%      +0.5        0.76 ±  3%  perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
      0.21 ±122%      +0.6        0.76 ±  3%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.unlink
      0.21 ±122%      +0.6        0.76 ±  3%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
      0.21 ±122%      +0.6        0.77 ±  4%  perf-profile.calltrace.cycles-pp.unlink
      0.10 ±200%      +0.6        0.68        perf-profile.calltrace.cycles-pp.iomap_set_range_uptodate.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
      0.00            +0.7        0.66 ±  2%  perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop
      0.00            +0.7        0.67 ±  4%  perf-profile.calltrace.cycles-pp.rw_verify_area.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +0.7        0.67 ±  2%  perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
      3.03 ±  9%      +0.9        3.88        perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write
      3.97 ±  9%      +0.9        4.83        perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write
      3.98 ±  9%      +0.9        4.85        perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write
     15.91 ±  6%      +1.6       17.46        perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter
     16.04 ±  6%      +1.6       17.61        perf-profile.calltrace.cycles-pp.touch_atime.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read
     26.56 ±  6%      +2.4       28.92        perf-profile.calltrace.cycles-pp.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read
      0.73 ±  8%      +2.4        3.15 ±  4%  perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter
      5.32 ±  5%      +3.1        8.43 ±  2%  perf-profile.calltrace.cycles-pp.up_read.xfs_iunlock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read
      5.39 ±  5%      +3.1        8.52 ±  2%  perf-profile.calltrace.cycles-pp.xfs_iunlock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read
      0.75 ±  8%      +3.7        4.43 ±  2%  perf-profile.calltrace.cycles-pp.pagecache_get_page.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read
     62.82 ±  6%      +4.4       67.25        perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.39 ±  6%      +5.9       15.29        perf-profile.calltrace.cycles-pp.down_read.xfs_ilock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read
      9.52 ±  6%      +5.9       15.45        perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read
      8.99 ± 23%      +6.2       15.19        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      9.03 ± 23%      +6.4       15.38        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      9.03 ± 23%      +6.4       15.40        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
      9.09 ± 23%      +6.4       15.51 ±  2%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
      9.09 ± 23%      +6.4       15.51 ±  2%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
      9.09 ± 23%      +6.4       15.51 ±  2%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
      9.13 ± 23%      +6.5       15.60 ±  2%  perf-profile.calltrace.cycles-pp.secondary_startup_64
     45.97 ±  6%      +8.4       54.34        perf-profile.calltrace.cycles-pp.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64
     41.54 ±  6%     +12.0       53.51        perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read
      9.79 ±  9%      -8.6        1.22 ±  6%  perf-profile.children.cycles-pp.fsnotify
     90.51 ±  2%      -6.6       83.91        perf-profile.children.cycles-pp.do_syscall_64
     90.53 ±  2%      -6.6       83.95        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.84 ± 10%      -2.3        0.51 ±  6%  perf-profile.children.cycles-pp.security_file_permission
      0.43 ± 13%      -0.3        0.10 ±  4%  perf-profile.children.cycles-pp.current_time
      0.06 ±  6%      +0.0        0.07 ±  5%  perf-profile.children.cycles-pp.xfs_dialloc
      0.09 ±  4%      +0.0        0.11 ±  3%  perf-profile.children.cycles-pp.xfs_buf_find
      0.09 ±  8%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.xfs_buf_get_map
      0.06 ±  7%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.xfs_dir_ialloc
      0.06 ±  7%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.xfs_ialloc
      0.04 ± 50%      +0.0        0.06 ±  6%  perf-profile.children.cycles-pp.xfs_difree
      0.05 ±  9%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.xfs_check_agi_freecount
      0.09 ±  5%      +0.0        0.12 ±  6%  perf-profile.children.cycles-pp.xfs_buf_read_map
      0.07 ±  9%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.common_file_perm
      0.04 ± 50%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.__fget_light
      0.06            +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.__fdget_pos
      0.05 ±  9%      +0.0        0.08 ±  7%  perf-profile.children.cycles-pp.xfs_trans_unreserve_and_mod_sb
      0.04 ± 50%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.__percpu_counter_compare
      0.12 ±  5%      +0.0        0.15 ±  6%  perf-profile.children.cycles-pp.xfs_ifree
      0.26 ±  8%      +0.0        0.29 ±  4%  perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
      0.05 ±  7%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.try_to_wake_up
      0.10 ±  7%      +0.0        0.13 ±  6%  perf-profile.children.cycles-pp.up_write
      0.06 ± 10%      +0.0        0.09 ±  4%  perf-profile.children.cycles-pp.mem_cgroup_commit_charge
      0.04 ± 50%      +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
      0.11 ±  3%      +0.0        0.14 ±  5%  perf-profile.children.cycles-pp.xfs_trans_read_buf_map
      0.03 ± 81%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.xfs_mod_ifree
      0.06 ± 12%      +0.0        0.10 ±  5%  perf-profile.children.cycles-pp.__pagevec_lru_add_fn
      0.09 ±  5%      +0.0        0.12 ±  3%  perf-profile.children.cycles-pp.___might_sleep
      0.07 ±  9%      +0.0        0.11 ±  8%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      0.05            +0.0        0.09        perf-profile.children.cycles-pp.truncate_cleanup_page
      0.03 ± 81%      +0.0        0.07 ±  9%  perf-profile.children.cycles-pp.xfs_da3_node_lookup_int
      0.07 ±  7%      +0.0        0.11 ±  3%  perf-profile.children.cycles-pp.release_pages
      0.06            +0.0        0.10 ±  3%  perf-profile.children.cycles-pp.__pagevec_release
      0.09 ±  4%      +0.0        0.13 ±  3%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.02 ±122%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.__percpu_counter_sum
      0.06 ±  8%      +0.0        0.10        perf-profile.children.cycles-pp.__mod_lruvec_state
      0.28 ±  6%      +0.0        0.33        perf-profile.children.cycles-pp.__add_to_page_cache_locked
      0.01 ±200%      +0.0        0.06        perf-profile.children.cycles-pp.__might_sleep
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.unlock_page
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.xfs_buf_item_format
      0.04 ± 50%      +0.1        0.09 ±  5%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.09 ±  8%      +0.1        0.14 ±  3%  perf-profile.children.cycles-pp.__lru_cache_add
      0.08 ±  9%      +0.1        0.13 ±  3%  perf-profile.children.cycles-pp.pagevec_lru_move_fn
      0.02 ±122%      +0.1        0.07 ± 10%  perf-profile.children.cycles-pp.xfs_dir_removename
      0.02 ±122%      +0.1        0.07 ± 10%  perf-profile.children.cycles-pp.xfs_dir2_node_removename
      0.00            +0.1        0.05 ±  7%  perf-profile.children.cycles-pp.account_page_cleaned
      0.00            +0.1        0.05 ±  7%  perf-profile.children.cycles-pp.xfs_dialloc_ag
      0.00            +0.1        0.05 ±  7%  perf-profile.children.cycles-pp.xfs_buf_item_release
      0.00            +0.1        0.05 ±  9%  perf-profile.children.cycles-pp.enqueue_entity
      0.24 ±  5%      +0.1        0.30 ±  3%  perf-profile.children.cycles-pp.xfs_fs_destroy_inode
      0.19 ±  3%      +0.1        0.25 ±  5%  perf-profile.children.cycles-pp.xfs_inactive_ifree
      0.24 ±  4%      +0.1        0.30 ±  3%  perf-profile.children.cycles-pp.xfs_inactive
      0.02 ±123%      +0.1        0.08 ± 13%  perf-profile.children.cycles-pp.rcu_core
      0.01 ±200%      +0.1        0.07 ±  5%  perf-profile.children.cycles-pp.iov_iter_fault_in_readable
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.pagevec_lookup_entries
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.find_get_entries
      0.25 ±  4%      +0.1        0.31 ±  3%  perf-profile.children.cycles-pp.destroy_inode
      0.10 ±  4%      +0.1        0.17 ±  2%  perf-profile.children.cycles-pp.entry_SYSCALL_64
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.activate_task
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.01 ±200%      +0.1        0.07 ±  5%  perf-profile.children.cycles-pp.delete_from_page_cache_batch
      0.11 ±  6%      +0.1        0.18 ±  7%  perf-profile.children.cycles-pp.xfs_vn_unlink
      0.11 ±  6%      +0.1        0.18 ±  7%  perf-profile.children.cycles-pp.xfs_remove
      0.02 ±125%      +0.1        0.09 ± 10%  perf-profile.children.cycles-pp.start_kernel
      0.09 ± 30%      +0.1        0.16 ± 18%  perf-profile.children.cycles-pp.ktime_get
      0.11 ±  7%      +0.1        0.19 ±  7%  perf-profile.children.cycles-pp.vfs_unlink
      0.00            +0.1        0.07 ±  5%  perf-profile.children.cycles-pp.__cancel_dirty_page
      0.11 ± 11%      +0.1        0.19 ±  8%  perf-profile.children.cycles-pp.account_page_dirtied
      0.08 ± 11%      +0.1        0.17 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.17 ±  2%      +0.1        0.26 ±  3%  perf-profile.children.cycles-pp.xfs_generic_create
      0.07 ± 33%      +0.1        0.16 ± 18%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.16 ±  3%      +0.1        0.25 ±  4%  perf-profile.children.cycles-pp.xfs_create
      0.39 ±  6%      +0.1        0.49        perf-profile.children.cycles-pp.add_to_page_cache_lru
      0.08 ± 26%      +0.1        0.19 ± 21%  perf-profile.children.cycles-pp.irq_exit
      0.42 ± 15%      +0.1        0.53 ±  8%  perf-profile.children.cycles-pp.copyout
      0.15 ± 11%      +0.1        0.26 ±  5%  perf-profile.children.cycles-pp.__set_page_dirty
      0.64 ± 13%      +0.1        0.77 ±  6%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.47 ± 14%      +0.1        0.60 ±  6%  perf-profile.children.cycles-pp.copy_page_to_iter
      0.61 ±  7%      +0.1        0.74        perf-profile.children.cycles-pp.rwsem_optimistic_spin
      0.60 ±  6%      +0.1        0.74 ±  3%  perf-profile.children.cycles-pp.do_sys_open
      0.60 ±  6%      +0.1        0.74 ±  3%  perf-profile.children.cycles-pp.do_sys_openat2
      0.21 ±  2%      +0.1        0.34 ±  2%  perf-profile.children.cycles-pp.truncate_inode_pages_range
      0.21            +0.1        0.35 ±  2%  perf-profile.children.cycles-pp.evict
      0.59 ±  6%      +0.1        0.73 ±  3%  perf-profile.children.cycles-pp.do_filp_open
      0.59 ±  6%      +0.1        0.73 ±  3%  perf-profile.children.cycles-pp.path_openat
      0.55 ±  6%      +0.2        0.70 ±  3%  perf-profile.children.cycles-pp.creat
      0.31 ±  7%      +0.2        0.47 ±  6%  perf-profile.children.cycles-pp.iomap_set_page_dirty
      0.85 ±  5%      +0.2        1.01        perf-profile.children.cycles-pp.grab_cache_page_write_begin
      0.52 ±  3%      +0.2        0.70 ±  2%  perf-profile.children.cycles-pp.exit_to_usermode_loop
      0.51 ±  3%      +0.2        0.70 ±  2%  perf-profile.children.cycles-pp.task_work_run
      0.51 ±  3%      +0.2        0.69 ±  2%  perf-profile.children.cycles-pp.__fput
      0.53 ±  3%      +0.2        0.72        perf-profile.children.cycles-pp.close
      0.69 ±  5%      +0.2        0.89 ±  3%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      0.23 ± 39%      +0.2        0.42 ±  9%  perf-profile.children.cycles-pp.update_cfs_group
      0.31 ±  6%      +0.2        0.51 ±  4%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      0.47 ±  3%      +0.2        0.66 ±  2%  perf-profile.children.cycles-pp.__dentry_kill
      0.47 ±  3%      +0.2        0.67 ±  2%  perf-profile.children.cycles-pp.dput
      0.11 ± 53%      +0.2        0.33 ±  7%  perf-profile.children.cycles-pp.update_load_avg
      0.50 ±  3%      +0.3        0.76 ±  3%  perf-profile.children.cycles-pp.do_unlinkat
      0.51 ±  3%      +0.3        0.77 ±  4%  perf-profile.children.cycles-pp.unlink
      0.93 ± 10%      +0.3        1.19 ±  2%  perf-profile.children.cycles-pp.iomap_write_end
      0.18 ±  7%      +0.3        0.45 ±  5%  perf-profile.children.cycles-pp.down_write
      0.35 ± 10%      +0.3        0.68 ±  3%  perf-profile.children.cycles-pp.rw_verify_area
      0.06 ±  7%      +0.3        0.40 ±  2%  perf-profile.children.cycles-pp.rcu_all_qs
      0.09 ±  8%      +0.3        0.43 ±  2%  perf-profile.children.cycles-pp._cond_resched
      0.94 ± 16%      +0.4        1.30        perf-profile.children.cycles-pp.iomap_set_range_uptodate
      0.40 ± 46%      +0.4        0.83 ±  7%  perf-profile.children.cycles-pp.task_tick_fair
      0.43 ± 47%      +0.5        0.89 ±  6%  perf-profile.children.cycles-pp.scheduler_tick
      1.66 ±  9%      +0.5        2.15        perf-profile.children.cycles-pp.iomap_write_begin
      0.48 ± 47%      +0.5        0.99 ±  6%  perf-profile.children.cycles-pp.tick_sched_handle
      0.48 ± 46%      +0.5        0.98 ±  5%  perf-profile.children.cycles-pp.update_process_times
      0.51 ± 46%      +0.5        1.04 ±  5%  perf-profile.children.cycles-pp.tick_sched_timer
      0.58 ± 40%      +0.5        1.12 ±  7%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.77 ± 37%      +0.7        1.43 ±  6%  perf-profile.children.cycles-pp.hrtimer_interrupt
      1.50 ± 20%      +0.8        2.28 ±  5%  perf-profile.children.cycles-pp.apic_timer_interrupt
      0.87 ± 35%      +0.8        1.65 ±  7%  perf-profile.children.cycles-pp.smp_apic_timer_interrupt
      3.03 ±  9%      +0.9        3.89        perf-profile.children.cycles-pp.iomap_write_actor
      3.98 ±  9%      +0.9        4.84        perf-profile.children.cycles-pp.iomap_apply
      3.98 ±  9%      +0.9        4.85        perf-profile.children.cycles-pp.iomap_file_buffered_write
     16.03 ±  6%      +1.6       17.59        perf-profile.children.cycles-pp.atime_needs_update
     16.04 ±  6%      +1.6       17.61        perf-profile.children.cycles-pp.touch_atime
      0.82 ±  8%      +2.5        3.29 ±  3%  perf-profile.children.cycles-pp.find_get_entry
     26.63 ±  6%      +2.9       29.52        perf-profile.children.cycles-pp.generic_file_read_iter
      5.41 ±  5%      +3.1        8.54 ±  2%  perf-profile.children.cycles-pp.up_read
      5.52 ±  6%      +3.2        8.68 ±  2%  perf-profile.children.cycles-pp.xfs_iunlock
      1.58 ±  6%      +3.3        4.87 ±  2%  perf-profile.children.cycles-pp.pagecache_get_page
     62.94 ±  6%      +4.4       67.35        perf-profile.children.cycles-pp.new_sync_read
      9.58 ±  5%      +6.0       15.54        perf-profile.children.cycles-pp.down_read
      9.71 ±  6%      +6.2       15.92        perf-profile.children.cycles-pp.xfs_ilock
      9.04 ± 23%      +6.3       15.29        perf-profile.children.cycles-pp.intel_idle
      9.07 ± 23%      +6.4       15.49        perf-profile.children.cycles-pp.cpuidle_enter
      9.07 ± 23%      +6.4       15.49        perf-profile.children.cycles-pp.cpuidle_enter_state
      9.09 ± 23%      +6.4       15.51 ±  2%  perf-profile.children.cycles-pp.start_secondary
      9.13 ± 23%      +6.5       15.60 ±  2%  perf-profile.children.cycles-pp.secondary_startup_64
      9.13 ± 23%      +6.5       15.60 ±  2%  perf-profile.children.cycles-pp.cpu_startup_entry
      9.13 ± 23%      +6.5       15.61 ±  2%  perf-profile.children.cycles-pp.do_idle
     45.98 ±  6%      +8.4       54.35        perf-profile.children.cycles-pp.xfs_file_read_iter
     41.54 ±  6%     +12.0       53.51        perf-profile.children.cycles-pp.xfs_file_buffered_aio_read
      9.69 ±  9%      -8.5        1.19 ±  6%  perf-profile.self.cycles-pp.fsnotify
     16.80 ±  6%      -4.0       12.76        perf-profile.self.cycles-pp.new_sync_read
      4.39 ±  8%      -3.6        0.82 ±  5%  perf-profile.self.cycles-pp.xfs_file_read_iter
      2.73 ± 10%      -2.3        0.39 ±  9%  perf-profile.self.cycles-pp.security_file_permission
      2.62 ± 11%      -2.3        0.36 ±  9%  perf-profile.self.cycles-pp.vfs_read
      9.22 ±  9%      -1.8        7.44 ±  2%  perf-profile.self.cycles-pp.generic_file_read_iter
      0.05            +0.0        0.06 ±  7%  perf-profile.self.cycles-pp.common_file_perm
      0.06            +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.xas_load
      0.06 ±  8%      +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.iomap_apply
      0.04 ± 51%      +0.0        0.07 ±  9%  perf-profile.self.cycles-pp.__add_to_page_cache_locked
      0.06 ±  6%      +0.0        0.09 ±  4%  perf-profile.self.cycles-pp.entry_SYSCALL_64
      0.06 ± 12%      +0.0        0.09 ±  8%  perf-profile.self.cycles-pp.percpu_counter_add_batch
      0.09 ±  8%      +0.0        0.12 ±  8%  perf-profile.self.cycles-pp.up_write
      0.08 ±  5%      +0.0        0.12 ±  3%  perf-profile.self.cycles-pp.___might_sleep
      0.02 ±122%      +0.0        0.06        perf-profile.self.cycles-pp.__fget_light
      0.09 ±  4%      +0.0        0.13 ±  3%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.unlock_page
      0.04 ± 50%      +0.1        0.09 ±  4%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.00            +0.1        0.05 ±  7%  perf-profile.self.cycles-pp.__pagevec_lru_add_fn
      0.00            +0.1        0.05 ±  7%  perf-profile.self.cycles-pp.__might_sleep
      0.00            +0.1        0.05 ±  7%  perf-profile.self.cycles-pp.find_get_entries
      0.00            +0.1        0.05 ±  9%  perf-profile.self.cycles-pp.write
      0.00            +0.1        0.05 ±  9%  perf-profile.self.cycles-pp.account_page_dirtied
      0.00            +0.1        0.05 ±  9%  perf-profile.self.cycles-pp.iomap_write_actor
      0.00            +0.1        0.06 ±  8%  perf-profile.self.cycles-pp.read
      0.00            +0.1        0.06 ±  8%  perf-profile.self.cycles-pp.__percpu_counter_sum
      0.00            +0.1        0.06 ±  6%  perf-profile.self.cycles-pp.iov_iter_fault_in_readable
      0.21 ± 16%      +0.1        0.28 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock
      0.07 ± 12%      +0.1        0.13 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.08 ± 34%      +0.1        0.15 ± 21%  perf-profile.self.cycles-pp.ktime_get
      0.00            +0.1        0.07        perf-profile.self.cycles-pp._cond_resched
      0.63 ± 13%      +0.1        0.75 ±  6%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.04 ± 50%      +0.2        0.20 ±  3%  perf-profile.self.cycles-pp.pagecache_get_page
      0.31 ±  5%      +0.2        0.50 ±  5%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      0.23 ± 39%      +0.2        0.42 ±  9%  perf-profile.self.cycles-pp.update_cfs_group
      0.05 ± 99%      +0.2        0.27 ±  8%  perf-profile.self.cycles-pp.update_load_avg
      0.15 ±  9%      +0.2        0.39 ±  6%  perf-profile.self.cycles-pp.down_write
      0.02 ±122%      +0.3        0.34 ±  2%  perf-profile.self.cycles-pp.rcu_all_qs
      0.34 ± 10%      +0.3        0.67 ±  3%  perf-profile.self.cycles-pp.rw_verify_area
      0.93 ± 16%      +0.3        1.27        perf-profile.self.cycles-pp.iomap_set_range_uptodate
     15.47 ±  6%      +1.7       17.22        perf-profile.self.cycles-pp.atime_needs_update
      0.49 ± 11%      +2.4        2.92 ±  4%  perf-profile.self.cycles-pp.find_get_entry
      5.35 ±  6%      +3.0        8.38 ±  2%  perf-profile.self.cycles-pp.up_read
      9.45 ±  6%      +5.8       15.21        perf-profile.self.cycles-pp.down_read
      9.03 ± 23%      +6.2       15.28        perf-profile.self.cycles-pp.intel_idle
    254.80 ±  2%     -18.7%     207.20        interrupts.9:IO-APIC.9-fasteoi.acpi
    252547 ±  3%     -18.4%     205974        interrupts.CPU0.LOC:Local_timer_interrupts
      1269 ± 14%     -39.1%     773.80 ± 46%  interrupts.CPU0.RES:Rescheduling_interrupts
    254.80 ±  2%     -18.7%     207.20        interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
    252625 ±  3%     -18.5%     206003        interrupts.CPU1.LOC:Local_timer_interrupts
    252757 ±  3%     -18.5%     206002        interrupts.CPU10.LOC:Local_timer_interrupts
    589.20 ± 81%     -66.8%     195.80 ±  9%  interrupts.CPU10.RES:Rescheduling_interrupts
    252682 ±  3%     -18.5%     205961        interrupts.CPU100.LOC:Local_timer_interrupts
    283.20 ±  4%     -45.2%     155.20 ± 12%  interrupts.CPU100.RES:Rescheduling_interrupts
    252645 ±  3%     -18.5%     205958        interrupts.CPU101.LOC:Local_timer_interrupts
    252.80 ±  5%     -37.7%     157.60 ± 16%  interrupts.CPU101.RES:Rescheduling_interrupts
    252667 ±  3%     -18.5%     205880        interrupts.CPU102.LOC:Local_timer_interrupts
    252681 ±  3%     -18.5%     205975        interrupts.CPU103.LOC:Local_timer_interrupts
    256.00 ±  9%     -45.1%     140.60 ± 10%  interrupts.CPU103.RES:Rescheduling_interrupts
    252683 ±  3%     -18.5%     205951        interrupts.CPU104.LOC:Local_timer_interrupts
    253.00 ±  8%     -40.8%     149.80 ± 16%  interrupts.CPU104.RES:Rescheduling_interrupts
    252672 ±  3%     -18.5%     205953        interrupts.CPU105.LOC:Local_timer_interrupts
    263.00 ±  6%     -45.2%     144.00 ± 10%  interrupts.CPU105.RES:Rescheduling_interrupts
    252587 ±  3%     -18.4%     205985        interrupts.CPU106.LOC:Local_timer_interrupts
    247.40 ±  6%     -41.0%     146.00 ± 14%  interrupts.CPU106.RES:Rescheduling_interrupts
    252694 ±  3%     -18.5%     205935        interrupts.CPU107.LOC:Local_timer_interrupts
    249.80 ±  2%     -41.2%     146.80 ± 19%  interrupts.CPU107.RES:Rescheduling_interrupts
    252686 ±  3%     -18.5%     205960        interrupts.CPU108.LOC:Local_timer_interrupts
      7444 ±  3%     -35.8%       4779 ± 21%  interrupts.CPU108.NMI:Non-maskable_interrupts
      7444 ±  3%     -35.8%       4779 ± 21%  interrupts.CPU108.PMI:Performance_monitoring_interrupts
    249.00 ±  5%     -39.4%     150.80 ± 21%  interrupts.CPU108.RES:Rescheduling_interrupts
    252691 ±  3%     -18.5%     205953        interrupts.CPU109.LOC:Local_timer_interrupts
      7396 ±  4%     -35.6%       4764 ± 21%  interrupts.CPU109.NMI:Non-maskable_interrupts
      7396 ±  4%     -35.6%       4764 ± 21%  interrupts.CPU109.PMI:Performance_monitoring_interrupts
    242.20 ±  7%     -40.6%     143.80 ± 14%  interrupts.CPU109.RES:Rescheduling_interrupts
    252739 ±  3%     -18.5%     205960        interrupts.CPU11.LOC:Local_timer_interrupts
    634.00 ± 70%     -67.3%     207.20 ±  9%  interrupts.CPU11.RES:Rescheduling_interrupts
    252668 ±  3%     -18.5%     205947        interrupts.CPU110.LOC:Local_timer_interrupts
      7374 ±  4%     -36.8%       4660 ± 21%  interrupts.CPU110.NMI:Non-maskable_interrupts
      7374 ±  4%     -36.8%       4660 ± 21%  interrupts.CPU110.PMI:Performance_monitoring_interrupts
    273.80 ±  4%     -50.3%     136.00 ± 15%  interrupts.CPU110.RES:Rescheduling_interrupts
    252605 ±  3%     -18.5%     205967        interrupts.CPU111.LOC:Local_timer_interrupts
      7291 ±  4%     -33.6%       4843 ± 20%  interrupts.CPU111.NMI:Non-maskable_interrupts
      7291 ±  4%     -33.6%       4843 ± 20%  interrupts.CPU111.PMI:Performance_monitoring_interrupts
    253.60 ± 10%     -44.6%     140.60 ± 16%  interrupts.CPU111.RES:Rescheduling_interrupts
    252685 ±  3%     -18.5%     205966        interrupts.CPU112.LOC:Local_timer_interrupts
      7405 ±  3%     -36.1%       4734 ± 20%  interrupts.CPU112.NMI:Non-maskable_interrupts
      7405 ±  3%     -36.1%       4734 ± 20%  interrupts.CPU112.PMI:Performance_monitoring_interrupts
    243.80 ±  5%     -39.5%     147.60 ± 19%  interrupts.CPU112.RES:Rescheduling_interrupts
    252697 ±  3%     -18.5%     205965        interrupts.CPU113.LOC:Local_timer_interrupts
      7413 ±  3%     -36.8%       4688 ± 21%  interrupts.CPU113.NMI:Non-maskable_interrupts
      7413 ±  3%     -36.8%       4688 ± 21%  interrupts.CPU113.PMI:Performance_monitoring_interrupts
    245.40 ±  6%     -41.6%     143.40 ± 12%  interrupts.CPU113.RES:Rescheduling_interrupts
    252721 ±  3%     -18.5%     205910        interrupts.CPU114.LOC:Local_timer_interrupts
      7416 ±  3%     -28.5%       5306 ±  4%  interrupts.CPU114.NMI:Non-maskable_interrupts
      7416 ±  3%     -28.5%       5306 ±  4%  interrupts.CPU114.PMI:Performance_monitoring_interrupts
    260.40 ± 10%     -47.2%     137.40 ±  9%  interrupts.CPU114.RES:Rescheduling_interrupts
    252688 ±  3%     -18.5%     205940        interrupts.CPU115.LOC:Local_timer_interrupts
      7339 ±  4%     -34.9%       4774 ± 21%  interrupts.CPU115.NMI:Non-maskable_interrupts
      7339 ±  4%     -34.9%       4774 ± 21%  interrupts.CPU115.PMI:Performance_monitoring_interrupts
    247.40 ±  6%     -39.8%     149.00 ± 19%  interrupts.CPU115.RES:Rescheduling_interrupts
    252694 ±  3%     -18.5%     205958        interrupts.CPU116.LOC:Local_timer_interrupts
      7374 ±  4%     -35.7%       4744 ± 21%  interrupts.CPU116.NMI:Non-maskable_interrupts
      7374 ±  4%     -35.7%       4744 ± 21%  interrupts.CPU116.PMI:Performance_monitoring_interrupts
    247.20 ±  6%     -41.3%     145.20 ± 18%  interrupts.CPU116.RES:Rescheduling_interrupts
    252693 ±  3%     -18.5%     205937        interrupts.CPU117.LOC:Local_timer_interrupts
    244.60 ±  8%     -40.6%     145.20 ± 10%  interrupts.CPU117.RES:Rescheduling_interrupts
    252679 ±  3%     -18.5%     205957        interrupts.CPU118.LOC:Local_timer_interrupts
      7384 ±  3%     -36.4%       4693 ± 22%  interrupts.CPU118.NMI:Non-maskable_interrupts
      7384 ±  3%     -36.4%       4693 ± 22%  interrupts.CPU118.PMI:Performance_monitoring_interrupts
    241.00 ±  3%     -42.0%     139.80 ± 17%  interrupts.CPU118.RES:Rescheduling_interrupts
    252614 ±  3%     -18.5%     205934        interrupts.CPU119.LOC:Local_timer_interrupts
      7367 ±  4%     -34.3%       4840 ± 21%  interrupts.CPU119.NMI:Non-maskable_interrupts
      7367 ±  4%     -34.3%       4840 ± 21%  interrupts.CPU119.PMI:Performance_monitoring_interrupts
    245.20 ±  7%     -47.2%     129.40 ± 20%  interrupts.CPU119.RES:Rescheduling_interrupts
    252756 ±  3%     -18.5%     205877        interrupts.CPU12.LOC:Local_timer_interrupts
      7405 ±  3%     -35.3%       4793 ± 23%  interrupts.CPU12.NMI:Non-maskable_interrupts
      7405 ±  3%     -35.3%       4793 ± 23%  interrupts.CPU12.PMI:Performance_monitoring_interrupts
    334.40 ±  4%     -37.9%     207.60 ± 10%  interrupts.CPU12.RES:Rescheduling_interrupts
    251996 ±  3%     -18.7%     204757        interrupts.CPU120.LOC:Local_timer_interrupts
    279.60 ± 10%     -44.8%     154.20 ± 12%  interrupts.CPU120.RES:Rescheduling_interrupts
    251984 ±  3%     -18.7%     204801        interrupts.CPU121.LOC:Local_timer_interrupts
    273.40 ±  9%     -43.8%     153.60 ± 13%  interrupts.CPU121.RES:Rescheduling_interrupts
    252005 ±  3%     -18.8%     204717        interrupts.CPU122.LOC:Local_timer_interrupts
    252.20 ± 10%     -44.3%     140.60 ±  6%  interrupts.CPU122.RES:Rescheduling_interrupts
    251973 ±  3%     -18.7%     204746        interrupts.CPU123.LOC:Local_timer_interrupts
      7372 ±  4%     -27.6%       5340 ±  4%  interrupts.CPU123.NMI:Non-maskable_interrupts
      7372 ±  4%     -27.6%       5340 ±  4%  interrupts.CPU123.PMI:Performance_monitoring_interrupts
    281.20 ± 14%     -50.4%     139.60 ±  7%  interrupts.CPU123.RES:Rescheduling_interrupts
    251981 ±  3%     -18.7%     204750        interrupts.CPU124.LOC:Local_timer_interrupts
      7367 ±  3%     -25.2%       5510 ±  3%  interrupts.CPU124.NMI:Non-maskable_interrupts
      7367 ±  3%     -25.2%       5510 ±  3%  interrupts.CPU124.PMI:Performance_monitoring_interrupts
    268.00 ± 15%     -49.6%     135.20 ± 10%  interrupts.CPU124.RES:Rescheduling_interrupts
    251972 ±  3%     -18.7%     204759        interrupts.CPU125.LOC:Local_timer_interrupts
      7365 ±  4%     -27.4%       5343 ±  3%  interrupts.CPU125.NMI:Non-maskable_interrupts
      7365 ±  4%     -27.4%       5343 ±  3%  interrupts.CPU125.PMI:Performance_monitoring_interrupts
    251.00 ± 10%     -42.5%     144.40 ± 11%  interrupts.CPU125.RES:Rescheduling_interrupts
    251977 ±  3%     -18.7%     204755        interrupts.CPU126.LOC:Local_timer_interrupts
      7301 ±  4%     -34.0%       4820 ± 22%  interrupts.CPU126.NMI:Non-maskable_interrupts
      7301 ±  4%     -34.0%       4820 ± 22%  interrupts.CPU126.PMI:Performance_monitoring_interrupts
    261.80 ± 11%     -49.0%     133.40 ± 14%  interrupts.CPU126.RES:Rescheduling_interrupts
    251997 ±  3%     -18.7%     204748        interrupts.CPU127.LOC:Local_timer_interrupts
      7324 ±  4%     -34.8%       4775 ± 22%  interrupts.CPU127.NMI:Non-maskable_interrupts
      7324 ±  4%     -34.8%       4775 ± 22%  interrupts.CPU127.PMI:Performance_monitoring_interrupts
    255.80 ± 12%     -48.9%     130.60 ± 11%  interrupts.CPU127.RES:Rescheduling_interrupts
    251918 ±  3%     -18.7%     204747        interrupts.CPU128.LOC:Local_timer_interrupts
      7397 ±  4%     -33.2%       4938 ± 21%  interrupts.CPU128.NMI:Non-maskable_interrupts
      7397 ±  4%     -33.2%       4938 ± 21%  interrupts.CPU128.PMI:Performance_monitoring_interrupts
    252.20 ± 14%     -44.6%     139.60 ± 18%  interrupts.CPU128.RES:Rescheduling_interrupts
    251912 ±  3%     -18.7%     204758        interrupts.CPU129.LOC:Local_timer_interrupts
      7360 ±  4%     -33.2%       4920 ± 22%  interrupts.CPU129.NMI:Non-maskable_interrupts
      7360 ±  4%     -33.2%       4920 ± 22%  interrupts.CPU129.PMI:Performance_monitoring_interrupts
    255.40 ±  6%     -45.2%     140.00 ± 14%  interrupts.CPU129.RES:Rescheduling_interrupts
    252718 ±  3%     -18.5%     205965        interrupts.CPU13.LOC:Local_timer_interrupts
    251969 ±  3%     -18.7%     204760        interrupts.CPU130.LOC:Local_timer_interrupts
      7293 ±  4%     -33.4%       4860 ± 22%  interrupts.CPU130.NMI:Non-maskable_interrupts
      7293 ±  4%     -33.4%       4860 ± 22%  interrupts.CPU130.PMI:Performance_monitoring_interrupts
    258.00 ±  7%     -47.9%     134.40 ± 13%  interrupts.CPU130.RES:Rescheduling_interrupts
    251960 ±  3%     -18.7%     204747        interrupts.CPU131.LOC:Local_timer_interrupts
      7438 ±  3%     -34.2%       4896 ± 22%  interrupts.CPU131.NMI:Non-maskable_interrupts
      7438 ±  3%     -34.2%       4896 ± 22%  interrupts.CPU131.PMI:Performance_monitoring_interrupts
    249.60 ± 12%     -49.5%     126.00 ± 10%  interrupts.CPU131.RES:Rescheduling_interrupts
    251942 ±  3%     -18.7%     204729        interrupts.CPU132.LOC:Local_timer_interrupts
      7398 ±  4%     -34.2%       4868 ± 22%  interrupts.CPU132.NMI:Non-maskable_interrupts
      7398 ±  4%     -34.2%       4868 ± 22%  interrupts.CPU132.PMI:Performance_monitoring_interrupts
    258.00 ± 11%     -45.7%     140.00 ±  8%  interrupts.CPU132.RES:Rescheduling_interrupts
    251919 ±  3%     -18.8%     204653        interrupts.CPU133.LOC:Local_timer_interrupts
    245.80 ±  4%     -44.6%     136.20 ±  8%  interrupts.CPU133.RES:Rescheduling_interrupts
    251730 ±  3%     -18.7%     204741        interrupts.CPU134.LOC:Local_timer_interrupts
    260.00 ±  9%     -47.8%     135.60 ± 11%  interrupts.CPU134.RES:Rescheduling_interrupts
    251914 ±  3%     -18.7%     204754        interrupts.CPU135.LOC:Local_timer_interrupts
    261.00 ±  9%     -49.3%     132.20 ± 11%  interrupts.CPU135.RES:Rescheduling_interrupts
    252018 ±  3%     -18.8%     204744        interrupts.CPU136.LOC:Local_timer_interrupts
    256.40 ± 11%     -48.4%     132.20 ± 20%  interrupts.CPU136.RES:Rescheduling_interrupts
    251974 ±  3%     -18.7%     204735        interrupts.CPU137.LOC:Local_timer_interrupts
    248.40 ± 11%     -45.5%     135.40 ± 10%  interrupts.CPU137.RES:Rescheduling_interrupts
    251927 ±  3%     -18.7%     204736        interrupts.CPU138.LOC:Local_timer_interrupts
    257.00 ± 14%     -48.4%     132.60 ± 17%  interrupts.CPU138.RES:Rescheduling_interrupts
    251789 ±  3%     -18.7%     204731        interrupts.CPU139.LOC:Local_timer_interrupts
    246.60 ± 10%     -46.4%     132.20 ± 12%  interrupts.CPU139.RES:Rescheduling_interrupts
    252719 ±  3%     -18.5%     205975        interrupts.CPU14.LOC:Local_timer_interrupts
      7362 ±  4%     -34.6%       4814 ± 22%  interrupts.CPU14.NMI:Non-maskable_interrupts
      7362 ±  4%     -34.6%       4814 ± 22%  interrupts.CPU14.PMI:Performance_monitoring_interrupts
    365.00 ±  4%     -43.7%     205.40 ± 13%  interrupts.CPU14.RES:Rescheduling_interrupts
    251951 ±  3%     -18.8%     204705        interrupts.CPU140.LOC:Local_timer_interrupts
    255.80 ±  7%     -47.5%     134.20 ± 12%  interrupts.CPU140.RES:Rescheduling_interrupts
    251924 ±  3%     -18.7%     204741        interrupts.CPU141.LOC:Local_timer_interrupts
    243.00 ± 10%     -44.5%     134.80 ±  9%  interrupts.CPU141.RES:Rescheduling_interrupts
    252007 ±  3%     -18.8%     204732        interrupts.CPU142.LOC:Local_timer_interrupts
    251.60 ±  7%     -46.8%     133.80 ± 17%  interrupts.CPU142.RES:Rescheduling_interrupts
    251943 ±  3%     -18.7%     204747        interrupts.CPU143.LOC:Local_timer_interrupts
    245.00 ±  8%     -41.9%     142.40 ± 15%  interrupts.CPU143.RES:Rescheduling_interrupts
     34.20 ± 67%    +103.5%      69.60 ± 39%  interrupts.CPU143.TLB:TLB_shootdowns
    252491 ±  3%     -18.8%     205025        interrupts.CPU144.LOC:Local_timer_interrupts
      7426 ±  3%     -27.9%       5353 ±  2%  interrupts.CPU144.NMI:Non-maskable_interrupts
      7426 ±  3%     -27.9%       5353 ±  2%  interrupts.CPU144.PMI:Performance_monitoring_interrupts
    265.80 ±  7%     -51.2%     129.60 ±  4%  interrupts.CPU144.RES:Rescheduling_interrupts
    252415 ±  3%     -18.8%     205048        interrupts.CPU145.LOC:Local_timer_interrupts
    272.40 ±  6%     -51.5%     132.00 ±  2%  interrupts.CPU145.RES:Rescheduling_interrupts
    252506 ±  3%     -18.8%     205055        interrupts.CPU146.LOC:Local_timer_interrupts
    266.40 ±  4%     -48.6%     136.80 ± 14%  interrupts.CPU146.RES:Rescheduling_interrupts
    252464 ±  3%     -18.8%     205039        interrupts.CPU147.LOC:Local_timer_interrupts
    264.00 ±  6%     -48.7%     135.40 ± 13%  interrupts.CPU147.RES:Rescheduling_interrupts
    252490 ±  3%     -18.8%     205010        interrupts.CPU148.LOC:Local_timer_interrupts
    245.60 ±  5%     -46.1%     132.40 ± 10%  interrupts.CPU148.RES:Rescheduling_interrupts
    252492 ±  3%     -18.8%     205041        interrupts.CPU149.LOC:Local_timer_interrupts
    264.80 ± 11%     -49.3%     134.20 ± 15%  interrupts.CPU149.RES:Rescheduling_interrupts
    252680 ±  3%     -18.5%     205986        interrupts.CPU15.LOC:Local_timer_interrupts
      7325 ±  3%     -36.0%       4686 ± 22%  interrupts.CPU15.NMI:Non-maskable_interrupts
      7325 ±  3%     -36.0%       4686 ± 22%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
    334.60 ±  2%     -42.2%     193.40 ± 12%  interrupts.CPU15.RES:Rescheduling_interrupts
    252444 ±  3%     -18.8%     205053        interrupts.CPU150.LOC:Local_timer_interrupts
    250.40 ±  6%     -50.4%     124.20 ± 14%  interrupts.CPU150.RES:Rescheduling_interrupts
    252514 ±  3%     -18.8%     205056        interrupts.CPU151.LOC:Local_timer_interrupts
    238.00 ±  7%     -42.5%     136.80 ± 16%  interrupts.CPU151.RES:Rescheduling_interrupts
    252470 ±  3%     -18.8%     205056        interrupts.CPU152.LOC:Local_timer_interrupts
    254.00 ±  7%     -51.4%     123.40 ± 14%  interrupts.CPU152.RES:Rescheduling_interrupts
    252507 ±  3%     -18.8%     205045        interrupts.CPU153.LOC:Local_timer_interrupts
    258.40 ±  5%     -51.2%     126.00 ± 18%  interrupts.CPU153.RES:Rescheduling_interrupts
    252493 ±  3%     -18.8%     205055        interrupts.CPU154.LOC:Local_timer_interrupts
    279.80 ± 11%     -54.1%     128.40 ± 11%  interrupts.CPU154.RES:Rescheduling_interrupts
    252491 ±  3%     -18.8%     205053        interrupts.CPU155.LOC:Local_timer_interrupts
    261.40 ±  9%     -49.7%     131.40 ±  6%  interrupts.CPU155.RES:Rescheduling_interrupts
    252475 ±  3%     -18.8%     205056        interrupts.CPU156.LOC:Local_timer_interrupts
    259.00 ±  6%     -52.0%     124.40 ± 13%  interrupts.CPU156.RES:Rescheduling_interrupts
    252454 ±  3%     -18.8%     205047        interrupts.CPU157.LOC:Local_timer_interrupts
    262.40 ±  8%     -53.7%     121.60 ± 14%  interrupts.CPU157.RES:Rescheduling_interrupts
    252493 ±  3%     -18.8%     205046        interrupts.CPU158.LOC:Local_timer_interrupts
    266.60 ± 11%     -50.9%     131.00 ± 18%  interrupts.CPU158.RES:Rescheduling_interrupts
    252527 ±  3%     -18.8%     205051        interrupts.CPU159.LOC:Local_timer_interrupts
      7283 ±  4%     -33.3%       4857 ± 23%  interrupts.CPU159.NMI:Non-maskable_interrupts
      7283 ±  4%     -33.3%       4857 ± 23%  interrupts.CPU159.PMI:Performance_monitoring_interrupts
    241.60 ±  3%     -48.7%     124.00 ± 11%  interrupts.CPU159.RES:Rescheduling_interrupts
    252752 ±  3%     -18.5%     205969        interrupts.CPU16.LOC:Local_timer_interrupts
      7306 ±  4%     -33.9%       4830 ± 23%  interrupts.CPU16.NMI:Non-maskable_interrupts
      7306 ±  4%     -33.9%       4830 ± 23%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
    326.60 ±  7%     -38.6%     200.60 ± 15%  interrupts.CPU16.RES:Rescheduling_interrupts
    252504 ±  3%     -18.8%     205047        interrupts.CPU160.LOC:Local_timer_interrupts
      7296 ±  3%     -33.5%       4849 ± 23%  interrupts.CPU160.NMI:Non-maskable_interrupts
      7296 ±  3%     -33.5%       4849 ± 23%  interrupts.CPU160.PMI:Performance_monitoring_interrupts
    256.60 ±  7%     -51.9%     123.40 ± 17%  interrupts.CPU160.RES:Rescheduling_interrupts
    252446 ±  3%     -18.8%     205078        interrupts.CPU161.LOC:Local_timer_interrupts
      7261 ±  3%     -35.2%       4705 ± 22%  interrupts.CPU161.NMI:Non-maskable_interrupts
      7261 ±  3%     -35.2%       4705 ± 22%  interrupts.CPU161.PMI:Performance_monitoring_interrupts
    262.20 ±  4%     -50.3%     130.20 ± 16%  interrupts.CPU161.RES:Rescheduling_interrupts
    252541 ±  3%     -18.8%     205056        interrupts.CPU162.LOC:Local_timer_interrupts
      7333 ±  3%     -34.8%       4784 ± 22%  interrupts.CPU162.NMI:Non-maskable_interrupts
      7333 ±  3%     -34.8%       4784 ± 22%  interrupts.CPU162.PMI:Performance_monitoring_interrupts
    277.80 ±  8%     -54.7%     125.80 ± 10%  interrupts.CPU162.RES:Rescheduling_interrupts
    252505 ±  3%     -18.8%     205071        interrupts.CPU163.LOC:Local_timer_interrupts
      7341 ±  3%     -34.8%       4784 ± 23%  interrupts.CPU163.NMI:Non-maskable_interrupts
      7341 ±  3%     -34.8%       4784 ± 23%  interrupts.CPU163.PMI:Performance_monitoring_interrupts
    274.00 ± 12%     -52.6%     129.80 ± 11%  interrupts.CPU163.RES:Rescheduling_interrupts
    252331 ±  3%     -18.7%     205035        interrupts.CPU164.LOC:Local_timer_interrupts
    262.00 ±  7%     -50.2%     130.60 ±  7%  interrupts.CPU164.RES:Rescheduling_interrupts
    252479 ±  3%     -18.8%     205070        interrupts.CPU165.LOC:Local_timer_interrupts
    263.20 ±  6%     -52.0%     126.40 ± 12%  interrupts.CPU165.RES:Rescheduling_interrupts
    252494 ±  3%     -18.8%     205053        interrupts.CPU166.LOC:Local_timer_interrupts
    255.20 ±  9%     -52.9%     120.20 ±  8%  interrupts.CPU166.RES:Rescheduling_interrupts
    252494 ±  3%     -18.8%     205053        interrupts.CPU167.LOC:Local_timer_interrupts
    241.60 ±  4%     -48.8%     123.60 ± 10%  interrupts.CPU167.RES:Rescheduling_interrupts
    252402 ±  3%     -18.7%     205290        interrupts.CPU168.LOC:Local_timer_interrupts
    270.00 ±  8%     -44.8%     149.00 ±  9%  interrupts.CPU168.RES:Rescheduling_interrupts
    252470 ±  3%     -18.7%     205342        interrupts.CPU169.LOC:Local_timer_interrupts
    270.20 ±  6%     -44.3%     150.60 ±  9%  interrupts.CPU169.RES:Rescheduling_interrupts
    252532 ±  3%     -18.4%     205979        interrupts.CPU17.LOC:Local_timer_interrupts
    330.00 ±  4%     -43.8%     185.40 ± 10%  interrupts.CPU17.RES:Rescheduling_interrupts
    252467 ±  3%     -18.7%     205332        interrupts.CPU170.LOC:Local_timer_interrupts
    297.00 ±  5%     -52.5%     141.20 ±  4%  interrupts.CPU170.RES:Rescheduling_interrupts
    252496 ±  3%     -18.7%     205365        interrupts.CPU171.LOC:Local_timer_interrupts
    269.20 ±  7%     -44.5%     149.40 ± 14%  interrupts.CPU171.RES:Rescheduling_interrupts
    252484 ±  3%     -18.7%     205349        interrupts.CPU172.LOC:Local_timer_interrupts
    268.60 ± 10%     -49.8%     134.80 ± 13%  interrupts.CPU172.RES:Rescheduling_interrupts
    252480 ±  3%     -18.7%     205363        interrupts.CPU173.LOC:Local_timer_interrupts
      7368 ±  3%     -31.3%       5061 ± 23%  interrupts.CPU173.NMI:Non-maskable_interrupts
      7368 ±  3%     -31.3%       5061 ± 23%  interrupts.CPU173.PMI:Performance_monitoring_interrupts
    288.60 ±  6%     -50.7%     142.40 ± 14%  interrupts.CPU173.RES:Rescheduling_interrupts
    252386 ±  3%     -18.6%     205360        interrupts.CPU174.LOC:Local_timer_interrupts
      7508 ±  3%     -33.6%       4986 ± 22%  interrupts.CPU174.NMI:Non-maskable_interrupts
      7508 ±  3%     -33.6%       4986 ± 22%  interrupts.CPU174.PMI:Performance_monitoring_interrupts
    264.80 ± 12%     -43.3%     150.20 ± 13%  interrupts.CPU174.RES:Rescheduling_interrupts
    252489 ±  3%     -18.7%     205307        interrupts.CPU175.LOC:Local_timer_interrupts
    269.80 ±  9%     -51.9%     129.80 ±  9%  interrupts.CPU175.RES:Rescheduling_interrupts
    252484 ±  3%     -18.7%     205360        interrupts.CPU176.LOC:Local_timer_interrupts
    270.00 ± 10%     -41.4%     158.20 ± 16%  interrupts.CPU176.RES:Rescheduling_interrupts
    252474 ±  3%     -18.7%     205375        interrupts.CPU177.LOC:Local_timer_interrupts
    283.40 ±  7%     -49.3%     143.60 ± 12%  interrupts.CPU177.RES:Rescheduling_interrupts
    252478 ±  3%     -18.7%     205344        interrupts.CPU178.LOC:Local_timer_interrupts
    272.60 ±  6%     -45.4%     148.80 ± 10%  interrupts.CPU178.RES:Rescheduling_interrupts
    252432 ±  3%     -18.7%     205281        interrupts.CPU179.LOC:Local_timer_interrupts
    276.80 ±  5%     -53.3%     129.40 ± 11%  interrupts.CPU179.RES:Rescheduling_interrupts
    252703 ±  3%     -18.5%     205941        interrupts.CPU18.LOC:Local_timer_interrupts
    323.00 ±  5%     -37.6%     201.60 ±  9%  interrupts.CPU18.RES:Rescheduling_interrupts
    252422 ±  3%     -18.6%     205357        interrupts.CPU180.LOC:Local_timer_interrupts
    263.80 ±  8%     -46.2%     142.00 ±  4%  interrupts.CPU180.RES:Rescheduling_interrupts
    252409 ±  3%     -18.7%     205324        interrupts.CPU181.LOC:Local_timer_interrupts
    265.00 ±  7%     -50.3%     131.60 ± 12%  interrupts.CPU181.RES:Rescheduling_interrupts
    252368 ±  3%     -18.7%     205201        interrupts.CPU182.LOC:Local_timer_interrupts
    284.40 ± 13%     -51.0%     139.40 ± 11%  interrupts.CPU182.RES:Rescheduling_interrupts
    252395 ±  3%     -18.6%     205352        interrupts.CPU183.LOC:Local_timer_interrupts
    265.20 ±  5%     -47.4%     139.40 ± 28%  interrupts.CPU183.RES:Rescheduling_interrupts
    252389 ±  3%     -18.6%     205334        interrupts.CPU184.LOC:Local_timer_interrupts
    265.80 ±  9%     -45.1%     146.00 ±  5%  interrupts.CPU184.RES:Rescheduling_interrupts
    252396 ±  3%     -18.6%     205332        interrupts.CPU185.LOC:Local_timer_interrupts
    267.60 ±  9%     -48.3%     138.40 ± 10%  interrupts.CPU185.RES:Rescheduling_interrupts
    252447 ±  3%     -18.7%     205331        interrupts.CPU186.LOC:Local_timer_interrupts
    263.40 ±  8%     -51.2%     128.60 ± 13%  interrupts.CPU186.RES:Rescheduling_interrupts
    252368 ±  3%     -18.6%     205334        interrupts.CPU187.LOC:Local_timer_interrupts
    279.60 ±  7%     -49.3%     141.80 ± 10%  interrupts.CPU187.RES:Rescheduling_interrupts
    252421 ±  3%     -18.7%     205344        interrupts.CPU188.LOC:Local_timer_interrupts
    252.00 ±  6%     -44.7%     139.40 ±  4%  interrupts.CPU188.RES:Rescheduling_interrupts
    252417 ±  3%     -18.6%     205353        interrupts.CPU189.LOC:Local_timer_interrupts
    277.00 ±  5%     -49.7%     139.20 ± 10%  interrupts.CPU189.RES:Rescheduling_interrupts
    252712 ±  3%     -18.5%     205991        interrupts.CPU19.LOC:Local_timer_interrupts
    327.80 ±  8%     -40.1%     196.20 ± 10%  interrupts.CPU19.RES:Rescheduling_interrupts
    252415 ±  3%     -18.6%     205351        interrupts.CPU190.LOC:Local_timer_interrupts
      7441 ±  3%     -25.1%       5573 ±  3%  interrupts.CPU190.NMI:Non-maskable_interrupts
      7441 ±  3%     -25.1%       5573 ±  3%  interrupts.CPU190.PMI:Performance_monitoring_interrupts
    264.60 ± 10%     -43.2%     150.20 ±  7%  interrupts.CPU190.RES:Rescheduling_interrupts
    252463 ±  3%     -18.6%     205467        interrupts.CPU191.LOC:Local_timer_interrupts
      7367 ±  3%     -25.9%       5458 ±  4%  interrupts.CPU191.NMI:Non-maskable_interrupts
      7367 ±  3%     -25.9%       5458 ±  4%  interrupts.CPU191.PMI:Performance_monitoring_interrupts
    418.40 ± 14%     -53.0%     196.60 ±  4%  interrupts.CPU191.RES:Rescheduling_interrupts
     42.00 ± 26%    +104.8%      86.00 ± 22%  interrupts.CPU191.TLB:TLB_shootdowns
    252699 ±  3%     -18.5%     206009        interrupts.CPU2.LOC:Local_timer_interrupts
    375.00 ±  6%     -41.0%     221.20 ± 10%  interrupts.CPU2.RES:Rescheduling_interrupts
    252676 ±  3%     -18.5%     205962        interrupts.CPU20.LOC:Local_timer_interrupts
    252713 ±  3%     -18.5%     205912        interrupts.CPU21.LOC:Local_timer_interrupts
    325.00 ±  5%     -42.8%     185.80 ± 15%  interrupts.CPU21.RES:Rescheduling_interrupts
    252736 ±  3%     -18.5%     205978        interrupts.CPU22.LOC:Local_timer_interrupts
    332.80 ±  4%     -43.1%     189.20 ± 13%  interrupts.CPU22.RES:Rescheduling_interrupts
    252698 ±  3%     -18.5%     205946        interrupts.CPU23.LOC:Local_timer_interrupts
    341.20 ±  5%     -44.4%     189.80 ±  8%  interrupts.CPU23.RES:Rescheduling_interrupts
    251942 ±  3%     -18.7%     204774        interrupts.CPU24.LOC:Local_timer_interrupts
      7349 ±  4%     -26.4%       5406 ±  3%  interrupts.CPU24.NMI:Non-maskable_interrupts
      7349 ±  4%     -26.4%       5406 ±  3%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
    251955 ±  3%     -18.7%     204773        interrupts.CPU25.LOC:Local_timer_interrupts
      7415 ±  3%     -34.3%       4869 ± 23%  interrupts.CPU25.NMI:Non-maskable_interrupts
      7415 ±  3%     -34.3%       4869 ± 23%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
    375.80 ±  7%     -38.5%     231.00 ±  7%  interrupts.CPU25.RES:Rescheduling_interrupts
    252000 ±  3%     -18.8%     204743        interrupts.CPU26.LOC:Local_timer_interrupts
      7436 ±  4%     -28.8%       5293        interrupts.CPU26.NMI:Non-maskable_interrupts
      7436 ±  4%     -28.8%       5293        interrupts.CPU26.PMI:Performance_monitoring_interrupts
    376.60 ±  6%     -40.2%     225.20 ± 10%  interrupts.CPU26.RES:Rescheduling_interrupts
    251985 ±  3%     -18.7%     204752        interrupts.CPU27.LOC:Local_timer_interrupts
    369.00 ±  7%     -41.9%     214.40 ±  4%  interrupts.CPU27.RES:Rescheduling_interrupts
    251993 ±  3%     -18.8%     204692        interrupts.CPU28.LOC:Local_timer_interrupts
    379.20 ±  8%     -46.3%     203.60 ±  9%  interrupts.CPU28.RES:Rescheduling_interrupts
    251982 ±  3%     -18.7%     204783        interrupts.CPU29.LOC:Local_timer_interrupts
    363.00 ± 11%     -44.5%     201.60 ±  6%  interrupts.CPU29.RES:Rescheduling_interrupts
    252708 ±  3%     -18.5%     205971        interrupts.CPU3.LOC:Local_timer_interrupts
      7383 ±  3%     -28.8%       5257 ±  2%  interrupts.CPU3.NMI:Non-maskable_interrupts
      7383 ±  3%     -28.8%       5257 ±  2%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    251899 ±  3%     -18.7%     204764        interrupts.CPU30.LOC:Local_timer_interrupts
    376.40 ±  9%     -45.6%     204.80 ±  5%  interrupts.CPU30.RES:Rescheduling_interrupts
    251996 ±  3%     -18.7%     204760        interrupts.CPU31.LOC:Local_timer_interrupts
    342.20 ± 13%     -42.7%     196.00 ± 11%  interrupts.CPU31.RES:Rescheduling_interrupts
    251931 ±  3%     -18.7%     204774        interrupts.CPU32.LOC:Local_timer_interrupts
    356.80 ±  8%     -42.4%     205.60 ±  7%  interrupts.CPU32.RES:Rescheduling_interrupts
    251947 ±  3%     -18.7%     204752        interrupts.CPU33.LOC:Local_timer_interrupts
      7407 ±  3%     -34.6%       4841 ± 22%  interrupts.CPU33.NMI:Non-maskable_interrupts
      7407 ±  3%     -34.6%       4841 ± 22%  interrupts.CPU33.PMI:Performance_monitoring_interrupts
    351.80 ±  7%     -43.8%     197.80 ±  8%  interrupts.CPU33.RES:Rescheduling_interrupts
    252009 ±  3%     -18.7%     204782        interrupts.CPU34.LOC:Local_timer_interrupts
      7400 ±  4%     -26.1%       5465 ±  3%  interrupts.CPU34.NMI:Non-maskable_interrupts
      7400 ±  4%     -26.1%       5465 ±  3%  interrupts.CPU34.PMI:Performance_monitoring_interrupts
    360.80 ±  9%     -46.7%     192.40 ±  7%  interrupts.CPU34.RES:Rescheduling_interrupts
    252000 ±  3%     -18.7%     204763        interrupts.CPU35.LOC:Local_timer_interrupts
      7360 ±  3%     -27.1%       5366 ±  2%  interrupts.CPU35.NMI:Non-maskable_interrupts
      7360 ±  3%     -27.1%       5366 ±  2%  interrupts.CPU35.PMI:Performance_monitoring_interrupts
    343.80 ±  6%     -40.8%     203.40 ±  9%  interrupts.CPU35.RES:Rescheduling_interrupts
    251943 ±  3%     -18.7%     204774        interrupts.CPU36.LOC:Local_timer_interrupts
      7418 ±  4%     -27.1%       5409 ±  2%  interrupts.CPU36.NMI:Non-maskable_interrupts
      7418 ±  4%     -27.1%       5409 ±  2%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
    340.00 ± 12%     -41.8%     198.00 ± 11%  interrupts.CPU36.RES:Rescheduling_interrupts
    251931 ±  3%     -18.7%     204774        interrupts.CPU37.LOC:Local_timer_interrupts
    335.60 ±  6%     -37.0%     211.40 ± 17%  interrupts.CPU37.RES:Rescheduling_interrupts
    251740 ±  3%     -18.7%     204762        interrupts.CPU38.LOC:Local_timer_interrupts
    351.20 ±  9%     -42.8%     200.80 ± 10%  interrupts.CPU38.RES:Rescheduling_interrupts
    251923 ±  3%     -18.7%     204769        interrupts.CPU39.LOC:Local_timer_interrupts
    339.60 ±  6%     -40.6%     201.60 ± 10%  interrupts.CPU39.RES:Rescheduling_interrupts
    252731 ±  3%     -18.5%     205953        interrupts.CPU4.LOC:Local_timer_interrupts
      1282 ± 93%     -82.0%     231.00 ± 12%  interrupts.CPU4.RES:Rescheduling_interrupts
    251998 ±  3%     -18.7%     204757        interrupts.CPU40.LOC:Local_timer_interrupts
    340.60 ±  6%     -42.6%     195.40 ±  4%  interrupts.CPU40.RES:Rescheduling_interrupts
    252000 ±  3%     -18.7%     204753        interrupts.CPU41.LOC:Local_timer_interrupts
    328.20 ±  5%     -41.6%     191.80 ± 12%  interrupts.CPU41.RES:Rescheduling_interrupts
    251964 ±  3%     -18.7%     204754        interrupts.CPU42.LOC:Local_timer_interrupts
    338.40 ±  9%     -46.6%     180.80 ± 11%  interrupts.CPU42.RES:Rescheduling_interrupts
    251810 ±  3%     -18.7%     204744        interrupts.CPU43.LOC:Local_timer_interrupts
    343.20 ±  7%     -43.4%     194.20 ± 10%  interrupts.CPU43.RES:Rescheduling_interrupts
    251943 ±  3%     -18.7%     204755        interrupts.CPU44.LOC:Local_timer_interrupts
    329.40 ±  3%     -39.2%     200.20 ± 12%  interrupts.CPU44.RES:Rescheduling_interrupts
     12.40 ± 42%    +245.2%      42.80 ± 85%  interrupts.CPU44.TLB:TLB_shootdowns
    251961 ±  3%     -18.7%     204766        interrupts.CPU45.LOC:Local_timer_interrupts
    337.20 ± 12%     -43.4%     191.00 ± 11%  interrupts.CPU45.RES:Rescheduling_interrupts
    252026 ±  3%     -18.7%     204773        interrupts.CPU46.LOC:Local_timer_interrupts
    328.80 ±  5%     -41.0%     194.00 ±  7%  interrupts.CPU46.RES:Rescheduling_interrupts
    251923 ±  3%     -18.7%     204751        interrupts.CPU47.LOC:Local_timer_interrupts
      7337 ±  4%     -33.3%       4897 ± 21%  interrupts.CPU47.NMI:Non-maskable_interrupts
      7337 ±  4%     -33.3%       4897 ± 21%  interrupts.CPU47.PMI:Performance_monitoring_interrupts
    334.20 ±  9%     -42.8%     191.20 ±  7%  interrupts.CPU47.RES:Rescheduling_interrupts
    252551 ±  3%     -18.8%     205090        interrupts.CPU48.LOC:Local_timer_interrupts
    389.20 ±  6%     -40.8%     230.60 ±  7%  interrupts.CPU48.RES:Rescheduling_interrupts
    252519 ±  3%     -18.8%     205063        interrupts.CPU49.LOC:Local_timer_interrupts
    389.20 ±  3%     -44.6%     215.60 ±  4%  interrupts.CPU49.RES:Rescheduling_interrupts
    252707 ±  3%     -18.5%     205972        interrupts.CPU5.LOC:Local_timer_interrupts
    252534 ±  3%     -18.8%     205071        interrupts.CPU50.LOC:Local_timer_interrupts
    375.40 ±  5%     -42.8%     214.60 ±  3%  interrupts.CPU50.RES:Rescheduling_interrupts
     19.60 ± 39%    +199.0%      58.60 ± 85%  interrupts.CPU50.TLB:TLB_shootdowns
    252402 ±  3%     -18.8%     205064        interrupts.CPU51.LOC:Local_timer_interrupts
    353.80 ±  4%     -46.2%     190.20 ±  8%  interrupts.CPU51.RES:Rescheduling_interrupts
    252498 ±  3%     -18.8%     205002        interrupts.CPU52.LOC:Local_timer_interrupts
    354.40 ±  5%     -41.4%     207.60 ±  7%  interrupts.CPU52.RES:Rescheduling_interrupts
    252511 ±  3%     -18.8%     205078        interrupts.CPU53.LOC:Local_timer_interrupts
    343.40 ±  7%     -42.3%     198.00 ±  9%  interrupts.CPU53.RES:Rescheduling_interrupts
    252488 ±  3%     -18.8%     205073        interrupts.CPU54.LOC:Local_timer_interrupts
    355.80 ±  4%     -46.7%     189.80 ± 10%  interrupts.CPU54.RES:Rescheduling_interrupts
    252526 ±  3%     -18.8%     205082        interrupts.CPU55.LOC:Local_timer_interrupts
      1241 ±145%     -84.7%     189.60 ± 12%  interrupts.CPU55.RES:Rescheduling_interrupts
    252467 ±  3%     -18.8%     205080        interrupts.CPU56.LOC:Local_timer_interrupts
    347.40 ±  5%     -43.8%     195.20 ±  8%  interrupts.CPU56.RES:Rescheduling_interrupts
    252517 ±  3%     -18.8%     205079        interrupts.CPU57.LOC:Local_timer_interrupts
    346.80 ±  4%     -45.6%     188.60 ±  4%  interrupts.CPU57.RES:Rescheduling_interrupts
    252462 ±  3%     -18.8%     205079        interrupts.CPU58.LOC:Local_timer_interrupts
    339.00 ±  5%     -43.0%     193.20 ±  5%  interrupts.CPU58.RES:Rescheduling_interrupts
    252443 ±  3%     -18.8%     205073        interrupts.CPU59.LOC:Local_timer_interrupts
    342.40 ±  4%     -43.2%     194.60 ±  3%  interrupts.CPU59.RES:Rescheduling_interrupts
    252713 ±  3%     -18.5%     205878        interrupts.CPU6.LOC:Local_timer_interrupts
    252499 ±  3%     -18.8%     205081        interrupts.CPU60.LOC:Local_timer_interrupts
    977.80 ±128%     -80.6%     189.40 ± 10%  interrupts.CPU60.RES:Rescheduling_interrupts
    252520 ±  3%     -18.8%     205071        interrupts.CPU61.LOC:Local_timer_interrupts
    333.80 ±  4%     -43.0%     190.20 ±  8%  interrupts.CPU61.RES:Rescheduling_interrupts
    252491 ±  3%     -18.8%     205075        interrupts.CPU62.LOC:Local_timer_interrupts
    349.60 ±  5%     -47.4%     183.80 ±  4%  interrupts.CPU62.RES:Rescheduling_interrupts
    252513 ±  3%     -18.8%     205064        interrupts.CPU63.LOC:Local_timer_interrupts
      5882 ± 31%     -37.0%       3707 ± 35%  interrupts.CPU63.NMI:Non-maskable_interrupts
      5882 ± 31%     -37.0%       3707 ± 35%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
    327.60 ±  5%     -43.3%     185.60 ±  4%  interrupts.CPU63.RES:Rescheduling_interrupts
    252522 ±  3%     -18.8%     205072        interrupts.CPU64.LOC:Local_timer_interrupts
      5879 ± 32%     -37.1%       3698 ± 37%  interrupts.CPU64.NMI:Non-maskable_interrupts
      5879 ± 32%     -37.1%       3698 ± 37%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
    338.20 ±  6%     -45.4%     184.80 ±  9%  interrupts.CPU64.RES:Rescheduling_interrupts
    252443 ±  3%     -18.8%     204934        interrupts.CPU65.LOC:Local_timer_interrupts
    337.20 ±  7%     -44.0%     189.00 ±  9%  interrupts.CPU65.RES:Rescheduling_interrupts
    252518 ±  3%     -18.8%     205083        interrupts.CPU66.LOC:Local_timer_interrupts
      6585 ± 24%     -42.6%       3778 ± 35%  interrupts.CPU66.NMI:Non-maskable_interrupts
      6585 ± 24%     -42.6%       3778 ± 35%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
    332.80 ±  3%     -41.4%     195.00 ±  4%  interrupts.CPU66.RES:Rescheduling_interrupts
    252525 ±  3%     -18.8%     205103        interrupts.CPU67.LOC:Local_timer_interrupts
      7340 ±  3%     -42.4%       4225 ± 30%  interrupts.CPU67.NMI:Non-maskable_interrupts
      7340 ±  3%     -42.4%       4225 ± 30%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
    330.80           -43.0%     188.60 ±  6%  interrupts.CPU67.RES:Rescheduling_interrupts
    252530 ±  3%     -18.8%     205070        interrupts.CPU68.LOC:Local_timer_interrupts
      7311 ±  5%     -43.1%       4159 ± 29%  interrupts.CPU68.NMI:Non-maskable_interrupts
      7311 ±  5%     -43.1%       4159 ± 29%  interrupts.CPU68.PMI:Performance_monitoring_interrupts
    332.60 ±  5%     -46.8%     176.80 ±  7%  interrupts.CPU68.RES:Rescheduling_interrupts
    252527 ±  3%     -18.8%     205046        interrupts.CPU69.LOC:Local_timer_interrupts
    334.40 ±  4%     -47.8%     174.60 ±  5%  interrupts.CPU69.RES:Rescheduling_interrupts
    252638 ±  3%     -18.5%     205969        interrupts.CPU7.LOC:Local_timer_interrupts
    333.00 ±  7%     -37.4%     208.60 ± 12%  interrupts.CPU7.RES:Rescheduling_interrupts
    252501 ±  3%     -18.8%     204991        interrupts.CPU70.LOC:Local_timer_interrupts
    343.80 ±  5%     -48.9%     175.60 ±  7%  interrupts.CPU70.RES:Rescheduling_interrupts
    252489 ±  3%     -18.8%     205073        interrupts.CPU71.LOC:Local_timer_interrupts
    323.20 ±  8%     -48.0%     168.00 ±  9%  interrupts.CPU71.RES:Rescheduling_interrupts
    252434 ±  3%     -18.7%     205354        interrupts.CPU72.LOC:Local_timer_interrupts
    401.80 ±  6%     -36.0%     257.20 ± 13%  interrupts.CPU72.RES:Rescheduling_interrupts
    252513 ±  3%     -18.7%     205376        interrupts.CPU73.LOC:Local_timer_interrupts
    393.40 ±  6%     -38.8%     240.80 ±  6%  interrupts.CPU73.RES:Rescheduling_interrupts
    252475 ±  3%     -18.7%     205301        interrupts.CPU74.LOC:Local_timer_interrupts
    407.20 ±  8%     -43.9%     228.40 ±  6%  interrupts.CPU74.RES:Rescheduling_interrupts
    252534 ±  3%     -18.7%     205348        interrupts.CPU75.LOC:Local_timer_interrupts
    388.20 ±  7%     -45.4%     212.00 ± 12%  interrupts.CPU75.RES:Rescheduling_interrupts
    252408 ±  3%     -18.6%     205367        interrupts.CPU76.LOC:Local_timer_interrupts
    359.80 ±  7%     -42.4%     207.20 ±  4%  interrupts.CPU76.RES:Rescheduling_interrupts
    252479 ±  3%     -18.7%     205355        interrupts.CPU77.LOC:Local_timer_interrupts
    385.40 ±  6%     -47.9%     200.80 ±  4%  interrupts.CPU77.RES:Rescheduling_interrupts
    252393 ±  3%     -18.6%     205370        interrupts.CPU78.LOC:Local_timer_interrupts
    359.80 ±  7%     -43.5%     203.20 ±  6%  interrupts.CPU78.RES:Rescheduling_interrupts
    252497 ±  3%     -18.7%     205364        interrupts.CPU79.LOC:Local_timer_interrupts
    360.00 ±  5%     -44.5%     199.80 ± 12%  interrupts.CPU79.RES:Rescheduling_interrupts
    252715 ±  3%     -18.6%     205823        interrupts.CPU8.LOC:Local_timer_interrupts
    252488 ±  3%     -18.7%     205362        interrupts.CPU80.LOC:Local_timer_interrupts
    340.40 ±  8%     -42.4%     196.00 ±  4%  interrupts.CPU80.RES:Rescheduling_interrupts
    252455 ±  3%     -18.7%     205350        interrupts.CPU81.LOC:Local_timer_interrupts
    352.80 ±  5%     -41.7%     205.80 ±  3%  interrupts.CPU81.RES:Rescheduling_interrupts
    252486 ±  3%     -18.7%     205374        interrupts.CPU82.LOC:Local_timer_interrupts
    349.80 ±  8%     -43.5%     197.80 ±  4%  interrupts.CPU82.RES:Rescheduling_interrupts
    252438 ±  3%     -18.6%     205378        interrupts.CPU83.LOC:Local_timer_interrupts
      7366 ±  3%     -23.8%       5616 ±  4%  interrupts.CPU83.NMI:Non-maskable_interrupts
      7366 ±  3%     -23.8%       5616 ±  4%  interrupts.CPU83.PMI:Performance_monitoring_interrupts
    337.80 ±  9%     -37.7%     210.60 ±  5%  interrupts.CPU83.RES:Rescheduling_interrupts
    252428 ±  3%     -18.6%     205378        interrupts.CPU84.LOC:Local_timer_interrupts
    354.60 ± 10%     -44.0%     198.60 ±  7%  interrupts.CPU84.RES:Rescheduling_interrupts
    252415 ±  3%     -18.7%     205283        interrupts.CPU85.LOC:Local_timer_interrupts
    336.20 ± 11%     -42.1%     194.80 ± 10%  interrupts.CPU85.RES:Rescheduling_interrupts
    252394 ±  3%     -18.6%     205378        interrupts.CPU86.LOC:Local_timer_interrupts
    337.00 ± 10%     -42.2%     194.80 ±  2%  interrupts.CPU86.RES:Rescheduling_interrupts
    252441 ±  3%     -18.7%     205336        interrupts.CPU87.LOC:Local_timer_interrupts
    329.60 ±  4%     -42.9%     188.20 ±  3%  interrupts.CPU87.RES:Rescheduling_interrupts
    252425 ±  3%     -18.6%     205381        interrupts.CPU88.LOC:Local_timer_interrupts
    344.80 ± 10%     -42.3%     199.00 ±  4%  interrupts.CPU88.RES:Rescheduling_interrupts
    252406 ±  3%     -18.7%     205295        interrupts.CPU89.LOC:Local_timer_interrupts
    330.60 ±  5%     -44.2%     184.60 ±  9%  interrupts.CPU89.RES:Rescheduling_interrupts
    252626 ±  3%     -18.5%     205977        interrupts.CPU9.LOC:Local_timer_interrupts
    356.80 ±  7%     -41.7%     208.00 ± 11%  interrupts.CPU9.RES:Rescheduling_interrupts
    252459 ±  3%     -18.7%     205262        interrupts.CPU90.LOC:Local_timer_interrupts
    336.00 ± 11%     -41.0%     198.20 ± 11%  interrupts.CPU90.RES:Rescheduling_interrupts
    252388 ±  3%     -18.6%     205357        interrupts.CPU91.LOC:Local_timer_interrupts
    319.60 ±  9%     -37.3%     200.40 ±  9%  interrupts.CPU91.RES:Rescheduling_interrupts
    252403 ±  3%     -18.6%     205347        interrupts.CPU92.LOC:Local_timer_interrupts
    310.00 ±  9%     -40.2%     185.40 ±  8%  interrupts.CPU92.RES:Rescheduling_interrupts
    252408 ±  3%     -18.6%     205345        interrupts.CPU93.LOC:Local_timer_interrupts
    323.40 ±  8%     -42.2%     186.80 ±  7%  interrupts.CPU93.RES:Rescheduling_interrupts
    252416 ±  3%     -18.6%     205352        interrupts.CPU94.LOC:Local_timer_interrupts
    305.00 ±  9%     -45.9%     165.00 ±  7%  interrupts.CPU94.RES:Rescheduling_interrupts
    252400 ±  3%     -18.6%     205348        interrupts.CPU95.LOC:Local_timer_interrupts
      7416 ±  3%     -33.1%       4961 ± 23%  interrupts.CPU95.NMI:Non-maskable_interrupts
      7416 ±  3%     -33.1%       4961 ± 23%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
    396.40 ±  8%     -52.1%     189.80 ±  6%  interrupts.CPU95.RES:Rescheduling_interrupts
    252729 ±  3%     -18.5%     205978        interrupts.CPU96.LOC:Local_timer_interrupts
      7363 ±  4%     -28.0%       5301 ±  4%  interrupts.CPU96.NMI:Non-maskable_interrupts
      7363 ±  4%     -28.0%       5301 ±  4%  interrupts.CPU96.PMI:Performance_monitoring_interrupts
    284.00 ±  8%     -42.5%     163.40 ± 12%  interrupts.CPU96.RES:Rescheduling_interrupts
    252690 ±  3%     -18.5%     205941        interrupts.CPU97.LOC:Local_timer_interrupts
    282.80 ±  4%     -42.2%     163.40 ± 15%  interrupts.CPU97.RES:Rescheduling_interrupts
    252709 ±  3%     -18.5%     205943        interrupts.CPU98.LOC:Local_timer_interrupts
      7465 ±  4%     -36.0%       4776 ± 21%  interrupts.CPU98.NMI:Non-maskable_interrupts
      7465 ±  4%     -36.0%       4776 ± 21%  interrupts.CPU98.PMI:Performance_monitoring_interrupts
    286.60 ±  7%     -46.1%     154.40 ± 18%  interrupts.CPU98.RES:Rescheduling_interrupts
    252683 ±  3%     -18.5%     205958        interrupts.CPU99.LOC:Local_timer_interrupts
    280.40 ±  4%     -44.7%     155.20 ± 14%  interrupts.CPU99.RES:Rescheduling_interrupts
  48458949 ±  3%     -18.7%   39413104        interrupts.LOC:Local_timer_interrupts
   1270757 ± 11%     -25.2%     950707 ±  6%  interrupts.NMI:Non-maskable_interrupts
   1270757 ± 11%     -25.2%     950707 ±  6%  interrupts.PMI:Performance_monitoring_interrupts
     63385 ±  4%     -41.8%      36883 ±  4%  interrupts.RES:Rescheduling_interrupts
     52996 ±  4%     -16.0%      44540 ±  3%  softirqs.CPU0.RCU
     16792 ±  5%     +12.4%      18876 ±  5%  softirqs.CPU0.SCHED
     56981 ±  4%     -14.3%      48842        softirqs.CPU0.TIMER
     51743 ±  2%     -12.1%      45487 ±  4%  softirqs.CPU1.RCU
     51345 ±  2%     -14.3%      43989 ±  3%  softirqs.CPU10.RCU
      8562 ±  5%     +20.7%      10337 ±  3%  softirqs.CPU10.SCHED
     52620 ±  3%     -10.4%      47143 ±  2%  softirqs.CPU10.TIMER
     50879 ±  2%     -16.0%      42745 ±  2%  softirqs.CPU100.RCU
      8332 ±  6%     +18.0%       9831 ±  6%  softirqs.CPU100.SCHED
     52182 ±  3%     -13.2%      45298 ±  4%  softirqs.CPU100.TIMER
     51195 ±  2%     -15.7%      43174 ±  2%  softirqs.CPU101.RCU
      8662 ±  3%     +16.4%      10081 ±  4%  softirqs.CPU101.SCHED
     52273 ±  2%     -11.2%      46408 ±  2%  softirqs.CPU101.TIMER
     50405 ±  2%     -14.4%      43129 ±  3%  softirqs.CPU102.RCU
      8571 ±  3%     +18.5%      10160 ±  2%  softirqs.CPU102.SCHED
     50486 ±  3%     -14.7%      43085 ±  2%  softirqs.CPU103.RCU
      8467 ±  3%     +16.8%       9887 ±  6%  softirqs.CPU103.SCHED
     50468 ±  3%     -15.4%      42677 ±  2%  softirqs.CPU104.RCU
      8567 ±  4%     +17.9%      10097 ±  3%  softirqs.CPU104.SCHED
     51050 ±  2%     -15.5%      43138 ±  3%  softirqs.CPU105.RCU
      8530 ±  2%     +17.9%      10053 ±  3%  softirqs.CPU105.SCHED
     52182 ±  2%     -11.4%      46224 ±  2%  softirqs.CPU105.TIMER
     51544 ±  4%     -16.9%      42819 ±  3%  softirqs.CPU106.RCU
      8720 ±  5%     +16.9%      10193 ±  2%  softirqs.CPU106.SCHED
     53096 ±  4%     -13.1%      46126 ±  2%  softirqs.CPU106.TIMER
     50547 ±  2%     -14.9%      43003 ±  2%  softirqs.CPU107.RCU
      8489 ±  2%     +22.6%      10407 ±  4%  softirqs.CPU107.SCHED
     50344 ±  3%     -14.2%      43170 ±  4%  softirqs.CPU108.RCU
      8172 ±  6%     +22.9%      10045 ±  2%  softirqs.CPU108.SCHED
     51819 ±  3%     -10.0%      46662 ±  4%  softirqs.CPU108.TIMER
     50735 ±  2%     -16.0%      42604 ±  3%  softirqs.CPU109.RCU
      8581 ±  4%     +17.0%      10043 ±  3%  softirqs.CPU109.SCHED
     51969 ±  3%     -11.8%      45815 ±  2%  softirqs.CPU109.TIMER
     51344 ±  3%     -15.3%      43496 ±  2%  softirqs.CPU11.RCU
      8664 ±  4%     +17.7%      10198 ±  2%  softirqs.CPU11.SCHED
     52786 ±  3%     -10.9%      47051        softirqs.CPU11.TIMER
     50670 ±  3%     -15.0%      43080 ±  4%  softirqs.CPU110.RCU
      8544 ±  3%     +17.8%      10069 ±  2%  softirqs.CPU110.SCHED
     52232 ±  3%     -11.6%      46191 ±  3%  softirqs.CPU110.TIMER
     50668 ±  2%     -14.8%      43153 ±  3%  softirqs.CPU111.RCU
      8547 ±  2%     +18.9%      10167 ±  2%  softirqs.CPU111.SCHED
     51803 ±  2%     -11.0%      46112 ±  2%  softirqs.CPU111.TIMER
     50736 ±  3%     -14.6%      43345 ±  2%  softirqs.CPU112.RCU
      8351 ±  6%     +21.2%      10125 ±  2%  softirqs.CPU112.SCHED
     51832 ±  3%     -11.3%      45963 ±  2%  softirqs.CPU112.TIMER
     50651           -14.0%      43564 ±  2%  softirqs.CPU113.RCU
      8520 ±  2%     +20.4%      10261 ±  2%  softirqs.CPU113.SCHED
     52237 ±  2%     -11.2%      46408        softirqs.CPU113.TIMER
     50636           -16.2%      42414 ±  2%  softirqs.CPU114.RCU
      8437 ±  3%     +19.8%      10109 ±  2%  softirqs.CPU114.SCHED
     51379 ±  4%     -10.2%      46115        softirqs.CPU114.TIMER
     50536 ±  2%     -15.2%      42876 ±  3%  softirqs.CPU115.RCU
      8537 ±  2%     +18.9%      10152 ±  3%  softirqs.CPU115.SCHED
     51958 ±  2%     -11.2%      46165 ±  2%  softirqs.CPU115.TIMER
     51334 ±  4%     -16.8%      42708 ±  2%  softirqs.CPU116.RCU
      8350 ±  3%     +20.5%      10064 ±  2%  softirqs.CPU116.SCHED
     52288 ±  4%     -11.9%      46090        softirqs.CPU116.TIMER
     52059 ±  4%     -18.1%      42651 ±  2%  softirqs.CPU117.RCU
      8492 ±  5%     +16.5%       9894 ±  5%  softirqs.CPU117.SCHED
     53217 ±  5%     -13.7%      45913        softirqs.CPU117.TIMER
     51334 ±  3%     -16.4%      42903 ±  2%  softirqs.CPU118.RCU
      8693 ±  4%     +16.8%      10151 ±  2%  softirqs.CPU118.SCHED
     52721 ±  3%     -12.5%      46106        softirqs.CPU118.TIMER
     50979 ±  4%     -15.4%      43132 ±  5%  softirqs.CPU119.RCU
      8595 ±  2%     +15.2%       9902 ±  3%  softirqs.CPU119.SCHED
     51523 ±  2%     -15.8%      43400 ±  3%  softirqs.CPU12.RCU
      8548 ±  4%     +18.0%      10090 ±  4%  softirqs.CPU12.SCHED
     53034 ±  3%     -11.5%      46948 ±  2%  softirqs.CPU12.TIMER
     49962 ±  3%     -13.9%      43000        softirqs.CPU120.RCU
      8519 ±  4%     +22.6%      10440 ±  4%  softirqs.CPU120.SCHED
     51550 ±  2%     -11.3%      45703 ±  2%  softirqs.CPU120.TIMER
     50262 ±  2%     -13.9%      43297        softirqs.CPU121.RCU
      8645 ±  3%     +18.8%      10271 ±  2%  softirqs.CPU121.SCHED
     50217 ±  2%     -13.8%      43303        softirqs.CPU122.RCU
      8523 ±  3%     +21.7%      10373 ±  5%  softirqs.CPU122.SCHED
     52040 ±  2%     -11.9%      45848 ±  3%  softirqs.CPU122.TIMER
     50273 ±  3%     -14.1%      43199 ±  2%  softirqs.CPU123.RCU
      8540 ±  3%     +19.3%      10187 ±  3%  softirqs.CPU123.SCHED
     51931 ±  2%     -11.8%      45826        softirqs.CPU123.TIMER
     50658 ±  2%     -14.7%      43221 ±  2%  softirqs.CPU124.RCU
      8760 ±  5%     +16.8%      10236 ±  2%  softirqs.CPU124.SCHED
     52150 ±  3%     -12.5%      45626        softirqs.CPU124.TIMER
     50648 ±  3%     -14.0%      43556 ±  3%  softirqs.CPU125.RCU
      8653 ±  4%     +20.1%      10392 ±  4%  softirqs.CPU125.SCHED
     51922 ±  2%     -11.2%      46094 ±  2%  softirqs.CPU125.TIMER
     50653 ±  2%     -14.6%      43279 ±  2%  softirqs.CPU126.RCU
      8612 ±  4%     +20.2%      10354 ±  2%  softirqs.CPU126.SCHED
     51901 ±  2%     -11.9%      45702        softirqs.CPU126.TIMER
     50261 ±  3%     -13.9%      43264 ±  2%  softirqs.CPU127.RCU
      8533 ±  3%     +21.4%      10360 ±  4%  softirqs.CPU127.SCHED
     51746 ±  2%     -11.6%      45759        softirqs.CPU127.TIMER
     50450           -12.4%      44199 ±  3%  softirqs.CPU128.RCU
      8567 ±  4%     +24.9%      10700 ±  7%  softirqs.CPU128.SCHED
     51783 ±  2%     -10.5%      46322 ±  2%  softirqs.CPU128.TIMER
     50645           -14.5%      43281 ±  2%  softirqs.CPU129.RCU
      8674 ±  2%     +18.1%      10244 ±  2%  softirqs.CPU129.SCHED
     52055           -12.2%      45681        softirqs.CPU129.TIMER
     51322 ±  3%     -14.2%      44014 ±  2%  softirqs.CPU13.RCU
      8551 ±  3%     +20.1%      10273 ±  2%  softirqs.CPU13.SCHED
     52731 ±  3%     -11.3%      46789 ±  2%  softirqs.CPU13.TIMER
     50219 ±  3%     -13.5%      43430 ±  2%  softirqs.CPU130.RCU
      8554 ±  3%     +20.7%      10329        softirqs.CPU130.SCHED
     51752 ±  2%     -12.0%      45542        softirqs.CPU130.TIMER
     50283 ±  2%     -14.6%      42934 ±  2%  softirqs.CPU131.RCU
      8841 ±  8%     +15.4%      10202        softirqs.CPU131.SCHED
     52252 ±  3%     -12.9%      45524        softirqs.CPU131.TIMER
     50335 ±  2%     -15.1%      42725        softirqs.CPU132.RCU
      8527 ±  3%     +20.3%      10256        softirqs.CPU132.SCHED
     51589 ±  2%     -12.0%      45379        softirqs.CPU132.TIMER
     50143 ±  2%     -14.9%      42663 ±  2%  softirqs.CPU133.RCU
      8528 ±  3%     +18.8%      10131 ±  2%  softirqs.CPU133.SCHED
     51477 ±  2%     -12.3%      45127        softirqs.CPU133.TIMER
     50092 ±  2%     -14.2%      42960 ±  2%  softirqs.CPU134.RCU
      8538 ±  5%     +19.7%      10218        softirqs.CPU134.SCHED
     51578 ±  2%     -12.4%      45203        softirqs.CPU134.TIMER
     49859 ±  3%     -13.9%      42912 ±  2%  softirqs.CPU135.RCU
      8541 ±  4%     +20.7%      10308        softirqs.CPU135.SCHED
     51619 ±  2%     -11.9%      45464        softirqs.CPU135.TIMER
     50080 ±  2%     -14.5%      42836        softirqs.CPU136.RCU
      8704 ±  4%     +17.8%      10250        softirqs.CPU136.SCHED
     56347 ± 16%     -19.6%      45293        softirqs.CPU136.TIMER
     49979 ±  2%     -14.9%      42554        softirqs.CPU137.RCU
      8533 ±  3%     +17.3%      10011 ±  4%  softirqs.CPU137.SCHED
     51595 ±  2%     -12.0%      45427        softirqs.CPU137.TIMER
     49614 ±  2%     -14.0%      42664        softirqs.CPU138.RCU
      8406 ±  4%     +21.4%      10204        softirqs.CPU138.SCHED
     51542 ±  2%     -11.8%      45462        softirqs.CPU138.TIMER
     49984 ±  3%     -14.8%      42592        softirqs.CPU139.RCU
      8538 ±  4%     +19.0%      10159        softirqs.CPU139.SCHED
     51770 ±  2%     -12.5%      45298        softirqs.CPU139.TIMER
     51361 ±  2%     -15.0%      43659 ±  3%  softirqs.CPU14.RCU
      8478 ±  3%     +20.7%      10233 ±  3%  softirqs.CPU14.SCHED
     52720 ±  3%     -11.1%      46866 ±  2%  softirqs.CPU14.TIMER
     50847 ±  2%     -15.5%      42966 ±  2%  softirqs.CPU140.RCU
      8679 ±  4%     +18.4%      10273 ±  2%  softirqs.CPU140.SCHED
     52220 ±  3%     -12.6%      45663        softirqs.CPU140.TIMER
     49909 ±  2%     -14.5%      42684 ±  2%  softirqs.CPU141.RCU
      8523 ±  2%     +20.0%      10224 ±  2%  softirqs.CPU141.SCHED
     51426 ±  2%     -11.7%      45411        softirqs.CPU141.TIMER
     49573 ±  2%     -13.7%      42782 ±  3%  softirqs.CPU142.RCU
      8489 ±  3%     +20.9%      10267 ±  2%  softirqs.CPU142.SCHED
     51457 ±  2%     -11.3%      45626        softirqs.CPU142.TIMER
     50239 ±  2%     -15.4%      42513 ±  2%  softirqs.CPU143.RCU
      8394 ±  2%     +21.3%      10178        softirqs.CPU143.SCHED
     51721 ±  2%     -12.7%      45173        softirqs.CPU143.TIMER
     50107 ±  2%     -14.8%      42673        softirqs.CPU144.RCU
      8522 ±  3%     +21.5%      10352        softirqs.CPU144.SCHED
     50078 ±  3%     -11.4%      44379 ±  2%  softirqs.CPU144.TIMER
     49917 ±  2%     -14.0%      42947        softirqs.CPU145.RCU
      8540 ±  3%     +21.4%      10368        softirqs.CPU145.SCHED
     50743 ±  2%     -12.4%      44470 ±  2%  softirqs.CPU145.TIMER
     49925 ±  2%     -13.4%      43231 ±  2%  softirqs.CPU146.RCU
      8547 ±  4%     +23.4%      10549 ±  2%  softirqs.CPU146.SCHED
     50101 ±  2%     -14.5%      42817        softirqs.CPU147.RCU
      8666 ±  3%     +19.7%      10376 ±  3%  softirqs.CPU147.SCHED
     50967 ±  2%     -12.4%      44638 ±  2%  softirqs.CPU147.TIMER
     49487 ±  2%     -13.1%      42988 ±  3%  softirqs.CPU148.RCU
      8662 ±  3%     +20.2%      10408 ±  2%  softirqs.CPU148.SCHED
     50862 ±  2%     -12.0%      44750 ±  2%  softirqs.CPU148.TIMER
     50070 ±  2%     -14.3%      42919 ±  2%  softirqs.CPU149.RCU
      8670 ±  3%     +19.9%      10393 ±  3%  softirqs.CPU149.SCHED
     50907 ±  2%     -12.2%      44721 ±  2%  softirqs.CPU149.TIMER
     50932 ±  2%     -14.5%      43551 ±  2%  softirqs.CPU15.RCU
      8488 ±  2%     +20.4%      10218 ±  2%  softirqs.CPU15.SCHED
     52559 ±  3%     -10.9%      46835 ±  2%  softirqs.CPU15.TIMER
     50202 ±  2%     -14.7%      42810 ±  2%  softirqs.CPU150.RCU
      8378 ±  6%     +23.8%      10369 ±  2%  softirqs.CPU150.SCHED
     50978 ±  2%     -12.5%      44618 ±  2%  softirqs.CPU150.TIMER
     50304 ±  2%     -13.8%      43387 ±  2%  softirqs.CPU151.RCU
      8726 ±  4%     +19.0%      10386 ±  2%  softirqs.CPU151.SCHED
     51201 ±  2%     -12.3%      44900 ±  2%  softirqs.CPU151.TIMER
     50416 ±  2%     -14.2%      43251        softirqs.CPU152.RCU
      8663 ±  4%     +20.2%      10409 ±  2%  softirqs.CPU152.SCHED
     49856 ±  5%     -10.5%      44631 ±  2%  softirqs.CPU152.TIMER
     49985 ±  2%     -13.7%      43133        softirqs.CPU153.RCU
      8635 ±  3%     +20.3%      10386        softirqs.CPU153.SCHED
     50766 ±  2%     -12.3%      44510 ±  2%  softirqs.CPU153.TIMER
     49615 ±  3%     -13.3%      43011 ±  2%  softirqs.CPU154.RCU
      8629 ±  4%     +19.5%      10307 ±  3%  softirqs.CPU154.SCHED
     55157 ± 14%     -18.5%      44931 ±  3%  softirqs.CPU154.TIMER
     50905 ±  3%     -15.9%      42821 ±  2%  softirqs.CPU155.RCU
      8698 ±  3%     +20.5%      10486 ±  2%  softirqs.CPU155.SCHED
     51302 ±  2%     -12.9%      44694 ±  2%  softirqs.CPU155.TIMER
     49848 ±  2%     -13.2%      43243        softirqs.CPU156.RCU
      8567 ±  3%     +20.9%      10360 ±  2%  softirqs.CPU156.SCHED
     50707 ±  3%     -12.3%      44455 ±  2%  softirqs.CPU156.TIMER
     49662 ±  2%     -13.3%      43077        softirqs.CPU157.RCU
      8599 ±  3%     +20.4%      10355 ±  2%  softirqs.CPU157.SCHED
     50620 ±  3%     -12.1%      44502 ±  3%  softirqs.CPU157.TIMER
     49997 ±  3%     -14.3%      42859        softirqs.CPU158.RCU
      8486 ±  4%     +23.2%      10453        softirqs.CPU158.SCHED
     50746 ±  2%     -12.3%      44496 ±  2%  softirqs.CPU158.TIMER
     49542 ±  3%     -10.8%      44197 ±  2%  softirqs.CPU159.RCU
      8610 ±  4%     +21.6%      10467 ±  2%  softirqs.CPU159.SCHED
     50553 ±  3%     -10.7%      45144 ±  4%  softirqs.CPU159.TIMER
     50930 ±  3%     -13.4%      44127 ±  4%  softirqs.CPU16.RCU
      8460 ±  2%     +19.9%      10141 ±  2%  softirqs.CPU16.SCHED
     52586 ±  3%     -10.5%      47056        softirqs.CPU16.TIMER
     49804 ±  2%     -13.7%      42999 ±  2%  softirqs.CPU160.RCU
      8654 ±  2%     +19.4%      10329        softirqs.CPU160.SCHED
     50574 ±  2%     -12.2%      44421 ±  2%  softirqs.CPU160.TIMER
     49977           -12.8%      43603 ±  3%  softirqs.CPU161.RCU
      8535           +23.4%      10533 ±  3%  softirqs.CPU161.SCHED
     50843 ±  2%     -10.7%      45387 ±  2%  softirqs.CPU161.TIMER
     50512 ±  4%     -15.2%      42839        softirqs.CPU162.RCU
      8712 ±  5%     +19.0%      10366        softirqs.CPU162.SCHED
     51075 ±  4%     -13.1%      44397 ±  2%  softirqs.CPU162.TIMER
     50127 ±  2%     -14.7%      42775 ±  2%  softirqs.CPU163.RCU
      8719 ±  3%     +19.1%      10387        softirqs.CPU163.SCHED
     51037 ±  3%     -12.9%      44435 ±  3%  softirqs.CPU163.TIMER
     50428 ±  2%     -15.1%      42832        softirqs.CPU164.RCU
      8460 ±  4%     +22.7%      10383        softirqs.CPU164.SCHED
     51074 ±  3%     -13.1%      44359 ±  2%  softirqs.CPU164.TIMER
     50915 ±  5%     -12.5%      44542 ±  3%  softirqs.CPU165.RCU
      8813 ±  7%     +20.6%      10628 ±  4%  softirqs.CPU165.SCHED
     50056 ±  4%     -14.0%      43043 ±  2%  softirqs.CPU166.RCU
      8733 ±  6%     +18.8%      10371 ±  2%  softirqs.CPU166.SCHED
     50922 ±  3%     -12.7%      44445 ±  2%  softirqs.CPU166.TIMER
     50127 ±  3%     -14.4%      42907        softirqs.CPU167.RCU
      8609 ±  3%     +19.7%      10309        softirqs.CPU167.SCHED
     50734 ±  3%     -12.4%      44431 ±  2%  softirqs.CPU167.TIMER
     50283 ±  3%     -16.8%      41859 ±  2%  softirqs.CPU168.RCU
      8532 ±  7%     +15.3%       9838 ±  6%  softirqs.CPU168.SCHED
     50262 ±  3%     -16.1%      42183        softirqs.CPU169.RCU
      8611 ±  3%     +17.4%      10108 ±  2%  softirqs.CPU169.SCHED
     51544 ±  2%     -15.6%      43499        softirqs.CPU17.RCU
      8613 ±  4%     +19.1%      10256 ±  2%  softirqs.CPU17.SCHED
     52791 ±  3%     -11.1%      46919        softirqs.CPU17.TIMER
     50284 ±  2%     -16.2%      42145 ±  2%  softirqs.CPU170.RCU
      8624 ±  4%     +14.9%       9906 ±  6%  softirqs.CPU170.SCHED
     50632 ±  3%     -16.9%      42090 ±  3%  softirqs.CPU171.RCU
      8744 ±  4%     +13.4%       9916 ±  4%  softirqs.CPU171.SCHED
     51652 ±  2%     -10.8%      46085 ±  2%  softirqs.CPU171.TIMER
     50081 ±  3%     -16.8%      41683        softirqs.CPU172.RCU
      8598 ±  5%     +16.5%      10018        softirqs.CPU172.SCHED
     50239 ±  2%     -14.9%      42769 ±  4%  softirqs.CPU173.RCU
      8685 ±  3%     +18.2%      10263 ±  5%  softirqs.CPU173.SCHED
     49938 ±  2%     -16.4%      41730 ±  2%  softirqs.CPU174.RCU
      8565 ±  3%     +17.4%      10054 ±  2%  softirqs.CPU174.SCHED
     49988 ±  3%     -16.5%      41739 ±  2%  softirqs.CPU175.RCU
      8607 ±  4%     +16.1%       9992 ±  3%  softirqs.CPU175.SCHED
     49644 ±  3%     -15.0%      42217 ±  3%  softirqs.CPU176.RCU
      8600 ±  4%     +18.4%      10183 ±  3%  softirqs.CPU176.SCHED
     50032 ±  2%     -14.2%      42920 ±  4%  softirqs.CPU177.RCU
      8479 ±  5%     +21.7%      10315 ±  4%  softirqs.CPU177.SCHED
     49762 ±  3%     -14.9%      42358 ±  3%  softirqs.CPU178.RCU
      8577 ±  4%     +19.5%      10249 ±  3%  softirqs.CPU178.SCHED
     49707 ±  3%     -15.3%      42103 ±  3%  softirqs.CPU179.RCU
      8514 ±  5%     +17.1%       9970 ±  5%  softirqs.CPU179.SCHED
     52056 ±  2%     -16.1%      43684 ±  4%  softirqs.CPU18.RCU
      8570 ±  2%     +19.3%      10222 ±  2%  softirqs.CPU18.SCHED
     57733 ± 13%     -18.0%      47343 ±  3%  softirqs.CPU18.TIMER
     49483 ±  3%     -15.6%      41756 ±  2%  softirqs.CPU180.RCU
      8609 ±  4%     +18.3%      10183 ±  3%  softirqs.CPU180.SCHED
     49510 ±  3%     -15.3%      41958        softirqs.CPU181.RCU
      8545 ±  5%     +17.8%      10061 ±  2%  softirqs.CPU181.SCHED
     49960 ±  2%     -16.5%      41695 ±  2%  softirqs.CPU182.RCU
      8644 ±  4%     +15.0%       9939 ±  3%  softirqs.CPU182.SCHED
     51249 ±  2%     -11.3%      45449 ±  3%  softirqs.CPU182.TIMER
     50011 ±  2%     -16.4%      41822        softirqs.CPU183.RCU
      8631 ±  4%     +14.9%       9918 ±  2%  softirqs.CPU183.SCHED
     49795 ±  2%     -15.0%      42330 ±  4%  softirqs.CPU184.RCU
      8590 ±  4%     +17.8%      10115 ±  5%  softirqs.CPU184.SCHED
     49937 ±  3%     -15.3%      42295 ±  3%  softirqs.CPU185.RCU
      8686 ±  5%     +15.9%      10068 ±  2%  softirqs.CPU185.SCHED
     49446 ±  2%     -16.5%      41296        softirqs.CPU186.RCU
      8622 ±  4%     +14.8%       9899 ±  3%  softirqs.CPU186.SCHED
     49483 ±  2%     -15.7%      41693        softirqs.CPU187.RCU
      8527 ±  4%     +18.1%      10067 ±  2%  softirqs.CPU187.SCHED
     49848 ±  3%     -16.1%      41818 ±  2%  softirqs.CPU188.RCU
      8613 ±  4%     +16.2%      10012 ±  3%  softirqs.CPU188.SCHED
     50124 ±  4%     -16.4%      41914 ±  2%  softirqs.CPU189.RCU
      8627 ±  6%     +17.1%      10101 ±  2%  softirqs.CPU189.SCHED
     51435 ±  3%     -15.7%      43362        softirqs.CPU19.RCU
      8603 ±  3%     +18.4%      10186 ±  2%  softirqs.CPU19.SCHED
     52851 ±  3%     -11.3%      46886 ±  2%  softirqs.CPU19.TIMER
     49713 ±  2%     -15.8%      41834 ±  2%  softirqs.CPU190.RCU
      8593 ±  4%     +16.5%      10010 ±  3%  softirqs.CPU190.SCHED
     47772 ±  3%     -15.4%      40394 ±  3%  softirqs.CPU191.RCU
      8215 ±  5%     +17.6%       9658 ±  2%  softirqs.CPU191.SCHED
     52390 ±  3%     -15.9%      44086 ±  2%  softirqs.CPU2.RCU
      8621 ±  4%     +21.8%      10503 ±  2%  softirqs.CPU2.SCHED
     53950 ±  3%     -13.2%      46854 ±  2%  softirqs.CPU2.TIMER
     51573 ±  2%     -14.0%      44370 ±  4%  softirqs.CPU20.RCU
      8476 ±  4%     +22.5%      10386 ±  2%  softirqs.CPU20.SCHED
     52870 ±  2%      -9.8%      47689 ±  4%  softirqs.CPU20.TIMER
     51265 ±  3%     -15.2%      43472 ±  2%  softirqs.CPU21.RCU
      8476 ±  3%     +20.1%      10180 ±  2%  softirqs.CPU21.SCHED
     52493 ±  3%     -10.8%      46808 ±  2%  softirqs.CPU21.TIMER
     51796 ±  2%     -15.5%      43747 ±  3%  softirqs.CPU22.RCU
      8386 ±  4%     +21.4%      10179 ±  4%  softirqs.CPU22.SCHED
     52981 ±  2%     -11.0%      47130 ±  2%  softirqs.CPU22.TIMER
     51833 ±  4%     -16.2%      43425 ±  3%  softirqs.CPU23.RCU
      8504 ±  3%     +19.7%      10179 ±  2%  softirqs.CPU23.SCHED
     53025 ±  4%     -11.7%      46828 ±  2%  softirqs.CPU23.TIMER
     51026           -14.0%      43875 ±  3%  softirqs.CPU24.RCU
      8711 ±  4%     +19.0%      10362 ±  3%  softirqs.CPU24.SCHED
     52541 ±  2%     -11.3%      46583        softirqs.CPU24.TIMER
     51251 ±  2%     -11.3%      45470 ±  5%  softirqs.CPU25.RCU
      8465 ±  4%     +24.2%      10511 ±  5%  softirqs.CPU25.SCHED
     52546 ±  2%     -11.7%      46395 ±  2%  softirqs.CPU25.TIMER
     57874           -18.5%      47163 ±  8%  softirqs.CPU26.RCU
      7994 ±  5%     +27.4%      10187 ±  8%  softirqs.CPU26.SCHED
     54119           -13.0%      47106 ±  2%  softirqs.CPU26.TIMER
     51574 ±  2%     -11.9%      45417 ±  6%  softirqs.CPU27.RCU
      8620 ±  3%     +20.8%      10411 ±  7%  softirqs.CPU27.SCHED
     52746 ±  2%     -10.6%      47148        softirqs.CPU27.TIMER
     51043           -13.5%      44143 ±  2%  softirqs.CPU28.RCU
      8562 ±  2%     +22.0%      10446 ±  4%  softirqs.CPU28.SCHED
     52556 ±  2%     -11.0%      46772        softirqs.CPU28.TIMER
     51794           -14.5%      44288 ±  2%  softirqs.CPU29.RCU
      8746 ±  3%     +18.4%      10358        softirqs.CPU29.SCHED
     53268 ±  3%     -12.7%      46522        softirqs.CPU29.TIMER
     51882 ±  3%     -15.1%      44073 ±  3%  softirqs.CPU3.RCU
      8935 ±  7%     +13.8%      10169 ±  3%  softirqs.CPU3.SCHED
     51026           -13.5%      44137 ±  2%  softirqs.CPU30.RCU
      8498 ±  2%     +21.7%      10339 ±  2%  softirqs.CPU30.SCHED
     52549 ±  2%     -11.0%      46766        softirqs.CPU30.TIMER
     50783 ±  2%     -13.3%      44015        softirqs.CPU31.RCU
      8560 ±  2%     +19.7%      10249 ±  2%  softirqs.CPU31.SCHED
     52544 ±  2%     -11.9%      46281        softirqs.CPU31.TIMER
     50514 ±  2%     -12.9%      43980        softirqs.CPU32.RCU
      8486 ±  3%     +21.3%      10291 ±  2%  softirqs.CPU32.SCHED
     52505 ±  2%     -11.8%      46331        softirqs.CPU32.TIMER
     51208 ±  2%     -14.4%      43818 ±  2%  softirqs.CPU33.RCU
      8590 ±  3%     +19.4%      10253 ±  2%  softirqs.CPU33.SCHED
     52821 ±  2%     -12.2%      46370        softirqs.CPU33.TIMER
     51707 ±  2%     -16.1%      43395 ±  2%  softirqs.CPU34.RCU
      8504 ±  3%     +20.3%      10227 ±  2%  softirqs.CPU34.SCHED
     53289 ±  2%     -13.4%      46143        softirqs.CPU34.TIMER
     51848 ±  6%     -16.0%      43564 ±  2%  softirqs.CPU35.RCU
      8716 ±  8%     +17.6%      10251        softirqs.CPU35.SCHED
     53681 ±  5%     -13.3%      46533        softirqs.CPU35.TIMER
     50592 ±  2%     -14.1%      43472 ±  2%  softirqs.CPU36.RCU
      8452 ±  3%     +21.6%      10276 ±  2%  softirqs.CPU36.SCHED
     52504 ±  2%     -11.8%      46317        softirqs.CPU36.TIMER
     51047 ±  2%     -14.9%      43445        softirqs.CPU37.RCU
      8519 ±  2%     +20.2%      10237 ±  2%  softirqs.CPU37.SCHED
     52338 ±  2%     -12.3%      45913        softirqs.CPU37.TIMER
     50415           -13.4%      43661        softirqs.CPU38.RCU
      8424 ±  4%     +21.7%      10251        softirqs.CPU38.SCHED
     52281 ±  2%     -12.1%      45978        softirqs.CPU38.TIMER
     50595 ±  2%     -13.8%      43619        softirqs.CPU39.RCU
      8449 ±  3%     +22.4%      10344 ±  2%  softirqs.CPU39.SCHED
     52314 ±  2%     -11.5%      46322        softirqs.CPU39.TIMER
     51297 ±  2%      -9.9%      46205 ±  7%  softirqs.CPU4.RCU
      9051 ±  7%     +17.4%      10624 ±  4%  softirqs.CPU4.SCHED
     51280 ±  5%     -14.9%      43644 ±  2%  softirqs.CPU40.RCU
      8606 ±  7%     +19.9%      10321        softirqs.CPU40.SCHED
     52173 ±  2%     -11.7%      46072        softirqs.CPU40.TIMER
     50540 ±  2%     -13.5%      43714 ±  2%  softirqs.CPU41.RCU
      8435 ±  3%     +22.6%      10339 ±  2%  softirqs.CPU41.SCHED
     52251 ±  2%     -11.1%      46447        softirqs.CPU41.TIMER
     50235 ±  2%     -13.6%      43408        softirqs.CPU42.RCU
      8462 ±  4%     +22.6%      10375 ±  2%  softirqs.CPU42.SCHED
     52211 ±  2%     -11.0%      46475        softirqs.CPU42.TIMER
     50574 ±  2%     -12.5%      44229 ±  2%  softirqs.CPU43.RCU
      8680 ±  5%     +21.0%      10502 ±  2%  softirqs.CPU43.SCHED
     52398 ±  2%     -10.0%      47175 ±  2%  softirqs.CPU43.TIMER
     50559 ±  3%     -12.2%      44375 ±  2%  softirqs.CPU44.RCU
      8422 ±  3%     +23.6%      10413        softirqs.CPU44.SCHED
     52278 ±  2%     -10.1%      47008 ±  2%  softirqs.CPU44.TIMER
     50525 ±  2%     -13.6%      43640        softirqs.CPU45.RCU
      8474 ±  4%     +21.9%      10328 ±  2%  softirqs.CPU45.SCHED
     52234 ±  2%     -11.3%      46333        softirqs.CPU45.TIMER
     50859 ±  3%     -14.2%      43661        softirqs.CPU46.RCU
      8572 ±  3%     +20.7%      10343        softirqs.CPU46.SCHED
     52358 ±  2%     -11.5%      46332        softirqs.CPU46.TIMER
     50737 ±  3%     -14.4%      43407 ±  2%  softirqs.CPU47.RCU
      8461 ±  3%     +21.7%      10299 ±  2%  softirqs.CPU47.SCHED
     52517 ±  2%     -12.1%      46171        softirqs.CPU47.TIMER
     50747 ±  3%     -14.4%      43452        softirqs.CPU48.RCU
      8630 ±  6%     +20.1%      10361 ±  2%  softirqs.CPU48.SCHED
     56318 ± 18%     -19.8%      45181 ±  2%  softirqs.CPU48.TIMER
     50967 ±  2%     -14.2%      43750        softirqs.CPU49.RCU
      8611 ±  3%     +20.0%      10336 ±  3%  softirqs.CPU49.SCHED
     51610 ±  2%     -12.4%      45220 ±  2%  softirqs.CPU49.TIMER
     51067 ±  2%     -14.5%      43645 ±  3%  softirqs.CPU5.RCU
      8585 ±  3%     +23.2%      10576 ±  5%  softirqs.CPU5.SCHED
     52764 ±  2%     -10.5%      47219        softirqs.CPU5.TIMER
     51669 ±  3%     -14.0%      44458 ±  3%  softirqs.CPU50.RCU
     52268 ±  3%     -13.8%      45062 ±  2%  softirqs.CPU50.TIMER
     51141 ±  2%     -14.2%      43881 ±  2%  softirqs.CPU51.RCU
      8594 ±  3%     +22.3%      10507 ±  2%  softirqs.CPU51.SCHED
     51469 ±  2%     -11.4%      45606 ±  2%  softirqs.CPU51.TIMER
     51113 ±  2%     -15.0%      43425        softirqs.CPU52.RCU
      8612 ±  3%     +17.9%      10155 ±  4%  softirqs.CPU52.SCHED
     51829 ±  2%     -12.3%      45459 ±  2%  softirqs.CPU52.TIMER
     51194 ±  2%     -15.0%      43509        softirqs.CPU53.RCU
      8526 ±  4%     +19.6%      10199 ±  3%  softirqs.CPU53.SCHED
     51660 ±  2%     -12.5%      45227 ±  2%  softirqs.CPU53.TIMER
     51801 ±  3%     -16.5%      43238        softirqs.CPU54.RCU
      8818 ±  7%     +18.2%      10423 ±  2%  softirqs.CPU54.SCHED
     52343 ±  3%     -13.5%      45264 ±  2%  softirqs.CPU54.TIMER
     51300 ±  3%     -15.3%      43431        softirqs.CPU55.RCU
     52138           -13.0%      45371 ±  2%  softirqs.CPU55.TIMER
     51090 ±  2%     -14.3%      43785        softirqs.CPU56.RCU
      8524 ±  4%     +21.6%      10361 ±  2%  softirqs.CPU56.SCHED
     55904 ± 14%     -18.8%      45376 ±  2%  softirqs.CPU56.TIMER
     50817 ±  3%     -12.8%      44302 ±  2%  softirqs.CPU57.RCU
      8626 ±  4%     +21.8%      10503 ±  2%  softirqs.CPU57.SCHED
     51454 ±  3%     -11.1%      45739 ±  3%  softirqs.CPU57.TIMER
     51402 ±  4%     -15.5%      43451 ±  2%  softirqs.CPU58.RCU
      8665 ±  3%     +20.8%      10464 ±  2%  softirqs.CPU58.SCHED
     51425 ±  3%     -11.8%      45374 ±  2%  softirqs.CPU58.TIMER
     51093 ±  3%     -15.4%      43212        softirqs.CPU59.RCU
      8609 ±  3%     +19.6%      10297 ±  2%  softirqs.CPU59.SCHED
     51842 ±  2%     -12.9%      45176 ±  2%  softirqs.CPU59.TIMER
     50946 ±  3%     -13.0%      44325        softirqs.CPU6.RCU
      8555 ±  4%     +27.2%      10885 ±  8%  softirqs.CPU6.SCHED
     52724 ±  3%      -9.6%      47638 ±  2%  softirqs.CPU6.TIMER
     50731 ±  2%     -11.7%      44811 ±  3%  softirqs.CPU60.RCU
      8929 ±  6%     +16.6%      10411        softirqs.CPU60.SCHED
     51512 ±  2%     -10.7%      46017 ±  2%  softirqs.CPU60.TIMER
     51304 ±  3%     -14.6%      43818        softirqs.CPU61.RCU
      8512 ±  4%     +22.0%      10385        softirqs.CPU61.SCHED
     52037 ±  3%     -13.0%      45246 ±  2%  softirqs.CPU61.TIMER
     50708 ±  2%     -13.9%      43681        softirqs.CPU62.RCU
      8554 ±  3%     +20.7%      10328 ±  4%  softirqs.CPU62.SCHED
     51447 ±  3%     -11.9%      45339 ±  2%  softirqs.CPU62.TIMER
     50694 ±  2%     -13.8%      43721        softirqs.CPU63.RCU
      8486 ±  3%     +22.5%      10399        softirqs.CPU63.SCHED
     51356 ±  3%     -11.9%      45228 ±  2%  softirqs.CPU63.TIMER
     51181 ±  4%     -14.5%      43780        softirqs.CPU64.RCU
      8660 ±  5%     +20.4%      10424 ±  2%  softirqs.CPU64.SCHED
     51777 ±  3%     -12.6%      45256 ±  2%  softirqs.CPU64.TIMER
     50930 ±  3%     -12.6%      44510 ±  2%  softirqs.CPU65.RCU
      8594 ±  5%     +20.0%      10314 ±  2%  softirqs.CPU65.SCHED
     50727 ±  3%     -11.8%      44747 ±  3%  softirqs.CPU66.RCU
      8512 ±  4%     +23.6%      10520 ±  2%  softirqs.CPU66.SCHED
     50875 ±  2%     -12.7%      44439        softirqs.CPU67.RCU
      8627 ±  3%     +23.7%      10674 ±  2%  softirqs.CPU67.SCHED
     51535 ±  2%     -11.2%      45771 ±  2%  softirqs.CPU67.TIMER
     51228 ±  2%     -14.2%      43972        softirqs.CPU68.RCU
      8564 ±  2%     +23.2%      10551        softirqs.CPU68.SCHED
     51638 ±  2%     -12.0%      45436 ±  2%  softirqs.CPU68.TIMER
     51901 ±  4%     -14.9%      44146 ±  2%  softirqs.CPU69.RCU
      8600 ±  3%     +21.4%      10440 ±  2%  softirqs.CPU69.SCHED
     52196 ±  2%     -14.2%      44798 ±  4%  softirqs.CPU69.TIMER
     51216 ±  2%     -13.2%      44443        softirqs.CPU7.RCU
      8755 ±  3%     +21.8%      10665 ±  4%  softirqs.CPU7.SCHED
     50860 ±  2%     -13.6%      43946 ±  2%  softirqs.CPU70.RCU
      8662 ±  5%     +20.7%      10458 ±  2%  softirqs.CPU70.SCHED
     51397 ±  2%     -12.1%      45163 ±  2%  softirqs.CPU70.TIMER
     50619 ±  2%     -12.3%      44369        softirqs.CPU71.RCU
      8521 ±  4%     +20.8%      10290 ±  3%  softirqs.CPU71.SCHED
     51351 ±  3%     -11.5%      45445        softirqs.CPU71.TIMER
     50908 ±  3%     -15.5%      43038 ±  2%  softirqs.CPU72.RCU
      8604 ±  4%     +20.0%      10325 ±  7%  softirqs.CPU72.SCHED
     51259 ±  3%     -16.5%      42810 ±  2%  softirqs.CPU73.RCU
      8534 ±  4%     +13.8%       9716 ±  6%  softirqs.CPU73.SCHED
     50834 ±  2%     -14.4%      43489 ±  4%  softirqs.CPU74.RCU
      8542 ±  4%     +18.6%      10131 ±  2%  softirqs.CPU74.SCHED
     50866 ±  2%     -15.7%      42888        softirqs.CPU75.RCU
      8539 ±  4%     +18.1%      10083 ±  2%  softirqs.CPU75.SCHED
     50667 ±  3%     -14.8%      43193        softirqs.CPU76.RCU
      8507 ±  4%     +18.8%      10105        softirqs.CPU76.SCHED
     50613 ±  3%     -16.0%      42515        softirqs.CPU77.RCU
      8485 ±  5%     +19.0%      10096        softirqs.CPU77.SCHED
     50745 ±  2%     -15.6%      42805 ±  2%  softirqs.CPU78.RCU
      8551 ±  4%     +17.7%      10066 ±  2%  softirqs.CPU78.SCHED
     50494 ±  2%     -15.5%      42671 ±  2%  softirqs.CPU79.RCU
      8498 ±  4%     +15.9%       9849 ±  3%  softirqs.CPU79.SCHED
     51399 ±  3%     -13.3%      44570 ±  5%  softirqs.CPU8.RCU
      8568 ±  4%     +23.1%      10549 ±  5%  softirqs.CPU8.SCHED
     50465 ±  3%     -14.8%      42995 ±  3%  softirqs.CPU80.RCU
      8455 ±  4%     +19.8%      10130 ±  4%  softirqs.CPU80.SCHED
     50917 ±  2%     -16.6%      42439        softirqs.CPU81.RCU
      8516 ±  4%     +17.7%      10028 ±  2%  softirqs.CPU81.SCHED
     50334 ±  2%     -13.7%      43433 ±  3%  softirqs.CPU82.RCU
      8554 ±  4%     +17.0%      10012 ±  3%  softirqs.CPU82.SCHED
     50437 ±  2%     -14.9%      42934 ±  3%  softirqs.CPU83.RCU
      8527 ±  3%     +17.2%       9996 ±  4%  softirqs.CPU83.SCHED
     50562 ±  2%     -16.2%      42394        softirqs.CPU84.RCU
      8568 ±  4%     +15.5%       9893 ±  4%  softirqs.CPU84.SCHED
     50630 ±  2%     -15.3%      42859 ±  2%  softirqs.CPU85.RCU
      8565 ±  4%     +16.8%      10002 ±  2%  softirqs.CPU85.SCHED
     50711 ±  3%     -15.8%      42722        softirqs.CPU86.RCU
      8350 ±  7%     +19.4%       9974 ±  2%  softirqs.CPU86.SCHED
     51693 ±  4%     -17.2%      42820 ±  2%  softirqs.CPU87.RCU
      8760 ±  7%     +15.2%      10092 ±  2%  softirqs.CPU87.SCHED
     52733 ±  4%     -11.4%      46744 ±  3%  softirqs.CPU87.TIMER
     50665 ±  2%     -16.1%      42488        softirqs.CPU88.RCU
      8642 ±  4%     +16.0%      10024 ±  2%  softirqs.CPU88.SCHED
     51986 ±  2%     -11.3%      46088 ±  3%  softirqs.CPU88.TIMER
     51112 ±  2%     -16.6%      42612 ±  2%  softirqs.CPU89.RCU
      8672 ±  4%     +16.4%      10091 ±  3%  softirqs.CPU89.SCHED
     52095 ±  2%     -10.8%      46484 ±  3%  softirqs.CPU89.TIMER
     51458 ±  3%     -14.3%      44112 ±  3%  softirqs.CPU9.RCU
      8575 ±  4%     +19.9%      10280 ±  2%  softirqs.CPU9.SCHED
     50538 ±  2%     -16.8%      42065        softirqs.CPU90.RCU
      8559 ±  5%     +16.8%       9994 ±  3%  softirqs.CPU90.SCHED
     50325 ±  3%     -15.8%      42351        softirqs.CPU91.RCU
      8564 ±  5%     +16.7%       9997 ±  2%  softirqs.CPU91.SCHED
     50169 ±  2%     -14.2%      43038        softirqs.CPU92.RCU
      8507 ±  4%     +17.8%      10022 ±  4%  softirqs.CPU92.SCHED
     50098 ±  3%     -14.9%      42656        softirqs.CPU93.RCU
      8454 ±  4%     +18.4%      10008 ±  3%  softirqs.CPU93.SCHED
     49986 ±  3%     -13.7%      43113 ±  3%  softirqs.CPU94.RCU
      8505 ±  5%     +18.2%      10055 ±  3%  softirqs.CPU94.SCHED
     51130 ±  4%     -15.7%      43104 ±  3%  softirqs.CPU95.RCU
     50488 ±  3%     -14.7%      43072 ±  4%  softirqs.CPU96.RCU
     51057 ±  3%     -15.5%      43135 ±  2%  softirqs.CPU97.RCU
      8528 ±  5%     +17.6%      10025 ±  3%  softirqs.CPU97.SCHED
     52418 ±  3%     -12.6%      45799 ±  3%  softirqs.CPU97.TIMER
     51606 ±  4%     -16.9%      42878 ±  2%  softirqs.CPU98.RCU
      8744 ±  5%     +15.9%      10136 ±  3%  softirqs.CPU98.SCHED
     52848 ±  4%     -13.4%      45770 ±  2%  softirqs.CPU98.TIMER
     51746 ±  5%     -17.4%      42762 ±  2%  softirqs.CPU99.RCU
      8503 ±  2%     +19.8%      10189 ±  3%  softirqs.CPU99.SCHED
     53069 ±  5%     -12.7%      46317 ±  2%  softirqs.CPU99.TIMER
   9733936 ±  2%     -14.7%    8301741        softirqs.RCU
   1654645 ±  3%     +19.3%    1974040        softirqs.SCHED
   9986673 ±  2%     -11.4%    8846639        softirqs.TIMER


                                                                                
                                  aim7.jobs-per-min                             
                                                                                
  180000 +------------------------------------------------------------------+   
         |                O                O                                |   
  175000 |-+                                                                |   
  170000 |-+                                                                |   
         |                                                                  |   
  165000 |-+                                                                |   
  160000 |-+                                                                |   
         |                                                                  |   
  155000 |-+                                                                |   
  150000 |-+                                                                |   
         |                                         ........+................|   
  145000 |-+                           ....+.......                         |   
  140000 |-+                   ........                                     |   
         |................+....                                             |   
  135000 +------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                aim7.time.system_time                           
                                                                                
  18000 +-------------------------------------------------------------------+   
        |        ........+................                                  |   
  17000 |........                         +................+................|   
  16000 |-+                                                                 |   
        |                                                                   |   
  15000 |-+                                                                 |   
  14000 |-+                                                                 |   
        |                                                                   |   
  13000 |-+                                                                 |   
  12000 |-+                                                                 |   
        |                                                                   |   
  11000 |-+                                                                 |   
  10000 |-+                                                                 |   
        |                                 O                                 |   
   9000 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                              aim7.time.elapsed_time                            
                                                                                
  135 +---------------------------------------------------------------------+   
      |                                                                     |   
  130 |.................+........                                           |   
      |                          ......                                     |   
  125 |-+                              ..                                   |   
      |                                  +.................+................|   
  120 |-+                                                                   |   
      |                                                                     |   
  115 |-+                                                                   |   
      |                                                                     |   
  110 |-+                                                                   |   
      |                                                                     |   
  105 |-+                                                                   |   
      |                 O                O                                  |   
  100 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            aim7.time.elapsed_time.max                          
                                                                                
  135 +---------------------------------------------------------------------+   
      |                                                                     |   
  130 |.................+........                                           |   
      |                          ......                                     |   
  125 |-+                              ..                                   |   
      |                                  +.................+................|   
  120 |-+                                                                   |   
      |                                                                     |   
  115 |-+                                                                   |   
      |                                                                     |   
  110 |-+                                                                   |   
      |                                                                     |   
  105 |-+                                                                   |   
      |                 O                O                                  |   
  100 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                             aim7.time.minor_page_faults                        
                                                                                
  250000 +------------------------------------------------------------------+   
  245000 |-+            ..+.....                                            |   
         |        ......        ...                                         |   
  240000 |-+......                 ...                   ..+................|   
  235000 |..                          ....         ......                   |   
         |                                .   .....                         |   
  230000 |-+                               +..                              |   
  225000 |-+                                                                |   
  220000 |-+                                                                |   
         |                                                                  |   
  215000 |-+                                                                |   
  210000 |-+                                                                |   
         |                                                 O                |   
  205000 |-+              O                O                                |   
  200000 +------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                         aim7.time.voluntary_context_switches                   
                                                                                
  1.02e+06 +----------------------------------------------------------------+   
           |                                                              ..|   
     1e+06 |-+                      ........+...........            ......  |   
    980000 |-+         ....+........                    ....   .....        |   
           |   ........                                     +..             |   
    960000 |...                                                             |   
           |                                                                |   
    940000 |-+                                                              |   
           |                                                                |   
    920000 |-+                                                              |   
    900000 |-+                                                              |   
           |                                                                |   
    880000 |-+             O                O               O               |   
           |                                                                |   
    860000 +----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                       aim7.time.involuntary_context_switches                   
                                                                                
  85000 +-------------------------------------------------------------------+   
  80000 |-+                           ....+................         ........|   
        |                     ........                     +........        |   
  75000 |-+      ........+....                                              |   
  70000 |........                                                           |   
  65000 |-+                                                                 |   
  60000 |-+                                                                 |   
        |                                                                   |   
  55000 |-+                                                                 |   
  50000 |-+                                                                 |   
  45000 |-+                                                                 |   
  40000 |-+                                                                 |   
        |                                                                   |   
  35000 |-+              O                O                O                |   
  30000 +-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.6.0-rc4-00005-g542951592c99f" of type "text/plain" (203581 bytes)

View attachment "job-script" of type "text/plain" (7708 bytes)

View attachment "job.yaml" of type "text/plain" (5281 bytes)

View attachment "reproduce" of type "text/plain" (1026 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ