lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Thu, 29 Oct 2020 21:08:02 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     "Darrick J. Wong" <darrick.wong@...cle.com>
Cc:     LKML <linux-kernel@...r.kernel.org>,
        "Darrick J. Wong" <darrick.wong@...cle.com>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com
Subject: [xfs] 3d46c44ae1: aim7.jobs-per-min -14.9% regression

Greeting,

FYI, we noticed a -14.9% regression of aim7.jobs-per-min due to commit:


commit: 3d46c44ae16bada5457adf9baffd4d19a611e6eb ("xfs: deferred inode inactivation")
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git widen-efi-and-bui-formats


in testcase: aim7
on test machine: 96 threads Intel(R) Xeon(R) Platinum 8260L CPU @ 2.40GHz with 128G memory
with following parameters:

	disk: 4BRD_12G
	md: RAID0
	fs: xfs
	test: disk_src
	load: 3000
	cpufreq_governor: performance
	ucode: 0x4002f01

test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/



If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/4BRD_12G/xfs/x86_64-rhel-8.3/3000/RAID0/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp2/disk_src/aim7/0x4002f01

commit: 
  6ff8d9ff6c ("xfs: track unlinked inactive inode quota counters")
  3d46c44ae1 ("xfs: deferred inode inactivation")

6ff8d9ff6c3b720d 3d46c44ae16bada5457adf9baff 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
           :4          100%           4:4     kmsg.XFS(md#):xlog_verify_grant_tail:space>BBTOB(tail_blocks)
         %stddev     %change         %stddev
             \          |                \  
    111493           -14.9%      94900        aim7.jobs-per-min
    161.74           +17.5%     190.00        aim7.time.elapsed_time
    161.74           +17.5%     190.00        aim7.time.elapsed_time.max
    800.00 ±  5%   +2101.8%      17614 ±  9%  aim7.time.file_system_inputs
      2280          +104.0%       4653 ±  3%  aim7.time.involuntary_context_switches
    992.23           +91.9%       1904 ±  2%  aim7.time.system_time
     28.15            +7.8%      30.34        aim7.time.user_time
  15880026           -59.0%    6507495        aim7.time.voluntary_context_switches
    197.48           +14.6%     226.23        uptime.boot
    826246 ± 27%     -47.5%     433755 ± 12%  cpuidle.POLL.time
    122345 ± 21%     -36.8%      77325 ± 10%  cpuidle.POLL.usage
     92.82            -5.1%      88.07        iostat.cpu.idle
      6.93           +68.8%      11.69 ±  2%  iostat.cpu.system
      6.17            +4.7       10.90 ±  2%  mpstat.cpu.all.sys%
      0.25 ±  2%      -0.0        0.23 ±  2%  mpstat.cpu.all.usr%
    349603 ± 23%    +471.6%    1998277 ±  4%  numa-numastat.node0.local_node
    357415 ± 19%    +462.6%    2010740 ±  4%  numa-numastat.node0.numa_hit
    227428 ± 36%    +830.9%    2117091 ±  4%  numa-numastat.node1.local_node
    250802 ± 28%    +751.6%    2135800 ±  4%  numa-numastat.node1.numa_hit
     92.25            -4.9%      87.75        vmstat.cpu.id
     14928          +476.9%      86115        vmstat.io.bo
   1190004          +436.5%    6384503        vmstat.memory.cache
      6.00           +75.0%      10.50 ± 10%  vmstat.procs.r
    195934           -42.1%     113386        vmstat.system.cs
     17877           +31.3%      23476 ±  5%  meminfo.Active
     17558           +30.6%      22931 ±  4%  meminfo.Active(anon)
    136139         +3792.2%    5298781        meminfo.KReclaimable
   2614245          +442.2%   14175202        meminfo.Memused
    136139         +3792.2%    5298781        meminfo.SReclaimable
    313373          +607.1%    2215765        meminfo.SUnreclaim
     27271           +20.7%      32916 ±  2%  meminfo.Shmem
    449513         +1571.7%    7514546        meminfo.Slab
    193847           +32.4%     256701        meminfo.VmallocUsed
     16900          +717.4%     138148        meminfo.max_used_kB
     19001 ± 18%   +3256.3%     637750 ±  7%  numa-vmstat.node0.nr_slab_reclaimable
     48148 ± 26%    +450.6%     265091 ±  9%  numa-vmstat.node0.nr_slab_unreclaimable
    961895 ± 12%     +84.2%    1771836 ±  2%  numa-vmstat.node0.numa_hit
    919259 ± 20%     +80.8%    1662229 ±  3%  numa-vmstat.node0.numa_local
      3255 ± 16%     +47.8%       4812 ± 12%  numa-vmstat.node1.nr_active_anon
  16216651            -9.5%   14678398        numa-vmstat.node1.nr_free_pages
     15065 ± 23%   +4464.5%     687661 ±  7%  numa-vmstat.node1.nr_slab_reclaimable
     30289 ± 43%    +855.3%     289355 ±  8%  numa-vmstat.node1.nr_slab_unreclaimable
      3255 ± 16%     +47.8%       4812 ± 12%  numa-vmstat.node1.nr_zone_active_anon
    708001 ± 16%    +123.8%    1584655 ±  2%  numa-vmstat.node1.numa_hit
    570169 ± 31%    +165.5%    1513837 ±  2%  numa-vmstat.node1.numa_local
     75956 ± 18%   +3259.9%    2552057 ±  7%  numa-meminfo.node0.KReclaimable
   1468060 ± 18%    +368.8%    6882287 ±  8%  numa-meminfo.node0.MemUsed
     75956 ± 18%   +3259.9%    2552057 ±  7%  numa-meminfo.node0.SReclaimable
    192399 ± 26%    +451.1%    1060381 ±  9%  numa-meminfo.node0.SUnreclaim
    268356 ± 24%   +1246.1%    3612438 ±  8%  numa-meminfo.node0.Slab
     13114 ± 16%     +48.5%      19474 ± 13%  numa-meminfo.node1.Active
     13035 ± 16%     +47.8%      19259 ± 12%  numa-meminfo.node1.Active(anon)
     60231 ± 23%   +4468.3%    2751543 ±  6%  numa-meminfo.node1.KReclaimable
  64866962            -9.5%   58710276        numa-meminfo.node1.MemFree
   1146768 ± 22%    +536.9%    7303454 ±  7%  numa-meminfo.node1.MemUsed
     60231 ± 23%   +4468.3%    2751543 ±  6%  numa-meminfo.node1.SReclaimable
    121085 ± 43%    +855.6%    1157054 ±  8%  numa-meminfo.node1.SUnreclaim
    181316 ± 36%   +2055.7%    3908598 ±  7%  numa-meminfo.node1.Slab
      4387           +30.7%       5733 ±  4%  proc-vmstat.nr_active_anon
    123103            +1.8%     125272        proc-vmstat.nr_anon_pages
   3206734            -9.0%    2917768        proc-vmstat.nr_dirty_background_threshold
   6421310            -9.0%    5842672        proc-vmstat.nr_dirty_threshold
  32268622            -9.0%   29374658        proc-vmstat.nr_free_pages
    125346            +1.8%     127584        proc-vmstat.nr_inactive_anon
      6815           +20.7%       8229 ±  2%  proc-vmstat.nr_shmem
     34053         +3795.6%    1326553        proc-vmstat.nr_slab_reclaimable
     78397          +607.4%     554614        proc-vmstat.nr_slab_unreclaimable
      4387           +30.7%       5733 ±  4%  proc-vmstat.nr_zone_active_anon
    125346            +1.8%     127584        proc-vmstat.nr_zone_inactive_anon
    637271 ±  2%    +555.5%    4177305        proc-vmstat.numa_hit
    605992 ±  2%    +584.2%    4146039        proc-vmstat.numa_local
      3732           +38.9%       5184 ±  6%  proc-vmstat.pgactivate
    794675          +832.3%    7409120        proc-vmstat.pgalloc_normal
    671147           +13.3%     760137        proc-vmstat.pgfault
    780944 ±  4%     +76.5%    1378751 ±  2%  proc-vmstat.pgfree
    400.00 ±  5%   +2152.8%       9011 ± 11%  proc-vmstat.pgpgin
   2459044          +573.6%   16563726        proc-vmstat.pgpgout
     33022           +17.3%      38734 ±  2%  proc-vmstat.pgreuse
     24247           +11.1%      26931        slabinfo.filp.active_objs
     24545           +11.0%      27246        slabinfo.filp.num_objs
      5283           +38.3%       7308 ±  2%  slabinfo.kmalloc-128.active_objs
      5285           +38.8%       7337 ±  2%  slabinfo.kmalloc-128.num_objs
     35844        +11796.9%    4264371        slabinfo.kmalloc-16.active_objs
    142.75        +11569.5%      16658        slabinfo.kmalloc-16.active_slabs
     36544        +11569.9%    4264664        slabinfo.kmalloc-16.num_objs
    142.75        +11569.5%      16658        slabinfo.kmalloc-16.num_slabs
      9205 ±  4%   +1433.7%     141177        slabinfo.kmalloc-256.active_objs
    288.75 ±  3%   +1427.8%       4411        slabinfo.kmalloc-256.active_slabs
      9251 ±  3%   +1426.1%     141181        slabinfo.kmalloc-256.num_objs
    288.75 ±  3%   +1427.8%       4411        slabinfo.kmalloc-256.num_slabs
     77048          +167.2%     205901        slabinfo.kmalloc-32.active_objs
    603.25          +166.6%       1608        slabinfo.kmalloc-32.active_slabs
     77278          +166.5%     205917        slabinfo.kmalloc-32.num_objs
    603.25          +166.6%       1608        slabinfo.kmalloc-32.num_slabs
      2094           +38.1%       2891        slabinfo.kmalloc-4k.active_objs
      2133           +37.5%       2934        slabinfo.kmalloc-4k.num_objs
     31901        +11207.0%    3607082        slabinfo.kmalloc-512.active_objs
      1011        +11053.0%     112756        slabinfo.kmalloc-512.active_slabs
     32363        +11049.1%    3608227        slabinfo.kmalloc-512.num_objs
      1011        +11053.0%     112756        slabinfo.kmalloc-512.num_slabs
      1294           +15.6%       1496        slabinfo.kmalloc-8k.active_objs
      1315           +20.1%       1579        slabinfo.kmalloc-8k.num_objs
      2955 ±  8%     +18.3%       3497 ± 14%  slabinfo.kmalloc-rcl-96.active_objs
      5710          +509.8%      34824        slabinfo.numa_policy.active_objs
     91.75          +511.7%     561.25        slabinfo.numa_policy.active_slabs
      5710          +510.1%      34837        slabinfo.numa_policy.num_objs
     91.75          +511.7%     561.25        slabinfo.numa_policy.num_slabs
     17148          +443.8%      93253        slabinfo.radix_tree_node.active_objs
    305.50          +447.1%       1671        slabinfo.radix_tree_node.active_slabs
     17148          +445.9%      93614        slabinfo.radix_tree_node.num_objs
    305.50          +447.1%       1671        slabinfo.radix_tree_node.num_slabs
      3863         +3395.6%     135033        slabinfo.xfs_buf.active_objs
     91.50         +3413.4%       3214        slabinfo.xfs_buf.active_slabs
      3863         +3395.8%     135041        slabinfo.xfs_buf.num_objs
     91.50         +3413.4%       3214        slabinfo.xfs_buf.num_slabs
      3286           +14.2%       3754 ±  2%  slabinfo.xfs_efd_item.active_objs
      3286           +14.2%       3754 ±  2%  slabinfo.xfs_efd_item.num_objs
      3374           +13.3%       3823 ±  2%  slabinfo.xfs_efi_item.active_objs
      3374           +13.3%       3823 ±  2%  slabinfo.xfs_efi_item.num_objs
      4768 ±  3%  +89536.8%    4274553        slabinfo.xfs_ili.active_objs
    131.75 ±  3%  +77271.0%     101936        slabinfo.xfs_ili.active_slabs
      5552 ±  3%  +77006.6%    4281344        slabinfo.xfs_ili.num_objs
    131.75 ±  3%  +77271.0%     101936        slabinfo.xfs_ili.num_slabs
      3679        +1.2e+05%    4274082        slabinfo.xfs_inode.active_objs
    166.25 ±  3%  +80367.5%     133777        slabinfo.xfs_inode.active_slabs
      5332 ±  3%  +80186.7%    4280886        slabinfo.xfs_inode.num_objs
    166.25 ±  3%  +80367.5%     133777        slabinfo.xfs_inode.num_slabs
      3882          +192.1%      11340 ±  2%  sched_debug.cfs_rq:/.exec_clock.avg
      6473 ±  5%    +448.3%      35490        sched_debug.cfs_rq:/.exec_clock.max
      3430 ±  2%    +146.1%       8443 ±  8%  sched_debug.cfs_rq:/.exec_clock.min
    399.38 ±  5%    +576.4%       2701        sched_debug.cfs_rq:/.exec_clock.stddev
     12857 ± 24%    +497.3%      76800 ±133%  sched_debug.cfs_rq:/.load.avg
     46348 ±  5%    +877.7%     453155 ±  4%  sched_debug.cfs_rq:/.min_vruntime.avg
    134257 ±  7%    +304.5%     543112 ±  5%  sched_debug.cfs_rq:/.min_vruntime.max
     37422 ±  7%    +900.4%     374377 ±  7%  sched_debug.cfs_rq:/.min_vruntime.min
     11844 ±  6%     +52.8%      18101 ±  3%  sched_debug.cfs_rq:/.min_vruntime.stddev
      0.07 ± 51%    +936.5%       0.70 ± 51%  sched_debug.cfs_rq:/.nr_spread_over.avg
      1.17 ± 47%   +1041.1%      13.31 ± 52%  sched_debug.cfs_rq:/.nr_spread_over.max
      0.21 ± 41%    +933.1%       2.15 ± 49%  sched_debug.cfs_rq:/.nr_spread_over.stddev
    331.08 ±  2%     -42.1%     191.69 ± 57%  sched_debug.cfs_rq:/.removed.load_avg.max
    171.24 ±  5%     -15.1%     145.38 ±  3%  sched_debug.cfs_rq:/.runnable_avg.stddev
     -8799          +670.3%     -67785        sched_debug.cfs_rq:/.spread0.min
     11845 ±  6%     +52.8%      18102 ±  3%  sched_debug.cfs_rq:/.spread0.stddev
    171.24 ±  5%     -15.2%     145.20 ±  3%  sched_debug.cfs_rq:/.util_avg.stddev
    616592 ±  6%     +20.7%     744528        sched_debug.cpu.avg_idle.avg
    318623 ± 11%     -36.8%     201311        sched_debug.cpu.avg_idle.stddev
     94746           +32.3%     125334        sched_debug.cpu.clock.avg
     94774           +32.3%     125361        sched_debug.cpu.clock.max
     94718           +32.3%     125306        sched_debug.cpu.clock.min
     94099           +32.2%     124383        sched_debug.cpu.clock_task.avg
     94296           +32.2%     124652        sched_debug.cpu.clock_task.max
     88926           +34.2%     119364        sched_debug.cpu.clock_task.min
      6240           +16.2%       7251        sched_debug.cpu.curr->pid.max
      1149            +9.6%       1259 ±  5%  sched_debug.cpu.curr->pid.stddev
    118673           -13.0%     103206        sched_debug.cpu.nr_switches.avg
    135464 ±  2%   +2140.6%    3035160        sched_debug.cpu.nr_switches.max
    107635           -71.3%      30849 ± 10%  sched_debug.cpu.nr_switches.min
      5062 ±  5%   +5846.1%     301038        sched_debug.cpu.nr_switches.stddev
     20.79           +11.3%      23.14        sched_debug.cpu.nr_uninterruptible.avg
     63.25 ±  6%     +42.7%      90.25 ± 19%  sched_debug.cpu.nr_uninterruptible.max
    -16.75          +488.8%     -98.62        sched_debug.cpu.nr_uninterruptible.min
     16.40 ± 11%     +39.3%      22.86 ±  8%  sched_debug.cpu.nr_uninterruptible.stddev
    116957           -13.2%     101495        sched_debug.cpu.sched_count.avg
    128395 ±  2%   +2260.7%    3031062        sched_debug.cpu.sched_count.max
    106410           -71.9%      29881 ± 11%  sched_debug.cpu.sched_count.min
      4473 ±  4%   +6622.3%     300702        sched_debug.cpu.sched_count.stddev
     57929           -19.6%      46573        sched_debug.cpu.sched_goidle.avg
     63728 ±  2%   +2248.0%    1496328        sched_debug.cpu.sched_goidle.max
     52542           -80.9%      10035 ±  4%  sched_debug.cpu.sched_goidle.min
      2301 ±  4%   +6365.6%     148810        sched_debug.cpu.sched_goidle.stddev
     62958           -17.0%      52283        sched_debug.cpu.ttwu_count.avg
     69397         +1754.0%    1286635        sched_debug.cpu.ttwu_count.max
     57245 ±  2%     -69.4%      17508 ± 12%  sched_debug.cpu.ttwu_count.min
      2410 ±  3%   +5161.5%     126833        sched_debug.cpu.ttwu_count.stddev
      1034          +405.8%       5233        sched_debug.cpu.ttwu_local.avg
      2257 ±  6%    +390.1%      11063 ±  7%  sched_debug.cpu.ttwu_local.max
    546.67 ±  6%    +277.8%       2065 ±  5%  sched_debug.cpu.ttwu_local.min
    315.04 ±  4%    +457.1%       1755 ±  2%  sched_debug.cpu.ttwu_local.stddev
     94719           +32.3%     125305        sched_debug.cpu_clk
     94223           +32.5%     124809        sched_debug.ktime
     95059           +32.2%     125660        sched_debug.sched_clk
      5.13 ±  5%     +14.6%       5.88 ±  3%  perf-stat.i.MPKI
 4.117e+09            +2.7%  4.227e+09        perf-stat.i.branch-instructions
      1.16 ±  2%      -0.1        1.05 ±  4%  perf-stat.i.branch-miss-rate%
  40109047           -16.0%   33684176 ±  2%  perf-stat.i.branch-misses
     25.90            +3.7       29.60        perf-stat.i.cache-miss-rate%
  27416382           +19.2%   32682698        perf-stat.i.cache-misses
 1.026e+08            +4.5%  1.072e+08 ±  2%  perf-stat.i.cache-references
    198400           -42.2%     114576        perf-stat.i.context-switches
      1.15           +27.6%       1.47        perf-stat.i.cpi
 2.315e+10 ±  2%     +56.1%  3.613e+10        perf-stat.i.cpu-cycles
      5782           -44.2%       3228 ±  3%  perf-stat.i.cpu-migrations
      0.04 ±  8%      +0.0        0.06 ±  6%  perf-stat.i.dTLB-load-miss-rate%
   1997198 ±  4%     +41.5%    2826836 ± 15%  perf-stat.i.dTLB-load-misses
 4.792e+09            +4.0%  4.984e+09        perf-stat.i.dTLB-loads
      0.01 ± 12%      +0.0        0.01 ± 12%  perf-stat.i.dTLB-store-miss-rate%
    148773 ±  7%     +18.6%     176378 ±  8%  perf-stat.i.dTLB-store-misses
 2.023e+09           -19.7%  1.623e+09        perf-stat.i.dTLB-stores
   9061470 ±  3%     -23.8%    6908878        perf-stat.i.iTLB-load-misses
  10017941 ±  3%     -28.5%    7161573 ±  2%  perf-stat.i.iTLB-loads
 2.041e+10            +2.3%  2.087e+10        perf-stat.i.instructions
      2334 ±  4%     +33.4%       3114        perf-stat.i.instructions-per-iTLB-miss
      0.88           -17.5%       0.72        perf-stat.i.ipc
      4.05 ± 32%     -61.5%       1.56 ± 11%  perf-stat.i.major-faults
      0.24 ±  2%     +56.0%       0.38        perf-stat.i.metric.GHz
      3912            -2.7%       3805        perf-stat.i.minor-faults
     88.59            -7.8       80.76        perf-stat.i.node-load-miss-rate%
   9996590            +2.4%   10235688        perf-stat.i.node-load-misses
   1213853           +99.9%    2426117        perf-stat.i.node-loads
     91.79           -20.3       71.45        perf-stat.i.node-store-miss-rate%
   4034356            +6.2%    4283281        perf-stat.i.node-store-misses
    286882 ±  2%    +480.4%    1665087        perf-stat.i.node-stores
      3916            -2.8%       3806        perf-stat.i.page-faults
      0.98            -0.2        0.79 ±  3%  perf-stat.overall.branch-miss-rate%
     26.72            +3.8       30.50        perf-stat.overall.cache-miss-rate%
      1.13           +53.7%       1.74        perf-stat.overall.cpi
    844.64 ±  2%     +32.7%       1121        perf-stat.overall.cycles-between-cache-misses
      0.04 ±  4%      +0.0        0.06 ± 15%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ±  6%      +0.0        0.01 ±  8%  perf-stat.overall.dTLB-store-miss-rate%
     47.49            +1.6       49.09        perf-stat.overall.iTLB-load-miss-rate%
      2255 ±  3%     +34.9%       3043        perf-stat.overall.instructions-per-iTLB-miss
      0.88           -35.0%       0.57        perf-stat.overall.ipc
     89.17            -8.3       80.85        perf-stat.overall.node-load-miss-rate%
     93.35           -21.3       72.02        perf-stat.overall.node-store-miss-rate%
 4.088e+09            +3.6%  4.233e+09        perf-stat.ps.branch-instructions
  39855776           -15.9%   33516766 ±  2%  perf-stat.ps.branch-misses
  27217504           +19.5%   32519633        perf-stat.ps.cache-misses
 1.019e+08            +4.7%  1.067e+08 ±  2%  perf-stat.ps.cache-references
    196917           -42.2%     113732        perf-stat.ps.context-switches
 2.299e+10 ±  2%     +58.6%  3.646e+10        perf-stat.ps.cpu-cycles
      5740           -44.0%       3213 ±  3%  perf-stat.ps.cpu-migrations
   1982707 ±  4%     +42.5%    2825818 ± 16%  perf-stat.ps.dTLB-load-misses
 4.757e+09            +5.0%  4.995e+09        perf-stat.ps.dTLB-loads
    147811 ±  7%     +18.7%     175395 ±  8%  perf-stat.ps.dTLB-store-misses
 2.008e+09           -19.5%  1.616e+09        perf-stat.ps.dTLB-stores
   8994708 ±  3%     -23.6%    6869062        perf-stat.ps.iTLB-load-misses
   9944571 ±  3%     -28.3%    7125456 ±  2%  perf-stat.ps.iTLB-loads
 2.026e+10            +3.2%   2.09e+10        perf-stat.ps.instructions
      4.02 ± 32%     -61.6%       1.55 ± 11%  perf-stat.ps.major-faults
      3906            -3.1%       3786        perf-stat.ps.minor-faults
   9922444            +2.6%   10184738        perf-stat.ps.node-load-misses
   1205247          +100.1%    2412267        perf-stat.ps.node-loads
   4004482            +6.4%    4262574        perf-stat.ps.node-store-misses
    285041 ±  2%    +480.9%    1655795        perf-stat.ps.node-stores
      3910            -3.1%       3788        perf-stat.ps.page-faults
 3.296e+12           +21.1%  3.991e+12        perf-stat.total.instructions
     25468 ±  2%     +15.6%      29446        softirqs.CPU0.SCHED
     22520           +12.1%      25242        softirqs.CPU11.SCHED
     22068 ±  2%     +14.4%      25243        softirqs.CPU13.SCHED
     22452           +12.6%      25276 ±  2%  softirqs.CPU14.SCHED
     21953 ±  4%     +14.5%      25137        softirqs.CPU15.SCHED
     22394 ±  2%     +13.0%      25307 ±  4%  softirqs.CPU17.SCHED
     22283           +15.1%      25638 ±  3%  softirqs.CPU18.SCHED
     22391 ±  3%     +11.5%      24962 ±  3%  softirqs.CPU19.SCHED
     21679 ±  7%     +18.7%      25730 ±  3%  softirqs.CPU2.SCHED
     22407 ±  3%     +13.5%      25442        softirqs.CPU21.SCHED
     21874 ±  3%     +14.9%      25141        softirqs.CPU22.SCHED
     22707           +11.5%      25311        softirqs.CPU23.SCHED
     22999 ±  2%     +10.8%      25478        softirqs.CPU24.SCHED
     22476 ±  2%     +14.1%      25643 ±  5%  softirqs.CPU25.SCHED
     32159 ±  2%     +13.7%      36549 ±  6%  softirqs.CPU26.RCU
     22260 ±  3%     +13.0%      25150        softirqs.CPU26.SCHED
     22723           +12.7%      25603 ±  2%  softirqs.CPU27.SCHED
     22468           +13.3%      25454        softirqs.CPU28.SCHED
     22419           +13.0%      25327        softirqs.CPU29.SCHED
     22299           +14.2%      25473        softirqs.CPU3.SCHED
     21929 ±  3%     +15.8%      25388        softirqs.CPU30.SCHED
     30229           +10.9%      33538        softirqs.CPU32.RCU
     29213 ±  4%     +14.6%      33490 ±  2%  softirqs.CPU33.RCU
     22106           +12.2%      24814        softirqs.CPU33.SCHED
     21988 ±  2%     +12.7%      24774 ±  2%  softirqs.CPU34.SCHED
     22055           +13.6%      25064        softirqs.CPU35.SCHED
     30957 ±  2%     +14.0%      35286 ±  5%  softirqs.CPU37.RCU
     22361           +17.6%      26290 ±  7%  softirqs.CPU37.SCHED
     30798 ±  3%     +12.5%      34653 ±  6%  softirqs.CPU38.RCU
     22199 ±  2%     +13.0%      25093        softirqs.CPU38.SCHED
     21635 ±  4%     +17.4%      25391 ±  2%  softirqs.CPU39.SCHED
     21557 ±  8%     +17.3%      25296        softirqs.CPU4.SCHED
     31515 ±  2%      +9.6%      34543        softirqs.CPU40.RCU
     22559           +10.0%      24812 ±  2%  softirqs.CPU40.SCHED
     21913 ±  4%     +15.4%      25289        softirqs.CPU41.SCHED
     31549 ±  2%      +9.5%      34556        softirqs.CPU42.RCU
     22188 ±  2%     +17.7%      26122 ±  5%  softirqs.CPU43.SCHED
     22331 ±  2%     +13.5%      25353 ±  2%  softirqs.CPU44.SCHED
     31136 ±  2%     +11.3%      34667 ±  3%  softirqs.CPU45.RCU
     21549 ±  5%     +16.5%      25115 ±  2%  softirqs.CPU45.SCHED
     31102           +10.7%      34430 ±  3%  softirqs.CPU46.RCU
     22378 ±  2%     +12.4%      25159        softirqs.CPU46.SCHED
     31151           +10.3%      34369 ±  2%  softirqs.CPU47.RCU
     21481 ±  4%     +14.3%      24564        softirqs.CPU48.SCHED
     21872           +12.2%      24534        softirqs.CPU49.SCHED
     22643           +12.7%      25525        softirqs.CPU5.SCHED
     22069 ±  2%     +12.4%      24795 ±  2%  softirqs.CPU51.SCHED
     22069           +13.7%      25092        softirqs.CPU53.SCHED
     22477           +10.7%      24880 ±  2%  softirqs.CPU54.SCHED
     22064           +12.4%      24797        softirqs.CPU55.SCHED
     21856 ±  2%     +14.1%      24929 ±  2%  softirqs.CPU56.SCHED
     22278 ±  3%     +11.5%      24846        softirqs.CPU58.SCHED
     21928           +13.1%      24810        softirqs.CPU59.SCHED
     22389           +12.5%      25187 ±  2%  softirqs.CPU6.SCHED
     21971           +11.3%      24463 ±  3%  softirqs.CPU61.SCHED
     22510 ±  2%     +10.2%      24795 ±  2%  softirqs.CPU62.SCHED
     21502 ±  2%     +13.2%      24350 ±  2%  softirqs.CPU63.SCHED
     22377           +12.4%      25162        softirqs.CPU64.SCHED
     22087 ±  3%     +12.8%      24924 ±  2%  softirqs.CPU65.SCHED
     22407           +11.7%      25027 ±  3%  softirqs.CPU67.SCHED
     22343           +17.1%      26165 ± 10%  softirqs.CPU68.SCHED
     22431           +14.1%      25597 ±  4%  softirqs.CPU69.SCHED
     22223 ±  3%     +11.9%      24877 ±  3%  softirqs.CPU7.SCHED
     22315 ±  2%     +13.4%      25309 ±  3%  softirqs.CPU70.SCHED
     22025 ±  4%     +13.7%      25036        softirqs.CPU71.SCHED
     22277           +12.5%      25061        softirqs.CPU74.SCHED
     21710 ±  4%     +13.4%      24623        softirqs.CPU76.SCHED
     22626           +10.7%      25048        softirqs.CPU77.SCHED
     22117 ±  2%     +11.2%      24585        softirqs.CPU79.SCHED
     22450           +12.7%      25299        softirqs.CPU8.SCHED
     30665           +10.6%      33914 ±  2%  softirqs.CPU80.RCU
     22144           +11.3%      24653        softirqs.CPU80.SCHED
     29232 ±  3%     +13.7%      33248        softirqs.CPU81.RCU
     22544 ±  3%     +11.0%      25024 ±  2%  softirqs.CPU81.SCHED
     22088           +11.1%      24534 ±  2%  softirqs.CPU82.SCHED
     30843           +10.2%      33995        softirqs.CPU83.RCU
     31052           +11.0%      34464 ±  3%  softirqs.CPU84.RCU
     22243           +17.4%      26111 ± 10%  softirqs.CPU84.SCHED
     30208 ±  3%     +13.2%      34199 ±  5%  softirqs.CPU86.RCU
     21853 ±  2%     +14.6%      25054 ±  2%  softirqs.CPU86.SCHED
     21979 ±  2%     +12.7%      24776 ±  2%  softirqs.CPU87.SCHED
     22324            +8.9%      24316        softirqs.CPU88.SCHED
     30518           +11.6%      34061        softirqs.CPU89.RCU
     22242 ±  7%     +12.1%      24941 ±  2%  softirqs.CPU89.SCHED
     22323 ±  2%     +12.0%      24997 ±  2%  softirqs.CPU9.SCHED
     31035           +10.0%      34146        softirqs.CPU90.RCU
     22411           +12.1%      25114        softirqs.CPU90.SCHED
     30065           +10.2%      33128        softirqs.CPU91.RCU
     30605            +9.9%      33633        softirqs.CPU92.RCU
     22051 ±  3%     +12.0%      24697 ±  2%  softirqs.CPU92.SCHED
     30119           +11.3%      33520 ±  2%  softirqs.CPU93.RCU
     21972           +13.9%      25017        softirqs.CPU93.SCHED
     30967 ±  2%      +9.9%      34020 ±  2%  softirqs.CPU94.RCU
     22452 ±  3%     +10.6%      24839        softirqs.CPU94.SCHED
     30843            +9.7%      33830 ±  2%  softirqs.CPU95.RCU
      3673 ± 59%    +177.2%      10181 ± 60%  softirqs.NET_RX
   2139370           +11.9%    2393452        softirqs.SCHED
     37630           +12.5%      42331        softirqs.TIMER
    124.75 ± 13%   +1625.7%       2152 ±158%  interrupts.80:PCI-MSI.70260742-edge.eth3-TxRx-5
     99.25 ± 10%   +2848.1%       2926 ± 95%  interrupts.81:PCI-MSI.70260743-edge.eth3-TxRx-6
    100.25 ±  9%   +1463.3%       1567 ±148%  interrupts.82:PCI-MSI.70260744-edge.eth3-TxRx-7
    327.00           +17.1%     383.00        interrupts.9:IO-APIC.9-fasteoi.acpi
    267627 ±  2%     +88.0%     503263 ±  2%  interrupts.CAL:Function_call_interrupts
      3143 ± 18%     +61.8%       5088 ± 28%  interrupts.CPU0.CAL:Function_call_interrupts
    283663 ± 24%     +33.2%     377727 ±  2%  interrupts.CPU0.LOC:Local_timer_interrupts
    516.25 ± 18%     -42.1%     298.75 ± 28%  interrupts.CPU0.RES:Rescheduling_interrupts
    327.00           +17.1%     383.00        interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
      2853 ±  9%     +66.3%       4744 ± 33%  interrupts.CPU1.CAL:Function_call_interrupts
    283815 ± 24%     +33.0%     377386 ±  2%  interrupts.CPU1.LOC:Local_timer_interrupts
    939.50 ± 25%     +55.2%       1458 ±  6%  interrupts.CPU1.NMI:Non-maskable_interrupts
    939.50 ± 25%     +55.2%       1458 ±  6%  interrupts.CPU1.PMI:Performance_monitoring_interrupts
    460.50 ± 15%     -46.3%     247.25 ± 28%  interrupts.CPU1.RES:Rescheduling_interrupts
      2901 ±  7%     +49.5%       4338 ± 23%  interrupts.CPU10.CAL:Function_call_interrupts
    283674 ± 24%     +33.1%     377704 ±  2%  interrupts.CPU10.LOC:Local_timer_interrupts
    496.50 ± 25%     -56.1%     218.00 ± 18%  interrupts.CPU10.RES:Rescheduling_interrupts
      2932 ±  8%     +53.1%       4488 ± 19%  interrupts.CPU11.CAL:Function_call_interrupts
    283700 ± 24%     +33.1%     377549 ±  2%  interrupts.CPU11.LOC:Local_timer_interrupts
      1098 ±  8%     -34.1%     723.75 ±  7%  interrupts.CPU11.NMI:Non-maskable_interrupts
      1098 ±  8%     -34.1%     723.75 ±  7%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
    450.50 ± 20%     -49.9%     225.50 ± 17%  interrupts.CPU11.RES:Rescheduling_interrupts
      2957 ± 11%     +51.5%       4479 ± 24%  interrupts.CPU12.CAL:Function_call_interrupts
    283714 ± 24%     +33.1%     377654 ±  2%  interrupts.CPU12.LOC:Local_timer_interrupts
    508.00 ± 20%     -59.1%     208.00 ± 25%  interrupts.CPU12.RES:Rescheduling_interrupts
      2853 ±  8%     +54.6%       4410 ± 23%  interrupts.CPU13.CAL:Function_call_interrupts
    283781 ± 24%     +33.1%     377641 ±  2%  interrupts.CPU13.LOC:Local_timer_interrupts
    483.25 ± 20%     -57.7%     204.50 ± 22%  interrupts.CPU13.RES:Rescheduling_interrupts
    103.25 ±135%     -96.4%       3.75 ± 63%  interrupts.CPU13.TLB:TLB_shootdowns
      2909 ± 12%     +49.8%       4358 ± 20%  interrupts.CPU14.CAL:Function_call_interrupts
    283859 ± 24%     +33.1%     377702 ±  2%  interrupts.CPU14.LOC:Local_timer_interrupts
    477.50 ± 19%     -53.1%     223.75 ± 27%  interrupts.CPU14.RES:Rescheduling_interrupts
      2825 ± 11%     +51.9%       4292 ± 20%  interrupts.CPU15.CAL:Function_call_interrupts
    283769 ± 24%     +33.1%     377684 ±  2%  interrupts.CPU15.LOC:Local_timer_interrupts
    477.50 ± 21%     -54.0%     219.75 ± 19%  interrupts.CPU15.RES:Rescheduling_interrupts
      3030 ± 14%     +44.7%       4385 ± 20%  interrupts.CPU16.CAL:Function_call_interrupts
    283770 ± 24%     +33.1%     377633 ±  2%  interrupts.CPU16.LOC:Local_timer_interrupts
      1079 ±  5%     +43.3%       1547 ±  4%  interrupts.CPU16.NMI:Non-maskable_interrupts
      1079 ±  5%     +43.3%       1547 ±  4%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
    517.25 ± 27%     -57.3%     221.00 ± 21%  interrupts.CPU16.RES:Rescheduling_interrupts
      2974 ± 10%     +44.0%       4283 ± 19%  interrupts.CPU17.CAL:Function_call_interrupts
    283804 ± 24%     +33.1%     377693 ±  2%  interrupts.CPU17.LOC:Local_timer_interrupts
      1031 ±  4%     +40.8%       1451 ±  7%  interrupts.CPU17.NMI:Non-maskable_interrupts
      1031 ±  4%     +40.8%       1451 ±  7%  interrupts.CPU17.PMI:Performance_monitoring_interrupts
    468.50 ± 22%     -49.3%     237.50 ± 15%  interrupts.CPU17.RES:Rescheduling_interrupts
      2948 ± 10%     +46.0%       4305 ± 26%  interrupts.CPU18.CAL:Function_call_interrupts
    283799 ± 24%     +33.1%     377682 ±  2%  interrupts.CPU18.LOC:Local_timer_interrupts
    933.50 ± 24%     +50.3%       1403 ±  8%  interrupts.CPU18.NMI:Non-maskable_interrupts
    933.50 ± 24%     +50.3%       1403 ±  8%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
    506.25 ± 22%     -49.3%     256.50 ± 42%  interrupts.CPU18.RES:Rescheduling_interrupts
      2963 ± 14%     +51.1%       4478 ± 24%  interrupts.CPU19.CAL:Function_call_interrupts
    283910 ± 24%     +32.9%     377456 ±  2%  interrupts.CPU19.LOC:Local_timer_interrupts
      1104 ±  4%     +29.8%       1433 ±  9%  interrupts.CPU19.NMI:Non-maskable_interrupts
      1104 ±  4%     +29.8%       1433 ±  9%  interrupts.CPU19.PMI:Performance_monitoring_interrupts
    468.25 ± 25%     -54.1%     215.00 ± 31%  interrupts.CPU19.RES:Rescheduling_interrupts
      2925 ± 12%     +60.9%       4707 ± 23%  interrupts.CPU2.CAL:Function_call_interrupts
    283509 ± 24%     +33.2%     377703 ±  2%  interrupts.CPU2.LOC:Local_timer_interrupts
    935.50 ± 27%     +53.4%       1435 ± 10%  interrupts.CPU2.NMI:Non-maskable_interrupts
    935.50 ± 27%     +53.4%       1435 ± 10%  interrupts.CPU2.PMI:Performance_monitoring_interrupts
    478.00 ± 25%     -53.9%     220.25 ± 37%  interrupts.CPU2.RES:Rescheduling_interrupts
    283790 ± 24%     +33.1%     377595 ±  2%  interrupts.CPU20.LOC:Local_timer_interrupts
    466.75 ± 17%     -57.1%     200.25 ± 15%  interrupts.CPU20.RES:Rescheduling_interrupts
      2903 ± 11%     +60.0%       4646 ± 28%  interrupts.CPU21.CAL:Function_call_interrupts
    283853 ± 24%     +33.0%     377395 ±  2%  interrupts.CPU21.LOC:Local_timer_interrupts
    456.75 ± 24%     -52.5%     216.75 ± 25%  interrupts.CPU21.RES:Rescheduling_interrupts
      2940 ± 11%     +56.0%       4586 ± 23%  interrupts.CPU22.CAL:Function_call_interrupts
    283798 ± 24%     +33.1%     377683 ±  2%  interrupts.CPU22.LOC:Local_timer_interrupts
    465.75 ± 21%     -52.8%     219.75 ± 28%  interrupts.CPU22.RES:Rescheduling_interrupts
      3163 ± 15%     +43.7%       4546 ± 19%  interrupts.CPU23.CAL:Function_call_interrupts
    283869 ± 24%     +33.0%     377457 ±  2%  interrupts.CPU23.LOC:Local_timer_interrupts
    484.50 ± 25%     -51.7%     234.25 ± 31%  interrupts.CPU23.RES:Rescheduling_interrupts
      2866 ±  6%     +88.1%       5392 ± 11%  interrupts.CPU24.CAL:Function_call_interrupts
    285207 ± 24%     +34.1%     382562        interrupts.CPU24.LOC:Local_timer_interrupts
      2500 ± 11%    +126.9%       5674 ± 14%  interrupts.CPU25.CAL:Function_call_interrupts
    285345 ± 24%     +34.1%     382766        interrupts.CPU25.LOC:Local_timer_interrupts
      2518 ±  9%    +125.5%       5678 ± 15%  interrupts.CPU26.CAL:Function_call_interrupts
    285477 ± 24%     +34.1%     382758        interrupts.CPU26.LOC:Local_timer_interrupts
    874.00 ± 26%     +71.1%       1495 ±  5%  interrupts.CPU26.NMI:Non-maskable_interrupts
    874.00 ± 26%     +71.1%       1495 ±  5%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
    471.50 ± 21%     -38.4%     290.50 ± 17%  interrupts.CPU26.RES:Rescheduling_interrupts
      2583 ±  5%    +116.3%       5588 ± 17%  interrupts.CPU27.CAL:Function_call_interrupts
    285510 ± 24%     +34.0%     382680        interrupts.CPU27.LOC:Local_timer_interrupts
      2645 ±  7%    +116.0%       5714 ± 13%  interrupts.CPU28.CAL:Function_call_interrupts
    285526 ± 24%     +34.1%     382784        interrupts.CPU28.LOC:Local_timer_interrupts
    465.00 ± 19%     -40.4%     277.00 ± 16%  interrupts.CPU28.RES:Rescheduling_interrupts
      2616 ±  6%    +121.2%       5788 ± 14%  interrupts.CPU29.CAL:Function_call_interrupts
    285531 ± 24%     +34.0%     382711        interrupts.CPU29.LOC:Local_timer_interrupts
      2898 ± 12%     +54.9%       4489 ± 24%  interrupts.CPU3.CAL:Function_call_interrupts
    283812 ± 24%     +33.1%     377637 ±  2%  interrupts.CPU3.LOC:Local_timer_interrupts
    874.25 ± 26%     +64.0%       1433 ± 13%  interrupts.CPU3.NMI:Non-maskable_interrupts
    874.25 ± 26%     +64.0%       1433 ± 13%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    486.75 ± 18%     -53.9%     224.50 ± 26%  interrupts.CPU3.RES:Rescheduling_interrupts
      2675 ±  5%    +119.1%       5862 ± 16%  interrupts.CPU30.CAL:Function_call_interrupts
    285568 ± 24%     +34.1%     382819        interrupts.CPU30.LOC:Local_timer_interrupts
    959.25 ± 26%     +57.0%       1505 ±  2%  interrupts.CPU30.NMI:Non-maskable_interrupts
    959.25 ± 26%     +57.0%       1505 ±  2%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
      2609 ±  7%    +114.3%       5591 ± 16%  interrupts.CPU31.CAL:Function_call_interrupts
    285405 ± 24%     +34.1%     382694        interrupts.CPU31.LOC:Local_timer_interrupts
      1092 ±  5%     +33.4%       1458 ±  6%  interrupts.CPU31.NMI:Non-maskable_interrupts
      1092 ±  5%     +33.4%       1458 ±  6%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
      2601 ±  9%    +112.5%       5527 ± 16%  interrupts.CPU32.CAL:Function_call_interrupts
    285418 ± 24%     +34.1%     382716        interrupts.CPU32.LOC:Local_timer_interrupts
    475.50 ± 21%     -44.2%     265.25 ± 17%  interrupts.CPU32.RES:Rescheduling_interrupts
      2567 ±  8%    +115.1%       5522 ± 17%  interrupts.CPU33.CAL:Function_call_interrupts
    285444 ± 24%     +34.1%     382745        interrupts.CPU33.LOC:Local_timer_interrupts
    487.00 ± 12%     -42.5%     280.25 ± 21%  interrupts.CPU33.RES:Rescheduling_interrupts
      2678 ±  8%    +104.7%       5484 ± 16%  interrupts.CPU34.CAL:Function_call_interrupts
    285478 ± 24%     +34.0%     382612        interrupts.CPU34.LOC:Local_timer_interrupts
    856.00 ± 39%     +76.9%       1514 ±  5%  interrupts.CPU34.NMI:Non-maskable_interrupts
    856.00 ± 39%     +76.9%       1514 ±  5%  interrupts.CPU34.PMI:Performance_monitoring_interrupts
    464.50 ± 18%     -38.3%     286.75 ± 19%  interrupts.CPU34.RES:Rescheduling_interrupts
      2645 ±  7%    +107.3%       5484 ± 15%  interrupts.CPU35.CAL:Function_call_interrupts
    285451 ± 24%     +34.0%     382477        interrupts.CPU35.LOC:Local_timer_interrupts
    473.50 ± 19%     -42.0%     274.75 ± 22%  interrupts.CPU35.RES:Rescheduling_interrupts
    285437 ± 24%     +34.0%     382469        interrupts.CPU36.LOC:Local_timer_interrupts
      1032 ±  4%     +44.4%       1490 ±  6%  interrupts.CPU36.NMI:Non-maskable_interrupts
      1032 ±  4%     +44.4%       1490 ±  6%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
    442.00 ± 20%     -50.5%     218.75 ± 35%  interrupts.CPU36.RES:Rescheduling_interrupts
      2600 ±  6%    +222.2%       8376 ± 61%  interrupts.CPU37.CAL:Function_call_interrupts
    285603 ± 24%     +34.0%     382750        interrupts.CPU37.LOC:Local_timer_interrupts
    972.00 ± 19%    +138.3%       2316 ± 49%  interrupts.CPU37.NMI:Non-maskable_interrupts
    972.00 ± 19%    +138.3%       2316 ± 49%  interrupts.CPU37.PMI:Performance_monitoring_interrupts
      2656 ±  9%    +146.6%       6551 ± 31%  interrupts.CPU38.CAL:Function_call_interrupts
    285598 ± 24%     +34.0%     382721        interrupts.CPU38.LOC:Local_timer_interrupts
      2610 ±  8%    +142.0%       6316 ± 25%  interrupts.CPU39.CAL:Function_call_interrupts
    285693 ± 24%     +34.0%     382759        interrupts.CPU39.LOC:Local_timer_interrupts
    978.00 ± 30%     +62.6%       1590        interrupts.CPU39.NMI:Non-maskable_interrupts
    978.00 ± 30%     +62.6%       1590        interrupts.CPU39.PMI:Performance_monitoring_interrupts
      3015 ± 12%     +49.4%       4506 ± 27%  interrupts.CPU4.CAL:Function_call_interrupts
    283860 ± 24%     +33.0%     377624 ±  2%  interrupts.CPU4.LOC:Local_timer_interrupts
    904.75 ± 27%     +62.0%       1465 ±  8%  interrupts.CPU4.NMI:Non-maskable_interrupts
    904.75 ± 27%     +62.0%       1465 ±  8%  interrupts.CPU4.PMI:Performance_monitoring_interrupts
    504.25 ± 24%     -49.7%     253.50 ± 17%  interrupts.CPU4.RES:Rescheduling_interrupts
      2617 ±  9%    +130.2%       6024 ± 22%  interrupts.CPU40.CAL:Function_call_interrupts
    285610 ± 24%     +34.0%     382744        interrupts.CPU40.LOC:Local_timer_interrupts
      1120 ± 11%     +36.3%       1527 ±  7%  interrupts.CPU40.NMI:Non-maskable_interrupts
      1120 ± 11%     +36.3%       1527 ±  7%  interrupts.CPU40.PMI:Performance_monitoring_interrupts
      2681 ±  6%    +119.7%       5891 ± 19%  interrupts.CPU41.CAL:Function_call_interrupts
    285448 ± 24%     +34.1%     382806        interrupts.CPU41.LOC:Local_timer_interrupts
    913.25 ± 27%     +64.5%       1502 ±  8%  interrupts.CPU41.NMI:Non-maskable_interrupts
    913.25 ± 27%     +64.5%       1502 ±  8%  interrupts.CPU41.PMI:Performance_monitoring_interrupts
      2820 ±  9%    +102.9%       5722 ± 16%  interrupts.CPU42.CAL:Function_call_interrupts
    285565 ± 24%     +34.0%     382783        interrupts.CPU42.LOC:Local_timer_interrupts
      1023 ±  6%     +45.5%       1489 ±  8%  interrupts.CPU42.NMI:Non-maskable_interrupts
      1023 ±  6%     +45.5%       1489 ±  8%  interrupts.CPU42.PMI:Performance_monitoring_interrupts
      2639 ±  6%    +247.5%       9169 ± 70%  interrupts.CPU43.CAL:Function_call_interrupts
    285657 ± 24%     +34.0%     382691        interrupts.CPU43.LOC:Local_timer_interrupts
    920.50 ± 25%    +136.0%       2172 ± 53%  interrupts.CPU43.NMI:Non-maskable_interrupts
    920.50 ± 25%    +136.0%       2172 ± 53%  interrupts.CPU43.PMI:Performance_monitoring_interrupts
      2752 ±  8%    +142.8%       6681 ± 30%  interrupts.CPU44.CAL:Function_call_interrupts
    285668 ± 24%     +34.0%     382755        interrupts.CPU44.LOC:Local_timer_interrupts
      2604 ±  8%    +140.1%       6254 ± 26%  interrupts.CPU45.CAL:Function_call_interrupts
    285625 ± 24%     +34.0%     382693        interrupts.CPU45.LOC:Local_timer_interrupts
      1031 ±  3%     +52.1%       1568 ± 10%  interrupts.CPU45.NMI:Non-maskable_interrupts
      1031 ±  3%     +52.1%       1568 ± 10%  interrupts.CPU45.PMI:Performance_monitoring_interrupts
    475.50 ± 20%     -32.8%     319.50 ± 37%  interrupts.CPU45.RES:Rescheduling_interrupts
      2644 ±  9%    +124.5%       5936 ± 19%  interrupts.CPU46.CAL:Function_call_interrupts
    285443 ± 24%     +34.1%     382810        interrupts.CPU46.LOC:Local_timer_interrupts
    909.50 ± 24%     +69.0%       1536 ±  6%  interrupts.CPU46.NMI:Non-maskable_interrupts
    909.50 ± 24%     +69.0%       1536 ±  6%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
    468.75 ± 17%     -41.1%     276.00 ± 23%  interrupts.CPU46.RES:Rescheduling_interrupts
      2652 ±  6%    +116.4%       5740 ± 14%  interrupts.CPU47.CAL:Function_call_interrupts
    285279 ± 24%     +34.2%     382815        interrupts.CPU47.LOC:Local_timer_interrupts
    704.25 ± 33%    +123.6%       1574 ±  4%  interrupts.CPU47.NMI:Non-maskable_interrupts
    704.25 ± 33%    +123.6%       1574 ±  4%  interrupts.CPU47.PMI:Performance_monitoring_interrupts
      2888 ±  8%     +50.8%       4356 ± 22%  interrupts.CPU48.CAL:Function_call_interrupts
    284068 ± 24%     +32.9%     377429 ±  2%  interrupts.CPU48.LOC:Local_timer_interrupts
    472.25 ± 21%     -54.0%     217.00 ± 25%  interrupts.CPU48.RES:Rescheduling_interrupts
      2931 ±  8%     +51.1%       4429 ± 25%  interrupts.CPU49.CAL:Function_call_interrupts
    283656 ± 24%     +33.1%     377578 ±  2%  interrupts.CPU49.LOC:Local_timer_interrupts
    980.25 ± 24%     +50.0%       1470 ± 10%  interrupts.CPU49.NMI:Non-maskable_interrupts
    980.25 ± 24%     +50.0%       1470 ± 10%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
    489.25 ± 22%     -53.1%     229.50 ± 34%  interrupts.CPU49.RES:Rescheduling_interrupts
      2990 ± 15%     +54.1%       4610 ± 25%  interrupts.CPU5.CAL:Function_call_interrupts
    283801 ± 24%     +33.1%     377689 ±  2%  interrupts.CPU5.LOC:Local_timer_interrupts
    476.75 ± 24%     -52.6%     225.75 ± 20%  interrupts.CPU5.RES:Rescheduling_interrupts
      2926 ± 10%     +53.8%       4499 ± 23%  interrupts.CPU50.CAL:Function_call_interrupts
    283885 ± 24%     +33.0%     377686 ±  2%  interrupts.CPU50.LOC:Local_timer_interrupts
    786.25 ± 32%     +80.9%       1422 ± 11%  interrupts.CPU50.NMI:Non-maskable_interrupts
    786.25 ± 32%     +80.9%       1422 ± 11%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
    488.75 ± 24%     -55.3%     218.50 ± 23%  interrupts.CPU50.RES:Rescheduling_interrupts
      2798 ± 10%     +54.8%       4331 ± 23%  interrupts.CPU51.CAL:Function_call_interrupts
    283702 ± 24%     +33.1%     377699 ±  2%  interrupts.CPU51.LOC:Local_timer_interrupts
    886.00 ± 25%     +60.9%       1425 ± 13%  interrupts.CPU51.NMI:Non-maskable_interrupts
    886.00 ± 25%     +60.9%       1425 ± 13%  interrupts.CPU51.PMI:Performance_monitoring_interrupts
    478.25 ± 19%     -53.6%     222.00 ± 25%  interrupts.CPU51.RES:Rescheduling_interrupts
      2933 ± 10%     +53.1%       4492 ± 23%  interrupts.CPU52.CAL:Function_call_interrupts
    283697 ± 24%     +33.1%     377686 ±  2%  interrupts.CPU52.LOC:Local_timer_interrupts
    885.25 ± 23%     +62.0%       1434 ±  7%  interrupts.CPU52.NMI:Non-maskable_interrupts
    885.25 ± 23%     +62.0%       1434 ±  7%  interrupts.CPU52.PMI:Performance_monitoring_interrupts
    514.00 ± 26%     -52.9%     242.25 ± 34%  interrupts.CPU52.RES:Rescheduling_interrupts
      2945 ± 12%     +47.5%       4344 ± 26%  interrupts.CPU53.CAL:Function_call_interrupts
    283533 ± 24%     +33.2%     377700 ±  2%  interrupts.CPU53.LOC:Local_timer_interrupts
    912.75 ± 23%     +52.0%       1387 ± 10%  interrupts.CPU53.NMI:Non-maskable_interrupts
    912.75 ± 23%     +52.0%       1387 ± 10%  interrupts.CPU53.PMI:Performance_monitoring_interrupts
    479.25 ± 24%     -48.3%     248.00 ± 32%  interrupts.CPU53.RES:Rescheduling_interrupts
      2882 ±  9%     +51.1%       4354 ± 24%  interrupts.CPU54.CAL:Function_call_interrupts
    283661 ± 24%     +33.2%     377697 ±  2%  interrupts.CPU54.LOC:Local_timer_interrupts
    480.75 ± 22%     -55.0%     216.50 ± 26%  interrupts.CPU54.RES:Rescheduling_interrupts
      2943 ± 12%     +50.2%       4421 ± 24%  interrupts.CPU55.CAL:Function_call_interrupts
    284345 ± 23%     +32.8%     377727 ±  2%  interrupts.CPU55.LOC:Local_timer_interrupts
    474.50 ± 20%     -52.7%     224.25 ± 25%  interrupts.CPU55.RES:Rescheduling_interrupts
      2909 ± 12%     +48.9%       4331 ± 23%  interrupts.CPU56.CAL:Function_call_interrupts
    283612 ± 24%     +33.2%     377720 ±  2%  interrupts.CPU56.LOC:Local_timer_interrupts
    944.75 ± 24%     +58.2%       1495 ±  7%  interrupts.CPU56.NMI:Non-maskable_interrupts
    944.75 ± 24%     +58.2%       1495 ±  7%  interrupts.CPU56.PMI:Performance_monitoring_interrupts
    499.75 ± 24%     -57.1%     214.25 ± 32%  interrupts.CPU56.RES:Rescheduling_interrupts
      2892 ±  9%     +49.2%       4314 ± 25%  interrupts.CPU57.CAL:Function_call_interrupts
    283734 ± 24%     +33.1%     377654 ±  2%  interrupts.CPU57.LOC:Local_timer_interrupts
    953.50 ± 24%     +55.6%       1483 ±  4%  interrupts.CPU57.NMI:Non-maskable_interrupts
    953.50 ± 24%     +55.6%       1483 ±  4%  interrupts.CPU57.PMI:Performance_monitoring_interrupts
    484.75 ± 19%     -53.0%     228.00 ± 25%  interrupts.CPU57.RES:Rescheduling_interrupts
      2899 ±  7%     +53.0%       4435 ± 24%  interrupts.CPU58.CAL:Function_call_interrupts
    283713 ± 24%     +33.1%     377696 ±  2%  interrupts.CPU58.LOC:Local_timer_interrupts
    922.75 ± 23%     +54.8%       1428 ±  4%  interrupts.CPU58.NMI:Non-maskable_interrupts
    922.75 ± 23%     +54.8%       1428 ±  4%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
    462.25 ± 19%     -51.4%     224.75 ± 34%  interrupts.CPU58.RES:Rescheduling_interrupts
      2971 ± 10%     +51.5%       4501 ± 20%  interrupts.CPU59.CAL:Function_call_interrupts
    283725 ± 24%     +33.1%     377698 ±  2%  interrupts.CPU59.LOC:Local_timer_interrupts
    837.75 ± 32%     +78.6%       1496 ±  7%  interrupts.CPU59.NMI:Non-maskable_interrupts
    837.75 ± 32%     +78.6%       1496 ±  7%  interrupts.CPU59.PMI:Performance_monitoring_interrupts
    511.00 ± 26%     -54.3%     233.50 ± 40%  interrupts.CPU59.RES:Rescheduling_interrupts
      2863 ±  7%     +58.5%       4539 ± 24%  interrupts.CPU6.CAL:Function_call_interrupts
    283801 ± 24%     +33.0%     377561 ±  2%  interrupts.CPU6.LOC:Local_timer_interrupts
    457.75 ± 16%     -54.2%     209.50 ± 27%  interrupts.CPU6.RES:Rescheduling_interrupts
      2911 ±  7%     +54.2%       4490 ± 21%  interrupts.CPU60.CAL:Function_call_interrupts
    283919 ± 24%     +33.0%     377666 ±  2%  interrupts.CPU60.LOC:Local_timer_interrupts
    474.00 ± 15%     -48.5%     244.00 ± 25%  interrupts.CPU60.RES:Rescheduling_interrupts
      2886 ± 11%     +56.5%       4517 ± 24%  interrupts.CPU61.CAL:Function_call_interrupts
    284103 ± 24%     +32.9%     377703 ±  2%  interrupts.CPU61.LOC:Local_timer_interrupts
    480.00 ± 21%     -51.9%     230.75 ± 27%  interrupts.CPU61.RES:Rescheduling_interrupts
      2886 ± 12%     +54.9%       4473 ± 28%  interrupts.CPU62.CAL:Function_call_interrupts
    283667 ± 24%     +33.2%     377706 ±  2%  interrupts.CPU62.LOC:Local_timer_interrupts
      1007 ± 11%     +47.4%       1485 ±  7%  interrupts.CPU62.NMI:Non-maskable_interrupts
      1007 ± 11%     +47.4%       1485 ±  7%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
    492.50 ± 25%     -50.0%     246.25 ± 27%  interrupts.CPU62.RES:Rescheduling_interrupts
    233.25 ±162%     -98.0%       4.75 ± 77%  interrupts.CPU62.TLB:TLB_shootdowns
      2899 ± 11%     +55.7%       4513 ± 24%  interrupts.CPU63.CAL:Function_call_interrupts
    283815 ± 24%     +33.0%     377588 ±  2%  interrupts.CPU63.LOC:Local_timer_interrupts
      1119 ± 11%     +30.7%       1463 ±  4%  interrupts.CPU63.NMI:Non-maskable_interrupts
      1119 ± 11%     +30.7%       1463 ±  4%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
    484.75 ± 19%     -47.2%     256.00 ± 38%  interrupts.CPU63.RES:Rescheduling_interrupts
      2841 ± 10%     +58.4%       4499 ± 27%  interrupts.CPU64.CAL:Function_call_interrupts
    283737 ± 24%     +33.1%     377688 ±  2%  interrupts.CPU64.LOC:Local_timer_interrupts
    494.00 ± 22%     -49.6%     248.75 ± 38%  interrupts.CPU64.RES:Rescheduling_interrupts
      2922 ± 10%     +52.2%       4447 ± 19%  interrupts.CPU65.CAL:Function_call_interrupts
    283725 ± 24%     +33.1%     377659 ±  2%  interrupts.CPU65.LOC:Local_timer_interrupts
    925.50 ± 25%     +58.0%       1462 ±  7%  interrupts.CPU65.NMI:Non-maskable_interrupts
    925.50 ± 25%     +58.0%       1462 ±  7%  interrupts.CPU65.PMI:Performance_monitoring_interrupts
    472.75 ± 18%     -49.4%     239.25 ± 21%  interrupts.CPU65.RES:Rescheduling_interrupts
      2908 ± 12%     +54.2%       4484 ± 23%  interrupts.CPU66.CAL:Function_call_interrupts
    283817 ± 24%     +33.1%     377741 ±  2%  interrupts.CPU66.LOC:Local_timer_interrupts
    479.00 ± 21%     -52.0%     229.75 ± 18%  interrupts.CPU66.RES:Rescheduling_interrupts
      2909 ± 12%     +61.6%       4702 ± 23%  interrupts.CPU67.CAL:Function_call_interrupts
    283858 ± 24%     +33.0%     377589 ±  2%  interrupts.CPU67.LOC:Local_timer_interrupts
      1114 ±  7%     +27.7%       1422 ±  8%  interrupts.CPU67.NMI:Non-maskable_interrupts
      1114 ±  7%     +27.7%       1422 ±  8%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
    498.00 ± 22%     -51.2%     243.00 ± 32%  interrupts.CPU67.RES:Rescheduling_interrupts
      2879 ± 13%    +178.3%       8015 ± 86%  interrupts.CPU68.CAL:Function_call_interrupts
    283526 ± 24%     +33.2%     377677 ±  2%  interrupts.CPU68.LOC:Local_timer_interrupts
    921.75 ± 25%    +132.7%       2145 ± 56%  interrupts.CPU68.NMI:Non-maskable_interrupts
    921.75 ± 25%    +132.7%       2145 ± 56%  interrupts.CPU68.PMI:Performance_monitoring_interrupts
      2780 ± 11%     +95.1%       5425 ± 47%  interrupts.CPU69.CAL:Function_call_interrupts
    283683 ± 24%     +33.1%     377700 ±  2%  interrupts.CPU69.LOC:Local_timer_interrupts
      1030 ±  2%     +30.4%       1344 ± 13%  interrupts.CPU69.NMI:Non-maskable_interrupts
      1030 ±  2%     +30.4%       1344 ± 13%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
      2972 ± 16%     +46.8%       4363 ± 25%  interrupts.CPU7.CAL:Function_call_interrupts
    283625 ± 24%     +33.2%     377705 ±  2%  interrupts.CPU7.LOC:Local_timer_interrupts
    467.50 ± 18%     -52.2%     223.50 ± 25%  interrupts.CPU7.RES:Rescheduling_interrupts
    101.50 ±145%     -98.0%       2.00 ± 35%  interrupts.CPU7.TLB:TLB_shootdowns
      2766 ± 10%     +86.8%       5167 ± 40%  interrupts.CPU70.CAL:Function_call_interrupts
    283639 ± 24%     +33.1%     377646 ±  2%  interrupts.CPU70.LOC:Local_timer_interrupts
      1005 ±  7%     +47.4%       1481 ± 17%  interrupts.CPU70.NMI:Non-maskable_interrupts
      1005 ±  7%     +47.4%       1481 ± 17%  interrupts.CPU70.PMI:Performance_monitoring_interrupts
    480.75 ± 26%     -44.0%     269.25 ± 56%  interrupts.CPU70.RES:Rescheduling_interrupts
      2817 ± 10%     +77.6%       5002 ± 29%  interrupts.CPU71.CAL:Function_call_interrupts
    283616 ± 24%     +33.1%     377632 ±  2%  interrupts.CPU71.LOC:Local_timer_interrupts
    987.25 ±  9%     +45.9%       1440 ± 14%  interrupts.CPU71.NMI:Non-maskable_interrupts
    987.25 ±  9%     +45.9%       1440 ± 14%  interrupts.CPU71.PMI:Performance_monitoring_interrupts
    470.25 ± 20%     -51.5%     228.25 ± 36%  interrupts.CPU71.RES:Rescheduling_interrupts
      2818 ±  4%     +87.7%       5288 ±  4%  interrupts.CPU72.CAL:Function_call_interrupts
    285289 ± 24%     +34.1%     382714        interrupts.CPU72.LOC:Local_timer_interrupts
      2615 ±  6%    +114.2%       5600 ± 16%  interrupts.CPU73.CAL:Function_call_interrupts
    285672 ± 24%     +33.9%     382594        interrupts.CPU73.LOC:Local_timer_interrupts
      1054 ± 12%     +40.2%       1478 ± 11%  interrupts.CPU73.NMI:Non-maskable_interrupts
      1054 ± 12%     +40.2%       1478 ± 11%  interrupts.CPU73.PMI:Performance_monitoring_interrupts
      2792 ± 16%    +100.7%       5602 ± 13%  interrupts.CPU74.CAL:Function_call_interrupts
    285544 ± 24%     +34.0%     382736        interrupts.CPU74.LOC:Local_timer_interrupts
      1060 ±  4%     +40.0%       1484 ±  7%  interrupts.CPU74.NMI:Non-maskable_interrupts
      1060 ±  4%     +40.0%       1484 ±  7%  interrupts.CPU74.PMI:Performance_monitoring_interrupts
      2700 ±  8%    +104.4%       5520 ± 15%  interrupts.CPU75.CAL:Function_call_interrupts
    285519 ± 24%     +34.1%     382798        interrupts.CPU75.LOC:Local_timer_interrupts
    476.00 ± 20%     -40.1%     285.00 ± 13%  interrupts.CPU75.RES:Rescheduling_interrupts
      2731 ±  5%    +103.6%       5560 ± 14%  interrupts.CPU76.CAL:Function_call_interrupts
    285488 ± 24%     +34.1%     382783        interrupts.CPU76.LOC:Local_timer_interrupts
    487.75 ± 22%     -44.9%     268.75 ± 17%  interrupts.CPU76.RES:Rescheduling_interrupts
      2684 ±  4%    +113.3%       5725 ± 14%  interrupts.CPU77.CAL:Function_call_interrupts
    285504 ± 24%     +34.1%     382787        interrupts.CPU77.LOC:Local_timer_interrupts
    487.00 ± 21%     -43.6%     274.50 ± 22%  interrupts.CPU77.RES:Rescheduling_interrupts
      2725 ±  6%    +109.8%       5716 ± 13%  interrupts.CPU78.CAL:Function_call_interrupts
    285444 ± 24%     +34.1%     382763        interrupts.CPU78.LOC:Local_timer_interrupts
    479.75 ± 18%     -38.7%     294.25 ± 21%  interrupts.CPU78.RES:Rescheduling_interrupts
      2639 ±  8%    +114.4%       5660 ± 15%  interrupts.CPU79.CAL:Function_call_interrupts
    285775 ± 24%     +33.9%     382786        interrupts.CPU79.LOC:Local_timer_interrupts
    476.50 ± 16%     -40.5%     283.50 ± 19%  interrupts.CPU79.RES:Rescheduling_interrupts
      2898 ±  9%     +53.3%       4442 ± 24%  interrupts.CPU8.CAL:Function_call_interrupts
    283623 ± 24%     +33.2%     377673 ±  2%  interrupts.CPU8.LOC:Local_timer_interrupts
    468.50 ± 20%     -53.7%     216.75 ± 18%  interrupts.CPU8.RES:Rescheduling_interrupts
      2599 ±  7%    +115.4%       5600 ± 15%  interrupts.CPU80.CAL:Function_call_interrupts
    285742 ± 24%     +33.9%     382702        interrupts.CPU80.LOC:Local_timer_interrupts
      2640 ±  6%    +105.5%       5424 ± 15%  interrupts.CPU81.CAL:Function_call_interrupts
    285539 ± 24%     +34.1%     382773        interrupts.CPU81.LOC:Local_timer_interrupts
      2590 ±  7%    +120.5%       5711 ± 15%  interrupts.CPU82.CAL:Function_call_interrupts
    285450 ± 24%     +34.1%     382825        interrupts.CPU82.LOC:Local_timer_interrupts
    509.00 ± 15%     -43.8%     286.25 ± 18%  interrupts.CPU82.RES:Rescheduling_interrupts
      2678 ±  7%    +115.6%       5775 ± 14%  interrupts.CPU83.CAL:Function_call_interrupts
    285550 ± 24%     +34.0%     382771        interrupts.CPU83.LOC:Local_timer_interrupts
    489.00 ± 16%     -43.4%     277.00 ± 19%  interrupts.CPU83.RES:Rescheduling_interrupts
      2662 ±  8%    +243.2%       9139 ± 68%  interrupts.CPU84.CAL:Function_call_interrupts
    285325 ± 24%     +34.2%     382769        interrupts.CPU84.LOC:Local_timer_interrupts
    124.75 ± 13%   +1625.7%       2152 ±158%  interrupts.CPU85.80:PCI-MSI.70260742-edge.eth3-TxRx-5
    285730 ± 24%     +34.0%     382811        interrupts.CPU85.LOC:Local_timer_interrupts
     99.25 ± 10%   +2848.1%       2926 ± 95%  interrupts.CPU86.81:PCI-MSI.70260743-edge.eth3-TxRx-6
      2700 ± 15%    +141.5%       6521 ± 26%  interrupts.CPU86.CAL:Function_call_interrupts
    285554 ± 24%     +34.0%     382742        interrupts.CPU86.LOC:Local_timer_interrupts
    100.25 ±  9%   +1463.3%       1567 ±148%  interrupts.CPU87.82:PCI-MSI.70260744-edge.eth3-TxRx-7
      2691 ±  6%    +129.7%       6182 ± 22%  interrupts.CPU87.CAL:Function_call_interrupts
    285479 ± 24%     +34.1%     382758        interrupts.CPU87.LOC:Local_timer_interrupts
      2694 ±  6%    +123.1%       6010 ± 19%  interrupts.CPU88.CAL:Function_call_interrupts
    285437 ± 24%     +34.1%     382824        interrupts.CPU88.LOC:Local_timer_interrupts
    952.75 ± 24%     +59.0%       1515 ±  7%  interrupts.CPU88.NMI:Non-maskable_interrupts
    952.75 ± 24%     +59.0%       1515 ±  7%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
      2655 ±  6%    +122.4%       5905 ± 17%  interrupts.CPU89.CAL:Function_call_interrupts
    285573 ± 24%     +34.0%     382777        interrupts.CPU89.LOC:Local_timer_interrupts
      1043 ±  7%     +44.0%       1502 ± 10%  interrupts.CPU89.NMI:Non-maskable_interrupts
      1043 ±  7%     +44.0%       1502 ± 10%  interrupts.CPU89.PMI:Performance_monitoring_interrupts
    463.50 ± 17%     -37.3%     290.75 ± 22%  interrupts.CPU89.RES:Rescheduling_interrupts
      2789 ±  8%     +53.9%       4294 ± 24%  interrupts.CPU9.CAL:Function_call_interrupts
    283839 ± 24%     +33.1%     377753 ±  2%  interrupts.CPU9.LOC:Local_timer_interrupts
    475.75 ± 20%     -56.4%     207.50 ± 22%  interrupts.CPU9.RES:Rescheduling_interrupts
      2669 ±  5%    +119.7%       5864 ± 15%  interrupts.CPU90.CAL:Function_call_interrupts
    285438 ± 24%     +34.1%     382817        interrupts.CPU90.LOC:Local_timer_interrupts
    285848 ± 24%     +33.9%     382784        interrupts.CPU91.LOC:Local_timer_interrupts
      1051 ±  3%     +82.0%       1912 ± 39%  interrupts.CPU91.NMI:Non-maskable_interrupts
      1051 ±  3%     +82.0%       1912 ± 39%  interrupts.CPU91.PMI:Performance_monitoring_interrupts
      2594 ±  8%    +116.9%       5626 ± 19%  interrupts.CPU92.CAL:Function_call_interrupts
    285485 ± 24%     +34.1%     382765        interrupts.CPU92.LOC:Local_timer_interrupts
      1001 ±  8%     +53.0%       1532 ± 14%  interrupts.CPU92.NMI:Non-maskable_interrupts
      1001 ±  8%     +53.0%       1532 ± 14%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
      2642 ±  7%    +114.4%       5664 ± 15%  interrupts.CPU93.CAL:Function_call_interrupts
    285373 ± 24%     +34.2%     382835        interrupts.CPU93.LOC:Local_timer_interrupts
    933.50 ± 27%     +66.4%       1553 ±  7%  interrupts.CPU93.NMI:Non-maskable_interrupts
    933.50 ± 27%     +66.4%       1553 ±  7%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
      2686 ±  7%    +116.0%       5801 ± 16%  interrupts.CPU94.CAL:Function_call_interrupts
    285609 ± 24%     +34.0%     382789        interrupts.CPU94.LOC:Local_timer_interrupts
      1074 ±  6%     +45.3%       1562 ±  5%  interrupts.CPU94.NMI:Non-maskable_interrupts
      1074 ±  6%     +45.3%       1562 ±  5%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
      2746 ± 13%    +103.9%       5599 ± 15%  interrupts.CPU95.CAL:Function_call_interrupts
    285476 ± 24%     +34.1%     382849        interrupts.CPU95.LOC:Local_timer_interrupts
    987.50 ±  4%     +58.1%       1561 ±  5%  interrupts.CPU95.NMI:Non-maskable_interrupts
    987.50 ±  4%     +58.1%       1561 ±  5%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
    476.75 ± 16%     -42.1%     276.25 ± 22%  interrupts.CPU95.RES:Rescheduling_interrupts
  27325737 ± 24%     +33.6%   36498659        interrupts.LOC:Local_timer_interrupts
     94229 ±  2%     +43.5%     135259 ±  5%  interrupts.NMI:Non-maskable_interrupts
     94229 ±  2%     +43.5%     135259 ±  5%  interrupts.PMI:Performance_monitoring_interrupts
     48.86           -18.6       30.29 ±  7%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     48.32           -18.3       29.99 ±  7%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     48.32           -18.3       30.00 ±  7%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     48.31           -18.3       29.99 ±  7%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     45.94           -17.1       28.81 ±  8%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     45.75           -17.1       28.66 ±  8%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     42.41           -15.7       26.69 ±  8%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      5.93            -5.9        0.00        perf-profile.calltrace.cycles-pp.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
      5.70 ±  2%      -5.7        0.00        perf-profile.calltrace.cycles-pp.xfs_fs_destroy_inode.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.67 ±  2%      -5.7        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_fs_destroy_inode.destroy_inode.do_unlinkat.do_syscall_64
      5.66 ±  2%      -5.7        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode.destroy_inode.do_unlinkat
     13.27            -4.6        8.69 ±  6%  perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
     13.05            -4.5        8.56 ±  6%  perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2
      9.49 ±  2%      -2.9        6.58 ±  7%  perf-profile.calltrace.cycles-pp.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
      9.28 ±  2%      -2.8        6.47 ±  7%  perf-profile.calltrace.cycles-pp.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.27 ±  2%      -2.8        6.46 ±  7%  perf-profile.calltrace.cycles-pp.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64
      5.52 ±  2%      -2.4        3.10 ±  8%  perf-profile.calltrace.cycles-pp.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
      4.42 ±  3%      -1.9        2.51 ±  8%  perf-profile.calltrace.cycles-pp.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink
      4.68 ±  2%      -1.6        3.12 ±  7%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat.do_filp_open
      4.65 ±  2%      -1.6        3.10 ±  7%  perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat
      3.49 ±  2%      -1.5        2.00 ±  6%  perf-profile.calltrace.cycles-pp.xfs_dir_createname.xfs_create.xfs_generic_create.path_openat.do_filp_open
      3.35 ±  2%      -1.2        2.11 ±  6%  perf-profile.calltrace.cycles-pp.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create
      3.09 ±  7%      -1.2        1.86 ±  5%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      4.16 ±  2%      -1.2        2.97 ±  5%  perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
      2.72 ±  2%      -1.2        1.53 ±  7%  perf-profile.calltrace.cycles-pp.xfs_dir2_block_addname.xfs_dir_createname.xfs_create.xfs_generic_create.path_openat
      2.87 ±  6%      -1.2        1.70 ±  6%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      4.16 ±  2%      -1.1        3.03 ±  5%  perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
      4.83            -1.1        3.72 ±  4%  perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64
      2.43 ±  2%      -1.0        1.48 ±  7%  perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create
      2.27 ±  2%      -0.9        1.33 ±  9%  perf-profile.calltrace.cycles-pp.xfs_dir2_block_lookup_int.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink
      2.00 ±  3%      -0.9        1.12 ±  6%  perf-profile.calltrace.cycles-pp.xfs_dir3_data_check.xfs_dir2_block_addname.xfs_dir_createname.xfs_create.xfs_generic_create
      1.99 ±  3%      -0.9        1.11 ±  6%  perf-profile.calltrace.cycles-pp.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_addname.xfs_dir_createname.xfs_create
      1.84 ±  3%      -0.8        1.02 ±  7%  perf-profile.calltrace.cycles-pp.xfs_dir3_data_check.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink
      1.83 ±  3%      -0.8        1.02 ±  7%  perf-profile.calltrace.cycles-pp.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove
      1.96 ±  2%      -0.8        1.15 ± 10%  perf-profile.calltrace.cycles-pp.xfs_dir3_data_check.xfs_dir2_block_lookup_int.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove
      1.95 ±  2%      -0.8        1.14 ± 10%  perf-profile.calltrace.cycles-pp.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_lookup_int.xfs_dir2_block_removename.xfs_dir_removename
      0.98 ±  2%      -0.7        0.27 ±100%  perf-profile.calltrace.cycles-pp.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink
      2.15 ±  2%      -0.7        1.44 ±  6%  perf-profile.calltrace.cycles-pp.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create
      1.60 ±  6%      -0.7        0.95 ±  5%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      1.61 ±  6%      -0.7        0.96 ±  5%  perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.58 ±  6%      -0.6        0.94 ±  5%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.89 ±  4%      -0.6        0.28 ±100%  perf-profile.calltrace.cycles-pp.xfs_trans_unreserve_and_mod_sb.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create
      0.84 ±  4%      -0.6        0.26 ±100%  perf-profile.calltrace.cycles-pp.__percpu_counter_compare.xfs_trans_unreserve_and_mod_sb.xfs_log_commit_cil.__xfs_trans_commit.xfs_create
      0.81 ±  5%      -0.6        0.25 ±100%  perf-profile.calltrace.cycles-pp.__percpu_counter_sum.__percpu_counter_compare.xfs_trans_unreserve_and_mod_sb.xfs_log_commit_cil.__xfs_trans_commit
      0.95 ±  5%      -0.5        0.40 ± 58%  perf-profile.calltrace.cycles-pp.__xstat64
      3.44 ±  2%      -0.5        2.94 ±  5%  perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open
      0.89 ±  5%      -0.5        0.42 ± 57%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
      2.46 ±  2%      -0.2        2.21 ±  7%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
      1.02 ±  4%      -0.2        0.80 ±  8%  perf-profile.calltrace.cycles-pp.xfs_buf_item_format.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_create
      1.24 ±  3%      -0.1        1.10 ±  6%  perf-profile.calltrace.cycles-pp.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove.xfs_vn_unlink
      0.59 ±  3%      +0.1        0.71 ±  6%  perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
      0.56 ±  5%      +0.1        0.69 ±  6%  perf-profile.calltrace.cycles-pp.xfs_buf_item_format.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove
      0.00            +0.6        0.58 ±  7%  perf-profile.calltrace.cycles-pp.xfs_btree_lookup.xfs_dialloc_ag_update_inobt.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc
      0.00            +0.7        0.66 ±  8%  perf-profile.calltrace.cycles-pp.xfs_dialloc_ag_update_inobt.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc
      0.00            +1.0        0.97 ±  6%  perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode
      0.00            +1.0        0.99 ±  6%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode.xfs_inode_walk_ag
      0.00            +1.0        1.02 ±  7%  perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode.xfs_inode_walk_ag
      0.00            +2.1        2.10 ±  6%  perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode.xfs_inode_walk_ag.__xfs_inode_walk
      0.00            +2.1        2.12 ±  6%  perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inactive_inode.xfs_inode_walk_ag.__xfs_inode_walk.xfs_inactive_worker
      0.00            +2.2        2.19 ±  6%  perf-profile.calltrace.cycles-pp.xfs_inactive_inode.xfs_inode_walk_ag.__xfs_inode_walk.xfs_inactive_worker.process_one_work
      0.00            +2.2        2.22 ±  6%  perf-profile.calltrace.cycles-pp.xfs_inactive_worker.process_one_work.worker_thread.kthread.ret_from_fork
      0.00            +2.2        2.22 ±  6%  perf-profile.calltrace.cycles-pp.__xfs_inode_walk.xfs_inactive_worker.process_one_work.worker_thread.kthread
      0.00            +2.2        2.22 ±  6%  perf-profile.calltrace.cycles-pp.xfs_inode_walk_ag.__xfs_inode_walk.xfs_inactive_worker.process_one_work.worker_thread
      0.00            +3.1        3.15 ±  6%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      0.00            +3.2        3.17 ±  6%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      0.00            +3.6        3.63 ±  6%  perf-profile.calltrace.cycles-pp.ret_from_fork
      0.00            +3.6        3.63 ±  6%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
     25.64            +4.3       29.90 ±  2%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
     25.68            +4.3       29.97 ±  2%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.unlink
     25.49            +4.3       29.83 ±  2%  perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
     25.80            +4.4       30.15 ±  2%  perf-profile.calltrace.cycles-pp.unlink
     22.43 ±  2%     +11.9       34.34 ±  4%  perf-profile.calltrace.cycles-pp.creat64
     22.29 ±  2%     +12.0       34.25 ±  4%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat64
     22.23 ±  2%     +12.0       34.22 ±  4%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64
     22.21 ±  2%     +12.0       34.21 ±  5%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64
     22.20 ±  2%     +12.0       34.21 ±  5%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat64
     21.92 ±  2%     +12.1       34.04 ±  5%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     21.90 ±  2%     +12.1       34.03 ±  5%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      8.79           +13.7       22.45 ±  5%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink
      7.75           +14.5       22.20 ±  5%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.87 ±  4%     +15.5       18.37 ±  7%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64
      6.83 ±  4%     +17.6       24.39 ±  8%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      5.77 ±  5%     +18.3       24.12 ±  8%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      2.25 ±  9%     +18.8       21.04 ± 10%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open
     48.86           -18.6       30.29 ±  7%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     48.86           -18.6       30.29 ±  7%  perf-profile.children.cycles-pp.cpu_startup_entry
     48.85           -18.6       30.29 ±  7%  perf-profile.children.cycles-pp.do_idle
     48.32           -18.3       30.00 ±  7%  perf-profile.children.cycles-pp.start_secondary
     46.46           -17.4       29.10 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter
     46.45           -17.4       29.09 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter_state
     42.88           -15.9       26.95 ±  8%  perf-profile.children.cycles-pp.intel_idle
      5.93            -5.7        0.20 ±  5%  perf-profile.children.cycles-pp.destroy_inode
      5.70 ±  2%      -5.7        0.00        perf-profile.children.cycles-pp.xfs_fs_destroy_inode
     13.28            -4.6        8.69 ±  6%  perf-profile.children.cycles-pp.xfs_generic_create
     13.05            -4.5        8.56 ±  6%  perf-profile.children.cycles-pp.xfs_create
      5.66 ±  2%      -3.6        2.10 ±  6%  perf-profile.children.cycles-pp.xfs_inactive_ifree
      5.67 ±  2%      -3.6        2.12 ±  6%  perf-profile.children.cycles-pp.xfs_inactive
      9.51 ±  2%      -3.1        6.42 ±  6%  perf-profile.children.cycles-pp.__xfs_trans_commit
      9.39 ±  2%      -3.1        6.33 ±  6%  perf-profile.children.cycles-pp.xfs_log_commit_cil
      9.82            -2.9        6.89 ±  5%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      9.49 ±  2%      -2.9        6.58 ±  7%  perf-profile.children.cycles-pp.vfs_unlink
      9.28 ±  2%      -2.8        6.47 ±  7%  perf-profile.children.cycles-pp.xfs_vn_unlink
      9.27 ±  2%      -2.8        6.46 ±  7%  perf-profile.children.cycles-pp.xfs_remove
      6.31 ±  2%      -2.8        3.55 ±  8%  perf-profile.children.cycles-pp.__xfs_dir3_data_check
      6.31 ±  2%      -2.8        3.55 ±  8%  perf-profile.children.cycles-pp.xfs_dir3_data_check
      2.92 ±  3%      -2.4        0.49 ±  9%  perf-profile.children.cycles-pp.xfs_check_agi_freecount
      5.52 ±  2%      -2.4        3.10 ±  8%  perf-profile.children.cycles-pp.xfs_dir_removename
      3.05            -2.0        1.02 ±  7%  perf-profile.children.cycles-pp.xfs_ifree
      4.42 ±  3%      -1.9        2.51 ±  8%  perf-profile.children.cycles-pp.xfs_dir2_block_removename
      2.06            -1.6        0.46 ±  7%  perf-profile.children.cycles-pp.xfs_difree
      3.49            -1.5        2.00 ±  6%  perf-profile.children.cycles-pp.xfs_dir_createname
      4.03            -1.4        2.65 ±  6%  perf-profile.children.cycles-pp.xfs_trans_read_buf_map
      3.35 ±  2%      -1.2        2.11 ±  6%  perf-profile.children.cycles-pp.xfs_dialloc
      1.92 ±  2%      -1.2        0.70 ±  6%  perf-profile.children.cycles-pp.try_to_wake_up
      4.16 ±  2%      -1.2        2.97 ±  5%  perf-profile.children.cycles-pp.xfs_ialloc
      2.72 ±  2%      -1.2        1.54 ±  7%  perf-profile.children.cycles-pp.xfs_dir2_block_addname
      4.16 ±  2%      -1.1        3.03 ±  5%  perf-profile.children.cycles-pp.xfs_dir_ialloc
      3.44 ±  6%      -1.1        2.32 ±  4%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      1.86            -1.1        0.77 ±  8%  perf-profile.children.cycles-pp.ttwu_do_activate
      1.86            -1.1        0.76 ±  7%  perf-profile.children.cycles-pp.enqueue_task_fair
      3.19 ±  6%      -1.1        2.13 ±  4%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      1.31 ±  3%      -1.1        0.26 ±  3%  perf-profile.children.cycles-pp.xfs_difree_inobt
      1.78 ±  2%      -1.0        0.73 ±  8%  perf-profile.children.cycles-pp.enqueue_entity
      3.97 ±  2%      -1.0        2.98 ±  6%  perf-profile.children.cycles-pp.xlog_cil_insert_items
      1.17            -1.0        0.19 ± 12%  perf-profile.children.cycles-pp.xfs_inobt_get_rec
      2.61            -1.0        1.65 ±  7%  perf-profile.children.cycles-pp.xfs_buf_read_map
      2.43 ±  2%      -1.0        1.48 ±  7%  perf-profile.children.cycles-pp.xfs_dialloc_ag
      2.27 ±  2%      -0.9        1.33 ±  9%  perf-profile.children.cycles-pp.xfs_dir2_block_lookup_int
      1.53 ±  4%      -0.9        0.61 ±  5%  perf-profile.children.cycles-pp.xfs_buf_item_release
      2.76 ±  3%      -0.9        1.88 ±  4%  perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
      2.53 ±  2%      -0.9        1.65 ±  7%  perf-profile.children.cycles-pp.xfs_buf_get_map
      2.34            -0.8        1.49 ±  7%  perf-profile.children.cycles-pp.xfs_buf_find
      1.45 ±  2%      -0.8        0.62 ±  9%  perf-profile.children.cycles-pp.__account_scheduler_latency
      1.40 ±  3%      -0.8        0.57 ±  5%  perf-profile.children.cycles-pp.xfs_buf_unlock
      1.29 ±  4%      -0.8        0.49 ±  6%  perf-profile.children.cycles-pp.up
      1.60 ±  2%      -0.8        0.84 ±  6%  perf-profile.children.cycles-pp.xfs_read_agi
      1.96 ±  3%      -0.7        1.26 ±  6%  perf-profile.children.cycles-pp.xfs_btree_lookup
      1.17 ±  2%      -0.7        0.52 ±  9%  perf-profile.children.cycles-pp.stack_trace_save_tsk
      1.47 ±  3%      -0.6        0.84 ±  9%  perf-profile.children.cycles-pp.xfs_dir_ino_validate
      1.93            -0.6        1.31 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock
      0.94 ±  2%      -0.6        0.32 ±  6%  perf-profile.children.cycles-pp.rwsem_wake
      1.09            -0.6        0.48 ±  9%  perf-profile.children.cycles-pp.arch_stack_walk
      1.55 ±  2%      -0.6        0.95 ±  7%  perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
      1.22 ±  2%      -0.6        0.62 ±  2%  perf-profile.children.cycles-pp.__schedule
      1.81 ±  5%      -0.5        1.27 ±  5%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      1.78 ±  5%      -0.5        1.25 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.69 ±  5%      -0.5        0.18 ± 17%  perf-profile.children.cycles-pp.xfs_difree_finobt
      0.79            -0.5        0.29 ±  8%  perf-profile.children.cycles-pp.wake_up_q
      0.93 ±  3%      -0.5        0.45 ± 10%  perf-profile.children.cycles-pp.xfs_iunlink_remove
      0.98 ±  2%      -0.5        0.50 ±  7%  perf-profile.children.cycles-pp.xfs_dir2_node_removename
      1.31 ±  2%      -0.5        0.84 ±  7%  perf-profile.children.cycles-pp.xfs_btree_read_buf_block
      1.01 ±  3%      -0.4        0.56 ±  9%  perf-profile.children.cycles-pp.xfs_verify_ino
      0.86 ±  2%      -0.4        0.41 ± 11%  perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      1.09            -0.4        0.65 ±  5%  perf-profile.children.cycles-pp.xfs_da_read_buf
      0.57            -0.4        0.12 ±  8%  perf-profile.children.cycles-pp.xfs_btree_check_sblock
      0.83            -0.4        0.40 ±  7%  perf-profile.children.cycles-pp.xfs_trans_alloc
      0.96 ±  5%      -0.4        0.53 ±  6%  perf-profile.children.cycles-pp.__xstat64
      0.79 ±  2%      -0.4        0.37 ± 10%  perf-profile.children.cycles-pp.unwind_next_frame
      0.53 ±  6%      -0.4        0.11 ±  9%  perf-profile.children.cycles-pp.xfs_btree_get_rec
      0.94 ±  5%      -0.4        0.53 ± 11%  perf-profile.children.cycles-pp.xfs_trans_unreserve_and_mod_sb
      0.81 ±  3%      -0.4        0.41 ± 10%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.79 ±  3%      -0.4        0.39 ±  4%  perf-profile.children.cycles-pp.xfs_ialloc_read_agi
      0.81            -0.4        0.42 ±  8%  perf-profile.children.cycles-pp.xfs_da3_node_lookup_int
      0.87 ±  5%      -0.4        0.48 ±  7%  perf-profile.children.cycles-pp.__do_sys_newstat
      0.45 ±  4%      -0.4        0.06 ± 26%  perf-profile.children.cycles-pp.xfs_btree_increment
      0.90 ±  8%      -0.4        0.52 ±  9%  perf-profile.children.cycles-pp.ktime_get
      0.69 ±  4%      -0.4        0.32 ±  9%  perf-profile.children.cycles-pp.xfs_trans_reserve
      0.85 ±  4%      -0.4        0.48 ± 11%  perf-profile.children.cycles-pp.__percpu_counter_compare
      0.93 ±  4%      -0.4        0.57 ±  5%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.80 ±  6%      -0.4        0.44 ±  8%  perf-profile.children.cycles-pp.vfs_statx
      0.82 ±  4%      -0.4        0.46 ± 11%  perf-profile.children.cycles-pp.__percpu_counter_sum
      1.25 ±  2%      -0.4        0.90 ±  8%  perf-profile.children.cycles-pp._xfs_trans_bjoin
      0.69 ±  3%      -0.4        0.33 ± 10%  perf-profile.children.cycles-pp.xfs_agino_range
      0.76            -0.3        0.41 ±  6%  perf-profile.children.cycles-pp.xfs_inode_item_format
      0.86 ±  4%      -0.3        0.52 ±  6%  perf-profile.children.cycles-pp.do_softirq_own_stack
      0.80 ±  2%      -0.3        0.46 ±  3%  perf-profile.children.cycles-pp.schedule
      0.62            -0.3        0.28 ±  8%  perf-profile.children.cycles-pp.xfs_log_reserve
      0.85 ±  4%      -0.3        0.54 ±  6%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.65 ±  4%      -0.3        0.36 ±  8%  perf-profile.children.cycles-pp.link_path_walk
      0.64            -0.3        0.35 ±  7%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.57 ±  2%      -0.3        0.29 ±  9%  perf-profile.children.cycles-pp.xfs_buf_lock
      0.64            -0.3        0.36 ±  6%  perf-profile.children.cycles-pp.xfs_dir2_node_addname
      0.65 ±  2%      -0.3        0.38 ±  6%  perf-profile.children.cycles-pp.xfs_dir3_block_read
      0.46 ±  4%      -0.3        0.19 ±  5%  perf-profile.children.cycles-pp.schedule_idle
      0.35 ±  4%      -0.3        0.08 ± 15%  perf-profile.children.cycles-pp.__xfs_btree_check_sblock
      0.53 ±  4%      -0.3        0.26 ±  9%  perf-profile.children.cycles-pp.down
      0.52 ±  4%      -0.3        0.26 ± 10%  perf-profile.children.cycles-pp.__down
      1.02 ±  5%      -0.3        0.76 ±  5%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.62 ±  6%      -0.2        0.38 ±  8%  perf-profile.children.cycles-pp.menu_select
      0.54 ±  6%      -0.2        0.30 ± 26%  perf-profile.children.cycles-pp.start_kernel
      0.50            -0.2        0.27 ±  8%  perf-profile.children.cycles-pp.getname_flags
      0.46 ±  3%      -0.2        0.23 ±  6%  perf-profile.children.cycles-pp.schedule_timeout
      0.45 ±  6%      -0.2        0.22 ±  3%  perf-profile.children.cycles-pp.xfs_trans_log_buf
      0.55 ±  6%      -0.2        0.32 ±  7%  perf-profile.children.cycles-pp.clockevents_program_event
      0.49 ±  3%      -0.2        0.27 ±  2%  perf-profile.children.cycles-pp.kmem_cache_free
      0.37 ±  6%      -0.2        0.15 ±  9%  perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
      0.34            -0.2        0.12 ±  8%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.41 ±  3%      -0.2        0.20 ± 10%  perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry
      0.41 ±  2%      -0.2        0.21 ±  4%  perf-profile.children.cycles-pp.__close
      0.49 ±  6%      -0.2        0.28 ±  5%  perf-profile.children.cycles-pp.filename_lookup
      0.53            -0.2        0.33 ± 10%  perf-profile.children.cycles-pp.xfs_perag_get
      0.39 ±  3%      -0.2        0.20 ±  9%  perf-profile.children.cycles-pp.xfs_dir2_leafn_remove
      0.50 ±  4%      -0.2        0.30 ±  9%  perf-profile.children.cycles-pp.xfs_iunlink_update_inode
      0.34 ±  4%      -0.2        0.14 ±  7%  perf-profile.children.cycles-pp.xfs_inobt_update
      0.30            -0.2        0.11 ±  9%  perf-profile.children.cycles-pp.dequeue_entity
      0.47 ±  6%      -0.2        0.27 ±  5%  perf-profile.children.cycles-pp.path_lookupat
      0.41            -0.2        0.22 ±  9%  perf-profile.children.cycles-pp.strncpy_from_user
      0.33 ±  6%      -0.2        0.14 ±  8%  perf-profile.children.cycles-pp.xfs_btree_update
      0.38 ±  4%      -0.2        0.19 ±  4%  perf-profile.children.cycles-pp.xfs_trans_dirty_buf
      0.40 ± 11%      -0.2        0.21 ± 11%  perf-profile.children.cycles-pp.xfs_errortag_test
      0.35 ±  6%      -0.2        0.17 ±  6%  perf-profile.children.cycles-pp.orc_find
      0.77 ±  8%      -0.2        0.59 ±  4%  perf-profile.children.cycles-pp.tick_sched_timer
      0.28 ±  3%      -0.2        0.10 ±  7%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.46 ±  4%      -0.2        0.29 ±  5%  perf-profile.children.cycles-pp.rcu_core
      0.59 ±  4%      -0.2        0.42 ±  8%  perf-profile.children.cycles-pp.xfs_buf_item_init
      0.28 ±  6%      -0.2        0.11 ±  8%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.62 ±  3%      -0.2        0.46 ± 10%  perf-profile.children.cycles-pp.xfs_buf_rele
      0.29 ±  7%      -0.2        0.14 ±  8%  perf-profile.children.cycles-pp.__orc_find
      0.24 ±  7%      -0.1        0.09 ± 17%  perf-profile.children.cycles-pp.xfs_inode_item_format_data_fork
      0.28 ±  6%      -0.1        0.14 ±  6%  perf-profile.children.cycles-pp.down_write
      0.51 ±  8%      -0.1        0.36 ±  5%  perf-profile.children.cycles-pp.xfs_next_bit
      0.35            -0.1        0.21 ±  7%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.30 ±  4%      -0.1        0.16 ± 11%  perf-profile.children.cycles-pp.inode_permission
      0.27 ±  3%      -0.1        0.14 ± 10%  perf-profile.children.cycles-pp.update_load_avg
      0.34            -0.1        0.20 ±  8%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.21 ± 12%      -0.1        0.08 ± 19%  perf-profile.children.cycles-pp.xfs_iextents_copy
      0.36 ±  3%      -0.1        0.23 ±  4%  perf-profile.children.cycles-pp.rcu_do_batch
      0.32 ±  6%      -0.1        0.19 ±  7%  perf-profile.children.cycles-pp.alloc_empty_file
      0.24 ±  5%      -0.1        0.11 ± 11%  perf-profile.children.cycles-pp.down_read
      0.24 ±  7%      -0.1        0.11 ±  9%  perf-profile.children.cycles-pp.xfs_dir3_leaf_check_int
      0.31 ±  6%      -0.1        0.18 ±  5%  perf-profile.children.cycles-pp.__alloc_file
      0.62 ±  6%      -0.1        0.49 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.60 ±  6%      -0.1        0.48 ±  4%  perf-profile.children.cycles-pp.update_process_times
      0.26 ±  4%      -0.1        0.13 ±  6%  perf-profile.children.cycles-pp.dput
      0.23 ±  2%      -0.1        0.11 ± 11%  perf-profile.children.cycles-pp.task_work_run
      0.20 ±  6%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.xlog_grant_add_space
      0.28 ±  4%      -0.1        0.17 ±  9%  perf-profile.children.cycles-pp.xfs_da3_node_read
      0.19 ±  7%      -0.1        0.07 ± 11%  perf-profile.children.cycles-pp.xfs_ilock
      0.28 ±  5%      -0.1        0.17 ± 13%  perf-profile.children.cycles-pp.xfs_dir2_node_addname_int
      0.30 ±  2%      -0.1        0.19 ±  6%  perf-profile.children.cycles-pp.walk_component
      0.25 ±  7%      -0.1        0.14 ± 10%  perf-profile.children.cycles-pp.xfs_da_hashname
      0.18 ±  8%      -0.1        0.07        perf-profile.children.cycles-pp.unwind_get_return_address
      0.23 ±  5%      -0.1        0.12 ± 14%  perf-profile.children.cycles-pp.xfs_ag_block_count
      0.23 ±  3%      -0.1        0.12 ± 16%  perf-profile.children.cycles-pp.user_path_at_empty
      0.22            -0.1        0.11 ±  6%  perf-profile.children.cycles-pp.cpumask_next
      0.19 ± 11%      -0.1        0.09 ± 10%  perf-profile.children.cycles-pp.xlog_ticket_alloc
      0.17 ±  7%      -0.1        0.06 ±  6%  perf-profile.children.cycles-pp.__kernel_text_address
      0.16 ±  7%      -0.1        0.05 ±  9%  perf-profile.children.cycles-pp.kernel_text_address
      0.24 ±  3%      -0.1        0.14 ±  9%  perf-profile.children.cycles-pp.filename_parentat
      0.12 ± 14%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.xfs_bmap_validate_extent_raw
      0.14 ±  8%      -0.1        0.04 ± 57%  perf-profile.children.cycles-pp.set_next_entity
      0.24 ±  3%      -0.1        0.14 ± 11%  perf-profile.children.cycles-pp.path_parentat
      0.19 ±  3%      -0.1        0.10 ± 11%  perf-profile.children.cycles-pp.update_rq_clock
      0.13 ±  5%      -0.1        0.04 ± 57%  perf-profile.children.cycles-pp.update_cfs_rq_h_load
      0.18 ±  2%      -0.1        0.09 ±  7%  perf-profile.children.cycles-pp.lockref_put_return
      0.18 ±  4%      -0.1        0.09 ±  5%  perf-profile.children.cycles-pp.evict
      0.14 ±  7%      -0.1        0.06 ±  9%  perf-profile.children.cycles-pp.__module_address
      0.27 ± 10%      -0.1        0.19 ± 10%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.16 ±  4%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.update_curr
      0.42 ±  9%      -0.1        0.34 ±  8%  perf-profile.children.cycles-pp._xfs_buf_obj_cmp
      0.20 ± 14%      -0.1        0.12 ±  5%  perf-profile.children.cycles-pp.unlazy_walk
      0.11 ± 14%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.16 ±  6%      -0.1        0.08 ± 15%  perf-profile.children.cycles-pp.xfs_dir2_data_entry_tag_p
      0.17 ±  3%      -0.1        0.09 ± 13%  perf-profile.children.cycles-pp.xlog_grant_push_ail
      0.16 ±  5%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.xlog_grant_push_threshold
      0.16 ±  4%      -0.1        0.08 ± 12%  perf-profile.children.cycles-pp.xlog_space_left
      0.17 ±  7%      -0.1        0.09 ± 12%  perf-profile.children.cycles-pp.xfs_dabuf_map
      0.20 ± 12%      -0.1        0.12 ± 12%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.15 ±  4%      -0.1        0.07 ± 14%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.21 ± 12%      -0.1        0.13 ±  8%  perf-profile.children.cycles-pp.xfs_buf_trylock
      0.16 ±  7%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.__fput
      0.18 ± 15%      -0.1        0.11 ±  6%  perf-profile.children.cycles-pp.__legitimize_path
      0.21 ±  3%      -0.1        0.13 ± 13%  perf-profile.children.cycles-pp.lookup_fast
      0.14 ±  6%      -0.1        0.06 ± 11%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.19 ±  8%      -0.1        0.11 ±  9%  perf-profile.children.cycles-pp.xfs_trans_del_item
      0.32 ±  5%      -0.1        0.25 ±  5%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.18 ±  6%      -0.1        0.10 ± 12%  perf-profile.children.cycles-pp.__might_sleep
      0.10 ± 11%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__switch_to
      0.11 ±  3%      -0.1        0.04 ± 58%  perf-profile.children.cycles-pp.mnt_want_write
      0.31 ±  6%      -0.1        0.24 ±  7%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.15 ± 10%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.xfs_verify_agbno
      0.17 ± 10%      -0.1        0.10 ±  9%  perf-profile.children.cycles-pp.__list_add_valid
      0.21 ± 10%      -0.1        0.15 ±  7%  perf-profile.children.cycles-pp.d_lookup
      0.14 ± 10%      -0.1        0.07 ± 14%  perf-profile.children.cycles-pp.xfs_dir2_block_sfsize
      0.21 ±  8%      -0.1        0.14 ±  7%  perf-profile.children.cycles-pp.__d_lookup
      0.20 ± 11%      -0.1        0.13 ±  6%  perf-profile.children.cycles-pp.down_trylock
      0.13 ± 11%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.__x64_sys_unlink
      0.10 ±  9%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.fsnotify_destroy_marks
      0.15 ±  9%      -0.1        0.09 ±  7%  perf-profile.children.cycles-pp.refill_obj_stock
      0.13 ±  6%      -0.1        0.07 ±  6%  perf-profile.children.cycles-pp.xfs_btree_ptr_to_daddr
      0.14 ± 12%      -0.1        0.07 ± 11%  perf-profile.children.cycles-pp.sched_clock
      0.15 ±  3%      -0.1        0.08 ± 13%  perf-profile.children.cycles-pp.xfs_inobt_init_cursor
      0.15 ± 12%      -0.1        0.09 ±  4%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.57 ±  2%      -0.1        0.51 ±  3%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.18 ±  6%      -0.1        0.11 ±  9%  perf-profile.children.cycles-pp.rebalance_domains
      0.14 ±  5%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp._find_next_bit
      0.09 ± 10%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.dentry_unlink_inode
      0.18 ± 12%      -0.1        0.12 ±  9%  perf-profile.children.cycles-pp.do_dentry_open
      0.13 ±  9%      -0.1        0.07 ± 17%  perf-profile.children.cycles-pp.security_file_alloc
      0.12 ±  8%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.xfs_ialloc_ag_select
      0.13 ±  9%      -0.1        0.07 ± 10%  perf-profile.children.cycles-pp.xfs_buf_item_put
      0.13 ±  5%      -0.1        0.07 ± 15%  perf-profile.children.cycles-pp.xfs_inobt_init_common
      0.12 ± 12%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.__destroy_inode
      0.12 ± 16%      -0.1        0.07 ± 12%  perf-profile.children.cycles-pp.xfs_buf_item_log
      0.12 ±  8%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.xfs_dir2_data_log_unused
      0.10 ± 15%      -0.1        0.04 ± 57%  perf-profile.children.cycles-pp.xfs_dir2_leafn_add
      0.15 ± 14%      -0.1        0.10 ±  4%  perf-profile.children.cycles-pp.complete_walk
      0.16 ±  6%      -0.1        0.11 ± 12%  perf-profile.children.cycles-pp.__d_lookup_rcu
      0.14 ± 11%      -0.1        0.09 ± 13%  perf-profile.children.cycles-pp.xfs_dir2_data_use_free
      0.49 ±  6%      -0.1        0.43        perf-profile.children.cycles-pp.xfs_iget
      0.13 ±  8%      -0.1        0.07 ± 11%  perf-profile.children.cycles-pp.native_sched_clock
      0.11 ±  3%      -0.1        0.06 ± 14%  perf-profile.children.cycles-pp.xfs_dir2_data_make_free
      0.16 ±  7%      -0.1        0.11 ± 12%  perf-profile.children.cycles-pp.xfs_perag_put
      0.14 ± 13%      -0.1        0.08 ±  5%  perf-profile.children.cycles-pp.lockref_get_not_dead
      0.12 ± 13%      -0.1        0.07 ± 16%  perf-profile.children.cycles-pp.xfs_bmapi_read
      0.12 ±  6%      -0.1        0.07 ±  5%  perf-profile.children.cycles-pp.drain_obj_stock
      0.09 ± 13%      -0.1        0.04 ± 57%  perf-profile.children.cycles-pp.__switch_to_asm
      0.11 ± 10%      -0.1        0.05 ±  9%  perf-profile.children.cycles-pp.apparmor_file_alloc_security
      0.08 ±  6%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.ksys_read
      0.08 ±  6%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.vfs_read
      0.13 ±  8%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.10 ±  7%      -0.1        0.05        perf-profile.children.cycles-pp.__mnt_want_write
      0.08 ± 14%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.read
      0.18 ±  2%      -0.0        0.14 ±  3%  perf-profile.children.cycles-pp.dsearch
      0.12 ± 12%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.read_tsc
      0.11 ±  6%      -0.0        0.06 ± 20%  perf-profile.children.cycles-pp.scramble
      0.09 ± 29%      -0.0        0.04 ± 58%  perf-profile.children.cycles-pp.xfs_trans_add_item
      0.11 ±  6%      -0.0        0.06 ± 13%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.09 ± 10%      -0.0        0.04 ± 57%  perf-profile.children.cycles-pp.get_list
      0.09 ±  4%      -0.0        0.04 ± 59%  perf-profile.children.cycles-pp.xfs_verify_dir_ino
      0.07 ± 11%      -0.0        0.03 ±100%  perf-profile.children.cycles-pp.xfs_lock_two_inodes
      0.10 ± 10%      -0.0        0.06 ± 11%  perf-profile.children.cycles-pp.page_counter_cancel
      0.10 ±  4%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.__check_object_size
      0.10 ±  7%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.__xfs_dir3_free_read
      0.12 ±  7%      -0.0        0.07 ± 11%  perf-profile.children.cycles-pp.xfs_droplink
      0.08 ±  8%      -0.0        0.04 ± 57%  perf-profile.children.cycles-pp.d_instantiate
      0.18 ±  7%      -0.0        0.14 ±  8%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.09 ±  8%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.xfs_btree_check_ptr
      0.13 ±  3%      -0.0        0.09 ±  9%  perf-profile.children.cycles-pp.xfs_dir3_data_read
      0.11 ±  4%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.___might_sleep
      0.24 ±  5%      -0.0        0.21 ±  2%  perf-profile.children.cycles-pp.xfs_trans_ijoin
      0.15 ± 10%      -0.0        0.12 ±  9%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.12 ± 10%      -0.0        0.09 ±  4%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.11 ± 13%      -0.0        0.07 ±  5%  perf-profile.children.cycles-pp.up_write
      0.09 ±  7%      -0.0        0.06 ±  9%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.07 ±  5%      -0.0        0.04 ± 58%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.12 ± 11%      -0.0        0.09 ± 12%  perf-profile.children.cycles-pp.update_blocked_averages
      0.10 ±  8%      -0.0        0.07 ± 12%  perf-profile.children.cycles-pp._atomic_dec_and_lock
      0.07 ± 12%      -0.0        0.04 ± 57%  perf-profile.children.cycles-pp._cond_resched
      0.09 ±  9%      -0.0        0.06 ± 11%  perf-profile.children.cycles-pp.xfs_trans_buf_item_match
      0.12 ±  6%      -0.0        0.10 ± 11%  perf-profile.children.cycles-pp.memset_erms
      0.08 ± 15%      -0.0        0.06        perf-profile.children.cycles-pp.update_cfs_group
      0.06 ±  6%      +0.0        0.08 ± 10%  perf-profile.children.cycles-pp.switch_fpu_return
      0.08 ± 10%      +0.0        0.12 ±  7%  perf-profile.children.cycles-pp.xfs_lookup_get_search_key
      0.04 ± 58%      +0.0        0.08 ± 10%  perf-profile.children.cycles-pp.xfs_inobt_init_key_from_rec
      0.13 ±  6%      +0.0        0.17 ±  4%  perf-profile.children.cycles-pp.newidle_balance
      0.08 ±  5%      +0.0        0.13 ± 13%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.05 ±  9%      +0.0        0.10 ±  8%  perf-profile.children.cycles-pp.xfs_cil_prepare_item
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.inode_init_once
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.xfs_alloc_ag_vextent
      0.01 ±173%      +0.1        0.07 ± 12%  perf-profile.children.cycles-pp.md_handle_request
      0.01 ±173%      +0.1        0.07 ± 12%  perf-profile.children.cycles-pp.raid0_make_request
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.xfs_ialloc_inode_init
      0.00            +0.1        0.06 ± 11%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.00            +0.1        0.07 ± 17%  perf-profile.children.cycles-pp.xfs_trans_get_buf_map
      0.00            +0.1        0.07 ± 17%  perf-profile.children.cycles-pp.xfs_reclaim_worker
      0.00            +0.1        0.07 ± 17%  perf-profile.children.cycles-pp.xfs_reclaim_inodes_ag
      0.00            +0.1        0.07 ±  7%  perf-profile.children.cycles-pp.xfs_inode_to_disk
      0.00            +0.1        0.07 ± 12%  perf-profile.children.cycles-pp.xfs_alloc_vextent
      0.00            +0.1        0.07 ± 19%  perf-profile.children.cycles-pp.crc_21
      0.00            +0.1        0.07 ± 10%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
      0.00            +0.1        0.07 ± 15%  perf-profile.children.cycles-pp.xlog_state_release_iclog
      0.00            +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.xfs_inode_set_inactive_tag
      0.04 ± 57%      +0.1        0.12 ± 13%  perf-profile.children.cycles-pp.kfree
      0.00            +0.1        0.08 ±  5%  perf-profile.children.cycles-pp.kernel_fpu_begin
      0.00            +0.1        0.08 ±  8%  perf-profile.children.cycles-pp.xfs_fs_inode_init_once
      0.00            +0.1        0.08 ±  5%  perf-profile.children.cycles-pp.xfs_buf_ioend
      0.00            +0.1        0.09 ±  9%  perf-profile.children.cycles-pp.xfs_trans_roll
      0.00            +0.1        0.09 ±  7%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.00            +0.1        0.09 ±  7%  perf-profile.children.cycles-pp.__slab_free
      0.06 ± 13%      +0.1        0.16 ±  8%  perf-profile.children.cycles-pp.xfs_trans_committed_bulk
      0.00            +0.1        0.10 ±  8%  perf-profile.children.cycles-pp.xfs_buf_inode_iodone
      0.00            +0.1        0.10 ± 14%  perf-profile.children.cycles-pp._xfs_buf_ioapply
      0.00            +0.1        0.11 ±  7%  perf-profile.children.cycles-pp.xfs_btree_del_cursor
      0.00            +0.1        0.11 ± 11%  perf-profile.children.cycles-pp.__xfs_buf_submit
      0.00            +0.1        0.11 ± 15%  perf-profile.children.cycles-pp.task_tick_fair
      0.59 ±  3%      +0.1        0.71 ±  6%  perf-profile.children.cycles-pp.xfs_iunlink
      0.37 ±  6%      +0.1        0.48 ±  7%  perf-profile.children.cycles-pp.xfs_trans_log_inode
      0.00            +0.1        0.12 ± 12%  perf-profile.children.cycles-pp.xfs_iunlink_insert_backref
      0.00            +0.1        0.12 ± 15%  perf-profile.children.cycles-pp.xfs_buf_delwri_submit_buffers
      0.00            +0.1        0.12 ± 12%  perf-profile.children.cycles-pp.xfs_iunlink_map_prev
      0.36 ±  6%      +0.1        0.48 ±  9%  perf-profile.children.cycles-pp.xfs_imap_to_bp
      0.11 ± 17%      +0.1        0.24 ±  8%  perf-profile.children.cycles-pp.__kmalloc
      0.00            +0.1        0.12 ±  8%  perf-profile.children.cycles-pp.rhashtable_rehash_table
      0.00            +0.1        0.13 ±  6%  perf-profile.children.cycles-pp.rht_deferred_worker
      0.06 ± 14%      +0.1        0.19 ±  4%  perf-profile.children.cycles-pp.submit_bio_noacct
      0.00            +0.1        0.13 ±  5%  perf-profile.children.cycles-pp.allocate_slab
      0.12 ± 15%      +0.1        0.25 ±  9%  perf-profile.children.cycles-pp.kmem_alloc
      0.00            +0.1        0.14 ±  8%  perf-profile.children.cycles-pp.submit_bio
      0.01 ±173%      +0.1        0.15 ±  8%  perf-profile.children.cycles-pp.brd_do_bvec
      0.01 ±173%      +0.1        0.15 ±  5%  perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      0.00            +0.1        0.15 ±  5%  perf-profile.children.cycles-pp.xfs_iflush
      0.01 ±173%      +0.1        0.16 ±  6%  perf-profile.children.cycles-pp.brd_submit_bio
      0.00            +0.2        0.15 ±  9%  perf-profile.children.cycles-pp.xfs_ialloc_ag_alloc
      0.01 ±173%      +0.2        0.18 ±  7%  perf-profile.children.cycles-pp.kmem_alloc_large
      0.08 ±  8%      +0.2        0.24 ±  9%  perf-profile.children.cycles-pp.xlog_cil_process_committed
      0.08 ±  8%      +0.2        0.24 ±  9%  perf-profile.children.cycles-pp.xlog_cil_committed
      0.08 ±  8%      +0.2        0.25 ±  8%  perf-profile.children.cycles-pp.xlog_ioend_work
      0.08 ±  8%      +0.2        0.25 ±  8%  perf-profile.children.cycles-pp.xlog_state_do_callback
      0.06 ±  6%      +0.2        0.25 ±  8%  perf-profile.children.cycles-pp.xlog_write
      0.08 ± 13%      +0.2        0.30 ±  7%  perf-profile.children.cycles-pp.xlog_cil_push_work
      0.01 ±173%      +0.2        0.24 ±  3%  perf-profile.children.cycles-pp.__slab_alloc
      0.00            +0.2        0.22 ±  4%  perf-profile.children.cycles-pp.xfs_inode_alloc
      0.00            +0.2        0.23 ±  3%  perf-profile.children.cycles-pp.___slab_alloc
      0.00            +0.3        0.27 ±  8%  perf-profile.children.cycles-pp.xfs_iflush_cluster
      0.00            +0.3        0.28 ±  8%  perf-profile.children.cycles-pp.xfs_inode_item_push
      0.00            +0.4        0.41 ± 10%  perf-profile.children.cycles-pp.xfsaild_push
      0.00            +0.4        0.41 ± 10%  perf-profile.children.cycles-pp.xfsaild
      0.18 ±  7%      +0.5        0.66 ±  8%  perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt
      0.00            +2.2        2.19 ±  6%  perf-profile.children.cycles-pp.xfs_inactive_inode
      0.00            +2.2        2.22 ±  6%  perf-profile.children.cycles-pp.xfs_inactive_worker
      0.00            +2.2        2.22 ±  6%  perf-profile.children.cycles-pp.__xfs_inode_walk
      0.00            +2.2        2.22 ±  6%  perf-profile.children.cycles-pp.xfs_inode_walk_ag
      0.23 ±  6%      +2.9        3.15 ±  6%  perf-profile.children.cycles-pp.process_one_work
      0.25 ±  6%      +2.9        3.17 ±  6%  perf-profile.children.cycles-pp.worker_thread
      0.29 ±  6%      +3.3        3.63 ±  6%  perf-profile.children.cycles-pp.ret_from_fork
      0.29 ±  6%      +3.3        3.63 ±  6%  perf-profile.children.cycles-pp.kthread
     25.50            +4.3       29.83 ±  2%  perf-profile.children.cycles-pp.do_unlinkat
     25.83            +4.3       30.17 ±  2%  perf-profile.children.cycles-pp.unlink
     22.46 ±  2%     +11.9       34.36 ±  4%  perf-profile.children.cycles-pp.creat64
     22.25 ±  2%     +12.0       34.24 ±  5%  perf-profile.children.cycles-pp.do_sys_open
     22.24 ±  2%     +12.0       34.23 ±  4%  perf-profile.children.cycles-pp.do_sys_openat2
     21.96 ±  2%     +12.1       34.07 ±  5%  perf-profile.children.cycles-pp.do_filp_open
     21.94 ±  2%     +12.1       34.06 ±  5%  perf-profile.children.cycles-pp.path_openat
     49.54           +15.5       65.08 ±  3%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     49.14           +15.7       64.84 ±  3%  perf-profile.children.cycles-pp.do_syscall_64
     15.63 ±  2%     +31.2       46.83 ±  6%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
     13.56 ±  2%     +32.9       46.50 ±  6%  perf-profile.children.cycles-pp.rwsem_optimistic_spin
      5.14 ±  5%     +34.4       39.51 ±  8%  perf-profile.children.cycles-pp.osq_lock
     42.88           -15.9       26.95 ±  8%  perf-profile.self.cycles-pp.intel_idle
      9.76            -2.9        6.83 ±  4%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      4.43 ±  3%      -2.0        2.48 ±  8%  perf-profile.self.cycles-pp.__xfs_dir3_data_check
      1.75            -0.5        1.23 ±  5%  perf-profile.self.cycles-pp._raw_spin_lock
      0.82 ±  2%      -0.3        0.48 ± 10%  perf-profile.self.cycles-pp.xfs_log_commit_cil
      0.79 ±  8%      -0.3        0.46 ± 10%  perf-profile.self.cycles-pp.ktime_get
      0.61 ±  4%      -0.3        0.30 ±  9%  perf-profile.self.cycles-pp.xlog_cil_insert_items
      0.48 ±  3%      -0.2        0.23 ± 10%  perf-profile.self.cycles-pp.xfs_agino_range
      0.54            -0.2        0.30 ±  8%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.27 ±  3%      -0.2        0.05 ±  8%  perf-profile.self.cycles-pp.__xfs_btree_check_sblock
      0.49 ±  5%      -0.2        0.29 ± 14%  perf-profile.self.cycles-pp.__percpu_counter_sum
      0.36 ±  6%      -0.2        0.15 ± 13%  perf-profile.self.cycles-pp.xfs_log_ticket_ungrant
      0.46 ±  3%      -0.2        0.26 ±  7%  perf-profile.self.cycles-pp.xfs_verify_ino
      0.58 ±  3%      -0.2        0.40 ±  5%  perf-profile.self.cycles-pp.xfs_buf_find
      0.37 ±  4%      -0.2        0.18 ±  4%  perf-profile.self.cycles-pp.xfs_trans_dirty_buf
      0.46            -0.2        0.27 ±  7%  perf-profile.self.cycles-pp.xfs_perag_get
      0.34 ±  4%      -0.2        0.16 ± 15%  perf-profile.self.cycles-pp.unwind_next_frame
      0.47 ±  4%      -0.2        0.29 ±  4%  perf-profile.self.cycles-pp.xfs_inode_item_format
      0.27 ±  7%      -0.2        0.10 ±  4%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      0.38 ±  9%      -0.2        0.21 ± 15%  perf-profile.self.cycles-pp.menu_select
      0.34 ± 12%      -0.2        0.18 ± 12%  perf-profile.self.cycles-pp.xfs_errortag_test
      0.61            -0.2        0.45 ± 10%  perf-profile.self.cycles-pp._xfs_trans_bjoin
      0.29 ±  7%      -0.2        0.14 ±  8%  perf-profile.self.cycles-pp.__orc_find
      0.29 ±  5%      -0.1        0.15 ± 12%  perf-profile.self.cycles-pp.strncpy_from_user
      0.52 ±  2%      -0.1        0.39 ±  7%  perf-profile.self.cycles-pp.xfs_buf_item_init
      0.29 ±  2%      -0.1        0.16 ±  2%  perf-profile.self.cycles-pp.kmem_cache_free
      0.47 ±  7%      -0.1        0.34 ±  4%  perf-profile.self.cycles-pp.xfs_next_bit
      0.24 ±  7%      -0.1        0.11 ±  9%  perf-profile.self.cycles-pp.xfs_dir3_leaf_check_int
      0.24 ±  9%      -0.1        0.12 ±  7%  perf-profile.self.cycles-pp.down_write
      0.20 ±  5%      -0.1        0.08 ±  5%  perf-profile.self.cycles-pp.__schedule
      0.20 ±  6%      -0.1        0.08 ±  8%  perf-profile.self.cycles-pp.xlog_grant_add_space
      0.21 ±  5%      -0.1        0.10 ± 11%  perf-profile.self.cycles-pp.down_read
      0.24 ±  2%      -0.1        0.13 ±  9%  perf-profile.self.cycles-pp.inode_permission
      0.17 ±  2%      -0.1        0.06 ±  6%  perf-profile.self.cycles-pp.__account_scheduler_latency
      0.24 ±  9%      -0.1        0.13 ±  6%  perf-profile.self.cycles-pp.xfs_btree_lookup
      0.22 ±  6%      -0.1        0.11 ± 14%  perf-profile.self.cycles-pp.xfs_ag_block_count
      0.13 ±  5%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.update_cfs_rq_h_load
      0.22 ±  3%      -0.1        0.12 ± 11%  perf-profile.self.cycles-pp.xfs_dir_ino_validate
      0.24 ±  3%      -0.1        0.14 ± 10%  perf-profile.self.cycles-pp.xfs_da_hashname
      0.25 ± 10%      -0.1        0.15 ±  9%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.18 ±  2%      -0.1        0.09 ±  4%  perf-profile.self.cycles-pp.lockref_put_return
      0.42 ±  9%      -0.1        0.32 ±  5%  perf-profile.self.cycles-pp._xfs_buf_obj_cmp
      0.14 ±  7%      -0.1        0.05 ±  8%  perf-profile.self.cycles-pp.__module_address
      0.16 ±  5%      -0.1        0.07 ± 10%  perf-profile.self.cycles-pp.rwsem_down_write_slowpath
      0.16 ±  4%      -0.1        0.08 ± 12%  perf-profile.self.cycles-pp.xlog_space_left
      0.12 ±  3%      -0.1        0.04 ± 58%  perf-profile.self.cycles-pp.xfs_btree_lookup_get_block
      0.10 ±  4%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.try_to_wake_up
      0.10 ± 18%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.18 ±  8%      -0.1        0.11 ±  3%  perf-profile.self.cycles-pp.xfs_buf_get_map
      0.23 ±  3%      -0.1        0.15 ± 10%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.17 ±  9%      -0.1        0.10 ± 10%  perf-profile.self.cycles-pp.xfs_trans_del_item
      0.17 ±  6%      -0.1        0.10 ± 11%  perf-profile.self.cycles-pp.__might_sleep
      0.46 ±  3%      -0.1        0.39 ±  8%  perf-profile.self.cycles-pp.xfs_buf_item_format
      0.14 ± 12%      -0.1        0.07 ± 10%  perf-profile.self.cycles-pp.link_path_walk
      0.11 ±  6%      -0.1        0.04 ± 60%  perf-profile.self.cycles-pp.update_rq_clock
      0.16 ± 11%      -0.1        0.09 ±  8%  perf-profile.self.cycles-pp.__list_add_valid
      0.14 ±  5%      -0.1        0.08 ± 10%  perf-profile.self.cycles-pp.xfs_dir2_data_entry_tag_p
      0.14 ± 11%      -0.1        0.07 ± 14%  perf-profile.self.cycles-pp.xfs_dir2_block_sfsize
      0.30 ±  7%      -0.1        0.24 ±  7%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.12 ±  4%      -0.1        0.06 ± 11%  perf-profile.self.cycles-pp.do_idle
      0.15 ±  9%      -0.1        0.09 ± 14%  perf-profile.self.cycles-pp.xfs_trans_log_inode
      0.09 ±  7%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.xfs_create
      0.12 ± 16%      -0.1        0.07 ± 13%  perf-profile.self.cycles-pp.xfs_buf_item_log
      0.10 ± 11%      -0.1        0.04 ± 57%  perf-profile.self.cycles-pp.xfs_buf_item_put
      0.16 ±  6%      -0.1        0.10 ± 14%  perf-profile.self.cycles-pp.__d_lookup_rcu
      0.13 ±  3%      -0.1        0.08 ±  6%  perf-profile.self.cycles-pp._find_next_bit
      0.12 ±  5%      -0.1        0.06 ± 13%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.17 ± 11%      -0.1        0.11 ±  7%  perf-profile.self.cycles-pp.__d_lookup
      0.13 ±  8%      -0.1        0.07 ± 11%  perf-profile.self.cycles-pp.native_sched_clock
      0.10 ± 11%      -0.1        0.04 ± 58%  perf-profile.self.cycles-pp.apparmor_file_alloc_security
      0.16 ±  6%      -0.1        0.11 ± 12%  perf-profile.self.cycles-pp.xfs_perag_put
      0.09 ±  7%      -0.0        0.04 ± 58%  perf-profile.self.cycles-pp.update_curr
      0.11 ±  6%      -0.0        0.06 ± 20%  perf-profile.self.cycles-pp.scramble
      0.09 ± 16%      -0.0        0.04 ± 57%  perf-profile.self.cycles-pp.__switch_to_asm
      0.13 ± 12%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.lockref_get_not_dead
      0.10 ±  8%      -0.0        0.05        perf-profile.self.cycles-pp.__mnt_want_write
      0.11 ±  9%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.read_tsc
      0.10 ± 14%      -0.0        0.06 ±  9%  perf-profile.self.cycles-pp.__destroy_inode
      0.07 ±  6%      -0.0        0.03 ±100%  perf-profile.self.cycles-pp.creat64
      0.11 ±  6%      -0.0        0.07 ± 17%  perf-profile.self.cycles-pp.xfs_dir2_block_addname
      0.08 ± 14%      -0.0        0.04 ± 57%  perf-profile.self.cycles-pp.get_list
      0.13 ±  3%      -0.0        0.10 ±  5%  perf-profile.self.cycles-pp.dsearch
      0.11 ± 13%      -0.0        0.07 ± 10%  perf-profile.self.cycles-pp.up_write
      0.10 ±  7%      -0.0        0.06 ± 13%  perf-profile.self.cycles-pp.update_load_avg
      0.09 ± 13%      -0.0        0.05 ±  8%  perf-profile.self.cycles-pp.xfs_trans_read_buf_map
      0.12 ±  3%      -0.0        0.08 ±  8%  perf-profile.self.cycles-pp.memset_erms
      0.11 ±  3%      -0.0        0.08 ±  6%  perf-profile.self.cycles-pp.___might_sleep
      0.07 ±  5%      -0.0        0.04 ± 58%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.10 ±  7%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.xfs_trans_ijoin
      0.10 ± 18%      -0.0        0.07 ± 12%  perf-profile.self.cycles-pp.tick_nohz_next_event
      0.07 ± 10%      -0.0        0.04 ± 57%  perf-profile.self.cycles-pp.rcu_sched_clock_irq
      0.08 ± 10%      -0.0        0.05 ±  8%  perf-profile.self.cycles-pp.page_counter_cancel
      0.09 ± 10%      -0.0        0.06 ± 14%  perf-profile.self.cycles-pp._atomic_dec_and_lock
      0.08 ± 12%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.xfs_trans_buf_item_match
      0.06 ±  6%      +0.0        0.08 ± 10%  perf-profile.self.cycles-pp.switch_fpu_return
      0.08 ±  5%      +0.0        0.12 ±  5%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.03 ±100%      +0.0        0.07 ± 11%  perf-profile.self.cycles-pp.__kmalloc
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.inode_init_once
      0.00            +0.1        0.06 ±  9%  perf-profile.self.cycles-pp.xlog_write
      0.00            +0.1        0.06 ±  9%  perf-profile.self.cycles-pp.xfs_iflush
      0.03 ±100%      +0.1        0.08 ± 10%  perf-profile.self.cycles-pp.xfs_inobt_init_key_from_rec
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.xfs_inode_to_disk
      0.00            +0.1        0.07 ±  7%  perf-profile.self.cycles-pp.kernel_fpu_begin
      0.00            +0.1        0.07 ±  6%  perf-profile.self.cycles-pp.___slab_alloc
      0.00            +0.1        0.07 ± 19%  perf-profile.self.cycles-pp.crc_21
      0.00            +0.1        0.07 ±  5%  perf-profile.self.cycles-pp.xfs_cil_prepare_item
      0.04 ± 57%      +0.1        0.12 ± 13%  perf-profile.self.cycles-pp.kfree
      0.00            +0.1        0.09 ±  7%  perf-profile.self.cycles-pp.__slab_free
      0.00            +0.1        0.10 ± 11%  perf-profile.self.cycles-pp.xfs_iflush_cluster
      0.00            +0.1        0.11 ± 13%  perf-profile.self.cycles-pp.brd_do_bvec
      0.00            +0.1        0.11 ±  7%  perf-profile.self.cycles-pp.rhashtable_rehash_table
      0.00            +0.1        0.11 ±  9%  perf-profile.self.cycles-pp.xfs_iunlink_insert_backref
      0.09 ±  8%      +0.2        0.25 ± 10%  perf-profile.self.cycles-pp.rwsem_optimistic_spin
      5.10 ±  5%     +34.2       39.29 ±  8%  perf-profile.self.cycles-pp.osq_lock


                                                                                
                                  aim7.jobs-per-min                             
                                                                                
  120000 +------------------------------------------------------------------+   
         |.++.+.++.+.++.+.++.+.++.+  +.+.+.++.+.++.+.++.+.++.+.++.+.++.+.++.|   
  100000 |-+                      :  :                                      |   
         |                        :  : O O OO O                             |   
         | OO O OO O OO O OO O OO : O:                                      |   
   80000 |-+                       : :                                      |   
         |                         : :                                      |   
   60000 |-+                       : :                                      |   
         |                         ::                                       |   
   40000 |-+                       ::                                       |   
         |                         ::                                       |   
         |                          :                                       |   
   20000 |-+                        :                                       |   
         |                          :                                       |   
       0 +------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                         aim7.time.voluntary_context_switches                   
                                                                                
  1.8e+07 +-----------------------------------------------------------------+   
          |.+           .+.    +. .+  +. +.        +. .+      .++.+.       .|   
  1.6e+07 |-++.+.++.+.++   ++.+  + :  : +  +.++.+.+  +  +.+.++      ++.+.++ |   
  1.4e+07 |-+                      :  :                                     |   
          | OO O    O O    O  OO   :  :                                     |   
  1.2e+07 |-+    OO    O O  O    O :O:                                      |   
    1e+07 |-+                      : :                                      |   
          |                        : :                                      |   
    8e+06 |-+                       ::                                      |   
    6e+06 |-+                       ::O OO O OO                             |   
          |                         ::                                      |   
    4e+06 |-+                       :                                       |   
    2e+06 |-+                       :                                       |   
          |                         :                                       |   
        0 +-----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            aim7.time.file_system_inputs                        
                                                                                
  20000 +-------------------------------------------------------------------+   
  18000 |-O       O      O                O O                               |   
        |      O O     O      O O OO O O     O                              |   
  16000 |-+O O             OO           O                                   |   
  14000 |-+                                                                 |   
        |             O                                                     |   
  12000 |-+                                                                 |   
  10000 |-+                                                                 |   
   8000 |-+                                                                 |   
        |                                                                   |   
   6000 |-+                                                                 |   
   4000 |-+                                                                 |   
        |                                                                   |   
   2000 |.++.+.+.++.+.++.+.++.+.+.+ .+.++.+.++.+.+.++.+.++.+.++.+.+.++.+.++.|   
      0 +-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.10.0-rc1-00055-g3d46c44ae16b" of type "text/plain" (171559 bytes)

View attachment "job-script" of type "text/plain" (8252 bytes)

View attachment "job.yaml" of type "text/plain" (5702 bytes)

View attachment "reproduce" of type "text/plain" (1028 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ