lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Tue, 22 Jun 2021 20:52:53 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     "Darrick J. Wong" <djwong@...nel.org>
Cc:     LKML <linux-kernel@...r.kernel.org>,
        "Darrick J. Wong" <darrick.wong@...cle.com>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...ux.intel.com
Subject: [xfs]  752d5513e6:  stress-ng.dentry.ops_per_sec -26.1% regression



Greeting,

FYI, we noticed a -26.1% regression of stress-ng.dentry.ops_per_sec due to commit:


commit: 752d5513e6e9f5128d3176e7d780f6b06bbb56f0 ("xfs: defer inode inactivation to a workqueue")
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git vectorized-scrub


in testcase: stress-ng
on test machine: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
with following parameters:

	nr_threads: 10%
	disk: 1HDD
	testtime: 60s
	fs: xfs
	class: filesystem
	test: dentry
	cpufreq_governor: performance
	ucode: 0x42e


In addition to that, the commit also has significant impact on the following tests:

+------------------+---------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.chattr.ops_per_sec 413.4% improvement                      |
| test machine     | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory |
| test parameters  | class=filesystem                                                                |
|                  | cpufreq_governor=performance                                                    |
|                  | disk=1HDD                                                                       |
|                  | fs=xfs                                                                          |
|                  | nr_threads=10%                                                                  |
|                  | test=chattr                                                                     |
|                  | testtime=60s                                                                    |
|                  | ucode=0x42e                                                                     |
+------------------+---------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.dnotify.ops_per_sec -72.5% regression                      |
| test machine     | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory |
| test parameters  | class=filesystem                                                                |
|                  | cpufreq_governor=performance                                                    |
|                  | disk=1HDD                                                                       |
|                  | fs=xfs                                                                          |
|                  | nr_threads=10%                                                                  |
|                  | test=dnotify                                                                    |
|                  | testtime=60s                                                                    |
|                  | ucode=0x42e                                                                     |
+------------------+---------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.dir.ops_per_sec -29.1% regression                          |
| test machine     | 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory |
| test parameters  | class=filesystem                                                                |
|                  | cpufreq_governor=performance                                                    |
|                  | disk=1HDD                                                                       |
|                  | fs=xfs                                                                          |
|                  | nr_threads=10%                                                                  |
|                  | test=dir                                                                        |
|                  | testtime=60s                                                                    |
|                  | ucode=0x42e                                                                     |
+------------------+---------------------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml  # generate the yaml file for lkp run
        bin/lkp run                    generated-yaml-file

=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/dentry/stress-ng/60s/0x42e

commit: 
  ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
  752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   1443226           -24.7%    1087366 ±  2%  stress-ng.dentry.ops
     23873           -26.1%      17630 ±  2%  stress-ng.dentry.ops_per_sec
      6279 ±  4%     -52.7%       2969 ± 12%  stress-ng.time.involuntary_context_switches
    182.50           -26.6%     134.00 ±  5%  stress-ng.time.percent_of_cpu_this_job_got
    101.44           -23.9%      77.22 ±  6%  stress-ng.time.system_time
      2845 ±  2%   +9422.7%     270984 ±  8%  stress-ng.time.voluntary_context_switches
      0.00 ± 49%      +0.3        0.28 ± 19%  mpstat.cpu.all.iowait%
      0.64 ±  3%      -0.1        0.50 ±  6%  mpstat.cpu.all.usr%
     12270 ± 48%     -55.0%       5520 ± 29%  softirqs.CPU10.RCU
    336454 ± 14%     -23.2%     258444 ± 13%  softirqs.RCU
     43228 ± 23%   +1266.3%     590625 ±  6%  turbostat.C1
      0.07 ± 16%      +0.3        0.34 ± 10%  turbostat.C1%
   2424846 ±  6%    +344.0%   10765180 ± 10%  cpuidle.C1.time
     56275 ±  6%    +959.5%     596260 ±  7%  cpuidle.C1.usage
      2196 ± 18%    +281.5%       8380 ± 18%  cpuidle.POLL.usage
      0.46 ± 13%     +54.4%       0.72 ± 28%  perf-sched.total_wait_and_delay.average.ms
      0.42 ± 11%     +64.3%       0.69 ± 30%  perf-sched.total_wait_time.average.ms
      1.79 ±102%    +492.3%      10.61 ± 82%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      1.79 ±102%    +492.3%      10.61 ± 82%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
     11365 ±  3%     +47.7%      16787        vmstat.io.bo
   1290368           +24.7%    1609253 ±  2%  vmstat.memory.cache
      2482 ±  2%    +686.7%      19529 ±  8%  vmstat.system.cs
     95877            +0.9%      96697        vmstat.system.in
    217992          +144.6%     533199 ±  8%  meminfo.KReclaimable
   2269047           +29.7%    2942056 ±  2%  meminfo.Memused
    217992          +144.6%     533199 ±  8%  meminfo.SReclaimable
    115859 ±  4%    +193.4%     339987 ±  6%  meminfo.SUnreclaim
    333852 ±  2%    +161.5%     873187 ±  7%  meminfo.Slab
   2286823           +30.2%    2978379 ±  2%  meminfo.max_used_kB
     54557          +144.4%     133335 ±  8%  proc-vmstat.nr_slab_reclaimable
     28961 ±  4%    +193.4%      84985 ±  6%  proc-vmstat.nr_slab_unreclaimable
      8.83 ±135%  +32252.8%       2857 ± 93%  proc-vmstat.numa_hint_faults
      5.67 ±129%  +45432.4%       2580 ± 96%  proc-vmstat.numa_hint_faults_local
    545645            +6.5%     581207        proc-vmstat.numa_hit
    501967            +7.1%     537522        proc-vmstat.numa_local
      2.83 ±223%   +9670.6%     276.83 ±194%  proc-vmstat.numa_pages_migrated
      1713 ±197%    +935.2%      17736 ± 51%  proc-vmstat.numa_pte_updates
    662756           +70.1%    1127661        proc-vmstat.pgalloc_normal
    221293            +2.8%     227500        proc-vmstat.pgfault
    567188 ±  6%     +37.9%     782168 ±  3%  proc-vmstat.pgfree
      2.83 ±223%   +9670.6%     276.83 ±194%  proc-vmstat.pgmigrate_success
    753556 ±  3%     +47.6%    1112216        proc-vmstat.pgpgout
     43966 ± 12%     +78.0%      78263 ± 11%  interrupts.CAL:Function_call_interrupts
    188.17 ± 12%     +99.5%     375.33 ± 67%  interrupts.CPU15.NMI:Non-maskable_interrupts
    188.17 ± 12%     +99.5%     375.33 ± 67%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
    190.33 ± 18%    +266.6%     697.83 ± 80%  interrupts.CPU18.NMI:Non-maskable_interrupts
    190.33 ± 18%    +266.6%     697.83 ± 80%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
    803.67 ±  2%     +68.5%       1354 ± 42%  interrupts.CPU2.CAL:Function_call_interrupts
    168.50 ± 12%    +122.6%     375.00 ± 38%  interrupts.CPU20.NMI:Non-maskable_interrupts
    168.50 ± 12%    +122.6%     375.00 ± 38%  interrupts.CPU20.PMI:Performance_monitoring_interrupts
    792.00           +47.7%       1169 ± 20%  interrupts.CPU25.CAL:Function_call_interrupts
    239.33 ± 31%    +147.7%     592.83 ± 77%  interrupts.CPU32.NMI:Non-maskable_interrupts
    239.33 ± 31%    +147.7%     592.83 ± 77%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
    811.50 ±  3%    +140.5%       1951 ± 70%  interrupts.CPU33.CAL:Function_call_interrupts
    795.00 ±  2%    +194.9%       2344 ±124%  interrupts.CPU4.CAL:Function_call_interrupts
    778.00 ±  4%    +225.1%       2529 ± 82%  interrupts.CPU7.CAL:Function_call_interrupts
    571.83 ± 15%    +489.2%       3369 ± 15%  interrupts.RES:Rescheduling_interrupts
     11.14 ± 12%    +185.2%      31.77 ± 10%  perf-stat.i.MPKI
 1.406e+09 ±  3%     -25.8%  1.044e+09 ±  3%  perf-stat.i.branch-instructions
      2.27 ±  5%      +3.6        5.88 ±  7%  perf-stat.i.branch-miss-rate%
  32230030 ±  3%     -15.4%   27274261 ±  7%  perf-stat.i.branch-misses
     13.19 ± 13%      +5.9       19.09 ±  7%  perf-stat.i.cache-miss-rate%
      2380 ±  2%    +746.4%      20150 ±  8%  perf-stat.i.context-switches
      1.43 ±  6%    +175.5%       3.93 ±  5%  perf-stat.i.cpi
      1033 ± 18%     -29.1%     732.43 ± 13%  perf-stat.i.cycles-between-cache-misses
  34965733 ±  3%     -19.5%   28145504 ±  2%  perf-stat.i.dTLB-load-misses
 1.871e+09           -26.1%  1.384e+09 ±  4%  perf-stat.i.dTLB-loads
      0.12 ±  9%      +0.0        0.16 ±  5%  perf-stat.i.dTLB-store-miss-rate%
 1.233e+09 ±  3%     -20.9%  9.756e+08 ±  5%  perf-stat.i.dTLB-stores
     48.62 ±  7%      +9.0       57.62 ±  3%  perf-stat.i.iTLB-load-miss-rate%
 7.226e+09 ±  3%     -26.4%  5.318e+09 ±  3%  perf-stat.i.instructions
      4253 ± 13%     -29.9%       2981 ±  4%  perf-stat.i.instructions-per-iTLB-miss
      0.71 ±  5%     -35.6%       0.46 ±  4%  perf-stat.i.ipc
    134.63 ± 18%    +222.4%     434.05 ± 13%  perf-stat.i.metric.K/sec
     95.58           -24.3%      72.32 ±  4%  perf-stat.i.metric.M/sec
    302514 ±126%    +259.2%    1086769 ± 57%  perf-stat.i.node-load-misses
    770854 ± 41%    +179.1%    2151403 ± 25%  perf-stat.i.node-loads
    812280 ± 19%     +87.1%    1520019 ± 20%  perf-stat.i.node-stores
     10.96 ± 11%     +37.2%      15.05 ±  5%  perf-stat.overall.MPKI
      2.29 ±  4%      +0.3        2.61 ±  7%  perf-stat.overall.branch-miss-rate%
      1.41 ±  5%     +26.6%       1.78 ±  5%  perf-stat.overall.cpi
      1030 ± 18%     -27.2%     750.20 ± 13%  perf-stat.overall.cycles-between-cache-misses
      1.83 ±  3%      +0.2        2.00 ±  3%  perf-stat.overall.dTLB-load-miss-rate%
      0.12 ±  9%      +0.0        0.14 ±  7%  perf-stat.overall.dTLB-store-miss-rate%
      0.71 ±  5%     -21.1%       0.56 ±  5%  perf-stat.overall.ipc
 1.384e+09 ±  3%     -25.6%  1.029e+09 ±  3%  perf-stat.ps.branch-instructions
  31703659 ±  3%     -15.3%   26857528 ±  7%  perf-stat.ps.branch-misses
      2342 ±  2%    +747.6%      19852 ±  8%  perf-stat.ps.context-switches
  34418379 ±  3%     -19.4%   27751346 ±  2%  perf-stat.ps.dTLB-load-misses
 1.842e+09           -25.9%  1.364e+09 ±  4%  perf-stat.ps.dTLB-loads
 1.214e+09 ±  3%     -20.8%  9.615e+08 ±  5%  perf-stat.ps.dTLB-stores
 7.111e+09 ±  3%     -26.3%  5.243e+09 ±  3%  perf-stat.ps.instructions
    297721 ±126%    +259.7%    1070841 ± 57%  perf-stat.ps.node-load-misses
    758624 ± 41%    +179.3%    2119119 ± 25%  perf-stat.ps.node-loads
    798769 ± 19%     +87.5%    1497519 ± 20%  perf-stat.ps.node-stores
 4.541e+11 ±  2%     -24.8%  3.415e+11 ±  3%  perf-stat.total.instructions
      1498 ± 27%     +47.5%       2208 ± 13%  slabinfo.Acpi-Parse.active_objs
      1498 ± 27%     +47.5%       2208 ± 13%  slabinfo.Acpi-Parse.num_objs
    399.50 ± 29%    +121.4%     884.67 ± 14%  slabinfo.bfq_io_cq.active_objs
    399.50 ± 29%    +121.4%     884.67 ± 14%  slabinfo.bfq_io_cq.num_objs
    762006           -14.5%     651709        slabinfo.dentry.active_objs
     18145           -14.5%      15519        slabinfo.dentry.active_slabs
    762146           -14.5%     651830        slabinfo.dentry.num_objs
     18145           -14.5%      15519        slabinfo.dentry.num_slabs
      1306 ± 10%     +57.7%       2059 ± 16%  slabinfo.dmaengine-unmap-16.active_objs
      1306 ± 10%     +59.6%       2085 ± 16%  slabinfo.dmaengine-unmap-16.num_objs
    979.33 ± 15%     +22.3%       1197 ± 11%  slabinfo.file_lock_cache.active_objs
    979.33 ± 15%     +22.3%       1197 ± 11%  slabinfo.file_lock_cache.num_objs
    733.17 ± 35%     +65.5%       1213 ± 11%  slabinfo.ip6-frags.active_objs
    733.17 ± 35%     +65.5%       1213 ± 11%  slabinfo.ip6-frags.num_objs
     18981         +1462.1%     296503 ± 11%  slabinfo.kmalloc-16.active_objs
     74.17         +1464.9%       1160 ± 11%  slabinfo.kmalloc-16.active_slabs
     18986         +1465.8%     297289 ± 11%  slabinfo.kmalloc-16.num_objs
     74.17         +1464.9%       1160 ± 11%  slabinfo.kmalloc-16.num_slabs
      3579 ±  2%     +69.6%       6068 ±  5%  slabinfo.kmalloc-1k.active_objs
      3682           +65.8%       6106 ±  5%  slabinfo.kmalloc-1k.num_objs
     55221           +21.2%      66933 ±  2%  slabinfo.kmalloc-32.active_objs
     55411           +21.5%      67351 ±  2%  slabinfo.kmalloc-32.num_objs
      1453 ±  5%     +29.5%       1882 ±  2%  slabinfo.kmalloc-4k.active_objs
      1475 ±  6%     +32.6%       1956 ±  2%  slabinfo.kmalloc-4k.num_objs
     25533 ±  4%   +1058.0%     295666 ± 12%  slabinfo.kmalloc-512.active_objs
    952.83 ±  4%    +876.7%       9306 ± 12%  slabinfo.kmalloc-512.active_slabs
     30507 ±  4%    +876.2%     297822 ± 12%  slabinfo.kmalloc-512.num_objs
    952.83 ±  4%    +876.7%       9306 ± 12%  slabinfo.kmalloc-512.num_slabs
    656.50 ±  7%   +1113.4%       7966 ±  2%  slabinfo.kmalloc-8k.active_objs
    169.33 ±  7%   +1232.0%       2255 ±  2%  slabinfo.kmalloc-8k.active_slabs
    678.83 ±  7%   +1229.3%       9023 ±  2%  slabinfo.kmalloc-8k.num_objs
    169.33 ±  7%   +1232.0%       2255 ±  2%  slabinfo.kmalloc-8k.num_slabs
     19104           +30.4%      24908 ±  5%  slabinfo.kmalloc-rcl-512.active_objs
    598.17           +31.7%     787.83 ±  4%  slabinfo.kmalloc-rcl-512.active_slabs
     19153           +31.7%      25222 ±  4%  slabinfo.kmalloc-rcl-512.num_objs
    598.17           +31.7%     787.83 ±  4%  slabinfo.kmalloc-rcl-512.num_slabs
      2078 ± 77%    +208.8%       6416        slabinfo.numa_policy.active_objs
     67.50 ± 77%    +249.4%     235.83        slabinfo.numa_policy.active_slabs
      2108 ± 76%    +247.4%       7324        slabinfo.numa_policy.num_objs
     67.50 ± 77%    +249.4%     235.83        slabinfo.numa_policy.num_slabs
      1280 ± 12%     +17.8%       1508 ±  7%  slabinfo.pool_workqueue.active_objs
      1346 ± 12%     +20.9%       1627 ±  6%  slabinfo.pool_workqueue.num_objs
     13414           +33.8%      17947 ±  4%  slabinfo.radix_tree_node.active_objs
    479.17           +34.6%     645.00 ±  3%  slabinfo.radix_tree_node.active_slabs
     13424           +34.6%      18074 ±  3%  slabinfo.radix_tree_node.num_objs
    479.17           +34.6%     645.00 ±  3%  slabinfo.radix_tree_node.num_slabs
    491.50 ± 28%     +94.0%     953.33 ± 13%  slabinfo.xfs_btree_cur.active_objs
    491.50 ± 28%     +94.0%     953.33 ± 13%  slabinfo.xfs_btree_cur.num_objs
      2465 ± 82%    +331.2%      10631 ± 10%  slabinfo.xfs_buf.active_objs
     59.33 ± 82%    +350.0%     267.00 ±  9%  slabinfo.xfs_buf.active_slabs
      2511 ± 81%    +347.3%      11231 ±  9%  slabinfo.xfs_buf.num_objs
     59.33 ± 82%    +350.0%     267.00 ±  9%  slabinfo.xfs_buf.num_slabs
    390.50 ± 29%     +93.8%     756.83 ± 13%  slabinfo.xfs_da_state.active_objs
    390.50 ± 29%     +93.8%     756.83 ± 13%  slabinfo.xfs_da_state.num_objs
    890.83 ±  7%    +328.6%       3818 ± 19%  slabinfo.xfs_icr.active_objs
    890.83 ±  7%    +334.5%       3870 ± 19%  slabinfo.xfs_icr.num_objs
      9665         +2975.4%     297261 ± 12%  slabinfo.xfs_ili.active_objs
    231.17         +2974.6%       7107 ± 12%  slabinfo.xfs_ili.active_slabs
      9718         +2971.8%     298530 ± 12%  slabinfo.xfs_ili.num_objs
    231.17         +2974.6%       7107 ± 12%  slabinfo.xfs_ili.num_slabs
      9482         +3033.0%     297095 ± 12%  slabinfo.xfs_inode.active_objs
    279.67         +3035.2%       8768 ± 12%  slabinfo.xfs_inode.active_slabs
      9523         +3030.7%     298140 ± 12%  slabinfo.xfs_inode.num_objs
    279.67         +3035.2%       8768 ± 12%  slabinfo.xfs_inode.num_slabs
     36.39 ± 10%      -9.0       27.40 ± 11%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     36.30 ± 10%      -9.0       27.32 ± 11%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.47 ± 12%      -6.5        0.00        perf-profile.calltrace.cycles-pp.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.39 ± 12%      -6.4        0.00        perf-profile.calltrace.cycles-pp.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.26 ± 12%      -6.3        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64
      6.23 ± 12%      -6.2        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat
     12.36 ± 10%      -6.0        6.38 ± 10%  perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.01 ± 12%      -5.0        0.00        perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode
     11.23 ± 10%      -2.4        8.79 ± 11%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11.22 ± 10%      -2.4        8.78 ± 11%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11.01 ± 11%      -2.4        8.60 ± 11%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     10.98 ± 11%      -2.4        8.58 ± 11%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      2.67 ±  9%      -2.4        0.28 ±101%  perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create
      9.71 ± 11%      -2.1        7.57 ± 11%  perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      9.49 ± 11%      -2.1        7.36 ± 11%  perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2
      3.46 ±  9%      -2.0        1.48 ± 14%  perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
      4.90 ±  9%      -1.7        3.20 ± 12%  perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
      2.41 ±  7%      -0.5        1.91 ±  9%  perf-profile.calltrace.cycles-pp.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
      1.91 ±  7%      -0.4        1.54 ± 10%  perf-profile.calltrace.cycles-pp.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink
      0.68 ±  3%      -0.3        0.38 ± 72%  perf-profile.calltrace.cycles-pp.xfs_dir2_leafn_lookup_for_entry.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove
      1.09 ±  6%      -0.3        0.82 ±  9%  perf-profile.calltrace.cycles-pp.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink
      0.00            +0.7        0.68 ± 26%  perf-profile.calltrace.cycles-pp.xfs_iunlink_remove.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
      0.00            +0.7        0.72 ± 26%  perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
      0.00            +0.7        0.74 ± 15%  perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
      0.38 ± 71%      +0.8        1.17 ± 31%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__percpu_counter_sum.xfs_fs_statfs.statfs_by_dentry.vfs_statfs
      0.00            +1.2        1.20 ± 28%  perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
      0.00            +1.3        1.27 ± 29%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
      0.00            +1.5        1.53 ± 26%  perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
      0.00            +3.0        2.98 ± 27%  perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
      0.00            +3.0        3.03 ± 27%  perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
      0.00            +3.1        3.12 ± 27%  perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
      0.00            +3.1        3.12 ± 27%  perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
      0.00            +3.1        3.12 ± 27%  perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
      1.23 ± 28%      +3.8        5.06 ± 15%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      1.20 ± 28%      +3.8        5.04 ± 16%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      1.34 ± 27%      +4.3        5.64 ± 13%  perf-profile.calltrace.cycles-pp.ret_from_fork
      1.34 ± 27%      +4.3        5.64 ± 13%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
     36.70 ± 10%      -9.0       27.68 ± 11%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     36.61 ± 10%      -9.0       27.61 ± 11%  perf-profile.children.cycles-pp.do_syscall_64
      6.47 ± 12%      -6.3        0.16 ± 25%  perf-profile.children.cycles-pp.destroy_inode
      6.39 ± 12%      -6.3        0.09 ± 22%  perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
     12.36 ± 10%      -6.0        6.39 ± 11%  perf-profile.children.cycles-pp.do_unlinkat
      6.42 ± 11%      -5.8        0.62 ± 13%  perf-profile.children.cycles-pp.xfs_check_agi_freecount
      4.51 ± 13%      -3.8        0.72 ± 26%  perf-profile.children.cycles-pp.xfs_difree
      5.01 ± 12%      -3.5        1.53 ± 26%  perf-profile.children.cycles-pp.xfs_ifree
      6.23 ± 12%      -3.3        2.98 ± 27%  perf-profile.children.cycles-pp.xfs_inactive_ifree
      6.26 ± 12%      -3.2        3.03 ± 27%  perf-profile.children.cycles-pp.xfs_inactive
      3.41 ± 13%      -3.0        0.44 ± 30%  perf-profile.children.cycles-pp.xfs_difree_inobt
      3.24 ± 11%      -3.0        0.28 ± 15%  perf-profile.children.cycles-pp.xfs_inobt_get_rec
      2.85 ± 13%      -2.6        0.27 ± 15%  perf-profile.children.cycles-pp.xfs_btree_check_sblock
     11.26 ± 10%      -2.4        8.81 ± 11%  perf-profile.children.cycles-pp.do_sys_open
     11.24 ± 10%      -2.4        8.80 ± 11%  perf-profile.children.cycles-pp.do_sys_openat2
     11.04 ± 11%      -2.4        8.62 ± 11%  perf-profile.children.cycles-pp.do_filp_open
     11.02 ± 10%      -2.4        8.60 ± 11%  perf-profile.children.cycles-pp.path_openat
      9.72 ± 11%      -2.2        7.57 ± 11%  perf-profile.children.cycles-pp.xfs_generic_create
      9.50 ± 11%      -2.1        7.37 ± 11%  perf-profile.children.cycles-pp.xfs_create
      2.18 ± 12%      -2.0        0.14 ± 32%  perf-profile.children.cycles-pp.xfs_btree_increment
      3.46 ±  9%      -2.0        1.48 ± 14%  perf-profile.children.cycles-pp.xfs_dialloc_ag
      2.03 ± 13%      -1.8        0.21 ± 20%  perf-profile.children.cycles-pp.xfs_btree_get_rec
      1.90 ± 13%      -1.7        0.17 ± 15%  perf-profile.children.cycles-pp.__xfs_btree_check_sblock
      4.90 ±  9%      -1.7        3.20 ± 12%  perf-profile.children.cycles-pp.xfs_dir_ialloc
      0.92 ± 18%      -0.8        0.08 ± 13%  perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs
      1.06 ± 11%      -0.8        0.25 ± 31%  perf-profile.children.cycles-pp.xfs_difree_finobt
      2.41 ±  7%      -0.5        1.91 ±  9%  perf-profile.children.cycles-pp.xfs_dir_removename
      0.64 ± 16%      -0.5        0.18 ± 15%  perf-profile.children.cycles-pp.xfs_errortag_test
      1.56 ± 11%      -0.4        1.16 ± 11%  perf-profile.children.cycles-pp.xfs_btree_lookup
      1.91 ±  7%      -0.4        1.54 ± 10%  perf-profile.children.cycles-pp.xfs_dir2_node_removename
      1.01 ± 12%      -0.3        0.71 ± 19%  perf-profile.children.cycles-pp.xfs_inode_item_format
      0.30 ± 30%      -0.3        0.03 ±100%  perf-profile.children.cycles-pp.xfs_btree_rec_offset
      1.14 ±  7%      -0.2        0.94 ± 12%  perf-profile.children.cycles-pp.xfs_dir3_data_check
      1.13 ±  6%      -0.2        0.93 ± 11%  perf-profile.children.cycles-pp.__xfs_dir3_data_check
      0.32 ± 15%      -0.2        0.15 ± 13%  perf-profile.children.cycles-pp.xfs_next_bit
      0.68 ± 12%      -0.2        0.52 ± 13%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.72 ±  2%      -0.2        0.56 ± 14%  perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry
      0.49 ± 10%      -0.2        0.34 ± 11%  perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
      0.46 ± 11%      -0.2        0.31 ± 17%  perf-profile.children.cycles-pp.xfs_inode_item_format_data_fork
      0.36 ± 10%      -0.1        0.22 ± 13%  perf-profile.children.cycles-pp.xfs_inobt_update
      0.34 ± 12%      -0.1        0.20 ± 14%  perf-profile.children.cycles-pp.xfs_btree_update
      0.42 ± 10%      -0.1        0.29 ± 17%  perf-profile.children.cycles-pp.xfs_iextents_copy
      0.24 ± 14%      -0.1        0.13 ± 18%  perf-profile.children.cycles-pp.xfs_lookup_get_search_key
      0.18 ± 14%      -0.1        0.08 ± 25%  perf-profile.children.cycles-pp.xfs_inobt_key_diff
      0.11 ± 18%      -0.1        0.03 ±101%  perf-profile.children.cycles-pp.xfs_ilock
      0.24 ±  9%      -0.1        0.16 ± 13%  perf-profile.children.cycles-pp.xfs_bmap_last_offset
      0.21 ± 17%      -0.1        0.14 ± 23%  perf-profile.children.cycles-pp.xfs_iext_lookup_extent
      0.17 ± 12%      -0.1        0.10 ± 14%  perf-profile.children.cycles-pp.xfs_inobt_init_cursor
      0.16 ± 11%      -0.1        0.10 ±  9%  perf-profile.children.cycles-pp.xfs_inobt_init_common
      0.12 ± 20%      -0.1        0.06 ± 45%  perf-profile.children.cycles-pp.xfs_dir2_data_entry_tag_p
      0.19 ± 11%      -0.1        0.13 ± 18%  perf-profile.children.cycles-pp.xfs_bmap_last_extent
      0.13 ± 13%      -0.1        0.07 ± 18%  perf-profile.children.cycles-pp.xfs_inobt_init_key_from_rec
      0.19 ±  9%      -0.1        0.13 ± 15%  perf-profile.children.cycles-pp.xfs_dir2_isblock
      0.15 ± 24%      -0.1        0.10 ± 17%  perf-profile.children.cycles-pp.xfs_btree_ptr_to_daddr
      0.15 ±  8%      -0.0        0.10 ± 14%  perf-profile.children.cycles-pp.xfs_bmap_validate_extent
      0.11 ± 18%      -0.0        0.06 ± 50%  perf-profile.children.cycles-pp.xfs_iext_get_extent
      0.08 ± 14%      -0.0        0.05 ±  7%  perf-profile.children.cycles-pp.xfs_bmapi_update_map
      0.09 ± 11%      -0.0        0.07 ± 14%  perf-profile.children.cycles-pp.xfs_verify_fsbext
      0.08 ± 28%      +0.0        0.12 ± 19%  perf-profile.children.cycles-pp.xfs_bmapi_write
      0.08 ± 32%      +0.0        0.13 ± 16%  perf-profile.children.cycles-pp.xfs_da_grow_inode_int
      0.07 ± 53%      +0.0        0.12 ± 18%  perf-profile.children.cycles-pp.xfs_bmapi_allocate
      0.08 ± 18%      +0.1        0.13 ± 22%  perf-profile.children.cycles-pp.rcu_do_batch
      0.02 ±146%      +0.1        0.08 ± 23%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.02 ± 99%      +0.1        0.08 ± 17%  perf-profile.children.cycles-pp.xfs_btree_del_cursor
      0.05 ± 46%      +0.1        0.11 ± 20%  perf-profile.children.cycles-pp.smpboot_thread_fn
      0.00            +0.1        0.06 ± 17%  perf-profile.children.cycles-pp.xfs_inode_item_init
      0.00            +0.1        0.07 ± 21%  perf-profile.children.cycles-pp.xfs_alloc_cur_check
      0.07 ± 57%      +0.1        0.14 ± 16%  perf-profile.children.cycles-pp.xfs_inode_item_committed
      0.09 ± 20%      +0.1        0.16 ± 15%  perf-profile.children.cycles-pp.__intel_pmu_disable_all
      0.10 ± 15%      +0.1        0.18 ± 18%  perf-profile.children.cycles-pp.intel_pmu_disable_all
      0.08 ± 35%      +0.1        0.16 ± 14%  perf-profile.children.cycles-pp.xfs_alloc_ag_vextent_near
      0.13 ± 26%      +0.1        0.21 ±  9%  perf-profile.children.cycles-pp.xfs_alloc_vextent
      0.00            +0.1        0.08 ± 20%  perf-profile.children.cycles-pp.xfs_alloc_walk_iter
      0.31 ± 10%      +0.1        0.40 ± 12%  perf-profile.children.cycles-pp.__legitimize_path
      0.01 ±223%      +0.1        0.10 ± 25%  perf-profile.children.cycles-pp.run_ksoftirqd
      0.23 ± 16%      +0.1        0.32 ± 17%  perf-profile.children.cycles-pp.xfs_ialloc_read_agi
      0.00            +0.1        0.09 ± 26%  perf-profile.children.cycles-pp.__perf_event_task_sched_out
      0.20 ±  8%      +0.1        0.29 ± 13%  perf-profile.children.cycles-pp.lockref_get_not_dead
      0.00            +0.1        0.10 ± 29%  perf-profile.children.cycles-pp.dequeue_entity
      0.00            +0.1        0.10 ± 30%  perf-profile.children.cycles-pp.xfs_iunlink_map_prev
      0.00            +0.1        0.10 ± 25%  perf-profile.children.cycles-pp.xfs_buf_ioend
      0.13 ± 17%      +0.1        0.24 ±  6%  perf-profile.children.cycles-pp.kmem_alloc_large
      0.00            +0.1        0.11 ± 20%  perf-profile.children.cycles-pp.__perf_pmu_sched_task
      0.00            +0.1        0.11 ± 15%  perf-profile.children.cycles-pp.xfs_iunlink_insert_backref
      0.00            +0.1        0.12 ± 39%  perf-profile.children.cycles-pp.xfs_reclaim_worker
      0.00            +0.1        0.12 ± 30%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.32 ± 14%      +0.1        0.44 ± 14%  perf-profile.children.cycles-pp.__kmalloc
      0.16 ± 20%      +0.1        0.28 ± 23%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.22 ± 15%      +0.1        0.34 ± 15%  perf-profile.children.cycles-pp.xfs_imap_to_bp
      0.26 ± 19%      +0.1        0.39 ± 11%  perf-profile.children.cycles-pp.kmem_alloc
      0.00            +0.1        0.13 ± 25%  perf-profile.children.cycles-pp.perf_pmu_sched_task
      0.00            +0.1        0.14 ± 26%  perf-profile.children.cycles-pp.rhashtable_rehash_table
      0.00            +0.1        0.14 ± 25%  perf-profile.children.cycles-pp.xfs_fs_inode_init_once
      0.00            +0.1        0.15 ± 26%  perf-profile.children.cycles-pp.rht_deferred_worker
      0.00            +0.2        0.16 ± 31%  perf-profile.children.cycles-pp.finish_task_switch
      0.07 ± 18%      +0.2        0.23 ± 21%  perf-profile.children.cycles-pp.xfs_contig_bits
      0.15 ± 16%      +0.2        0.32 ± 21%  perf-profile.children.cycles-pp.up
      0.19 ± 15%      +0.2        0.37 ± 17%  perf-profile.children.cycles-pp.xfs_buf_unlock
      0.00            +0.2        0.18 ± 25%  perf-profile.children.cycles-pp.xfs_iflush
      0.00            +0.2        0.20 ± 12%  perf-profile.children.cycles-pp.xfs_iunlink_update_dinode
      0.03 ±103%      +0.2        0.24 ± 24%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.04 ±102%      +0.2        0.25 ± 30%  perf-profile.children.cycles-pp.try_to_wake_up
      0.04 ± 75%      +0.2        0.27 ± 25%  perf-profile.children.cycles-pp.crc32c
      0.02 ±141%      +0.2        0.26 ± 24%  perf-profile.children.cycles-pp.xfs_dinode_calc_crc
      0.03 ±102%      +0.2        0.28 ± 29%  perf-profile.children.cycles-pp.schedule_idle
      0.18 ± 24%      +0.2        0.42 ± 13%  perf-profile.children.cycles-pp.xfs_iunlink_update_inode
      0.19 ± 13%      +0.3        0.45 ± 17%  perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt
      0.11 ± 13%      +0.3        0.40 ± 14%  perf-profile.children.cycles-pp.allocate_slab
      0.00            +0.3        0.29 ± 24%  perf-profile.children.cycles-pp.xfs_inode_alloc
      0.56 ± 10%      +0.3        0.86 ± 16%  perf-profile.children.cycles-pp.xfs_read_agi
      0.00            +0.3        0.30 ± 23%  perf-profile.children.cycles-pp.schedule_timeout
      0.08 ± 32%      +0.3        0.38 ± 22%  perf-profile.children.cycles-pp.schedule
      0.62 ± 13%      +0.3        0.92 ± 12%  perf-profile.children.cycles-pp.memcpy_erms
      0.38 ± 17%      +0.3        0.68 ± 26%  perf-profile.children.cycles-pp.xfs_iunlink_remove
      0.14 ± 14%      +0.3        0.45 ± 12%  perf-profile.children.cycles-pp.__slab_alloc
      0.14 ± 13%      +0.3        0.44 ± 12%  perf-profile.children.cycles-pp.___slab_alloc
      0.00            +0.3        0.31 ± 23%  perf-profile.children.cycles-pp.__down
      0.00            +0.3        0.31 ± 24%  perf-profile.children.cycles-pp.down
      0.00            +0.3        0.32 ± 24%  perf-profile.children.cycles-pp.xfs_buf_lock
      0.00            +0.3        0.32 ± 30%  perf-profile.children.cycles-pp.xfs_iflush_cluster
      0.00            +0.3        0.34 ± 31%  perf-profile.children.cycles-pp.xfs_inode_item_push
      0.00            +0.4        0.40 ± 26%  perf-profile.children.cycles-pp.xfsaild
      0.00            +0.4        0.40 ± 26%  perf-profile.children.cycles-pp.xfsaild_push
      0.18 ± 24%      +0.4        0.61 ± 38%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.13 ± 23%      +0.5        0.64 ± 24%  perf-profile.children.cycles-pp.__schedule
      0.23 ± 18%      +0.5        0.74 ± 15%  perf-profile.children.cycles-pp.xfs_iunlink
      0.77 ± 12%      +0.5        1.31 ± 11%  perf-profile.children.cycles-pp.xfs_buf_item_format_segment
      0.88 ± 12%      +0.6        1.43 ±  9%  perf-profile.children.cycles-pp.xfs_buf_item_format
      0.99 ±  8%      +0.7        1.66 ± 22%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.00            +3.1        3.12 ± 27%  perf-profile.children.cycles-pp.xfs_inodegc_worker
      0.00            +3.2        3.24 ± 26%  perf-profile.children.cycles-pp.xfs_icwalk
      0.00            +3.2        3.24 ± 26%  perf-profile.children.cycles-pp.xfs_icwalk_ag
      1.23 ± 28%      +3.8        5.06 ± 15%  perf-profile.children.cycles-pp.worker_thread
      1.20 ± 28%      +3.8        5.04 ± 16%  perf-profile.children.cycles-pp.process_one_work
      1.34 ± 27%      +4.3        5.64 ± 13%  perf-profile.children.cycles-pp.kthread
      1.35 ± 27%      +4.3        5.64 ± 13%  perf-profile.children.cycles-pp.ret_from_fork
      0.92 ± 11%      -0.8        0.08 ± 46%  perf-profile.self.cycles-pp.__xfs_btree_check_sblock
      0.82 ± 13%      -0.8        0.06 ± 45%  perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs
      0.50 ± 13%      -0.3        0.16 ± 14%  perf-profile.self.cycles-pp.xfs_errortag_test
      0.24 ± 15%      -0.2        0.03 ±100%  perf-profile.self.cycles-pp.xfs_btree_rec_offset
      0.30 ± 14%      -0.2        0.14 ± 16%  perf-profile.self.cycles-pp.xfs_next_bit
      0.67 ± 12%      -0.2        0.52 ± 14%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.36 ± 18%      -0.2        0.21 ± 23%  perf-profile.self.cycles-pp.xfs_btree_lookup
      0.71 ± 10%      -0.1        0.58 ± 13%  perf-profile.self.cycles-pp.__xfs_dir3_data_check
      0.38 ± 18%      -0.1        0.27 ± 22%  perf-profile.self.cycles-pp.xfs_inode_item_format
      0.42 ± 11%      -0.1        0.32 ± 11%  perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
      0.12 ± 23%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.xfs_iget
      0.13 ± 21%      -0.1        0.06 ± 50%  perf-profile.self.cycles-pp.xfs_inobt_key_diff
      0.15 ± 20%      -0.1        0.08 ± 45%  perf-profile.self.cycles-pp.do_syscall_64
      0.20 ± 16%      -0.1        0.14 ± 23%  perf-profile.self.cycles-pp.xfs_iext_lookup_extent
      0.14 ± 21%      -0.1        0.08 ± 52%  perf-profile.self.cycles-pp.xfs_da3_node_lookup_int
      0.12 ± 10%      -0.1        0.07 ± 24%  perf-profile.self.cycles-pp.xfs_inobt_init_key_from_rec
      0.09 ± 14%      -0.0        0.05 ± 45%  perf-profile.self.cycles-pp.xfs_dir2_data_entry_tag_p
      0.14 ± 14%      -0.0        0.10 ± 13%  perf-profile.self.cycles-pp.strncpy_from_user
      0.08 ± 13%      -0.0        0.05 ±  7%  perf-profile.self.cycles-pp.xfs_bmapi_update_map
      0.09 ± 11%      -0.0        0.06 ± 14%  perf-profile.self.cycles-pp.xfs_verify_fsbext
      0.01 ±223%      +0.1        0.06 ± 16%  perf-profile.self.cycles-pp.xfs_cil_prepare_item
      0.08 ± 21%      +0.1        0.16 ± 14%  perf-profile.self.cycles-pp.__intel_pmu_disable_all
      0.00            +0.1        0.08 ± 27%  perf-profile.self.cycles-pp.__schedule
      0.00            +0.1        0.08 ± 15%  perf-profile.self.cycles-pp.xfs_fs_inode_init_once
      0.20 ±  7%      +0.1        0.29 ± 13%  perf-profile.self.cycles-pp.lockref_get_not_dead
      0.00            +0.1        0.10 ± 10%  perf-profile.self.cycles-pp.xfs_iunlink_insert_backref
      0.17 ± 23%      +0.1        0.28 ± 15%  perf-profile.self.cycles-pp.xfs_buf_item_format_segment
      0.08 ± 19%      +0.1        0.19 ± 14%  perf-profile.self.cycles-pp.allocate_slab
      0.00            +0.1        0.12 ± 26%  perf-profile.self.cycles-pp.rhashtable_rehash_table
      0.14 ± 19%      +0.1        0.27 ± 26%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.06 ± 17%      +0.1        0.21 ± 14%  perf-profile.self.cycles-pp.xfs_contig_bits
      0.82 ±  9%      +0.3        1.08 ± 15%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.60 ± 14%      +0.3        0.90 ± 12%  perf-profile.self.cycles-pp.memcpy_erms
      0.18 ± 24%      +0.4        0.61 ± 39%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath


                                                                                
                                 stress-ng.dentry.ops                           
                                                                                
   1.5e+06 +----------------------------------------------------------------+   
  1.45e+06 |.+.++.+.+  +     ++.+.+. +.+.+.+ .+.+.++.+.+.+      ++.+        |   
           |                        +       +             +.+. +            |   
   1.4e+06 |-+                                                +             |   
  1.35e+06 |-+                                                              |   
           |                                                                |   
   1.3e+06 |-+             O                O O O  O O                      |   
  1.25e+06 |-O      O        OO O O O      O      O    O  O O               |   
   1.2e+06 |-+  O O   O              O O O                                  |   
           |   O       O                                 O                  |   
  1.15e+06 |-+           O                                                  |   
   1.1e+06 |-+                                                O O    O OO O |   
           |                                                     O          |   
  1.05e+06 |-+                                                     O        |   
     1e+06 +----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            stress-ng.dentry.ops_per_sec                        
                                                                                
  25000 +-------------------------------------------------------------------+   
        |.+.+.++.+.+.+.+.++.+.+.   .++.+.+. .+.++.+.+. .+.     +.+.+        |   
  24000 |-+                     +.+        +          +   ++. +             |   
  23000 |-+                                                  +              |   
        |                                                                   |   
  22000 |-+                                                                 |   
  21000 |-O              OO     O O        O O OO O O O                     |   
        |     O  O O        O O     OO   O                OO                |   
  20000 |-+ O  O     O                 O                                    |   
  19000 |-+            O                                O                   |   
        |                                                    O       O      |   
  18000 |-+                                                    O      O   O |   
  17000 |-+                                                      O O    O   |   
        |                                                                   |   
  16000 +-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample

***************************************************************************************************
lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/chattr/stress-ng/60s/0x42e

commit: 
  ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
  752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      6652 ±  6%    +413.4%      34154 ± 26%  stress-ng.chattr.ops
    110.84 ±  6%    +413.4%     569.02 ± 26%  stress-ng.chattr.ops_per_sec
    358525           -23.5%     274162 ±  6%  stress-ng.time.file_system_outputs
     11.33 ±  6%    +255.9%      40.33 ± 22%  stress-ng.time.percent_of_cpu_this_job_got
      6.93 ±  5%    +244.1%      23.86 ± 22%  stress-ng.time.system_time
    152024 ±  6%    +598.2%    1061460 ± 27%  stress-ng.time.voluntary_context_switches
      0.31 ±  3%      +0.5        0.80 ± 19%  mpstat.cpu.all.sys%
     15656 ±  2%      +8.6%      17008 ±  4%  slabinfo.filp.active_objs
     13317           -37.1%       8376 ± 45%  softirqs.CPU8.TASKLET
     13532           -25.0%      10143 ±  7%  softirqs.TASKLET
    456.67           -24.3%     345.83 ±  8%  vmstat.io.bo
      7100 ±  4%    +622.3%      51286 ± 25%  vmstat.system.cs
   9784354 ± 75%    +808.9%   88926742 ± 74%  cpuidle.C1.time
    295397 ±107%    +737.5%    2473882 ± 54%  cpuidle.C1.usage
   4050936 ± 27%     -25.9%    3003642        cpuidle.C6.usage
   1893108 ±107%     -64.0%     681464 ± 23%  cpuidle.POLL.time
    102.67 ±  2%     +20.3%     123.50 ±  5%  turbostat.Avg_MHz
    286621 ±110%    +759.3%    2462825 ± 54%  turbostat.C1
      0.31 ± 76%      +2.6        2.91 ± 74%  turbostat.C1%
   4044781 ± 27%     -25.8%    2999808        turbostat.C6
     23919           -51.3%      11656 ± 71%  interrupts.73:PCI-MSI.2097152-edge.isci-msix
     50082 ±  3%     +62.2%      81218 ± 14%  interrupts.CAL:Function_call_interrupts
     11.67 ±156%   +1428.6%     178.33 ± 98%  interrupts.CPU26.RES:Rescheduling_interrupts
    984.67 ± 28%    +200.5%       2959 ± 67%  interrupts.CPU28.CAL:Function_call_interrupts
      9.17 ± 89%   +1638.2%     159.33 ± 74%  interrupts.CPU30.RES:Rescheduling_interrupts
     23919           -51.3%      11656 ± 71%  interrupts.CPU8.73:PCI-MSI.2097152-edge.isci-msix
      1343 ± 19%    +326.0%       5722 ± 16%  interrupts.RES:Rescheduling_interrupts
     44614           -23.4%      34159 ±  6%  proc-vmstat.nr_dirtied
      5133           -29.0%       3646 ± 10%  proc-vmstat.nr_written
    323981            -3.2%     313681        proc-vmstat.numa_hit
    280278            -3.6%     270120        proc-vmstat.numa_local
    333778            -2.0%     327011        proc-vmstat.pgalloc_normal
    267308            -2.6%     260285        proc-vmstat.pgfree
     29766           -24.7%      22424 ±  8%  proc-vmstat.pgpgout
     52.18 ± 15%     -40.7%      30.96 ±  9%  perf-stat.i.MPKI
 2.518e+08 ±  4%     +53.4%  3.862e+08 ± 11%  perf-stat.i.branch-instructions
     10.21 ± 11%      -4.4        5.79 ± 15%  perf-stat.i.branch-miss-rate%
     22.48 ±  8%      -6.5       16.00 ± 12%  perf-stat.i.cache-miss-rate%
   8833462 ± 22%     -21.3%    6948121 ±  4%  perf-stat.i.cache-misses
      7161 ±  4%    +638.0%      52852 ± 25%  perf-stat.i.context-switches
      6.55 ±  8%     -39.8%       3.94 ± 12%  perf-stat.i.cpi
 5.208e+09 ±  6%     +14.0%  5.939e+09 ±  5%  perf-stat.i.cpu-cycles
    608.00 ± 16%     +41.3%     858.99 ±  8%  perf-stat.i.cycles-between-cache-misses
      1.06 ± 11%      -0.3        0.76 ± 14%  perf-stat.i.dTLB-load-miss-rate%
 2.964e+08 ±  2%     +61.3%  4.781e+08 ± 11%  perf-stat.i.dTLB-loads
      0.19 ±  4%      -0.0        0.17 ±  4%  perf-stat.i.dTLB-store-miss-rate%
     80.42 ±  2%     -28.0       52.45 ± 10%  perf-stat.i.iTLB-load-miss-rate%
   1069939 ± 12%     +29.2%    1382654 ±  4%  perf-stat.i.iTLB-load-misses
    260420 ±  8%    +441.5%    1410231 ± 24%  perf-stat.i.iTLB-loads
 1.204e+09 ±  3%     +55.3%  1.869e+09 ± 11%  perf-stat.i.instructions
      0.19 ±  7%     +48.6%       0.29 ±  8%  perf-stat.i.ipc
      0.11 ±  6%     +14.1%       0.12 ±  5%  perf-stat.i.metric.GHz
     18.16 ±  6%     +43.7%      26.10 ± 11%  perf-stat.i.metric.M/sec
     32.33 ± 16%     -25.7%      24.04 ±  4%  perf-stat.overall.MPKI
      8.32 ±  9%      -2.8        5.57 ± 11%  perf-stat.overall.branch-miss-rate%
     22.51 ±  8%      -6.8       15.69 ± 13%  perf-stat.overall.cache-miss-rate%
      4.34 ±  9%     -26.2%       3.20 ±  7%  perf-stat.overall.cpi
    611.45 ± 16%     +40.3%     857.89 ±  9%  perf-stat.overall.cycles-between-cache-misses
      0.83 ± 11%      -0.2        0.66 ± 11%  perf-stat.overall.dTLB-load-miss-rate%
      0.18 ±  5%      -0.0        0.16 ±  3%  perf-stat.overall.dTLB-store-miss-rate%
     80.23 ±  2%     -29.9       50.35 ± 11%  perf-stat.overall.iTLB-load-miss-rate%
      0.23 ± 10%     +34.9%       0.31 ±  6%  perf-stat.overall.ipc
 2.478e+08 ±  4%     +53.4%  3.801e+08 ± 11%  perf-stat.ps.branch-instructions
   8693373 ± 22%     -21.3%    6837732 ±  4%  perf-stat.ps.cache-misses
      7048 ±  4%    +637.9%      52009 ± 25%  perf-stat.ps.context-switches
 5.126e+09 ±  6%     +14.0%  5.845e+09 ±  5%  perf-stat.ps.cpu-cycles
 2.917e+08 ±  2%     +61.3%  4.705e+08 ± 11%  perf-stat.ps.dTLB-loads
   1052992 ± 12%     +29.2%    1360682 ±  4%  perf-stat.ps.iTLB-load-misses
    256297 ±  8%    +441.5%    1387757 ± 24%  perf-stat.ps.iTLB-loads
 1.185e+09 ±  3%     +55.3%   1.84e+09 ± 11%  perf-stat.ps.instructions
 7.509e+10 ±  3%     +54.9%  1.163e+11 ± 11%  perf-stat.total.instructions
     91.20            -5.0       86.21        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     82.04            -4.7       77.30        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     89.41            -4.7       84.72        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     89.40            -4.7       84.72        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     89.26            -4.7       84.59        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     80.93            -4.5       76.38        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      2.19 ±  7%      -0.4        1.80 ±  7%  perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
      1.17 ± 23%      -0.3        0.85 ±  9%  perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      0.84 ± 12%      -0.3        0.52 ± 46%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      1.50 ±  9%      -0.3        1.19 ± 15%  perf-profile.calltrace.cycles-pp.asm_sysvec_irq_work.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      1.50 ±  9%      -0.3        1.19 ± 15%  perf-profile.calltrace.cycles-pp.sysvec_irq_work.asm_sysvec_irq_work.cpuidle_enter_state.cpuidle_enter.do_idle
      1.50 ±  9%      -0.3        1.19 ± 15%  perf-profile.calltrace.cycles-pp.__sysvec_irq_work.sysvec_irq_work.asm_sysvec_irq_work.cpuidle_enter_state.cpuidle_enter
      1.50 ±  8%      -0.3        1.19 ± 15%  perf-profile.calltrace.cycles-pp.irq_work_run.__sysvec_irq_work.sysvec_irq_work.asm_sysvec_irq_work.cpuidle_enter_state
      1.41 ±  8%      -0.3        1.14 ±  6%  perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
      0.78 ±  8%      +0.2        0.97 ±  9%  perf-profile.calltrace.cycles-pp.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
      0.79 ±  8%      +0.2        0.99 ±  9%  perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.81 ±  8%      +0.2        1.03 ± 10%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.81 ±  8%      +0.2        1.04 ± 10%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.85 ± 18%      +0.4        1.27 ±  8%  perf-profile.calltrace.cycles-pp.vfs_fileattr_set.do_vfs_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.09 ±223%      +0.5        0.62 ±  7%  perf-profile.calltrace.cycles-pp.xfs_fileattr_set.vfs_fileattr_set.do_vfs_ioctl.__x64_sys_ioctl.do_syscall_64
      0.93 ± 19%      +0.5        1.48 ±  9%  perf-profile.calltrace.cycles-pp.do_vfs_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.95 ± 19%      +0.6        1.51 ±  9%  perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +0.7        0.68 ± 14%  perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
      0.00            +0.7        0.74 ± 16%  perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open
      0.00            +0.8        0.79 ±  8%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +0.8        0.84 ± 12%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      0.00            +0.9        0.86 ± 11%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.00            +1.0        0.96 ± 22%  perf-profile.calltrace.cycles-pp.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64
      0.18 ±141%      +1.0        1.14 ± 21%  perf-profile.calltrace.cycles-pp.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.0        0.96 ± 21%  perf-profile.calltrace.cycles-pp.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.28 ±100%      +1.1        1.36 ± 17%  perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2
      0.00            +1.1        1.12 ±  9%  perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
      0.30 ±100%      +1.1        1.44 ± 17%  perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      1.08 ± 10%      +1.2        2.24 ± 13%  perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.4        1.36 ±  6%  perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
      1.14 ± 14%      +1.4        2.57 ± 14%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      0.00            +1.4        1.43 ±  5%  perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
      1.15 ± 14%      +1.4        2.59 ± 14%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.4        1.45 ±  5%  perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
      0.00            +1.5        1.46 ±  5%  perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
      1.72 ± 27%      +1.5        3.18 ± 13%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      2.01 ± 23%      +1.5        3.55 ± 11%  perf-profile.calltrace.cycles-pp.ret_from_fork
      1.24 ± 14%      +1.5        2.78 ± 13%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.01 ± 23%      +1.5        3.55 ± 11%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      1.23 ± 14%      +1.5        2.78 ± 13%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.80 ± 26%      +1.6        3.39 ± 12%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      5.42 ±  9%      +3.3        8.74 ± 10%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.43 ±  9%      +3.3        8.77 ± 10%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     83.71            -5.1       78.64 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter
     83.58            -5.1       78.52 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter_state
     91.20            -5.0       86.20        perf-profile.children.cycles-pp.do_idle
     91.20            -5.0       86.21        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     91.20            -5.0       86.21        perf-profile.children.cycles-pp.cpu_startup_entry
     89.41            -4.7       84.72        perf-profile.children.cycles-pp.start_secondary
      7.83 ±  8%      -0.7        7.12 ±  6%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.73 ± 12%      -0.5        0.23 ± 25%  perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
      0.74 ± 12%      -0.5        0.26 ± 21%  perf-profile.children.cycles-pp.destroy_inode
      2.25 ±  6%      -0.4        1.86 ±  7%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      1.24 ± 24%      -0.3        0.91 ±  8%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.74 ± 14%      -0.3        0.43 ± 10%  perf-profile.children.cycles-pp.__dentry_kill
      0.78 ± 13%      -0.3        0.50 ± 10%  perf-profile.children.cycles-pp.dput
      1.47 ±  8%      -0.3        1.21 ±  6%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.84 ± 12%      -0.2        0.62 ± 13%  perf-profile.children.cycles-pp.__fput
      0.87 ± 12%      -0.2        0.65 ± 16%  perf-profile.children.cycles-pp.task_work_run
      0.53 ±  7%      -0.1        0.45 ± 11%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.18 ± 21%      -0.1        0.11 ± 18%  perf-profile.children.cycles-pp.can_stop_idle_tick
      0.60 ±  8%      -0.1        0.53 ±  8%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.19 ± 24%      -0.1        0.12 ± 16%  perf-profile.children.cycles-pp.rcu_nmi_exit
      0.02 ±142%      +0.0        0.07 ± 18%  perf-profile.children.cycles-pp.new_sync_read
      0.01 ±223%      +0.1        0.06 ± 15%  perf-profile.children.cycles-pp.__switch_to_asm
      0.10 ± 20%      +0.1        0.15 ± 15%  perf-profile.children.cycles-pp.evict
      0.01 ±223%      +0.1        0.06 ± 16%  perf-profile.children.cycles-pp.security_capable
      0.04 ± 71%      +0.1        0.10 ± 18%  perf-profile.children.cycles-pp.xfs_buf_item_format_segment
      0.03 ±100%      +0.1        0.09 ± 34%  perf-profile.children.cycles-pp.xfs_btree_check_sblock
      0.01 ±223%      +0.1        0.07 ± 18%  perf-profile.children.cycles-pp.ns_capable_common
      0.06 ± 49%      +0.1        0.12 ± 15%  perf-profile.children.cycles-pp.xfs_buffered_write_iomap_begin
      0.04 ± 71%      +0.1        0.10 ± 27%  perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
      0.04 ± 72%      +0.1        0.10 ± 29%  perf-profile.children.cycles-pp.down_write
      0.11 ± 27%      +0.1        0.17 ± 20%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.05 ± 46%      +0.1        0.11 ± 42%  perf-profile.children.cycles-pp.rcu_do_batch
      0.00            +0.1        0.06 ± 29%  perf-profile.children.cycles-pp.xfs_btree_increment
      0.00            +0.1        0.07 ± 16%  perf-profile.children.cycles-pp.xfs_trans_alloc_icreate
      0.04 ± 75%      +0.1        0.11 ± 23%  perf-profile.children.cycles-pp.xfs_buf_item_format
      0.02 ±142%      +0.1        0.09 ± 23%  perf-profile.children.cycles-pp.xfs_btree_update
      0.07 ± 25%      +0.1        0.14 ± 13%  perf-profile.children.cycles-pp._xfs_trans_bjoin
      0.04 ± 71%      +0.1        0.11 ± 20%  perf-profile.children.cycles-pp.xfs_inobt_update
      0.03 ±100%      +0.1        0.10 ± 20%  perf-profile.children.cycles-pp.xfs_iget
      0.02 ±141%      +0.1        0.09 ± 31%  perf-profile.children.cycles-pp.xfs_dir_removename
      0.02 ±149%      +0.1        0.10 ± 17%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.03 ±103%      +0.1        0.11 ± 29%  perf-profile.children.cycles-pp.xfs_inobt_get_rec
      0.09 ± 36%      +0.1        0.18 ± 21%  perf-profile.children.cycles-pp.alloc_empty_file
      0.08 ± 40%      +0.1        0.17 ± 23%  perf-profile.children.cycles-pp.__alloc_file
      0.06 ± 21%      +0.1        0.15 ± 32%  perf-profile.children.cycles-pp.xfs_trans_log_inode
      0.01 ±223%      +0.1        0.10 ± 17%  perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.21 ± 23%      +0.1        0.30 ±  8%  perf-profile.children.cycles-pp.osq_lock
      0.01 ±223%      +0.1        0.11 ± 51%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.02 ±142%      +0.1        0.12 ± 43%  perf-profile.children.cycles-pp.xfs_dialloc_select_ag
      0.01 ±223%      +0.1        0.12 ± 13%  perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      0.03 ±102%      +0.1        0.14 ± 25%  perf-profile.children.cycles-pp.set_next_entity
      0.13 ±  9%      +0.1        0.24 ± 20%  perf-profile.children.cycles-pp.xfs_log_reserve
      0.12 ± 23%      +0.1        0.23 ± 12%  perf-profile.children.cycles-pp.xfs_inode_item_format
      0.11 ± 34%      +0.1        0.22 ± 13%  perf-profile.children.cycles-pp.xfs_difree_inobt
      0.03 ±103%      +0.1        0.15 ± 26%  perf-profile.children.cycles-pp.update_curr
      0.08 ± 12%      +0.1        0.20 ± 21%  perf-profile.children.cycles-pp.xfs_fileattr_get
      0.00            +0.1        0.12 ± 38%  perf-profile.children.cycles-pp.xfs_perag_get
      0.01 ±223%      +0.1        0.13 ± 14%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.10 ± 29%      +0.1        0.22 ± 24%  perf-profile.children.cycles-pp.xfs_btree_read_buf_block
      0.15 ± 11%      +0.1        0.28 ± 19%  perf-profile.children.cycles-pp.xfs_trans_reserve
      0.04 ± 72%      +0.1        0.17 ± 28%  perf-profile.children.cycles-pp.up
      0.11 ± 35%      +0.1        0.24 ± 25%  perf-profile.children.cycles-pp.enqueue_entity
      0.01 ±223%      +0.1        0.14 ± 61%  perf-profile.children.cycles-pp.memcpy_erms
      0.08 ± 32%      +0.1        0.21 ± 25%  perf-profile.children.cycles-pp.xfs_buf_item_release
      0.19 ± 21%      +0.1        0.33 ±  8%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.06 ± 51%      +0.1        0.19 ± 18%  perf-profile.children.cycles-pp.__queue_work
      0.05 ± 73%      +0.1        0.19 ± 25%  perf-profile.children.cycles-pp.xfs_buf_unlock
      0.00            +0.2        0.15 ± 27%  perf-profile.children.cycles-pp.queue_delayed_work_on
      0.00            +0.2        0.16 ± 23%  perf-profile.children.cycles-pp.xfs_inodegc_queue
      0.16 ± 25%      +0.2        0.32 ± 29%  perf-profile.children.cycles-pp.schedule_timeout
      0.13 ± 29%      +0.2        0.29 ± 21%  perf-profile.children.cycles-pp.xfs_iunlink_remove
      0.20 ± 16%      +0.2        0.36 ± 15%  perf-profile.children.cycles-pp.xfs_difree
      0.16 ± 20%      +0.2        0.32 ± 18%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.02 ±146%      +0.2        0.19 ± 13%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.13 ± 19%      +0.2        0.30 ± 21%  perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
      0.02 ±144%      +0.2        0.19 ± 15%  perf-profile.children.cycles-pp.__perf_event_task_sched_in
      0.08 ± 46%      +0.2        0.25 ± 37%  perf-profile.children.cycles-pp.down
      0.13 ± 35%      +0.2        0.30 ± 21%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.08 ± 49%      +0.2        0.25 ± 37%  perf-profile.children.cycles-pp.__down
      0.20 ± 15%      +0.2        0.37 ± 18%  perf-profile.children.cycles-pp.xfs_trans_alloc
      0.13 ± 34%      +0.2        0.30 ± 19%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.08 ± 49%      +0.2        0.26 ± 35%  perf-profile.children.cycles-pp.xfs_buf_lock
      0.08 ± 55%      +0.2        0.27 ± 15%  perf-profile.children.cycles-pp.dequeue_entity
      0.78 ±  8%      +0.2        0.97 ±  9%  perf-profile.children.cycles-pp.xfs_file_buffered_write
      0.08 ± 32%      +0.2        0.27 ± 27%  perf-profile.children.cycles-pp.wake_up_q
      0.81 ±  7%      +0.2        1.01 ± 10%  perf-profile.children.cycles-pp.new_sync_write
      0.06 ± 50%      +0.2        0.25 ± 10%  perf-profile.children.cycles-pp.__perf_event_task_sched_out
      0.00            +0.2        0.20 ± 31%  perf-profile.children.cycles-pp.xfs_perag_set_inode_tag
      0.59 ± 12%      +0.2        0.79 ±  7%  perf-profile.children.cycles-pp._raw_spin_lock
      0.12 ± 37%      +0.2        0.33 ± 18%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.84 ±  6%      +0.2        1.05 ± 10%  perf-profile.children.cycles-pp.vfs_write
      0.19 ± 21%      +0.2        0.41 ± 17%  perf-profile.children.cycles-pp.xfs_btree_lookup
      0.10 ± 29%      +0.2        0.32 ± 28%  perf-profile.children.cycles-pp.rwsem_wake
      0.40 ± 14%      +0.2        0.63 ±  8%  perf-profile.children.cycles-pp.xfs_fileattr_set
      0.05 ± 74%      +0.2        0.27 ± 30%  perf-profile.children.cycles-pp.xfs_iunlink
      0.84 ±  7%      +0.2        1.07 ± 10%  perf-profile.children.cycles-pp.ksys_write
      0.06 ± 53%      +0.3        0.34 ±  9%  perf-profile.children.cycles-pp.__perf_pmu_sched_task
      0.19 ± 16%      +0.3        0.47 ± 18%  perf-profile.children.cycles-pp.xfs_check_agi_freecount
      0.26 ± 17%      +0.3        0.54 ± 11%  perf-profile.children.cycles-pp.xlog_cil_insert_items
      0.16 ± 34%      +0.3        0.46 ± 19%  perf-profile.children.cycles-pp.xfs_dialloc_ag
      0.16 ± 52%      +0.3        0.46 ± 12%  perf-profile.children.cycles-pp.finish_task_switch
      0.08 ± 25%      +0.3        0.39 ±  8%  perf-profile.children.cycles-pp.perf_pmu_sched_task
      0.31 ± 22%      +0.3        0.63 ± 12%  perf-profile.children.cycles-pp.try_to_wake_up
      0.17 ± 23%      +0.3        0.50 ± 23%  perf-profile.children.cycles-pp.xfs_buf_find
      0.89 ± 14%      +0.3        1.22 ±  8%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      0.18 ± 17%      +0.3        0.52 ± 24%  perf-profile.children.cycles-pp.xfs_buf_get_map
      0.34 ± 17%      +0.3        0.68 ± 14%  perf-profile.children.cycles-pp.xfs_ifree
      0.20 ± 18%      +0.4        0.55 ± 23%  perf-profile.children.cycles-pp.xfs_buf_read_map
      0.16 ± 19%      +0.4        0.52 ± 29%  perf-profile.children.cycles-pp.xfs_read_agi
      0.85 ± 18%      +0.4        1.27 ±  8%  perf-profile.children.cycles-pp.vfs_fileattr_set
      0.29 ± 16%      +0.5        0.74 ± 18%  perf-profile.children.cycles-pp.xfs_trans_read_buf_map
      0.27 ± 20%      +0.5        0.74 ± 16%  perf-profile.children.cycles-pp.xfs_dir_ialloc
      0.94 ± 19%      +0.5        1.48 ±  9%  perf-profile.children.cycles-pp.do_vfs_ioctl
      0.33 ± 25%      +0.5        0.87 ± 10%  perf-profile.children.cycles-pp.schedule_idle
      0.95 ± 19%      +0.6        1.51 ±  9%  perf-profile.children.cycles-pp.__x64_sys_ioctl
      0.41 ± 17%      +0.6        1.00 ± 12%  perf-profile.children.cycles-pp.schedule
      0.37 ± 14%      +0.6        0.96 ± 22%  perf-profile.children.cycles-pp.xfs_remove
      0.37 ± 14%      +0.6        0.96 ± 21%  perf-profile.children.cycles-pp.xfs_vn_unlink
      0.52 ± 14%      +0.6        1.12 ±  9%  perf-profile.children.cycles-pp.xfs_inactive_ifree
      0.72 ± 13%      +0.6        1.36 ±  6%  perf-profile.children.cycles-pp.xfs_inactive
      0.47 ±  9%      +0.7        1.14 ± 21%  perf-profile.children.cycles-pp.vfs_unlink
      0.62 ± 12%      +0.7        1.35 ± 13%  perf-profile.children.cycles-pp.xfs_log_commit_cil
      0.70 ± 12%      +0.8        1.48 ± 11%  perf-profile.children.cycles-pp.__xfs_trans_commit
      1.22 ± 14%      +0.8        2.02 ±  6%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      0.49 ± 16%      +0.9        1.36 ± 17%  perf-profile.children.cycles-pp.xfs_create
      0.51 ± 18%      +0.9        1.44 ± 17%  perf-profile.children.cycles-pp.xfs_generic_create
      0.74 ± 13%      +1.1        1.84 ±  9%  perf-profile.children.cycles-pp.__schedule
      1.09 ± 10%      +1.2        2.24 ± 13%  perf-profile.children.cycles-pp.do_unlinkat
      1.18 ± 13%      +1.4        2.60 ± 14%  perf-profile.children.cycles-pp.path_openat
      0.00            +1.4        1.43 ±  5%  perf-profile.children.cycles-pp.xfs_icwalk_ag
      1.19 ± 13%      +1.4        2.62 ± 14%  perf-profile.children.cycles-pp.do_filp_open
      0.00            +1.4        1.45 ±  5%  perf-profile.children.cycles-pp.xfs_icwalk
      0.00            +1.5        1.46 ±  5%  perf-profile.children.cycles-pp.xfs_inodegc_worker
      1.72 ± 27%      +1.5        3.18 ± 13%  perf-profile.children.cycles-pp.process_one_work
      1.28 ± 13%      +1.5        2.81 ± 13%  perf-profile.children.cycles-pp.do_sys_open
      1.27 ± 13%      +1.5        2.80 ± 13%  perf-profile.children.cycles-pp.do_sys_openat2
      2.03 ± 23%      +1.5        3.56 ± 11%  perf-profile.children.cycles-pp.ret_from_fork
      2.01 ± 23%      +1.5        3.55 ± 11%  perf-profile.children.cycles-pp.kthread
      1.80 ± 26%      +1.6        3.39 ± 12%  perf-profile.children.cycles-pp.worker_thread
      5.96 ±  9%      +3.3        9.28 ±  9%  perf-profile.children.cycles-pp.do_syscall_64
      5.98 ±  9%      +3.3        9.30 ±  9%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.19 ± 19%      -0.1        0.12 ± 27%  perf-profile.self.cycles-pp.tick_nohz_get_sleep_length
      0.18 ± 22%      -0.1        0.10 ± 17%  perf-profile.self.cycles-pp.can_stop_idle_tick
      0.16 ± 21%      -0.1        0.10 ± 14%  perf-profile.self.cycles-pp.rcu_nmi_exit
      0.16 ± 13%      -0.1        0.10 ± 27%  perf-profile.self.cycles-pp.__remove_hrtimer
      0.22 ± 15%      -0.1        0.16 ± 13%  perf-profile.self.cycles-pp.irq_exit_rcu
      0.14 ± 12%      -0.1        0.08 ± 18%  perf-profile.self.cycles-pp.hrtimer_update_next_event
      0.02 ±141%      +0.1        0.08 ±  8%  perf-profile.self.cycles-pp.xfs_buf_find
      0.11 ± 27%      +0.1        0.17 ± 20%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.10 ± 14%      +0.1        0.17 ± 14%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.03 ±100%      +0.1        0.10 ± 27%  perf-profile.self.cycles-pp.xlog_cil_insert_items
      0.04 ± 72%      +0.1        0.12 ± 33%  perf-profile.self.cycles-pp.xfs_log_commit_cil
      0.01 ±223%      +0.1        0.09 ± 32%  perf-profile.self.cycles-pp.memcpy_erms
      0.07 ± 51%      +0.1        0.16 ± 18%  perf-profile.self.cycles-pp.xfs_inode_item_format
      0.01 ±223%      +0.1        0.10 ± 38%  perf-profile.self.cycles-pp.enqueue_entity
      0.01 ±223%      +0.1        0.11 ± 38%  perf-profile.self.cycles-pp.update_load_avg
      0.21 ± 24%      +0.1        0.30 ±  7%  perf-profile.self.cycles-pp.osq_lock
      0.08 ± 36%      +0.1        0.21 ± 17%  perf-profile.self.cycles-pp.__schedule
      0.55 ± 11%      +0.2        0.75 ±  7%  perf-profile.self.cycles-pp._raw_spin_lock
      0.88 ± 14%      +0.3        1.21 ±  8%  perf-profile.self.cycles-pp.rwsem_spin_on_owner



***************************************************************************************************
lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/dnotify/stress-ng/60s/0x42e

commit: 
  ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
  752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    716513 ±  4%     -72.4%     197697 ±  6%  stress-ng.dnotify.ops
     11941 ±  4%     -72.5%       3280 ±  6%  stress-ng.dnotify.ops_per_sec
  28660457 ±  4%     -72.4%    7907804 ±  6%  stress-ng.time.file_system_outputs
    379.00           -68.5%     119.50 ±  6%  stress-ng.time.percent_of_cpu_this_job_got
    219.75           -68.0%      70.35 ±  6%  stress-ng.time.system_time
     15.73 ± 27%     -72.0%       4.40 ± 25%  stress-ng.time.user_time
    288.67 ± 14%  +1.3e+05%     363311 ±  5%  stress-ng.time.voluntary_context_switches
      2149 ± 19%    +467.0%      12186 ± 21%  cpuidle.POLL.usage
     89.93            +4.4%      93.85        iostat.cpu.idle
      9.29 ±  2%     -42.0%       5.39 ±  7%  iostat.cpu.system
   2826008 ± 44%     -79.4%     582267 ± 34%  numa-numastat.node1.local_node
   2837040 ± 44%     -78.8%     601547 ± 31%  numa-numastat.node1.numa_hit
      0.08 ± 18%     -20.5%       0.06 ± 12%  perf-sched.wait_and_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      6.00 ± 54%    +180.6%      16.83 ± 27%  perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
      0.00 ±223%      +0.3        0.34 ±  7%  mpstat.cpu.all.iowait%
      6.78            -3.9        2.90 ±  5%  mpstat.cpu.all.sys%
      0.72 ± 18%      -0.3        0.37 ± 11%  mpstat.cpu.all.usr%
    322.50           -41.0%     190.33 ±  3%  turbostat.Avg_MHz
     11.15 ±  5%      -3.7        7.41 ±  5%  turbostat.Busy%
      2906 ±  5%     -11.2%       2580 ±  4%  turbostat.Bzy_MHz
      3.00        +5.3e+05%      15876 ±  6%  vmstat.io.bo
   1146773           +29.2%    1481606        vmstat.memory.cache
      4.00           -66.7%       1.33 ± 35%  vmstat.procs.r
      5055 ±  4%    +459.9%      28309 ±  6%  vmstat.system.cs
     96267            +0.9%      97179        vmstat.system.in
      4421 ±  8%     -16.5%       3690 ± 10%  meminfo.Active
      4198 ±  5%     -20.9%       3322        meminfo.Active(anon)
     70801          +467.9%     402075 ±  3%  meminfo.KReclaimable
   2115687           +35.2%    2860204        meminfo.Memused
     70801          +467.9%     402075 ±  3%  meminfo.SReclaimable
    105243          +268.1%     387360 ±  2%  meminfo.SUnreclaim
    176045          +348.4%     789436 ±  3%  meminfo.Slab
   2156637           +33.6%    2881017        meminfo.max_used_kB
     13792 ±  2%    +352.7%      62446 ± 16%  numa-vmstat.node0.nr_slab_reclaimable
     15508 ±  3%    +270.6%      57474 ± 18%  numa-vmstat.node0.nr_slab_unreclaimable
    809.33 ± 11%     -34.1%     533.50 ± 13%  numa-vmstat.node1.nr_active_anon
   1199392 ± 47%     -82.5%     209467 ± 42%  numa-vmstat.node1.nr_dirtied
    406.17 ± 72%     -51.6%     196.67 ±105%  numa-vmstat.node1.nr_mapped
      1191 ± 26%     -44.3%     663.00 ± 32%  numa-vmstat.node1.nr_shmem
      3906 ± 11%    +878.8%      38236 ± 31%  numa-vmstat.node1.nr_slab_reclaimable
     10763 ±  5%    +266.6%      39463 ± 29%  numa-vmstat.node1.nr_slab_unreclaimable
    809.33 ± 11%     -34.1%     533.50 ± 13%  numa-vmstat.node1.nr_zone_active_anon
   1561754 ± 38%     -63.8%     566013 ± 18%  numa-vmstat.node1.numa_hit
   1536181 ± 39%     -65.4%     531807 ± 20%  numa-vmstat.node1.numa_local
      1250         +1141.4%      15528 ±  4%  softirqs.BLOCK
      5617 ± 33%     +79.7%      10095 ± 24%  softirqs.CPU2.RCU
      4150 ± 49%    +139.2%       9927 ± 48%  softirqs.CPU26.RCU
      3642 ± 32%    +112.3%       7734 ± 25%  softirqs.CPU31.RCU
      8807 ± 19%     -41.8%       5124 ± 27%  softirqs.CPU32.SCHED
      4658 ± 43%     +89.6%       8833 ± 25%  softirqs.CPU4.RCU
    846.33 ±  4%    +981.6%       9154 ± 41%  softirqs.CPU8.BLOCK
      3898 ± 31%    +138.4%       9295 ± 33%  softirqs.CPU8.RCU
      1407         +1176.0%      17957 ±  4%  softirqs.CPU8.TASKLET
      1623         +1019.2%      18174 ±  4%  softirqs.TASKLET
     33825 ±  6%     -39.3%      20516 ±  8%  softirqs.TIMER
      1049 ±  5%     -20.8%     831.00        proc-vmstat.nr_active_anon
   3582507 ±  4%     -72.4%     988405 ±  6%  proc-vmstat.nr_dirtied
      4624            -6.1%       4340        proc-vmstat.nr_shmem
     17700          +468.3%     100596 ±  3%  proc-vmstat.nr_slab_reclaimable
     26284          +268.6%      96872 ±  2%  proc-vmstat.nr_slab_unreclaimable
      1049 ±  5%     -20.8%     831.00        proc-vmstat.nr_zone_active_anon
   4085111 ±  3%     -63.1%    1508141 ±  4%  proc-vmstat.numa_hit
   4041490 ±  3%     -63.8%    1464583 ±  4%  proc-vmstat.numa_local
      1585 ±  9%     -29.2%       1122 ±  7%  proc-vmstat.pgactivate
   4301589 ±  3%     -56.4%    1873579 ±  4%  proc-vmstat.pgalloc_normal
   4233247 ±  3%     -64.4%    1507771 ±  5%  proc-vmstat.pgfree
    135.50 ±  4%  +7.4e+05%    1009454 ±  5%  proc-vmstat.pgpgout
     55173 ±  2%    +352.1%     249427 ± 16%  numa-meminfo.node0.KReclaimable
   1796218           +22.6%    2202221 ±  4%  numa-meminfo.node0.MemUsed
     55173 ±  2%    +352.1%     249427 ± 16%  numa-meminfo.node0.SReclaimable
     62123 ±  3%    +269.8%     229723 ± 18%  numa-meminfo.node0.SUnreclaim
    117297 ±  3%    +308.5%     479150 ± 16%  numa-meminfo.node0.Slab
      3412 ± 17%     -36.9%       2152 ± 12%  numa-meminfo.node1.Active
      3232 ± 11%     -34.1%       2131 ± 13%  numa-meminfo.node1.Active(anon)
     15628 ± 11%    +878.4%     152905 ± 31%  numa-meminfo.node1.KReclaimable
      1621 ± 72%     -56.4%     706.17 ±114%  numa-meminfo.node1.Mapped
    319477 ±  3%    +106.1%     658570 ± 14%  numa-meminfo.node1.MemUsed
     15628 ± 11%    +878.4%     152905 ± 31%  numa-meminfo.node1.SReclaimable
     43066 ±  5%    +266.2%     157700 ± 29%  numa-meminfo.node1.SUnreclaim
      4760 ± 26%     -44.3%       2649 ± 32%  numa-meminfo.node1.Shmem
     58695 ±  6%    +429.2%     310606 ± 30%  numa-meminfo.node1.Slab
     59.83 ± 16%  +55370.2%      33189 ±  5%  interrupts.73:PCI-MSI.2097152-edge.isci-msix
     43587 ±  2%    +188.6%     125790 ±  4%  interrupts.CAL:Function_call_interrupts
    494.83 ±  6%    +465.8%       2799 ± 61%  interrupts.CPU0.CAL:Function_call_interrupts
    821.00 ±  3%    +219.7%       2624 ± 28%  interrupts.CPU1.CAL:Function_call_interrupts
    771.83 ±  3%    +259.1%       2772 ± 48%  interrupts.CPU10.CAL:Function_call_interrupts
    852.50 ±  7%    +353.1%       3862 ± 72%  interrupts.CPU11.CAL:Function_call_interrupts
     77.33 ±131%    +453.7%     428.17 ± 67%  interrupts.CPU11.RES:Rescheduling_interrupts
    817.50 ±  4%    +526.4%       5120 ± 44%  interrupts.CPU12.CAL:Function_call_interrupts
    917.67 ±  5%    +212.3%       2865 ± 68%  interrupts.CPU13.CAL:Function_call_interrupts
    960.67 ± 14%    +232.1%       3190 ± 44%  interrupts.CPU15.CAL:Function_call_interrupts
    909.17 ± 17%    +136.9%       2153 ± 67%  interrupts.CPU16.CAL:Function_call_interrupts
    941.67 ± 19%    +252.5%       3319 ± 60%  interrupts.CPU2.CAL:Function_call_interrupts
    810.33 ±  2%    +126.4%       1834 ± 54%  interrupts.CPU25.CAL:Function_call_interrupts
    230.67 ± 30%     +70.0%     392.17 ± 21%  interrupts.CPU25.NMI:Non-maskable_interrupts
    230.67 ± 30%     +70.0%     392.17 ± 21%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
    246.17 ± 27%    +112.0%     521.83 ± 48%  interrupts.CPU26.NMI:Non-maskable_interrupts
    246.17 ± 27%    +112.0%     521.83 ± 48%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
     17.17 ±113%    +766.0%     148.67 ± 75%  interrupts.CPU26.RES:Rescheduling_interrupts
    927.33 ± 22%    +193.8%       2724 ± 47%  interrupts.CPU27.CAL:Function_call_interrupts
    194.83 ± 31%    +144.1%     475.50 ± 72%  interrupts.CPU3.NMI:Non-maskable_interrupts
    194.83 ± 31%    +144.1%     475.50 ± 72%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    835.00 ±  9%    +352.7%       3779 ± 68%  interrupts.CPU31.CAL:Function_call_interrupts
    185.83 ± 25%    +340.4%     818.50 ± 67%  interrupts.CPU31.NMI:Non-maskable_interrupts
    185.83 ± 25%    +340.4%     818.50 ± 67%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
    813.67 ±  4%    +438.3%       4379 ± 71%  interrupts.CPU32.CAL:Function_call_interrupts
    238.50 ± 41%    +198.3%     711.50 ± 58%  interrupts.CPU32.NMI:Non-maskable_interrupts
    238.50 ± 41%    +198.3%     711.50 ± 58%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
    852.17 ± 13%     +93.8%       1651 ± 30%  interrupts.CPU34.CAL:Function_call_interrupts
    838.33 ±  7%    +261.0%       3026 ± 82%  interrupts.CPU35.CAL:Function_call_interrupts
    889.83 ± 19%    +183.0%       2518 ± 51%  interrupts.CPU37.CAL:Function_call_interrupts
    939.50 ± 20%    +287.9%       3644 ± 82%  interrupts.CPU4.CAL:Function_call_interrupts
    198.33 ± 39%    +161.8%     519.17 ± 42%  interrupts.CPU4.NMI:Non-maskable_interrupts
    198.33 ± 39%    +161.8%     519.17 ± 42%  interrupts.CPU4.PMI:Performance_monitoring_interrupts
    830.00 ± 10%    +130.7%       1915 ± 53%  interrupts.CPU45.CAL:Function_call_interrupts
      1138 ± 40%    +158.8%       2945 ± 58%  interrupts.CPU5.CAL:Function_call_interrupts
    174.50 ± 19%    +376.2%     831.00 ± 63%  interrupts.CPU5.NMI:Non-maskable_interrupts
    174.50 ± 19%    +376.2%     831.00 ± 63%  interrupts.CPU5.PMI:Performance_monitoring_interrupts
    701.00 ± 21%    +578.1%       4753 ± 59%  interrupts.CPU6.CAL:Function_call_interrupts
     42.50 ±152%    +520.0%     263.50 ± 69%  interrupts.CPU6.RES:Rescheduling_interrupts
    872.67 ± 10%    +471.6%       4988 ± 52%  interrupts.CPU7.CAL:Function_call_interrupts
    196.00 ± 40%    +229.6%     646.00 ± 55%  interrupts.CPU7.NMI:Non-maskable_interrupts
    196.00 ± 40%    +229.6%     646.00 ± 55%  interrupts.CPU7.PMI:Performance_monitoring_interrupts
     73.67 ±138%    +387.6%     359.17 ± 88%  interrupts.CPU7.RES:Rescheduling_interrupts
     59.83 ± 16%  +55370.2%      33189 ±  5%  interrupts.CPU8.73:PCI-MSI.2097152-edge.isci-msix
    817.00 ±  7%    +180.7%       2293 ± 56%  interrupts.CPU8.CAL:Function_call_interrupts
     14.17 ±130%    +805.9%     128.33 ± 50%  interrupts.CPU8.RES:Rescheduling_interrupts
     41765 ± 10%     -40.1%      25016 ±  4%  interrupts.NMI:Non-maskable_interrupts
     41765 ± 10%     -40.1%      25016 ±  4%  interrupts.PMI:Performance_monitoring_interrupts
      4650 ± 10%     +53.1%       7119 ± 18%  interrupts.RES:Rescheduling_interrupts
     26.20 ±  3%     +81.5%      47.56 ± 10%  perf-stat.i.MPKI
 1.589e+09 ±  4%     -54.5%  7.233e+08 ±  2%  perf-stat.i.branch-instructions
      2.01 ±  3%      +5.5        7.54 ± 11%  perf-stat.i.branch-miss-rate%
  32120648           -16.1%   26936027 ±  6%  perf-stat.i.branch-misses
      5.53 ± 25%     +12.5       18.03 ±  4%  perf-stat.i.cache-miss-rate%
 2.119e+08 ±  2%     -48.3%  1.096e+08 ±  3%  perf-stat.i.cache-references
      5019 ±  4%    +480.3%      29125 ±  6%  perf-stat.i.context-switches
      1.92 ±  4%    +165.2%       5.09 ±  7%  perf-stat.i.cpi
  1.55e+10           -38.8%  9.484e+09 ±  3%  perf-stat.i.cpu-cycles
     57.32 ±  2%      +7.8%      61.81        perf-stat.i.cpu-migrations
      1736 ± 32%     -62.1%     658.28 ±  8%  perf-stat.i.cycles-between-cache-misses
      0.67 ± 14%      +0.4        1.08 ±  4%  perf-stat.i.dTLB-load-miss-rate%
  15915472 ± 13%     -42.5%    9152352 ±  7%  perf-stat.i.dTLB-load-misses
  2.33e+09 ±  3%     -53.7%  1.078e+09 ±  3%  perf-stat.i.dTLB-loads
   2971804 ±  7%     -46.5%    1590106 ±  4%  perf-stat.i.dTLB-store-misses
 1.628e+09 ±  2%     -47.6%  8.528e+08 ±  4%  perf-stat.i.dTLB-stores
     49.39 ±  4%     +12.4       61.78 ±  3%  perf-stat.i.iTLB-load-miss-rate%
   2759418 ±  9%     -41.2%    1623723 ±  4%  perf-stat.i.iTLB-load-misses
   2978816 ± 10%     -38.1%    1844222 ±  7%  perf-stat.i.iTLB-loads
 8.124e+09 ±  4%     -54.3%  3.715e+09 ±  2%  perf-stat.i.instructions
      3057 ±  9%     -37.1%       1922 ±  3%  perf-stat.i.instructions-per-iTLB-miss
      0.53 ±  4%     -41.3%       0.31 ±  3%  perf-stat.i.ipc
     10.44            +6.8%      11.15 ±  5%  perf-stat.i.major-faults
      0.32           -38.8%       0.20 ±  3%  perf-stat.i.metric.GHz
    277.49 ± 43%     +81.1%     502.53 ±  3%  perf-stat.i.metric.K/sec
    119.93 ±  3%     -52.2%      57.30 ±  3%  perf-stat.i.metric.M/sec
     46.95 ±  3%      -8.4       38.51 ±  6%  perf-stat.i.node-load-miss-rate%
     26.12 ±  3%     +12.9%      29.50 ±  4%  perf-stat.overall.MPKI
      2.02 ±  3%      +1.7        3.72 ±  8%  perf-stat.overall.branch-miss-rate%
      4.77 ± 31%      +8.0       12.81 ±  7%  perf-stat.overall.cache-miss-rate%
      1.91 ±  4%     +33.4%       2.55 ±  3%  perf-stat.overall.cpi
      1701 ± 32%     -60.1%     679.71 ±  8%  perf-stat.overall.cycles-between-cache-misses
      0.68 ± 14%      +0.2        0.84 ±  5%  perf-stat.overall.dTLB-load-miss-rate%
      2970 ± 10%     -22.8%       2293 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.52 ±  4%     -25.1%       0.39 ±  4%  perf-stat.overall.ipc
     47.40 ±  4%      -5.8       41.57 ±  5%  perf-stat.overall.node-load-miss-rate%
 1.564e+09 ±  4%     -54.4%  7.135e+08 ±  2%  perf-stat.ps.branch-instructions
  31592135           -16.1%   26519684 ±  6%  perf-stat.ps.branch-misses
 2.085e+08 ±  2%     -48.2%  1.081e+08 ±  3%  perf-stat.ps.cache-references
      4939 ±  4%    +481.8%      28734 ±  6%  perf-stat.ps.context-switches
 1.526e+10           -38.7%  9.346e+09 ±  3%  perf-stat.ps.cpu-cycles
     56.42 ±  2%      +8.0%      60.90        perf-stat.ps.cpu-migrations
  15663464 ± 13%     -42.4%    9025938 ±  7%  perf-stat.ps.dTLB-load-misses
 2.293e+09 ±  3%     -53.6%  1.063e+09 ±  3%  perf-stat.ps.dTLB-loads
   2924860 ±  7%     -46.4%    1567613 ±  4%  perf-stat.ps.dTLB-store-misses
 1.602e+09 ±  2%     -47.5%  8.408e+08 ±  4%  perf-stat.ps.dTLB-stores
   2715568 ±  9%     -41.1%    1599431 ±  4%  perf-stat.ps.iTLB-load-misses
   2931718 ± 10%     -37.9%    1819937 ±  7%  perf-stat.ps.iTLB-loads
 7.993e+09 ±  4%     -54.2%  3.665e+09 ±  2%  perf-stat.ps.instructions
     10.26            +6.7%      10.95 ±  5%  perf-stat.ps.major-faults
 5.031e+11 ±  3%     -54.0%  2.314e+11 ±  2%  perf-stat.total.instructions
      1081 ±  4%     +54.4%       1669 ±  6%  slabinfo.Acpi-Parse.active_objs
      1081 ±  4%     +54.4%       1669 ±  6%  slabinfo.Acpi-Parse.num_objs
    561.33 ±  9%    +132.5%       1305 ±  7%  slabinfo.bfq_io_cq.active_objs
    561.33 ±  9%    +132.5%       1305 ±  7%  slabinfo.bfq_io_cq.num_objs
    388.67 ± 11%     +37.9%     535.83 ± 11%  slabinfo.biovec-64.active_objs
    388.67 ± 11%     +37.9%     535.83 ± 11%  slabinfo.biovec-64.num_objs
      1201 ± 11%    +119.0%       2631 ± 36%  slabinfo.dmaengine-unmap-16.active_objs
      1201 ± 11%    +121.2%       2658 ± 35%  slabinfo.dmaengine-unmap-16.num_objs
      2055 ±  9%    +108.8%       4291 ±  6%  slabinfo.dnotify_struct.active_objs
      2055 ±  9%    +108.8%       4291 ±  6%  slabinfo.dnotify_struct.num_objs
     23858 ± 13%     -31.6%      16307 ±  4%  slabinfo.filp.active_objs
    756.17 ± 13%     -28.9%     537.50 ±  3%  slabinfo.filp.active_slabs
     24210 ± 13%     -28.9%      17214 ±  3%  slabinfo.filp.num_objs
    756.17 ± 13%     -28.9%     537.50 ±  3%  slabinfo.filp.num_slabs
    792.83 ±  9%    +114.8%       1703 ±  6%  slabinfo.ip6-frags.active_objs
    792.83 ±  9%    +114.8%       1703 ±  6%  slabinfo.ip6-frags.num_objs
      2844          +142.5%       6896 ± 14%  slabinfo.kmalloc-128.active_objs
     90.67 ±  2%    +141.0%     218.50 ± 14%  slabinfo.kmalloc-128.active_slabs
      2911 ±  2%    +141.0%       7015 ± 14%  slabinfo.kmalloc-128.num_objs
     90.67 ±  2%    +141.0%     218.50 ± 14%  slabinfo.kmalloc-128.num_slabs
     18896         +2493.2%     490004 ±  5%  slabinfo.kmalloc-16.active_objs
     73.83         +2492.8%       1914 ±  5%  slabinfo.kmalloc-16.active_slabs
     18901         +2493.4%     490195 ±  5%  slabinfo.kmalloc-16.num_objs
     73.83         +2492.8%       1914 ±  5%  slabinfo.kmalloc-16.num_slabs
      7292 ±  5%     +14.5%       8353 ±  5%  slabinfo.kmalloc-256.active_objs
      7343 ±  5%     +14.1%       8379 ±  5%  slabinfo.kmalloc-256.num_objs
     54440 ±  2%     +21.9%      66345 ±  3%  slabinfo.kmalloc-32.active_objs
     54716 ±  2%     +21.7%      66577 ±  2%  slabinfo.kmalloc-32.num_objs
     10611 ±  5%   +3325.7%     363499 ±  3%  slabinfo.kmalloc-512.active_objs
    332.83 ±  5%   +3648.3%      12475 ±  3%  slabinfo.kmalloc-512.active_slabs
     10664 ±  5%   +3643.5%     399231 ±  3%  slabinfo.kmalloc-512.num_objs
    332.83 ±  5%   +3648.3%      12475 ±  3%  slabinfo.kmalloc-512.num_slabs
    438.33         +1627.5%       7572        slabinfo.kmalloc-8k.active_objs
    109.33         +1894.7%       2180        slabinfo.kmalloc-8k.active_slabs
    438.33         +1890.5%       8725        slabinfo.kmalloc-8k.num_objs
    109.33         +1894.7%       2180        slabinfo.kmalloc-8k.num_slabs
      2722          +308.5%      11121 ±  3%  slabinfo.kmalloc-rcl-512.active_objs
     84.50          +321.7%     356.33 ±  3%  slabinfo.kmalloc-rcl-512.active_slabs
      2722          +319.4%      11417 ±  3%  slabinfo.kmalloc-rcl-512.num_objs
     84.50          +321.7%     356.33 ±  3%  slabinfo.kmalloc-rcl-512.num_slabs
    442.50 ± 10%   +1340.9%       6376 ±  6%  slabinfo.numa_policy.active_objs
     13.67 ± 11%   +1501.2%     218.83 ±  5%  slabinfo.numa_policy.active_slabs
    442.50 ± 10%   +1435.4%       6794 ±  5%  slabinfo.numa_policy.num_objs
     13.67 ± 11%   +1501.2%     218.83 ±  5%  slabinfo.numa_policy.num_slabs
      1172 ±  8%     +27.8%       1499 ±  7%  slabinfo.pool_workqueue.active_objs
      1224 ±  8%     +31.3%       1607 ±  5%  slabinfo.pool_workqueue.num_objs
     13130           +32.8%      17438        slabinfo.radix_tree_node.active_objs
    468.83           +34.1%     628.83        slabinfo.radix_tree_node.active_slabs
     13137           +34.1%      17621        slabinfo.radix_tree_node.num_objs
    468.83           +34.1%     628.83        slabinfo.radix_tree_node.num_slabs
    383.50 ± 10%     +41.3%     542.00 ± 14%  slabinfo.skbuff_fclone_cache.active_objs
    383.50 ± 10%     +41.3%     542.00 ± 14%  slabinfo.skbuff_fclone_cache.num_objs
    657.67 ±  9%    +105.3%       1350 ±  6%  slabinfo.xfs_btree_cur.active_objs
    657.67 ±  9%    +105.3%       1350 ±  6%  slabinfo.xfs_btree_cur.num_objs
    396.50 ±  7%   +2477.0%      10217 ±  6%  slabinfo.xfs_buf.active_objs
      8.67 ±  8%   +2757.7%     247.67 ±  6%  slabinfo.xfs_buf.active_slabs
    396.50 ±  7%   +2528.8%      10423 ±  6%  slabinfo.xfs_buf.num_objs
      8.67 ±  8%   +2757.7%     247.67 ±  6%  slabinfo.xfs_buf.num_slabs
     39.00         +5183.8%       2060 ± 26%  slabinfo.xfs_efi_item.active_objs
     39.00         +5251.3%       2087 ± 26%  slabinfo.xfs_efi_item.num_objs
    129.00         +4297.2%       5672 ± 24%  slabinfo.xfs_icr.active_objs
      2.00         +6108.3%     124.17 ± 24%  slabinfo.xfs_icr.active_slabs
    129.00         +4344.7%       5733 ± 24%  slabinfo.xfs_icr.num_objs
      2.00         +6108.3%     124.17 ± 24%  slabinfo.xfs_icr.num_slabs
    157.00        +1.8e+05%     281652 ±  4%  slabinfo.xfs_ili.active_objs
      3.00        +2.3e+05%       6773 ±  4%  slabinfo.xfs_ili.active_slabs
    157.00        +1.8e+05%     284506 ±  4%  slabinfo.xfs_ili.num_objs
      3.00        +2.3e+05%       6773 ±  4%  slabinfo.xfs_ili.num_slabs
    246.33 ± 10%  +1.1e+05%     281353 ±  4%  slabinfo.xfs_inode.active_objs
      6.50 ± 11%  +1.3e+05%       8339 ±  4%  slabinfo.xfs_inode.active_slabs
    246.33 ± 10%  +1.2e+05%     283577 ±  4%  slabinfo.xfs_inode.num_objs
      6.50 ± 11%  +1.3e+05%       8339 ±  4%  slabinfo.xfs_inode.num_slabs
     49.47 ± 14%     -23.3       26.14 ± 11%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     49.33 ± 14%     -23.2       26.08 ± 11%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
     17.61 ± 14%     -11.2        6.42 ± 13%  perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.28 ± 14%      -9.3        0.00        perf-profile.calltrace.cycles-pp.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.03 ± 15%      -9.0        0.00        perf-profile.calltrace.cycles-pp.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      8.65 ± 15%      -8.7        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat.do_syscall_64
      6.12 ± 16%      -6.1        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.do_unlinkat
     14.08 ± 14%      -3.9       10.14 ± 11%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     14.01 ± 14%      -3.9       10.11 ± 11%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12.93 ± 14%      -3.3        9.59 ± 11%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12.83 ± 14%      -3.3        9.54 ± 11%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      6.63 ± 15%      -3.0        3.61 ± 10%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.89 ± 16%      -2.3        2.60 ± 12%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.84 ± 16%      -2.3        2.57 ± 12%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.84 ± 13%      -2.1        2.75 ± 10%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.27 ± 17%      -2.0        2.25 ± 12%  perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.15 ± 17%      -1.9        2.21 ± 12%  perf-profile.calltrace.cycles-pp.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
      3.68 ± 16%      -1.7        1.97 ± 12%  perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write.ksys_write
      3.66 ± 16%      -1.7        1.95 ± 12%  perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write.vfs_write
      2.06 ± 17%      -1.6        0.42 ± 72%  perf-profile.calltrace.cycles-pp.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive
      8.65 ± 15%      -1.4        7.20 ± 11%  perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      3.46 ± 12%      -1.4        2.08 ± 10%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.24 ± 12%      -1.3        1.96 ± 10%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      2.62 ± 16%      -1.2        1.40 ± 11%  perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write.new_sync_write
      2.27 ± 13%      -1.0        1.27 ± 16%  perf-profile.calltrace.cycles-pp.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.91 ± 15%      -0.9        1.03 ± 18%  perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.evict.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.44 ± 12%      -0.9        1.56 ±  7%  perf-profile.calltrace.cycles-pp.xfs_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      1.44 ± 17%      -0.8        0.63 ± 48%  perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create
      1.50 ± 17%      -0.7        0.77 ± 13%  perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_write
      1.18 ± 16%      -0.7        0.48 ± 46%  perf-profile.calltrace.cycles-pp.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.98 ± 16%      -0.7        0.30 ±100%  perf-profile.calltrace.cycles-pp.__pagevec_release.truncate_inode_pages_range.evict.do_unlinkat.do_syscall_64
      1.28 ± 15%      -0.6        0.64 ± 16%  perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply
      1.31 ± 14%      -0.6        0.67 ± 13%  perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
      1.92 ± 12%      -0.6        1.29 ±  6%  perf-profile.calltrace.cycles-pp.xfs_free_eofblocks.xfs_release.__fput.task_work_run.exit_to_user_mode_prepare
      1.17 ± 12%      -0.6        0.57 ± 45%  perf-profile.calltrace.cycles-pp.filp_close.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.42 ± 11%      -0.6        0.82 ±  9%  perf-profile.calltrace.cycles-pp.do_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      1.32 ±  9%      -0.6        0.74 ± 15%  perf-profile.calltrace.cycles-pp.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.29 ± 12%      -0.6        0.72 ± 12%  perf-profile.calltrace.cycles-pp.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.28 ± 13%      -0.6        0.70 ± 10%  perf-profile.calltrace.cycles-pp.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.95 ± 12%      -0.6        0.38 ± 71%  perf-profile.calltrace.cycles-pp.vfs_rename.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.23 ± 12%      -0.6        0.68 ± 11%  perf-profile.calltrace.cycles-pp.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.12 ±  8%      -0.5        0.57 ± 47%  perf-profile.calltrace.cycles-pp.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      1.22 ±  9%      -0.5        0.68 ± 15%  perf-profile.calltrace.cycles-pp.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.55 ± 15%      -0.5        2.02 ± 13%  perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
      1.07 ±  8%      -0.5        0.55 ± 47%  perf-profile.calltrace.cycles-pp.__alloc_file.alloc_empty_file.path_openat.do_filp_open.do_sys_openat2
      1.14 ±  9%      -0.5        0.63 ± 16%  perf-profile.calltrace.cycles-pp.fcntl_dirnotify.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.72 ± 13%      -0.4        0.36 ± 71%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_free_eofblocks.xfs_release.__fput.task_work_run
      2.18 ± 13%      -0.3        1.86 ± 13%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat.do_filp_open
      0.70 ± 10%      +0.2        0.93 ± 11%  perf-profile.calltrace.cycles-pp.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_remove.xfs_vn_unlink
      0.26 ±100%      +0.5        0.75 ± 14%  perf-profile.calltrace.cycles-pp.xfs_dialloc_select_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat
      0.69 ± 16%      +0.6        1.31 ± 17%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.09 ±223%      +0.6        0.73 ± 16%  perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
      0.30 ±101%      +0.7        0.98 ± 20%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      0.33 ±104%      +0.7        1.02 ± 11%  perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      0.46 ± 71%      +0.7        1.16 ± 14%  perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat
      0.00            +0.8        0.77 ± 16%  perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      0.00            +0.8        0.78 ± 16%  perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.24 ±143%      +0.9        1.16 ± 16%  perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
      0.00            +0.9        0.93 ± 26%  perf-profile.calltrace.cycles-pp.xfs_iunlink_remove.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
      0.00            +0.9        0.93 ± 22%  perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
      1.00 ± 22%      +1.0        1.96 ± 10%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      1.07 ± 23%      +1.0        2.09 ± 10%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      0.00            +1.0        1.04 ± 24%  perf-profile.calltrace.cycles-pp.xfs_inactive_truncate.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
      1.24 ± 21%      +1.1        2.38 ± 10%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      0.00            +1.4        1.41 ± 25%  perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
      0.00            +1.5        1.47 ± 24%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
      1.31 ± 27%      +1.5        2.82 ± 19%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.00            +1.9        1.94 ± 24%  perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
      2.04 ± 19%      +2.0        4.03 ± 10%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      2.82 ± 20%      +2.8        5.58 ± 10%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      2.94 ± 20%      +2.9        5.85 ± 10%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.00            +3.6        3.56 ± 24%  perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
      4.32 ± 19%      +4.3        8.60 ± 11%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      0.00            +4.7        4.67 ± 24%  perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
      0.00            +4.8        4.81 ± 24%  perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
      0.00            +4.8        4.81 ± 24%  perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
      0.00            +4.8        4.81 ± 24%  perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
      4.69 ± 19%      +4.9        9.62 ± 14%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      0.72 ± 15%      +6.3        7.06 ± 21%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      0.54 ± 47%      +6.4        6.97 ± 21%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      0.93 ± 16%      +6.9        7.87 ± 20%  perf-profile.calltrace.cycles-pp.ret_from_fork
      0.93 ± 16%      +6.9        7.87 ± 20%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
     43.77 ± 16%     +14.2       57.96 ±  6%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     44.08 ± 16%     +14.5       58.56 ±  6%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     47.05 ± 15%     +17.1       64.19 ±  6%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     45.98 ± 16%     +17.2       63.17 ±  6%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     46.01 ± 16%     +17.2       63.24 ±  6%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     46.01 ± 16%     +17.2       63.24 ±  6%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     49.66 ± 14%     -23.2       26.48 ± 11%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     49.52 ± 14%     -23.1       26.42 ± 11%  perf-profile.children.cycles-pp.do_syscall_64
     17.63 ± 14%     -11.2        6.42 ± 13%  perf-profile.children.cycles-pp.do_unlinkat
      9.28 ± 14%      -9.0        0.28 ± 15%  perf-profile.children.cycles-pp.destroy_inode
      9.05 ± 15%      -8.9        0.13 ± 19%  perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
      8.65 ± 15%      -4.0        4.67 ± 23%  perf-profile.children.cycles-pp.xfs_inactive
     14.10 ± 13%      -3.9       10.17 ± 11%  perf-profile.children.cycles-pp.do_sys_open
     14.04 ± 13%      -3.9       10.14 ± 11%  perf-profile.children.cycles-pp.do_sys_openat2
     12.95 ± 14%      -3.3        9.63 ± 11%  perf-profile.children.cycles-pp.do_filp_open
     12.86 ± 14%      -3.3        9.58 ± 11%  perf-profile.children.cycles-pp.path_openat
      6.65 ± 14%      -3.0        3.63 ± 10%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      6.13 ± 16%      -2.6        3.56 ± 24%  perf-profile.children.cycles-pp.xfs_inactive_ifree
      4.91 ± 16%      -2.3        2.61 ± 12%  perf-profile.children.cycles-pp.ksys_write
      4.86 ± 16%      -2.3        2.58 ± 12%  perf-profile.children.cycles-pp.vfs_write
      4.12 ± 18%      -2.2        1.94 ± 24%  perf-profile.children.cycles-pp.xfs_ifree
      3.09 ± 17%      -2.2        0.93 ± 22%  perf-profile.children.cycles-pp.xfs_difree
      4.88 ± 13%      -2.1        2.78 ± 10%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      2.90 ± 17%      -2.1        0.84 ± 18%  perf-profile.children.cycles-pp.xfs_check_agi_freecount
      4.28 ± 17%      -2.0        2.26 ± 12%  perf-profile.children.cycles-pp.new_sync_write
      4.15 ± 17%      -1.9        2.21 ± 12%  perf-profile.children.cycles-pp.xfs_file_buffered_write
      3.68 ± 16%      -1.7        1.97 ± 12%  perf-profile.children.cycles-pp.iomap_file_buffered_write
      3.67 ± 16%      -1.7        1.96 ± 12%  perf-profile.children.cycles-pp.iomap_apply
      2.06 ± 17%      -1.5        0.56 ± 23%  perf-profile.children.cycles-pp.xfs_difree_inobt
      8.67 ± 15%      -1.5        7.21 ± 11%  perf-profile.children.cycles-pp.xfs_generic_create
      2.43 ± 12%      -1.4        1.04 ± 24%  perf-profile.children.cycles-pp.xfs_inactive_truncate
      3.47 ± 12%      -1.4        2.08 ± 10%  perf-profile.children.cycles-pp.task_work_run
      3.26 ± 12%      -1.3        1.98 ± 10%  perf-profile.children.cycles-pp.__fput
      2.63 ± 16%      -1.2        1.40 ± 11%  perf-profile.children.cycles-pp.iomap_write_actor
      2.03 ± 11%      -1.2        0.81 ± 16%  perf-profile.children.cycles-pp.xfs_itruncate_extents_flags
      2.28 ± 13%      -1.0        1.27 ± 16%  perf-profile.children.cycles-pp.evict
      2.06 ± 11%      -0.9        1.17 ±  8%  perf-profile.children.cycles-pp.xfs_trans_alloc
      2.45 ± 12%      -0.9        1.56 ±  7%  perf-profile.children.cycles-pp.xfs_release
      1.91 ± 15%      -0.9        1.03 ± 17%  perf-profile.children.cycles-pp.truncate_inode_pages_range
      1.50 ± 17%      -0.7        0.77 ± 13%  perf-profile.children.cycles-pp.iomap_write_begin
      1.07 ± 18%      -0.7        0.37 ± 13%  perf-profile.children.cycles-pp.xfs_inobt_get_rec
      2.20 ± 16%      -0.7        1.50 ± 16%  perf-profile.children.cycles-pp.xfs_btree_lookup
      1.63 ± 10%      -0.6        0.98 ±  9%  perf-profile.children.cycles-pp.xfs_trans_reserve
      1.31 ± 15%      -0.6        0.67 ± 13%  perf-profile.children.cycles-pp.grab_cache_page_write_begin
      1.28 ± 15%      -0.6        0.64 ± 15%  perf-profile.children.cycles-pp.pagecache_get_page
      1.92 ± 12%      -0.6        1.30 ±  6%  perf-profile.children.cycles-pp.xfs_free_eofblocks
      2.00 ± 13%      -0.6        1.37 ± 13%  perf-profile.children.cycles-pp.kmem_cache_alloc
      1.19 ± 15%      -0.6        0.57 ± 11%  perf-profile.children.cycles-pp.arch_do_signal_or_restart
      1.44 ± 11%      -0.6        0.84 ±  9%  perf-profile.children.cycles-pp.do_open
      1.23 ± 14%      -0.6        0.63 ± 13%  perf-profile.children.cycles-pp.fsnotify
      0.96 ± 12%      -0.6        0.37 ± 20%  perf-profile.children.cycles-pp.xfs_defer_finish
      1.32 ±  9%      -0.6        0.74 ± 15%  perf-profile.children.cycles-pp.__x64_sys_fcntl
      0.91 ± 18%      -0.6        0.33 ± 24%  perf-profile.children.cycles-pp.xfs_difree_finobt
      1.30 ± 12%      -0.6        0.72 ± 12%  perf-profile.children.cycles-pp.__x64_sys_close
      1.28 ± 13%      -0.6        0.70 ± 10%  perf-profile.children.cycles-pp.__x64_sys_rename
      1.24 ± 12%      -0.6        0.68 ± 10%  perf-profile.children.cycles-pp.do_renameat2
      1.22 ±  9%      -0.5        0.68 ± 15%  perf-profile.children.cycles-pp.do_fcntl
      2.56 ± 16%      -0.5        2.03 ± 13%  perf-profile.children.cycles-pp.xfs_dialloc_ag
      0.89 ± 11%      -0.5        0.36 ± 22%  perf-profile.children.cycles-pp.xfs_defer_trans_roll
      1.18 ± 13%      -0.5        0.65 ± 12%  perf-profile.children.cycles-pp.filp_close
      1.37 ± 10%      -0.5        0.85 ±  8%  perf-profile.children.cycles-pp.xfs_log_reserve
      1.14 ±  9%      -0.5        0.64 ± 16%  perf-profile.children.cycles-pp.fcntl_dirnotify
      0.76 ± 16%      -0.5        0.27 ± 17%  perf-profile.children.cycles-pp.__xfs_bunmapi
      1.12 ±  7%      -0.5        0.65 ± 18%  perf-profile.children.cycles-pp.alloc_empty_file
      0.89 ± 17%      -0.5        0.43 ± 16%  perf-profile.children.cycles-pp.__entry_text_start
      0.77 ± 12%      -0.5        0.32 ± 19%  perf-profile.children.cycles-pp.xfs_inobt_update
      1.08 ±  7%      -0.4        0.64 ± 19%  perf-profile.children.cycles-pp.__alloc_file
      0.85 ± 19%      -0.4        0.41 ± 15%  perf-profile.children.cycles-pp.link_path_walk
      0.98 ± 16%      -0.4        0.54 ± 15%  perf-profile.children.cycles-pp.__pagevec_release
      0.90 ± 17%      -0.4        0.46 ±  6%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.72 ± 19%      -0.4        0.28 ± 22%  perf-profile.children.cycles-pp.xfs_btree_check_sblock
      0.92 ± 17%      -0.4        0.50 ± 14%  perf-profile.children.cycles-pp.xfs_buffered_write_iomap_begin
      0.95 ± 12%      -0.4        0.54 ± 10%  perf-profile.children.cycles-pp.vfs_rename
      0.70 ± 11%      -0.4        0.29 ± 17%  perf-profile.children.cycles-pp.xfs_btree_update
      0.86 ± 15%      -0.4        0.46 ± 15%  perf-profile.children.cycles-pp.__fsnotify_parent
      0.81 ± 15%      -0.4        0.40 ± 13%  perf-profile.children.cycles-pp.getname_flags
      0.78 ± 13%      -0.4        0.37 ± 19%  perf-profile.children.cycles-pp.xfs_trans_roll
      0.69 ± 15%      -0.4        0.31 ± 16%  perf-profile.children.cycles-pp.add_to_page_cache_lru
      0.86 ± 17%      -0.4        0.50 ±  5%  perf-profile.children.cycles-pp.xfs_dir_createname
      1.28 ± 14%      -0.4        0.91 ± 12%  perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
      0.77 ± 12%      -0.4        0.41 ± 19%  perf-profile.children.cycles-pp.__x64_sys_chmod
      0.76 ± 16%      -0.4        0.40 ± 14%  perf-profile.children.cycles-pp.dnotify_handle_event
      0.63 ± 18%      -0.4        0.27 ± 19%  perf-profile.children.cycles-pp.xfs_btree_get_rec
      0.76 ± 13%      -0.4        0.40 ± 19%  perf-profile.children.cycles-pp.do_fchmodat
      0.67 ± 16%      -0.4        0.31 ± 14%  perf-profile.children.cycles-pp.filename_parentat
      0.64 ± 16%      -0.4        0.28 ± 14%  perf-profile.children.cycles-pp.__add_to_page_cache_locked
      0.63 ± 19%      -0.3        0.29 ± 14%  perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
      0.60 ± 11%      -0.3        0.26 ± 16%  perf-profile.children.cycles-pp.__setup_rt_frame
      0.61 ± 17%      -0.3        0.28 ± 16%  perf-profile.children.cycles-pp.path_parentat
      0.61 ± 17%      -0.3        0.28 ± 25%  perf-profile.children.cycles-pp.xfs_dir_removename
      0.83 ± 15%      -0.3        0.51 ± 17%  perf-profile.children.cycles-pp.do_dentry_open
      0.68 ± 16%      -0.3        0.36 ± 16%  perf-profile.children.cycles-pp.send_sigio
      0.92 ± 12%      -0.3        0.60 ± 12%  perf-profile.children.cycles-pp.kmem_cache_free
      0.70 ± 15%      -0.3        0.38 ± 11%  perf-profile.children.cycles-pp.release_pages
      0.44 ± 21%      -0.3        0.13 ± 23%  perf-profile.children.cycles-pp.xfs_btree_increment
      0.94 ± 15%      -0.3        0.63 ± 11%  perf-profile.children.cycles-pp.xfs_inode_item_format
      0.66 ± 12%      -0.3        0.35 ± 20%  perf-profile.children.cycles-pp.chmod_common
      0.71 ± 14%      -0.3        0.41 ± 15%  perf-profile.children.cycles-pp.iomap_write_end
      0.50 ± 18%      -0.3        0.20 ± 22%  perf-profile.children.cycles-pp.__xfs_btree_check_sblock
      0.61 ± 16%      -0.3        0.32 ± 17%  perf-profile.children.cycles-pp.send_sigio_to_task
      0.61 ± 13%      -0.3        0.32 ± 20%  perf-profile.children.cycles-pp.notify_change
      0.59 ± 19%      -0.3        0.31 ± 10%  perf-profile.children.cycles-pp.xfs_dir2_sf_addname
      0.61 ± 12%      -0.3        0.34 ± 15%  perf-profile.children.cycles-pp.dnotify_flush
      0.59 ± 15%      -0.3        0.34 ± 14%  perf-profile.children.cycles-pp.iomap_set_page_dirty
      0.52 ± 17%      -0.3        0.27 ± 15%  perf-profile.children.cycles-pp.do_send_sig_info
      0.46 ± 17%      -0.3        0.20 ± 16%  perf-profile.children.cycles-pp.inode_permission
      0.53 ± 11%      -0.2        0.28 ± 12%  perf-profile.children.cycles-pp.strncpy_from_user
      0.32 ± 15%      -0.2        0.08 ± 32%  perf-profile.children.cycles-pp.xfs_bmap_del_extent_delay
      0.62 ± 12%      -0.2        0.38 ± 15%  perf-profile.children.cycles-pp.xfs_vn_rename
      0.61 ± 12%      -0.2        0.38 ± 16%  perf-profile.children.cycles-pp.xfs_rename
      0.48 ± 14%      -0.2        0.26 ± 13%  perf-profile.children.cycles-pp.fsnotify_put_mark
      0.40 ± 19%      -0.2        0.18 ± 14%  perf-profile.children.cycles-pp.xlog_grant_add_space
      0.42 ± 22%      -0.2        0.20 ± 11%  perf-profile.children.cycles-pp.dput
      0.38 ± 10%      -0.2        0.16 ± 25%  perf-profile.children.cycles-pp.xlog_ticket_alloc
      0.40 ± 20%      -0.2        0.19 ±  9%  perf-profile.children.cycles-pp.___might_sleep
      0.46 ± 17%      -0.2        0.26 ±  8%  perf-profile.children.cycles-pp.xfs_bmapi_reserve_delalloc
      0.39 ± 15%      -0.2        0.20 ± 17%  perf-profile.children.cycles-pp.__send_signal
      0.34 ± 21%      -0.2        0.16 ± 27%  perf-profile.children.cycles-pp.xfs_mod_fdblocks
      0.51 ± 14%      -0.2        0.33 ±  8%  perf-profile.children.cycles-pp.xfs_trans_alloc_icreate
      0.37 ± 14%      -0.2        0.19 ± 17%  perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn
      0.36 ± 22%      -0.2        0.18 ± 27%  perf-profile.children.cycles-pp.delete_from_page_cache_batch
      0.35 ± 10%      -0.2        0.17 ± 24%  perf-profile.children.cycles-pp.fsnotify_add_mark_locked
      0.43 ± 19%      -0.2        0.26 ± 10%  perf-profile.children.cycles-pp.ksys_read
      0.80 ± 12%      -0.2        0.62 ± 10%  perf-profile.children.cycles-pp.xfs_trans_log_inode
      0.40 ± 19%      -0.2        0.23 ± 26%  perf-profile.children.cycles-pp.lru_add_drain
      0.42 ± 19%      -0.2        0.25 ± 11%  perf-profile.children.cycles-pp.vfs_read
      0.39 ± 16%      -0.2        0.22 ± 10%  perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
      0.32 ± 19%      -0.2        0.16 ± 27%  perf-profile.children.cycles-pp.xfs_file_write_checks
      0.32 ± 21%      -0.2        0.15 ± 15%  perf-profile.children.cycles-pp.get_signal
      0.28 ± 25%      -0.2        0.12 ± 15%  perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
      0.23 ± 17%      -0.2        0.07 ± 24%  perf-profile.children.cycles-pp.xfs_perag_set_inode_tag
      0.34 ±  7%      -0.2        0.18 ± 14%  perf-profile.children.cycles-pp.__check_object_size
      0.37 ± 21%      -0.2        0.21 ± 25%  perf-profile.children.cycles-pp.lru_add_drain_cpu
      0.34 ±  9%      -0.2        0.19 ± 21%  perf-profile.children.cycles-pp.xfs_vn_setattr
      0.28 ± 20%      -0.2        0.12 ± 23%  perf-profile.children.cycles-pp.copy_fpstate_to_sigframe
      0.22 ± 22%      -0.2        0.06 ± 55%  perf-profile.children.cycles-pp.alloc_fd
      0.18 ± 19%      -0.1        0.03 ±103%  perf-profile.children.cycles-pp.xfs_btree_update_keys
      0.22 ± 21%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.xfs_inode_item_size
      0.41 ± 12%      -0.1        0.27 ± 10%  perf-profile.children.cycles-pp.__alloc_pages
      0.27 ± 19%      -0.1        0.13 ± 20%  perf-profile.children.cycles-pp.__x64_sys_unlink
      0.24 ± 19%      -0.1        0.10 ± 23%  perf-profile.children.cycles-pp.map_id_range_down
      0.32 ± 18%      -0.1        0.19 ± 26%  perf-profile.children.cycles-pp.xfs_dir2_sf_removename
      0.31 ± 10%      -0.1        0.17 ± 20%  perf-profile.children.cycles-pp.xfs_setattr_nonsize
      0.33 ± 13%      -0.1        0.19 ± 26%  perf-profile.children.cycles-pp.security_file_alloc
      0.26 ±  9%      -0.1        0.12 ± 13%  perf-profile.children.cycles-pp.complete_walk
      0.28 ± 29%      -0.1        0.14 ± 22%  perf-profile.children.cycles-pp.xfs_trans_add_item
      0.26 ± 19%      -0.1        0.13 ± 29%  perf-profile.children.cycles-pp.xas_store
      0.27 ± 20%      -0.1        0.14 ± 10%  perf-profile.children.cycles-pp.xfs_ilock
      0.26 ± 16%      -0.1        0.13 ± 11%  perf-profile.children.cycles-pp.memset_erms
      0.24 ± 21%      -0.1        0.11 ± 15%  perf-profile.children.cycles-pp.xfs_trans_log_buf
      0.24 ± 15%      -0.1        0.11 ± 26%  perf-profile.children.cycles-pp.xfs_errortag_test
      0.32 ± 18%      -0.1        0.19 ± 12%  perf-profile.children.cycles-pp.uncharge_batch
      0.22 ± 13%      -0.1        0.10 ± 18%  perf-profile.children.cycles-pp.restore_sigcontext
      0.30 ± 15%      -0.1        0.18 ± 15%  perf-profile.children.cycles-pp.xfs_can_free_eofblocks
      0.25 ±  7%      -0.1        0.13 ± 10%  perf-profile.children.cycles-pp.try_to_unlazy
      0.23 ± 17%      -0.1        0.10 ± 11%  perf-profile.children.cycles-pp.generic_permission
      0.22 ± 19%      -0.1        0.09 ±  7%  perf-profile.children.cycles-pp.make_kuid
      0.25 ± 16%      -0.1        0.13 ±  8%  perf-profile.children.cycles-pp.xfs_btree_ptr_to_daddr
      0.22 ± 29%      -0.1        0.10 ±  6%  perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
      0.27 ± 25%      -0.1        0.15 ± 27%  perf-profile.children.cycles-pp.xfs_inobt_init_cursor
      0.20 ± 20%      -0.1        0.08 ± 26%  perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs
      0.18 ± 19%      -0.1        0.06 ± 17%  perf-profile.children.cycles-pp.xfs_btree_rec_offset
      0.30 ± 19%      -0.1        0.18 ± 16%  perf-profile.children.cycles-pp.__might_sleep
      0.27 ± 15%      -0.1        0.16 ± 13%  perf-profile.children.cycles-pp.__set_page_dirty
      0.23 ± 19%      -0.1        0.12 ±  9%  perf-profile.children.cycles-pp.__lookup_hash
      0.20 ± 26%      -0.1        0.08 ± 13%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.15 ± 21%      -0.1        0.04 ± 75%  perf-profile.children.cycles-pp.xfs_file_buffered_read
      0.20 ± 21%      -0.1        0.08 ± 23%  perf-profile.children.cycles-pp.xfs_trans_free
      0.31 ± 17%      -0.1        0.20 ± 11%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.15 ± 59%      -0.1        0.04 ± 73%  perf-profile.children.cycles-pp.may_delete
      0.26 ± 20%      -0.1        0.15 ± 19%  perf-profile.children.cycles-pp.xfs_iunlock
      0.16 ± 21%      -0.1        0.06 ± 48%  perf-profile.children.cycles-pp.up_read
      0.20 ± 10%      -0.1        0.10 ± 18%  perf-profile.children.cycles-pp.__virt_addr_valid
      0.20 ± 15%      -0.1        0.09 ± 27%  perf-profile.children.cycles-pp.fsnotify_grab_connector
      0.18 ± 29%      -0.1        0.08 ± 11%  perf-profile.children.cycles-pp.copyin
      0.18 ± 19%      -0.1        0.08 ± 17%  perf-profile.children.cycles-pp.xfs_trans_dirty_buf
      0.16 ± 24%      -0.1        0.06 ± 20%  perf-profile.children.cycles-pp.xfs_file_read_iter
      0.21 ± 18%      -0.1        0.12 ± 13%  perf-profile.children.cycles-pp.down_write
      0.13 ± 19%      -0.1        0.03 ±102%  perf-profile.children.cycles-pp.security_path_unlink
      0.27 ± 15%      -0.1        0.17 ± 11%  perf-profile.children.cycles-pp.page_counter_cancel
      0.25 ± 15%      -0.1        0.15 ± 29%  perf-profile.children.cycles-pp.xfs_perag_clear_inode_tag
      0.26 ± 21%      -0.1        0.17 ± 13%  perf-profile.children.cycles-pp.xfs_bmap_add_extent_hole_delay
      0.22 ± 27%      -0.1        0.12 ± 13%  perf-profile.children.cycles-pp.xfs_trans_del_item
      0.23 ± 23%      -0.1        0.13 ± 21%  perf-profile.children.cycles-pp.xfs_inobt_init_common
      0.12 ± 19%      -0.1        0.03 ±105%  perf-profile.children.cycles-pp.filemap_read
      0.14 ± 12%      -0.1        0.04 ± 73%  perf-profile.children.cycles-pp.xfs_iext_lookup_extent_before
      0.17 ± 11%      -0.1        0.08 ± 12%  perf-profile.children.cycles-pp.xfs_ialloc_log_agi
      0.18 ± 16%      -0.1        0.09 ± 18%  perf-profile.children.cycles-pp.__fsnotify_update_child_dentry_flags
      0.20 ± 16%      -0.1        0.11 ± 13%  perf-profile.children.cycles-pp.iput
      0.19 ±  7%      -0.1        0.10 ± 25%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.19 ± 13%      -0.1        0.10 ± 11%  perf-profile.children.cycles-pp.mem_cgroup_charge
      0.19 ± 16%      -0.1        0.10 ± 20%  perf-profile.children.cycles-pp.new_sync_read
      0.19 ± 22%      -0.1        0.10 ± 33%  perf-profile.children.cycles-pp.__cancel_dirty_page
      0.16 ± 21%      -0.1        0.07 ± 48%  perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
      0.14 ± 10%      -0.1        0.05 ± 74%  perf-profile.children.cycles-pp.xfs_dir2_sf_lookup
      0.23 ± 14%      -0.1        0.15 ± 18%  perf-profile.children.cycles-pp.__cond_resched
      0.22 ± 16%      -0.1        0.14 ± 24%  perf-profile.children.cycles-pp.get_obj_cgroup_from_current
      0.13 ± 14%      -0.1        0.04 ± 75%  perf-profile.children.cycles-pp.fsnotify_find_mark
      0.15 ± 12%      -0.1        0.06 ± 19%  perf-profile.children.cycles-pp.__fpu__restore_sig
      0.20 ± 12%      -0.1        0.12 ± 19%  perf-profile.children.cycles-pp.ima_file_check
      0.22 ± 22%      -0.1        0.14 ± 28%  perf-profile.children.cycles-pp.apparmor_file_alloc_security
      0.11 ± 25%      -0.1        0.04 ±105%  perf-profile.children.cycles-pp.xfs_dir_open
      0.17 ± 17%      -0.1        0.09 ± 16%  perf-profile.children.cycles-pp.may_open
      0.16 ± 20%      -0.1        0.08 ± 19%  perf-profile.children.cycles-pp.dequeue_signal
      0.17 ± 19%      -0.1        0.10 ± 10%  perf-profile.children.cycles-pp.xfs_droplink
      0.16 ± 14%      -0.1        0.09 ±  8%  perf-profile.children.cycles-pp.inode_io_list_del
      0.12 ± 14%      -0.1        0.04 ± 74%  perf-profile.children.cycles-pp.rcu_all_qs
      0.10 ± 15%      -0.1        0.03 ±105%  perf-profile.children.cycles-pp.fsnotify_destroy_marks
      0.15 ± 14%      -0.1        0.08 ± 20%  perf-profile.children.cycles-pp.security_file_permission
      0.12 ± 19%      -0.1        0.05 ± 73%  perf-profile.children.cycles-pp.__d_lookup_rcu
      0.13 ± 27%      -0.1        0.06 ± 52%  perf-profile.children.cycles-pp.__might_fault
      0.12 ± 22%      -0.1        0.04 ± 72%  perf-profile.children.cycles-pp.xfs_buf_item_put
      0.17 ± 24%      -0.1        0.10 ± 25%  perf-profile.children.cycles-pp.xfs_idata_realloc
      0.14 ±  5%      -0.1        0.07 ±  9%  perf-profile.children.cycles-pp.__legitimize_path
      0.14 ± 17%      -0.1        0.08 ± 27%  perf-profile.children.cycles-pp.__srcu_read_lock
      0.13 ± 16%      -0.1        0.06 ± 49%  perf-profile.children.cycles-pp.current_time
      0.15 ± 13%      -0.1        0.09 ± 34%  perf-profile.children.cycles-pp.find_lock_entries
      0.12 ± 15%      -0.1        0.06 ± 47%  perf-profile.children.cycles-pp.dentry_unlink_inode
      0.13 ± 18%      -0.1        0.07 ± 53%  perf-profile.children.cycles-pp.d_instantiate
      0.18 ± 13%      -0.1        0.11 ±  6%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.15 ± 14%      -0.1        0.08 ± 14%  perf-profile.children.cycles-pp.security_task_getsecid_subj
      0.16 ± 19%      -0.1        0.10 ± 10%  perf-profile.children.cycles-pp.xfs_iext_insert
      0.14 ± 14%      -0.1        0.08 ± 14%  perf-profile.children.cycles-pp.free_unref_page_list
      0.09 ± 27%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.xfs_break_layouts
      0.13 ± 14%      -0.1        0.06 ± 45%  perf-profile.children.cycles-pp.fsnotify_mark_destroy_workfn
      0.10 ± 18%      -0.1        0.04 ± 75%  perf-profile.children.cycles-pp.fput_many
      0.11 ± 16%      -0.1        0.05 ± 45%  perf-profile.children.cycles-pp.refcount_dec_and_lock
      0.15 ± 21%      -0.1        0.09 ± 16%  perf-profile.children.cycles-pp.up_write
      0.13 ± 13%      -0.1        0.07 ± 11%  perf-profile.children.cycles-pp.apparmor_task_getsecid
      0.12 ± 29%      -0.1        0.06 ± 23%  perf-profile.children.cycles-pp.inode_init_always
      0.09 ± 15%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.fsnotify_final_mark_destroy
      0.11 ± 13%      -0.1        0.06 ± 47%  perf-profile.children.cycles-pp.fpu__clear
      0.14 ± 16%      -0.1        0.08 ± 13%  perf-profile.children.cycles-pp.xfs_btree_check_ptr
      0.11 ± 18%      -0.1        0.05 ± 71%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      0.14 ± 18%      -0.1        0.08 ± 21%  perf-profile.children.cycles-pp.xfs_iext_lookup_extent
      0.10 ± 26%      -0.1        0.04 ± 72%  perf-profile.children.cycles-pp.d_lookup
      0.14 ± 26%      -0.1        0.08 ± 16%  perf-profile.children.cycles-pp.xfs_trans_unreserve_and_mod_sb
      0.13 ± 23%      -0.1        0.07 ± 33%  perf-profile.children.cycles-pp.account_page_cleaned
      0.11 ± 21%      -0.1        0.06 ± 11%  perf-profile.children.cycles-pp.__mem_cgroup_charge
      0.13 ± 17%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.__irqentry_text_end
      0.14 ± 12%      -0.1        0.09 ± 20%  perf-profile.children.cycles-pp.account_page_dirtied
      0.08 ± 16%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.file_update_time
      0.10 ± 21%      -0.1        0.05 ± 47%  perf-profile.children.cycles-pp.xfs_lock_two_inodes
      0.16 ± 16%      -0.1        0.11 ± 11%  perf-profile.children.cycles-pp.xfs_bmapi_read
      0.10 ± 13%      -0.0        0.05 ± 49%  perf-profile.children.cycles-pp.security_path_mknod
      0.11 ± 18%      -0.0        0.06 ±  6%  perf-profile.children.cycles-pp.xfs_ialloc_ag_select
      0.14 ± 22%      -0.0        0.09 ± 25%  perf-profile.children.cycles-pp.xfs_perag_put
      0.08 ± 19%      -0.0        0.03 ±100%  perf-profile.children.cycles-pp.common_file_perm
      0.14 ± 22%      -0.0        0.10 ± 22%  perf-profile.children.cycles-pp.map_id_up
      0.09 ± 13%      -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.rcu_read_unlock_strict
      0.13 ± 18%      -0.0        0.09 ± 15%  perf-profile.children.cycles-pp._atomic_dec_and_lock
      0.08 ± 13%      -0.0        0.05 ± 46%  perf-profile.children.cycles-pp.xfs_isilocked
      0.06 ± 17%      +0.0        0.10 ± 11%  perf-profile.children.cycles-pp.handle_mm_fault
      0.07 ± 20%      +0.0        0.10 ±  9%  perf-profile.children.cycles-pp.do_user_addr_fault
      0.07 ± 17%      +0.0        0.11 ± 11%  perf-profile.children.cycles-pp.exc_page_fault
      0.05 ± 49%      +0.0        0.09 ± 11%  perf-profile.children.cycles-pp.__handle_mm_fault
      0.08 ± 19%      +0.0        0.12 ±  8%  perf-profile.children.cycles-pp.asm_exc_page_fault
      0.08 ± 22%      +0.0        0.12 ± 12%  perf-profile.children.cycles-pp.xfs_btree_del_cursor
      0.03 ±100%      +0.0        0.08 ± 16%  perf-profile.children.cycles-pp.call_cpuidle
      0.04 ± 72%      +0.0        0.09 ± 14%  perf-profile.children.cycles-pp.tick_nohz_tick_stopped
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.rcu_is_cpu_rrupt_from_idle
      0.04 ± 75%      +0.1        0.09 ± 17%  perf-profile.children.cycles-pp.__x64_sys_execve
      0.04 ± 75%      +0.1        0.09 ± 17%  perf-profile.children.cycles-pp.execve
      0.02 ±144%      +0.1        0.08 ± 20%  perf-profile.children.cycles-pp.bprm_execve
      0.00            +0.1        0.06 ± 13%  perf-profile.children.cycles-pp.inode_init_once
      0.00            +0.1        0.06 ± 18%  perf-profile.children.cycles-pp.rcu_segcblist_ready_cbs
      0.06 ± 48%      +0.1        0.12 ± 19%  perf-profile.children.cycles-pp.trigger_load_balance
      0.04 ± 73%      +0.1        0.10 ± 11%  perf-profile.children.cycles-pp.hrtimer_get_next_event
      0.18 ± 23%      +0.1        0.24 ± 13%  perf-profile.children.cycles-pp.update_sd_lb_stats
      0.07 ± 53%      +0.1        0.13 ±  9%  perf-profile.children.cycles-pp.irqtime_account_process_tick
      0.03 ±103%      +0.1        0.09 ± 17%  perf-profile.children.cycles-pp.do_execveat_common
      0.07 ± 22%      +0.1        0.13 ±  9%  perf-profile.children.cycles-pp.menu_reflect
      0.08 ± 21%      +0.1        0.15 ± 10%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.00            +0.1        0.06 ± 11%  perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
      0.01 ±223%      +0.1        0.07 ± 18%  perf-profile.children.cycles-pp.rcu_nocb_flush_deferred_wakeup
      0.00            +0.1        0.06 ± 11%  perf-profile.children.cycles-pp.xfs_alloc_ag_vextent_near
      0.03 ±100%      +0.1        0.10 ± 10%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.06 ± 21%      +0.1        0.14 ± 22%  perf-profile.children.cycles-pp.xfs_cil_prepare_item
      0.00            +0.1        0.07 ± 16%  perf-profile.children.cycles-pp.xfs_inode_item_init
      0.03 ±103%      +0.1        0.10 ± 23%  perf-profile.children.cycles-pp.tick_check_broadcast_expired
      0.00            +0.1        0.07 ± 18%  perf-profile.children.cycles-pp.__libc_fork
      0.02 ±144%      +0.1        0.09 ± 29%  perf-profile.children.cycles-pp.rcu_nmi_exit
      0.00            +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.03 ±101%      +0.1        0.10 ± 21%  perf-profile.children.cycles-pp.cpuidle_not_available
      0.00            +0.1        0.08 ± 16%  perf-profile.children.cycles-pp.read
      0.02 ±141%      +0.1        0.09 ± 13%  perf-profile.children.cycles-pp.tick_program_event
      0.03 ±102%      +0.1        0.10 ± 18%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.19 ± 22%      +0.1        0.27 ± 13%  perf-profile.children.cycles-pp.find_busiest_group
      0.00            +0.1        0.08 ± 24%  perf-profile.children.cycles-pp.cpuidle_reflect
      0.02 ±142%      +0.1        0.10 ± 29%  perf-profile.children.cycles-pp.can_stop_idle_tick
      0.00            +0.1        0.08 ± 16%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.20 ± 22%      +0.1        0.28 ± 17%  perf-profile.children.cycles-pp.xfs_dialloc_ag_finobt_near
      0.00            +0.1        0.08 ± 23%  perf-profile.children.cycles-pp.irq_work_needs_cpu
      0.00            +0.1        0.08 ± 17%  perf-profile.children.cycles-pp.x86_pmu_disable
      0.02 ±146%      +0.1        0.10 ± 31%  perf-profile.children.cycles-pp.rcu_nmi_enter
      0.05 ± 77%      +0.1        0.13 ± 15%  perf-profile.children.cycles-pp.perf_event_task_tick
      0.05 ± 48%      +0.1        0.14 ± 22%  perf-profile.children.cycles-pp.native_apic_mem_write
      0.00            +0.1        0.08 ± 25%  perf-profile.children.cycles-pp.asm_common_interrupt
      0.00            +0.1        0.08 ± 25%  perf-profile.children.cycles-pp.common_interrupt
      0.01 ±223%      +0.1        0.09 ± 15%  perf-profile.children.cycles-pp.update_curr
      0.00            +0.1        0.08 ± 27%  perf-profile.children.cycles-pp.xfs_btree_dup_cursor
      0.06 ± 46%      +0.1        0.14 ± 22%  perf-profile.children.cycles-pp.rb_next
      0.04 ±110%      +0.1        0.13 ± 16%  perf-profile.children.cycles-pp.rcu_eqs_enter
      0.06 ± 46%      +0.1        0.15 ± 16%  perf-profile.children.cycles-pp.irqentry_exit
      0.00            +0.1        0.09 ± 15%  perf-profile.children.cycles-pp.xfs_alloc_ag_vextent
      0.09 ± 28%      +0.1        0.18 ± 16%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.08 ± 34%      +0.1        0.17 ± 24%  perf-profile.children.cycles-pp.irqentry_enter
      0.00            +0.1        0.09 ± 22%  perf-profile.children.cycles-pp.crc_21
      0.06 ± 52%      +0.1        0.16 ± 19%  perf-profile.children.cycles-pp.tick_check_oneshot_broadcast_this_cpu
      0.13 ± 34%      +0.1        0.22 ± 18%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.09 ± 14%      +0.1        0.18 ± 12%  perf-profile.children.cycles-pp.__hrtimer_get_next_event
      0.15 ± 26%      +0.1        0.24 ± 11%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      0.02 ±141%      +0.1        0.12 ± 10%  perf-profile.children.cycles-pp.get_cpu_device
      0.04 ±104%      +0.1        0.13 ± 20%  perf-profile.children.cycles-pp.pm_qos_read_value
      0.06 ± 50%      +0.1        0.15 ± 23%  perf-profile.children.cycles-pp._xfs_buf_obj_cmp
      0.06 ± 51%      +0.1        0.16 ± 23%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.06 ± 17%      +0.1        0.16 ± 14%  perf-profile.children.cycles-pp.rb_erase
      0.00            +0.1        0.10 ± 11%  perf-profile.children.cycles-pp.enqueue_entity
      0.00            +0.1        0.10 ± 32%  perf-profile.children.cycles-pp.xfs_inode_free_callback
      0.07 ± 59%      +0.1        0.17 ± 14%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.00            +0.1        0.10 ± 22%  perf-profile.children.cycles-pp.__perf_event_task_sched_in
      0.00            +0.1        0.10 ± 17%  perf-profile.children.cycles-pp.xfs_ialloc_inode_init
      0.00            +0.1        0.11 ± 13%  perf-profile.children.cycles-pp.xfs_alloc_vextent
      0.03 ±102%      +0.1        0.14 ± 26%  perf-profile.children.cycles-pp.update_load_avg
      0.00            +0.1        0.12 ± 41%  perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.15 ± 18%      +0.1        0.27 ± 15%  perf-profile.children.cycles-pp.timerqueue_add
      0.16 ± 29%      +0.1        0.28 ± 18%  perf-profile.children.cycles-pp.run_ksoftirqd
      0.17 ± 29%      +0.1        0.30 ± 19%  perf-profile.children.cycles-pp.smpboot_thread_fn
      0.10 ± 28%      +0.1        0.22 ± 23%  perf-profile.children.cycles-pp.update_ts_time_stats
      0.00            +0.1        0.13 ± 21%  perf-profile.children.cycles-pp.__perf_event_task_sched_out
      0.06 ± 11%      +0.1        0.19 ± 12%  perf-profile.children.cycles-pp.__intel_pmu_disable_all
      0.00            +0.1        0.13 ± 17%  perf-profile.children.cycles-pp.xfs_fs_inode_init_once
      0.18 ± 17%      +0.1        0.31 ± 16%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.13 ± 17%      +0.1        0.27 ± 14%  perf-profile.children.cycles-pp.update_irq_load_avg
      0.00            +0.1        0.14 ± 40%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.16 ± 14%      +0.1        0.30 ± 13%  perf-profile.children.cycles-pp.update_blocked_averages
      0.06 ± 11%      +0.1        0.20 ± 15%  perf-profile.children.cycles-pp.intel_pmu_disable_all
      0.00            +0.1        0.14 ± 14%  perf-profile.children.cycles-pp.xfs_iunlink_insert_backref
      0.00            +0.1        0.14 ± 11%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.12 ± 35%      +0.1        0.27 ± 14%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.00            +0.1        0.14 ± 13%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.12 ± 26%      +0.1        0.26 ± 15%  perf-profile.children.cycles-pp.hrtimer_next_event_without
      0.00            +0.1        0.15 ± 21%  perf-profile.children.cycles-pp.xfs_iunlink_map_prev
      0.00            +0.2        0.15 ± 39%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.13 ± 34%      +0.2        0.28 ± 17%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.16 ± 14%      +0.2        0.31 ± 12%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.10 ± 23%      +0.2        0.25 ± 20%  perf-profile.children.cycles-pp.__slab_free
      0.00            +0.2        0.16 ± 21%  perf-profile.children.cycles-pp.dequeue_entity
      0.44 ± 21%      +0.2        0.60 ± 12%  perf-profile.children.cycles-pp.xfs_iunlink_update_inode
      0.09 ± 34%      +0.2        0.25 ± 24%  perf-profile.children.cycles-pp.xfs_contig_bits
      0.00            +0.2        0.16 ± 58%  perf-profile.children.cycles-pp.xfs_inode_item_committed
      0.00            +0.2        0.16 ± 40%  perf-profile.children.cycles-pp.xfs_buf_ioend
      0.00            +0.2        0.16 ± 19%  perf-profile.children.cycles-pp.__perf_pmu_sched_task
      0.33 ± 14%      +0.2        0.50 ± 18%  perf-profile.children.cycles-pp.rcu_core
      0.26 ± 24%      +0.2        0.43 ± 16%  perf-profile.children.cycles-pp.rebalance_domains
      0.18 ± 24%      +0.2        0.35 ± 10%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.16 ± 28%      +0.2        0.33 ± 13%  perf-profile.children.cycles-pp.__hrtimer_next_event_base
      0.11 ± 12%      +0.2        0.28 ± 20%  perf-profile.children.cycles-pp.allocate_slab
      0.16 ± 20%      +0.2        0.33 ± 14%  perf-profile.children.cycles-pp.native_sched_clock
      0.00            +0.2        0.18 ± 17%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.17 ± 11%      +0.2        0.35 ± 15%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.18 ± 16%      +0.2        0.37 ±  9%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.23 ± 15%      +0.2        0.42 ± 11%  perf-profile.children.cycles-pp.read_tsc
      0.00            +0.2        0.19 ± 28%  perf-profile.children.cycles-pp.xfs_iflush
      0.14 ± 28%      +0.2        0.34 ± 14%  perf-profile.children.cycles-pp.cpuidle_governor_latency_req
      0.00            +0.2        0.20 ± 23%  perf-profile.children.cycles-pp.perf_pmu_sched_task
      0.00            +0.2        0.20 ± 38%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.00            +0.2        0.21 ± 31%  perf-profile.children.cycles-pp.xfs_reclaim_worker
      0.28 ± 24%      +0.2        0.49 ± 15%  perf-profile.children.cycles-pp.xfs_imap_to_bp
      0.00            +0.2        0.22 ± 35%  perf-profile.children.cycles-pp.xfs_buf_inode_iodone
      0.18 ± 18%      +0.2        0.40 ± 11%  perf-profile.children.cycles-pp.timerqueue_del
      0.27 ± 18%      +0.2        0.50 ± 16%  perf-profile.children.cycles-pp.io_serial_in
      0.00            +0.2        0.22 ± 17%  perf-profile.children.cycles-pp.kmem_alloc_large
      0.22 ± 17%      +0.2        0.44 ± 10%  perf-profile.children.cycles-pp.update_rq_clock
      0.14 ± 20%      +0.2        0.37 ± 15%  perf-profile.children.cycles-pp.___slab_alloc
      0.22 ± 20%      +0.2        0.44 ± 13%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.15 ± 19%      +0.2        0.38 ± 15%  perf-profile.children.cycles-pp.__slab_alloc
      0.00            +0.2        0.24 ± 11%  perf-profile.children.cycles-pp.xfs_ialloc_ag_alloc
      0.29 ± 10%      +0.2        0.53 ±  9%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.15 ± 31%      +0.2        0.40 ± 22%  perf-profile.children.cycles-pp.up
      0.32 ± 14%      +0.3        0.57 ±  8%  perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt
      0.20 ± 30%      +0.3        0.46 ± 21%  perf-profile.children.cycles-pp.xfs_buf_unlock
      0.20 ± 15%      +0.3        0.46 ± 18%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.41 ± 23%      +0.3        0.69 ± 13%  perf-profile.children.cycles-pp.serial8250_console_write
      0.22 ± 18%      +0.3        0.50 ± 15%  perf-profile.children.cycles-pp.__remove_hrtimer
      0.40 ± 23%      +0.3        0.68 ± 13%  perf-profile.children.cycles-pp.uart_console_write
      0.39 ± 24%      +0.3        0.68 ± 14%  perf-profile.children.cycles-pp.serial8250_console_putchar
      0.40 ± 25%      +0.3        0.68 ± 14%  perf-profile.children.cycles-pp.wait_for_xmitr
      0.47 ± 16%      +0.3        0.75 ± 13%  perf-profile.children.cycles-pp.xfs_dialloc_select_ag
      0.32 ± 21%      +0.3        0.61 ±  8%  perf-profile.children.cycles-pp.clockevents_program_event
      0.12 ± 13%      +0.3        0.41 ± 11%  perf-profile.children.cycles-pp.try_to_wake_up
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.asm_sysvec_irq_work
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.sysvec_irq_work
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.__sysvec_irq_work
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.irq_work_run
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.irq_work_single
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.printk
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.vprintk_emit
      0.42 ± 20%      +0.3        0.72 ± 11%  perf-profile.children.cycles-pp.console_unlock
      0.44 ± 20%      +0.3        0.75 ± 10%  perf-profile.children.cycles-pp.irq_work_run_list
      0.00            +0.3        0.31 ± 19%  perf-profile.children.cycles-pp.xlog_write
      0.00            +0.3        0.33 ± 16%  perf-profile.children.cycles-pp.xfs_iunlink_update_dinode
      0.00            +0.3        0.33 ± 30%  perf-profile.children.cycles-pp.xfs_iflush_cluster
      0.00            +0.3        0.34 ± 13%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.00            +0.3        0.35 ± 23%  perf-profile.children.cycles-pp.finish_task_switch
      0.00            +0.4        0.36 ± 30%  perf-profile.children.cycles-pp.xfs_inode_item_push
      0.00            +0.4        0.37 ± 49%  perf-profile.children.cycles-pp.xfs_trans_committed_bulk
      0.00            +0.4        0.37 ± 12%  perf-profile.children.cycles-pp.xfs_inode_alloc
      0.40 ± 16%      +0.4        0.78 ±  5%  perf-profile.children.cycles-pp.ktime_get
      0.00            +0.4        0.40 ± 13%  perf-profile.children.cycles-pp.xfs_dinode_calc_crc
      0.00            +0.4        0.40 ± 13%  perf-profile.children.cycles-pp.crc32c
      0.00            +0.4        0.40 ± 21%  perf-profile.children.cycles-pp.xlog_cil_push_work
      0.35 ± 26%      +0.4        0.78 ± 16%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.36 ± 19%      +0.4        0.79 ± 15%  perf-profile.children.cycles-pp.tick_irq_enter
      0.00            +0.4        0.44 ± 29%  perf-profile.children.cycles-pp.xfsaild_push
      0.00            +0.4        0.44 ± 29%  perf-profile.children.cycles-pp.xfsaild
      0.36 ± 20%      +0.4        0.81 ± 15%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.67 ± 23%      +0.5        1.13 ± 11%  perf-profile.children.cycles-pp.scheduler_tick
      0.03 ±100%      +0.5        0.49 ± 18%  perf-profile.children.cycles-pp.schedule_timeout
      0.15 ± 20%      +0.5        0.62 ± 12%  perf-profile.children.cycles-pp.schedule
      0.04 ± 45%      +0.5        0.54 ± 22%  perf-profile.children.cycles-pp.schedule_idle
      0.00            +0.5        0.52 ± 23%  perf-profile.children.cycles-pp.__down
      0.00            +0.5        0.52 ± 22%  perf-profile.children.cycles-pp.down
      0.00            +0.5        0.53 ± 47%  perf-profile.children.cycles-pp.xlog_cil_process_committed
      0.00            +0.5        0.53 ± 47%  perf-profile.children.cycles-pp.xlog_cil_committed
      0.00            +0.5        0.53 ± 24%  perf-profile.children.cycles-pp.xfs_buf_lock
      0.00            +0.5        0.54 ± 48%  perf-profile.children.cycles-pp.xlog_state_do_callback
      0.63 ± 17%      +0.5        1.16 ± 14%  perf-profile.children.cycles-pp.xfs_iunlink
      0.00            +0.5        0.54 ± 48%  perf-profile.children.cycles-pp.xlog_ioend_work
      0.25 ± 17%      +0.6        0.87 ± 11%  perf-profile.children.cycles-pp.memcpy_erms
      0.87 ± 10%      +0.6        1.50 ± 14%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.62 ± 18%      +0.7        1.27 ± 15%  perf-profile.children.cycles-pp.xfs_buf_item_format
      0.56 ± 26%      +0.7        1.22 ± 15%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.89 ± 12%      +0.7        1.55 ± 14%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.46 ± 19%      +0.7        1.20 ± 14%  perf-profile.children.cycles-pp.xfs_buf_item_format_segment
      0.21 ± 15%      +0.9        1.13 ± 15%  perf-profile.children.cycles-pp.__schedule
      1.17 ± 18%      +1.0        2.13 ± 10%  perf-profile.children.cycles-pp.update_process_times
      1.24 ± 19%      +1.0        2.25 ± 10%  perf-profile.children.cycles-pp.tick_sched_handle
      1.42 ± 18%      +1.1        2.57 ±  9%  perf-profile.children.cycles-pp.tick_sched_timer
      1.34 ± 27%      +1.6        2.92 ± 18%  perf-profile.children.cycles-pp.menu_select
      2.29 ± 16%      +2.0        4.32 ± 10%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      3.15 ± 17%      +2.8        5.95 ±  9%  perf-profile.children.cycles-pp.hrtimer_interrupt
      3.28 ± 16%      +2.9        6.21 ± 10%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      4.87 ± 16%      +4.3        9.19 ± 10%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      5.31 ± 16%      +4.7       10.00 ± 10%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.00            +4.8        4.81 ± 24%  perf-profile.children.cycles-pp.xfs_inodegc_worker
      0.00            +5.0        5.02 ± 23%  perf-profile.children.cycles-pp.xfs_icwalk
      0.00            +5.0        5.02 ± 23%  perf-profile.children.cycles-pp.xfs_icwalk_ag
      0.72 ± 15%      +6.3        7.06 ± 21%  perf-profile.children.cycles-pp.worker_thread
      0.62 ± 15%      +6.4        6.97 ± 21%  perf-profile.children.cycles-pp.process_one_work
      0.94 ± 16%      +6.9        7.87 ± 20%  perf-profile.children.cycles-pp.ret_from_fork
      0.93 ± 16%      +6.9        7.87 ± 20%  perf-profile.children.cycles-pp.kthread
     45.05 ± 16%     +14.3       59.33 ±  6%  perf-profile.children.cycles-pp.cpuidle_enter_state
     45.09 ± 16%     +14.3       59.40 ±  6%  perf-profile.children.cycles-pp.cpuidle_enter
     47.05 ± 15%     +17.1       64.19 ±  6%  perf-profile.children.cycles-pp.do_idle
     47.05 ± 15%     +17.1       64.19 ±  6%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     47.05 ± 15%     +17.1       64.19 ±  6%  perf-profile.children.cycles-pp.cpu_startup_entry
     46.01 ± 16%     +17.2       63.24 ±  6%  perf-profile.children.cycles-pp.start_secondary
      1.74 ± 20%      -0.9        0.84 ± 13%  perf-profile.self.cycles-pp.syscall_exit_to_user_mode
      0.89 ± 17%      -0.5        0.43 ± 15%  perf-profile.self.cycles-pp.__entry_text_start
      0.90 ± 17%      -0.4        0.46 ±  6%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.97 ± 13%      -0.4        0.57 ± 10%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.58 ± 20%      -0.4        0.21 ± 13%  perf-profile.self.cycles-pp.xfs_log_ticket_ungrant
      0.66 ± 15%      -0.3        0.39 ± 13%  perf-profile.self.cycles-pp.kmem_cache_free
      0.60 ± 15%      -0.2        0.36 ± 12%  perf-profile.self.cycles-pp.xfs_inode_item_format
      0.50 ± 17%      -0.2        0.27 ±  9%  perf-profile.self.cycles-pp.xfs_trans_log_inode
      0.40 ± 20%      -0.2        0.18 ± 15%  perf-profile.self.cycles-pp.xlog_grant_add_space
      0.39 ± 21%      -0.2        0.19 ± 10%  perf-profile.self.cycles-pp.___might_sleep
      0.44 ± 19%      -0.2        0.24 ± 21%  perf-profile.self.cycles-pp.xfs_btree_lookup
      0.39 ± 13%      -0.2        0.19 ± 13%  perf-profile.self.cycles-pp.fsnotify
      0.29 ± 16%      -0.2        0.11 ± 34%  perf-profile.self.cycles-pp.__xfs_btree_check_sblock
      0.31 ± 25%      -0.2        0.13 ± 19%  perf-profile.self.cycles-pp.link_path_walk
      0.49 ± 14%      -0.2        0.33 ± 20%  perf-profile.self.cycles-pp.xlog_cil_insert_items
      0.25 ± 31%      -0.2        0.10 ± 28%  perf-profile.self.cycles-pp.xfs_mod_fdblocks
      0.24 ± 22%      -0.1        0.09 ± 47%  perf-profile.self.cycles-pp.xfs_buffered_write_iomap_begin
      0.22 ± 15%      -0.1        0.09 ± 15%  perf-profile.self.cycles-pp.map_id_range_down
      0.18 ± 21%      -0.1        0.06 ± 79%  perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs
      0.21 ± 23%      -0.1        0.09 ± 14%  perf-profile.self.cycles-pp.__raw_callee_save___native_queued_spin_unlock
      0.25 ± 16%      -0.1        0.12 ± 14%  perf-profile.self.cycles-pp.memset_erms
      0.23 ± 27%      -0.1        0.11 ± 26%  perf-profile.self.cycles-pp.__xfs_bunmapi
      0.22 ± 15%      -0.1        0.10 ± 17%  perf-profile.self.cycles-pp.do_syscall_64
      0.20 ± 13%      -0.1        0.08 ± 30%  perf-profile.self.cycles-pp.__setup_rt_frame
      0.22 ± 17%      -0.1        0.10 ± 27%  perf-profile.self.cycles-pp.xfs_errortag_test
      0.26 ± 15%      -0.1        0.15 ± 15%  perf-profile.self.cycles-pp.__might_sleep
      0.19 ± 25%      -0.1        0.08 ± 13%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.19 ± 14%      -0.1        0.08 ± 20%  perf-profile.self.cycles-pp.xfs_buf_item_size
      0.20 ± 11%      -0.1        0.10 ± 15%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.17 ± 19%      -0.1        0.06 ± 14%  perf-profile.self.cycles-pp.xfs_btree_rec_offset
      0.24 ± 24%      -0.1        0.14 ± 20%  perf-profile.self.cycles-pp.xfs_trans_add_item
      0.15 ± 20%      -0.1        0.05 ± 73%  perf-profile.self.cycles-pp.copy_fpstate_to_sigframe
      0.16 ± 21%      -0.1        0.06 ± 48%  perf-profile.self.cycles-pp.up_read
      0.18 ± 18%      -0.1        0.08 ± 17%  perf-profile.self.cycles-pp.xfs_trans_dirty_buf
      0.17 ± 25%      -0.1        0.08 ± 17%  perf-profile.self.cycles-pp.xfs_iget
      0.26 ± 16%      -0.1        0.16 ± 13%  perf-profile.self.cycles-pp.page_counter_cancel
      0.18 ± 20%      -0.1        0.08 ± 49%  perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.15 ± 30%      -0.1        0.06 ± 46%  perf-profile.self.cycles-pp.xfs_create
      0.16 ± 26%      -0.1        0.07 ± 46%  perf-profile.self.cycles-pp.xfs_trans_alloc
      0.16 ± 22%      -0.1        0.06 ±  7%  perf-profile.self.cycles-pp.xfs_inode_item_size
      0.14 ± 18%      -0.1        0.05 ± 77%  perf-profile.self.cycles-pp.__fput
      0.14 ± 20%      -0.1        0.06 ± 13%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.19 ± 18%      -0.1        0.11 ± 17%  perf-profile.self.cycles-pp.path_openat
      0.15 ± 14%      -0.1        0.07 ± 47%  perf-profile.self.cycles-pp.xfs_buf_item_format
      0.13 ± 22%      -0.1        0.05 ± 46%  perf-profile.self.cycles-pp.do_dentry_open
      0.10 ± 25%      -0.1        0.02 ± 99%  perf-profile.self.cycles-pp.xfs_check_agi_freecount
      0.18 ± 18%      -0.1        0.10 ± 21%  perf-profile.self.cycles-pp.xfs_trans_read_buf_map
      0.11 ± 24%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.xfs_btree_check_sblock
      0.12 ± 27%      -0.1        0.05 ± 81%  perf-profile.self.cycles-pp.__xfs_trans_commit
      0.11 ± 20%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.__fsnotify_parent
      0.20 ± 25%      -0.1        0.12 ± 13%  perf-profile.self.cycles-pp.xfs_trans_del_item
      0.11 ± 20%      -0.1        0.03 ±103%  perf-profile.self.cycles-pp.xfs_dir2_sf_check
      0.14 ± 17%      -0.1        0.06 ± 21%  perf-profile.self.cycles-pp.strncpy_from_user
      0.11 ± 29%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.xfs_dir2_sf_removename
      0.11 ± 31%      -0.1        0.04 ± 75%  perf-profile.self.cycles-pp.lockref_put_return
      0.11 ± 33%      -0.1        0.04 ± 73%  perf-profile.self.cycles-pp.xfs_ilock
      0.10 ± 19%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.xfs_buf_item_release
      0.10 ± 21%      -0.1        0.03 ±101%  perf-profile.self.cycles-pp.__add_to_page_cache_locked
      0.13 ± 22%      -0.1        0.06 ± 58%  perf-profile.self.cycles-pp.xas_store
      0.10 ± 11%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.fpu__clear
      0.17 ± 14%      -0.1        0.10 ± 22%  perf-profile.self.cycles-pp.get_obj_cgroup_from_current
      0.15 ± 24%      -0.1        0.08 ± 13%  perf-profile.self.cycles-pp.xfs_log_reserve
      0.12 ± 21%      -0.1        0.05 ± 73%  perf-profile.self.cycles-pp.__d_lookup_rcu
      0.14 ± 19%      -0.1        0.08 ± 21%  perf-profile.self.cycles-pp.inode_permission
      0.18 ± 18%      -0.1        0.11 ± 12%  perf-profile.self.cycles-pp.xfs_dir2_sf_addname
      0.10 ± 13%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.generic_permission
      0.14 ± 17%      -0.1        0.08 ± 27%  perf-profile.self.cycles-pp.__srcu_read_lock
      0.11 ± 12%      -0.1        0.05 ± 74%  perf-profile.self.cycles-pp.do_open
      0.10 ± 18%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.percpu_counter_add_batch
      0.13 ± 10%      -0.1        0.07 ± 48%  perf-profile.self.cycles-pp.do_sys_openat2
      0.10 ± 32%      -0.1        0.04 ± 45%  perf-profile.self.cycles-pp.xfs_btree_get_rec
      0.12 ± 20%      -0.1        0.06 ± 50%  perf-profile.self.cycles-pp.xfs_iunlock
      0.11 ± 20%      -0.1        0.05 ± 46%  perf-profile.self.cycles-pp.xfs_btree_ptr_to_daddr
      0.12 ± 22%      -0.1        0.06 ± 19%  perf-profile.self.cycles-pp.xfs_dir_ialloc
      0.10 ± 19%      -0.1        0.05 ± 47%  perf-profile.self.cycles-pp.__fsnotify_update_child_dentry_flags
      0.13 ± 17%      -0.1        0.08 ±  8%  perf-profile.self.cycles-pp.__irqentry_text_end
      0.09 ± 22%      -0.1        0.04 ± 72%  perf-profile.self.cycles-pp.xfs_buf_read_map
      0.13 ± 22%      -0.1        0.08 ± 14%  perf-profile.self.cycles-pp.up_write
      0.08 ± 21%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.do_fcntl
      0.14 ± 13%      -0.0        0.09 ± 31%  perf-profile.self.cycles-pp.xfs_btree_lookup_get_block
      0.11 ± 19%      -0.0        0.06 ± 14%  perf-profile.self.cycles-pp.iput
      0.14 ± 20%      -0.0        0.09 ± 24%  perf-profile.self.cycles-pp.map_id_up
      0.07 ± 11%      -0.0        0.03 ±100%  perf-profile.self.cycles-pp.xfs_isilocked
      0.02 ±141%      +0.1        0.07 ± 16%  perf-profile.self.cycles-pp.call_cpuidle
      0.04 ± 71%      +0.1        0.09 ± 19%  perf-profile.self.cycles-pp.irq_exit_rcu
      0.06 ± 47%      +0.1        0.11 ± 21%  perf-profile.self.cycles-pp.trigger_load_balance
      0.06 ± 17%      +0.1        0.12 ± 14%  perf-profile.self.cycles-pp.clockevents_program_event
      0.06 ±  9%      +0.1        0.11 ± 26%  perf-profile.self.cycles-pp.allocate_slab
      0.00            +0.1        0.06 ±  9%  perf-profile.self.cycles-pp.inode_init_once
      0.02 ±141%      +0.1        0.07 ± 21%  perf-profile.self.cycles-pp.rcu_eqs_enter
      0.02 ±141%      +0.1        0.07 ± 21%  perf-profile.self.cycles-pp.radix_tree_tag_clear
      0.01 ±223%      +0.1        0.07 ± 16%  perf-profile.self.cycles-pp.rcu_nocb_flush_deferred_wakeup
      0.00            +0.1        0.06 ± 13%  perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
      0.07 ± 53%      +0.1        0.13 ±  9%  perf-profile.self.cycles-pp.irqtime_account_process_tick
      0.02 ±141%      +0.1        0.08 ± 28%  perf-profile.self.cycles-pp.rcu_nmi_exit
      0.01 ±223%      +0.1        0.07 ± 21%  perf-profile.self.cycles-pp.rebalance_domains
      0.08 ± 20%      +0.1        0.14 ± 18%  perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
      0.06 ± 28%      +0.1        0.13 ± 33%  perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
      0.08 ± 17%      +0.1        0.14 ± 17%  perf-profile.self.cycles-pp.update_process_times
      0.03 ±105%      +0.1        0.10 ± 20%  perf-profile.self.cycles-pp.update_ts_time_stats
      0.03 ±102%      +0.1        0.10 ± 21%  perf-profile.self.cycles-pp.rcu_idle_exit
      0.02 ±141%      +0.1        0.09 ± 15%  perf-profile.self.cycles-pp.tick_program_event
      0.02 ±146%      +0.1        0.09 ± 22%  perf-profile.self.cycles-pp.tick_check_broadcast_expired
      0.00            +0.1        0.07 ± 23%  perf-profile.self.cycles-pp.irq_work_needs_cpu
      0.06 ± 11%      +0.1        0.13 ± 15%  perf-profile.self.cycles-pp.__hrtimer_get_next_event
      0.00            +0.1        0.08 ± 26%  perf-profile.self.cycles-pp.xfs_fs_inode_init_once
      0.09 ± 12%      +0.1        0.16 ±  9%  perf-profile.self.cycles-pp.timerqueue_add
      0.02 ±142%      +0.1        0.10 ± 28%  perf-profile.self.cycles-pp.can_stop_idle_tick
      0.00            +0.1        0.08 ± 54%  perf-profile.self.cycles-pp.xfs_trans_committed_bulk
      0.03 ±106%      +0.1        0.11 ± 20%  perf-profile.self.cycles-pp.rcu_eqs_exit
      0.02 ±142%      +0.1        0.10 ± 29%  perf-profile.self.cycles-pp.__remove_hrtimer
      0.10 ± 25%      +0.1        0.18 ± 16%  perf-profile.self.cycles-pp.scheduler_tick
      0.09 ± 27%      +0.1        0.17 ± 18%  perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
      0.02 ±144%      +0.1        0.10 ± 23%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.00            +0.1        0.08 ± 16%  perf-profile.self.cycles-pp.x86_pmu_disable
      0.00            +0.1        0.08 ± 16%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.06 ± 46%      +0.1        0.14 ± 23%  perf-profile.self.cycles-pp.rb_next
      0.06 ± 47%      +0.1        0.14 ± 18%  perf-profile.self.cycles-pp.timerqueue_del
      0.02 ±142%      +0.1        0.10 ± 21%  perf-profile.self.cycles-pp.cpuidle_not_available
      0.01 ±223%      +0.1        0.09 ± 24%  perf-profile.self.cycles-pp.cpuidle_governor_latency_req
      0.05 ± 50%      +0.1        0.13 ± 20%  perf-profile.self.cycles-pp.native_apic_mem_write
      0.08 ± 12%      +0.1        0.16 ± 13%  perf-profile.self.cycles-pp.update_rq_clock
      0.04 ± 79%      +0.1        0.13 ± 15%  perf-profile.self.cycles-pp.perf_event_task_tick
      0.04 ±109%      +0.1        0.12 ± 19%  perf-profile.self.cycles-pp.pm_qos_read_value
      0.06 ± 52%      +0.1        0.15 ± 19%  perf-profile.self.cycles-pp.tick_check_oneshot_broadcast_this_cpu
      0.13 ± 34%      +0.1        0.22 ± 18%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.02 ±141%      +0.1        0.12 ± 10%  perf-profile.self.cycles-pp.get_cpu_device
      0.06 ± 17%      +0.1        0.16 ± 12%  perf-profile.self.cycles-pp.rb_erase
      0.06 ± 51%      +0.1        0.16 ± 24%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.04 ± 77%      +0.1        0.15 ± 22%  perf-profile.self.cycles-pp._xfs_buf_obj_cmp
      0.12 ± 25%      +0.1        0.22 ± 13%  perf-profile.self.cycles-pp.hrtimer_interrupt
      0.00            +0.1        0.12 ± 16%  perf-profile.self.cycles-pp.xfs_iunlink_insert_backref
      0.00            +0.1        0.12 ± 17%  perf-profile.self.cycles-pp.__schedule
      0.09 ± 20%      +0.1        0.22 ± 19%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.05 ±  8%      +0.1        0.18 ± 11%  perf-profile.self.cycles-pp.__intel_pmu_disable_all
      0.13 ± 18%      +0.1        0.26 ± 13%  perf-profile.self.cycles-pp.update_irq_load_avg
      0.14 ± 30%      +0.1        0.28 ± 13%  perf-profile.self.cycles-pp.__hrtimer_next_event_base
      0.00            +0.2        0.15 ± 20%  perf-profile.self.cycles-pp.xlog_write
      0.12 ± 17%      +0.2        0.28 ± 19%  perf-profile.self.cycles-pp.tick_nohz_next_event
      0.08 ± 38%      +0.2        0.24 ± 26%  perf-profile.self.cycles-pp.xfs_contig_bits
      0.09 ± 25%      +0.2        0.25 ± 20%  perf-profile.self.cycles-pp.__slab_free
      0.18 ± 24%      +0.2        0.34 ±  9%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.15 ± 19%      +0.2        0.31 ± 14%  perf-profile.self.cycles-pp.native_sched_clock
      0.20 ± 16%      +0.2        0.36 ± 12%  perf-profile.self.cycles-pp.read_tsc
      0.13 ± 23%      +0.2        0.30 ± 15%  perf-profile.self.cycles-pp.__hrtimer_run_queues
      0.18 ± 24%      +0.2        0.37 ± 10%  perf-profile.self.cycles-pp.ktime_get
      0.18 ± 17%      +0.2        0.37 ±  9%  perf-profile.self.cycles-pp.do_idle
      0.20 ± 40%      +0.2        0.41 ± 16%  perf-profile.self.cycles-pp.memcpy_toio
      0.15 ± 24%      +0.2        0.36 ± 22%  perf-profile.self.cycles-pp.rcu_sched_clock_irq
      0.26 ± 19%      +0.2        0.48 ± 14%  perf-profile.self.cycles-pp.io_serial_in
      0.49 ± 21%      +0.5        0.97 ± 14%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.24 ± 18%      +0.6        0.85 ± 11%  perf-profile.self.cycles-pp.memcpy_erms
      0.60 ± 30%      +0.7        1.28 ± 25%  perf-profile.self.cycles-pp.menu_select



***************************************************************************************************
lkp-ivb-2ep1: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/dir/stress-ng/60s/0x42e

commit: 
  ae8eb51386 ("xfs: separate primary inode selection criteria in xfs_iget_cache_hit")
  752d5513e6 ("xfs: defer inode inactivation to a workqueue")

ae8eb51386366771 752d5513e6e9f5128d3176e7d78 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   1168842 ±  2%     -28.6%     834743        stress-ng.dir.ops
     19377 ±  2%     -29.1%      13742        stress-ng.dir.ops_per_sec
    866.33 ±  4%     +56.8%       1358 ±  2%  stress-ng.time.involuntary_context_switches
    172.17           -45.8%      93.33 ±  2%  stress-ng.time.percent_of_cpu_this_job_got
    100.98           -46.5%      54.02 ±  3%  stress-ng.time.system_time
   1020437           -60.4%     404018        stress-ng.time.voluntary_context_switches
   2934462           +51.7%    4450935 ± 25%  cpuidle.C6.usage
     93.18            +1.5%      94.56        iostat.cpu.idle
      6.35 ±  3%     -21.0%       5.02 ±  6%  iostat.cpu.system
      3.17            -0.7        2.42        mpstat.cpu.all.sys%
      0.43 ±  3%      -0.1        0.37 ±  5%  mpstat.cpu.all.usr%
      1.60 ± 84%    +501.9%       9.66 ± 73%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      1.60 ± 84%    +501.9%       9.66 ± 73%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
     57.33 ± 53%    +311.3%     235.83 ± 76%  interrupts.37:PCI-MSI.2621443-edge.eth0-TxRx-2
     95585 ±  5%     -16.1%      80192 ±  3%  interrupts.CAL:Function_call_interrupts
     57.33 ± 53%    +311.3%     235.83 ± 76%  interrupts.CPU28.37:PCI-MSI.2621443-edge.eth0-TxRx-2
    198.67           -12.2%     174.33 ±  2%  turbostat.Avg_MHz
      8.55 ±  3%      -1.4        7.12 ±  5%  turbostat.Busy%
   2928562           +51.8%    4445863 ± 25%  turbostat.C6
      4869 ±  3%     +56.3%       7612        vmstat.io.bo
      2.00           -50.0%       1.00        vmstat.procs.r
     32756 ±  2%     -46.1%      17640        vmstat.system.cs
      7545 ±  2%     +47.1%      11098        softirqs.BLOCK
      9013 ±  2%     +47.3%      13274        softirqs.CPU8.TASKLET
      9229 ±  2%     +46.2%      13491        softirqs.TASKLET
     10011 ±  3%     +20.7%      12088 ±  5%  softirqs.TIMER
     35680            +7.5%      38348 ±  2%  proc-vmstat.nr_slab_unreclaimable
    477412            -2.2%     467123        proc-vmstat.numa_hit
    433741            -2.4%     423448        proc-vmstat.numa_local
    609441 ±  3%     +28.4%     782412        proc-vmstat.pgalloc_normal
    515904 ±  4%     +33.3%     687913        proc-vmstat.pgfree
    318440 ±  2%     +57.0%     499795        proc-vmstat.pgpgout
     18944          +139.7%      45407 ±  7%  slabinfo.kmalloc-16.active_objs
     74.00          +156.3%     189.67 ±  6%  slabinfo.kmalloc-16.active_slabs
     18944          +156.9%      48661 ±  6%  slabinfo.kmalloc-16.num_objs
     74.00          +156.3%     189.67 ±  6%  slabinfo.kmalloc-16.num_slabs
      2549 ±  5%     +17.8%       3003 ±  8%  slabinfo.kmalloc-2k.active_objs
      2631 ±  5%     +17.5%       3092 ±  8%  slabinfo.kmalloc-2k.num_objs
      2176 ±  2%     -14.8%       1853        slabinfo.kmalloc-512.active_slabs
     69665 ±  2%     -14.8%      59328        slabinfo.kmalloc-512.num_objs
      2176 ±  2%     -14.8%       1853        slabinfo.kmalloc-512.num_slabs
    135099 ± 11%     -31.3%      92781 ±  8%  slabinfo.kmalloc-8.active_objs
    135373 ± 11%     -28.2%      97194 ±  7%  slabinfo.kmalloc-8.num_objs
      1149          +134.4%       2695        slabinfo.kmalloc-8k.active_objs
    288.67          +155.8%     738.50        slabinfo.kmalloc-8k.active_slabs
      1156          +155.6%       2955        slabinfo.kmalloc-8k.num_objs
    288.67          +155.8%     738.50        slabinfo.kmalloc-8k.num_slabs
     11.63 ±  2%     +49.2%      17.35 ± 10%  perf-stat.i.MPKI
 1.408e+09           -21.3%  1.108e+09        perf-stat.i.branch-instructions
      2.65            +1.6        4.25 ±  6%  perf-stat.i.branch-miss-rate%
     12.30 ±  9%      +6.6       18.93 ±  7%  perf-stat.i.cache-miss-rate%
   8844435 ±  9%     +29.8%   11477739 ± 19%  perf-stat.i.cache-misses
     33497 ±  2%     -45.6%      18238        perf-stat.i.context-switches
      1.45 ±  2%     +56.1%       2.27 ±  5%  perf-stat.i.cpi
 9.709e+09            -9.5%   8.79e+09 ±  5%  perf-stat.i.cpu-cycles
      1106 ±  7%     -29.5%     780.09 ± 14%  perf-stat.i.cycles-between-cache-misses
  16804031           -18.6%   13673237 ±  5%  perf-stat.i.dTLB-load-misses
 1.989e+09           -21.3%  1.564e+09        perf-stat.i.dTLB-loads
      0.08 ±  4%      +0.0        0.11 ±  7%  perf-stat.i.dTLB-store-miss-rate%
 1.226e+09           -14.2%  1.052e+09 ±  4%  perf-stat.i.dTLB-stores
     40.00 ±  6%     +18.5       58.47 ±  3%  perf-stat.i.iTLB-load-miss-rate%
   2471083 ±  6%     -35.0%    1606327 ±  4%  perf-stat.i.iTLB-loads
 7.446e+09           -21.4%  5.852e+09        perf-stat.i.instructions
      5070 ±  6%     -25.6%       3774 ± 10%  perf-stat.i.instructions-per-iTLB-miss
      0.73 ±  2%     -17.8%       0.60 ±  4%  perf-stat.i.ipc
      0.20            -9.5%       0.18 ±  5%  perf-stat.i.metric.GHz
    188.78 ± 19%    +100.7%     378.78 ± 13%  perf-stat.i.metric.K/sec
     97.88           -19.6%      78.74 ±  2%  perf-stat.i.metric.M/sec
   1065297 ± 30%     -19.7%     855431 ±  2%  perf-stat.i.node-stores
      2.51            +0.5        3.01 ±  6%  perf-stat.overall.branch-miss-rate%
     11.47 ± 10%      +5.0       16.44 ± 10%  perf-stat.overall.cache-miss-rate%
      1.30 ±  2%     +15.1%       1.50 ±  4%  perf-stat.overall.cpi
      1106 ±  7%     -28.8%     787.97 ± 14%  perf-stat.overall.cycles-between-cache-misses
      0.08 ±  5%      +0.0        0.10 ±  8%  perf-stat.overall.dTLB-store-miss-rate%
     36.84 ±  6%     +10.7       47.55 ±  4%  perf-stat.overall.iTLB-load-miss-rate%
      5193 ±  6%     -22.1%       4048 ± 10%  perf-stat.overall.instructions-per-iTLB-miss
      0.77 ±  2%     -13.0%       0.67 ±  5%  perf-stat.overall.ipc
 1.386e+09           -21.3%  1.091e+09        perf-stat.ps.branch-instructions
   8703834 ±  9%     +29.8%   11296182 ± 19%  perf-stat.ps.cache-misses
     32998 ±  2%     -45.6%      17962        perf-stat.ps.context-switches
 9.558e+09            -9.5%  8.654e+09 ±  5%  perf-stat.ps.cpu-cycles
  16542050           -18.6%   13461636 ±  5%  perf-stat.ps.dTLB-load-misses
 1.958e+09           -21.3%   1.54e+09        perf-stat.ps.dTLB-loads
 1.207e+09           -14.2%  1.036e+09 ±  4%  perf-stat.ps.dTLB-stores
   2433257 ±  6%     -35.0%    1581700 ±  4%  perf-stat.ps.iTLB-loads
 7.331e+09           -21.4%  5.762e+09        perf-stat.ps.instructions
   1048161 ± 30%     -19.7%     841811 ±  2%  perf-stat.ps.node-stores
 4.643e+11           -21.0%  3.668e+11        perf-stat.total.instructions
     39.51 ±  6%     -15.6       23.94 ± 13%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
     39.56 ±  6%     -15.6       24.00 ± 13%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     11.32 ±  7%     -11.3        0.00        perf-profile.calltrace.cycles-pp.destroy_inode.vfs_rmdir.do_rmdir.do_syscall_64.entry_SYSCALL_64_after_hwframe
     18.17 ±  7%     -11.3        6.90 ± 16%  perf-profile.calltrace.cycles-pp.do_rmdir.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11.22 ±  6%     -11.2        0.00        perf-profile.calltrace.cycles-pp.xfs_inode_mark_reclaimable.destroy_inode.vfs_rmdir.do_rmdir.do_syscall_64
     17.68 ±  7%     -11.2        6.46 ± 15%  perf-profile.calltrace.cycles-pp.vfs_rmdir.do_rmdir.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11.08 ±  6%     -11.1        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.vfs_rmdir.do_rmdir
     11.05 ±  6%     -11.0        0.00        perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode.vfs_rmdir
      9.47 ±  6%      -9.5        0.00        perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable.destroy_inode
      8.43 ±  6%      -8.4        0.00        perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inode_mark_reclaimable
     15.42 ±  6%      -3.1       12.36 ± 12%  perf-profile.calltrace.cycles-pp.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     14.86 ±  6%      -3.0       11.88 ± 12%  perf-profile.calltrace.cycles-pp.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     14.77 ±  6%      -3.0       11.80 ± 12%  perf-profile.calltrace.cycles-pp.xfs_generic_create.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     14.56 ±  6%      -2.9       11.68 ± 12%  perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat.do_syscall_64
      9.95 ±  5%      -2.0        7.91 ± 12%  perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.vfs_mkdir.do_mkdirat
      7.58 ±  6%      -1.8        5.73 ± 15%  perf-profile.calltrace.cycles-pp.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive
      8.19 ±  5%      -1.7        6.46 ± 11%  perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create.vfs_mkdir
      7.16 ±  6%      -1.7        5.45 ± 15%  perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree
      7.54 ±  5%      -1.6        5.91 ± 12%  perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create.xfs_generic_create
      4.50 ±  9%      -1.0        3.46 ± 12%  perf-profile.calltrace.cycles-pp.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.40 ±  9%      -1.0        3.39 ± 12%  perf-profile.calltrace.cycles-pp.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.97 ±  5%      -0.9        3.09 ± 12%  perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create
      3.33 ± 10%      -0.8        2.49 ± 13%  perf-profile.calltrace.cycles-pp.vfs_statfs.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.31 ± 10%      -0.8        2.47 ± 13%  perf-profile.calltrace.cycles-pp.statfs_by_dentry.vfs_statfs.user_statfs.__do_sys_statfs.do_syscall_64
      3.24 ± 10%      -0.8        2.42 ± 13%  perf-profile.calltrace.cycles-pp.xfs_fs_statfs.statfs_by_dentry.vfs_statfs.user_statfs.__do_sys_statfs
      3.10 ± 10%      -0.8        2.31 ± 13%  perf-profile.calltrace.cycles-pp.__percpu_counter_sum.xfs_fs_statfs.statfs_by_dentry.vfs_statfs.user_statfs
      3.79 ±  5%      -0.8        3.04 ± 15%  perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree
      2.69 ±  8%      -0.7        2.01 ± 17%  perf-profile.calltrace.cycles-pp.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree
      2.73 ±  7%      -0.6        2.10 ± 12%  perf-profile.calltrace.cycles-pp.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc.xfs_create
      2.42 ±  5%      -0.6        1.85 ± 12%  perf-profile.calltrace.cycles-pp.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc
      2.39 ±  5%      -0.5        1.89 ± 15%  perf-profile.calltrace.cycles-pp.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree
      1.04 ± 28%      -0.5        0.57 ± 56%  perf-profile.calltrace.cycles-pp.xfs_inobt_get_maxrecs.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount
      2.21 ±  5%      -0.4        1.77 ±  7%  perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount
      1.73 ±  9%      -0.4        1.31 ± 17%  perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree
      1.62 ±  5%      -0.4        1.20 ±  9%  perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag
      1.74 ±  7%      -0.4        1.37 ± 12%  perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dir_ialloc
      0.65 ±  6%      -0.4        0.29 ±100%  perf-profile.calltrace.cycles-pp.cpumask_next.__percpu_counter_sum.xfs_fs_statfs.statfs_by_dentry.vfs_statfs
      1.43 ±  7%      -0.3        1.11 ± 15%  perf-profile.calltrace.cycles-pp.xfs_dir2_node_addname.xfs_dir_createname.xfs_create.xfs_generic_create.vfs_mkdir
      1.54 ±  6%      -0.3        1.26 ± 15%  perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt
      1.17 ± 10%      -0.3        0.91 ± 16%  perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt
      1.20 ±  7%      -0.2        0.96 ± 10%  perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag
      0.84 ±  7%      +0.2        1.03 ± 10%  perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      0.36 ± 70%      +0.2        0.60 ± 11%  perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.53 ± 45%      +0.2        0.78 ± 14%  perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
      0.98 ± 12%      +0.3        1.26 ± 11%  perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
      0.47 ± 46%      +0.3        0.77 ±  9%  perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.57 ±  9%      +0.3        1.92 ± 10%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      1.67 ± 10%      +0.4        2.04 ± 10%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      0.68 ± 10%      +0.4        1.10 ± 13%  perf-profile.calltrace.cycles-pp.xfs_iunlink.xfs_remove.xfs_vn_unlink.vfs_rmdir.do_rmdir
      1.91 ± 12%      +0.4        2.35 ±  9%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      0.21 ±141%      +0.5        0.75 ± 10%  perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      0.00            +0.7        0.75 ± 16%  perf-profile.calltrace.cycles-pp.xfs_buf_item_format.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree
      2.46 ± 11%      +0.8        3.21 ± 12%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      3.24 ±  7%      +0.8        4.06 ±  5%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.18 ±141%      +0.8        1.02 ± 18%  perf-profile.calltrace.cycles-pp.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive
      0.00            +1.2        1.18 ± 36%  perf-profile.calltrace.cycles-pp.xfs_buf_item_format_segment.xfs_buf_item_format.xlog_cil_insert_items.xfs_log_commit_cil.__xfs_trans_commit
      4.53 ±  7%      +1.2        5.71 ±  5%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      4.71 ±  7%      +1.3        5.97 ±  5%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.00            +1.6        1.60 ± 16%  perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
      0.00            +1.7        1.67 ± 16%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
      6.86 ±  7%      +2.0        8.84 ±  7%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      7.43 ±  7%      +2.5        9.96 ±  6%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     52.84 ±  5%      +5.0       57.80 ±  5%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     56.80 ±  4%      +5.8       62.62 ±  5%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     56.85 ±  4%      +5.9       62.73 ±  5%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     56.85 ±  4%      +5.9       62.73 ±  5%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
      0.00            +6.2        6.18 ± 14%  perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag
     57.70 ±  4%      +6.5       64.16 ±  5%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      0.00            +6.9        6.92 ± 15%  perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk
      0.00            +8.8        8.80 ± 15%  perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker
      0.00            +8.8        8.84 ± 15%  perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work
      0.00            +8.9        8.92 ± 15%  perf-profile.calltrace.cycles-pp.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread.kthread
      0.00            +8.9        8.92 ± 15%  perf-profile.calltrace.cycles-pp.xfs_icwalk_ag.xfs_icwalk.xfs_inodegc_worker.process_one_work.worker_thread
      0.00            +8.9        8.92 ± 15%  perf-profile.calltrace.cycles-pp.xfs_inodegc_worker.process_one_work.worker_thread.kthread.ret_from_fork
      1.37 ± 10%      +9.1       10.48 ± 15%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      1.39 ± 10%      +9.1       10.50 ± 15%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      1.45 ±  9%      +9.1       10.59 ± 15%  perf-profile.calltrace.cycles-pp.ret_from_fork
      1.45 ±  9%      +9.1       10.59 ± 15%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
     39.78 ±  6%     -15.5       24.24 ± 13%  perf-profile.children.cycles-pp.do_syscall_64
     39.84 ±  6%     -15.5       24.31 ± 13%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     18.18 ±  7%     -11.3        6.90 ± 16%  perf-profile.children.cycles-pp.do_rmdir
     17.68 ±  7%     -11.2        6.46 ± 15%  perf-profile.children.cycles-pp.vfs_rmdir
     11.32 ±  7%     -11.2        0.16 ± 35%  perf-profile.children.cycles-pp.destroy_inode
     11.22 ±  6%     -11.1        0.10 ± 34%  perf-profile.children.cycles-pp.xfs_inode_mark_reclaimable
     15.18 ±  5%      -3.6       11.61 ±  6%  perf-profile.children.cycles-pp.xfs_check_agi_freecount
     15.42 ±  6%      -3.1       12.37 ± 12%  perf-profile.children.cycles-pp.do_mkdirat
     14.86 ±  6%      -3.0       11.88 ± 12%  perf-profile.children.cycles-pp.vfs_mkdir
     14.77 ±  6%      -3.0       11.80 ± 12%  perf-profile.children.cycles-pp.xfs_generic_create
     14.56 ±  6%      -2.9       11.68 ± 12%  perf-profile.children.cycles-pp.xfs_create
      9.48 ±  6%      -2.6        6.93 ± 15%  perf-profile.children.cycles-pp.xfs_ifree
      8.43 ±  6%      -2.2        6.18 ± 14%  perf-profile.children.cycles-pp.xfs_difree
      9.95 ±  5%      -2.0        7.91 ± 12%  perf-profile.children.cycles-pp.xfs_dir_ialloc
      7.59 ±  6%      -1.9        5.74 ± 15%  perf-profile.children.cycles-pp.xfs_difree_inobt
      7.41 ±  5%      -1.8        5.62 ±  7%  perf-profile.children.cycles-pp.xfs_btree_check_sblock
      8.20 ±  4%      -1.8        6.42 ±  6%  perf-profile.children.cycles-pp.xfs_inobt_get_rec
      8.19 ±  5%      -1.7        6.47 ± 11%  perf-profile.children.cycles-pp.xfs_dialloc_ag
      5.68 ±  5%      -1.4        4.25 ±  8%  perf-profile.children.cycles-pp.xfs_btree_increment
      5.14 ±  3%      -1.2        3.96 ±  8%  perf-profile.children.cycles-pp.xfs_btree_get_rec
      4.92 ±  5%      -1.1        3.84 ±  6%  perf-profile.children.cycles-pp.__xfs_btree_check_sblock
      4.50 ±  9%      -1.0        3.46 ± 12%  perf-profile.children.cycles-pp.__do_sys_statfs
      4.40 ±  9%      -1.0        3.39 ± 12%  perf-profile.children.cycles-pp.user_statfs
      3.33 ± 10%      -0.8        2.49 ± 13%  perf-profile.children.cycles-pp.vfs_statfs
      3.31 ± 10%      -0.8        2.47 ± 13%  perf-profile.children.cycles-pp.statfs_by_dentry
      3.24 ± 10%      -0.8        2.42 ± 13%  perf-profile.children.cycles-pp.xfs_fs_statfs
      3.12 ± 10%      -0.8        2.32 ± 13%  perf-profile.children.cycles-pp.__percpu_counter_sum
      3.14 ± 11%      -0.8        2.39 ± 11%  perf-profile.children.cycles-pp.xfs_trans_read_buf_map
      2.32 ±  9%      -0.6        1.76 ± 11%  perf-profile.children.cycles-pp.xfs_buf_read_map
      2.29 ± 10%      -0.6        1.73 ± 11%  perf-profile.children.cycles-pp.xfs_buf_get_map
      1.76 ±  9%      -0.5        1.23 ±  8%  perf-profile.children.cycles-pp.xfs_btree_lookup
      2.07 ± 10%      -0.5        1.56 ± 11%  perf-profile.children.cycles-pp.xfs_buf_find
      2.41 ±  6%      -0.5        1.91 ±  6%  perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs
      1.26 ±  6%      -0.4        0.85 ± 17%  perf-profile.children.cycles-pp.__schedule
      1.47 ±  7%      -0.4        1.07 ± 13%  perf-profile.children.cycles-pp.xfs_read_agi
      0.80 ±  8%      -0.4        0.42 ± 10%  perf-profile.children.cycles-pp.xfs_difree_finobt
      1.54 ±  7%      -0.4        1.17 ± 11%  perf-profile.children.cycles-pp.xfs_errortag_test
      0.78 ±  6%      -0.3        0.46 ± 16%  perf-profile.children.cycles-pp.xfs_buf_lock
      0.78 ±  6%      -0.3        0.46 ± 17%  perf-profile.children.cycles-pp.down
      1.43 ±  7%      -0.3        1.11 ± 15%  perf-profile.children.cycles-pp.xfs_dir2_node_addname
      0.77 ±  7%      -0.3        0.46 ± 17%  perf-profile.children.cycles-pp.__down
      1.49 ±  9%      -0.3        1.18 ± 12%  perf-profile.children.cycles-pp.xfs_da_read_buf
      0.86 ± 16%      -0.3        0.57 ± 13%  perf-profile.children.cycles-pp.xfs_btree_lookup_get_block
      0.74 ±  6%      -0.3        0.46 ± 18%  perf-profile.children.cycles-pp.schedule_timeout
      0.87 ± 12%      -0.3        0.60 ± 18%  perf-profile.children.cycles-pp.xfs_iunlink_remove
      0.75 ±  5%      -0.2        0.50 ± 16%  perf-profile.children.cycles-pp.schedule
      0.68 ±  8%      -0.2        0.44 ± 18%  perf-profile.children.cycles-pp.xfs_buf_unlock
      0.64 ±  8%      -0.2        0.40 ± 16%  perf-profile.children.cycles-pp.up
      0.63 ± 19%      -0.2        0.41 ± 13%  perf-profile.children.cycles-pp.xfs_btree_read_buf_block
      0.80 ±  5%      -0.2        0.58 ± 17%  perf-profile.children.cycles-pp.xfs_buf_item_release
      0.58 ± 18%      -0.2        0.39 ± 15%  perf-profile.children.cycles-pp._xfs_trans_bjoin
      0.65 ±  6%      -0.2        0.47 ±  8%  perf-profile.children.cycles-pp.xfs_verify_agino
      0.49 ±  7%      -0.2        0.31 ± 13%  perf-profile.children.cycles-pp.try_to_wake_up
      0.52 ± 11%      -0.2        0.35 ± 19%  perf-profile.children.cycles-pp.schedule_idle
      0.86 ±  8%      -0.2        0.70 ± 11%  perf-profile.children.cycles-pp.xfs_da3_node_read
      0.55 ±  6%      -0.2        0.39 ±  9%  perf-profile.children.cycles-pp.xfs_btree_rec_offset
      0.80 ±  6%      -0.2        0.65 ± 12%  perf-profile.children.cycles-pp.cpumask_next
      0.58 ± 11%      -0.2        0.42 ± 11%  perf-profile.children.cycles-pp.xfs_inobt_btrec_to_irec
      0.54 ±  9%      -0.1        0.40 ± 17%  perf-profile.children.cycles-pp.xfs_btree_check_block
      0.62 ± 11%      -0.1        0.50 ± 12%  perf-profile.children.cycles-pp.xfs_trans_alloc
      0.29 ±  8%      -0.1        0.18 ± 16%  perf-profile.children.cycles-pp.xfs_lookup_get_search_key
      0.42 ± 16%      -0.1        0.32 ± 21%  perf-profile.children.cycles-pp.xfs_btree_get_block
      0.57 ±  8%      -0.1        0.47 ± 13%  perf-profile.children.cycles-pp._find_next_bit
      0.24 ±  8%      -0.1        0.15 ± 21%  perf-profile.children.cycles-pp.perf_pmu_sched_task
      0.21 ±  8%      -0.1        0.12 ± 23%  perf-profile.children.cycles-pp.__perf_pmu_sched_task
      0.17 ± 11%      -0.1        0.09 ± 32%  perf-profile.children.cycles-pp.xfs_dir2_isblock
      0.21 ± 11%      -0.1        0.13 ± 14%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.19 ± 11%      -0.1        0.12 ± 25%  perf-profile.children.cycles-pp.xfs_bmap_last_offset
      0.26 ± 11%      -0.1        0.18 ± 16%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.20 ± 11%      -0.1        0.13 ± 14%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.42 ±  5%      -0.1        0.34 ± 15%  perf-profile.children.cycles-pp.__do_sys_newstat
      0.17 ± 16%      -0.1        0.10 ± 20%  perf-profile.children.cycles-pp.xfs_bmap_last_extent
      0.22 ±  9%      -0.1        0.16 ± 18%  perf-profile.children.cycles-pp.dequeue_entity
      0.16 ± 13%      -0.1        0.09 ± 25%  perf-profile.children.cycles-pp.__perf_event_task_sched_out
      0.23 ± 12%      -0.1        0.17 ± 18%  perf-profile.children.cycles-pp.xfs_defer_finish_noroll
      0.18 ± 12%      -0.1        0.11 ± 17%  perf-profile.children.cycles-pp.xfs_inobt_init_key_from_rec
      0.17 ± 13%      -0.1        0.12 ± 14%  perf-profile.children.cycles-pp.update_load_avg
      0.16 ± 14%      -0.1        0.10 ± 14%  perf-profile.children.cycles-pp.enqueue_entity
      0.13 ± 22%      -0.1        0.07 ± 12%  perf-profile.children.cycles-pp.xfs_trans_free
      0.20 ± 15%      -0.1        0.14 ± 19%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.21 ± 14%      -0.1        0.16 ± 15%  perf-profile.children.cycles-pp.xfs_log_ticket_ungrant
      0.20 ± 13%      -0.1        0.15 ± 16%  perf-profile.children.cycles-pp.__intel_pmu_disable_all
      0.33 ±  5%      -0.0        0.28 ±  7%  perf-profile.children.cycles-pp.xfs_buf_rele
      0.08 ± 14%      -0.0        0.03 ±101%  perf-profile.children.cycles-pp.xfs_buf_allocate_memory
      0.09 ± 26%      -0.0        0.05 ± 48%  perf-profile.children.cycles-pp.set_next_entity
      0.13 ±  8%      -0.0        0.08 ± 11%  perf-profile.children.cycles-pp.update_curr
      0.11 ± 13%      -0.0        0.07 ± 46%  perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
      0.20 ±  8%      -0.0        0.16 ± 11%  perf-profile.children.cycles-pp.xfs_btree_readahead
      0.11 ± 13%      -0.0        0.08 ± 13%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.10 ± 23%      -0.0        0.07 ± 20%  perf-profile.children.cycles-pp.evict
      0.08 ±  6%      -0.0        0.05 ± 45%  perf-profile.children.cycles-pp.map_id_up
      0.03 ± 70%      +0.0        0.07 ± 15%  perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
      0.10 ± 16%      +0.0        0.14 ± 16%  perf-profile.children.cycles-pp.rcu_eqs_enter
      0.04 ± 73%      +0.0        0.09 ± 15%  perf-profile.children.cycles-pp.hrtimer_forward
      0.12 ± 14%      +0.1        0.17 ±  9%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.14 ± 11%      +0.1        0.19 ± 14%  perf-profile.children.cycles-pp.irqentry_enter
      0.12 ± 14%      +0.1        0.18 ±  8%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.29 ± 12%      +0.1        0.35 ± 11%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.26 ± 17%      +0.1        0.33 ± 14%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.07 ± 47%      +0.1        0.14 ± 26%  perf-profile.children.cycles-pp.__slab_free
      0.28 ± 13%      +0.1        0.35 ±  8%  perf-profile.children.cycles-pp.__hrtimer_next_event_base
      0.24 ± 12%      +0.1        0.30 ±  8%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.19 ± 12%      +0.1        0.26 ±  4%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.04 ± 76%      +0.1        0.12 ± 18%  perf-profile.children.cycles-pp.allocate_slab
      0.06 ± 52%      +0.1        0.14 ± 14%  perf-profile.children.cycles-pp.___slab_alloc
      0.06 ± 52%      +0.1        0.14 ± 15%  perf-profile.children.cycles-pp.__slab_alloc
      0.13 ± 19%      +0.1        0.21 ± 16%  perf-profile.children.cycles-pp.kmem_alloc_large
      0.00            +0.1        0.08 ± 17%  perf-profile.children.cycles-pp.xfs_iunlink_map_ino
      0.19 ± 16%      +0.1        0.28 ± 15%  perf-profile.children.cycles-pp.timerqueue_add
      0.14 ± 21%      +0.1        0.23 ± 17%  perf-profile.children.cycles-pp.update_ts_time_stats
      0.56 ± 10%      +0.1        0.65 ± 11%  perf-profile.children.cycles-pp.clockevents_program_event
      0.29 ± 20%      +0.1        0.39 ± 11%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.12 ± 15%      +0.1        0.23 ± 25%  perf-profile.children.cycles-pp.xlog_write
      0.22 ± 17%      +0.1        0.32 ± 14%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.00            +0.1        0.11 ± 11%  perf-profile.children.cycles-pp.xfs_iunlink_map_prev
      0.16 ± 18%      +0.1        0.28 ± 27%  perf-profile.children.cycles-pp.xlog_cil_push_work
      0.00            +0.1        0.12 ± 27%  perf-profile.children.cycles-pp.rhashtable_rehash_table
      0.00            +0.1        0.14 ± 26%  perf-profile.children.cycles-pp.rht_deferred_worker
      0.22 ± 13%      +0.2        0.39 ± 13%  perf-profile.children.cycles-pp.xfs_buf_item_size_segment
      0.02 ±142%      +0.2        0.20 ± 21%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.63 ± 14%      +0.2        0.82 ± 15%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.35 ±  9%      +0.2        0.56 ± 13%  perf-profile.children.cycles-pp.xfs_buf_item_size
      0.92 ±  7%      +0.2        1.13 ±  9%  perf-profile.children.cycles-pp.scheduler_tick
      0.04 ± 75%      +0.2        0.26 ± 13%  perf-profile.children.cycles-pp.xfs_contig_bits
      0.55 ± 13%      +0.2        0.78 ±  9%  perf-profile.children.cycles-pp.tick_irq_enter
      0.57 ± 13%      +0.2        0.80 ±  9%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.02 ±142%      +0.2        0.25 ± 23%  perf-profile.children.cycles-pp.crc32c
      0.00            +0.2        0.24 ± 22%  perf-profile.children.cycles-pp.xfs_iunlink_update_dinode
      0.01 ±223%      +0.2        0.25 ± 23%  perf-profile.children.cycles-pp.xfs_dinode_calc_crc
      0.25 ± 14%      +0.2        0.50 ± 14%  perf-profile.children.cycles-pp.xfs_iunlink_update_inode
      1.01 ± 12%      +0.3        1.30 ± 11%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      1.18 ±  7%      +0.3        1.51 ± 19%  perf-profile.children.cycles-pp.irq_exit_rcu
      1.71 ±  8%      +0.3        2.05 ±  9%  perf-profile.children.cycles-pp.update_process_times
      1.81 ±  9%      +0.4        2.17 ±  9%  perf-profile.children.cycles-pp.tick_sched_handle
      0.75 ± 11%      +0.4        1.11 ± 15%  perf-profile.children.cycles-pp.memcpy_erms
      0.68 ± 10%      +0.4        1.10 ± 13%  perf-profile.children.cycles-pp.xfs_iunlink
      0.90 ±  9%      +0.7        1.62 ± 13%  perf-profile.children.cycles-pp.xfs_buf_item_format_segment
      0.98 ±  9%      +0.7        1.71 ± 13%  perf-profile.children.cycles-pp.xfs_buf_item_format
      2.52 ± 11%      +0.8        3.30 ± 12%  perf-profile.children.cycles-pp.menu_select
      3.47 ±  7%      +0.8        4.31 ±  5%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      4.83 ±  7%      +1.2        6.04 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
      5.02 ±  7%      +1.3        6.29 ±  5%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      7.27 ±  6%      +2.0        9.29 ±  6%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      7.93 ±  6%      +2.2       10.12 ±  6%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
     53.56 ±  5%      +5.5       59.06 ±  6%  perf-profile.children.cycles-pp.cpuidle_enter_state
     53.61 ±  5%      +5.5       59.14 ±  6%  perf-profile.children.cycles-pp.cpuidle_enter
     56.85 ±  4%      +5.9       62.73 ±  5%  perf-profile.children.cycles-pp.start_secondary
     57.70 ±  4%      +6.5       64.16 ±  5%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     57.70 ±  4%      +6.5       64.16 ±  5%  perf-profile.children.cycles-pp.cpu_startup_entry
     57.70 ±  4%      +6.5       64.16 ±  5%  perf-profile.children.cycles-pp.do_idle
      0.00            +8.9        8.92 ± 15%  perf-profile.children.cycles-pp.xfs_inodegc_worker
      0.03 ±103%      +9.0        9.00 ± 15%  perf-profile.children.cycles-pp.xfs_icwalk
      0.03 ±103%      +9.0        9.00 ± 15%  perf-profile.children.cycles-pp.xfs_icwalk_ag
      1.37 ± 10%      +9.1       10.48 ± 15%  perf-profile.children.cycles-pp.process_one_work
      1.39 ± 10%      +9.1       10.50 ± 15%  perf-profile.children.cycles-pp.worker_thread
      1.45 ±  9%      +9.1       10.59 ± 15%  perf-profile.children.cycles-pp.kthread
      1.45 ± 10%      +9.1       10.59 ± 15%  perf-profile.children.cycles-pp.ret_from_fork
      2.34 ±  6%      -0.6        1.78 ±  6%  perf-profile.self.cycles-pp.__xfs_btree_check_sblock
      2.23 ±  6%      -0.5        1.72 ±  8%  perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs
      1.40 ±  5%      -0.5        0.94 ±  5%  perf-profile.self.cycles-pp.xfs_btree_check_sblock
      1.84 ± 12%      -0.5        1.38 ± 12%  perf-profile.self.cycles-pp.__percpu_counter_sum
      1.16 ±  4%      -0.4        0.81 ± 13%  perf-profile.self.cycles-pp.xfs_btree_increment
      1.21 ±  8%      -0.3        0.94 ± 10%  perf-profile.self.cycles-pp.xfs_errortag_test
      0.99 ±  5%      -0.2        0.77 ± 10%  perf-profile.self.cycles-pp.xfs_inobt_get_rec
      0.55 ± 11%      -0.2        0.38 ± 12%  perf-profile.self.cycles-pp.xfs_inobt_btrec_to_irec
      0.60 ±  9%      -0.2        0.44 ±  9%  perf-profile.self.cycles-pp.xfs_verify_agino
      0.49 ±  8%      -0.2        0.34 ± 11%  perf-profile.self.cycles-pp.xfs_btree_rec_offset
      0.89 ±  3%      -0.1        0.75 ± 10%  perf-profile.self.cycles-pp.xfs_btree_get_rec
      0.58 ±  8%      -0.1        0.45 ± 17%  perf-profile.self.cycles-pp.syscall_exit_to_user_mode
      0.50 ±  8%      -0.1        0.39 ± 16%  perf-profile.self.cycles-pp._find_next_bit
      0.27 ± 16%      -0.1        0.18 ± 19%  perf-profile.self.cycles-pp._xfs_trans_bjoin
      0.43 ± 10%      -0.1        0.34 ± 13%  perf-profile.self.cycles-pp.xfs_btree_check_block
      0.37 ±  9%      -0.1        0.29 ±  3%  perf-profile.self.cycles-pp.xfs_btree_lookup
      0.36 ± 14%      -0.1        0.29 ±  9%  perf-profile.self.cycles-pp.xfs_perag_get
      0.17 ± 10%      -0.1        0.10 ± 23%  perf-profile.self.cycles-pp.xfs_inobt_init_key_from_rec
      0.10 ± 24%      -0.1        0.05 ± 74%  perf-profile.self.cycles-pp.xfs_da3_node_lookup_int
      0.20 ± 14%      -0.0        0.14 ± 15%  perf-profile.self.cycles-pp.__intel_pmu_disable_all
      0.10 ± 24%      -0.0        0.06 ± 13%  perf-profile.self.cycles-pp.xfs_btree_lookup_get_block
      0.09 ± 25%      -0.0        0.06 ± 19%  perf-profile.self.cycles-pp.down_read
      0.10 ± 13%      -0.0        0.08 ± 13%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.08 ± 20%      +0.0        0.12 ± 13%  perf-profile.self.cycles-pp.rcu_eqs_exit
      0.11 ± 16%      +0.0        0.15 ± 13%  perf-profile.self.cycles-pp.rb_next
      0.07 ± 23%      +0.0        0.11 ± 17%  perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
      0.12 ± 25%      +0.0        0.16 ± 20%  perf-profile.self.cycles-pp.xfs_buf_item_size_segment
      0.07 ± 47%      +0.0        0.12 ± 17%  perf-profile.self.cycles-pp.cpuidle_not_available
      0.04 ± 73%      +0.0        0.08 ± 16%  perf-profile.self.cycles-pp.hrtimer_forward
      0.11 ± 14%      +0.0        0.16 ± 11%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.13 ± 19%      +0.1        0.18 ± 11%  perf-profile.self.cycles-pp.timerqueue_add
      0.13 ± 16%      +0.1        0.18 ± 19%  perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
      0.24 ± 14%      +0.1        0.30 ±  7%  perf-profile.self.cycles-pp.__hrtimer_next_event_base
      0.03 ±101%      +0.1        0.09 ± 25%  perf-profile.self.cycles-pp.xlog_write
      0.01 ±223%      +0.1        0.07 ± 23%  perf-profile.self.cycles-pp.allocate_slab
      0.08 ± 51%      +0.1        0.14 ± 22%  perf-profile.self.cycles-pp.sched_clock_cpu
      0.00            +0.1        0.10 ± 28%  perf-profile.self.cycles-pp.rhashtable_rehash_table
      0.20 ± 13%      +0.1        0.30 ± 17%  perf-profile.self.cycles-pp.__hrtimer_run_queues
      0.18 ± 14%      +0.2        0.34 ± 16%  perf-profile.self.cycles-pp.xfs_buf_item_format_segment
      0.03 ±101%      +0.2        0.25 ± 14%  perf-profile.self.cycles-pp.xfs_contig_bits
      0.77 ±  9%      +0.2        1.01 ±  6%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.74 ± 11%      +0.3        1.06 ± 12%  perf-profile.self.cycles-pp.memcpy_erms





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.13.0-rc6-00030-g752d5513e6e9" of type "text/plain" (174182 bytes)

View attachment "job-script" of type "text/plain" (8473 bytes)

View attachment "job.yaml" of type "text/plain" (5950 bytes)

View attachment "reproduce" of type "text/plain" (540 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ