lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20220418141856.GC25584@xsang-OptiPlex-9020>
Date:   Mon, 18 Apr 2022 22:18:57 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Mel Gorman <mgorman@...hsingularity.net>
Cc:     Peter Zijlstra <peterz@...radead.org>,
        "Gautham R. Shenoy" <gautham.shenoy@....com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...ux.intel.com, fengwei.yin@...el.com,
        aubrey.li@...ux.intel.com, yu.c.chen@...el.com
Subject: [sched/fair]  2cfb7a1b03:  stress-ng.fstat.ops_per_sec -19.8%
 regression


(please be noted we reported "[sched/fair]  2cfb7a1b03:  fsmark.files_per_sec
-26.2% regression" at
https://lore.kernel.org/all/20220303153108.GC14527@xsang-OptiPlex-9020/
when this is still on branch:
commit: 2cfb7a1b031b0e816af7a6ee0c6ab83b0acdf05a ("sched/fair: Improve consistency of allowed NUMA balance calculations")
https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git sched/core

now we noticed the similar performance changes as well as some others are
still existing on mainline, so report this again for information)


Greeting,

FYI, we noticed a -19.8% regression of stress-ng.fstat.ops_per_sec due to commit:


commit: 2cfb7a1b031b0e816af7a6ee0c6ab83b0acdf05a ("sched/fair: Improve consistency of allowed NUMA balance calculations")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master

in testcase: stress-ng
on test machine: 96 threads 2 sockets Ice Lake with 256G memory
with following parameters:

	nr_threads: 10%
	disk: 1HDD
	testtime: 60s
	fs: f2fs
	class: filesystem
	test: fstat
	cpufreq_governor: performance
	ucode: 0xb000280


In addition to that, the commit also has significant impact on the following tests:

+------------------+-------------------------------------------------------------------------------------+
| testcase: change | phoronix-test-suite: phoronix-test-suite.neatbench.CPU.fps 12.5% improvement        |
| test machine     | 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory      |
| test parameters  | cpufreq_governor=performance                                                        |
|                  | option_a=CPU                                                                        |
|                  | test=neatbench-1.0.4                                                                |
|                  | ucode=0x500320a                                                                     |
+------------------+-------------------------------------------------------------------------------------+
| testcase: change | phoronix-test-suite: phoronix-test-suite.neatbench.All.fps 15.2% improvement        |
| test machine     | 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory      |
| test parameters  | cpufreq_governor=performance                                                        |
|                  | option_a=All (CPU + GPU)                                                            |
|                  | test=neatbench-1.0.4                                                                |
|                  | ucode=0x500320a                                                                     |
+------------------+-------------------------------------------------------------------------------------+
| testcase: change | fsmark: fsmark.files_per_sec -9.9% regression                                       |
| test machine     | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters  | cpufreq_governor=performance                                                        |
|                  | disk=1BRD_48G                                                                       |
|                  | filesize=4M                                                                         |
|                  | fs=f2fs                                                                             |
|                  | iterations=1x                                                                       |
|                  | nr_threads=64t                                                                      |
|                  | sync_method=fsyncBeforeClose                                                        |
|                  | test_size=24G                                                                       |
|                  | ucode=0x500320a                                                                     |
+------------------+-------------------------------------------------------------------------------------+
| testcase: change | fsmark: fsmark.files_per_sec -26.2% regression                                      |
| test machine     | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters  | cpufreq_governor=performance                                                        |
|                  | disk=1BRD_48G                                                                       |
|                  | filesize=4M                                                                         |
|                  | fs=ext4                                                                             |
|                  | iterations=1x                                                                       |
|                  | nr_threads=64t                                                                      |
|                  | sync_method=NoSync                                                                  |
|                  | test_size=24G                                                                       |
|                  | ucode=0x500320a                                                                     |
+------------------+-------------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.fstat.ops_per_sec -20.1% regression                            |
| test machine     | 96 threads 2 sockets Ice Lake with 256G memory                                      |
| test parameters  | class=filesystem                                                                    |
|                  | cpufreq_governor=performance                                                        |
|                  | disk=1HDD                                                                           |
|                  | fs=xfs                                                                              |
|                  | nr_threads=10%                                                                      |
|                  | test=fstat                                                                          |
|                  | testtime=60s                                                                        |
|                  | ucode=0xb000280                                                                     |
+------------------+-------------------------------------------------------------------------------------+
| testcase: change | fsmark: fsmark.files_per_sec -16.3% regression                                      |
| test machine     | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters  | cpufreq_governor=performance                                                        |
|                  | disk=1BRD_48G                                                                       |
|                  | filesize=4M                                                                         |
|                  | fs=ext4                                                                             |
|                  | iterations=1x                                                                       |
|                  | nr_threads=64t                                                                      |
|                  | sync_method=fsyncBeforeClose                                                        |
|                  | test_size=24G                                                                       |
|                  | ucode=0x500320a                                                                     |
+------------------+-------------------------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.fstat.ops_per_sec -20.2% regression                            |
| test machine     | 96 threads 2 sockets Ice Lake with 256G memory                                      |
| test parameters  | class=filesystem                                                                    |
|                  | cpufreq_governor=performance                                                        |
|                  | disk=1HDD                                                                           |
|                  | fs=xfs                                                                              |
|                  | nr_threads=10%                                                                      |
|                  | test=fstat                                                                          |
|                  | testtime=60s                                                                        |
|                  | ucode=0xb000280                                                                     |
+------------------+-------------------------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-11/performance/1HDD/f2fs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp1/fstat/stress-ng/60s/0xb000280

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   1910790           -19.8%    1531715        stress-ng.fstat.ops
     31846           -19.8%      25528        stress-ng.fstat.ops_per_sec
    824867 ±  5%     -30.7%     571652        stress-ng.time.involuntary_context_switches
      2888            +5.8%       3055        stress-ng.time.percent_of_cpu_this_job_got
      1626            +8.3%       1762        stress-ng.time.system_time
    165.22           -19.2%     133.56        stress-ng.time.user_time
   3574287           -20.1%    2855119        stress-ng.time.voluntary_context_switches
  19230901           -12.8%   16761104        cpuidle..usage
      2.88            -0.5        2.37        mpstat.cpu.all.usr%
     38279 ±  4%     -14.5%      32721        numa-meminfo.node1.Active(anon)
    308558 ±  5%     -16.2%     258505 ±  3%  sched_debug.cpu.avg_idle.stddev
    568500           -21.9%     444186        vmstat.system.cs
     68.58            -2.3%      67.01        iostat.cpu.idle
     28.61            +7.2%      30.67        iostat.cpu.system
      2.82           -17.7%       2.32        iostat.cpu.user
     58109 ±  2%      -9.2%      52752        meminfo.Active
     39809 ±  3%     -13.4%      34471 ±  2%  meminfo.Active(anon)
  22895621           -35.9%   14670649 ± 14%  meminfo.DirectMap2M
  19806137 ±  2%     -33.3%   13203212 ±  2%  numa-numastat.node0.local_node
  19870464 ±  2%     -33.3%   13253265 ±  2%  numa-numastat.node0.numa_hit
  16553028 ±  4%     -13.9%   14259589 ±  2%  numa-numastat.node1.local_node
  16565135 ±  4%     -13.7%   14292196 ±  2%  numa-numastat.node1.numa_hit
  19871046 ±  2%     -33.3%   13253475 ±  2%  numa-vmstat.node0.numa_hit
  19806719 ±  2%     -33.3%   13203423 ±  2%  numa-vmstat.node0.numa_local
      9591 ±  4%     -14.5%       8199        numa-vmstat.node1.nr_active_anon
      9591 ±  4%     -14.5%       8199        numa-vmstat.node1.nr_zone_active_anon
  16565272 ±  4%     -13.7%   14292210 ±  2%  numa-vmstat.node1.numa_hit
  16553148 ±  4%     -13.9%   14259557 ±  2%  numa-vmstat.node1.numa_local
    101175 ±  5%     -23.9%      77036        turbostat.C1
  18210758 ±  6%     -17.7%   14992364 ±  5%  turbostat.C1E
      0.29 ± 10%     -26.5%       0.21 ±  6%  turbostat.IPC
      0.18 ± 26%      -0.1        0.05 ± 68%  turbostat.PKG_%
     24063 ±  4%     -23.3%      18463 ±  2%  turbostat.POLL
      0.02            -0.0        0.01        turbostat.POLL%
      9964 ±  3%     -13.4%       8632 ±  2%  proc-vmstat.nr_active_anon
    115321            -1.8%     113295        proc-vmstat.nr_inactive_anon
     25779            -3.7%      24818        proc-vmstat.nr_kernel_stack
     42573            -7.1%      39538        proc-vmstat.nr_shmem
      9964 ±  3%     -13.4%       8632 ±  2%  proc-vmstat.nr_zone_active_anon
    115321            -1.8%     113295        proc-vmstat.nr_zone_inactive_anon
  36437989           -24.4%   27549314        proc-vmstat.numa_hit
  36361554           -24.5%   27467330        proc-vmstat.numa_local
      1905 ±  2%      -8.9%       1735 ±  4%  proc-vmstat.pgactivate
  36389058           -24.3%   27528706        proc-vmstat.pgalloc_normal
  36169726           -24.5%   27314323        proc-vmstat.pgfree
      7.92 ±  5%     +15.5%       9.15 ±  5%  perf-stat.i.MPKI
 1.433e+10           -21.0%  1.132e+10        perf-stat.i.branch-instructions
      0.92 ±  5%      +0.1        1.02 ±  4%  perf-stat.i.branch-miss-rate%
 1.247e+08 ±  2%     -13.0%  1.085e+08        perf-stat.i.branch-misses
     16.99 ±  2%      +8.3       25.31 ±  2%  perf-stat.i.cache-miss-rate%
  1.01e+08           +34.7%   1.36e+08        perf-stat.i.cache-misses
 5.967e+08 ±  2%     -10.7%   5.33e+08        perf-stat.i.cache-references
    591451           -22.7%     457367        perf-stat.i.context-switches
      1.37           +30.5%       1.79        perf-stat.i.cpi
 1.035e+11            +4.2%  1.079e+11        perf-stat.i.cpu-cycles
      9193 ±  6%     +39.7%      12844 ±  2%  perf-stat.i.cpu-migrations
      1061           -21.1%     837.52 ±  4%  perf-stat.i.cycles-between-cache-misses
      0.03 ± 28%      +0.0        0.04 ± 19%  perf-stat.i.dTLB-load-miss-rate%
   4758679 ± 12%     +23.7%    5884602 ±  9%  perf-stat.i.dTLB-load-misses
  2.18e+10           -21.1%  1.719e+10        perf-stat.i.dTLB-loads
   1489612 ±  3%     -11.2%    1322879 ±  5%  perf-stat.i.dTLB-store-misses
 1.297e+10           -21.6%  1.017e+10        perf-stat.i.dTLB-stores
 7.708e+10           -21.2%  6.074e+10        perf-stat.i.instructions
      0.74           -23.8%       0.56        perf-stat.i.ipc
      1.08            +4.2%       1.12        perf-stat.i.metric.GHz
    842.21           +20.6%       1015        perf-stat.i.metric.K/sec
    517.46           -21.1%     408.30        perf-stat.i.metric.M/sec
     85.06            +5.7       90.75        perf-stat.i.node-load-miss-rate%
  13175467 ±  2%     +61.3%   21248434        perf-stat.i.node-load-misses
   2181296 ±  2%     -14.2%    1871438        perf-stat.i.node-loads
     19.61 ±  2%     +16.4       35.98        perf-stat.i.node-store-miss-rate%
  11968394 ±  2%    +115.9%   25835847        perf-stat.i.node-store-misses
  50644280           -10.0%   45599834        perf-stat.i.node-stores
      7.83           +13.1%       8.85        perf-stat.overall.MPKI
      0.87 ±  3%      +0.1        0.96        perf-stat.overall.branch-miss-rate%
     16.74 ±  2%      +8.2       24.96        perf-stat.overall.cache-miss-rate%
      1.34           +31.3%       1.76        perf-stat.overall.cpi
      1025           -22.2%     798.32        perf-stat.overall.cycles-between-cache-misses
      0.02 ± 12%      +0.0        0.03 ± 10%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ±  3%      +0.0        0.01 ±  6%  perf-stat.overall.dTLB-store-miss-rate%
      0.74           -23.8%       0.57        perf-stat.overall.ipc
     85.82            +6.0       91.82        perf-stat.overall.node-load-miss-rate%
     19.23 ±  2%     +16.6       35.87        perf-stat.overall.node-store-miss-rate%
 1.416e+10           -20.6%  1.125e+10        perf-stat.ps.branch-instructions
 1.233e+08 ±  2%     -12.7%  1.077e+08        perf-stat.ps.branch-misses
  99801466           +33.7%  1.334e+08        perf-stat.ps.cache-misses
 5.962e+08 ±  2%     -10.3%  5.347e+08        perf-stat.ps.cache-references
    582660           -22.2%     453372        perf-stat.ps.context-switches
 1.024e+11            +4.0%  1.065e+11        perf-stat.ps.cpu-cycles
      9286 ±  5%     +36.7%      12693 ±  2%  perf-stat.ps.cpu-migrations
   4738332 ± 12%     +22.6%    5807697 ±  9%  perf-stat.ps.dTLB-load-misses
 2.152e+10           -20.7%  1.707e+10        perf-stat.ps.dTLB-loads
   1467487 ±  3%     -11.0%    1305700 ±  5%  perf-stat.ps.dTLB-store-misses
 1.279e+10           -21.1%  1.009e+10        perf-stat.ps.dTLB-stores
 7.618e+10           -20.7%  6.038e+10        perf-stat.ps.instructions
  13071092 ±  2%     +59.6%   20858289        perf-stat.ps.node-load-misses
   2158639 ±  2%     -13.9%    1859163 ±  2%  perf-stat.ps.node-loads
  11864450 ±  2%    +112.2%   25178871        perf-stat.ps.node-store-misses
  49828833            -9.7%   45018219        perf-stat.ps.node-stores
 4.792e+12           -21.0%  3.787e+12        perf-stat.total.instructions
      9.68            -2.4        7.31        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__clone
      9.68            -2.4        7.31        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.66            -2.4        7.29        perf-profile.calltrace.cycles-pp.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.66            -2.4        7.30        perf-profile.calltrace.cycles-pp.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.97            -2.3        7.62        perf-profile.calltrace.cycles-pp.__clone
      7.55 ±  2%      -2.2        5.34        perf-profile.calltrace.cycles-pp.copy_process.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.81 ±  2%      -1.8        4.00 ±  2%  perf-profile.calltrace.cycles-pp.dup_task_struct.copy_process.kernel_clone.__do_sys_clone.do_syscall_64
      4.54 ±  3%      -1.6        2.99 ±  3%  perf-profile.calltrace.cycles-pp.alloc_thread_stack_node.dup_task_struct.copy_process.kernel_clone.__do_sys_clone
      4.17 ±  3%      -1.4        2.77 ±  3%  perf-profile.calltrace.cycles-pp.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct.copy_process.kernel_clone
      1.92            -1.3        0.63 ±  2%  perf-profile.calltrace.cycles-pp.__check_object_size.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx
      3.06 ±  5%      -1.1        1.92 ±  5%  perf-profile.calltrace.cycles-pp.__get_vm_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct.copy_process
      3.72            -1.0        2.76        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx
      2.72 ±  5%      -0.9        1.78 ±  5%  perf-profile.calltrace.cycles-pp.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct
      2.50 ±  4%      -0.8        1.67        perf-profile.calltrace.cycles-pp.ret_from_fork
      2.50 ±  4%      -0.8        1.67        perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      2.44 ±  3%      -0.8        1.63        perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      1.93 ±  3%      -0.8        1.17 ±  2%  perf-profile.calltrace.cycles-pp.__vunmap.free_work.process_one_work.worker_thread.kthread
      1.98 ±  3%      -0.8        1.22        perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      1.96 ±  3%      -0.8        1.20 ±  2%  perf-profile.calltrace.cycles-pp.free_work.process_one_work.worker_thread.kthread.ret_from_fork
      2.49            -0.7        1.80        perf-profile.calltrace.cycles-pp.__entry_text_start.statx
      2.95            -0.7        2.29        perf-profile.calltrace.cycles-pp.link_path_walk.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
      2.45            -0.6        1.81        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64
      2.48            -0.6        1.85        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64
      1.40 ±  6%      -0.6        0.84 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.alloc_thread_stack_node
      2.18 ±  2%      -0.6        1.63        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.do_statx
      1.23 ±  3%      -0.5        0.70 ±  2%  perf-profile.calltrace.cycles-pp.remove_vm_area.__vunmap.free_work.process_one_work.worker_thread
      1.32 ±  6%      -0.5        0.80 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range
      1.46            -0.4        1.08        perf-profile.calltrace.cycles-pp.__fxstat
      1.40 ±  2%      -0.4        1.03        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newstat
      5.54            -0.4        5.17        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      1.41            -0.4        1.05        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newlstat
      5.47            -0.4        5.11        perf-profile.calltrace.cycles-pp.cpu_startup_entry.secondary_startup_64_no_verify
      5.46            -0.4        5.10        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      4.23            -0.4        3.88 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      3.90            -0.4        3.55 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
      2.30 ±  2%      -0.3        1.97 ±  2%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
      3.99            -0.3        3.65        perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      1.58            -0.3        1.25        perf-profile.calltrace.cycles-pp.find_idlest_group.find_idlest_cpu.select_task_rq_fair.wake_up_new_task.kernel_clone
      2.28 ±  2%      -0.3        1.94 ±  2%  perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
      1.49            -0.3        1.17        perf-profile.calltrace.cycles-pp.update_sg_wakeup_stats.find_idlest_group.find_idlest_cpu.select_task_rq_fair.wake_up_new_task
      2.46 ±  2%      -0.3        2.17        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.46 ±  2%      -0.3        2.17        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.45 ±  2%      -0.3        2.16        perf-profile.calltrace.cycles-pp.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.45 ±  2%      -0.3        2.16        perf-profile.calltrace.cycles-pp.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.10 ±  3%      -0.3        0.84        perf-profile.calltrace.cycles-pp.__vmalloc_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct.copy_process
      0.99            -0.3        0.74        perf-profile.calltrace.cycles-pp.kmem_cache_alloc.getname_flags.user_path_at_empty.vfs_statx.do_statx
      0.82 ±  2%      -0.2        0.58        perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      1.12 ±  2%      -0.2        0.91        perf-profile.calltrace.cycles-pp.exit_notify.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.74            -0.2        0.54 ±  4%  perf-profile.calltrace.cycles-pp.shim_statx
      0.87 ±  3%      -0.2        0.68 ±  2%  perf-profile.calltrace.cycles-pp.vm_area_alloc_pages.__vmalloc_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct
      1.66            -0.2        1.47        perf-profile.calltrace.cycles-pp.find_idlest_cpu.select_task_rq_fair.wake_up_new_task.kernel_clone.__do_sys_clone
      0.74 ±  2%      -0.2        0.56        perf-profile.calltrace.cycles-pp.cp_statx.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.67            -0.2        1.49        perf-profile.calltrace.cycles-pp.select_task_rq_fair.wake_up_new_task.kernel_clone.__do_sys_clone.do_syscall_64
      0.81 ±  3%      -0.2        0.65 ±  2%  perf-profile.calltrace.cycles-pp.__alloc_pages_bulk.vm_area_alloc_pages.__vmalloc_area_node.__vmalloc_node_range.alloc_thread_stack_node
      2.07            -0.2        1.92        perf-profile.calltrace.cycles-pp.wake_up_new_task.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.83 ±  2%      -0.1        0.68        perf-profile.calltrace.cycles-pp.release_task.exit_notify.do_exit.__x64_sys_exit.do_syscall_64
      1.10 ±  2%      -0.0        1.05 ±  2%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      0.66 ±  2%      -0.0        0.61        perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry
      1.09 ±  2%      -0.0        1.05 ±  2%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      0.56 ±  2%      +0.0        0.58        perf-profile.calltrace.cycles-pp.lookup_fast.walk_component.path_lookupat.filename_lookup.user_path_at_empty
      0.99            +0.1        1.06        perf-profile.calltrace.cycles-pp.walk_component.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
      0.80 ±  3%      +0.1        0.87        perf-profile.calltrace.cycles-pp.start_thread
     28.57            +0.2       28.79        perf-profile.calltrace.cycles-pp.statx
      1.49            +0.3        1.80        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
      1.45            +0.3        1.77        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_statx.do_statx.__x64_sys_statx
      1.48            +0.3        1.81        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.44            +0.3        1.77        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_statx.__do_sys_newlstat.do_syscall_64
      1.45            +0.3        1.80        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.41            +0.4        1.76        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_statx.__do_sys_newstat.do_syscall_64
     13.44            +0.5       13.91        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
     12.56            +1.1       13.61        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     11.49            +1.1       12.60        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     24.26            +1.4       25.62        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.statx
     23.81            +1.5       25.29        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      5.18 ±  2%      +1.6        6.74        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.do_statx
      5.48            +1.6        7.06        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
      5.46            +1.6        7.04        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.do_statx.__x64_sys_statx
      9.01            +1.6       10.62        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx
      5.07 ±  2%      +1.6        6.70        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.__do_sys_newlstat
      5.37 ±  2%      +1.6        7.02        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.34 ±  2%      +1.6        6.99        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.__do_sys_newlstat.do_syscall_64
      4.98 ±  2%      +1.7        6.64        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.__do_sys_newstat
      5.28 ±  2%      +1.7        6.96        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      8.75            +1.7       10.43        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.do_statx
      5.25 ±  2%      +1.7        6.94        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.__do_sys_newstat.do_syscall_64
      9.73            +1.8       11.52        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64
      9.54            +1.8       11.36        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newstat
      8.63            +1.8       10.46        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64
     22.50            +1.8       24.34        perf-profile.calltrace.cycles-pp.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      8.47            +1.9       10.33        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newlstat
     22.04            +2.0       24.00        perf-profile.calltrace.cycles-pp.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
     22.00            +2.2       24.15        perf-profile.calltrace.cycles-pp.__lxstat64
     22.94            +2.2       25.11        perf-profile.calltrace.cycles-pp.__xstat
     20.96            +2.2       23.19        perf-profile.calltrace.cycles-pp.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe
     21.41            +2.6       23.98        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__xstat
     20.44            +2.6       23.02        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__lxstat64
     21.23            +2.6       23.84        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat
     20.26            +2.6       22.88        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     20.55            +2.8       23.34        perf-profile.calltrace.cycles-pp.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat
     19.59            +2.8       22.39        perf-profile.calltrace.cycles-pp.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     18.82            +3.0       21.80        perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     19.77            +3.0       22.74        perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat
     20.82            +6.3       27.16        perf-profile.calltrace.cycles-pp.complete_walk.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
     20.66            +6.4       27.04        perf-profile.calltrace.cycles-pp.try_to_unlazy.complete_walk.path_lookupat.filename_lookup.user_path_at_empty
     20.40            +6.4       26.84        perf-profile.calltrace.cycles-pp.__legitimize_path.try_to_unlazy.complete_walk.path_lookupat.filename_lookup
     19.93            +6.5       26.44        perf-profile.calltrace.cycles-pp.lockref_get_not_dead.__legitimize_path.try_to_unlazy.complete_walk.path_lookupat
      9.67            -2.4        7.31        perf-profile.children.cycles-pp.__do_sys_clone
      9.66            -2.4        7.30        perf-profile.children.cycles-pp.kernel_clone
      9.99            -2.4        7.63        perf-profile.children.cycles-pp.__clone
      9.08            -2.3        6.74        perf-profile.children.cycles-pp.getname_flags
      7.56 ±  2%      -2.2        5.35        perf-profile.children.cycles-pp.copy_process
      5.81 ±  2%      -1.8        4.00 ±  2%  perf-profile.children.cycles-pp.dup_task_struct
      4.54 ±  3%      -1.6        2.99 ±  3%  perf-profile.children.cycles-pp.alloc_thread_stack_node
      3.18 ±  3%      -1.4        1.74 ±  2%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      3.61 ±  3%      -1.4        2.17 ±  2%  perf-profile.children.cycles-pp._raw_spin_lock
      4.17 ±  3%      -1.4        2.77 ±  3%  perf-profile.children.cycles-pp.__vmalloc_node_range
      5.13            -1.3        3.80        perf-profile.children.cycles-pp.strncpy_from_user
      3.06 ±  5%      -1.1        1.93 ±  5%  perf-profile.children.cycles-pp.__get_vm_area_node
      2.72 ±  5%      -0.9        1.78 ±  5%  perf-profile.children.cycles-pp.alloc_vmap_area
      3.36            -0.9        2.45        perf-profile.children.cycles-pp.__entry_text_start
      2.50 ±  4%      -0.8        1.67        perf-profile.children.cycles-pp.kthread
      2.44 ±  3%      -0.8        1.63        perf-profile.children.cycles-pp.worker_thread
      2.66 ±  3%      -0.8        1.86        perf-profile.children.cycles-pp.ret_from_fork
      1.94 ±  3%      -0.8        1.17        perf-profile.children.cycles-pp.__vunmap
      1.96 ±  3%      -0.8        1.20 ±  2%  perf-profile.children.cycles-pp.free_work
      1.98 ±  3%      -0.8        1.23        perf-profile.children.cycles-pp.process_one_work
      2.88            -0.8        2.13        perf-profile.children.cycles-pp.syscall_return_via_sysret
      3.02            -0.7        2.34        perf-profile.children.cycles-pp.link_path_walk
      2.44            -0.6        1.83        perf-profile.children.cycles-pp.kmem_cache_alloc
      2.19            -0.6        1.62        perf-profile.children.cycles-pp.__check_object_size
      1.23 ±  3%      -0.5        0.70 ±  2%  perf-profile.children.cycles-pp.remove_vm_area
      1.84 ±  2%      -0.5        1.36        perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      1.68            -0.4        1.23        perf-profile.children.cycles-pp.__fxstat
      0.79 ±  3%      -0.4        0.38 ±  4%  perf-profile.children.cycles-pp.find_vmap_area
      2.17 ±  2%      -0.4        1.78        perf-profile.children.cycles-pp.kmem_cache_free
      5.54            -0.4        5.17        perf-profile.children.cycles-pp.do_idle
      5.54            -0.4        5.17        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
      5.54            -0.4        5.17        perf-profile.children.cycles-pp.cpu_startup_entry
      4.28            -0.4        3.93 ±  2%  perf-profile.children.cycles-pp.cpuidle_idle_call
      2.33 ±  2%      -0.3        1.99 ±  2%  perf-profile.children.cycles-pp.intel_idle
      4.04            -0.3        3.70        perf-profile.children.cycles-pp.cpuidle_enter
      4.03            -0.3        3.69        perf-profile.children.cycles-pp.cpuidle_enter_state
      2.31 ±  2%      -0.3        1.97 ±  2%  perf-profile.children.cycles-pp.mwait_idle_with_hints
      1.59            -0.3        1.26        perf-profile.children.cycles-pp.find_idlest_group
      2.95            -0.3        2.62        perf-profile.children.cycles-pp.walk_component
      1.53            -0.3        1.20        perf-profile.children.cycles-pp.update_sg_wakeup_stats
      0.80 ±  3%      -0.3        0.49 ±  3%  perf-profile.children.cycles-pp.free_vmap_area_noflush
      1.21 ±  2%      -0.3        0.92        perf-profile.children.cycles-pp._copy_to_user
      1.20 ±  2%      -0.3        0.90        perf-profile.children.cycles-pp.__might_resched
      1.26            -0.3        0.97        perf-profile.children.cycles-pp.cp_new_stat
      1.11 ±  2%      -0.3        0.85        perf-profile.children.cycles-pp.__vmalloc_area_node
      3.12 ±  2%      -0.3        2.86        perf-profile.children.cycles-pp.__x64_sys_exit
      3.12 ±  2%      -0.3        2.86        perf-profile.children.cycles-pp.do_exit
      0.91 ±  2%      -0.2        0.69        perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      3.18 ±  3%      -0.2        2.96        perf-profile.children.cycles-pp.__schedule
      0.97 ±  2%      -0.2        0.76        perf-profile.children.cycles-pp.__might_fault
      1.12 ±  2%      -0.2        0.91        perf-profile.children.cycles-pp.exit_notify
      0.77            -0.2        0.57        perf-profile.children.cycles-pp.__check_heap_object
      0.77 ±  2%      -0.2        0.56 ±  4%  perf-profile.children.cycles-pp.shim_statx
      0.87 ±  3%      -0.2        0.68 ±  2%  perf-profile.children.cycles-pp.vm_area_alloc_pages
      0.34 ±  3%      -0.2        0.16 ±  6%  perf-profile.children.cycles-pp.find_vm_area
      0.90 ±  2%      -0.2        0.71        perf-profile.children.cycles-pp.memcg_slab_free_hook
      0.76 ±  2%      -0.2        0.57        perf-profile.children.cycles-pp.cp_statx
      1.66            -0.2        1.48        perf-profile.children.cycles-pp.find_idlest_cpu
      0.82 ±  3%      -0.2        0.65 ±  2%  perf-profile.children.cycles-pp.__alloc_pages_bulk
      1.62 ±  3%      -0.2        1.45        perf-profile.children.cycles-pp.lookup_fast
      1.68            -0.2        1.51        perf-profile.children.cycles-pp.select_task_rq_fair
      0.71 ±  2%      -0.2        0.54        perf-profile.children.cycles-pp.vfs_getattr_nosec
      1.46 ±  5%      -0.2        1.30 ±  2%  perf-profile.children.cycles-pp.schedule
      2.07            -0.2        1.92        perf-profile.children.cycles-pp.wake_up_new_task
      0.56 ±  2%      -0.2        0.41        perf-profile.children.cycles-pp.syscall_enter_from_user_mode
      0.55 ±  3%      -0.1        0.40 ±  2%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.89 ±  6%      -0.1        0.74 ±  3%  perf-profile.children.cycles-pp.__d_lookup_rcu
      0.83 ±  2%      -0.1        0.68        perf-profile.children.cycles-pp.release_task
      0.59 ±  3%      -0.1        0.44 ±  2%  perf-profile.children.cycles-pp.clear_page_erms
      0.76 ±  2%      -0.1        0.62        perf-profile.children.cycles-pp.path_init
      0.73            -0.1        0.60        perf-profile.children.cycles-pp.inode_permission
      0.50 ±  3%      -0.1        0.37 ±  2%  perf-profile.children.cycles-pp.__virt_addr_valid
      0.62            -0.1        0.50        perf-profile.children.cycles-pp.__might_sleep
      0.60 ±  2%      -0.1        0.47        perf-profile.children.cycles-pp.sched_yield
      0.90            -0.1        0.78 ±  2%  perf-profile.children.cycles-pp.step_into
      0.41 ±  3%      -0.1        0.31 ±  2%  perf-profile.children.cycles-pp.__cond_resched
      0.40 ±  5%      -0.1        0.30 ±  3%  perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.52 ±  2%      -0.1        0.42        perf-profile.children.cycles-pp.memcpy_erms
      0.51 ±  2%      -0.1        0.41        perf-profile.children.cycles-pp.__x64_sys_sched_yield
      0.35 ±  2%      -0.1        0.25 ±  3%  perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
      0.50 ±  2%      -0.1        0.41        perf-profile.children.cycles-pp.arch_dup_task_struct
      0.31 ±  2%      -0.1        0.21 ±  4%  perf-profile.children.cycles-pp.alloc_pid
      0.26 ±  4%      -0.1        0.17 ±  6%  perf-profile.children.cycles-pp.insert_vmap_area
      0.37 ±  2%      -0.1        0.29 ±  2%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.38            -0.1        0.31 ±  3%  perf-profile.children.cycles-pp.kmem_cache_alloc_node
      0.33 ±  2%      -0.1        0.25        perf-profile.children.cycles-pp.pfn_valid
      0.59 ±  5%      -0.1        0.52 ±  3%  perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
      0.43            -0.1        0.36 ±  2%  perf-profile.children.cycles-pp.generic_permission
      0.29 ±  3%      -0.1        0.22        perf-profile.children.cycles-pp.map_id_up
      0.29 ±  3%      -0.1        0.22        perf-profile.children.cycles-pp.putname
      0.29            -0.1        0.22        perf-profile.children.cycles-pp.cpumask_next
      0.22 ±  2%      -0.1        0.15 ±  2%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
      0.55 ±  6%      -0.1        0.48 ±  3%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.43 ±  5%      -0.1        0.37 ±  2%  perf-profile.children.cycles-pp.__legitimize_mnt
      0.28 ±  2%      -0.1        0.21 ±  3%  perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook
      0.21 ±  4%      -0.1        0.15 ±  4%  perf-profile.children.cycles-pp.cgroup_can_fork
      0.30 ±  5%      -0.1        0.24 ±  3%  perf-profile.children.cycles-pp.obj_cgroup_charge_pages
      0.17 ±  4%      -0.1        0.11 ±  6%  perf-profile.children.cycles-pp.cgroup_release
      0.30 ±  2%      -0.1        0.25 ±  4%  perf-profile.children.cycles-pp.terminate_walk
      0.22 ±  6%      -0.1        0.16 ±  4%  perf-profile.children.cycles-pp.__do_sys_newfstat
      0.25 ±  2%      -0.1        0.20 ±  9%  perf-profile.children.cycles-pp.cgroup_free
      0.19 ±  5%      -0.1        0.14 ±  4%  perf-profile.children.cycles-pp.cgroup_post_fork
      0.36            -0.1        0.31 ±  2%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.24 ±  3%      -0.1        0.19 ±  8%  perf-profile.children.cycles-pp.refcount_dec_not_one
      0.34 ±  3%      -0.1        0.29 ±  3%  perf-profile.children.cycles-pp.nd_jump_root
      1.12 ±  2%      -0.0        1.07 ±  2%  perf-profile.children.cycles-pp.schedule_idle
      0.32 ±  5%      -0.0        0.27 ±  3%  perf-profile.children.cycles-pp.stress_fstat_helper
      0.20 ±  3%      -0.0        0.15 ±  2%  perf-profile.children.cycles-pp.rcu_all_qs
      0.22 ±  2%      -0.0        0.17 ±  4%  perf-profile.children.cycles-pp.generic_fillattr
      0.23 ±  4%      -0.0        0.18 ±  6%  perf-profile.children.cycles-pp.page_counter_charge
      0.18 ±  3%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.security_inode_permission
      0.17 ±  5%      -0.0        0.13 ±  6%  perf-profile.children.cycles-pp.vfs_fstat
      0.12 ±  3%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.insert_vmap_area_augment
      0.17 ±  4%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.__x64_sys_newlstat
      0.28 ±  5%      -0.0        0.24        perf-profile.children.cycles-pp.try_to_wake_up
      0.45 ±  5%      -0.0        0.41 ±  3%  perf-profile.children.cycles-pp.page_counter_cancel
      0.37            -0.0        0.33 ±  6%  perf-profile.children.cycles-pp.__put_task_struct
      0.17 ±  5%      -0.0        0.13 ±  4%  perf-profile.children.cycles-pp.from_kuid_munged
      0.22 ±  3%      -0.0        0.18 ±  2%  perf-profile.children.cycles-pp.perf_iterate_sb
      0.21            -0.0        0.17 ±  2%  perf-profile.children.cycles-pp.___slab_alloc
      0.20 ±  2%      -0.0        0.16 ±  2%  perf-profile.children.cycles-pp._raw_write_lock_irq
      0.17 ±  2%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.from_kgid_munged
      0.16 ±  3%      -0.0        0.12 ±  3%  perf-profile.children.cycles-pp.__x64_sys_newstat
      0.22 ±  4%      -0.0        0.18 ±  4%  perf-profile.children.cycles-pp.__memcg_kmem_charge_page
      0.76 ±  2%      -0.0        0.72 ±  2%  perf-profile.children.cycles-pp.finish_task_switch
      0.15 ±  3%      -0.0        0.12 ±  6%  perf-profile.children.cycles-pp.add_device_randomness
      0.44 ±  2%      -0.0        0.40 ±  2%  perf-profile.children.cycles-pp.__exit_signal
      0.18 ±  4%      -0.0        0.14 ±  3%  perf-profile.children.cycles-pp.perf_event_task_output
      0.12 ±  4%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.cgroup_exit
      0.29            -0.0        0.25        perf-profile.children.cycles-pp.dequeue_entity
      0.12 ±  6%      -0.0        0.09 ±  4%  perf-profile.children.cycles-pp.rb_insert_color
      0.11 ±  6%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.pids_can_fork
      0.14 ±  3%      -0.0        0.10 ±  6%  perf-profile.children.cycles-pp.sched_post_fork
      0.21 ±  3%      -0.0        0.17 ±  2%  perf-profile.children.cycles-pp.update_curr
      0.29 ±  3%      -0.0        0.25        perf-profile.children.cycles-pp._find_next_bit
      0.13 ±  5%      -0.0        0.10 ±  5%  perf-profile.children.cycles-pp.propagate_protected_usage
      0.24 ±  4%      -0.0        0.21 ±  3%  perf-profile.children.cycles-pp.__fget_light
      0.32 ±  4%      -0.0        0.29 ±  2%  perf-profile.children.cycles-pp.sched_move_task
      0.07            -0.0        0.04 ± 50%  perf-profile.children.cycles-pp.idr_alloc_u32
      0.14            -0.0        0.11        perf-profile.children.cycles-pp.do_sched_yield
      0.07 ±  9%      -0.0        0.04 ± 50%  perf-profile.children.cycles-pp.refill_stock
      0.16 ±  5%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.wake_up_q
      0.14 ±  3%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.check_stack_object
      0.10 ±  6%      -0.0        0.07 ±  9%  perf-profile.children.cycles-pp.cgroup_css_set_fork
      0.16 ±  6%      -0.0        0.14 ± 11%  perf-profile.children.cycles-pp.menu_select
      0.09 ±  5%      -0.0        0.06        perf-profile.children.cycles-pp.cpu_cgroup_fork
      0.07 ±  5%      -0.0        0.05 ± 50%  perf-profile.children.cycles-pp.pids_release
      0.09 ±  7%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.copy_thread
      0.11            -0.0        0.09 ±  5%  perf-profile.children.cycles-pp._mix_pool_bytes
      0.13 ±  5%      -0.0        0.11 ±  3%  perf-profile.children.cycles-pp.allocate_slab
      0.09 ±  7%      -0.0        0.07 ±  9%  perf-profile.children.cycles-pp.task_rq_lock
      0.09 ±  7%      -0.0        0.07        perf-profile.children.cycles-pp.__x64_sys_newfstat
      0.16 ±  3%      -0.0        0.14 ±  2%  perf-profile.children.cycles-pp.mntput_no_expire
      0.15 ±  3%      -0.0        0.12 ±  3%  perf-profile.children.cycles-pp.queue_work_on
      0.19 ±  4%      -0.0        0.17 ±  2%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.10 ±  5%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.obj_cgroup_charge
      0.14 ±  4%      -0.0        0.12        perf-profile.children.cycles-pp.__queue_work
      0.09 ±  7%      -0.0        0.07 ±  5%  perf-profile.children.cycles-pp.__list_add_valid
      0.10 ± 10%      -0.0        0.07 ± 13%  perf-profile.children.cycles-pp.vunmap_range_noflush
      0.10 ±  4%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.perf_event_fork
      0.07            -0.0        0.05        perf-profile.children.cycles-pp.idr_alloc_cyclic
      0.06            -0.0        0.04 ± 50%  perf-profile.children.cycles-pp.__call_rcu
      0.13 ±  4%      -0.0        0.11        perf-profile.children.cycles-pp.ttwu_do_activate
      0.08 ±  5%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.task_fork_fair
      0.14 ±  3%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.12 ±  6%      -0.0        0.10 ±  4%  perf-profile.children.cycles-pp.native_sched_clock
      0.25 ±  3%      -0.0        0.23 ±  2%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.07 ±  5%      -0.0        0.05        perf-profile.children.cycles-pp.should_failslab
      0.08 ±  8%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.__purge_vmap_area_lazy
      0.08 ±  5%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.task_change_group_fair
      0.08 ±  5%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.rb_erase
      0.08 ±  6%      -0.0        0.06        perf-profile.children.cycles-pp.__perf_event_header__init_id
      0.10 ±  3%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.prepare_task_switch
      0.12 ±  5%      -0.0        0.10 ±  3%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.21 ±  3%      -0.0        0.19 ±  2%  perf-profile.children.cycles-pp.enqueue_entity
      0.06 ±  7%      -0.0        0.05        perf-profile.children.cycles-pp.__free_pages
      0.10 ±  5%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.do_prlimit
      0.06 ±  7%      -0.0        0.05 ±  7%  perf-profile.children.cycles-pp.__task_pid_nr_ns
      0.15 ±  3%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.free_pid
      0.07 ±  5%      +0.0        0.08        perf-profile.children.cycles-pp.pid_revalidate
      0.14 ±  3%      +0.0        0.16 ±  2%  perf-profile.children.cycles-pp.stress_fstat
      0.07 ±  5%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.proc_fd_link
      0.06 ±  9%      +0.0        0.07 ±  5%  perf-profile.children.cycles-pp.taskstats_exit
      0.06 ±  9%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.tid_fd_revalidate
      0.12 ±  6%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.pthread_create
      0.24 ±  2%      +0.0        0.26 ±  2%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.04 ± 44%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.schedule_tail
      0.06 ±  7%      +0.0        0.09        perf-profile.children.cycles-pp.try_get_compound_head
      0.26 ±  3%      +0.0        0.29 ±  3%  perf-profile.children.cycles-pp.update_process_times
      0.04 ± 44%      +0.0        0.07 ±  5%  perf-profile.children.cycles-pp.get_pid_task
      0.05 ± 45%      +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.llist_add_batch
      0.14 ±  2%      +0.0        0.17 ±  4%  perf-profile.children.cycles-pp.kfree
      0.14 ±  5%      +0.0        0.17 ±  6%  perf-profile.children.cycles-pp.__slab_free
      0.27 ±  5%      +0.0        0.30 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.23 ±  4%      +0.0        0.26 ±  4%  perf-profile.children.cycles-pp.pick_link
      0.13 ±  5%      +0.0        0.16 ±  2%  perf-profile.children.cycles-pp.get_futex_key
      0.28 ±  4%      +0.0        0.32 ±  2%  perf-profile.children.cycles-pp.tick_sched_timer
      0.11 ±  6%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp.gup_pgd_range
      0.02 ± 99%      +0.0        0.06        perf-profile.children.cycles-pp.task_dump_owner
      0.12 ±  4%      +0.0        0.15 ±  2%  perf-profile.children.cycles-pp.lockless_pages_from_mm
      0.12 ±  5%      +0.0        0.16 ±  2%  perf-profile.children.cycles-pp.internal_get_user_pages_fast
      0.13 ±  7%      +0.0        0.16 ±  6%  perf-profile.children.cycles-pp.proc_pid_get_link
      0.20 ±  2%      +0.0        0.24 ±  3%  perf-profile.children.cycles-pp.try_to_unlazy_next
      0.08 ±  4%      +0.0        0.12        perf-profile.children.cycles-pp.gup_pte_range
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.__cleanup_sighand
      0.00            +0.1        0.05 ±  7%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.18 ±  5%      +0.1        0.24 ±  3%  perf-profile.children.cycles-pp.__unfreeze_partials
      0.82 ±  3%      +0.1        0.88        perf-profile.children.cycles-pp.start_thread
      0.00            +0.1        0.07 ±  7%  perf-profile.children.cycles-pp.memset_erms
      0.00            +0.1        0.07        perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      0.52 ±  4%      +0.1        0.64 ±  3%  perf-profile.children.cycles-pp.lockref_put_return
      4.46            +1.0        5.43        perf-profile.children.cycles-pp.security_inode_getattr
      4.32            +1.0        5.32        perf-profile.children.cycles-pp.common_perm_cond
     22.55            +1.8       24.37        perf-profile.children.cycles-pp.__x64_sys_statx
     22.08            +2.0       24.03        perf-profile.children.cycles-pp.do_statx
     22.42            +2.0       24.46        perf-profile.children.cycles-pp.__lxstat64
     23.37            +2.1       25.42        perf-profile.children.cycles-pp.__xstat
     37.65            +2.6       40.24        perf-profile.children.cycles-pp.user_path_at_empty
     20.58            +2.8       23.36        perf-profile.children.cycles-pp.__do_sys_newstat
     19.61            +2.8       22.40        perf-profile.children.cycles-pp.__do_sys_newlstat
     81.83            +3.5       85.35        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     81.06            +3.7       84.77        perf-profile.children.cycles-pp.do_syscall_64
     16.16            +4.9       21.05        perf-profile.children.cycles-pp.path_put
     15.40 ±  2%      +4.9       20.31        perf-profile.children.cycles-pp.lockref_put_or_lock
     16.38            +5.0       21.33        perf-profile.children.cycles-pp.dput
     27.42            +5.2       32.65        perf-profile.children.cycles-pp.filename_lookup
     26.88            +5.3       32.22        perf-profile.children.cycles-pp.path_lookupat
     20.85            +6.3       27.18        perf-profile.children.cycles-pp.complete_walk
     20.72            +6.4       27.08        perf-profile.children.cycles-pp.try_to_unlazy
     20.63            +6.4       27.08        perf-profile.children.cycles-pp.__legitimize_path
     20.14            +6.5       26.69        perf-profile.children.cycles-pp.lockref_get_not_dead
     59.67            +8.1       67.82        perf-profile.children.cycles-pp.vfs_statx
      3.15 ±  3%      -1.4        1.73 ±  2%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      2.84            -0.7        2.09        perf-profile.self.cycles-pp.syscall_return_via_sysret
      2.29 ±  2%      -0.6        1.69        perf-profile.self.cycles-pp.strncpy_from_user
      1.97            -0.5        1.43        perf-profile.self.cycles-pp.statx
      1.32 ±  2%      -0.3        0.97        perf-profile.self.cycles-pp.kmem_cache_alloc
      1.25 ±  2%      -0.3        0.91        perf-profile.self.cycles-pp.syscall_exit_to_user_mode
      2.30 ±  2%      -0.3        1.96 ±  2%  perf-profile.self.cycles-pp.mwait_idle_with_hints
      1.22 ±  2%      -0.3        0.90        perf-profile.self.cycles-pp.__entry_text_start
      1.09 ±  2%      -0.3        0.83        perf-profile.self.cycles-pp.__might_resched
      1.03 ±  2%      -0.3        0.77 ±  2%  perf-profile.self.cycles-pp.kmem_cache_free
      1.28            -0.3        1.01 ±  2%  perf-profile.self.cycles-pp.update_sg_wakeup_stats
      0.88 ±  2%      -0.2        0.64 ±  2%  perf-profile.self.cycles-pp.link_path_walk
      0.85 ±  2%      -0.2        0.62        perf-profile.self.cycles-pp.__check_object_size
      0.87 ±  8%      -0.2        0.65 ±  9%  perf-profile.self.cycles-pp.alloc_vmap_area
      0.86            -0.2        0.64        perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.88 ±  2%      -0.2        0.66        perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.79            -0.2        0.59        perf-profile.self.cycles-pp.getname_flags
      0.72 ±  2%      -0.2        0.53 ±  4%  perf-profile.self.cycles-pp.shim_statx
      0.70            -0.2        0.52        perf-profile.self.cycles-pp.__check_heap_object
      0.70 ±  2%      -0.2        0.52        perf-profile.self.cycles-pp.do_syscall_64
      0.64            -0.2        0.47        perf-profile.self.cycles-pp.__lxstat64
      0.64            -0.2        0.47        perf-profile.self.cycles-pp.__xstat
      0.92 ±  2%      -0.1        0.78        perf-profile.self.cycles-pp._raw_spin_lock
      0.59 ±  3%      -0.1        0.44 ±  2%  perf-profile.self.cycles-pp.clear_page_erms
      0.57 ±  2%      -0.1        0.43        perf-profile.self.cycles-pp.vfs_statx
      0.85 ±  6%      -0.1        0.71 ±  2%  perf-profile.self.cycles-pp.__d_lookup_rcu
      0.53 ±  2%      -0.1        0.41        perf-profile.self.cycles-pp.step_into
      0.47 ±  2%      -0.1        0.35        perf-profile.self.cycles-pp.syscall_enter_from_user_mode
      0.44 ±  2%      -0.1        0.32        perf-profile.self.cycles-pp.__x64_sys_statx
      0.52 ±  2%      -0.1        0.41        perf-profile.self.cycles-pp.filename_lookup
      0.47 ±  2%      -0.1        0.36        perf-profile.self.cycles-pp.vfs_getattr_nosec
      0.46 ±  3%      -0.1        0.36        perf-profile.self.cycles-pp.memcg_slab_free_hook
      0.36 ±  2%      -0.1        0.26 ±  2%  perf-profile.self.cycles-pp.__fxstat
      0.52            -0.1        0.42        perf-profile.self.cycles-pp.memcpy_erms
      0.35 ±  3%      -0.1        0.25 ±  3%  perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
      0.51 ±  2%      -0.1        0.42        perf-profile.self.cycles-pp.__might_sleep
      0.36            -0.1        0.27        perf-profile.self.cycles-pp.path_lookupat
      0.40            -0.1        0.31        perf-profile.self.cycles-pp.lookup_fast
      0.32 ±  2%      -0.1        0.23 ±  3%  perf-profile.self.cycles-pp.path_init
      0.32            -0.1        0.23 ±  2%  perf-profile.self.cycles-pp.do_statx
      0.30 ±  3%      -0.1        0.22 ±  2%  perf-profile.self.cycles-pp.user_path_at_empty
      0.34 ±  2%      -0.1        0.26 ±  2%  perf-profile.self.cycles-pp.walk_component
      0.24 ±  3%      -0.1        0.16 ±  6%  perf-profile.self.cycles-pp.find_vmap_area
      0.24 ±  3%      -0.1        0.18 ±  2%  perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.26 ±  4%      -0.1        0.19 ±  2%  perf-profile.self.cycles-pp.__cond_resched
      0.27 ±  2%      -0.1        0.20 ±  3%  perf-profile.self.cycles-pp.inode_permission
      0.24 ±  4%      -0.1        0.17 ±  2%  perf-profile.self.cycles-pp.free_vmap_area_noflush
      0.26            -0.1        0.20 ±  2%  perf-profile.self.cycles-pp.pfn_valid
      0.40            -0.1        0.34 ±  2%  perf-profile.self.cycles-pp.generic_permission
      0.26 ±  3%      -0.1        0.20 ±  2%  perf-profile.self.cycles-pp.map_id_up
      0.40 ±  4%      -0.1        0.34 ±  2%  perf-profile.self.cycles-pp.__legitimize_mnt
      0.20 ±  6%      -0.1        0.14 ±  2%  perf-profile.self.cycles-pp.__vmalloc_area_node
      0.18 ±  4%      -0.1        0.12 ±  6%  perf-profile.self.cycles-pp.insert_vmap_area
      0.17 ±  4%      -0.1        0.12 ±  4%  perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
      0.20 ±  4%      -0.1        0.15 ±  2%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.24 ±  3%      -0.1        0.19 ±  8%  perf-profile.self.cycles-pp.refcount_dec_not_one
      0.23 ±  3%      -0.1        0.18 ±  2%  perf-profile.self.cycles-pp.putname
      0.30            -0.0        0.25 ±  4%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.23 ±  2%      -0.0        0.18 ±  2%  perf-profile.self.cycles-pp.cp_statx
      0.19 ±  5%      -0.0        0.14 ±  3%  perf-profile.self.cycles-pp.memcg_slab_post_alloc_hook
      0.11 ±  7%      -0.0        0.07 ±  7%  perf-profile.self.cycles-pp.__alloc_pages_bulk
      0.25 ±  3%      -0.0        0.21 ±  2%  perf-profile.self.cycles-pp.cp_new_stat
      0.20 ±  2%      -0.0        0.16 ±  3%  perf-profile.self.cycles-pp._raw_write_lock_irq
      0.45 ±  6%      -0.0        0.40 ±  2%  perf-profile.self.cycles-pp.page_counter_cancel
      0.20 ±  3%      -0.0        0.16 ±  4%  perf-profile.self.cycles-pp.generic_fillattr
      0.20 ±  5%      -0.0        0.16 ±  7%  perf-profile.self.cycles-pp.page_counter_charge
      0.16 ±  3%      -0.0        0.12 ±  3%  perf-profile.self.cycles-pp.terminate_walk
      0.21 ±  5%      -0.0        0.18 ±  2%  perf-profile.self.cycles-pp.queued_write_lock_slowpath
      0.15 ±  5%      -0.0        0.11        perf-profile.self.cycles-pp.__x64_sys_newstat
      0.15 ±  4%      -0.0        0.11 ±  3%  perf-profile.self.cycles-pp.security_inode_permission
      0.12 ±  6%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.rb_insert_color
      0.11 ±  6%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.pids_can_fork
      0.19 ±  3%      -0.0        0.15 ±  4%  perf-profile.self.cycles-pp.dput
      0.15 ±  4%      -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.__x64_sys_newlstat
      0.13 ±  5%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.__do_sys_newstat
      0.18 ±  4%      -0.0        0.15 ±  4%  perf-profile.self.cycles-pp.__might_fault
      0.13 ±  5%      -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.propagate_protected_usage
      0.26 ±  5%      -0.0        0.23 ±  4%  perf-profile.self.cycles-pp.stress_fstat_helper
      0.12 ±  3%      -0.0        0.09 ±  7%  perf-profile.self.cycles-pp.nd_jump_root
      0.26 ±  3%      -0.0        0.22 ±  2%  perf-profile.self.cycles-pp._find_next_bit
      0.14 ±  3%      -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.try_to_unlazy
      0.06            -0.0        0.03 ± 81%  perf-profile.self.cycles-pp.__free_pages
      0.11 ±  4%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.complete_walk
      0.13 ±  3%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.dup_task_struct
      0.12 ±  6%      -0.0        0.09 ±  4%  perf-profile.self.cycles-pp._copy_to_user
      0.07 ±  5%      -0.0        0.04 ± 51%  perf-profile.self.cycles-pp.pids_release
      0.14 ±  5%      -0.0        0.11        perf-profile.self.cycles-pp.__do_sys_newlstat
      0.11            -0.0        0.08 ±  5%  perf-profile.self.cycles-pp._mix_pool_bytes
      0.10 ±  3%      -0.0        0.08 ±  6%  perf-profile.self.cycles-pp.rcu_all_qs
      0.10 ±  5%      -0.0        0.07        perf-profile.self.cycles-pp.cpumask_next
      0.27 ±  3%      -0.0        0.24 ±  2%  perf-profile.self.cycles-pp.__schedule
      0.12 ±  6%      -0.0        0.10 ±  6%  perf-profile.self.cycles-pp.__legitimize_path
      0.10 ±  7%      -0.0        0.08        perf-profile.self.cycles-pp.update_curr
      0.08 ±  5%      -0.0        0.06        perf-profile.self.cycles-pp.legitimize_links
      0.15 ±  4%      -0.0        0.13 ±  4%  perf-profile.self.cycles-pp.mntput_no_expire
      0.10 ±  6%      -0.0        0.08        perf-profile.self.cycles-pp.check_stack_object
      0.08 ±  4%      -0.0        0.06        perf-profile.self.cycles-pp.__x64_sys_newfstat
      0.10 ±  4%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.security_inode_getattr
      0.11 ±  5%      -0.0        0.09        perf-profile.self.cycles-pp.native_sched_clock
      0.09 ±  6%      -0.0        0.07 ±  9%  perf-profile.self.cycles-pp.__list_add_valid
      0.10 ±  3%      -0.0        0.09 ±  9%  perf-profile.self.cycles-pp.__fget_files
      0.08 ±  4%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.rb_erase
      0.06 ±  7%      -0.0        0.05 ±  9%  perf-profile.self.cycles-pp.mntput
      0.06 ±  8%      +0.0        0.07        perf-profile.self.cycles-pp.cpuidle_idle_call
      0.14 ±  4%      +0.0        0.16 ±  3%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.11 ±  4%      +0.0        0.13 ±  3%  perf-profile.self.cycles-pp.pthread_create
      0.06 ±  7%      +0.0        0.09        perf-profile.self.cycles-pp.try_get_compound_head
      0.10 ±  7%      +0.0        0.13 ±  3%  perf-profile.self.cycles-pp.start_thread
      0.14 ±  5%      +0.0        0.17 ±  6%  perf-profile.self.cycles-pp.__slab_free
      0.03 ±100%      +0.0        0.07        perf-profile.self.cycles-pp.llist_add_batch
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.__cleanup_sighand
      0.02 ±141%      +0.1        0.07 ±  5%  perf-profile.self.cycles-pp.get_pid_task
      0.00            +0.1        0.07 ±  7%  perf-profile.self.cycles-pp.memset_erms
      0.05 ±  7%      +0.1        0.17 ±  2%  perf-profile.self.cycles-pp.find_idlest_cpu
      0.51 ±  4%      +0.1        0.64 ±  3%  perf-profile.self.cycles-pp.lockref_put_return
      4.26            +1.0        5.26        perf-profile.self.cycles-pp.common_perm_cond
     15.25 ±  2%      +4.9       20.12        perf-profile.self.cycles-pp.lockref_put_or_lock
     19.94            +6.5       26.44        perf-profile.self.cycles-pp.lockref_get_not_dead


***************************************************************************************************
lkp-csl-2sp7: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/option_a/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/CPU/debian-x86_64-phoronix/lkp-csl-2sp7/neatbench-1.0.4/phoronix-test-suite/0x500320a

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     21.93           +12.5%      24.67        phoronix-test-suite.neatbench.CPU.fps
  29295274           -15.5%   24743253 ±  2%  meminfo.DirectMap2M
     90734 ±  2%     -10.5%      81194 ±  4%  numa-vmstat.node1.nr_anon_pages
    487282           +24.8%     608044 ±  4%  numa-meminfo.node0.AnonPages.max
    174060           -15.4%     147263 ±  4%  numa-meminfo.node1.AnonHugePages
    362897 ±  2%     -10.5%     324765 ±  4%  numa-meminfo.node1.AnonPages
    204270           +24.3%     253988 ± 16%  proc-vmstat.numa_hint_faults
     27906 ± 10%    +239.6%      94760 ± 29%  proc-vmstat.numa_pages_migrated
     27906 ± 10%    +239.6%      94760 ± 29%  proc-vmstat.pgmigrate_success
    507.87 ±  3%     +11.3%     565.26 ±  7%  perf-stat.i.cpu-migrations
   2761308 ±  2%     +19.0%    3286398 ± 13%  perf-stat.i.dTLB-load-misses
 8.745e+09 ±  2%      +6.0%  9.273e+09        perf-stat.i.dTLB-loads
 1.654e+08            +3.1%  1.705e+08        perf-stat.i.metric.M/sec
     29.42            +8.9       38.28 ±  2%  perf-stat.i.node-load-miss-rate%
   6226327           +57.2%    9785959 ±  2%  perf-stat.i.node-load-misses
  20558122           -14.3%   17615819 ±  3%  perf-stat.i.node-loads
     32.14 ±  2%      +4.5       36.69 ±  3%  perf-stat.i.node-store-miss-rate%
  11969241 ±  3%     +17.5%   14067728 ±  6%  perf-stat.i.node-store-misses
  26170161           -12.8%   22819269 ±  6%  perf-stat.i.node-stores
     35.48            -1.1       34.40 ±  2%  perf-stat.overall.cache-miss-rate%
      0.03            +0.0        0.04 ± 11%  perf-stat.overall.dTLB-load-miss-rate%
     23.27           +12.5       35.72 ±  3%  perf-stat.overall.node-load-miss-rate%
     31.40 ±  2%      +6.8       38.18 ±  7%  perf-stat.overall.node-store-miss-rate%
   2740309 ±  2%     +18.9%    3258409 ± 13%  perf-stat.ps.dTLB-load-misses
 8.672e+09 ±  2%      +6.0%  9.191e+09        perf-stat.ps.dTLB-loads
   6183578           +56.9%    9702575 ±  2%  perf-stat.ps.node-load-misses
  20393328           -14.4%   17466096 ±  2%  perf-stat.ps.node-loads
  11891538 ±  3%     +17.4%   13956458 ±  6%  perf-stat.ps.node-store-misses
  25975231           -12.8%   22637665 ±  6%  perf-stat.ps.node-stores
     14.49 ± 17%      -6.9        7.63 ± 58%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     14.48 ± 17%      -6.9        7.62 ± 58%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.44 ± 26%      -5.6        3.87 ± 70%  perf-profile.calltrace.cycles-pp.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.43 ± 26%      -5.6        3.87 ± 70%  perf-profile.calltrace.cycles-pp.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      9.22 ± 27%      -5.5        3.76 ± 70%  perf-profile.calltrace.cycles-pp.zap_page_range.madvise_vma_behavior.do_madvise.__x64_sys_madvise.do_syscall_64
      9.23 ± 27%      -5.5        3.77 ± 70%  perf-profile.calltrace.cycles-pp.madvise_vma_behavior.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      8.66 ± 28%      -5.2        3.46 ± 70%  perf-profile.calltrace.cycles-pp.tlb_finish_mmu.zap_page_range.madvise_vma_behavior.do_madvise.__x64_sys_madvise
      8.64 ± 28%      -5.2        3.45 ± 70%  perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.zap_page_range.madvise_vma_behavior.do_madvise
      8.43 ± 29%      -5.1        3.31 ± 70%  perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.zap_page_range.madvise_vma_behavior
      8.88 ± 16%      -4.3        4.56 ± 59%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt
      8.57 ± 17%      -4.1        4.43 ± 60%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      7.77 ± 17%      -3.8        4.00 ± 60%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      7.72 ± 17%      -3.7        3.97 ± 60%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      7.42 ± 21%      -2.8        4.58 ± 30%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      5.09 ± 20%      -2.8        2.25 ± 71%  perf-profile.calltrace.cycles-pp.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer
      7.48 ± 20%      -2.8        4.67 ± 30%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      7.78 ± 21%      -2.6        5.16 ± 21%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      9.08 ± 20%      -2.4        6.64 ± 17%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      4.22 ± 21%      -2.4        1.86 ± 71%  perf-profile.calltrace.cycles-pp.update_curr.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle
      3.82 ± 22%      -2.1        1.68 ± 71%  perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.task_tick_fair.scheduler_tick.update_process_times
      3.61 ± 22%      -2.0        1.59 ± 71%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.task_tick_fair.scheduler_tick
      3.32 ± 20%      -1.8        1.48 ± 71%  perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.task_tick_fair
      4.11 ±  8%      -1.8        2.35 ± 48%  perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      4.11 ±  8%      -1.8        2.36 ± 48%  perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
      4.12 ±  8%      -1.7        2.41 ± 44%  perf-profile.calltrace.cycles-pp.asm_exc_page_fault
      2.80 ± 19%      -1.4        1.43 ± 70%  perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event
      2.49 ± 18%      -1.2        1.32 ± 71%  perf-profile.calltrace.cycles-pp.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow
      2.40 ± 18%      -1.1        1.29 ± 71%  perf-profile.calltrace.cycles-pp.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow
      2.82 ±  9%      -1.0        1.80 ± 42%  perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      2.62 ±  9%      -0.9        1.71 ± 40%  perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      1.75 ±  5%      -0.8        0.92 ± 71%  perf-profile.calltrace.cycles-pp.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
      1.57 ± 15%      -0.7        0.84 ± 70%  perf-profile.calltrace.cycles-pp.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward
      1.35 ±  9%      -0.6        0.76 ± 71%  perf-profile.calltrace.cycles-pp.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.36 ±  9%      -0.6        0.76 ± 71%  perf-profile.calltrace.cycles-pp.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.99 ± 21%      -0.6        0.42 ± 70%  perf-profile.calltrace.cycles-pp.asm_sysvec_call_function
      1.21 ± 14%      -0.6        0.65 ± 71%  perf-profile.calltrace.cycles-pp.copy_process.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.92 ± 20%      -0.5        0.39 ± 70%  perf-profile.calltrace.cycles-pp.sysvec_call_function.asm_sysvec_call_function
      0.87            -0.5        0.37 ± 70%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.95 ±  3%      -0.5        0.45 ± 71%  perf-profile.calltrace.cycles-pp.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      0.83 ±  2%      -0.5        0.34 ± 70%  perf-profile.calltrace.cycles-pp.__schedule.schedule.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault
      0.83 ±  2%      -0.5        0.34 ± 70%  perf-profile.calltrace.cycles-pp.schedule.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.90 ±  4%      -0.5        0.43 ± 71%  perf-profile.calltrace.cycles-pp.__alloc_pages.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault
      0.82 ± 19%      -0.5        0.34 ± 70%  perf-profile.calltrace.cycles-pp.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function
      0.79 ± 19%      -0.4        0.34 ± 70%  perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.__sysvec_call_function.sysvec_call_function.asm_sysvec_call_function
      0.84 ±  4%      -0.4        0.39 ± 71%  perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages.alloc_pages_vma.do_anonymous_page.__handle_mm_fault
      0.83 ±  8%      -0.4        0.41 ± 70%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      0.83 ±  8%      -0.4        0.42 ± 71%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.78 ± 14%      -0.3        0.45 ± 71%  perf-profile.calltrace.cycles-pp.dup_task_struct.copy_process.kernel_clone.__do_sys_clone.do_syscall_64
      0.71 ± 17%      -0.3        0.39 ± 71%  perf-profile.calltrace.cycles-pp.__unwind_start.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample
      1.36 ± 14%      -0.2        1.14 ± 18%  perf-profile.calltrace.cycles-pp.ret_from_fork
      0.00            +0.6        0.59 ±  7%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
      0.00            +0.6        0.59 ±  7%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      0.00            +0.6        0.61 ±  9%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      0.00            +0.6        0.61 ±  9%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      0.00            +0.6        0.61 ±  9%  perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64_no_verify
     61.21 ±  6%     +12.0       73.25 ±  8%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     60.63 ±  6%     +12.2       72.83 ±  8%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     64.35 ±  5%     +12.7       77.08 ±  9%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     64.35 ±  5%     +12.7       77.08 ±  9%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     64.34 ±  5%     +12.7       77.07 ±  9%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     64.72 ±  4%     +13.0       77.69 ±  9%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      9.44 ± 26%      -5.6        3.87 ± 70%  perf-profile.children.cycles-pp.__x64_sys_madvise
      9.44 ± 26%      -5.6        3.87 ± 70%  perf-profile.children.cycles-pp.do_madvise
      9.22 ± 27%      -5.5        3.76 ± 70%  perf-profile.children.cycles-pp.zap_page_range
      9.23 ± 27%      -5.5        3.77 ± 70%  perf-profile.children.cycles-pp.madvise_vma_behavior
      8.75 ± 28%      -5.1        3.61 ± 66%  perf-profile.children.cycles-pp.tlb_flush_mmu
      8.76 ± 28%      -5.1        3.63 ± 65%  perf-profile.children.cycles-pp.tlb_finish_mmu
      8.50 ± 29%      -5.1        3.39 ± 69%  perf-profile.children.cycles-pp.flush_tlb_mm_range
      8.45 ± 29%      -5.1        3.34 ± 70%  perf-profile.children.cycles-pp.on_each_cpu_cond_mask
      8.45 ± 29%      -5.1        3.34 ± 70%  perf-profile.children.cycles-pp.smp_call_function_many_cond
     16.82 ± 14%      -5.1       11.72 ± 18%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     16.81 ± 14%      -5.1       11.71 ± 18%  perf-profile.children.cycles-pp.do_syscall_64
      7.62 ± 20%      -2.8        4.85 ± 25%  perf-profile.children.cycles-pp.update_process_times
      5.25 ± 20%      -2.8        2.49 ± 57%  perf-profile.children.cycles-pp.task_tick_fair
      7.69 ± 20%      -2.7        4.94 ± 25%  perf-profile.children.cycles-pp.tick_sched_handle
      5.85 ± 18%      -2.7        3.13 ± 59%  perf-profile.children.cycles-pp.update_curr
      6.30 ± 20%      -2.6        3.70 ± 30%  perf-profile.children.cycles-pp.scheduler_tick
      7.99 ± 20%      -2.6        5.44 ± 18%  perf-profile.children.cycles-pp.tick_sched_timer
      5.71 ± 16%      -2.4        3.27 ± 59%  perf-profile.children.cycles-pp.perf_swevent_overflow
      9.37 ± 20%      -2.4        6.94 ± 15%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      5.29 ± 19%      -2.4        2.87 ± 59%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      5.67 ± 16%      -2.4        3.25 ± 59%  perf-profile.children.cycles-pp.__perf_event_overflow
      5.60 ± 16%      -2.4        3.20 ± 60%  perf-profile.children.cycles-pp.perf_event_output_forward
      4.94 ±  9%      -1.9        3.00 ± 40%  perf-profile.children.cycles-pp.asm_exc_page_fault
      4.67 ± 15%      -1.9        2.73 ± 60%  perf-profile.children.cycles-pp.perf_prepare_sample
      4.62 ±  9%      -1.9        2.73 ± 40%  perf-profile.children.cycles-pp.exc_page_fault
      4.30 ±  8%      -1.7        2.61 ± 39%  perf-profile.children.cycles-pp.do_user_addr_fault
      4.13 ± 15%      -1.6        2.52 ± 60%  perf-profile.children.cycles-pp.perf_callchain
      4.02 ± 15%      -1.5        2.47 ± 59%  perf-profile.children.cycles-pp.get_perf_callchain
      3.43 ±  7%      -1.4        2.07 ± 62%  perf-profile.children.cycles-pp.__schedule
      2.78 ± 12%      -1.0        1.80 ± 58%  perf-profile.children.cycles-pp.perf_callchain_kernel
      2.94 ±  9%      -0.9        2.03 ± 31%  perf-profile.children.cycles-pp.handle_mm_fault
      1.76 ±  6%      -0.8        0.96 ± 65%  perf-profile.children.cycles-pp.do_anonymous_page
      2.73 ±  8%      -0.8        1.93 ± 29%  perf-profile.children.cycles-pp.__handle_mm_fault
      1.23 ± 16%      -0.7        0.54 ± 70%  perf-profile.children.cycles-pp.asm_sysvec_call_function
      2.06 ± 12%      -0.7        1.39 ± 54%  perf-profile.children.cycles-pp.unwind_next_frame
      1.08 ± 19%      -0.6        0.47 ± 70%  perf-profile.children.cycles-pp.sysvec_call_function
      1.36 ±  9%      -0.6        0.76 ± 71%  perf-profile.children.cycles-pp.__x64_sys_exit
      1.02 ±  2%      -0.6        0.45 ± 70%  perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      1.16 ± 21%      -0.6        0.60 ± 72%  perf-profile.children.cycles-pp.perf_callchain_user
      0.99 ± 14%      -0.6        0.43 ± 70%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      1.12 ± 21%      -0.6        0.57 ± 72%  perf-profile.children.cycles-pp.__get_user_nocheck_8
      0.95 ± 18%      -0.5        0.40 ± 70%  perf-profile.children.cycles-pp.__sysvec_call_function
      1.88 ± 15%      -0.5        1.35 ±  8%  perf-profile.children.cycles-pp.native_irq_return_iret
      1.03 ±  2%      -0.5        0.53 ± 62%  perf-profile.children.cycles-pp.__alloc_pages
      0.98            -0.5        0.50 ± 62%  perf-profile.children.cycles-pp.alloc_pages_vma
      1.36 ± 13%      -0.5        0.88 ± 44%  perf-profile.children.cycles-pp.clear_page_erms
      0.93 ±  3%      -0.5        0.45 ± 71%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.90 ± 14%      -0.4        0.46 ± 59%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.86 ± 15%      -0.4        0.43 ± 59%  perf-profile.children.cycles-pp.dequeue_entity
      0.97 ± 26%      -0.4        0.54 ± 70%  perf-profile.children.cycles-pp.vfs_read
      0.97 ± 26%      -0.4        0.55 ± 70%  perf-profile.children.cycles-pp.ksys_read
      0.69 ± 16%      -0.4        0.29 ± 70%  perf-profile.children.cycles-pp.update_load_avg
      0.80 ± 10%      -0.4        0.41 ± 70%  perf-profile.children.cycles-pp.kernel_init_free_pages
      0.75 ±  9%      -0.4        0.39 ± 70%  perf-profile.children.cycles-pp.newidle_balance
      0.67 ± 10%      -0.4        0.32 ± 70%  perf-profile.children.cycles-pp.prep_new_page
      0.66 ± 10%      -0.3        0.33 ± 75%  perf-profile.children.cycles-pp.try_to_wake_up
      0.83 ±  8%      -0.3        0.51 ± 32%  perf-profile.children.cycles-pp.schedule_idle
      0.61 ± 14%      -0.3        0.30 ± 72%  perf-profile.children.cycles-pp.finish_task_switch
      0.73 ± 24%      -0.3        0.43 ± 68%  perf-profile.children.cycles-pp.seq_read_iter
      0.57 ±  8%      -0.3        0.31 ± 56%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.46 ± 12%      -0.2        0.24 ± 72%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.40 ± 28%      -0.2        0.19 ± 45%  perf-profile.children.cycles-pp.flush_tlb_func
      0.41 ± 10%      -0.2        0.19 ± 71%  perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
      0.42 ± 14%      -0.2        0.20 ± 75%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.32 ± 11%      -0.2        0.12 ± 71%  perf-profile.children.cycles-pp.__perf_event_header__init_id
      1.36 ± 14%      -0.2        1.17 ± 16%  perf-profile.children.cycles-pp.ret_from_fork
      0.94 ± 16%      -0.2        0.75 ± 14%  perf-profile.children.cycles-pp.load_balance
      0.38 ± 11%      -0.2        0.21 ± 71%  perf-profile.children.cycles-pp.put_task_stack
      0.32            -0.2        0.15 ± 70%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.26 ± 14%      -0.2        0.10 ± 70%  perf-profile.children.cycles-pp.perf_event_pid_type
      0.32 ± 13%      -0.2        0.15 ± 73%  perf-profile.children.cycles-pp.llist_reverse_order
      0.44 ±  8%      -0.2        0.27 ± 36%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.58 ± 14%      -0.2        0.41 ± 11%  perf-profile.children.cycles-pp.unmap_page_range
      0.31 ± 12%      -0.2        0.15 ± 70%  perf-profile.children.cycles-pp.llist_add_batch
      0.31 ±  3%      -0.2        0.15 ± 77%  perf-profile.children.cycles-pp.wake_up_q
      0.40 ±  8%      -0.2        0.24 ± 71%  perf-profile.children.cycles-pp.unwind_get_return_address
      0.31 ±  4%      -0.1        0.16 ± 77%  perf-profile.children.cycles-pp.rwsem_wake
      0.22 ± 19%      -0.1        0.07 ± 70%  perf-profile.children.cycles-pp.__task_pid_nr_ns
      0.23 ± 30%      -0.1        0.10 ± 74%  perf-profile.children.cycles-pp.perf_output_begin_forward
      0.21 ± 15%      -0.1        0.09 ± 73%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.20 ±  7%      -0.1        0.07 ± 71%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.27 ±  4%      -0.1        0.15 ± 70%  perf-profile.children.cycles-pp.vm_mmap_pgoff
      0.24 ± 10%      -0.1        0.12 ± 73%  perf-profile.children.cycles-pp.rmqueue
      0.19 ± 11%      -0.1        0.07 ± 70%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.21 ± 20%      -0.1        0.09 ± 72%  perf-profile.children.cycles-pp.do_task_stat
      0.38 ± 15%      -0.1        0.26 ± 33%  perf-profile.children.cycles-pp.sync_regs
      0.36 ±  7%      -0.1        0.24 ± 29%  perf-profile.children.cycles-pp.__x64_sys_mprotect
      0.36 ±  7%      -0.1        0.24 ± 29%  perf-profile.children.cycles-pp.do_mprotect_pkey
      0.21 ± 12%      -0.1        0.10 ± 70%  perf-profile.children.cycles-pp.down_write_killable
      0.18 ±  7%      -0.1        0.07 ± 71%  perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.28 ± 17%      -0.1        0.17 ± 41%  perf-profile.children.cycles-pp.queue_work_on
      0.19 ± 11%      -0.1        0.09 ± 71%  perf-profile.children.cycles-pp.native_flush_tlb_local
      0.26 ±  4%      -0.1        0.17 ± 41%  perf-profile.children.cycles-pp.sched_move_task
      0.20 ±  6%      -0.1        0.10 ± 71%  perf-profile.children.cycles-pp.___perf_sw_event
      0.17 ± 19%      -0.1        0.08 ± 73%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.21 ± 14%      -0.1        0.12 ± 29%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      0.18 ± 24%      -0.1        0.10 ± 80%  perf-profile.children.cycles-pp.trigger_load_balance
      0.19 ± 14%      -0.1        0.10 ± 73%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.18 ± 26%      -0.1        0.10 ± 31%  perf-profile.children.cycles-pp.note_gp_changes
      0.13 ± 28%      -0.1        0.05 ± 72%  perf-profile.children.cycles-pp.arch_dup_task_struct
      0.11 ± 29%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.cpuacct_charge
      0.13 ±  3%      -0.1        0.06 ± 73%  perf-profile.children.cycles-pp.find_vma
      0.14 ± 20%      -0.1        0.07 ± 71%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.10 ±  4%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.update_min_vruntime
      0.10 ±  9%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
      0.10 ± 16%      -0.1        0.04 ± 76%  perf-profile.children.cycles-pp.__split_huge_pmd
      0.10            -0.1        0.05 ± 74%  perf-profile.children.cycles-pp.hrtimer_active
      0.09 ± 22%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.__split_vma
      0.17 ±  9%      -0.0        0.12 ± 31%  perf-profile.children.cycles-pp.release_task
      0.09 ± 14%      -0.0        0.04 ± 73%  perf-profile.children.cycles-pp.mm_release
      0.13 ± 21%      -0.0        0.09 ± 27%  perf-profile.children.cycles-pp.link_path_walk
      0.08 ± 11%      -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.08 ± 14%      -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.__put_task_struct
      0.08 ± 16%      -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.futex_wake
      0.08 ± 16%      -0.0        0.04 ± 73%  perf-profile.children.cycles-pp.__switch_to
      0.11 ± 19%      -0.0        0.08 ± 12%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.09 ± 19%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.mod_objcg_state
      0.13 ± 25%      +0.1        0.23 ± 36%  perf-profile.children.cycles-pp.__x64_sys_execve
      0.13 ± 25%      +0.1        0.23 ± 36%  perf-profile.children.cycles-pp.do_execveat_common
      0.11 ± 26%      +0.1        0.22 ± 42%  perf-profile.children.cycles-pp.bprm_execve
      0.38 ± 27%      +0.2        0.61 ±  9%  perf-profile.children.cycles-pp.start_kernel
      0.19 ± 60%      +0.9        1.11 ±103%  perf-profile.children.cycles-pp.delay_tsc
     61.55 ±  6%     +12.3       73.84 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter
     61.53 ±  6%     +12.3       73.83 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter_state
     64.35 ±  5%     +12.7       77.08 ±  9%  perf-profile.children.cycles-pp.start_secondary
     64.72 ±  4%     +13.0       77.69 ±  9%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     64.72 ±  4%     +13.0       77.69 ±  9%  perf-profile.children.cycles-pp.cpu_startup_entry
     64.72 ±  4%     +13.0       77.69 ±  9%  perf-profile.children.cycles-pp.do_idle
      1.88 ± 15%      -0.5        1.35 ±  8%  perf-profile.self.cycles-pp.native_irq_return_iret
      1.33 ± 13%      -0.5        0.86 ± 44%  perf-profile.self.cycles-pp.clear_page_erms
      0.32 ± 23%      -0.2        0.13 ± 71%  perf-profile.self.cycles-pp.update_load_avg
      0.32            -0.2        0.15 ± 70%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.32 ± 13%      -0.2        0.15 ± 73%  perf-profile.self.cycles-pp.llist_reverse_order
      0.44 ±  8%      -0.2        0.27 ± 36%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      0.28 ±  8%      -0.2        0.13 ± 70%  perf-profile.self.cycles-pp.llist_add_batch
      0.22 ± 44%      -0.1        0.07 ± 72%  perf-profile.self.cycles-pp.flush_tlb_func
      0.22 ± 18%      -0.1        0.07 ± 70%  perf-profile.self.cycles-pp.__task_pid_nr_ns
      0.23 ± 30%      -0.1        0.10 ± 76%  perf-profile.self.cycles-pp.perf_output_begin_forward
      0.19 ± 11%      -0.1        0.07 ± 71%  perf-profile.self.cycles-pp.__update_load_avg_se
      0.22 ±  7%      -0.1        0.09 ± 71%  perf-profile.self.cycles-pp.flush_smp_call_function_queue
      0.21 ± 23%      -0.1        0.09 ± 74%  perf-profile.self.cycles-pp.perf_output_sample
      0.38 ± 15%      -0.1        0.26 ± 33%  perf-profile.self.cycles-pp.sync_regs
      0.19 ± 19%      -0.1        0.08 ± 72%  perf-profile.self.cycles-pp.__unwind_start
      0.18 ± 21%      -0.1        0.08 ± 77%  perf-profile.self.cycles-pp.perf_prepare_sample
      0.19 ± 11%      -0.1        0.09 ± 71%  perf-profile.self.cycles-pp.native_flush_tlb_local
      0.19 ± 33%      -0.1        0.09 ± 39%  perf-profile.self.cycles-pp.perf_tp_event
      0.19 ± 14%      -0.1        0.10 ± 73%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.16 ± 21%      -0.1        0.07 ± 78%  perf-profile.self.cycles-pp.trigger_load_balance
      0.11 ± 29%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp.cpuacct_charge
      0.15 ±  3%      -0.1        0.09 ± 71%  perf-profile.self.cycles-pp.___perf_sw_event
      0.11 ± 14%      -0.1        0.05 ± 81%  perf-profile.self.cycles-pp.__softirqentry_text_start
      0.15 ± 28%      -0.1        0.09 ± 24%  perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime
      0.09 ±  5%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.update_min_vruntime
      0.11 ± 23%      -0.1        0.05 ± 71%  perf-profile.self.cycles-pp.perf_callchain_kernel
      0.10 ±  9%      -0.1        0.04 ± 70%  perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
      0.09 ±  5%      -0.1        0.04 ± 73%  perf-profile.self.cycles-pp.find_vma
      0.10 ± 14%      -0.1        0.05 ± 70%  perf-profile.self.cycles-pp.perf_callchain
      0.10            -0.1        0.05 ± 74%  perf-profile.self.cycles-pp.hrtimer_active
      0.08 ± 16%      -0.0        0.04 ± 73%  perf-profile.self.cycles-pp.__switch_to
      0.13 ± 24%      +0.9        1.06 ±111%  perf-profile.self.cycles-pp.delay_tsc



***************************************************************************************************
lkp-csl-2sp7: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/option_a/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/All (CPU + GPU)/debian-x86_64-phoronix/lkp-csl-2sp7/neatbench-1.0.4/phoronix-test-suite/0x500320a

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     21.90           +15.2%      25.23        phoronix-test-suite.neatbench.All.fps
    240.02 ± 79%     -57.9%     100.99        phoronix-test-suite.time.elapsed_time
    240.02 ± 79%     -57.9%     100.99        phoronix-test-suite.time.elapsed_time.max
      2106 ±  6%      -8.8%       1920        phoronix-test-suite.time.percent_of_cpu_this_job_got
     90.11 ± 82%     -63.1%      33.23 ±  2%  phoronix-test-suite.time.system_time
      5230 ± 85%     -63.5%       1906        phoronix-test-suite.time.user_time
  29614080 ±  3%     -14.2%   25394517 ±  5%  meminfo.DirectMap2M
   5613969 ± 70%     -66.2%    1894969 ± 39%  numa-numastat.node0.local_node
   5639979 ± 69%     -65.3%    1957289 ± 38%  numa-numastat.node0.numa_hit
  26828862 ± 63%     -69.9%    8072601 ± 68%  turbostat.C1E
    170.80            +0.7%     171.92        turbostat.RAMWatt
    606.67 ± 50%     +45.9%     885.00 ±  2%  vmstat.io.bi
     23.33 ±  7%     -18.6%      19.00 ±  7%  vmstat.procs.r
    361167 ± 15%     -32.2%     244960 ± 25%  numa-meminfo.node0.AnonHugePages
     82728 ± 20%    +114.0%     177014 ± 62%  numa-meminfo.node1.AnonPages
     89169 ± 15%    +124.0%     199717 ± 69%  numa-meminfo.node1.Inactive
     85555 ± 17%    +109.1%     178925 ± 63%  numa-meminfo.node1.Inactive(anon)
      8604 ±  2%     +15.7%       9958 ±  4%  numa-meminfo.node1.KernelStack
    843417 ±  6%     +30.6%    1101447 ± 16%  numa-meminfo.node1.MemUsed
   4147856 ± 48%     -45.2%    2272023 ± 13%  numa-vmstat.node0.numa_hit
   4119756 ± 48%     -46.4%    2208525 ± 14%  numa-vmstat.node0.numa_local
     20691 ± 20%    +113.9%      44251 ± 62%  numa-vmstat.node1.nr_anon_pages
     21398 ± 17%    +109.0%      44724 ± 63%  numa-vmstat.node1.nr_inactive_anon
      8606 ±  2%     +15.7%       9955 ±  4%  numa-vmstat.node1.nr_kernel_stack
     21398 ± 17%    +109.0%      44724 ± 63%  numa-vmstat.node1.nr_zone_inactive_anon
    190582 ±  3%      -4.5%     181962        proc-vmstat.nr_anon_pages
    417246            -2.5%     406841        proc-vmstat.nr_inactive_anon
     20308 ±  2%      -3.5%      19599        proc-vmstat.nr_mapped
    229553            -1.5%     226075        proc-vmstat.nr_shmem
    417246            -2.5%     406841        proc-vmstat.nr_zone_inactive_anon
    572357 ± 96%     -72.9%     155080 ±  5%  proc-vmstat.numa_hint_faults_local
   1571296 ± 96%     -69.9%     473479        proc-vmstat.numa_pte_updates
     28837 ± 65%     -47.1%      15245        proc-vmstat.pgactivate
   7313749 ± 79%     -56.6%    3171525        proc-vmstat.pgfault
    187098 ± 63%     -46.0%     100957        proc-vmstat.pgreuse
 2.741e+09            +3.2%  2.829e+09        perf-stat.i.branch-instructions
  23946611 ±  3%     +11.0%   26584797 ±  8%  perf-stat.i.branch-misses
 5.418e+10 ±  6%      -8.2%  4.973e+10        perf-stat.i.cpu-cycles
    550.15 ±  2%     +11.1%     611.20 ±  2%  perf-stat.i.cpu-migrations
   2562764 ±  4%      +6.8%    2737034 ±  3%  perf-stat.i.dTLB-store-misses
 3.302e+10            +3.2%  3.409e+10        perf-stat.i.instructions
    565991 ±  6%      -8.3%     519287        perf-stat.i.metric.GHz
     27.15 ±  5%     +10.6       37.77        perf-stat.i.node-load-miss-rate%
   6023051           +68.7%   10161660 ±  3%  perf-stat.i.node-load-misses
  20814028           -12.6%   18197576        perf-stat.i.node-loads
     28.25 ± 12%      +5.9       34.16 ±  2%  perf-stat.i.node-store-miss-rate%
  11383164 ± 11%     +32.8%   15111590 ±  2%  perf-stat.i.node-store-misses
  27464998 ±  7%     -16.6%   22902472        perf-stat.i.node-stores
      1.64 ±  5%     -11.1%       1.46        perf-stat.overall.cpi
    245.86 ±  4%      -9.2%     223.35        perf-stat.overall.cycles-between-cache-misses
      0.61 ±  5%     +12.1%       0.68        perf-stat.overall.ipc
     22.46           +13.4       35.83 ±  3%  perf-stat.overall.node-load-miss-rate%
     29.38 ± 12%     +10.4       39.76        perf-stat.overall.node-store-miss-rate%
 2.724e+09            +2.9%  2.803e+09        perf-stat.ps.branch-instructions
  23798405 ±  3%     +10.7%   26346637 ±  8%  perf-stat.ps.branch-misses
 5.393e+10 ±  6%      -8.5%  4.933e+10        perf-stat.ps.cpu-cycles
    548.77 ±  2%     +10.7%     607.37 ±  2%  perf-stat.ps.cpu-migrations
 3.281e+10            +2.9%  3.377e+10        perf-stat.ps.instructions
   5993351 ±  2%     +68.1%   10075396 ±  4%  perf-stat.ps.node-load-misses
  20693312 ±  2%     -12.8%   18041364        perf-stat.ps.node-loads
  11326881 ± 11%     +32.4%   15001975 ±  2%  perf-stat.ps.node-store-misses
  27328186 ±  7%     -16.9%   22721712        perf-stat.ps.node-stores
     10.70 ±  9%     -10.7        0.00        perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt
     10.12 ± 13%     -10.1        0.00        perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      9.17 ± 14%      -9.2        0.00        perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      9.10 ± 14%      -9.1        0.00        perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
     11.57 ± 10%      -7.6        3.98 ±102%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     11.56 ± 10%      -7.6        3.98 ±102%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.53 ± 14%      -6.5        0.00        perf-profile.calltrace.cycles-pp.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.52 ± 14%      -6.5        0.00        perf-profile.calltrace.cycles-pp.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.34 ± 14%      -6.3        0.00        perf-profile.calltrace.cycles-pp.madvise_vma_behavior.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.33 ± 14%      -6.3        0.00        perf-profile.calltrace.cycles-pp.zap_page_range.madvise_vma_behavior.do_madvise.__x64_sys_madvise.do_syscall_64
      5.95 ± 17%      -5.9        0.00        perf-profile.calltrace.cycles-pp.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer
      5.88 ± 16%      -5.9        0.00        perf-profile.calltrace.cycles-pp.tlb_finish_mmu.zap_page_range.madvise_vma_behavior.do_madvise.__x64_sys_madvise
      5.86 ± 16%      -5.9        0.00        perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.zap_page_range.madvise_vma_behavior.do_madvise
      6.94 ± 14%      -5.7        1.23 ± 70%  perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      5.63 ± 17%      -5.6        0.00        perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.zap_page_range.madvise_vma_behavior
      5.60 ± 16%      -5.6        0.00        perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.zap_page_range
      5.59 ± 16%      -5.6        0.00        perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu_cond_mask.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu
      8.53 ± 12%      -5.4        3.10 ± 17%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      8.45 ± 12%      -5.4        3.04 ± 16%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      4.93 ± 17%      -4.9        0.00        perf-profile.calltrace.cycles-pp.update_curr.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle
      8.84 ± 11%      -4.6        4.20 ±  3%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
     10.15 ±  9%      -4.5        5.60 ±  9%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      4.34 ±  4%      -3.4        0.96 ± 11%  perf-profile.calltrace.cycles-pp.asm_exc_page_fault
      4.14 ± 10%      -3.2        0.91 ± 12%  perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      4.14 ± 11%      -3.2        0.91 ± 12%  perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
      2.73 ± 11%      -1.9        0.86 ± 11%  perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      2.56 ± 10%      -1.4        1.13 ± 31%  perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.40 ± 71%      +0.7        1.07 ± 40%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      0.40 ± 71%      +0.7        1.07 ± 40%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      0.40 ± 71%      +0.7        1.07 ± 40%  perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64_no_verify
      0.37 ± 70%      +1.0        1.36 ± 29%  perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.00            +1.1        1.08 ± 18%  perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.00            +1.3        1.27 ± 24%  perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.80 ± 15%      +1.4        2.20 ± 13%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      0.95 ± 15%      +1.6        2.60 ± 15%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      3.21 ± 18%      +6.7        9.96 ± 36%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      3.28 ± 18%      +7.3       10.59 ± 27%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      5.04 ± 19%     +10.4       15.46 ± 26%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      6.11 ± 22%     +12.4       18.52 ± 33%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     62.20 ±  2%     +15.1       77.26 ±  7%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     62.78 ±  2%     +15.2       77.99 ±  8%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     65.95 ±  3%     +17.6       83.53 ± 10%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     65.95 ±  3%     +17.6       83.53 ± 10%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     65.94 ±  3%     +17.6       83.53 ± 10%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     66.51 ±  3%     +18.1       84.59 ± 10%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      6.53 ± 14%      -6.5        0.00        perf-profile.children.cycles-pp.__x64_sys_madvise
      6.52 ± 14%      -6.5        0.00        perf-profile.children.cycles-pp.do_madvise
      6.34 ± 14%      -6.3        0.00        perf-profile.children.cycles-pp.madvise_vma_behavior
      6.33 ± 14%      -6.3        0.00        perf-profile.children.cycles-pp.zap_page_range
      6.45 ± 17%      -6.2        0.21 ± 71%  perf-profile.children.cycles-pp.update_curr
      6.81 ± 15%      -6.2        0.62 ± 22%  perf-profile.children.cycles-pp.perf_tp_event
      6.14 ± 16%      -6.0        0.09 ± 93%  perf-profile.children.cycles-pp.task_tick_fair
      7.28 ± 14%      -6.0        1.33 ± 70%  perf-profile.children.cycles-pp.scheduler_tick
      6.25 ± 15%      -5.9        0.35 ± 71%  perf-profile.children.cycles-pp.perf_swevent_overflow
      6.20 ± 15%      -5.8        0.35 ± 71%  perf-profile.children.cycles-pp.__perf_event_overflow
      6.10 ± 15%      -5.8        0.35 ± 71%  perf-profile.children.cycles-pp.perf_event_output_forward
      5.68 ± 17%      -5.7        0.00        perf-profile.children.cycles-pp.flush_tlb_mm_range
      5.86 ± 17%      -5.7        0.20 ± 70%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      5.64 ± 16%      -5.6        0.00        perf-profile.children.cycles-pp.on_each_cpu_cond_mask
      5.64 ± 16%      -5.6        0.00        perf-profile.children.cycles-pp.smp_call_function_many_cond
      8.77 ± 12%      -5.5        3.22 ± 20%  perf-profile.children.cycles-pp.tick_sched_handle
      8.70 ± 12%      -5.5        3.18 ± 19%  perf-profile.children.cycles-pp.update_process_times
      5.10 ± 17%      -4.9        0.22 ± 71%  perf-profile.children.cycles-pp.perf_prepare_sample
      5.96 ± 15%      -4.8        1.13 ±133%  perf-profile.children.cycles-pp.tlb_flush_mmu
      5.95 ± 15%      -4.8        1.13 ±133%  perf-profile.children.cycles-pp.tlb_finish_mmu
      9.11 ± 11%      -4.7        4.40 ±  7%  perf-profile.children.cycles-pp.tick_sched_timer
     10.43 ±  9%      -4.5        5.89 ± 12%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      4.61 ± 19%      -4.4        0.21 ± 72%  perf-profile.children.cycles-pp.perf_callchain
      4.50 ± 19%      -4.3        0.21 ± 72%  perf-profile.children.cycles-pp.get_perf_callchain
      5.18 ±  4%      -3.7        1.52 ±  5%  perf-profile.children.cycles-pp.asm_exc_page_fault
      4.67 ±  8%      -3.3        1.40 ± 12%  perf-profile.children.cycles-pp.exc_page_fault
      3.21 ± 20%      -3.1        0.13 ± 71%  perf-profile.children.cycles-pp.perf_callchain_kernel
      4.33 ±  9%      -3.0        1.38 ± 12%  perf-profile.children.cycles-pp.do_user_addr_fault
      3.33 ± 13%      -2.8        0.52 ± 39%  perf-profile.children.cycles-pp.__schedule
      2.41 ± 18%      -2.3        0.10 ± 70%  perf-profile.children.cycles-pp.unwind_next_frame
      2.15 ± 20%      -2.0        0.13 ± 71%  perf-profile.children.cycles-pp.schedule
      1.75 ± 12%      -1.6        0.12 ± 73%  perf-profile.children.cycles-pp.do_anonymous_page
      2.84 ± 10%      -1.5        1.37 ± 13%  perf-profile.children.cycles-pp.handle_mm_fault
      1.47 ± 18%      -1.4        0.10 ± 70%  perf-profile.children.cycles-pp.__unwind_start
      2.68 ±  9%      -1.3        1.36 ± 14%  perf-profile.children.cycles-pp.__handle_mm_fault
      1.21 ± 17%      -1.1        0.07 ± 86%  perf-profile.children.cycles-pp.perf_callchain_user
      1.17 ± 18%      -1.1        0.07 ± 86%  perf-profile.children.cycles-pp.__get_user_nocheck_8
      1.28 ± 11%      -0.9        0.35 ± 92%  perf-profile.children.cycles-pp.clear_page_erms
      1.03 ± 12%      -0.9        0.12 ± 73%  perf-profile.children.cycles-pp.__alloc_pages
      0.94 ± 13%      -0.9        0.09 ± 71%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.83 ± 15%      -0.8        0.07 ± 86%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.81 ± 18%      -0.8        0.05 ± 72%  perf-profile.children.cycles-pp.__orc_find
      0.80 ±  5%      -0.7        0.10 ± 86%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.75 ± 18%      -0.7        0.07 ± 86%  perf-profile.children.cycles-pp.kernel_init_free_pages
      0.75 ±  5%      -0.7        0.10 ± 86%  perf-profile.children.cycles-pp.dequeue_entity
      0.73 ± 18%      -0.6        0.14 ± 80%  perf-profile.children.cycles-pp.rcu_core
      0.63 ± 20%      -0.6        0.07 ± 86%  perf-profile.children.cycles-pp.prep_new_page
      0.58 ± 10%      -0.5        0.10 ± 70%  perf-profile.children.cycles-pp.perf_output_sample
      0.54 ±  5%      -0.5        0.07 ± 83%  perf-profile.children.cycles-pp.error_entry
      0.83 ± 11%      -0.4        0.39 ± 76%  perf-profile.children.cycles-pp.schedule_idle
      0.32 ± 16%      -0.2        0.10 ± 97%  perf-profile.children.cycles-pp.vm_mmap_pgoff
      0.24 ±  6%      -0.2        0.04 ± 71%  perf-profile.children.cycles-pp.try_charge_memcg
      0.16 ± 15%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.19 ± 24%      -0.1        0.10 ± 70%  perf-profile.children.cycles-pp.note_gp_changes
      0.13 ± 18%      +0.3        0.40 ± 72%  perf-profile.children.cycles-pp.unmap_vmas
      0.22 ± 11%      +0.3        0.51 ± 41%  perf-profile.children.cycles-pp.update_blocked_averages
      0.04 ± 71%      +0.3        0.35 ± 94%  perf-profile.children.cycles-pp.dup_mmap
      0.00            +0.3        0.31 ±112%  perf-profile.children.cycles-pp.__get_free_pages
      0.03 ±141%      +0.3        0.34 ± 96%  perf-profile.children.cycles-pp.tick_sched_do_timer
      0.02 ±141%      +0.3        0.34 ± 99%  perf-profile.children.cycles-pp.free_pgtables
      0.00            +0.3        0.32 ±106%  perf-profile.children.cycles-pp.proc_reg_read_iter
      0.05 ± 78%      +0.3        0.37 ± 84%  perf-profile.children.cycles-pp.task_work_run
      0.02 ±141%      +0.3        0.35 ± 92%  perf-profile.children.cycles-pp.__fput
      0.07 ± 25%      +0.3        0.41 ± 71%  perf-profile.children.cycles-pp.new_sync_read
      0.19 ± 15%      +0.4        0.54 ± 34%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.07 ± 20%      +0.4        0.44 ± 60%  perf-profile.children.cycles-pp.filemap_map_pages
      0.12 ± 24%      +0.4        0.50 ± 49%  perf-profile.children.cycles-pp.do_fault
      0.28 ± 17%      +0.4        0.69 ± 19%  perf-profile.children.cycles-pp.read_tsc
      0.56 ±  9%      +0.5        1.07 ± 40%  perf-profile.children.cycles-pp.start_kernel
      0.05 ± 71%      +0.6        0.62 ±115%  perf-profile.children.cycles-pp.dup_mm
      1.64 ± 16%      +0.6        2.25 ± 12%  perf-profile.children.cycles-pp.__softirqentry_text_start
      2.04 ± 15%      +0.6        2.67 ± 16%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.20 ± 47%      +0.6        0.84 ± 69%  perf-profile.children.cycles-pp.perf_event_read
      0.26 ± 83%      +0.7        0.92 ± 66%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.23 ± 41%      +0.7        0.91 ± 60%  perf-profile.children.cycles-pp.perf_read
      0.37 ± 16%      +0.7        1.08 ± 18%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      0.45 ± 15%      +0.8        1.28 ± 24%  perf-profile.children.cycles-pp.rebalance_domains
      0.45 ± 33%      +0.9        1.37 ± 30%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.26 ± 38%      +1.0        1.26 ± 67%  perf-profile.children.cycles-pp.__libc_read
      0.47 ±  2%      +1.1        1.56 ± 76%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.12 ± 24%      +1.2        1.32 ±103%  perf-profile.children.cycles-pp.__libc_fork
      0.20 ± 49%      +1.2        1.44 ± 90%  perf-profile.children.cycles-pp.smp_call_function_single
      0.75 ± 43%      +1.3        2.03 ± 45%  perf-profile.children.cycles-pp.ksys_read
      0.75 ± 43%      +1.3        2.03 ± 45%  perf-profile.children.cycles-pp.vfs_read
      0.12 ± 23%      +1.8        1.95 ±106%  perf-profile.children.cycles-pp.mmput
      0.11 ± 27%      +1.8        1.95 ±106%  perf-profile.children.cycles-pp.exit_mmap
      0.10 ± 21%      +2.6        2.74 ±118%  perf-profile.children.cycles-pp.__x64_sys_exit_group
      0.11 ± 26%      +3.2        3.31 ±120%  perf-profile.children.cycles-pp.do_group_exit
     63.32 ±  2%     +15.6       78.95 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter
     63.29 ±  2%     +15.6       78.93 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter_state
     65.95 ±  3%     +17.6       83.53 ± 10%  perf-profile.children.cycles-pp.start_secondary
     66.51 ±  3%     +18.1       84.59 ± 10%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     66.51 ±  3%     +18.1       84.59 ± 10%  perf-profile.children.cycles-pp.cpu_startup_entry
     66.51 ±  3%     +18.1       84.59 ± 10%  perf-profile.children.cycles-pp.do_idle
      5.00 ± 17%      -5.0        0.00        perf-profile.self.cycles-pp.smp_call_function_many_cond
      1.26 ± 11%      -0.9        0.35 ± 92%  perf-profile.self.cycles-pp.clear_page_erms
      0.81 ± 18%      -0.8        0.05 ± 72%  perf-profile.self.cycles-pp.__orc_find
      0.22 ±  3%      -0.2        0.04 ± 71%  perf-profile.self.cycles-pp.zap_pte_range
      0.22 ± 23%      -0.1        0.11 ± 72%  perf-profile.self.cycles-pp.__hrtimer_run_queues
      0.09 ± 15%      -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.do_user_addr_fault
      0.36 ±  2%      +0.3        0.64 ± 24%  perf-profile.self.cycles-pp._raw_spin_lock
      0.28 ± 18%      +0.4        0.69 ± 19%  perf-profile.self.cycles-pp.read_tsc
      0.34 ±  2%      +0.7        1.01 ± 43%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.37 ±  9%      +0.7        1.05 ± 44%  perf-profile.self.cycles-pp.update_process_times
      0.19 ± 50%      +1.2        1.43 ± 91%  perf-profile.self.cycles-pp.smp_call_function_single



***************************************************************************************************
lkp-csl-2ap4: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
  gcc-9/performance/1BRD_48G/4M/f2fs/1x/x86_64-rhel-8.3/64t/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap4/24G/fsmark/0x500320a

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     88507 ±  2%      -4.9%      84186        fsmark.app_overhead
    389.87            -9.9%     351.27        fsmark.files_per_sec
     60.58 ±  3%     +19.3%      72.26 ±  7%  fsmark.time.system_time
      1.19 ± 12%      -0.2        0.97 ±  2%  mpstat.cpu.all.irq%
   1131873 ±  2%      -7.0%    1052808        vmstat.io.bo
      5605           +14.7%       6432 ±  4%  meminfo.Active(anon)
    281974           +12.2%     316254        meminfo.SUnreclaim
     32.33 ±  5%     +47.4%      47.67 ±  3%  turbostat.Avg_MHz
      1852 ± 12%     +31.9%       2443 ±  2%  turbostat.Bzy_MHz
   2210427 ± 66%     +90.4%    4207690        turbostat.C1E
   1398445 ± 65%     -90.1%     138730 ± 38%  turbostat.C6
      6.92 ± 76%     -92.7%       0.51 ± 31%  turbostat.CPU%c6
      9.65 ±108%     -99.9%       0.01 ±141%  turbostat.Pkg%pc2
    106.24 ±  7%     +10.8%     117.67        turbostat.PkgWatt
   9155566           -65.2%    3186814 ±  4%  numa-numastat.node0.local_node
   9158181           -64.4%    3262229 ±  4%  numa-numastat.node0.numa_hit
      3.33 ±101%  +2.3e+06%      76644 ± 19%  numa-numastat.node0.other_node
   1457380 ±  5%    +119.1%    3192690 ±  6%  numa-numastat.node1.local_node
   1544426 ±  5%    +109.9%    3241511 ±  5%  numa-numastat.node1.numa_hit
     87046           -42.9%      49694 ± 53%  numa-numastat.node1.other_node
   1166175 ±  9%    +168.5%    3131073 ±  5%  numa-numastat.node2.local_node
   1253220 ±  9%    +156.0%    3207626 ±  5%  numa-numastat.node2.numa_hit
   1215097 ±  8%    +186.4%    3480151 ±  3%  numa-numastat.node3.local_node
   1301898 ±  7%    +171.8%    3537939 ±  3%  numa-numastat.node3.numa_hit
     87047           -33.4%      57973 ± 39%  numa-numastat.node3.other_node
      1401           +14.7%       1608 ±  4%  proc-vmstat.nr_active_anon
     31600            +3.6%      32724        proc-vmstat.nr_kernel_stack
      1434 ±  2%      -5.4%       1357 ±  2%  proc-vmstat.nr_page_table_pages
      6359            +3.2%       6563        proc-vmstat.nr_shmem
     49106            +3.0%      50574        proc-vmstat.nr_slab_reclaimable
     70492           +12.2%      79065        proc-vmstat.nr_slab_unreclaimable
      1401           +14.7%       1608 ±  4%  proc-vmstat.nr_zone_active_anon
      4624 ±133%     -98.6%      65.33 ±115%  proc-vmstat.numa_pages_migrated
      2629            +6.7%       2805 ±  2%  proc-vmstat.pgactivate
      4624 ±133%     -98.6%      65.33 ±115%  proc-vmstat.pgmigrate_success
     16244            +7.9%      17527 ±  6%  proc-vmstat.pgreuse
 2.599e+09            -2.1%  2.543e+09        perf-stat.i.branch-instructions
     40.08 ± 11%     +11.5       51.53        perf-stat.i.cache-miss-rate%
  83712718 ± 18%     -26.5%   61515419        perf-stat.i.cache-references
      3602            -1.9%       3534        perf-stat.i.context-switches
    270.60            -3.4%     261.51        perf-stat.i.cpu-migrations
      0.04 ± 62%      -0.0        0.01        perf-stat.i.dTLB-load-miss-rate%
   1127093 ± 63%     -82.7%     195421 ±  2%  perf-stat.i.dTLB-load-misses
 3.052e+09 ±  2%      -6.6%   2.85e+09 ±  2%  perf-stat.i.dTLB-loads
      0.01 ± 58%      -0.0        0.00        perf-stat.i.dTLB-store-miss-rate%
    163825 ± 58%     -72.0%      45947        perf-stat.i.dTLB-store-misses
 1.205e+09            -5.9%  1.134e+09        perf-stat.i.dTLB-stores
   2754325 ±  8%     +11.9%    3080812        perf-stat.i.iTLB-loads
 1.245e+10            -2.2%  1.217e+10        perf-stat.i.instructions
    529.53 ± 14%     -21.8%     414.06        perf-stat.i.metric.K/sec
     35.67            -4.8%      33.97        perf-stat.i.metric.M/sec
     12565 ±  4%      -6.1%      11793        perf-stat.i.minor-faults
     19.67 ± 11%     +13.4       33.04 ±  5%  perf-stat.i.node-load-miss-rate%
   1932373 ±  4%     +74.9%    3380337 ±  4%  perf-stat.i.node-load-misses
   9008481 ±  5%     -19.0%    7299190 ±  2%  perf-stat.i.node-loads
     23.58 ±  9%      +6.9       30.45 ±  9%  perf-stat.i.node-store-miss-rate%
    963702 ± 14%     +31.7%    1269384 ±  4%  perf-stat.i.node-store-misses
   3311559 ±  3%      -9.0%    3014187 ±  4%  perf-stat.i.node-stores
     12575 ±  4%      -6.1%      11803        perf-stat.i.page-faults
     39.24 ± 12%     +12.0       51.20        perf-stat.overall.cache-miss-rate%
      0.04 ± 62%      -0.0        0.01        perf-stat.overall.dTLB-load-miss-rate%
      0.01 ± 57%      -0.0        0.00        perf-stat.overall.dTLB-store-miss-rate%
     17.68 ±  6%     +13.9       31.63        perf-stat.overall.node-load-miss-rate%
     22.50 ± 12%      +7.1       29.65 ±  6%  perf-stat.overall.node-store-miss-rate%
 2.465e+09            -1.7%  2.424e+09        perf-stat.ps.branch-instructions
  79393861 ± 18%     -26.2%   58619062        perf-stat.ps.cache-references
    256.54            -2.9%     248.99        perf-stat.ps.cpu-migrations
   1068598 ± 63%     -82.6%     185709 ±  2%  perf-stat.ps.dTLB-load-misses
 2.895e+09 ±  2%      -6.1%  2.717e+09 ±  2%  perf-stat.ps.dTLB-loads
    155087 ± 58%     -71.9%      43504        perf-stat.ps.dTLB-store-misses
 1.144e+09            -5.5%  1.081e+09        perf-stat.ps.dTLB-stores
   2614299 ±  8%     +12.3%    2936796        perf-stat.ps.iTLB-loads
 1.181e+10            -1.8%   1.16e+10        perf-stat.ps.instructions
     11807 ±  3%      -5.6%      11141        perf-stat.ps.minor-faults
   1832971 ±  4%     +75.7%    3221390 ±  4%  perf-stat.ps.node-load-misses
   8554322 ±  5%     -18.6%    6960163 ±  2%  perf-stat.ps.node-loads
    914226 ± 14%     +32.3%    1209266 ±  5%  perf-stat.ps.node-store-misses
   3143274 ±  3%      -8.6%    2874173 ±  4%  perf-stat.ps.node-stores
     11817 ±  3%      -5.6%      11150        perf-stat.ps.page-faults
 2.361e+11 ±  3%      +6.4%  2.512e+11        perf-stat.total.instructions
     19132           -63.9%       6901 ± 12%  numa-meminfo.node0.Active
      2088 ±  3%     -68.7%     654.00 ± 22%  numa-meminfo.node0.Active(anon)
     17043           -63.3%       6246 ± 11%  numa-meminfo.node0.Active(file)
     68298           -75.8%      16532 ±141%  numa-meminfo.node0.AnonHugePages
    276292 ±  9%     -68.0%      88420 ±123%  numa-meminfo.node0.AnonPages
    307916 ±  5%     -68.9%      95617 ±123%  numa-meminfo.node0.AnonPages.max
    145189           -62.5%      54414 ±  7%  numa-meminfo.node0.Dirty
   9777470 ± 12%     -56.1%    4293645 ± 25%  numa-meminfo.node0.FilePages
   8269055           -66.6%    2758978 ±  5%  numa-meminfo.node0.Inactive
    285386 ± 12%     -67.0%      94262 ±117%  numa-meminfo.node0.Inactive(anon)
   7983669           -66.6%    2664715        numa-meminfo.node0.Inactive(file)
    126968 ± 14%     -43.1%      72212 ± 35%  numa-meminfo.node0.KReclaimable
     11018 ±  4%     -20.0%       8816 ±  9%  numa-meminfo.node0.KernelStack
  29011509 ±  4%     +41.2%   40974386 ±  2%  numa-meminfo.node0.MemFree
  20145006 ±  6%     -59.4%    8182129 ± 14%  numa-meminfo.node0.MemUsed
      5210 ±  4%     -77.1%       1191 ± 23%  numa-meminfo.node0.PageTables
    126968 ± 14%     -43.1%      72212 ± 35%  numa-meminfo.node0.SReclaimable
    113658 ±  9%     -18.0%      93208 ±  9%  numa-meminfo.node0.SUnreclaim
    240627 ±  8%     -31.3%     165421 ± 20%  numa-meminfo.node0.Slab
      1540 ± 25%     -67.1%     507.00 ± 20%  numa-meminfo.node0.Writeback
      2507 ±  7%    +152.3%       6327 ±  4%  numa-meminfo.node1.Active
      2411 ±  4%    +138.9%       5762 ±  2%  numa-meminfo.node1.Active(file)
      3150 ± 61%   +1841.7%      61170 ± 48%  numa-meminfo.node1.AnonPages
      3473 ± 57%   +1747.1%      64157 ± 45%  numa-meminfo.node1.AnonPages.max
     24014 ±  8%    +108.7%      50127 ±  3%  numa-meminfo.node1.Dirty
   1262798 ±  4%    +138.7%    3014286 ±  2%  numa-meminfo.node1.Inactive
      9488 ± 65%    +548.6%      61540 ± 48%  numa-meminfo.node1.Inactive(anon)
   1253310 ±  4%    +135.6%    2952745 ±  3%  numa-meminfo.node1.Inactive(file)
      6724 ±  3%     +26.6%       8509 ±  2%  numa-meminfo.node1.KernelStack
   4051006 ± 26%     +73.8%    7040111        numa-meminfo.node1.MemUsed
    138.33 ± 54%   +1289.6%       1922 ± 41%  numa-meminfo.node1.PageTables
      2109 ± 10%    +196.2%       6247 ± 13%  numa-meminfo.node2.Active
      2087 ± 10%    +169.5%       5625 ± 13%  numa-meminfo.node2.Active(file)
     18867 ±134%    +571.6%     126709 ± 68%  numa-meminfo.node2.AnonPages
     27004 ±135%    +410.3%     137813 ± 67%  numa-meminfo.node2.AnonPages.max
     19080 ±  8%    +178.5%      53131 ±  7%  numa-meminfo.node2.Dirty
   1073700 ± 11%    +157.4%    2763903 ±  2%  numa-meminfo.node2.FilePages
   1089976 ±  9%    +156.8%    2798747 ±  4%  numa-meminfo.node2.Inactive
     21869 ±133%    +507.8%     132924 ± 62%  numa-meminfo.node2.Inactive(anon)
   1068106 ± 11%    +149.6%    2665823 ±  2%  numa-meminfo.node2.Inactive(file)
     14479 ±  2%    +152.4%      36538 ± 26%  numa-meminfo.node2.KReclaimable
      1726 ±106%    +139.9%       4141 ± 58%  numa-meminfo.node2.Mapped
   2850224 ±  8%    +130.9%    6580642        numa-meminfo.node2.MemUsed
     67.33 ± 74%   +1243.1%     904.33 ±  9%  numa-meminfo.node2.PageTables
     14479 ±  2%    +152.4%      36538 ± 26%  numa-meminfo.node2.SReclaimable
     51831 ±  2%     +44.3%      74799 ± 18%  numa-meminfo.node2.SUnreclaim
      3038 ±123%    +130.9%       7016 ± 62%  numa-meminfo.node2.Shmem
     66311           +67.9%     111337 ± 20%  numa-meminfo.node2.Slab
    359.00 ±141%  +23589.4%      85045 ± 86%  numa-meminfo.node2.Unevictable
      5571 ±  2%     +92.9%      10745 ±  2%  numa-meminfo.node3.Active
      3401 ±  2%     +35.0%       4593 ±  4%  numa-meminfo.node3.Active(anon)
      2169 ±  2%    +183.5%       6152        numa-meminfo.node3.Active(file)
      2313 ±  4%    +961.4%      24557 ± 50%  numa-meminfo.node3.AnonPages
     10494 ± 17%    +271.4%      38973 ± 34%  numa-meminfo.node3.AnonPages.max
     20071 ± 10%    +168.8%      53950 ±  5%  numa-meminfo.node3.Dirty
   1111599 ±  4%    +253.5%    3929901 ± 27%  numa-meminfo.node3.FilePages
   1109455 ±  4%    +189.1%    3207390 ±  3%  numa-meminfo.node3.Inactive
      4665 ± 10%    +567.5%      31145 ± 56%  numa-meminfo.node3.Inactive(anon)
   1104789 ±  4%    +187.5%    3176244 ±  3%  numa-meminfo.node3.Inactive(file)
     17657          +207.4%      54286 ± 43%  numa-meminfo.node3.KReclaimable
      7059 ±  9%     +12.5%       7943 ±  6%  numa-meminfo.node3.KernelStack
  46560977           -11.3%   41306504 ±  2%  numa-meminfo.node3.MemFree
   2928314 ±  3%    +179.4%    8182782 ± 14%  numa-meminfo.node3.MemUsed
    318.33 ±  8%    +341.9%       1406 ± 37%  numa-meminfo.node3.PageTables
     17657          +207.4%      54286 ± 43%  numa-meminfo.node3.SReclaimable
     55405 ±  4%     +35.1%      74849 ±  9%  numa-meminfo.node3.SUnreclaim
      4507 ± 10%    +152.5%      11382 ± 69%  numa-meminfo.node3.Shmem
     73062 ±  3%     +76.7%     129136 ± 23%  numa-meminfo.node3.Slab
     87.67 ±109%    +831.6%     816.67 ± 62%  numa-meminfo.node3.Writeback
    521.67 ±  3%     -68.8%     163.00 ± 22%  numa-vmstat.node0.nr_active_anon
      4270 ±  2%     -63.5%       1558 ± 11%  numa-vmstat.node0.nr_active_file
     69116 ± 10%     -68.0%      22118 ±123%  numa-vmstat.node0.nr_anon_pages
   2361412           -66.6%     789675        numa-vmstat.node0.nr_dirtied
     36058 ±  2%     -62.7%      13445 ±  8%  numa-vmstat.node0.nr_dirty
   2441191 ± 12%     -56.1%    1072902 ± 25%  numa-vmstat.node0.nr_file_pages
   7244956 ±  4%     +41.3%   10240234 ±  2%  numa-vmstat.node0.nr_free_pages
     71387 ± 12%     -67.0%      23577 ±117%  numa-vmstat.node0.nr_inactive_anon
   1992723           -66.6%     665671        numa-vmstat.node0.nr_inactive_file
     10994 ±  4%     -19.9%       8809 ±  9%  numa-vmstat.node0.nr_kernel_stack
      1283 ±  5%     -76.9%     296.33 ± 22%  numa-vmstat.node0.nr_page_table_pages
     31799 ± 14%     -43.2%      18054 ± 35%  numa-vmstat.node0.nr_slab_reclaimable
     28408 ±  9%     -18.0%      23301 ±  9%  numa-vmstat.node0.nr_slab_unreclaimable
    405.67 ±  5%     -71.5%     115.67 ± 19%  numa-vmstat.node0.nr_writeback
   2324918           -66.6%     776126        numa-vmstat.node0.nr_written
    521.67 ±  3%     -68.8%     163.00 ± 22%  numa-vmstat.node0.nr_zone_active_anon
      4270 ±  2%     -63.5%       1558 ± 11%  numa-vmstat.node0.nr_zone_active_file
     71385 ± 12%     -67.0%      23576 ±117%  numa-vmstat.node0.nr_zone_inactive_anon
   1992709           -66.6%     665647        numa-vmstat.node0.nr_zone_inactive_file
     36410 ±  2%     -62.8%      13546 ±  7%  numa-vmstat.node0.nr_zone_write_pending
   6403385 ±  4%     -58.3%    2673098 ± 12%  numa-vmstat.node0.numa_hit
   6399174 ±  4%     -59.4%    2596121 ± 13%  numa-vmstat.node0.numa_local
      3604 ± 57%   +2061.9%      77913 ± 17%  numa-vmstat.node0.numa_other
     23.33 ± 96%    +502.9%     140.67 ± 37%  numa-vmstat.node1.nr_active_anon
    605.00 ±  4%    +138.3%       1442 ±  2%  numa-vmstat.node1.nr_active_file
    784.33 ± 61%   +1852.8%      15316 ± 47%  numa-vmstat.node1.nr_anon_pages
    367180 ±  4%    +130.4%     845833 ±  3%  numa-vmstat.node1.nr_dirtied
      5937 ±  8%    +109.3%      12426 ±  3%  numa-vmstat.node1.nr_dirty
      2370 ± 65%    +550.2%      15410 ± 47%  numa-vmstat.node1.nr_inactive_anon
    312758 ±  4%    +135.6%     736785 ±  3%  numa-vmstat.node1.nr_inactive_file
      6721 ±  3%     +26.5%       8499        numa-vmstat.node1.nr_kernel_stack
     32.67 ± 58%   +1356.1%     475.67 ± 42%  numa-vmstat.node1.nr_page_table_pages
    361167 ±  4%    +130.7%     833225 ±  3%  numa-vmstat.node1.nr_written
     23.33 ± 96%    +501.4%     140.33 ± 37%  numa-vmstat.node1.nr_zone_active_anon
    605.00 ±  4%    +138.3%       1441 ±  2%  numa-vmstat.node1.nr_zone_active_file
      2370 ± 65%    +550.2%      15410 ± 47%  numa-vmstat.node1.nr_zone_inactive_anon
    312746 ±  4%    +135.6%     736794 ±  3%  numa-vmstat.node1.nr_zone_inactive_file
      5985 ±  8%    +110.0%      12567 ±  2%  numa-vmstat.node1.nr_zone_write_pending
   1348209 ± 20%     +69.1%    2279324 ±  3%  numa-vmstat.node1.numa_hit
   1241961 ± 21%     +77.6%    2206168 ±  3%  numa-vmstat.node1.numa_local
      5.33 ± 35%   +2812.5%     155.33 ± 22%  numa-vmstat.node2.nr_active_anon
    520.67 ± 11%    +172.2%       1417 ± 14%  numa-vmstat.node2.nr_active_file
      4719 ±134%    +571.5%      31688 ± 68%  numa-vmstat.node2.nr_anon_pages
    311740 ± 12%    +150.5%     780761        numa-vmstat.node2.nr_dirtied
      4746 ±  8%    +177.3%      13163 ±  8%  numa-vmstat.node2.nr_dirty
    268033 ± 11%    +157.6%     690490        numa-vmstat.node2.nr_file_pages
      5468 ±133%    +507.9%      33242 ± 62%  numa-vmstat.node2.nr_inactive_anon
    266633 ± 11%    +149.8%     665970 ±  2%  numa-vmstat.node2.nr_inactive_file
    431.33 ±106%    +147.4%       1067 ± 52%  numa-vmstat.node2.nr_mapped
     16.67 ± 73%   +1238.0%     223.00 ±  9%  numa-vmstat.node2.nr_page_table_pages
    759.67 ±123%    +130.8%       1753 ± 62%  numa-vmstat.node2.nr_shmem
      3630 ±  2%    +152.6%       9169 ± 26%  numa-vmstat.node2.nr_slab_reclaimable
     12957 ±  2%     +44.3%      18698 ± 18%  numa-vmstat.node2.nr_slab_unreclaimable
     89.33 ±141%  +23699.6%      21261 ± 86%  numa-vmstat.node2.nr_unevictable
    306939 ± 12%    +150.0%     767458        numa-vmstat.node2.nr_written
      5.33 ± 35%   +2812.5%     155.33 ± 22%  numa-vmstat.node2.nr_zone_active_anon
    520.67 ± 11%    +172.2%       1417 ± 14%  numa-vmstat.node2.nr_zone_active_file
      5468 ±133%    +507.9%      33242 ± 62%  numa-vmstat.node2.nr_zone_inactive_anon
    266639 ± 11%    +149.8%     665976 ±  2%  numa-vmstat.node2.nr_zone_inactive_file
     89.33 ±141%  +23699.6%      21261 ± 86%  numa-vmstat.node2.nr_zone_unevictable
      4803 ±  8%    +176.8%      13297 ±  8%  numa-vmstat.node2.nr_zone_write_pending
    990757 ±  5%    +121.4%    2193355 ±  5%  numa-vmstat.node2.numa_hit
    881411 ±  6%    +137.7%    2094791 ±  5%  numa-vmstat.node2.numa_local
    850.00 ±  2%     +35.1%       1148 ±  4%  numa-vmstat.node3.nr_active_anon
    548.00 ±  3%    +182.2%       1546        numa-vmstat.node3.nr_active_file
    638.67 ±  3%    +873.8%       6219 ± 49%  numa-vmstat.node3.nr_anon_pages
    322944 ±  4%    +181.9%     910237 ±  3%  numa-vmstat.node3.nr_dirtied
      4951 ± 11%    +171.7%      13451 ±  5%  numa-vmstat.node3.nr_dirty
    277018 ±  4%    +253.8%     980150 ± 27%  numa-vmstat.node3.nr_file_pages
  11639803           -11.3%   10325268 ±  2%  numa-vmstat.node3.nr_free_pages
      1222 ± 12%    +543.0%       7862 ± 56%  numa-vmstat.node3.nr_inactive_anon
    275308 ±  4%    +187.6%     791735 ±  3%  numa-vmstat.node3.nr_inactive_file
      7059 ±  9%     +12.5%       7944 ±  6%  numa-vmstat.node3.nr_kernel_stack
     79.00 ±  8%    +341.4%     348.67 ± 36%  numa-vmstat.node3.nr_page_table_pages
      1126 ± 10%    +152.7%       2847 ± 69%  numa-vmstat.node3.nr_shmem
      4431          +206.9%      13601 ± 43%  numa-vmstat.node3.nr_slab_reclaimable
     13850 ±  4%     +35.1%      18717 ±  9%  numa-vmstat.node3.nr_slab_unreclaimable
     41.33 ±122%    +373.4%     195.67 ± 44%  numa-vmstat.node3.nr_writeback
    317952 ±  3%    +182.0%     896576 ±  3%  numa-vmstat.node3.nr_written
    850.00 ±  2%     +35.1%       1148 ±  4%  numa-vmstat.node3.nr_zone_active_anon
    548.00 ±  3%    +182.2%       1546        numa-vmstat.node3.nr_zone_active_file
      1222 ± 12%    +543.0%       7862 ± 56%  numa-vmstat.node3.nr_zone_inactive_anon
    275306 ±  4%    +187.6%     791737 ±  3%  numa-vmstat.node3.nr_zone_inactive_file
      4987 ± 11%    +173.4%      13634 ±  5%  numa-vmstat.node3.nr_zone_write_pending
   1015839 ±  3%    +151.1%    2551060 ± 10%  numa-vmstat.node3.numa_hit
    907100 ±  3%    +172.4%    2471388 ± 11%  numa-vmstat.node3.numa_local
      7.36 ±  3%      -1.7        5.70 ± 16%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
      7.36 ±  3%      -1.7        5.70 ± 16%  perf-profile.calltrace.cycles-pp.__submit_merged_bio.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      7.35 ±  3%      -1.7        5.70 ± 16%  perf-profile.calltrace.cycles-pp.submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
      7.35 ±  3%      -1.7        5.70 ± 16%  perf-profile.calltrace.cycles-pp.__submit_bio.submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond.f2fs_write_cache_pages
      6.60 ±  3%      -1.5        5.09 ± 17%  perf-profile.calltrace.cycles-pp.brd_submit_bio.__submit_bio.submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond
      6.58 ±  3%      -1.5        5.08 ± 17%  perf-profile.calltrace.cycles-pp.brd_do_bvec.brd_submit_bio.__submit_bio.submit_bio_noacct.__submit_merged_bio
      4.39 ±  3%      -1.0        3.38 ± 18%  perf-profile.calltrace.cycles-pp.brd_insert_page.brd_do_bvec.brd_submit_bio.__submit_bio.submit_bio_noacct
      3.18 ±  3%      -0.7        2.45 ± 19%  perf-profile.calltrace.cycles-pp._raw_spin_lock.brd_insert_page.brd_do_bvec.brd_submit_bio.__submit_bio
      1.76 ±  5%      -0.3        1.42 ± 17%  perf-profile.calltrace.cycles-pp.__filemap_get_folio.pagecache_get_page.f2fs_write_begin.generic_perform_write.f2fs_buffered_write_iter
      1.78 ±  4%      -0.3        1.45 ± 17%  perf-profile.calltrace.cycles-pp.pagecache_get_page.f2fs_write_begin.generic_perform_write.f2fs_buffered_write_iter.f2fs_file_write_iter
      0.73 ±  7%      -0.3        0.41 ± 72%  perf-profile.calltrace.cycles-pp.__filemap_add_folio.filemap_add_folio.__filemap_get_folio.pagecache_get_page.f2fs_write_begin
      1.11 ±  6%      -0.2        0.87 ± 19%  perf-profile.calltrace.cycles-pp.filemap_add_folio.__filemap_get_folio.pagecache_get_page.f2fs_write_begin.generic_perform_write
      0.75 ±  3%      -0.1        0.60 ± 13%  perf-profile.calltrace.cycles-pp.f2fs_write_end_io.__submit_bio.submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond
      0.69 ± 20%      +0.1        0.82 ± 16%  perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.17 ±141%      +0.4        0.62 ± 22%  perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write
      7.38 ±  3%      -1.7        5.71 ± 16%  perf-profile.children.cycles-pp.submit_bio_noacct
      7.38 ±  3%      -1.7        5.71 ± 16%  perf-profile.children.cycles-pp.__submit_bio
      7.38 ±  3%      -1.7        5.72 ± 16%  perf-profile.children.cycles-pp.__submit_merged_bio
      7.38 ±  3%      -1.7        5.72 ± 16%  perf-profile.children.cycles-pp.__submit_merged_write_cond
      6.61 ±  3%      -1.5        5.11 ± 17%  perf-profile.children.cycles-pp.brd_submit_bio
      6.59 ±  3%      -1.5        5.09 ± 17%  perf-profile.children.cycles-pp.brd_do_bvec
      4.42 ±  3%      -1.0        3.42 ± 17%  perf-profile.children.cycles-pp.brd_insert_page
      0.88 ± 95%      -0.7        0.15 ± 16%  perf-profile.children.cycles-pp.start_kernel
      2.27 ±  5%      -0.4        1.83 ± 15%  perf-profile.children.cycles-pp.pagecache_get_page
      2.21 ±  4%      -0.4        1.79 ± 15%  perf-profile.children.cycles-pp.__filemap_get_folio
      1.12 ±  6%      -0.2        0.88 ± 19%  perf-profile.children.cycles-pp.filemap_add_folio
      0.74 ±  7%      -0.2        0.58 ± 16%  perf-profile.children.cycles-pp.__filemap_add_folio
      0.76 ±  3%      -0.1        0.61 ± 13%  perf-profile.children.cycles-pp.f2fs_write_end_io
      0.58 ±  4%      -0.1        0.45 ± 13%  perf-profile.children.cycles-pp.folio_end_writeback
      0.50 ±  5%      -0.1        0.39 ± 14%  perf-profile.children.cycles-pp.__folio_end_writeback
      0.30 ±  8%      -0.1        0.19 ± 21%  perf-profile.children.cycles-pp.update_rq_clock
      0.39 ± 18%      -0.1        0.30 ± 27%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.39 ± 17%      -0.1        0.30 ± 27%  perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
      0.11 ± 11%      -0.1        0.05 ± 78%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.23 ±  4%      -0.1        0.16 ± 10%  perf-profile.children.cycles-pp.__radix_tree_preload
      0.11 ±  7%      -0.1        0.05 ± 78%  perf-profile.children.cycles-pp.update_ts_time_stats
      0.18 ±  6%      -0.1        0.13 ±  9%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.18 ± 17%      -0.1        0.13 ±  7%  perf-profile.children.cycles-pp.mutex_lock
      0.22 ± 21%      -0.1        0.17 ±  7%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.12 ± 22%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.09 ± 10%      -0.0        0.04 ± 73%  perf-profile.children.cycles-pp.__xa_set_mark
      0.25 ±  9%      -0.0        0.20 ± 12%  perf-profile.children.cycles-pp.__mem_cgroup_charge
      0.10 ± 21%      -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.timerqueue_add
      0.16 ±  7%      -0.0        0.13 ± 16%  perf-profile.children.cycles-pp.fault_in_iov_iter_readable
      0.15 ± 14%      -0.0        0.11 ± 11%  perf-profile.children.cycles-pp.brd_lookup_page
      0.10 ± 21%      -0.0        0.07 ± 14%  perf-profile.children.cycles-pp.cpuidle_governor_latency_req
      0.14 ±  6%      -0.0        0.11 ± 18%  perf-profile.children.cycles-pp.fault_in_readable
      0.13 ± 15%      -0.0        0.10 ± 12%  perf-profile.children.cycles-pp.__cond_resched
      0.11 ±  7%      -0.0        0.08 ± 17%  perf-profile.children.cycles-pp.xas_store
      0.12 ± 10%      -0.0        0.09        perf-profile.children.cycles-pp.__might_sleep
      0.10 ±  4%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.alloc_pages
      0.09 ±  5%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.08 ±  6%      -0.0        0.06 ± 13%  perf-profile.children.cycles-pp.try_charge_memcg
      0.06 ±  8%      +0.0        0.09 ± 10%  perf-profile.children.cycles-pp.f2fs_update_iostat
      0.08 ± 11%      +0.0        0.11 ± 16%  perf-profile.children.cycles-pp.f2fs_inode_chksum_verify
      0.12 ± 10%      +0.0        0.16 ± 13%  perf-profile.children.cycles-pp.update_sit_entry
      0.10 ±  8%      +0.0        0.14 ± 10%  perf-profile.children.cycles-pp.__get_segment_type
      0.02 ±141%      +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.f2fs_target_device
      0.41 ± 14%      +0.1        0.48 ± 12%  perf-profile.children.cycles-pp.folio_clear_dirty_for_io
      0.22 ± 11%      +0.1        0.33 ± 13%  perf-profile.children.cycles-pp.__mark_inode_dirty
      0.40 ±  9%      +0.1        0.51 ± 21%  perf-profile.children.cycles-pp.io_serial_in
      0.29 ±  8%      +0.1        0.43 ± 14%  perf-profile.children.cycles-pp.f2fs_balance_fs
      0.37 ± 24%      +0.2        0.56 ±  9%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      2.01 ±  5%      -0.5        1.55 ± 15%  perf-profile.self.cycles-pp.brd_do_bvec
      1.42 ±  8%      -0.3        1.07 ± 16%  perf-profile.self.cycles-pp.f2fs_write_end
      0.12 ± 16%      -0.1        0.05 ± 78%  perf-profile.self.cycles-pp.update_rq_clock
      0.11 ±  8%      -0.1        0.05 ± 78%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.22 ±  4%      -0.1        0.16 ± 10%  perf-profile.self.cycles-pp.__radix_tree_preload
      0.18 ±  7%      -0.0        0.13 ±  9%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.10 ± 25%      -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.rebalance_domains
      0.12 ±  3%      -0.0        0.08 ± 17%  perf-profile.self.cycles-pp.__filemap_add_folio
      0.14 ±  8%      -0.0        0.10 ± 19%  perf-profile.self.cycles-pp.rmqueue
      0.21 ±  7%      -0.0        0.18 ±  9%  perf-profile.self.cycles-pp.__filemap_get_folio
      0.16 ±  3%      -0.0        0.12 ± 15%  perf-profile.self.cycles-pp.__mod_lruvec_page_state
      0.14 ±  6%      -0.0        0.11 ± 18%  perf-profile.self.cycles-pp.fault_in_readable
      0.09 ±  5%      -0.0        0.06 ± 23%  perf-profile.self.cycles-pp.get_page_from_freelist
      0.11 ±  8%      -0.0        0.08        perf-profile.self.cycles-pp.__might_sleep
      0.08 ±  5%      -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.mutex_lock
      0.08 ±  6%      -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.08 ±  5%      -0.0        0.06 ± 14%  perf-profile.self.cycles-pp.folio_end_writeback
      0.17 ±  4%      +0.0        0.19 ±  6%  perf-profile.self.cycles-pp.f2fs_map_blocks
      0.08 ± 10%      +0.0        0.11 ±  7%  perf-profile.self.cycles-pp.__folio_mark_dirty
      0.06 ±  8%      +0.0        0.09 ± 10%  perf-profile.self.cycles-pp.f2fs_update_iostat
      0.12 ± 10%      +0.0        0.16 ± 13%  perf-profile.self.cycles-pp.update_sit_entry
      0.10 ±  8%      +0.0        0.14 ± 10%  perf-profile.self.cycles-pp.__get_segment_type
      0.02 ±141%      +0.0        0.06 ± 19%  perf-profile.self.cycles-pp.f2fs_inode_chksum_verify
      0.00            +0.1        0.06 ± 19%  perf-profile.self.cycles-pp.f2fs_target_device
      0.11 ±  7%      +0.1        0.18 ± 21%  perf-profile.self.cycles-pp.__get_node_page
      0.12 ± 17%      +0.1        0.18 ± 17%  perf-profile.self.cycles-pp.f2fs_write_begin
      0.17 ± 19%      +0.1        0.27 ± 13%  perf-profile.self.cycles-pp.__mark_inode_dirty
      0.29 ±  8%      +0.1        0.43 ± 14%  perf-profile.self.cycles-pp.f2fs_balance_fs
      0.34 ± 28%      +0.2        0.54 ± 10%  perf-profile.self.cycles-pp.percpu_counter_add_batch



***************************************************************************************************
lkp-csl-2ap4: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
  gcc-9/performance/1BRD_48G/4M/ext4/1x/x86_64-rhel-8.3/64t/debian-10.4-x86_64-20200603.cgz/NoSync/lkp-csl-2ap4/24G/fsmark/0x500320a

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    122957 ±  7%     -41.3%      72222        fsmark.app_overhead
      2440 ±  2%     -26.2%       1801 ±  4%  fsmark.files_per_sec
    869.83           +25.5%       1091 ±  4%  fsmark.time.percent_of_cpu_this_job_got
    169.06 ±  2%     +29.9%     219.63 ±  4%  fsmark.time.system_time
      5.73 ±  4%     +12.9%       6.46 ±  5%  iostat.cpu.system
   1120075            -7.5%    1036423 ±  9%  vmstat.io.bo
    364503 ±  7%      +5.7%     385342        vmstat.system.in
     10457 ±  6%     +52.1%      15903 ±  9%  meminfo.Active
      6997 ±  9%     +81.0%      12666 ± 13%  meminfo.Active(anon)
     28931 ±  3%     +28.8%      37262 ±  4%  meminfo.Shmem
    844341 ± 13%    +342.6%    3737198 ± 74%  numa-numastat.node2.local_node
    911032 ± 12%    +317.3%    3801896 ± 73%  numa-numastat.node2.numa_hit
    379577 ±146%     -81.7%      69374 ± 27%  numa-numastat.node2.other_node
    849951 ± 20%    +237.0%    2864139 ± 80%  numa-numastat.node3.local_node
    927632 ± 18%    +215.0%    2922048 ± 79%  numa-numastat.node3.numa_hit
 2.262e+09            -3.7%  2.178e+09 ±  4%  perf-stat.i.branch-instructions
  50059502 ±  2%      +9.9%   55031386 ±  5%  perf-stat.i.cache-misses
    267.03            -2.2%     261.23 ±  2%  perf-stat.i.cpu-migrations
 1.206e+09            -4.6%   1.15e+09 ±  5%  perf-stat.i.dTLB-stores
 1.119e+10            -3.6%  1.079e+10 ±  4%  perf-stat.i.instructions
      9.90 ±  5%     -13.4%       8.58 ±  8%  perf-stat.i.major-faults
     68.64 ±  2%     +12.8       81.46        perf-stat.i.node-load-miss-rate%
  12916037 ±  3%     +15.1%   14866227 ±  6%  perf-stat.i.node-load-misses
   5586107 ±  6%     -40.0%    3349633 ±  8%  perf-stat.i.node-loads
      3.50 ±  3%     +14.4%       4.00 ±  3%  perf-stat.overall.cpi
      3328 ±  3%     -10.9%       2966 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.29 ±  3%     -12.5%       0.25 ±  3%  perf-stat.overall.ipc
     69.90 ±  2%     +11.8       81.72        perf-stat.overall.node-load-miss-rate%
  48090872 ±  2%     +11.2%   53476431 ±  4%  perf-stat.ps.cache-misses
 3.747e+10 ±  2%     +10.9%  4.157e+10 ±  5%  perf-stat.ps.cpu-cycles
  12291100 ±  3%     +15.9%   14246666 ±  5%  perf-stat.ps.node-load-misses
   5292116 ±  6%     -39.7%    3191213 ±  8%  perf-stat.ps.node-loads
      1733 ±  8%     +82.8%       3167 ± 13%  proc-vmstat.nr_active_anon
   2334357            -8.8%    2128372 ±  9%  proc-vmstat.nr_dirty
   5347564            -5.9%    5029652 ±  8%  proc-vmstat.nr_file_pages
     79430            +1.0%      80254        proc-vmstat.nr_inactive_anon
   4713828            -6.8%    4395202 ±  9%  proc-vmstat.nr_inactive_file
     31588            +1.6%      32107        proc-vmstat.nr_kernel_stack
     10415            +6.3%      11069        proc-vmstat.nr_mapped
      7220 ±  3%     +29.1%       9318 ±  4%  proc-vmstat.nr_shmem
     87414            +4.2%      91099 ±  2%  proc-vmstat.nr_slab_unreclaimable
      1733 ±  8%     +82.8%       3167 ± 13%  proc-vmstat.nr_zone_active_anon
     79430            +1.0%      80254        proc-vmstat.nr_zone_inactive_anon
   4713828            -6.8%    4395202 ±  9%  proc-vmstat.nr_zone_inactive_file
   2334942            -8.8%    2128919 ±  9%  proc-vmstat.nr_zone_write_pending
   1465471 ±  8%    -100.0%       0.00        proc-vmstat.numa_foreign
  12106397           +11.9%   13543781        proc-vmstat.numa_hit
  11937052           +11.3%   13287929        proc-vmstat.numa_local
   1459228 ±  8%    -100.0%       0.00        proc-vmstat.numa_miss
   1716007 ±  6%     -84.8%     260872        proc-vmstat.numa_other
      2675 ± 14%    +116.9%       5802 ±  9%  proc-vmstat.pgactivate
     50209 ± 31%     -63.8%      18155 ± 74%  numa-meminfo.node0.AnonHugePages
   8252135 ± 17%     -37.3%    5174756 ± 24%  numa-meminfo.node0.FilePages
   7185000 ±  5%     -31.1%    4948415 ± 19%  numa-meminfo.node1.FilePages
   7146622 ±  3%     -36.6%    4533737 ±  9%  numa-meminfo.node1.Inactive
   7091176 ±  4%     -36.9%    4476760 ±  9%  numa-meminfo.node1.Inactive(file)
    307.00 ± 41%    +333.4%       1330 ± 48%  numa-meminfo.node2.Active
    219.50 ± 12%    +280.4%     835.00 ± 71%  numa-meminfo.node2.Active(file)
      3261 ±198%   +1417.1%      49473 ±155%  numa-meminfo.node2.AnonPages
      6083 ±188%    +855.5%      58123 ±132%  numa-meminfo.node2.AnonPages.max
   1477008 ± 24%     +43.5%    2118995 ±  8%  numa-meminfo.node2.Dirty
      3557 ±178%   +1420.0%      54067 ±145%  numa-meminfo.node2.Inactive(anon)
     75574 ±  8%     +98.3%     149829 ±  6%  numa-meminfo.node2.KReclaimable
    551.67 ±  5%    +733.2%       4596 ± 45%  numa-meminfo.node2.Mapped
     85.33 ±128%    +852.9%     813.17 ± 22%  numa-meminfo.node2.PageTables
     75574 ±  8%     +98.3%     149829 ±  6%  numa-meminfo.node2.SReclaimable
     61158 ±  4%     +28.9%      78837 ±  5%  numa-meminfo.node2.SUnreclaim
    432.17 ± 66%   +1046.9%       4956 ± 80%  numa-meminfo.node2.Shmem
    136733 ±  5%     +67.2%     228667 ±  4%  numa-meminfo.node2.Slab
     41.67 ±164%  +1.6e+05%      66511 ±113%  numa-meminfo.node2.Unevictable
      5151 ± 13%    +127.5%      11719 ± 14%  numa-meminfo.node3.Active
      4938 ± 14%    +122.3%      10980 ± 15%  numa-meminfo.node3.Active(anon)
    211.67 ±  9%    +248.5%     737.67 ± 92%  numa-meminfo.node3.Active(file)
   1303369 ± 20%     +64.1%    2138250 ± 10%  numa-meminfo.node3.Dirty
   2739749 ± 37%    +103.7%    5579919 ± 16%  numa-meminfo.node3.FilePages
   2390623 ± 14%     +87.9%    4492696 ± 10%  numa-meminfo.node3.Inactive
   2310089 ± 16%     +91.5%    4424939 ± 10%  numa-meminfo.node3.Inactive(file)
     88743 ± 31%     +92.3%     170619 ±  8%  numa-meminfo.node3.KReclaimable
   3580239 ± 30%    +149.2%    8920534 ± 49%  numa-meminfo.node3.MemUsed
    567.83 ± 36%     +85.3%       1052 ± 35%  numa-meminfo.node3.PageTables
     88743 ± 31%     +92.3%     170619 ±  8%  numa-meminfo.node3.SReclaimable
    162480 ± 22%     +56.0%     253448 ±  4%  numa-meminfo.node3.Slab
   2080535 ± 18%     -37.8%    1293625 ± 23%  numa-vmstat.node0.nr_file_pages
     27818 ± 91%    +165.0%      73718 ± 28%  numa-vmstat.node0.numa_other
   1985397 ±  6%     -29.4%    1402170 ±  4%  numa-vmstat.node1.nr_dirtied
   1815794 ±  5%     -31.9%    1237101 ± 18%  numa-vmstat.node1.nr_file_pages
   1792343 ±  5%     -37.6%    1119190 ±  8%  numa-vmstat.node1.nr_inactive_file
   1282190 ±  9%     -32.4%     866377 ±  9%  numa-vmstat.node1.nr_written
   1792321 ±  5%     -37.6%    1119187 ±  8%  numa-vmstat.node1.nr_zone_inactive_file
     21.33 ±153%    +478.1%     123.33 ± 31%  numa-vmstat.node2.nr_active_anon
     55.17 ± 12%    +282.5%     211.00 ± 71%  numa-vmstat.node2.nr_active_file
    371312 ± 22%     +42.7%     529941 ±  7%  numa-vmstat.node2.nr_dirty
    920.17 ±180%   +1372.5%      13549 ±145%  numa-vmstat.node2.nr_inactive_anon
    140.67 ±  6%    +718.2%       1151 ± 45%  numa-vmstat.node2.nr_mapped
     21.33 ±131%    +843.8%     201.33 ± 22%  numa-vmstat.node2.nr_page_table_pages
    107.67 ± 67%   +1050.5%       1238 ± 80%  numa-vmstat.node2.nr_shmem
     19029 ±  7%     +96.8%      37452 ±  6%  numa-vmstat.node2.nr_slab_reclaimable
     15301 ±  4%     +28.9%      19720 ±  5%  numa-vmstat.node2.nr_slab_unreclaimable
     21.33 ±153%    +478.1%     123.33 ± 31%  numa-vmstat.node2.nr_zone_active_anon
     55.17 ± 12%    +282.5%     211.00 ± 71%  numa-vmstat.node2.nr_zone_active_file
    920.17 ±180%   +1372.5%      13549 ±145%  numa-vmstat.node2.nr_zone_inactive_anon
    371434 ± 22%     +42.7%     530074 ±  7%  numa-vmstat.node2.nr_zone_write_pending
   1090475 ±  9%    +179.5%    3048218 ± 49%  numa-vmstat.node2.numa_hit
    999961 ±  9%    +195.7%    2957320 ± 51%  numa-vmstat.node2.numa_local
    343707 ±130%     -72.9%      93030 ± 19%  numa-vmstat.node2.numa_other
      1205 ± 14%    +126.5%       2730 ± 14%  numa-vmstat.node3.nr_active_anon
     53.00 ±  9%    +245.3%     183.00 ± 93%  numa-vmstat.node3.nr_active_file
    672301 ± 15%    +104.4%    1374415 ±  4%  numa-vmstat.node3.nr_dirtied
    328259 ± 19%     +62.8%     534500 ±  9%  numa-vmstat.node3.nr_dirty
    689847 ± 36%    +102.3%    1395219 ± 16%  numa-vmstat.node3.nr_file_pages
    582451 ± 14%     +90.0%    1106487 ±  9%  numa-vmstat.node3.nr_inactive_file
    142.33 ± 37%     +84.1%     262.00 ± 35%  numa-vmstat.node3.nr_page_table_pages
     22316 ± 31%     +91.2%      42672 ±  7%  numa-vmstat.node3.nr_slab_reclaimable
    343968 ± 12%    +144.1%     839703 ± 10%  numa-vmstat.node3.nr_written
      1205 ± 14%    +126.5%       2730 ± 14%  numa-vmstat.node3.nr_zone_active_anon
     53.00 ±  9%    +245.3%     183.00 ± 93%  numa-vmstat.node3.nr_zone_active_file
    582443 ± 14%     +90.0%    1106485 ±  9%  numa-vmstat.node3.nr_zone_inactive_file
    328324 ± 19%     +62.9%     534716 ±  9%  numa-vmstat.node3.nr_zone_write_pending
   1341212 ± 22%    +110.8%    2827390 ± 37%  numa-vmstat.node3.numa_hit
   1242142 ± 24%    +121.1%    2746075 ± 38%  numa-vmstat.node3.numa_local
     12.09 ± 15%      -6.6        5.54 ±  7%  perf-profile.calltrace.cycles-pp.ret_from_fork
     12.09 ± 15%      -6.6        5.54 ±  7%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
     11.97 ± 15%      -6.5        5.48 ±  7%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
     11.96 ± 15%      -6.5        5.48 ±  7%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
     11.61 ± 15%      -6.2        5.41 ±  8%  perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork
     11.61 ± 15%      -6.2        5.41 ±  8%  perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread
     10.88 ± 15%      -6.0        4.92 ±  9%  perf-profile.calltrace.cycles-pp.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work.worker_thread
     10.87 ± 15%      -6.0        4.92 ±  9%  perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work
     10.87 ± 15%      -5.9        4.92 ±  9%  perf-profile.calltrace.cycles-pp.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback
     10.87 ± 15%      -5.9        4.92 ±  9%  perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn
      5.95 ± 27%      -4.9        1.09 ± 11%  perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
      5.73 ± 28%      -4.7        1.06 ± 11%  perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      5.66 ± 27%      -4.6        1.05 ± 10%  perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter
      8.20 ± 17%      -4.6        3.62 ±  9%  perf-profile.calltrace.cycles-pp.submit_bio_noacct.ext4_io_submit.ext4_writepages.do_writepages.__writeback_single_inode
      8.20 ± 17%      -4.6        3.62 ±  9%  perf-profile.calltrace.cycles-pp.__submit_bio.submit_bio_noacct.ext4_io_submit.ext4_writepages.do_writepages
      8.20 ± 17%      -4.6        3.62 ±  9%  perf-profile.calltrace.cycles-pp.ext4_io_submit.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
      8.19 ± 17%      -4.6        3.62 ±  9%  perf-profile.calltrace.cycles-pp.brd_submit_bio.__submit_bio.submit_bio_noacct.ext4_io_submit.ext4_writepages
      8.17 ± 17%      -4.6        3.61 ±  9%  perf-profile.calltrace.cycles-pp.brd_do_bvec.brd_submit_bio.__submit_bio.submit_bio_noacct.ext4_io_submit
      8.07 ± 12%      -4.5        3.55 ± 13%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      5.53 ± 11%      -3.5        2.00 ± 32%  perf-profile.calltrace.cycles-pp.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
      6.69 ± 13%      -3.5        3.17 ± 13%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      4.29 ± 15%      -2.4        1.93 ±  9%  perf-profile.calltrace.cycles-pp.brd_insert_page.brd_do_bvec.brd_submit_bio.__submit_bio.submit_bio_noacct
      4.31 ± 13%      -2.3        2.02 ± 16%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      4.23 ± 13%      -2.3        1.98 ± 16%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      3.20 ± 13%      -2.2        1.02 ± 10%  perf-profile.calltrace.cycles-pp.pagecache_get_page.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      3.19 ± 13%      -2.2        1.01 ± 11%  perf-profile.calltrace.cycles-pp.__filemap_get_folio.pagecache_get_page.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      3.08 ± 16%      -1.7        1.36 ± 11%  perf-profile.calltrace.cycles-pp._raw_spin_lock.brd_insert_page.brd_do_bvec.brd_submit_bio.__submit_bio
      2.84 ± 25%      -1.7        1.12 ± 22%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      2.50 ± 22%      -1.7        0.81 ± 11%  perf-profile.calltrace.cycles-pp.__block_commit_write.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      2.50 ± 24%      -1.5        0.96 ± 23%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      2.22 ± 14%      -1.4        0.82 ± 11%  perf-profile.calltrace.cycles-pp.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      2.11 ± 13%      -1.4        0.74 ±  9%  perf-profile.calltrace.cycles-pp.filemap_add_folio.__filemap_get_folio.pagecache_get_page.ext4_da_write_begin.generic_perform_write
      1.78 ± 22%      -1.2        0.59 ± 49%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      1.96 ± 21%      -1.2        0.76 ± 21%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      1.69 ± 20%      -1.1        0.56 ± 48%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      1.98 ± 11%      -1.1        0.90 ± 54%  perf-profile.calltrace.cycles-pp.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      1.10 ± 15%      -0.8        0.27 ±100%  perf-profile.calltrace.cycles-pp.mpage_map_and_submit_buffers.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
      1.30 ± 10%      -0.8        0.48 ± 45%  perf-profile.calltrace.cycles-pp.__filemap_add_folio.filemap_add_folio.__filemap_get_folio.pagecache_get_page.ext4_da_write_begin
      1.08 ± 16%      -0.8        0.28 ±100%  perf-profile.calltrace.cycles-pp.ext4_put_io_end.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
      1.14 ± 27%      -0.7        0.40 ± 75%  perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      1.20 ± 23%      -0.6        0.59 ± 12%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.90 ± 14%      -0.5        1.38 ± 10%  perf-profile.calltrace.cycles-pp.stop_this_handle.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end
      0.73 ± 16%      -0.4        0.36 ± 70%  perf-profile.calltrace.cycles-pp.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work
      0.73 ± 16%      -0.4        0.36 ± 70%  perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn
      0.73 ± 16%      -0.4        0.36 ± 70%  perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback
      0.73 ± 16%      -0.4        0.36 ± 70%  perf-profile.calltrace.cycles-pp.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb
      0.73 ± 16%      -0.4        0.36 ± 70%  perf-profile.calltrace.cycles-pp.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work.worker_thread
      0.32 ±103%      +0.9        1.25 ± 11%  perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_update_time.file_update_time
      0.22 ±143%      +0.9        1.17 ± 11%  perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_update_time
      0.46 ± 75%      +1.0        1.48 ± 12%  perf-profile.calltrace.cycles-pp.ext4_dirty_inode.__mark_inode_dirty.generic_update_time.file_update_time.ext4_write_checks
      0.66 ± 50%      +1.0        1.70 ± 13%  perf-profile.calltrace.cycles-pp.ext4_write_checks.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
      0.64 ± 50%      +1.0        1.69 ± 12%  perf-profile.calltrace.cycles-pp.file_update_time.ext4_write_checks.ext4_buffered_write_iter.new_sync_write.vfs_write
      0.62 ± 50%      +1.0        1.67 ± 11%  perf-profile.calltrace.cycles-pp.generic_update_time.file_update_time.ext4_write_checks.ext4_buffered_write_iter.new_sync_write
      0.62 ± 50%      +1.1        1.67 ± 11%  perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_update_time.file_update_time.ext4_write_checks.ext4_buffered_write_iter
      2.42 ± 10%      +1.1        3.54 ± 12%  perf-profile.calltrace.cycles-pp.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      1.79 ±  6%      +1.2        2.98 ± 11%  perf-profile.calltrace.cycles-pp.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      0.90 ± 19%      +1.4        2.28 ±  8%  perf-profile.calltrace.cycles-pp.jbd2_journal_dirty_metadata.__ext4_handle_dirty_metadata.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode
      1.18 ± 10%      +1.4        2.55 ±  9%  perf-profile.calltrace.cycles-pp.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      3.82 ± 12%      +1.4        5.20 ±  7%  perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.97 ± 16%      +1.4        2.37 ± 11%  perf-profile.calltrace.cycles-pp.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      1.07 ± 10%      +1.4        2.47 ±  8%  perf-profile.calltrace.cycles-pp.jbd2_journal_get_write_access.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode
      3.96 ± 12%      +1.4        5.40 ±  8%  perf-profile.calltrace.cycles-pp.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      3.08 ± 13%      +1.6        4.64 ±  9%  perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
      1.02 ± 18%      +1.7        2.68 ±  8%  perf-profile.calltrace.cycles-pp.__ext4_handle_dirty_metadata.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      4.26 ±  8%      +2.3        6.56 ± 12%  perf-profile.calltrace.cycles-pp.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
      3.82 ± 15%      +2.4        6.22 ±  8%  perf-profile.calltrace.cycles-pp._raw_read_lock.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
     43.99 ±  8%      +7.8       51.83 ±  9%  perf-profile.calltrace.cycles-pp.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
     45.33 ±  9%      +8.4       53.74 ±  9%  perf-profile.calltrace.cycles-pp.write
     45.28 ±  9%      +8.4       53.72 ±  9%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     45.27 ±  9%      +8.5       53.72 ±  9%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     45.24 ±  9%      +8.5       53.71 ±  9%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     45.20 ±  9%      +8.5       53.69 ±  9%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     45.12 ±  9%      +8.5       53.64 ±  9%  perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     44.78 ±  9%      +8.8       53.56 ±  9%  perf-profile.calltrace.cycles-pp.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     20.02 ± 15%     +13.3       33.28 ±  9%  perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
     20.05 ± 16%     +14.2       34.28 ±  9%  perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty
     21.00 ± 15%     +14.7       35.68 ±  9%  perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
     32.04 ± 12%     +16.5       48.56 ±  8%  perf-profile.calltrace.cycles-pp.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     25.28 ± 14%     +17.0       42.26 ±  9%  perf-profile.calltrace.cycles-pp.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
     29.40 ± 13%     +18.3       47.71 ±  8%  perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     12.10 ± 15%      -6.6        5.54 ±  7%  perf-profile.children.cycles-pp.ret_from_fork
     12.09 ± 15%      -6.6        5.54 ±  7%  perf-profile.children.cycles-pp.kthread
     11.97 ± 15%      -6.5        5.48 ±  7%  perf-profile.children.cycles-pp.worker_thread
     11.96 ± 15%      -6.5        5.48 ±  7%  perf-profile.children.cycles-pp.process_one_work
     11.61 ± 15%      -6.2        5.41 ±  8%  perf-profile.children.cycles-pp.writeback_sb_inodes
     11.61 ± 15%      -6.2        5.41 ±  8%  perf-profile.children.cycles-pp.wb_workfn
     11.61 ± 15%      -6.2        5.41 ±  8%  perf-profile.children.cycles-pp.wb_writeback
     11.61 ± 15%      -6.2        5.40 ±  8%  perf-profile.children.cycles-pp.__writeback_single_inode
     11.61 ± 15%      -6.2        5.40 ±  8%  perf-profile.children.cycles-pp.do_writepages
     11.61 ± 15%      -6.2        5.40 ±  8%  perf-profile.children.cycles-pp.ext4_writepages
      9.40 ± 24%      -5.4        3.98 ± 12%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      5.95 ± 27%      -4.9        1.09 ± 11%  perf-profile.children.cycles-pp.copy_page_from_iter_atomic
      8.68 ± 15%      -4.7        3.98 ±  7%  perf-profile.children.cycles-pp.submit_bio_noacct
      8.68 ± 15%      -4.7        3.98 ±  7%  perf-profile.children.cycles-pp.__submit_bio
      8.68 ± 15%      -4.7        3.98 ±  7%  perf-profile.children.cycles-pp.brd_submit_bio
      8.65 ± 15%      -4.7        3.96 ±  8%  perf-profile.children.cycles-pp.brd_do_bvec
      5.73 ± 28%      -4.7        1.06 ± 11%  perf-profile.children.cycles-pp.copyin
      5.72 ± 28%      -4.7        1.06 ± 11%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      8.60 ± 15%      -4.6        3.95 ±  7%  perf-profile.children.cycles-pp.ext4_io_submit
      7.86 ± 12%      -4.3        3.52 ± 13%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      5.54 ± 12%      -3.5        2.00 ± 32%  perf-profile.children.cycles-pp.ext4_da_write_begin
      5.17 ± 14%      -2.8        2.33 ± 15%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      5.10 ± 14%      -2.8        2.30 ± 15%  perf-profile.children.cycles-pp.hrtimer_interrupt
      4.67 ± 16%      -2.5        2.14 ±  8%  perf-profile.children.cycles-pp.brd_insert_page
      3.89 ± 15%      -2.2        1.66 ± 10%  perf-profile.children.cycles-pp._raw_spin_lock
      3.22 ± 13%      -2.2        1.02 ± 10%  perf-profile.children.cycles-pp.pagecache_get_page
      3.20 ± 13%      -2.2        1.02 ± 10%  perf-profile.children.cycles-pp.__filemap_get_folio
      3.13 ± 24%      -1.8        1.30 ± 20%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      2.50 ± 17%      -1.7        0.82 ± 12%  perf-profile.children.cycles-pp.block_write_end
      2.42 ± 16%      -1.6        0.81 ± 11%  perf-profile.children.cycles-pp.__block_commit_write
      2.53 ± 24%      -1.6        0.97 ± 23%  perf-profile.children.cycles-pp.menu_select
      2.11 ± 13%      -1.4        0.74 ±  9%  perf-profile.children.cycles-pp.filemap_add_folio
      2.19 ± 19%      -1.3        0.92 ± 18%  perf-profile.children.cycles-pp.tick_sched_timer
      1.91 ± 13%      -1.2        0.66 ±  9%  perf-profile.children.cycles-pp.__alloc_pages
      2.00 ± 20%      -1.2        0.80 ± 20%  perf-profile.children.cycles-pp.tick_sched_handle
      1.91 ± 18%      -1.1        0.77 ± 18%  perf-profile.children.cycles-pp.update_process_times
      1.69 ± 14%      -1.1        0.59 ± 10%  perf-profile.children.cycles-pp.get_page_from_freelist
      1.63 ± 21%      -1.1        0.54 ± 32%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      1.98 ± 11%      -1.1        0.90 ± 54%  perf-profile.children.cycles-pp.ext4_block_write_begin
      1.43 ± 22%      -1.0        0.44 ± 41%  perf-profile.children.cycles-pp.tick_nohz_next_event
      1.72 ± 27%      -0.9        0.79 ± 38%  perf-profile.children.cycles-pp.ktime_get
      1.45 ± 11%      -0.8        0.63 ± 13%  perf-profile.children.cycles-pp.irq_exit_rcu
      1.31 ± 10%      -0.7        0.56 ±  9%  perf-profile.children.cycles-pp.__filemap_add_folio
      0.94 ± 17%      -0.7        0.22 ± 16%  perf-profile.children.cycles-pp.folio_alloc
      1.31 ± 21%      -0.7        0.61 ± 28%  perf-profile.children.cycles-pp.clockevents_program_event
      1.26 ± 16%      -0.7        0.58 ±  8%  perf-profile.children.cycles-pp.mpage_map_and_submit_buffers
      1.13 ± 11%      -0.7        0.46 ± 15%  perf-profile.children.cycles-pp.mark_buffer_dirty
      1.00 ± 14%      -0.6        0.36 ± 12%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      1.10 ± 11%      -0.6        0.48 ± 15%  perf-profile.children.cycles-pp.__softirqentry_text_start
      1.02 ± 18%      -0.6        0.40 ± 16%  perf-profile.children.cycles-pp.scheduler_tick
      0.78 ± 20%      -0.6        0.17 ± 11%  perf-profile.children.cycles-pp.folio_add_lru
      0.99 ± 10%      -0.6        0.39 ± 11%  perf-profile.children.cycles-pp.create_empty_buffers
      1.17 ± 15%      -0.6        0.59 ±  9%  perf-profile.children.cycles-pp.ext4_put_io_end
      1.15 ± 16%      -0.6        0.58 ±  9%  perf-profile.children.cycles-pp.ext4_release_io_end
      1.14 ± 16%      -0.6        0.58 ±  9%  perf-profile.children.cycles-pp.ext4_finish_bio
      0.78 ± 21%      -0.6        0.22 ± 65%  perf-profile.children.cycles-pp.timekeeping_max_deferment
      1.03 ± 17%      -0.6        0.48 ±  8%  perf-profile.children.cycles-pp.mpage_submit_page
      0.68 ± 21%      -0.5        0.16 ± 12%  perf-profile.children.cycles-pp.__pagevec_lru_add
      1.94 ± 14%      -0.5        1.44 ± 10%  perf-profile.children.cycles-pp.stop_this_handle
      0.65 ± 13%      -0.4        0.21 ± 13%  perf-profile.children.cycles-pp.rmqueue
      0.80 ±  8%      -0.4        0.37 ± 10%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.76 ± 18%      -0.4        0.34 ± 10%  perf-profile.children.cycles-pp.ext4_bio_write_page
      0.81 ± 10%      -0.4        0.40 ±  9%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.74 ± 15%      -0.4        0.34 ± 18%  perf-profile.children.cycles-pp.__folio_mark_dirty
      0.70 ± 11%      -0.4        0.32 ± 11%  perf-profile.children.cycles-pp.alloc_page_buffers
      0.50 ± 24%      -0.4        0.14 ± 45%  perf-profile.children.cycles-pp.vprintk_emit
      0.58 ± 20%      -0.4        0.22 ± 52%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.66 ± 10%      -0.4        0.32 ± 10%  perf-profile.children.cycles-pp.alloc_buffer_head
      0.65 ± 10%      -0.3        0.30 ± 18%  perf-profile.children.cycles-pp.rebalance_domains
      0.66 ± 15%      -0.3        0.32 ±  9%  perf-profile.children.cycles-pp.folio_end_writeback
      0.48 ± 21%      -0.3        0.14 ± 45%  perf-profile.children.cycles-pp.console_unlock
      0.64 ± 22%      -0.3        0.30 ± 27%  perf-profile.children.cycles-pp.prep_new_page
      0.61 ± 24%      -0.3        0.29 ± 28%  perf-profile.children.cycles-pp.kernel_init_free_pages
      0.60 ± 24%      -0.3        0.28 ± 28%  perf-profile.children.cycles-pp.clear_page_erms
      0.64 ± 15%      -0.3        0.34 ± 30%  perf-profile.children.cycles-pp.ext4_fill_raw_inode
      0.58 ± 15%      -0.3        0.28 ± 10%  perf-profile.children.cycles-pp.__folio_end_writeback
      0.38 ± 21%      -0.3        0.08 ± 78%  perf-profile.children.cycles-pp.calc_global_load_tick
      0.54 ± 19%      -0.3        0.24 ± 18%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.42 ± 23%      -0.3        0.13 ± 45%  perf-profile.children.cycles-pp.serial8250_console_write
      0.60 ± 10%      -0.3        0.33 ±  9%  perf-profile.children.cycles-pp.__mem_cgroup_charge
      0.52 ± 15%      -0.3        0.24 ± 12%  perf-profile.children.cycles-pp.mpage_prepare_extent_to_map
      0.39 ± 24%      -0.3        0.12 ± 42%  perf-profile.children.cycles-pp.wait_for_lsr
      0.45 ± 28%      -0.3        0.19 ± 11%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.73 ± 16%      -0.2        0.49 ± 17%  perf-profile.children.cycles-pp.__writeback_inodes_wb
      0.37 ± 12%      -0.2        0.13 ± 13%  perf-profile.children.cycles-pp.rmqueue_bulk
      0.26 ± 26%      -0.2        0.02 ± 99%  perf-profile.children.cycles-pp.node_dirty_ok
      0.45 ± 11%      -0.2        0.23 ± 17%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.42 ± 18%      -0.2        0.20 ± 12%  perf-profile.children.cycles-pp.__folio_start_writeback
      0.30 ± 14%      -0.2        0.08 ± 33%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.30 ± 13%      -0.2        0.08 ± 33%  perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
      0.47 ± 11%      -0.2        0.25 ± 16%  perf-profile.children.cycles-pp.__getblk_gfp
      0.42 ±  6%      -0.2        0.21 ± 11%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.31 ± 23%      -0.2        0.10 ± 47%  perf-profile.children.cycles-pp.io_serial_in
      0.43 ± 11%      -0.2        0.23 ± 18%  perf-profile.children.cycles-pp.__find_get_block
      0.39 ± 15%      -0.2        0.20 ± 50%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.34 ± 17%      -0.2        0.15 ± 16%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.43 ±  9%      -0.2        0.24 ± 11%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.37 ± 16%      -0.2        0.19 ± 51%  perf-profile.children.cycles-pp.tick_irq_enter
      0.30 ± 16%      -0.2        0.13 ± 20%  perf-profile.children.cycles-pp.load_balance
      0.32 ± 23%      -0.2        0.16 ± 12%  perf-profile.children.cycles-pp.ext4_inode_csum_set
      0.24 ± 10%      -0.2        0.07 ±  9%  perf-profile.children.cycles-pp.jbd2_write_access_granted
      0.33 ± 29%      -0.2        0.17 ± 34%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.29 ± 16%      -0.2        0.13 ± 17%  perf-profile.children.cycles-pp.native_sched_clock
      0.26 ± 14%      -0.2        0.11 ± 10%  perf-profile.children.cycles-pp.xas_load
      0.20 ± 18%      -0.2        0.04 ± 72%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.18 ± 20%      -0.2        0.02 ± 99%  perf-profile.children.cycles-pp.ext4_es_lookup_extent
      0.29 ± 23%      -0.1        0.14 ±  8%  perf-profile.children.cycles-pp.ext4_inode_csum
      0.22 ±  8%      -0.1        0.08 ± 11%  perf-profile.children.cycles-pp.__might_resched
      0.29 ± 10%      -0.1        0.14 ±  9%  perf-profile.children.cycles-pp.read_tsc
      0.32 ± 13%      -0.1        0.17 ± 12%  perf-profile.children.cycles-pp.charge_memcg
      0.24 ± 17%      -0.1        0.10 ± 21%  perf-profile.children.cycles-pp.update_rq_clock
      0.20 ± 10%      -0.1        0.06 ± 26%  perf-profile.children.cycles-pp.ext4_es_insert_delayed_block
      0.22 ± 19%      -0.1        0.08 ± 24%  perf-profile.children.cycles-pp.update_blocked_averages
      0.26 ± 15%      -0.1        0.12 ±  7%  perf-profile.children.cycles-pp.folio_clear_dirty_for_io
      0.21 ± 33%      -0.1        0.08 ± 51%  perf-profile.children.cycles-pp.irq_work_run_list
      0.22 ± 15%      -0.1        0.09 ± 21%  perf-profile.children.cycles-pp.find_busiest_group
      0.20 ± 32%      -0.1        0.07 ± 50%  perf-profile.children.cycles-pp.asm_sysvec_irq_work
      0.20 ± 32%      -0.1        0.07 ± 50%  perf-profile.children.cycles-pp.sysvec_irq_work
      0.20 ± 32%      -0.1        0.07 ± 50%  perf-profile.children.cycles-pp.__sysvec_irq_work
      0.20 ± 32%      -0.1        0.07 ± 50%  perf-profile.children.cycles-pp.irq_work_run
      0.20 ± 32%      -0.1        0.07 ± 50%  perf-profile.children.cycles-pp.irq_work_single
      0.20 ± 32%      -0.1        0.07 ± 50%  perf-profile.children.cycles-pp._printk
      0.22 ± 20%      -0.1        0.10 ±  8%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.23 ± 29%      -0.1        0.10 ± 32%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.21 ± 15%      -0.1        0.09 ± 20%  perf-profile.children.cycles-pp.update_sd_lb_stats
      0.24 ±  9%      -0.1        0.11 ±  6%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      0.26 ± 14%      -0.1        0.14 ± 10%  perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
      0.20 ± 21%      -0.1        0.08 ±  7%  perf-profile.children.cycles-pp.__mod_node_page_state
      0.20 ± 38%      -0.1        0.09 ± 65%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.19 ± 23%      -0.1        0.08 ± 12%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.20 ± 14%      -0.1        0.09 ± 13%  perf-profile.children.cycles-pp.__radix_tree_preload
      0.19 ± 26%      -0.1        0.09 ± 36%  perf-profile.children.cycles-pp.__hrtimer_next_event_base
      0.18 ± 14%      -0.1        0.09 ± 22%  perf-profile.children.cycles-pp.___slab_alloc
      0.18 ± 14%      -0.1        0.09 ± 21%  perf-profile.children.cycles-pp.__slab_alloc
      0.19 ± 19%      -0.1        0.10 ± 14%  perf-profile.children.cycles-pp.mpage_process_page_bufs
      0.16 ± 14%      -0.1        0.07 ± 14%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      0.16 ± 14%      -0.1        0.07 ± 14%  perf-profile.children.cycles-pp.find_get_pages_range_tag
      0.13 ± 17%      -0.1        0.05 ± 47%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.15 ± 20%      -0.1        0.07 ± 25%  perf-profile.children.cycles-pp.hrtimer_next_event_without
      0.14 ± 23%      -0.1        0.05 ± 51%  perf-profile.children.cycles-pp.update_irq_load_avg
      0.15 ± 18%      -0.1        0.06 ± 17%  perf-profile.children.cycles-pp.brd_lookup_page
      0.15 ± 21%      -0.1        0.07 ± 31%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.15 ± 14%      -0.1        0.07 ± 14%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.15 ± 35%      -0.1        0.07 ± 41%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.18 ± 21%      -0.1        0.10 ±  6%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.14 ± 11%      -0.1        0.06 ± 11%  perf-profile.children.cycles-pp.release_pages
      0.15 ± 27%      -0.1        0.07 ± 24%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.16 ± 14%      -0.1        0.08 ± 22%  perf-profile.children.cycles-pp.allocate_slab
      0.11 ± 26%      -0.1        0.03 ±102%  perf-profile.children.cycles-pp.__hrtimer_get_next_event
      0.11 ± 12%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.fault_in_iov_iter_readable
      0.11 ± 15%      -0.1        0.04 ± 73%  perf-profile.children.cycles-pp.__cond_resched
      0.13 ± 17%      -0.1        0.06 ± 14%  perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
      0.09 ± 14%      -0.1        0.02 ± 99%  perf-profile.children.cycles-pp.__pagevec_release
      0.11 ± 26%      -0.1        0.05 ± 47%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.12 ± 22%      -0.1        0.06 ± 13%  perf-profile.children.cycles-pp.__xa_clear_mark
      0.14 ± 20%      -0.1        0.08 ± 21%  perf-profile.children.cycles-pp.try_charge_memcg
      0.12 ± 16%      -0.1        0.06 ± 11%  perf-profile.children.cycles-pp.__count_memcg_events
      0.16 ±  7%      -0.1        0.11 ± 12%  perf-profile.children.cycles-pp.get_obj_cgroup_from_current
      0.10 ± 11%      -0.0        0.06 ± 13%  perf-profile.children.cycles-pp.folio_memcg_lock
      0.09 ± 20%      -0.0        0.04 ± 45%  perf-profile.children.cycles-pp.page_counter_try_charge
      0.16 ±  7%      -0.0        0.12 ± 12%  perf-profile.children.cycles-pp.do_sys_open
      0.16 ±  7%      -0.0        0.12 ± 12%  perf-profile.children.cycles-pp.do_sys_openat2
      0.15 ±  5%      -0.0        0.11 ± 14%  perf-profile.children.cycles-pp.do_filp_open
      0.15 ±  6%      -0.0        0.11 ± 14%  perf-profile.children.cycles-pp.path_openat
      0.10 ± 20%      -0.0        0.06 ± 17%  perf-profile.children.cycles-pp.mem_cgroup_track_foreign_dirty_slowpath
      0.72 ± 28%      +1.0        1.70 ± 13%  perf-profile.children.cycles-pp.ext4_write_checks
      0.70 ± 29%      +1.0        1.69 ± 12%  perf-profile.children.cycles-pp.file_update_time
      0.68 ± 29%      +1.0        1.67 ± 11%  perf-profile.children.cycles-pp.generic_update_time
      2.49 ± 10%      +1.2        3.67 ± 12%  perf-profile.children.cycles-pp.ext4_mark_iloc_dirty
      1.85 ±  6%      +1.3        3.10 ± 11%  perf-profile.children.cycles-pp.ext4_reserve_inode_write
      0.92 ± 19%      +1.4        2.37 ±  8%  perf-profile.children.cycles-pp.jbd2_journal_dirty_metadata
      1.22 ± 10%      +1.4        2.66 ±  9%  perf-profile.children.cycles-pp.__ext4_journal_get_write_access
      1.00 ± 16%      +1.5        2.46 ± 11%  perf-profile.children.cycles-pp.ext4_journal_check_start
      1.11 ± 10%      +1.5        2.59 ±  8%  perf-profile.children.cycles-pp.jbd2_journal_get_write_access
      3.91 ± 13%      +1.5        5.40 ±  7%  perf-profile.children.cycles-pp.jbd2_journal_stop
      4.06 ± 13%      +1.5        5.60 ±  8%  perf-profile.children.cycles-pp.__ext4_journal_stop
      3.16 ± 13%      +1.6        4.80 ±  9%  perf-profile.children.cycles-pp.add_transaction_credits
      1.06 ± 18%      +1.7        2.78 ±  8%  perf-profile.children.cycles-pp.__ext4_handle_dirty_metadata
      4.39 ±  8%      +2.4        6.82 ± 12%  perf-profile.children.cycles-pp.__ext4_mark_inode_dirty
      3.99 ± 15%      +2.5        6.47 ±  8%  perf-profile.children.cycles-pp._raw_read_lock
     44.00 ±  8%      +7.8       51.84 ±  9%  perf-profile.children.cycles-pp.generic_perform_write
     45.75 ±  9%      +8.2       53.97 ±  9%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     45.73 ±  9%      +8.2       53.96 ±  9%  perf-profile.children.cycles-pp.do_syscall_64
     45.34 ±  9%      +8.4       53.76 ±  9%  perf-profile.children.cycles-pp.write
     45.24 ±  9%      +8.5       53.72 ±  9%  perf-profile.children.cycles-pp.ksys_write
     45.21 ±  9%      +8.5       53.70 ±  9%  perf-profile.children.cycles-pp.vfs_write
     45.13 ±  9%      +8.5       53.66 ±  9%  perf-profile.children.cycles-pp.new_sync_write
     44.78 ±  9%      +8.8       53.56 ±  9%  perf-profile.children.cycles-pp.ext4_buffered_write_iter
     20.52 ± 15%     +14.0       34.49 ±  9%  perf-profile.children.cycles-pp.jbd2__journal_start
     20.34 ± 16%     +14.0       34.34 ±  9%  perf-profile.children.cycles-pp.start_this_handle
     21.53 ± 15%     +15.4       36.97 ±  9%  perf-profile.children.cycles-pp.__ext4_journal_start_sb
     32.08 ± 12%     +16.5       48.56 ±  8%  perf-profile.children.cycles-pp.generic_write_end
     25.87 ± 14%     +17.9       43.73 ±  9%  perf-profile.children.cycles-pp.ext4_dirty_inode
     30.18 ± 13%     +19.2       49.41 ±  8%  perf-profile.children.cycles-pp.__mark_inode_dirty
      5.68 ± 28%      -4.6        1.06 ± 11%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      3.78 ± 15%      -2.1        1.64 ± 10%  perf-profile.self.cycles-pp._raw_spin_lock
      3.81 ± 15%      -2.0        1.76 ±  7%  perf-profile.self.cycles-pp.brd_do_bvec
      1.49 ± 31%      -0.8        0.68 ± 45%  perf-profile.self.cycles-pp.ktime_get
      0.90 ± 21%      -0.6        0.32 ± 10%  perf-profile.self.cycles-pp.__block_commit_write
      0.78 ± 20%      -0.6        0.22 ± 66%  perf-profile.self.cycles-pp.timekeeping_max_deferment
      0.99 ± 14%      -0.5        0.50 ± 17%  perf-profile.self.cycles-pp.cpuidle_enter_state
      1.92 ± 14%      -0.5        1.43 ± 10%  perf-profile.self.cycles-pp.stop_this_handle
      0.77 ± 12%      -0.4        0.35 ± 13%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.44 ± 27%      -0.3        0.12 ± 48%  perf-profile.self.cycles-pp.tick_nohz_next_event
      0.59 ± 23%      -0.3        0.28 ± 28%  perf-profile.self.cycles-pp.clear_page_erms
      0.38 ± 21%      -0.3        0.08 ± 78%  perf-profile.self.cycles-pp.calc_global_load_tick
      0.42 ± 29%      -0.3        0.14 ± 50%  perf-profile.self.cycles-pp.update_process_times
      0.45 ± 11%      -0.2        0.23 ± 17%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.29 ± 13%      -0.2        0.07 ± 33%  perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
      0.40 ± 26%      -0.2        0.18 ± 27%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.42 ±  6%      -0.2        0.21 ± 11%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.31 ± 23%      -0.2        0.10 ± 47%  perf-profile.self.cycles-pp.io_serial_in
      0.23 ± 18%      -0.2        0.04 ± 72%  perf-profile.self.cycles-pp.__pagevec_lru_add
      0.41 ± 12%      -0.2        0.22 ± 19%  perf-profile.self.cycles-pp.__find_get_block
      0.28 ± 13%      -0.2        0.10 ± 12%  perf-profile.self.cycles-pp.rmqueue_bulk
      0.23 ± 11%      -0.2        0.07 ±  9%  perf-profile.self.cycles-pp.jbd2_write_access_granted
      0.33 ± 30%      -0.2        0.17 ± 34%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.38 ±  9%      -0.2        0.22 ±  9%  perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      0.28 ± 16%      -0.2        0.13 ± 15%  perf-profile.self.cycles-pp.native_sched_clock
      0.20 ± 18%      -0.2        0.05 ± 47%  perf-profile.self.cycles-pp.rmqueue
      0.19 ± 16%      -0.2        0.04 ± 73%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.19 ± 13%      -0.1        0.05 ± 46%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.22 ±  9%      -0.1        0.08 ±  9%  perf-profile.self.cycles-pp.__might_resched
      0.28 ± 11%      -0.1        0.14 ±  9%  perf-profile.self.cycles-pp.read_tsc
      0.26 ± 12%      -0.1        0.12 ±  9%  perf-profile.self.cycles-pp.__mod_lruvec_page_state
      0.21 ± 13%      -0.1        0.09 ± 10%  perf-profile.self.cycles-pp.xas_load
      0.20 ± 23%      -0.1        0.08 ±  8%  perf-profile.self.cycles-pp.__mod_node_page_state
      0.19 ± 23%      -0.1        0.08 ± 12%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.14 ±  6%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.__alloc_pages
      0.20 ± 11%      -0.1        0.09 ±  7%  perf-profile.self.cycles-pp.percpu_counter_add_batch
      0.20 ± 15%      -0.1        0.09 ± 14%  perf-profile.self.cycles-pp.__radix_tree_preload
      0.19 ± 11%      -0.1        0.09 ± 11%  perf-profile.self.cycles-pp.ext4_bio_write_page
      0.18 ± 37%      -0.1        0.08 ± 61%  perf-profile.self.cycles-pp.rcu_sched_clock_irq
      0.17 ± 12%      -0.1        0.07 ± 14%  perf-profile.self.cycles-pp.__folio_end_writeback
      0.23 ± 13%      -0.1        0.14 ± 11%  perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
      0.18 ± 20%      -0.1        0.10 ± 14%  perf-profile.self.cycles-pp.mpage_process_page_bufs
      0.17 ± 31%      -0.1        0.08 ± 38%  perf-profile.self.cycles-pp.__hrtimer_next_event_base
      0.16 ± 18%      -0.1        0.08 ± 17%  perf-profile.self.cycles-pp.do_idle
      0.14 ± 23%      -0.1        0.05 ± 51%  perf-profile.self.cycles-pp.update_irq_load_avg
      0.15 ± 19%      -0.1        0.07 ± 16%  perf-profile.self.cycles-pp.__folio_start_writeback
      0.15 ± 14%      -0.1        0.07 ± 14%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.13 ± 18%      -0.1        0.05 ± 47%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.14 ± 12%      -0.1        0.06 ± 25%  perf-profile.self.cycles-pp.update_sd_lb_stats
      0.13 ±  9%      -0.1        0.06 ±  9%  perf-profile.self.cycles-pp.release_pages
      0.12 ± 12%      -0.1        0.05 ± 46%  perf-profile.self.cycles-pp.find_get_pages_range_tag
      0.10 ± 22%      -0.1        0.03 ±103%  perf-profile.self.cycles-pp.hrtimer_interrupt
      0.13 ± 15%      -0.1        0.06 ±  8%  perf-profile.self.cycles-pp.folio_clear_dirty_for_io
      0.10 ± 23%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp.mpage_map_and_submit_buffers
      0.14 ± 15%      -0.1        0.07 ± 12%  perf-profile.self.cycles-pp.ext4_finish_bio
      0.16 ± 16%      -0.1        0.10 ±  6%  perf-profile.self.cycles-pp.crc32c_pcl_intel_update
      0.11 ± 18%      -0.1        0.05 ± 51%  perf-profile.self.cycles-pp.allocate_slab
      0.10 ± 13%      -0.1        0.04 ± 45%  perf-profile.self.cycles-pp.folio_memcg_lock
      0.11 ± 11%      -0.1        0.06 ± 13%  perf-profile.self.cycles-pp.__count_memcg_events
      0.16 ±  5%      -0.0        0.11 ± 10%  perf-profile.self.cycles-pp.get_obj_cgroup_from_current
      0.10 ± 20%      -0.0        0.06 ± 17%  perf-profile.self.cycles-pp.mem_cgroup_track_foreign_dirty_slowpath
      0.08 ± 14%      +0.0        0.12 ± 19%  perf-profile.self.cycles-pp.jbd2__journal_start
      0.10 ± 22%      +0.3        0.40 ±  9%  perf-profile.self.cycles-pp.__ext4_handle_dirty_metadata
      0.92 ± 19%      +1.4        2.35 ±  8%  perf-profile.self.cycles-pp.jbd2_journal_dirty_metadata
      0.95 ± 17%      +1.5        2.43 ± 12%  perf-profile.self.cycles-pp.ext4_journal_check_start
      0.87 ± 13%      +1.6        2.50 ±  8%  perf-profile.self.cycles-pp.jbd2_journal_get_write_access
      3.14 ± 13%      +1.6        4.78 ±  9%  perf-profile.self.cycles-pp.add_transaction_credits
      1.93 ± 13%      +2.0        3.93 ±  7%  perf-profile.self.cycles-pp.jbd2_journal_stop
      3.94 ± 15%      +2.5        6.44 ±  8%  perf-profile.self.cycles-pp._raw_read_lock
     13.14 ± 17%      +9.8       22.93 ±  9%  perf-profile.self.cycles-pp.start_this_handle



***************************************************************************************************
lkp-icl-2sp1: 96 threads 2 sockets Ice Lake with 256G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-11/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp1/fstat/stress-ng/60s/0xb000280

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   1919597           -20.1%    1534630        stress-ng.fstat.ops
     31993           -20.1%      25577        stress-ng.fstat.ops_per_sec
    817763 ±  4%     -28.9%     581442 ±  2%  stress-ng.time.involuntary_context_switches
      2887            +5.7%       3051        stress-ng.time.percent_of_cpu_this_job_got
      1626            +8.3%       1761        stress-ng.time.system_time
    166.16           -20.0%     132.88        stress-ng.time.user_time
   3587756           -20.4%    2856397        stress-ng.time.voluntary_context_switches
  19377947           -12.9%   16869737        cpuidle..usage
  22169258 ±  6%     -38.4%   13650944        meminfo.DirectMap2M
      0.77 ±  5%      +0.0        0.82 ±  3%  mpstat.cpu.all.irq%
      2.88            -0.6        2.33        mpstat.cpu.all.usr%
    310.30 ±  4%     +16.1%     360.24 ±  5%  sched_debug.cfs_rq:/.runnable_avg.stddev
    308.22 ±  4%     +15.1%     354.71 ±  6%  sched_debug.cfs_rq:/.util_avg.stddev
    567825           -22.8%     438177        vmstat.system.cs
    237994            -2.0%     233210        vmstat.system.in
     68.72            -1.8%      67.47        iostat.cpu.idle
     28.46            +6.2%      30.24        iostat.cpu.system
      2.82           -19.0%       2.28        iostat.cpu.user
  19720321 ±  3%     -33.4%   13134826 ±  3%  numa-numastat.node0.local_node
  19777686 ±  3%     -33.4%   13181681 ±  3%  numa-numastat.node0.numa_hit
  16776225 ±  4%     -14.3%   14379038 ±  2%  numa-numastat.node1.local_node
  16805121 ±  4%     -14.2%   14420003 ±  2%  numa-numastat.node1.numa_hit
  19777804 ±  3%     -33.4%   13181408 ±  3%  numa-vmstat.node0.numa_hit
  19720438 ±  3%     -33.4%   13134553 ±  3%  numa-vmstat.node0.numa_local
  16805357 ±  4%     -14.2%   14420086 ±  2%  numa-vmstat.node1.numa_hit
  16776463 ±  4%     -14.3%   14379121 ±  2%  numa-vmstat.node1.numa_local
    100111 ±  2%     -20.2%      79842 ±  7%  turbostat.C1
  18109273 ±  5%     -17.9%   14868577 ±  5%  turbostat.C1E
      0.25           -24.2%       0.19        turbostat.IPC
     23591           -17.9%      19362 ±  7%  turbostat.POLL
      0.02            -0.0        0.01        turbostat.POLL%
      9853 ±  4%      -9.4%       8922 ±  2%  proc-vmstat.nr_active_anon
     25609 ±  2%      -4.0%      24587        proc-vmstat.nr_kernel_stack
     42955            -7.1%      39903 ±  2%  proc-vmstat.nr_shmem
     47746            +6.3%      50766        proc-vmstat.nr_slab_reclaimable
      9853 ±  4%      -9.4%       8922 ±  2%  proc-vmstat.nr_zone_active_anon
  36584891           -24.5%   27603451        proc-vmstat.numa_hit
  36498661           -24.6%   27528869        proc-vmstat.numa_local
      0.17 ±223%  +3.6e+05%     604.17 ±213%  proc-vmstat.numa_pages_migrated
      1748 ±  4%     -11.1%       1554 ±  4%  proc-vmstat.pgactivate
  36528014           -24.5%   27580355        proc-vmstat.pgalloc_normal
  36290911           -24.6%   27369541        proc-vmstat.pgfree
      0.17 ±223%  +3.6e+05%     604.17 ±213%  proc-vmstat.pgmigrate_success
      7.98 ±  4%     +15.4%       9.21 ±  5%  perf-stat.i.MPKI
 1.429e+10           -21.2%  1.125e+10        perf-stat.i.branch-instructions
      0.92 ±  3%      +0.1        1.03 ±  4%  perf-stat.i.branch-miss-rate%
 1.241e+08           -12.8%  1.082e+08        perf-stat.i.branch-misses
     17.09 ±  2%      +8.2       25.31 ±  2%  perf-stat.i.cache-miss-rate%
 1.019e+08           +33.9%  1.364e+08        perf-stat.i.cache-misses
 6.012e+08           -11.2%  5.339e+08        perf-stat.i.cache-references
    591439           -22.7%     457142        perf-stat.i.context-switches
      1.36           +32.2%       1.79        perf-stat.i.cpi
 1.031e+11            +4.3%  1.075e+11        perf-stat.i.cpu-cycles
      9522 ±  3%     +37.4%      13088        perf-stat.i.cpu-migrations
      1026           -20.0%     821.06 ±  2%  perf-stat.i.cycles-between-cache-misses
      0.03 ± 24%      +0.0        0.04 ± 14%  perf-stat.i.dTLB-load-miss-rate%
   4941417 ± 12%     +23.0%    6077138 ±  5%  perf-stat.i.dTLB-load-misses
 2.178e+10           -21.5%  1.711e+10        perf-stat.i.dTLB-loads
      0.01 ± 10%      +0.0        0.02 ±  8%  perf-stat.i.dTLB-store-miss-rate%
   1485395 ±  4%     -10.2%    1334061 ±  2%  perf-stat.i.dTLB-store-misses
 1.296e+10           -21.8%  1.013e+10        perf-stat.i.dTLB-stores
 7.687e+10           -21.4%  6.043e+10        perf-stat.i.instructions
      0.74           -24.3%       0.56        perf-stat.i.ipc
      1.07            +4.3%       1.12        perf-stat.i.metric.GHz
    837.30           +20.6%       1009        perf-stat.i.metric.K/sec
    516.87           -21.4%     406.42        perf-stat.i.metric.M/sec
     85.06            +5.6       90.71        perf-stat.i.node-load-miss-rate%
  13326340           +59.8%   21295732        perf-stat.i.node-load-misses
   2193567           -14.3%    1880215        perf-stat.i.node-loads
     20.29           +15.9       36.18        perf-stat.i.node-store-miss-rate%
  12130018          +113.1%   25843397        perf-stat.i.node-store-misses
  49891047            -8.5%   45663845        perf-stat.i.node-stores
      7.88           +12.9%       8.90        perf-stat.overall.MPKI
      0.87            +0.1        0.96        perf-stat.overall.branch-miss-rate%
     16.79            +8.3       25.08        perf-stat.overall.cache-miss-rate%
      1.34           +31.8%       1.77        perf-stat.overall.cpi
      1013           -21.9%     791.55        perf-stat.overall.cycles-between-cache-misses
      0.02 ± 12%      +0.0        0.04 ±  5%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ±  4%      +0.0        0.01 ±  2%  perf-stat.overall.dTLB-store-miss-rate%
      0.75           -24.1%       0.57        perf-stat.overall.ipc
     85.88            +5.9       91.76        perf-stat.overall.node-load-miss-rate%
     19.62           +16.3       35.88        perf-stat.overall.node-store-miss-rate%
 1.409e+10           -20.7%  1.117e+10        perf-stat.ps.branch-instructions
 1.224e+08           -12.4%  1.072e+08        perf-stat.ps.branch-misses
 1.004e+08           +33.4%  1.339e+08        perf-stat.ps.cache-misses
 5.977e+08           -10.7%   5.34e+08        perf-stat.ps.cache-references
    582510           -22.2%     453172        perf-stat.ps.context-switches
 1.017e+11            +4.3%   1.06e+11        perf-stat.ps.cpu-cycles
      9553 ±  3%     +35.5%      12949        perf-stat.ps.cpu-migrations
   4912066 ± 12%     +22.9%    6038093 ±  5%  perf-stat.ps.dTLB-load-misses
 2.148e+10           -20.9%  1.699e+10        perf-stat.ps.dTLB-loads
   1463340 ±  4%     -10.0%    1317415 ±  2%  perf-stat.ps.dTLB-store-misses
 1.278e+10           -21.3%  1.005e+10        perf-stat.ps.dTLB-stores
 7.581e+10           -20.9%  5.998e+10        perf-stat.ps.instructions
  13165441           +58.8%   20908585        perf-stat.ps.node-load-misses
   2164818           -13.2%    1878125        perf-stat.ps.node-loads
  11972044          +110.7%   25225320        perf-stat.ps.node-store-misses
  49038059            -8.1%   45075970        perf-stat.ps.node-stores
 4.814e+12           -21.3%  3.788e+12        perf-stat.total.instructions
      9.65            -2.4        7.24        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.66            -2.4        7.25        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__clone
      9.64            -2.4        7.24        perf-profile.calltrace.cycles-pp.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.63            -2.4        7.23        perf-profile.calltrace.cycles-pp.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.95            -2.4        7.56        perf-profile.calltrace.cycles-pp.__clone
      7.53 ±  2%      -2.3        5.26        perf-profile.calltrace.cycles-pp.copy_process.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.80 ±  2%      -1.9        3.91        perf-profile.calltrace.cycles-pp.dup_task_struct.copy_process.kernel_clone.__do_sys_clone.do_syscall_64
      4.54 ±  2%      -1.7        2.88        perf-profile.calltrace.cycles-pp.alloc_thread_stack_node.dup_task_struct.copy_process.kernel_clone.__do_sys_clone
      4.16 ±  2%      -1.5        2.67        perf-profile.calltrace.cycles-pp.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct.copy_process.kernel_clone
      1.92            -1.3        0.62 ±  2%  perf-profile.calltrace.cycles-pp.__check_object_size.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx
      3.06 ±  2%      -1.2        1.83 ±  2%  perf-profile.calltrace.cycles-pp.__get_vm_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct.copy_process
      2.72 ±  2%      -1.0        1.68 ±  2%  perf-profile.calltrace.cycles-pp.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct
      3.71            -1.0        2.72        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx
      2.54 ±  3%      -0.9        1.68        perf-profile.calltrace.cycles-pp.ret_from_fork
      2.54 ±  3%      -0.9        1.68        perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      2.48 ±  3%      -0.8        1.64        perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      2.01 ±  4%      -0.8        1.24 ±  2%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      1.96 ±  4%      -0.8        1.18 ±  2%  perf-profile.calltrace.cycles-pp.__vunmap.free_work.process_one_work.worker_thread.kthread
      1.98 ±  4%      -0.8        1.21        perf-profile.calltrace.cycles-pp.free_work.process_one_work.worker_thread.kthread.ret_from_fork
      2.51            -0.7        1.80        perf-profile.calltrace.cycles-pp.__entry_text_start.statx
      2.94            -0.7        2.27        perf-profile.calltrace.cycles-pp.link_path_walk.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
      2.46            -0.7        1.81        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64
      2.46            -0.7        1.80        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64
      1.42 ±  3%      -0.6        0.80        perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.alloc_thread_stack_node
      1.34 ±  3%      -0.6        0.75        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range
      2.19            -0.6        1.60        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.do_statx
      1.25 ±  4%      -0.5        0.71 ±  3%  perf-profile.calltrace.cycles-pp.remove_vm_area.__vunmap.free_work.process_one_work.worker_thread
      1.47            -0.4        1.06        perf-profile.calltrace.cycles-pp.__fxstat
      1.40            -0.4        1.02        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newlstat
      1.40            -0.4        1.02        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newstat
      4.26            -0.4        3.90        perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      3.93            -0.4        3.57        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
      4.02            -0.3        3.68        perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      5.57            -0.3        5.23        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      5.50            -0.3        5.16        perf-profile.calltrace.cycles-pp.cpu_startup_entry.secondary_startup_64_no_verify
      5.49            -0.3        5.16        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.secondary_startup_64_no_verify
      2.31            -0.3        1.98        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
      2.28            -0.3        1.96        perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
      1.58            -0.3        1.26 ±  2%  perf-profile.calltrace.cycles-pp.find_idlest_group.find_idlest_cpu.select_task_rq_fair.wake_up_new_task.kernel_clone
      1.49            -0.3        1.18 ±  2%  perf-profile.calltrace.cycles-pp.update_sg_wakeup_stats.find_idlest_group.find_idlest_cpu.select_task_rq_fair.wake_up_new_task
      2.49            -0.3        2.22        perf-profile.calltrace.cycles-pp.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.50            -0.3        2.22        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.50            -0.3        2.22        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.49 ±  2%      -0.3        2.22        perf-profile.calltrace.cycles-pp.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.09 ±  2%      -0.3        0.83        perf-profile.calltrace.cycles-pp.__vmalloc_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct.copy_process
      0.97            -0.2        0.72 ±  2%  perf-profile.calltrace.cycles-pp.kmem_cache_alloc.getname_flags.user_path_at_empty.vfs_statx.do_statx
      0.82            -0.2        0.59 ±  2%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      1.14 ±  3%      -0.2        0.93 ±  2%  perf-profile.calltrace.cycles-pp.exit_notify.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.74            -0.2        0.54 ±  4%  perf-profile.calltrace.cycles-pp.shim_statx
      0.74            -0.2        0.55        perf-profile.calltrace.cycles-pp.cp_statx.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.86 ±  2%      -0.2        0.67        perf-profile.calltrace.cycles-pp.vm_area_alloc_pages.__vmalloc_area_node.__vmalloc_node_range.alloc_thread_stack_node.dup_task_struct
      0.80 ±  2%      -0.2        0.63        perf-profile.calltrace.cycles-pp.__alloc_pages_bulk.vm_area_alloc_pages.__vmalloc_area_node.__vmalloc_node_range.alloc_thread_stack_node
      1.66            -0.2        1.49 ±  2%  perf-profile.calltrace.cycles-pp.find_idlest_cpu.select_task_rq_fair.wake_up_new_task.kernel_clone.__do_sys_clone
      1.67            -0.2        1.51 ±  2%  perf-profile.calltrace.cycles-pp.select_task_rq_fair.wake_up_new_task.kernel_clone.__do_sys_clone.do_syscall_64
      0.84 ±  3%      -0.1        0.70 ±  2%  perf-profile.calltrace.cycles-pp.release_task.exit_notify.do_exit.__x64_sys_exit.do_syscall_64
      2.06            -0.1        1.94        perf-profile.calltrace.cycles-pp.wake_up_new_task.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.67 ±  6%      -0.1        0.60 ±  2%  perf-profile.calltrace.cycles-pp.schedule.futex_wait_queue.futex_wait.do_futex.__x64_sys_futex
      0.68 ±  6%      -0.1        0.61 ±  2%  perf-profile.calltrace.cycles-pp.futex_wait_queue.futex_wait.do_futex.__x64_sys_futex.do_syscall_64
      0.66 ±  6%      -0.1        0.60 ±  2%  perf-profile.calltrace.cycles-pp.__schedule.schedule.futex_wait_queue.futex_wait.do_futex
      0.78 ±  5%      -0.1        0.71 ±  2%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__pthread_timedjoin_ex
      0.76 ±  5%      -0.1        0.70 ±  2%  perf-profile.calltrace.cycles-pp.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe.__pthread_timedjoin_ex
      0.77 ±  5%      -0.1        0.71 ±  2%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__pthread_timedjoin_ex
      0.67 ±  2%      -0.0        0.63 ±  2%  perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.61 ±  2%      -0.0        0.58 ±  2%  perf-profile.calltrace.cycles-pp.put_task_stack.finish_task_switch.__schedule.schedule_idle.do_idle
      0.66 ±  2%      +0.0        0.69 ±  2%  perf-profile.calltrace.cycles-pp.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe.start_thread
      0.66            +0.0        0.69 ±  2%  perf-profile.calltrace.cycles-pp.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe.start_thread
      0.68 ±  2%      +0.0        0.72        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.start_thread
      0.68 ±  2%      +0.0        0.73        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.start_thread
      0.54 ±  2%      +0.1        0.60 ±  2%  perf-profile.calltrace.cycles-pp.lookup_fast.walk_component.path_lookupat.filename_lookup.user_path_at_empty
      0.80 ±  2%      +0.1        0.87        perf-profile.calltrace.cycles-pp.start_thread
      0.97 ±  2%      +0.1        1.08        perf-profile.calltrace.cycles-pp.walk_component.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
     28.57            +0.2       28.77        perf-profile.calltrace.cycles-pp.statx
      1.48            +0.3        1.81        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
      1.44            +0.3        1.78        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_statx.do_statx.__x64_sys_statx
      1.44            +0.4        1.80        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.46            +0.4        1.81        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.40            +0.4        1.76        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_statx.__do_sys_newstat.do_syscall_64
      1.41            +0.4        1.78        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_statx.__do_sys_newlstat.do_syscall_64
     13.42            +0.5       13.89        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
     11.48            +1.1       12.56        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12.50            +1.1       13.63        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     24.25            +1.4       25.63        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.statx
     23.80            +1.5       25.30        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      5.17            +1.6        6.78        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.do_statx
      5.48            +1.6        7.09        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
      5.45            +1.6        7.07        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.do_statx.__x64_sys_statx
      9.01            +1.6       10.64        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx
      8.75            +1.7       10.45        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.do_statx
      4.97            +1.7        6.67        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.__do_sys_newstat
      5.26            +1.7        6.99        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.24            +1.7        6.97        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.__do_sys_newstat.do_syscall_64
      5.05            +1.7        6.78        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.__do_sys_newlstat
      5.35            +1.7        7.10        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.33            +1.7        7.07        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.__do_sys_newlstat.do_syscall_64
      8.64            +1.8       10.48        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64
     22.48            +1.9       24.34        perf-profile.calltrace.cycles-pp.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      8.48            +1.9       10.35        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newlstat
      9.68            +1.9       11.56        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64
      9.48            +1.9       11.39        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newstat
     22.02            +2.0       24.02        perf-profile.calltrace.cycles-pp.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
     21.94            +2.2       24.16        perf-profile.calltrace.cycles-pp.__lxstat64
     22.89            +2.2       25.13        perf-profile.calltrace.cycles-pp.__xstat
     20.94            +2.3       23.22        perf-profile.calltrace.cycles-pp.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe
     20.40            +2.6       23.04        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__lxstat64
     21.34            +2.7       24.02        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__xstat
     20.22            +2.7       22.91        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     21.14            +2.7       23.88        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat
     19.54            +2.9       22.42        perf-profile.calltrace.cycles-pp.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     20.46            +2.9       23.38        perf-profile.calltrace.cycles-pp.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat
     18.78            +3.1       21.84        perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     19.68            +3.1       22.79        perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat
     20.81            +6.4       27.23        perf-profile.calltrace.cycles-pp.complete_walk.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
     20.65            +6.5       27.12        perf-profile.calltrace.cycles-pp.try_to_unlazy.complete_walk.path_lookupat.filename_lookup.user_path_at_empty
     20.38            +6.5       26.92        perf-profile.calltrace.cycles-pp.__legitimize_path.try_to_unlazy.complete_walk.path_lookupat.filename_lookup
     19.93            +6.6       26.52        perf-profile.calltrace.cycles-pp.lockref_get_not_dead.__legitimize_path.try_to_unlazy.complete_walk.path_lookupat
      9.64            -2.4        7.24        perf-profile.children.cycles-pp.kernel_clone
      9.05            -2.4        6.64        perf-profile.children.cycles-pp.getname_flags
      9.97            -2.4        7.57        perf-profile.children.cycles-pp.__clone
      9.64            -2.4        7.24        perf-profile.children.cycles-pp.__do_sys_clone
      7.54 ±  2%      -2.3        5.27        perf-profile.children.cycles-pp.copy_process
      5.80 ±  2%      -1.9        3.91        perf-profile.children.cycles-pp.dup_task_struct
      4.54 ±  2%      -1.7        2.88        perf-profile.children.cycles-pp.alloc_thread_stack_node
      3.68 ±  3%      -1.5        2.13        perf-profile.children.cycles-pp._raw_spin_lock
      3.24 ±  4%      -1.5        1.70 ±  2%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      4.16 ±  2%      -1.5        2.67        perf-profile.children.cycles-pp.__vmalloc_node_range
      5.13            -1.4        3.74        perf-profile.children.cycles-pp.strncpy_from_user
      3.06 ±  2%      -1.2        1.83 ±  2%  perf-profile.children.cycles-pp.__get_vm_area_node
      2.72 ±  2%      -1.0        1.69 ±  2%  perf-profile.children.cycles-pp.alloc_vmap_area
      3.38            -1.0        2.42        perf-profile.children.cycles-pp.__entry_text_start
      2.54 ±  3%      -0.9        1.68        perf-profile.children.cycles-pp.kthread
      2.48 ±  3%      -0.8        1.64        perf-profile.children.cycles-pp.worker_thread
      2.70 ±  3%      -0.8        1.88        perf-profile.children.cycles-pp.ret_from_fork
      2.90            -0.8        2.10        perf-profile.children.cycles-pp.syscall_return_via_sysret
      2.01 ±  4%      -0.8        1.24 ±  2%  perf-profile.children.cycles-pp.process_one_work
      1.96 ±  4%      -0.8        1.19 ±  2%  perf-profile.children.cycles-pp.__vunmap
      1.98 ±  4%      -0.8        1.21 ±  2%  perf-profile.children.cycles-pp.free_work
      3.00            -0.7        2.32        perf-profile.children.cycles-pp.link_path_walk
      2.42            -0.6        1.80        perf-profile.children.cycles-pp.kmem_cache_alloc
      2.18            -0.6        1.59        perf-profile.children.cycles-pp.__check_object_size
      1.25 ±  4%      -0.5        0.71 ±  3%  perf-profile.children.cycles-pp.remove_vm_area
      1.84            -0.5        1.36        perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      1.69            -0.5        1.21        perf-profile.children.cycles-pp.__fxstat
      0.81 ±  5%      -0.4        0.39 ±  3%  perf-profile.children.cycles-pp.find_vmap_area
      2.16            -0.4        1.76        perf-profile.children.cycles-pp.kmem_cache_free
      4.31            -0.4        3.95        perf-profile.children.cycles-pp.cpuidle_idle_call
      4.06            -0.3        3.72        perf-profile.children.cycles-pp.cpuidle_enter_state
      4.06            -0.3        3.72        perf-profile.children.cycles-pp.cpuidle_enter
      5.57            -0.3        5.23        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
      5.57            -0.3        5.23        perf-profile.children.cycles-pp.cpu_startup_entry
      5.56            -0.3        5.22        perf-profile.children.cycles-pp.do_idle
      2.34            -0.3        2.01        perf-profile.children.cycles-pp.intel_idle
      2.32            -0.3        1.99        perf-profile.children.cycles-pp.mwait_idle_with_hints
      1.59            -0.3        1.27 ±  2%  perf-profile.children.cycles-pp.find_idlest_group
      1.53            -0.3        1.22 ±  2%  perf-profile.children.cycles-pp.update_sg_wakeup_stats
      0.80 ±  3%      -0.3        0.49 ±  3%  perf-profile.children.cycles-pp.free_vmap_area_noflush
      1.27            -0.3        0.96        perf-profile.children.cycles-pp.cp_new_stat
      1.21            -0.3        0.91 ±  2%  perf-profile.children.cycles-pp._copy_to_user
      1.20            -0.3        0.91        perf-profile.children.cycles-pp.__might_resched
      2.90            -0.3        2.62        perf-profile.children.cycles-pp.walk_component
      1.10 ±  2%      -0.3        0.83        perf-profile.children.cycles-pp.__vmalloc_area_node
      3.16            -0.2        2.91        perf-profile.children.cycles-pp.__x64_sys_exit
      3.16            -0.2        2.91        perf-profile.children.cycles-pp.do_exit
      0.99            -0.2        0.75        perf-profile.children.cycles-pp.__might_fault
      0.91            -0.2        0.69 ±  2%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      1.15 ±  3%      -0.2        0.93 ±  2%  perf-profile.children.cycles-pp.exit_notify
      0.77            -0.2        0.56 ±  2%  perf-profile.children.cycles-pp.__check_heap_object
      0.76            -0.2        0.56 ±  4%  perf-profile.children.cycles-pp.shim_statx
      3.20 ±  2%      -0.2        3.00        perf-profile.children.cycles-pp.__schedule
      0.35 ±  4%      -0.2        0.15 ±  6%  perf-profile.children.cycles-pp.find_vm_area
      0.76            -0.2        0.56 ±  2%  perf-profile.children.cycles-pp.cp_statx
      0.90            -0.2        0.70 ±  2%  perf-profile.children.cycles-pp.memcg_slab_free_hook
      0.86 ±  2%      -0.2        0.67        perf-profile.children.cycles-pp.vm_area_alloc_pages
      1.48 ±  3%      -0.2        1.30        perf-profile.children.cycles-pp.schedule
      0.72            -0.2        0.55 ±  3%  perf-profile.children.cycles-pp.vfs_getattr_nosec
      0.81 ±  2%      -0.2        0.64        perf-profile.children.cycles-pp.__alloc_pages_bulk
      1.66            -0.2        1.50 ±  2%  perf-profile.children.cycles-pp.find_idlest_cpu
      1.68            -0.2        1.53 ±  2%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.76 ±  2%      -0.2        0.61        perf-profile.children.cycles-pp.path_init
      0.56            -0.2        0.42 ±  2%  perf-profile.children.cycles-pp.syscall_enter_from_user_mode
      0.56 ±  2%      -0.1        0.41 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.84 ±  3%      -0.1        0.70 ±  2%  perf-profile.children.cycles-pp.release_task
      0.50 ±  2%      -0.1        0.36        perf-profile.children.cycles-pp.__virt_addr_valid
      0.92 ±  2%      -0.1        0.78 ±  3%  perf-profile.children.cycles-pp.step_into
      0.64            -0.1        0.50        perf-profile.children.cycles-pp.__might_sleep
      0.58 ±  2%      -0.1        0.44        perf-profile.children.cycles-pp.clear_page_erms
      0.74 ±  2%      -0.1        0.61 ±  3%  perf-profile.children.cycles-pp.inode_permission
      2.06            -0.1        1.94        perf-profile.children.cycles-pp.wake_up_new_task
      1.57            -0.1        1.45 ±  2%  perf-profile.children.cycles-pp.lookup_fast
      0.59 ±  2%      -0.1        0.47        perf-profile.children.cycles-pp.sched_yield
      0.41 ±  6%      -0.1        0.30 ±  2%  perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.35            -0.1        0.25 ±  4%  perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
      0.40 ±  2%      -0.1        0.30 ±  3%  perf-profile.children.cycles-pp.__cond_resched
      0.84            -0.1        0.74 ±  3%  perf-profile.children.cycles-pp.__d_lookup_rcu
      0.50            -0.1        0.41 ±  2%  perf-profile.children.cycles-pp.__x64_sys_sched_yield
      1.56 ±  3%      -0.1        1.47        perf-profile.children.cycles-pp.pick_next_task_fair
      0.51 ±  2%      -0.1        0.42 ±  2%  perf-profile.children.cycles-pp.memcpy_erms
      0.49 ±  3%      -0.1        0.40        perf-profile.children.cycles-pp.arch_dup_task_struct
      0.25 ±  3%      -0.1        0.16 ±  4%  perf-profile.children.cycles-pp.insert_vmap_area
      0.33 ±  3%      -0.1        0.24        perf-profile.children.cycles-pp.pfn_valid
      0.30 ±  3%      -0.1        0.22 ±  3%  perf-profile.children.cycles-pp.alloc_pid
      0.45 ±  2%      -0.1        0.36 ±  3%  perf-profile.children.cycles-pp.generic_permission
      0.33 ±  3%      -0.1        0.25 ±  9%  perf-profile.children.cycles-pp.stress_fstat_helper
      0.29            -0.1        0.22 ±  3%  perf-profile.children.cycles-pp.putname
      0.39 ±  3%      -0.1        0.31 ±  2%  perf-profile.children.cycles-pp.kmem_cache_alloc_node
      0.59 ±  2%      -0.1        0.52        perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
      0.37            -0.1        0.30        perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.28 ±  3%      -0.1        0.21 ±  3%  perf-profile.children.cycles-pp.map_id_up
      0.68 ±  6%      -0.1        0.61 ±  2%  perf-profile.children.cycles-pp.futex_wait_queue
      1.20 ±  2%      -0.1        1.13        perf-profile.children.cycles-pp.rcu_core
      0.30 ±  4%      -0.1        0.24 ±  2%  perf-profile.children.cycles-pp.obj_cgroup_charge_pages
      0.21 ±  5%      -0.1        0.15 ±  7%  perf-profile.children.cycles-pp.cgroup_can_fork
      1.16 ±  2%      -0.1        1.09        perf-profile.children.cycles-pp.rcu_do_batch
      0.56 ±  3%      -0.1        0.49        perf-profile.children.cycles-pp.page_counter_uncharge
      0.27 ±  2%      -0.1        0.21 ±  3%  perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook
      0.34 ±  5%      -0.1        0.28 ±  3%  perf-profile.children.cycles-pp.nd_jump_root
      0.25 ±  6%      -0.1        0.19 ±  5%  perf-profile.children.cycles-pp.refcount_dec_not_one
      0.25 ±  6%      -0.1        0.19 ±  5%  perf-profile.children.cycles-pp.cgroup_free
      0.76 ±  5%      -0.1        0.70 ±  2%  perf-profile.children.cycles-pp.__x64_sys_futex
      0.18 ±  5%      -0.1        0.12 ±  5%  perf-profile.children.cycles-pp.cgroup_release
      0.20 ±  3%      -0.1        0.14 ±  4%  perf-profile.children.cycles-pp.cgroup_post_fork
      1.06 ±  4%      -0.1        1.00 ±  2%  perf-profile.children.cycles-pp.do_futex
      0.43 ±  2%      -0.1        0.37        perf-profile.children.cycles-pp.__legitimize_mnt
      0.29            -0.1        0.23 ±  2%  perf-profile.children.cycles-pp.cpumask_next
      0.30 ±  3%      -0.1        0.25 ±  3%  perf-profile.children.cycles-pp.terminate_walk
      0.21 ±  3%      -0.1        0.16 ±  3%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
      0.22 ±  2%      -0.1        0.17 ±  2%  perf-profile.children.cycles-pp.__do_sys_newfstat
      0.23 ±  2%      -0.1        0.18 ±  2%  perf-profile.children.cycles-pp.generic_fillattr
      0.21 ±  3%      -0.1        0.16 ±  4%  perf-profile.children.cycles-pp._raw_write_lock_irq
      0.18 ±  3%      -0.1        0.13 ±  4%  perf-profile.children.cycles-pp.security_inode_permission
      0.17 ±  2%      -0.1        0.12        perf-profile.children.cycles-pp.__x64_sys_newlstat
      0.23 ±  2%      -0.1        0.18 ±  3%  perf-profile.children.cycles-pp.page_counter_charge
      0.20 ±  2%      -0.1        0.15 ±  3%  perf-profile.children.cycles-pp.rcu_all_qs
      0.38 ±  3%      -0.0        0.33 ±  3%  perf-profile.children.cycles-pp.__put_task_struct
      0.13 ±  5%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.insert_vmap_area_augment
      0.14 ±  4%      -0.0        0.10 ±  5%  perf-profile.children.cycles-pp.propagate_protected_usage
      0.22 ±  4%      -0.0        0.18 ±  2%  perf-profile.children.cycles-pp.__memcg_kmem_charge_page
      0.17 ±  4%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.__x64_sys_newstat
      0.17 ±  2%      -0.0        0.13 ±  5%  perf-profile.children.cycles-pp.from_kuid_munged
      0.28 ±  3%      -0.0        0.24 ±  2%  perf-profile.children.cycles-pp.try_to_wake_up
      0.17 ±  3%      -0.0        0.13 ±  2%  perf-profile.children.cycles-pp.vfs_fstat
      0.17 ±  4%      -0.0        0.13 ±  2%  perf-profile.children.cycles-pp.from_kgid_munged
      0.14 ±  3%      -0.0        0.10 ±  4%  perf-profile.children.cycles-pp.check_stack_object
      0.45 ±  2%      -0.0        0.41 ±  2%  perf-profile.children.cycles-pp.page_counter_cancel
      0.18 ±  7%      -0.0        0.14 ±  2%  perf-profile.children.cycles-pp.mntput_no_expire
      0.12 ±  6%      -0.0        0.09 ±  5%  perf-profile.children.cycles-pp.cgroup_exit
      0.21 ±  4%      -0.0        0.17 ±  3%  perf-profile.children.cycles-pp.___slab_alloc
      0.65 ±  2%      -0.0        0.62        perf-profile.children.cycles-pp.put_task_stack
      0.22 ±  4%      -0.0        0.19 ±  3%  perf-profile.children.cycles-pp.perf_iterate_sb
      0.16 ±  4%      -0.0        0.12        perf-profile.children.cycles-pp.add_device_randomness
      0.10 ±  3%      -0.0        0.07 ± 11%  perf-profile.children.cycles-pp.cgroup_css_set_fork
      0.07 ±  7%      -0.0        0.03 ± 70%  perf-profile.children.cycles-pp.css_set_move_task
      0.12 ±  4%      -0.0        0.09 ±  5%  perf-profile.children.cycles-pp.rb_insert_color
      0.29 ±  2%      -0.0        0.26 ±  3%  perf-profile.children.cycles-pp._find_next_bit
      0.13 ±  2%      -0.0        0.10 ±  4%  perf-profile.children.cycles-pp.sched_post_fork
      0.35            -0.0        0.32 ±  2%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.14 ±  5%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.do_sched_yield
      0.24 ±  3%      -0.0        0.21 ±  4%  perf-profile.children.cycles-pp.__fget_light
      0.20 ±  3%      -0.0        0.17 ±  5%  perf-profile.children.cycles-pp.update_curr
      0.18 ±  4%      -0.0        0.15 ±  6%  perf-profile.children.cycles-pp.perf_event_task_output
      0.17 ±  7%      -0.0        0.14 ±  8%  perf-profile.children.cycles-pp.menu_select
      0.09 ±  7%      -0.0        0.06 ± 15%  perf-profile.children.cycles-pp.__purge_vmap_area_lazy
      0.11 ±  8%      -0.0        0.08 ±  7%  perf-profile.children.cycles-pp.pids_can_fork
      0.06 ±  6%      -0.0        0.03 ± 70%  perf-profile.children.cycles-pp.__free_pages
      0.22 ±  7%      -0.0        0.20 ±  2%  perf-profile.children.cycles-pp.set_root
      0.16 ±  4%      -0.0        0.13 ±  5%  perf-profile.children.cycles-pp.wake_up_q
      0.19 ±  3%      -0.0        0.16 ±  4%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.14 ±  3%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.__queue_work
      0.13 ±  9%      -0.0        0.10 ± 11%  perf-profile.children.cycles-pp.__lookup_mnt
      0.32            -0.0        0.29 ±  2%  perf-profile.children.cycles-pp.sched_move_task
      0.10 ±  4%      -0.0        0.07 ±  8%  perf-profile.children.cycles-pp.__x64_sys_newfstat
      0.10 ±  4%      -0.0        0.07        perf-profile.children.cycles-pp.task_rq_lock
      0.10 ±  4%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.vunmap_range_noflush
      0.21 ±  4%      -0.0        0.19 ±  3%  perf-profile.children.cycles-pp.unmap_page_range
      0.11 ±  4%      -0.0        0.09 ±  4%  perf-profile.children.cycles-pp._mix_pool_bytes
      0.09 ±  7%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.cpu_cgroup_fork
      0.14 ±  4%      -0.0        0.12 ±  5%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.15 ±  5%      -0.0        0.12 ±  3%  perf-profile.children.cycles-pp.queue_work_on
      0.09 ±  7%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.copy_thread
      0.08 ±  6%      -0.0        0.05 ±  7%  perf-profile.children.cycles-pp.idr_alloc_u32
      0.10 ±  5%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.obj_cgroup_charge
      0.06 ±  7%      -0.0        0.04 ± 44%  perf-profile.children.cycles-pp.detach_entity_cfs_rq
      0.19 ±  5%      -0.0        0.17 ±  5%  perf-profile.children.cycles-pp.zap_pmd_range
      0.10 ±  4%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.perf_event_fork
      0.10 ±  5%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.__list_add_valid
      0.08 ±  5%      -0.0        0.06 ±  6%  perf-profile.children.cycles-pp.task_fork_fair
      0.08 ±  6%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.idr_alloc_cyclic
      0.12 ±  4%      -0.0        0.10 ±  5%  perf-profile.children.cycles-pp.native_sched_clock
      0.07 ±  5%      -0.0        0.05 ±  7%  perf-profile.children.cycles-pp.should_failslab
      0.12 ±  6%      -0.0        0.10 ±  9%  perf-profile.children.cycles-pp.__fget_files
      0.24            -0.0        0.22 ±  4%  perf-profile.children.cycles-pp.account_kernel_stack
      0.07            -0.0        0.05 ±  7%  perf-profile.children.cycles-pp.refill_stock
      0.11 ±  6%      -0.0        0.09        perf-profile.children.cycles-pp.native_irq_return_iret
      0.09 ±  5%      -0.0        0.07 ±  5%  perf-profile.children.cycles-pp.task_change_group_fair
      0.15 ±  5%      -0.0        0.13        perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.12 ±  3%      -0.0        0.10 ±  3%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.08 ±  6%      -0.0        0.06 ±  6%  perf-profile.children.cycles-pp.__perf_event_header__init_id
      0.08 ±  6%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.pids_release
      0.09 ±  4%      +0.0        0.10        perf-profile.children.cycles-pp.__x64_sys_rt_sigprocmask
      0.07 ±  6%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.14 ±  3%      +0.0        0.16 ±  4%  perf-profile.children.cycles-pp.sigprocmask
      0.06 ±  6%      +0.0        0.08 ± 10%  perf-profile.children.cycles-pp.llist_add_batch
      0.36            +0.0        0.38        perf-profile.children.cycles-pp.update_load_avg
      0.06 ±  9%      +0.0        0.08 ± 10%  perf-profile.children.cycles-pp.tid_fd_revalidate
      0.04 ± 44%      +0.0        0.06 ±  6%  perf-profile.children.cycles-pp.task_tick_fair
      0.18 ±  4%      +0.0        0.20        perf-profile.children.cycles-pp.scheduler_tick
      0.06 ±  7%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.try_get_compound_head
      0.23 ±  4%      +0.0        0.25 ±  2%  perf-profile.children.cycles-pp.pick_link
      0.14 ±  2%      +0.0        0.17 ±  2%  perf-profile.children.cycles-pp.kfree
      0.12 ±  3%      +0.0        0.15        perf-profile.children.cycles-pp.internal_get_user_pages_fast
      0.11 ±  3%      +0.0        0.14        perf-profile.children.cycles-pp.gup_pgd_range
      0.04 ± 44%      +0.0        0.07        perf-profile.children.cycles-pp.schedule_tail
      0.13 ±  4%      +0.0        0.16        perf-profile.children.cycles-pp.get_futex_key
      0.08 ±  5%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.gup_pte_range
      0.26 ±  5%      +0.0        0.29 ±  4%  perf-profile.children.cycles-pp.update_process_times
      0.12 ±  5%      +0.0        0.15        perf-profile.children.cycles-pp.lockless_pages_from_mm
      0.26 ±  6%      +0.0        0.30 ±  4%  perf-profile.children.cycles-pp.tick_sched_handle
      0.15 ±  5%      +0.0        0.18 ±  3%  perf-profile.children.cycles-pp.__slab_free
      0.02 ± 99%      +0.0        0.06        perf-profile.children.cycles-pp.task_dump_owner
      0.13 ±  5%      +0.0        0.16 ±  4%  perf-profile.children.cycles-pp.proc_pid_get_link
      0.28 ±  5%      +0.0        0.32 ±  4%  perf-profile.children.cycles-pp.tick_sched_timer
      0.02 ± 99%      +0.0        0.07 ±  8%  perf-profile.children.cycles-pp.get_pid_task
      0.18 ±  4%      +0.0        0.23 ±  4%  perf-profile.children.cycles-pp.__unfreeze_partials
      0.19 ±  3%      +0.0        0.24 ±  3%  perf-profile.children.cycles-pp.try_to_unlazy_next
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.__cleanup_sighand
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.00            +0.1        0.06 ±  8%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.01 ±223%      +0.1        0.07        perf-profile.children.cycles-pp.memset_erms
      0.81            +0.1        0.88        perf-profile.children.cycles-pp.start_thread
      0.00            +0.1        0.08 ±  6%  perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      0.52 ±  3%      +0.1        0.64 ±  3%  perf-profile.children.cycles-pp.lockref_put_return
      4.41            +1.0        5.44        perf-profile.children.cycles-pp.security_inode_getattr
      4.27            +1.1        5.33        perf-profile.children.cycles-pp.common_perm_cond
     22.53            +1.8       24.38        perf-profile.children.cycles-pp.__x64_sys_statx
     22.07            +2.0       24.05        perf-profile.children.cycles-pp.do_statx
     22.36            +2.1       24.46        perf-profile.children.cycles-pp.__lxstat64
     23.33            +2.1       25.43        perf-profile.children.cycles-pp.__xstat
     37.56            +2.6       40.19        perf-profile.children.cycles-pp.user_path_at_empty
     19.57            +2.9       22.44        perf-profile.children.cycles-pp.__do_sys_newlstat
     20.49            +2.9       23.40        perf-profile.children.cycles-pp.__do_sys_newstat
     81.71            +3.7       85.40        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     80.95            +3.9       84.83        perf-profile.children.cycles-pp.do_syscall_64
     16.12            +5.1       21.20        perf-profile.children.cycles-pp.path_put
     15.35            +5.1       20.45        perf-profile.children.cycles-pp.lockref_put_or_lock
     16.34            +5.1       21.48        perf-profile.children.cycles-pp.dput
     27.38            +5.3       32.71        perf-profile.children.cycles-pp.filename_lookup
     26.84            +5.4       32.29        perf-profile.children.cycles-pp.path_lookupat
     20.84            +6.4       27.25        perf-profile.children.cycles-pp.complete_walk
     20.71            +6.4       27.16        perf-profile.children.cycles-pp.try_to_unlazy
     20.61            +6.5       27.16        perf-profile.children.cycles-pp.__legitimize_path
     20.13            +6.6       26.76        perf-profile.children.cycles-pp.lockref_get_not_dead
     59.52            +8.4       67.94        perf-profile.children.cycles-pp.vfs_statx
      3.21 ±  4%      -1.5        1.69 ±  2%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      2.86            -0.8        2.07        perf-profile.self.cycles-pp.syscall_return_via_sysret
      2.28            -0.6        1.66        perf-profile.self.cycles-pp.strncpy_from_user
      1.98            -0.6        1.42        perf-profile.self.cycles-pp.statx
      1.25            -0.3        0.90        perf-profile.self.cycles-pp.syscall_exit_to_user_mode
      1.30            -0.3        0.96        perf-profile.self.cycles-pp.kmem_cache_alloc
      1.22            -0.3        0.88        perf-profile.self.cycles-pp.__entry_text_start
      2.30            -0.3        1.98        perf-profile.self.cycles-pp.mwait_idle_with_hints
      1.10            -0.3        0.83 ±  2%  perf-profile.self.cycles-pp.__might_resched
      1.02 ±  2%      -0.3        0.76        perf-profile.self.cycles-pp.kmem_cache_free
      1.27            -0.3        1.02 ±  2%  perf-profile.self.cycles-pp.update_sg_wakeup_stats
      0.85 ±  2%      -0.2        0.60 ±  6%  perf-profile.self.cycles-pp.alloc_vmap_area
      0.87            -0.2        0.64        perf-profile.self.cycles-pp.link_path_walk
      0.88            -0.2        0.66 ±  2%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.85            -0.2        0.63        perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.82 ±  2%      -0.2        0.62 ±  2%  perf-profile.self.cycles-pp.__check_object_size
      0.78            -0.2        0.58        perf-profile.self.cycles-pp.getname_flags
      0.66            -0.2        0.46        perf-profile.self.cycles-pp.__xstat
      0.72            -0.2        0.52 ±  4%  perf-profile.self.cycles-pp.shim_statx
      0.70            -0.2        0.51 ±  2%  perf-profile.self.cycles-pp.__check_heap_object
      0.70            -0.2        0.52 ±  2%  perf-profile.self.cycles-pp.do_syscall_64
      0.64            -0.2        0.46 ±  2%  perf-profile.self.cycles-pp.__lxstat64
      0.94            -0.2        0.78 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.57 ±  2%      -0.1        0.44        perf-profile.self.cycles-pp.vfs_statx
      0.58 ±  2%      -0.1        0.44        perf-profile.self.cycles-pp.clear_page_erms
      0.53 ±  2%      -0.1        0.40 ±  3%  perf-profile.self.cycles-pp.step_into
      0.48            -0.1        0.35        perf-profile.self.cycles-pp.syscall_enter_from_user_mode
      0.48            -0.1        0.36 ±  2%  perf-profile.self.cycles-pp.vfs_getattr_nosec
      0.43            -0.1        0.31        perf-profile.self.cycles-pp.__x64_sys_statx
      0.53 ±  2%      -0.1        0.41        perf-profile.self.cycles-pp.__might_sleep
      0.52 ±  2%      -0.1        0.41 ±  2%  perf-profile.self.cycles-pp.filename_lookup
      0.46            -0.1        0.35 ±  3%  perf-profile.self.cycles-pp.memcg_slab_free_hook
      0.35 ±  2%      -0.1        0.25 ±  3%  perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
      0.35            -0.1        0.25        perf-profile.self.cycles-pp.__fxstat
      0.40 ±  2%      -0.1        0.30 ±  2%  perf-profile.self.cycles-pp.lookup_fast
      0.33 ±  3%      -0.1        0.24 ±  2%  perf-profile.self.cycles-pp.do_statx
      0.36            -0.1        0.27 ±  3%  perf-profile.self.cycles-pp.path_lookupat
      0.50 ±  3%      -0.1        0.41 ±  2%  perf-profile.self.cycles-pp.memcpy_erms
      0.31 ±  2%      -0.1        0.22 ±  2%  perf-profile.self.cycles-pp.path_init
      0.80 ±  2%      -0.1        0.71 ±  3%  perf-profile.self.cycles-pp.__d_lookup_rcu
      0.34 ±  2%      -0.1        0.26        perf-profile.self.cycles-pp.walk_component
      0.30            -0.1        0.22 ±  3%  perf-profile.self.cycles-pp.user_path_at_empty
      0.41 ±  2%      -0.1        0.34 ±  3%  perf-profile.self.cycles-pp.generic_permission
      0.26 ±  4%      -0.1        0.19 ±  2%  perf-profile.self.cycles-pp.pfn_valid
      0.23 ±  2%      -0.1        0.16 ±  2%  perf-profile.self.cycles-pp.find_vmap_area
      0.26 ±  3%      -0.1        0.19 ±  3%  perf-profile.self.cycles-pp.map_id_up
      0.27 ±  4%      -0.1        0.20 ±  4%  perf-profile.self.cycles-pp.inode_permission
      0.25            -0.1        0.18 ±  3%  perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.18 ±  4%      -0.1        0.12 ±  3%  perf-profile.self.cycles-pp.insert_vmap_area
      0.24 ±  2%      -0.1        0.18 ±  6%  perf-profile.self.cycles-pp.cp_statx
      0.25 ±  6%      -0.1        0.19 ±  5%  perf-profile.self.cycles-pp.refcount_dec_not_one
      0.20 ±  3%      -0.1        0.14 ±  2%  perf-profile.self.cycles-pp.__vmalloc_area_node
      0.27 ±  3%      -0.1        0.21 ± 12%  perf-profile.self.cycles-pp.stress_fstat_helper
      0.23 ±  3%      -0.1        0.17 ±  3%  perf-profile.self.cycles-pp.putname
      0.20 ±  3%      -0.1        0.14 ±  3%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.24 ±  2%      -0.1        0.18 ±  2%  perf-profile.self.cycles-pp.free_vmap_area_noflush
      0.25 ±  4%      -0.1        0.19 ±  4%  perf-profile.self.cycles-pp.__cond_resched
      0.26            -0.1        0.20 ±  3%  perf-profile.self.cycles-pp.cp_new_stat
      0.39 ±  3%      -0.1        0.34 ±  2%  perf-profile.self.cycles-pp.__legitimize_mnt
      0.21 ±  3%      -0.1        0.16 ±  4%  perf-profile.self.cycles-pp._raw_write_lock_irq
      0.19 ±  3%      -0.1        0.14 ±  4%  perf-profile.self.cycles-pp.memcg_slab_post_alloc_hook
      0.22 ±  4%      -0.0        0.18 ±  2%  perf-profile.self.cycles-pp.queued_write_lock_slowpath
      0.21 ±  3%      -0.0        0.16 ±  3%  perf-profile.self.cycles-pp.generic_fillattr
      0.16 ±  4%      -0.0        0.11 ±  3%  perf-profile.self.cycles-pp.security_inode_permission
      0.14 ±  4%      -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.propagate_protected_usage
      0.15 ±  3%      -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.__x64_sys_newlstat
      0.16 ±  4%      -0.0        0.12        perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
      0.15 ±  5%      -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.__x64_sys_newstat
      0.15 ±  4%      -0.0        0.12 ±  4%  perf-profile.self.cycles-pp.terminate_walk
      0.11 ±  3%      -0.0        0.07 ±  8%  perf-profile.self.cycles-pp.__alloc_pages_bulk
      0.18 ±  2%      -0.0        0.15 ±  3%  perf-profile.self.cycles-pp.__might_fault
      0.30 ±  2%      -0.0        0.26 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.20 ±  3%      -0.0        0.16 ±  3%  perf-profile.self.cycles-pp.page_counter_charge
      0.14 ±  4%      -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.try_to_unlazy
      0.14 ±  2%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.__do_sys_newlstat
      0.12 ±  6%      -0.0        0.08 ±  4%  perf-profile.self.cycles-pp.complete_walk
      0.06            -0.0        0.02 ± 99%  perf-profile.self.cycles-pp.__free_pages
      0.16 ±  5%      -0.0        0.13 ±  3%  perf-profile.self.cycles-pp.mntput_no_expire
      0.12 ±  5%      -0.0        0.08 ±  8%  perf-profile.self.cycles-pp.rb_insert_color
      0.12 ±  5%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.nd_jump_root
      0.13 ±  6%      -0.0        0.10 ±  5%  perf-profile.self.cycles-pp.__do_sys_newstat
      0.44 ±  2%      -0.0        0.41 ±  2%  perf-profile.self.cycles-pp.page_counter_cancel
      0.18 ±  4%      -0.0        0.15 ±  2%  perf-profile.self.cycles-pp.dput
      0.26            -0.0        0.22 ±  4%  perf-profile.self.cycles-pp._find_next_bit
      0.12            -0.0        0.09 ±  6%  perf-profile.self.cycles-pp._copy_to_user
      0.21 ±  5%      -0.0        0.18 ±  3%  perf-profile.self.cycles-pp.set_root
      0.11 ±  8%      -0.0        0.08 ±  7%  perf-profile.self.cycles-pp.pids_can_fork
      0.10 ±  6%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.rcu_all_qs
      0.10 ±  3%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.check_stack_object
      0.14 ±  5%      -0.0        0.11        perf-profile.self.cycles-pp.dup_task_struct
      0.13 ±  3%      -0.0        0.10 ±  3%  perf-profile.self.cycles-pp.__legitimize_path
      0.10 ±  7%      -0.0        0.07 ±  5%  perf-profile.self.cycles-pp.vunmap_range_noflush
      0.26 ±  3%      -0.0        0.24        perf-profile.self.cycles-pp.__schedule
      0.11 ±  6%      -0.0        0.09 ±  4%  perf-profile.self.cycles-pp._mix_pool_bytes
      0.09 ±  5%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.__x64_sys_newfstat
      0.11 ±  6%      -0.0        0.09 ±  6%  perf-profile.self.cycles-pp.zap_pte_range
      0.09 ±  6%      -0.0        0.07 ±  5%  perf-profile.self.cycles-pp.__list_add_valid
      0.09 ±  5%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.legitimize_links
      0.10            -0.0        0.08 ±  7%  perf-profile.self.cycles-pp.update_curr
      0.11 ±  6%      -0.0        0.09        perf-profile.self.cycles-pp.native_irq_return_iret
      0.10 ±  5%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.security_inode_getattr
      0.09 ±  6%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.cpumask_next
      0.10            -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.enqueue_entity
      0.08 ±  6%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.pids_release
      0.05            +0.0        0.06 ±  6%  perf-profile.self.cycles-pp.__pthread_timedjoin_ex
      0.07 ±  5%      +0.0        0.08 ±  4%  perf-profile.self.cycles-pp.__update_load_avg_se
      0.06 ±  8%      +0.0        0.07        perf-profile.self.cycles-pp.cpuidle_idle_call
      0.05 ±  8%      +0.0        0.07 ± 10%  perf-profile.self.cycles-pp.llist_add_batch
      0.14 ±  2%      +0.0        0.16 ±  4%  perf-profile.self.cycles-pp.update_load_avg
      0.06 ±  7%      +0.0        0.09 ±  5%  perf-profile.self.cycles-pp.try_get_compound_head
      0.11 ±  4%      +0.0        0.13 ±  3%  perf-profile.self.cycles-pp.start_thread
      0.14 ±  3%      +0.0        0.18 ±  3%  perf-profile.self.cycles-pp.__slab_free
      0.02 ± 99%      +0.0        0.07 ±  8%  perf-profile.self.cycles-pp.get_pid_task
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.__cleanup_sighand
      0.01 ±223%      +0.1        0.07        perf-profile.self.cycles-pp.memset_erms
      0.05 ±  8%      +0.1        0.17 ±  4%  perf-profile.self.cycles-pp.find_idlest_cpu
      0.52 ±  3%      +0.1        0.64 ±  3%  perf-profile.self.cycles-pp.lockref_put_return
      4.22            +1.1        5.28        perf-profile.self.cycles-pp.common_perm_cond
     15.20            +5.1       20.28        perf-profile.self.cycles-pp.lockref_put_or_lock
     19.93            +6.6       26.52        perf-profile.self.cycles-pp.lockref_get_not_dead



***************************************************************************************************
lkp-csl-2ap4: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
  gcc-11/performance/1BRD_48G/4M/ext4/1x/x86_64-rhel-8.3/64t/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap4/24G/fsmark/0x500320a

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    124108 ±  2%     -13.8%     106934 ±  7%  fsmark.app_overhead
      1561 ±  4%     -16.3%       1306 ±  4%  fsmark.files_per_sec
      2767 ±  2%      +6.4%       2945 ±  2%  fsmark.time.percent_of_cpu_this_job_got
    199.63 ±  3%     +15.9%     231.38 ±  3%  fsmark.time.system_time
      0.20 ± 16%      +0.1        0.30 ±  9%  mpstat.cpu.all.iowait%
     13988 ±  2%      -7.4%      12948 ±  4%  vmstat.system.cs
     87.82            -1.5%      86.54        iostat.cpu.idle
     11.40 ±  3%     +10.6%      12.61 ±  3%  iostat.cpu.system
   3466502 ±  6%     +12.8%    3911067 ±  2%  turbostat.IRQ
    156.89 ±  3%      -6.9%     146.06        turbostat.PkgWatt
    135.26 ±  6%     +32.0%     178.54 ±  5%  sched_debug.cfs_rq:/.runnable_avg.avg
    282.67 ±  6%     -15.4%     239.26        sched_debug.cfs_rq:/.runnable_avg.stddev
    134.95 ±  6%     +32.0%     178.09 ±  5%  sched_debug.cfs_rq:/.util_avg.avg
    282.30 ±  6%     -15.4%     238.93        sched_debug.cfs_rq:/.util_avg.stddev
    269695 ±  6%     -13.5%     233318 ±  7%  sched_debug.cpu.avg_idle.stddev
   2891810 ±  3%      +4.7%    3027838 ±  2%  proc-vmstat.nr_file_pages
   2300394 ±  3%      +5.9%    2436615 ±  2%  proc-vmstat.nr_inactive_file
     31775            +2.4%      32536        proc-vmstat.nr_kernel_stack
    110156            +3.8%     114369        proc-vmstat.nr_slab_reclaimable
     81885            +7.2%      87818        proc-vmstat.nr_slab_unreclaimable
   2300394 ±  3%      +5.9%    2436615 ±  2%  proc-vmstat.nr_zone_inactive_file
   7873747 ±  5%     -58.4%    3279053 ±  5%  numa-numastat.node0.local_node
   7872482 ±  4%     -57.5%    3343690 ±  6%  numa-numastat.node0.numa_hit
     19031 ±102%    +274.8%      71322 ± 12%  numa-numastat.node0.other_node
   1977839 ± 14%     +68.6%    3335315 ±  7%  numa-numastat.node1.local_node
   2055359 ± 13%     +65.4%    3399152 ±  7%  numa-numastat.node1.numa_hit
   1683926 ± 15%     +93.5%    3259192 ±  7%  numa-numastat.node2.local_node
   1760441 ± 15%     +87.6%    3303316 ±  7%  numa-numastat.node2.numa_hit
   1650883 ± 12%    +103.7%    3363648 ±  2%  numa-numastat.node3.local_node
   1737678 ± 11%     +96.7%    3418864 ±  2%  numa-numastat.node3.numa_hit
 1.274e+08 ±  4%     +22.2%  1.557e+08 ± 12%  perf-stat.i.cache-misses
      3.62 ±  2%     +13.0%       4.09 ±  5%  perf-stat.i.cpi
    329.11 ±  3%      -8.5%     301.10 ±  2%  perf-stat.i.cpu-migrations
   6033964 ±  4%     +19.0%    7178931 ±  6%  perf-stat.i.iTLB-load-misses
      4140 ±  7%     -15.5%       3497 ±  6%  perf-stat.i.instructions-per-iTLB-miss
     29.80 ±  9%      +9.8       39.64 ±  9%  perf-stat.i.node-load-miss-rate%
   8788835 ±  3%     +55.7%   13680401 ± 25%  perf-stat.i.node-load-misses
     40.53 ± 10%      +8.7       49.21 ± 11%  perf-stat.i.node-store-miss-rate%
   5858142 ± 14%     +36.7%    8008011 ± 16%  perf-stat.i.node-store-misses
      4.24 ±  2%     +11.3%       4.72 ±  4%  perf-stat.overall.cpi
      3730 ±  3%     -15.8%       3139 ±  7%  perf-stat.overall.instructions-per-iTLB-miss
      0.24 ±  2%     -10.1%       0.21 ±  4%  perf-stat.overall.ipc
     23.18 ±  5%      +7.2       30.36 ± 16%  perf-stat.overall.node-load-miss-rate%
 1.151e+08 ±  3%     +22.0%  1.403e+08 ± 12%  perf-stat.ps.cache-misses
 8.487e+10 ±  4%     +11.6%  9.469e+10 ±  3%  perf-stat.ps.cpu-cycles
    287.47 ±  2%      -8.8%     262.11        perf-stat.ps.cpu-migrations
   5375619 ±  4%     +19.4%    6420673 ±  6%  perf-stat.ps.iTLB-load-misses
   7927841 ±  3%     +55.4%   12317393 ± 25%  perf-stat.ps.node-load-misses
      3871 ± 30%     -52.0%       1856 ± 44%  numa-meminfo.node0.Active
      1596 ± 16%     -52.2%     763.33 ± 26%  numa-meminfo.node0.Active(anon)
     19800 ± 15%     -65.8%       6767 ± 19%  numa-meminfo.node0.Dirty
   6729746 ± 17%     -31.9%    4581408 ±  4%  numa-meminfo.node0.FilePages
   5621436 ±  8%     -53.6%    2608180 ±  3%  numa-meminfo.node0.Inactive
   5405663 ±  7%     -54.8%    2443705 ±  5%  numa-meminfo.node0.Inactive(file)
    255360 ± 11%     -36.6%     161831 ±  4%  numa-meminfo.node0.KReclaimable
     10545 ±  5%     -11.8%       9302 ±  5%  numa-meminfo.node0.KernelStack
  31945516 ±  4%     +23.4%   39434773        numa-meminfo.node0.MemFree
  17210998 ±  8%     -43.5%    9721741 ±  3%  numa-meminfo.node0.MemUsed
      5381 ± 13%     -63.5%       1966 ± 20%  numa-meminfo.node0.PageTables
    255360 ± 11%     -36.6%     161831 ±  4%  numa-meminfo.node0.SReclaimable
    138151 ±  6%     -18.9%     112057 ±  3%  numa-meminfo.node0.SUnreclaim
    393512 ±  8%     -30.4%     273889 ±  4%  numa-meminfo.node0.Slab
      7272 ± 45%     -75.5%       1778 ±105%  numa-meminfo.node0.Writeback
      3875 ± 45%    +120.3%       8536 ± 27%  numa-meminfo.node1.Dirty
   1483770 ± 12%     +67.7%    2488545 ±  4%  numa-meminfo.node1.Inactive
   1411062 ± 13%     +72.5%    2433514 ±  6%  numa-meminfo.node1.Inactive(file)
     68073 ± 15%     +50.6%     102530 ±  7%  numa-meminfo.node1.KReclaimable
   4945846 ± 12%     +45.9%    7214903 ±  6%  numa-meminfo.node1.MemUsed
     68073 ± 15%     +50.6%     102530 ±  7%  numa-meminfo.node1.SReclaimable
     64408 ± 10%     +25.8%      81052 ±  5%  numa-meminfo.node1.SUnreclaim
    132481 ±  7%     +38.6%     183583 ±  6%  numa-meminfo.node1.Slab
      3891 ± 50%    +128.8%       8902 ± 25%  numa-meminfo.node2.Dirty
   1208578 ± 12%    +109.5%    2531720 ± 11%  numa-meminfo.node2.FilePages
   1235487 ± 11%    +100.3%    2474364 ±  5%  numa-meminfo.node2.Inactive
   1207177 ± 12%     +98.7%    2398227 ±  8%  numa-meminfo.node2.Inactive(file)
     49965 ± 11%     +97.1%      98463 ±  8%  numa-meminfo.node2.KReclaimable
      6777 ±  3%     +10.7%       7503 ±  4%  numa-meminfo.node2.KernelStack
   3942891 ± 13%     +81.2%    7145601 ±  5%  numa-meminfo.node2.MemUsed
     49965 ± 11%     +97.1%      98463 ±  8%  numa-meminfo.node2.SReclaimable
     57878 ±  2%     +36.3%      78874 ±  7%  numa-meminfo.node2.SUnreclaim
    107844 ±  6%     +64.4%     177338 ±  7%  numa-meminfo.node2.Slab
     21.83 ±131%    +6e+05%     131703 ± 92%  numa-meminfo.node2.Unevictable
      2563 ± 64%    +842.9%      24174 ± 88%  numa-meminfo.node3.AnonPages
      4060 ± 60%    +633.6%      29790 ± 86%  numa-meminfo.node3.AnonPages.max
      3439 ± 28%    +247.2%      11941 ± 17%  numa-meminfo.node3.Dirty
   1187567 ± 10%    +110.9%    2504148 ±  4%  numa-meminfo.node3.Inactive
   1177518 ± 10%    +110.1%    2473678 ±  3%  numa-meminfo.node3.Inactive(file)
      7142 ±  6%     +11.3%       7948 ±  6%  numa-meminfo.node3.KernelStack
   4533549 ± 23%     +55.5%    7049648 ±  2%  numa-meminfo.node3.MemUsed
    241.17 ±110%    +660.1%       1833 ± 49%  numa-meminfo.node3.PageTables
    398.83 ± 16%     -52.3%     190.33 ± 26%  numa-vmstat.node0.nr_active_anon
   3742174 ±  5%     -57.7%    1581110 ±  6%  numa-vmstat.node0.nr_dirtied
      5638 ±  6%     -55.4%       2515 ± 17%  numa-vmstat.node0.nr_dirty
   1675683 ± 17%     -31.8%    1142601 ±  4%  numa-vmstat.node0.nr_file_pages
   7987823 ±  4%     +23.4%    9859439        numa-vmstat.node0.nr_free_pages
   1344664 ±  7%     -54.8%     608172 ±  5%  numa-vmstat.node0.nr_inactive_file
     10557 ±  5%     -11.8%       9312 ±  5%  numa-vmstat.node0.nr_kernel_stack
      1343 ± 14%     -63.4%     492.00 ± 19%  numa-vmstat.node0.nr_page_table_pages
     63683 ± 11%     -36.5%      40411 ±  4%  numa-vmstat.node0.nr_slab_reclaimable
     34563 ±  6%     -18.9%      28025 ±  3%  numa-vmstat.node0.nr_slab_unreclaimable
      1978 ± 38%     -80.2%     391.83 ± 64%  numa-vmstat.node0.nr_writeback
   3742175 ±  5%     -57.7%    1581110 ±  6%  numa-vmstat.node0.nr_written
    398.83 ± 16%     -52.3%     190.33 ± 26%  numa-vmstat.node0.nr_zone_active_anon
   1344663 ±  7%     -54.8%     608113 ±  5%  numa-vmstat.node0.nr_zone_inactive_file
      7457 ±  8%     -62.7%       2779 ± 19%  numa-vmstat.node0.nr_zone_write_pending
   7871907 ±  4%     -57.5%    3343740 ±  6%  numa-vmstat.node0.numa_hit
   7873172 ±  5%     -58.4%    3279103 ±  5%  numa-vmstat.node0.numa_local
     19031 ±102%    +274.8%      71322 ± 12%  numa-vmstat.node0.numa_other
     24.00 ±126%    +281.2%      91.50 ± 39%  numa-vmstat.node1.nr_active_anon
    947741 ± 11%     +65.7%    1570584 ±  6%  numa-vmstat.node1.nr_dirtied
      1253 ± 38%    +103.6%       2551 ±  7%  numa-vmstat.node1.nr_dirty
    351145 ± 12%     +72.3%     604947 ±  6%  numa-vmstat.node1.nr_inactive_file
     16987 ± 15%     +50.5%      25572 ±  7%  numa-vmstat.node1.nr_slab_reclaimable
     16102 ± 10%     +25.9%      20271 ±  5%  numa-vmstat.node1.nr_slab_unreclaimable
    947741 ± 11%     +65.7%    1570584 ±  6%  numa-vmstat.node1.nr_written
     24.00 ±126%    +281.2%      91.50 ± 39%  numa-vmstat.node1.nr_zone_active_anon
    351137 ± 12%     +72.3%     604932 ±  6%  numa-vmstat.node1.nr_zone_inactive_file
      1600 ± 40%     +92.8%       3086 ± 16%  numa-vmstat.node1.nr_zone_write_pending
   2055417 ± 13%     +65.3%    3398599 ±  7%  numa-vmstat.node1.numa_hit
   1977897 ± 14%     +68.6%    3334762 ±  7%  numa-vmstat.node1.numa_local
    807229 ± 14%     +90.1%    1534388 ±  7%  numa-vmstat.node2.nr_dirtied
    540.50 ± 49%    +390.9%       2653 ± 19%  numa-vmstat.node2.nr_dirty
    300781 ± 12%    +109.5%     630205 ± 11%  numa-vmstat.node2.nr_file_pages
    300427 ± 12%     +98.7%     596826 ±  8%  numa-vmstat.node2.nr_inactive_file
      6777 ±  3%     +10.9%       7518 ±  4%  numa-vmstat.node2.nr_kernel_stack
     12483 ± 11%     +96.5%      24533 ±  8%  numa-vmstat.node2.nr_slab_reclaimable
     14483 ±  2%     +36.3%      19734 ±  7%  numa-vmstat.node2.nr_slab_unreclaimable
      5.00 ±145%  +6.6e+05%      32925 ± 92%  numa-vmstat.node2.nr_unevictable
    807229 ± 14%     +90.1%    1534388 ±  7%  numa-vmstat.node2.nr_written
    300418 ± 12%     +98.7%     596816 ±  8%  numa-vmstat.node2.nr_zone_inactive_file
      5.00 ±145%  +6.6e+05%      32925 ± 92%  numa-vmstat.node2.nr_zone_unevictable
    794.17 ± 38%    +323.9%       3366 ± 15%  numa-vmstat.node2.nr_zone_write_pending
   1760442 ± 15%     +87.6%    3302675 ±  7%  numa-vmstat.node2.numa_hit
   1683927 ± 15%     +93.5%    3258551 ±  7%  numa-vmstat.node2.numa_local
    641.67 ± 64%    +845.2%       6064 ± 88%  numa-vmstat.node3.nr_anon_pages
    795203 ± 12%    +102.0%    1606267        numa-vmstat.node3.nr_dirtied
    796.50 ± 48%    +205.3%       2431 ± 26%  numa-vmstat.node3.nr_dirty
    292940 ± 10%    +110.0%     615274 ±  3%  numa-vmstat.node3.nr_inactive_file
      7142 ±  6%     +11.3%       7950 ±  6%  numa-vmstat.node3.nr_kernel_stack
     59.83 ±111%    +658.5%     453.83 ± 50%  numa-vmstat.node3.nr_page_table_pages
    795203 ± 12%    +102.0%    1606267        numa-vmstat.node3.nr_written
    292935 ± 10%    +110.0%     615267 ±  3%  numa-vmstat.node3.nr_zone_inactive_file
      1242 ± 39%    +167.8%       3327 ± 25%  numa-vmstat.node3.nr_zone_write_pending
   1737678 ± 11%     +96.7%    3418251 ±  2%  numa-vmstat.node3.numa_hit
   1650883 ± 12%    +103.7%    3363015 ±  2%  numa-vmstat.node3.numa_local
      1.88 ± 30%      -0.7        1.16 ±  3%  perf-profile.calltrace.cycles-pp.copy_to_brd.brd_do_bvec.brd_submit_bio.__submit_bio.__submit_bio_noacct
      1.85 ± 19%      -0.7        1.19 ±  5%  perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.umount2
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.umount2
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.umount2
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.umount2
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.umount2
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.cleanup_mnt.task_work_run.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.deactivate_locked_super.cleanup_mnt.task_work_run.exit_to_user_mode_loop.exit_to_user_mode_prepare
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.kill_block_super.deactivate_locked_super.cleanup_mnt.task_work_run.exit_to_user_mode_loop
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.calltrace.cycles-pp.generic_shutdown_super.kill_block_super.deactivate_locked_super.cleanup_mnt.task_work_run
      2.04 ± 28%      -0.6        1.39 ± 13%  perf-profile.calltrace.cycles-pp.evict.dispose_list.evict_inodes.generic_shutdown_super.kill_block_super
      2.04 ± 28%      -0.6        1.39 ± 13%  perf-profile.calltrace.cycles-pp.evict_inodes.generic_shutdown_super.kill_block_super.deactivate_locked_super.cleanup_mnt
      2.04 ± 28%      -0.6        1.39 ± 13%  perf-profile.calltrace.cycles-pp.dispose_list.evict_inodes.generic_shutdown_super.kill_block_super.deactivate_locked_super
      2.03 ± 28%      -0.6        1.39 ± 13%  perf-profile.calltrace.cycles-pp.ext4_evict_inode.evict.dispose_list.evict_inodes.generic_shutdown_super
      2.03 ± 28%      -0.6        1.39 ± 13%  perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.ext4_evict_inode.evict.dispose_list.evict_inodes
      1.78 ± 16%      -0.6        1.16 ±  4%  perf-profile.calltrace.cycles-pp.pagecache_get_page.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      1.79 ± 19%      -0.6        1.17 ±  5%  perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      1.78 ± 19%      -0.6        1.16 ±  5%  perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter
      1.78 ± 16%      -0.6        1.15 ±  4%  perf-profile.calltrace.cycles-pp.__filemap_get_folio.pagecache_get_page.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      1.24 ± 14%      -0.4        0.82 ±  6%  perf-profile.calltrace.cycles-pp.filemap_add_folio.__filemap_get_folio.pagecache_get_page.ext4_da_write_begin.generic_perform_write
      1.32 ± 15%      -0.4        0.95 ±  8%  perf-profile.calltrace.cycles-pp.__block_commit_write.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.74 ± 15%      -0.3        0.39 ± 72%  perf-profile.calltrace.cycles-pp.mark_buffer_dirty.__block_commit_write.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.88 ± 13%      -0.3        0.61 ±  5%  perf-profile.calltrace.cycles-pp.__filemap_add_folio.filemap_add_folio.__filemap_get_folio.pagecache_get_page.ext4_da_write_begin
      1.00 ± 10%      -0.2        0.78 ±  5%  perf-profile.calltrace.cycles-pp.mpage_map_and_submit_extent.ext4_writepages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
      0.91 ± 10%      -0.2        0.69 ±  5%  perf-profile.calltrace.cycles-pp.mpage_map_and_submit_buffers.mpage_map_and_submit_extent.ext4_writepages.do_writepages.filemap_fdatawrite_wbc
      0.92 ± 13%      -0.2        0.72 ±  6%  perf-profile.calltrace.cycles-pp.ext4_put_io_end.ext4_writepages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
      0.78 ±  9%      -0.2        0.61 ±  5%  perf-profile.calltrace.cycles-pp.mpage_submit_page.mpage_map_and_submit_buffers.mpage_map_and_submit_extent.ext4_writepages.do_writepages
      0.79 ± 10%      -0.2        0.63 ±  5%  perf-profile.calltrace.cycles-pp.ext4_release_io_end.ext4_put_io_end.ext4_writepages.do_writepages.filemap_fdatawrite_wbc
      0.78 ± 10%      -0.2        0.63 ±  6%  perf-profile.calltrace.cycles-pp.ext4_finish_bio.ext4_release_io_end.ext4_put_io_end.ext4_writepages.do_writepages
      0.80 ± 12%      +0.1        0.94 ±  9%  perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_update_time
      0.83 ± 12%      +0.1        0.97 ±  9%  perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_update_time.file_update_time
      0.98 ± 12%      +0.2        1.16 ± 10%  perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_update_time.file_update_time.ext4_buffered_write_iter.new_sync_write
      0.98 ± 12%      +0.2        1.16 ± 10%  perf-profile.calltrace.cycles-pp.generic_update_time.file_update_time.ext4_buffered_write_iter.new_sync_write.vfs_write
      1.16 ±  8%      +0.3        1.42 ±  4%  perf-profile.calltrace.cycles-pp.jbd2_journal_get_write_access.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode
      1.24 ±  7%      +0.3        1.53 ±  5%  perf-profile.calltrace.cycles-pp.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      1.65 ±  8%      +0.3        1.95 ± 11%  perf-profile.calltrace.cycles-pp.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      1.02 ±  9%      +0.3        1.36 ±  7%  perf-profile.calltrace.cycles-pp.jbd2_journal_dirty_metadata.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty
      1.08 ±  8%      +0.4        1.43 ±  6%  perf-profile.calltrace.cycles-pp.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      1.18 ±  9%      +0.4        1.56 ±  7%  perf-profile.calltrace.cycles-pp.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode
      3.66 ± 18%      -1.1        2.53 ±  7%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      3.08 ± 13%      -0.8        2.26 ±  7%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      1.92 ± 29%      -0.7        1.17 ±  4%  perf-profile.children.cycles-pp.copy_to_brd
      2.06 ± 28%      -0.7        1.41 ± 13%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      1.85 ± 19%      -0.7        1.19 ±  5%  perf-profile.children.cycles-pp.copy_page_from_iter_atomic
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.children.cycles-pp.umount2
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.children.cycles-pp.cleanup_mnt
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.children.cycles-pp.deactivate_locked_super
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.children.cycles-pp.kill_block_super
      2.05 ± 28%      -0.7        1.40 ± 13%  perf-profile.children.cycles-pp.generic_shutdown_super
      1.29 ± 26%      -0.6        0.64 ±  5%  perf-profile.children.cycles-pp.__alloc_pages
      2.04 ± 28%      -0.6        1.39 ± 13%  perf-profile.children.cycles-pp.evict_inodes
      2.04 ± 28%      -0.6        1.39 ± 13%  perf-profile.children.cycles-pp.dispose_list
      2.04 ± 28%      -0.6        1.39 ± 13%  perf-profile.children.cycles-pp.evict
      2.03 ± 28%      -0.6        1.39 ± 13%  perf-profile.children.cycles-pp.ext4_evict_inode
      2.03 ± 28%      -0.6        1.39 ± 13%  perf-profile.children.cycles-pp.truncate_inode_pages_range
      1.80 ± 15%      -0.6        1.16 ±  4%  perf-profile.children.cycles-pp.pagecache_get_page
      1.79 ± 15%      -0.6        1.16 ±  4%  perf-profile.children.cycles-pp.__filemap_get_folio
      1.80 ± 18%      -0.6        1.17 ±  5%  perf-profile.children.cycles-pp.copyin
      1.79 ± 19%      -0.6        1.16 ±  5%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      1.15 ± 28%      -0.6        0.54 ±  5%  perf-profile.children.cycles-pp.get_page_from_freelist
      2.03 ± 11%      -0.5        1.54 ±  9%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      2.00 ± 12%      -0.5        1.52 ±  9%  perf-profile.children.cycles-pp.hrtimer_interrupt
      1.24 ± 14%      -0.4        0.82 ±  6%  perf-profile.children.cycles-pp.filemap_add_folio
      1.32 ± 15%      -0.4        0.95 ±  8%  perf-profile.children.cycles-pp.__block_commit_write
      0.59 ± 31%      -0.4        0.24 ±  9%  perf-profile.children.cycles-pp.clear_page_erms
      0.72 ± 17%      -0.3        0.41 ±  6%  perf-profile.children.cycles-pp.create_empty_buffers
      0.79 ± 21%      -0.3        0.50 ± 12%  perf-profile.children.cycles-pp.ktime_get
      0.88 ± 14%      -0.3        0.62 ±  6%  perf-profile.children.cycles-pp.__filemap_add_folio
      1.00 ± 10%      -0.2        0.78 ±  5%  perf-profile.children.cycles-pp.mpage_map_and_submit_extent
      0.62 ± 16%      -0.2        0.40 ±  6%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.91 ± 10%      -0.2        0.69 ±  5%  perf-profile.children.cycles-pp.mpage_map_and_submit_buffers
      0.56 ± 17%      -0.2        0.34 ±  6%  perf-profile.children.cycles-pp.alloc_page_buffers
      0.92 ± 13%      -0.2        0.72 ±  6%  perf-profile.children.cycles-pp.ext4_put_io_end
      0.53 ± 17%      -0.2        0.33 ±  5%  perf-profile.children.cycles-pp.alloc_buffer_head
      0.54 ± 11%      -0.2        0.35 ±  9%  perf-profile.children.cycles-pp.brd_lookup_page
      0.74 ± 15%      -0.2        0.55 ± 14%  perf-profile.children.cycles-pp.mark_buffer_dirty
      0.59 ± 16%      -0.2        0.40 ±  9%  perf-profile.children.cycles-pp.clockevents_program_event
      0.44 ± 20%      -0.2        0.26 ±  3%  perf-profile.children.cycles-pp.folio_alloc
      0.74 ± 11%      -0.2        0.55 ±  6%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.53 ± 11%      -0.2        0.35 ±  9%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.38 ± 28%      -0.2        0.20 ±  6%  perf-profile.children.cycles-pp.rmqueue
      0.78 ±  9%      -0.2        0.61 ±  5%  perf-profile.children.cycles-pp.mpage_submit_page
      0.79 ± 10%      -0.2        0.63 ±  5%  perf-profile.children.cycles-pp.ext4_release_io_end
      0.35 ± 16%      -0.2        0.20 ± 10%  perf-profile.children.cycles-pp.folio_add_lru
      0.78 ± 10%      -0.2        0.63 ±  6%  perf-profile.children.cycles-pp.ext4_finish_bio
      0.36 ± 22%      -0.2        0.21 ±  3%  perf-profile.children.cycles-pp.mpage_prepare_extent_to_map
      0.50 ± 11%      -0.1        0.35 ±  3%  perf-profile.children.cycles-pp.ext4_bio_write_page
      0.31 ± 17%      -0.1        0.18 ±  8%  perf-profile.children.cycles-pp.__pagevec_lru_add
      0.30 ± 28%      -0.1        0.20 ± 14%  perf-profile.children.cycles-pp.free_unref_page_list
      0.22 ± 30%      -0.1        0.12 ± 11%  perf-profile.children.cycles-pp.rmqueue_bulk
      0.29 ± 13%      -0.1        0.20 ± 17%  perf-profile.children.cycles-pp.__getblk_gfp
      0.27 ± 15%      -0.1        0.17 ± 18%  perf-profile.children.cycles-pp.__find_get_block
      0.22 ± 20%      -0.1        0.13 ± 10%  perf-profile.children.cycles-pp.xas_store
      0.23 ± 20%      -0.1        0.15 ± 10%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.33 ± 10%      -0.1        0.25 ±  7%  perf-profile.children.cycles-pp.__folio_start_writeback
      0.24 ± 26%      -0.1        0.16 ±  8%  perf-profile.children.cycles-pp.block_invalidatepage
      0.15 ± 10%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.jbd2_write_access_granted
      0.18 ± 16%      -0.1        0.11 ± 11%  perf-profile.children.cycles-pp.xas_load
      0.21 ± 27%      -0.1        0.14 ± 12%  perf-profile.children.cycles-pp.free_pcppages_bulk
      0.21 ± 15%      -0.1        0.14 ± 11%  perf-profile.children.cycles-pp.__pagevec_lru_add_fn
      0.20 ± 16%      -0.1        0.13 ± 12%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.12 ± 34%      -0.1        0.05        perf-profile.children.cycles-pp.mpage_process_page_bufs
      0.12 ± 14%      -0.1        0.06 ±  8%  perf-profile.children.cycles-pp.ext4_es_lookup_extent
      0.13 ± 18%      -0.1        0.08 ± 18%  perf-profile.children.cycles-pp.ext4_es_insert_delayed_block
      0.12 ± 22%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.___slab_alloc
      0.38 ±  7%      -0.0        0.33 ±  9%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      0.15 ± 28%      -0.0        0.10 ± 16%  perf-profile.children.cycles-pp.__free_one_page
      0.16 ± 14%      -0.0        0.11 ±  7%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.09 ± 20%      -0.0        0.04 ± 44%  perf-profile.children.cycles-pp.node_dirty_ok
      0.18 ± 18%      -0.0        0.13 ± 11%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.12 ± 13%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook
      0.17 ±  9%      -0.0        0.13 ± 10%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.10 ± 31%      -0.0        0.05 ± 46%  perf-profile.children.cycles-pp.jbd2_journal_try_to_free_buffers
      0.10 ± 24%      -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.allocate_slab
      0.15 ± 12%      -0.0        0.11 ±  8%  perf-profile.children.cycles-pp.radix_tree_insert
      0.09 ± 19%      -0.0        0.06 ± 48%  perf-profile.children.cycles-pp.__slab_free
      0.09 ± 18%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.folio_unlock
      0.08 ± 34%      -0.0        0.04 ± 45%  perf-profile.children.cycles-pp.jbd2_journal_grab_journal_head
      0.10 ± 18%      -0.0        0.07 ± 10%  perf-profile.children.cycles-pp.native_sched_clock
      0.08 ± 16%      -0.0        0.05        perf-profile.children.cycles-pp.__might_sleep
      0.07 ± 11%      -0.0        0.04 ± 44%  perf-profile.children.cycles-pp.update_rq_clock
      0.07 ± 11%      -0.0        0.04 ± 45%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.98 ± 12%      +0.2        1.16 ± 10%  perf-profile.children.cycles-pp.generic_update_time
      1.26 ±  7%      +0.3        1.52 ±  4%  perf-profile.children.cycles-pp.jbd2_journal_get_write_access
      1.34 ±  7%      +0.3        1.64 ±  5%  perf-profile.children.cycles-pp.__ext4_journal_get_write_access
      1.73 ±  8%      +0.3        2.04 ± 11%  perf-profile.children.cycles-pp.ext4_reserve_inode_write
      1.10 ±  9%      +0.4        1.46 ±  6%  perf-profile.children.cycles-pp.jbd2_journal_dirty_metadata
      1.12 ±  8%      +0.4        1.48 ±  7%  perf-profile.children.cycles-pp.ext4_journal_check_start
      1.27 ±  9%      +0.4        1.68 ±  7%  perf-profile.children.cycles-pp.__ext4_handle_dirty_metadata
      1.72 ± 30%      -0.6        1.10 ±  3%  perf-profile.self.cycles-pp.copy_to_brd
      1.78 ± 19%      -0.6        1.16 ±  5%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      2.14 ± 11%      -0.4        1.71 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock
      0.59 ± 31%      -0.3        0.24 ± 10%  perf-profile.self.cycles-pp.clear_page_erms
      0.71 ± 24%      -0.3        0.45 ± 13%  perf-profile.self.cycles-pp.ktime_get
      0.60 ± 21%      -0.2        0.39 ±  7%  perf-profile.self.cycles-pp.fnmatch
      0.53 ± 10%      -0.2        0.34 ±  7%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.53 ± 16%      -0.2        0.38 ±  4%  perf-profile.self.cycles-pp.__block_commit_write
      0.42 ± 13%      -0.1        0.29 ±  6%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.26 ± 16%      -0.1        0.16 ± 19%  perf-profile.self.cycles-pp.__find_get_block
      0.22 ± 15%      -0.1        0.14 ± 13%  perf-profile.self.cycles-pp.__mod_lruvec_page_state
      0.14 ± 10%      -0.1        0.07 ±  7%  perf-profile.self.cycles-pp.jbd2_write_access_granted
      0.12 ± 34%      -0.1        0.05        perf-profile.self.cycles-pp.mpage_process_page_bufs
      0.11 ± 25%      -0.1        0.05 ±  7%  perf-profile.self.cycles-pp.rmqueue
      0.15 ± 27%      -0.1        0.09 ±  9%  perf-profile.self.cycles-pp.rmqueue_bulk
      0.16 ± 22%      -0.1        0.10 ± 19%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.10 ± 23%      -0.1        0.05 ± 46%  perf-profile.self.cycles-pp.xas_store
      0.12 ± 17%      -0.1        0.07 ± 12%  perf-profile.self.cycles-pp.ext4_bio_write_page
      0.16 ± 14%      -0.0        0.11 ±  7%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.13 ± 20%      -0.0        0.08 ± 10%  perf-profile.self.cycles-pp.xas_load
      0.18 ± 18%      -0.0        0.13 ± 11%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.09 ± 18%      -0.0        0.04 ± 45%  perf-profile.self.cycles-pp.folio_unlock
      0.11 ± 23%      -0.0        0.06 ± 11%  perf-profile.self.cycles-pp.__pagevec_lru_add_fn
      0.08 ± 34%      -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.jbd2_journal_grab_journal_head
      0.10 ± 19%      -0.0        0.06 ± 13%  perf-profile.self.cycles-pp.__alloc_pages
      0.09 ± 20%      -0.0        0.05 ±  7%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.09 ± 21%      -0.0        0.05 ± 48%  perf-profile.self.cycles-pp.__slab_free
      0.13 ± 12%      -0.0        0.10 ±  7%  perf-profile.self.cycles-pp.brd_insert_page
      0.14 ± 13%      -0.0        0.10 ±  6%  perf-profile.self.cycles-pp.radix_tree_insert
      0.09 ± 15%      -0.0        0.06 ± 11%  perf-profile.self.cycles-pp.__folio_end_writeback
      0.08 ± 13%      -0.0        0.05 ±  8%  perf-profile.self.cycles-pp.__folio_start_writeback
      0.07 ± 11%      -0.0        0.04 ± 45%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.14 ±  9%      +0.1        0.20 ± 10%  perf-profile.self.cycles-pp.__ext4_handle_dirty_metadata
      1.46 ± 10%      +0.3        1.78 ±  5%  perf-profile.self.cycles-pp.jbd2_journal_stop
      1.06 ±  9%      +0.4        1.41 ±  7%  perf-profile.self.cycles-pp.jbd2_journal_dirty_metadata
      1.04 ±  7%      +0.4        1.39 ±  5%  perf-profile.self.cycles-pp.jbd2_journal_get_write_access
      1.08 ±  7%      +0.4        1.45 ±  7%  perf-profile.self.cycles-pp.ext4_journal_check_start



***************************************************************************************************
lkp-icl-2sp1: 96 threads 2 sockets Ice Lake with 256G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-9/performance/1HDD/xfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp1/fstat/stress-ng/60s/0xb000280

commit: 
  889c5d60fb ("selftests/rseq: Change type of rseq_offset to ptrdiff_t")
  2cfb7a1b03 ("sched/fair: Improve consistency of allowed NUMA balance calculations")

889c5d60fbcf332c 2cfb7a1b031b0e816af7a6ee0c6 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   1877946           -20.2%    1499226        stress-ng.fstat.ops
     31299           -20.2%      24987        stress-ng.fstat.ops_per_sec
    826920 ±  3%     -32.5%     558204 ±  4%  stress-ng.time.involuntary_context_switches
      2887            +5.9%       3057        stress-ng.time.percent_of_cpu_this_job_got
      1626            +8.4%       1762        stress-ng.time.system_time
    165.56           -18.4%     135.09        stress-ng.time.user_time
   3553984           -21.7%    2783175        stress-ng.time.voluntary_context_switches
     18.25            +2.6%      18.72        boot-time.dhcp
  19191253           -12.9%   16709285        cpuidle..usage
      2.87            -0.5        2.38        mpstat.cpu.all.usr%
    563054           -23.0%     433349        vmstat.system.cs
     99176           -22.6%      76767        turbostat.C1
  17615260 ±  7%     -15.2%   14937197 ±  6%  turbostat.C1E
     68.73            -2.0%      67.33        iostat.cpu.idle
     28.46            +6.6%      30.35        iostat.cpu.system
      2.81           -17.3%       2.33        iostat.cpu.user
     38564            -9.5%      34882        meminfo.Active
     38377            -9.8%      34616        meminfo.Active(anon)
  22913024           -41.0%   13527040        meminfo.DirectMap2M
  18658648 ±  3%     -33.3%   12451242 ±  5%  numa-numastat.node0.local_node
  18707476 ±  3%     -33.2%   12502127 ±  5%  numa-numastat.node0.numa_hit
  17372081 ±  2%     -15.7%   14653067 ±  4%  numa-numastat.node1.local_node
  17409491 ±  2%     -15.6%   14688341 ±  4%  numa-numastat.node1.numa_hit
    396952 ±  5%     -22.6%     307388 ± 30%  numa-meminfo.node0.AnonPages.max
      1112           -62.2%     420.33 ± 91%  numa-meminfo.node0.Inactive(file)
     89474 ±  3%     -13.1%      77777 ± 12%  numa-meminfo.node0.KReclaimable
     14690           -12.7%      12824        numa-meminfo.node0.KernelStack
      3996 ±  6%     -28.9%       2843 ± 21%  numa-meminfo.node0.PageTables
     89474 ±  3%     -13.1%      77777 ± 12%  numa-meminfo.node0.SReclaimable
     36499           -10.3%      32749        numa-meminfo.node1.Active
     36499           -10.6%      32641        numa-meminfo.node1.Active(anon)
     10922 ±  4%     +11.8%      12215 ±  2%  numa-meminfo.node1.KernelStack
      1507 ± 12%     +76.3%       2657 ± 23%  numa-meminfo.node1.PageTables
    176.00 ± 49%  +55065.7%      97091 ± 83%  numa-meminfo.node1.Unevictable
      9609            -9.8%       8668        proc-vmstat.nr_active_anon
    111731            -1.4%     110215        proc-vmstat.nr_inactive_anon
     25612 ±  2%      -2.3%      25032        proc-vmstat.nr_kernel_stack
     34054            +2.2%      34793        proc-vmstat.nr_mapped
     42187            -5.3%      39936        proc-vmstat.nr_shmem
      9609            -9.8%       8668        proc-vmstat.nr_zone_active_anon
    111731            -1.4%     110215        proc-vmstat.nr_zone_inactive_anon
  36118982           -24.7%   27192686        proc-vmstat.numa_hit
  36032745           -24.7%   27133038        proc-vmstat.numa_local
      1640            -6.8%       1529        proc-vmstat.pgactivate
  36094672           -24.7%   27170985        proc-vmstat.pgalloc_normal
  35882879           -24.8%   26969209        proc-vmstat.pgfree
     20271            +1.5%      20565        proc-vmstat.pgreuse
    278.00           -62.2%     105.00 ± 91%  numa-vmstat.node0.nr_inactive_file
     14713           -13.0%      12805        numa-vmstat.node0.nr_kernel_stack
    999.00 ±  6%     -29.0%     709.00 ± 21%  numa-vmstat.node0.nr_page_table_pages
     22369 ±  3%     -13.1%      19444 ± 12%  numa-vmstat.node0.nr_slab_reclaimable
    278.00           -62.2%     105.00 ± 91%  numa-vmstat.node0.nr_zone_inactive_file
  10838015           -29.9%    7593976 ±  5%  numa-vmstat.node0.numa_hit
  10789068           -29.9%    7566832 ±  5%  numa-vmstat.node0.numa_local
      9147           -11.2%       8122        numa-vmstat.node1.nr_active_anon
     10911 ±  4%     +11.5%      12163 ±  2%  numa-vmstat.node1.nr_kernel_stack
    376.67 ± 12%     +76.8%     666.00 ± 23%  numa-vmstat.node1.nr_page_table_pages
     43.33 ± 50%  +55913.1%      24272 ± 83%  numa-vmstat.node1.nr_unevictable
      9147           -11.2%       8122        numa-vmstat.node1.nr_zone_active_anon
     43.33 ± 50%  +55913.1%      24272 ± 83%  numa-vmstat.node1.nr_zone_unevictable
   8564698           -13.6%    7399145 ±  4%  numa-vmstat.node1.numa_hit
   8483147           -13.7%    7322816 ±  4%  numa-vmstat.node1.numa_local
      7.50 ±  5%     +14.1%       8.56 ±  5%  perf-stat.i.MPKI
  1.41e+10           -21.2%  1.111e+10        perf-stat.i.branch-instructions
      0.93 ±  4%      +0.1        1.01 ±  4%  perf-stat.i.branch-miss-rate%
 1.251e+08           -14.3%  1.072e+08 ±  2%  perf-stat.i.branch-misses
     17.97 ±  2%      +9.3       27.26 ±  2%  perf-stat.i.cache-miss-rate%
  98129033           +38.9%  1.363e+08        perf-stat.i.cache-misses
  5.48e+08            -9.4%  4.964e+08 ±  2%  perf-stat.i.cache-references
    585589           -23.2%     449975        perf-stat.i.context-switches
      1.38           +31.3%       1.82        perf-stat.i.cpi
 1.026e+11            +4.5%  1.072e+11        perf-stat.i.cpu-cycles
      7465 ±  3%     +56.0%      11648 ±  6%  perf-stat.i.cpu-migrations
      1062           -24.0%     807.28        perf-stat.i.cycles-between-cache-misses
  2.11e+10           -21.2%  1.662e+10        perf-stat.i.dTLB-loads
   1601716 ±  5%     -18.0%    1312862 ±  6%  perf-stat.i.dTLB-store-misses
 1.251e+10           -21.8%   9.78e+09        perf-stat.i.dTLB-stores
 7.503e+10           -21.3%  5.906e+10        perf-stat.i.instructions
      0.73           -23.9%       0.55        perf-stat.i.ipc
      1.07            +4.5%       1.12        perf-stat.i.metric.GHz
    825.91           +25.2%       1034        perf-stat.i.metric.K/sec
    502.50           -21.2%     395.81        perf-stat.i.metric.M/sec
     83.64            +3.7       87.35        perf-stat.i.node-load-miss-rate%
  13945135           +59.2%   22206111        perf-stat.i.node-load-misses
   2607458           +10.8%    2889896        perf-stat.i.node-loads
     19.85           +16.8       36.63        perf-stat.i.node-store-miss-rate%
  11453861          +125.1%   25784492        perf-stat.i.node-store-misses
  48591551            -7.4%   44979157        perf-stat.i.node-stores
      7.36           +14.8%       8.45 ±  2%  perf-stat.overall.MPKI
      0.89            +0.1        0.96 ±  2%  perf-stat.overall.branch-miss-rate%
     17.84            +9.3       27.12        perf-stat.overall.cache-miss-rate%
      1.37           +31.9%       1.81        perf-stat.overall.cpi
      1044           -24.4%     789.38        perf-stat.overall.cycles-between-cache-misses
      0.02 ± 15%      +0.0        0.03 ± 15%  perf-stat.overall.dTLB-load-miss-rate%
      0.73           -24.2%       0.55        perf-stat.overall.ipc
     84.21            +4.2       88.39        perf-stat.overall.node-load-miss-rate%
     19.25           +17.0       36.27        perf-stat.overall.node-store-miss-rate%
 1.388e+10           -20.8%    1.1e+10        perf-stat.ps.branch-instructions
 1.232e+08           -14.1%  1.059e+08 ±  2%  perf-stat.ps.branch-misses
  96942023           +38.1%  1.339e+08        perf-stat.ps.cache-misses
 5.435e+08            -9.1%  4.938e+08 ±  2%  perf-stat.ps.cache-references
    575989           -22.7%     445024        perf-stat.ps.context-switches
 1.012e+11            +4.4%  1.057e+11        perf-stat.ps.cpu-cycles
      7513 ±  4%     +52.8%      11483 ±  6%  perf-stat.ps.cpu-migrations
 2.078e+10           -20.8%  1.646e+10        perf-stat.ps.dTLB-loads
   1574685 ±  5%     -17.8%    1294093 ±  6%  perf-stat.ps.dTLB-store-misses
 1.231e+10           -21.4%  9.678e+09        perf-stat.ps.dTLB-stores
 7.388e+10           -20.9%  5.846e+10        perf-stat.ps.instructions
  13848805           +57.7%   21844951        perf-stat.ps.node-load-misses
   2596916           +10.5%    2869144        perf-stat.ps.node-loads
  11385387          +121.5%   25213701        perf-stat.ps.node-store-misses
  47754773            -7.2%   44308372        perf-stat.ps.node-stores
 4.667e+12           -20.9%  3.694e+12        perf-stat.total.instructions
      9.95            -2.5        7.47        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__clone
      9.93            -2.5        7.46        perf-profile.calltrace.cycles-pp.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.94            -2.5        7.47        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
      9.93            -2.5        7.46        perf-profile.calltrace.cycles-pp.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__clone
     10.22            -2.4        7.78        perf-profile.calltrace.cycles-pp.__clone
      7.78            -2.4        5.42        perf-profile.calltrace.cycles-pp.copy_process.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
      6.14            -2.0        4.15        perf-profile.calltrace.cycles-pp.dup_task_struct.copy_process.kernel_clone.__do_sys_clone.do_syscall_64
      4.56            -1.6        2.96 ±  2%  perf-profile.calltrace.cycles-pp.__vmalloc_node_range.dup_task_struct.copy_process.kernel_clone.__do_sys_clone
      3.45 ±  2%      -1.3        2.12 ±  3%  perf-profile.calltrace.cycles-pp.__get_vm_area_node.__vmalloc_node_range.dup_task_struct.copy_process.kernel_clone
      1.82            -1.2        0.57        perf-profile.calltrace.cycles-pp.__check_object_size.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx
      3.12 ±  2%      -1.1        1.98 ±  4%  perf-profile.calltrace.cycles-pp.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.dup_task_struct.copy_process
      3.57            -1.0        2.57 ±  2%  perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx
      2.48 ±  3%      -0.8        1.63 ±  3%  perf-profile.calltrace.cycles-pp.ret_from_fork
      2.48 ±  3%      -0.8        1.63 ±  3%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      2.43 ±  3%      -0.8        1.59 ±  3%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      1.96 ±  3%      -0.8        1.15 ±  3%  perf-profile.calltrace.cycles-pp.__vunmap.free_work.process_one_work.worker_thread.kthread
      2.01 ±  3%      -0.8        1.20 ±  3%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      1.98 ±  3%      -0.8        1.18 ±  3%  perf-profile.calltrace.cycles-pp.free_work.process_one_work.worker_thread.kthread.ret_from_fork
      1.59 ±  2%      -0.7        0.90 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range.dup_task_struct
      2.96            -0.7        2.28        perf-profile.calltrace.cycles-pp.link_path_walk.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
      2.42            -0.7        1.74        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64
      2.50            -0.7        1.82        perf-profile.calltrace.cycles-pp.__entry_text_start.statx
      2.39            -0.7        1.73        perf-profile.calltrace.cycles-pp.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64
      1.51 ±  2%      -0.7        0.85        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.alloc_vmap_area.__get_vm_area_node.__vmalloc_node_range
      2.13            -0.6        1.55 ±  2%  perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.do_statx
      1.25 ±  4%      -0.6        0.69 ±  3%  perf-profile.calltrace.cycles-pp.remove_vm_area.__vunmap.free_work.process_one_work.worker_thread
      5.48            -0.4        5.07        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      3.89 ±  2%      -0.4        3.48 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      3.98 ±  2%      -0.4        3.58 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      5.42            -0.4        5.02        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      5.42            -0.4        5.02        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
      5.41            -0.4        5.01        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      2.32 ±  3%      -0.4        1.94 ±  2%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      1.39            -0.4        1.00        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newstat
      1.44            -0.4        1.06        perf-profile.calltrace.cycles-pp.__fxstat64
      1.40            -0.4        1.02        perf-profile.calltrace.cycles-pp.strncpy_from_user.getname_flags.user_path_at_empty.vfs_statx.__do_sys_newlstat
      1.62            -0.3        1.31        perf-profile.calltrace.cycles-pp.find_idlest_group.select_task_rq_fair.wake_up_new_task.kernel_clone.__do_sys_clone
      1.10            -0.3        0.84        perf-profile.calltrace.cycles-pp.__vmalloc_area_node.__vmalloc_node_range.dup_task_struct.copy_process.kernel_clone
      2.36            -0.2        2.12 ±  2%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.34            -0.2        2.09 ±  2%  perf-profile.calltrace.cycles-pp.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.36            -0.2        2.12 ±  2%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      2.33            -0.2        2.09 ±  2%  perf-profile.calltrace.cycles-pp.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.88            -0.2        0.64        perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      0.85            -0.2        0.63        perf-profile.calltrace.cycles-pp.kmem_cache_alloc.getname_flags.user_path_at_empty.vfs_statx.do_statx
      0.77 ±  3%      -0.2        0.55 ±  3%  perf-profile.calltrace.cycles-pp.shim_statx
      0.74            -0.2        0.56 ±  3%  perf-profile.calltrace.cycles-pp.cp_statx.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.81            -0.2        0.64        perf-profile.calltrace.cycles-pp.__alloc_pages_bulk.__vmalloc_area_node.__vmalloc_node_range.dup_task_struct.copy_process
      1.73            -0.2        1.58        perf-profile.calltrace.cycles-pp.select_task_rq_fair.wake_up_new_task.kernel_clone.__do_sys_clone.do_syscall_64
      0.77            -0.1        0.63        perf-profile.calltrace.cycles-pp.release_task.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.11            -0.1        2.01        perf-profile.calltrace.cycles-pp.wake_up_new_task.kernel_clone.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.64            +0.0        0.68        perf-profile.calltrace.cycles-pp.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe.start_thread
      0.63            +0.0        0.67        perf-profile.calltrace.cycles-pp.do_exit.__x64_sys_exit.do_syscall_64.entry_SYSCALL_64_after_hwframe.start_thread
      0.73 ±  3%      +0.0        0.78 ±  3%  perf-profile.calltrace.cycles-pp.__GI___pthread_timedjoin_ex
      0.65            +0.0        0.70        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.start_thread
      0.66            +0.1        0.71        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.start_thread
      1.00 ±  2%      +0.1        1.07 ±  2%  perf-profile.calltrace.cycles-pp.walk_component.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
      0.77            +0.1        0.85        perf-profile.calltrace.cycles-pp.start_thread
     28.56            +0.1       28.66        perf-profile.calltrace.cycles-pp.statx
      1.61            +0.3        1.91        perf-profile.calltrace.cycles-pp.vfs_getattr.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
      1.57            +0.3        1.88        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_getattr.vfs_statx.do_statx.__x64_sys_statx
      1.52            +0.3        1.84        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_getattr.vfs_statx.do_statx
      1.58            +0.3        1.90        perf-profile.calltrace.cycles-pp.vfs_getattr.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.54            +0.3        1.87        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_getattr.vfs_statx.__do_sys_newstat.do_syscall_64
      1.50            +0.3        1.82        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_getattr.vfs_statx.__do_sys_newstat
      1.58            +0.3        1.93        perf-profile.calltrace.cycles-pp.vfs_getattr.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.50            +0.4        1.85        perf-profile.calltrace.cycles-pp.common_perm_cond.security_inode_getattr.vfs_getattr.vfs_statx.__do_sys_newlstat
      1.54            +0.4        1.90        perf-profile.calltrace.cycles-pp.security_inode_getattr.vfs_getattr.vfs_statx.__do_sys_newlstat.do_syscall_64
     13.16            +0.4       13.55        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
     11.39            +1.1       12.46        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12.38            +1.1       13.49        perf-profile.calltrace.cycles-pp.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     24.32            +1.2       25.53        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.statx
     23.87            +1.3       25.19        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      5.33            +1.5        6.84        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.do_statx
      5.65            +1.5        7.17        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64
      5.63            +1.5        7.15        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.do_statx.__x64_sys_statx
      9.07            +1.6       10.63        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.do_statx.__x64_sys_statx
      5.21            +1.6        6.82        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.__do_sys_newlstat
      5.12            +1.6        6.75        perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.path_put.vfs_statx.__do_sys_newstat
      5.52            +1.6        7.15        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.50            +1.6        7.14        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.__do_sys_newlstat.do_syscall_64
      5.44            +1.6        7.08        perf-profile.calltrace.cycles-pp.path_put.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      8.79            +1.6       10.44        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.do_statx
      5.41            +1.6        7.06        perf-profile.calltrace.cycles-pp.dput.path_put.vfs_statx.__do_sys_newstat.do_syscall_64
     22.50            +1.7       24.19        perf-profile.calltrace.cycles-pp.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
     22.07            +1.8       23.87        perf-profile.calltrace.cycles-pp.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe.statx
      8.69            +1.8       10.54        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newlstat.do_syscall_64
      9.72            +1.9       11.58        perf-profile.calltrace.cycles-pp.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newstat.do_syscall_64
      8.52            +1.9       10.41        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newlstat
      9.53            +1.9       11.43        perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx.__do_sys_newstat
     20.98            +2.1       23.05        perf-profile.calltrace.cycles-pp.vfs_statx.do_statx.__x64_sys_statx.do_syscall_64.entry_SYSCALL_64_after_hwframe
     22.17            +2.2       24.32        perf-profile.calltrace.cycles-pp.__lxstat64
     23.01            +2.2       25.21        perf-profile.calltrace.cycles-pp.__xstat64
     20.63            +2.5       23.16        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__lxstat64
     20.45            +2.6       23.03        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     21.50            +2.6       24.09        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__xstat64
     21.30            +2.6       23.95        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64
     19.77            +2.7       22.51        perf-profile.calltrace.cycles-pp.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     20.63            +2.8       23.44        perf-profile.calltrace.cycles-pp.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64
     18.98            +2.9       21.91        perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     19.86            +3.0       22.85        perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64
     20.92            +6.4       27.34        perf-profile.calltrace.cycles-pp.complete_walk.path_lookupat.filename_lookup.user_path_at_empty.vfs_statx
     20.77            +6.5       27.22        perf-profile.calltrace.cycles-pp.try_to_unlazy.complete_walk.path_lookupat.filename_lookup.user_path_at_empty
     20.52            +6.5       27.04        perf-profile.calltrace.cycles-pp.__legitimize_path.try_to_unlazy.complete_walk.path_lookupat.filename_lookup
     20.03            +6.6       26.61        perf-profile.calltrace.cycles-pp.lockref_get_not_dead.__legitimize_path.try_to_unlazy.complete_walk.path_lookupat
      9.94            -2.5        7.47        perf-profile.children.cycles-pp.__do_sys_clone
      9.93            -2.5        7.46        perf-profile.children.cycles-pp.kernel_clone
     10.24            -2.4        7.79        perf-profile.children.cycles-pp.__clone
      8.51            -2.4        6.12        perf-profile.children.cycles-pp.getname_flags
      7.79            -2.4        5.43        perf-profile.children.cycles-pp.copy_process
      6.15            -2.0        4.15        perf-profile.children.cycles-pp.dup_task_struct
      3.76 ±  2%      -1.6        2.13        perf-profile.children.cycles-pp._raw_spin_lock
      4.56            -1.6        2.96 ±  2%  perf-profile.children.cycles-pp.__vmalloc_node_range
      3.32 ±  3%      -1.6        1.72 ±  2%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      5.04            -1.4        3.65        perf-profile.children.cycles-pp.strncpy_from_user
      3.46 ±  2%      -1.3        2.12 ±  3%  perf-profile.children.cycles-pp.__get_vm_area_node
      3.12 ±  2%      -1.1        1.99 ±  4%  perf-profile.children.cycles-pp.alloc_vmap_area
      3.34            -0.9        2.44        perf-profile.children.cycles-pp.__entry_text_start
      2.48 ±  3%      -0.8        1.63 ±  3%  perf-profile.children.cycles-pp.kthread
      2.43 ±  3%      -0.8        1.59 ±  3%  perf-profile.children.cycles-pp.worker_thread
      1.96 ±  3%      -0.8        1.15 ±  3%  perf-profile.children.cycles-pp.__vunmap
      2.63 ±  3%      -0.8        1.82 ±  3%  perf-profile.children.cycles-pp.ret_from_fork
      2.01 ±  3%      -0.8        1.20 ±  3%  perf-profile.children.cycles-pp.process_one_work
      1.98 ±  3%      -0.8        1.18 ±  3%  perf-profile.children.cycles-pp.free_work
      2.85            -0.7        2.11        perf-profile.children.cycles-pp.syscall_return_via_sysret
      3.04            -0.7        2.34        perf-profile.children.cycles-pp.link_path_walk
      1.25 ±  4%      -0.6        0.69 ±  3%  perf-profile.children.cycles-pp.remove_vm_area
      1.98            -0.6        1.43        perf-profile.children.cycles-pp.__check_object_size
      2.15            -0.6        1.59        perf-profile.children.cycles-pp.kmem_cache_alloc
      1.67            -0.5        1.18        perf-profile.children.cycles-pp.kmem_cache_free
      1.93            -0.5        1.46        perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.79 ±  3%      -0.4        0.36 ±  4%  perf-profile.children.cycles-pp.find_vmap_area
      1.65            -0.4        1.22        perf-profile.children.cycles-pp.__fxstat64
      5.48            -0.4        5.07        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
      5.48            -0.4        5.07        perf-profile.children.cycles-pp.cpu_startup_entry
      4.03 ±  2%      -0.4        3.62 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter
      5.48            -0.4        5.07        perf-profile.children.cycles-pp.do_idle
      4.02 ±  2%      -0.4        3.61 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter_state
      5.42            -0.4        5.02        perf-profile.children.cycles-pp.start_secondary
      2.36 ±  3%      -0.4        1.97 ±  2%  perf-profile.children.cycles-pp.intel_idle
      3.02            -0.4        2.67        perf-profile.children.cycles-pp.walk_component
      0.80 ±  3%      -0.3        0.47 ±  3%  perf-profile.children.cycles-pp.free_vmap_area_noflush
      1.23            -0.3        0.91        perf-profile.children.cycles-pp._copy_to_user
      1.66            -0.3        1.35        perf-profile.children.cycles-pp.find_idlest_group
      1.28            -0.3        0.98        perf-profile.children.cycles-pp.cp_new_stat
      1.25            -0.3        0.97        perf-profile.children.cycles-pp.__might_resched
      1.10            -0.3        0.84        perf-profile.children.cycles-pp.__vmalloc_area_node
      0.91            -0.2        0.67        perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      1.00            -0.2        0.77        perf-profile.children.cycles-pp.__might_fault
      0.78            -0.2        0.55        perf-profile.children.cycles-pp.__check_heap_object
      0.79 ±  3%      -0.2        0.57 ±  3%  perf-profile.children.cycles-pp.shim_statx
      2.97            -0.2        2.77        perf-profile.children.cycles-pp.__x64_sys_exit
      2.97            -0.2        2.77        perf-profile.children.cycles-pp.do_exit
      0.34 ±  6%      -0.2        0.14 ±  3%  perf-profile.children.cycles-pp.find_vm_area
      0.76            -0.2        0.57 ±  2%  perf-profile.children.cycles-pp.cp_statx
      0.96 ±  3%      -0.2        0.79 ±  2%  perf-profile.children.cycles-pp.step_into
      0.81            -0.2        0.65        perf-profile.children.cycles-pp.__alloc_pages_bulk
      0.65            -0.2        0.49        perf-profile.children.cycles-pp.__might_sleep
      0.69 ±  2%      -0.2        0.54        perf-profile.children.cycles-pp.vfs_getattr_nosec
      0.78 ±  2%      -0.1        0.63        perf-profile.children.cycles-pp.release_task
      0.58            -0.1        0.44        perf-profile.children.cycles-pp.kernel_init_free_pages
      1.75            -0.1        1.61        perf-profile.children.cycles-pp.select_task_rq_fair
      0.71            -0.1        0.57        perf-profile.children.cycles-pp.path_init
      0.56            -0.1        0.42        perf-profile.children.cycles-pp.syscall_enter_from_user_mode
      0.57            -0.1        0.44 ±  2%  perf-profile.children.cycles-pp.clear_page_erms
      0.51            -0.1        0.38 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.74 ±  3%      -0.1        0.61        perf-profile.children.cycles-pp.inode_permission
      1.60 ±  3%      -0.1        1.49        perf-profile.children.cycles-pp.lookup_fast
      2.11            -0.1        2.01        perf-profile.children.cycles-pp.wake_up_new_task
      0.36 ±  3%      -0.1        0.26        perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
      0.39            -0.1        0.30 ±  4%  perf-profile.children.cycles-pp.__virt_addr_valid
      0.34 ±  4%      -0.1        0.25        perf-profile.children.cycles-pp.__cond_resched
      0.53            -0.1        0.44 ±  2%  perf-profile.children.cycles-pp.__sched_yield
      0.32 ±  2%      -0.1        0.22 ±  4%  perf-profile.children.cycles-pp.putname
      0.46            -0.1        0.37        perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.35 ±  4%      -0.1        0.26        perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.25            -0.1        0.16 ±  6%  perf-profile.children.cycles-pp.insert_vmap_area
      0.86 ±  3%      -0.1        0.78        perf-profile.children.cycles-pp.__d_lookup_rcu
      0.51 ±  2%      -0.1        0.42 ±  2%  perf-profile.children.cycles-pp.memcpy_erms
      0.29            -0.1        0.20 ±  2%  perf-profile.children.cycles-pp.alloc_pid
      0.49 ±  2%      -0.1        0.41 ±  3%  perf-profile.children.cycles-pp.arch_dup_task_struct
      0.44            -0.1        0.37 ±  2%  perf-profile.children.cycles-pp.__x64_sys_sched_yield
      0.22            -0.1        0.15 ±  3%  perf-profile.children.cycles-pp.cgroup_can_fork
      0.42 ±  4%      -0.1        0.36 ±  2%  perf-profile.children.cycles-pp.generic_permission
      0.36 ±  2%      -0.1        0.29 ±  3%  perf-profile.children.cycles-pp.kmem_cache_alloc_node
      0.31            -0.1        0.24        perf-profile.children.cycles-pp.terminate_walk
      0.26            -0.1        0.19 ±  2%  perf-profile.children.cycles-pp.cgroup_free
      0.29            -0.1        0.23 ±  4%  perf-profile.children.cycles-pp.cpumask_next
      0.28 ±  4%      -0.1        0.22 ±  2%  perf-profile.children.cycles-pp.obj_cgroup_charge_pages
      0.15            -0.1        0.09        perf-profile.children.cycles-pp.cgroup_release
      0.29 ±  2%      -0.1        0.23        perf-profile.children.cycles-pp.map_id_up
      0.37 ±  2%      -0.1        0.31 ±  5%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.18            -0.1        0.12 ±  3%  perf-profile.children.cycles-pp.cgroup_post_fork
      0.25 ±  3%      -0.1        0.19 ±  2%  perf-profile.children.cycles-pp.refcount_dec_not_one
      0.25 ±  3%      -0.1        0.19        perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
      0.13            -0.1        0.08 ±  6%  perf-profile.children.cycles-pp.insert_vmap_area_augment
      0.14 ± 21%      -0.1        0.09 ±  5%  perf-profile.children.cycles-pp.__lookup_mnt
      0.20 ±  2%      -0.1        0.15 ±  3%  perf-profile.children.cycles-pp.__do_sys_newfstat
      0.31            -0.0        0.26 ±  3%  perf-profile.children.cycles-pp.nd_jump_root
      0.22 ±  3%      -0.0        0.17        perf-profile.children.cycles-pp.page_counter_charge
      0.18            -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.security_inode_permission
      0.16 ±  2%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.__x64_sys_newstat
      0.16 ±  5%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.rcu_all_qs
      0.13 ±  7%      -0.0        0.08        perf-profile.children.cycles-pp.rb_insert_color
      0.21 ±  3%      -0.0        0.16 ±  2%  perf-profile.children.cycles-pp.__memcg_kmem_charge_page
      0.20 ±  6%      -0.0        0.15 ±  3%  perf-profile.children.cycles-pp.common_perm
      0.18 ±  2%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.from_kgid_munged
      0.12            -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.pids_can_fork
      0.29 ±  2%      -0.0        0.25        perf-profile.children.cycles-pp.dequeue_entity
      0.37            -0.0        0.33        perf-profile.children.cycles-pp.__put_task_struct
      0.22 ±  2%      -0.0        0.18 ±  2%  perf-profile.children.cycles-pp.generic_fillattr
      0.16 ±  5%      -0.0        0.12        perf-profile.children.cycles-pp.__x64_sys_newlstat
      0.13 ±  3%      -0.0        0.09 ±  5%  perf-profile.children.cycles-pp.do_sched_yield
      0.40 ±  3%      -0.0        0.36 ±  2%  perf-profile.children.cycles-pp.__legitimize_mnt
      0.32            -0.0        0.28        perf-profile.children.cycles-pp.sched_move_task
      0.20            -0.0        0.16 ±  2%  perf-profile.children.cycles-pp.update_curr
      0.19 ±  2%      -0.0        0.16 ±  3%  perf-profile.children.cycles-pp.__slab_alloc
      0.19 ±  2%      -0.0        0.16 ±  3%  perf-profile.children.cycles-pp.___slab_alloc
      0.14            -0.0        0.10 ±  4%  perf-profile.children.cycles-pp.check_stack_object
      0.15 ±  3%      -0.0        0.11        perf-profile.children.cycles-pp.vfs_fstat
      0.47 ±  4%      -0.0        0.43 ±  3%  perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
      0.27            -0.0        0.23 ±  2%  perf-profile.children.cycles-pp.try_to_wake_up
      0.07 ± 14%      -0.0        0.03 ± 70%  perf-profile.children.cycles-pp.__free_pages
      0.17 ±  4%      -0.0        0.14 ±  3%  perf-profile.children.cycles-pp.mntput_no_expire
      0.17 ±  2%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.from_kuid_munged
      0.11 ±  4%      -0.0        0.08        perf-profile.children.cycles-pp.cgroup_exit
      0.42 ±  4%      -0.0        0.39 ±  3%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.19 ±  2%      -0.0        0.16 ±  2%  perf-profile.children.cycles-pp._raw_write_lock_irq
      0.18 ±  4%      -0.0        0.15 ±  5%  perf-profile.children.cycles-pp.menu_select
      0.09            -0.0        0.06        perf-profile.children.cycles-pp.copy_thread
      0.16            -0.0        0.13        perf-profile.children.cycles-pp.wake_up_q
      0.12 ±  6%      -0.0        0.09        perf-profile.children.cycles-pp.sched_post_fork
      0.11 ± 12%      -0.0        0.08        perf-profile.children.cycles-pp.propagate_protected_usage
      0.16 ±  3%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.add_device_randomness
      0.14 ±  3%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.14 ±  3%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.free_pid
      0.14            -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.32 ±  3%      -0.0        0.29        perf-profile.children.cycles-pp.stress_fstat_helper
      0.24 ±  3%      -0.0        0.21        perf-profile.children.cycles-pp.account_kernel_stack
      0.21 ±  2%      -0.0        0.19 ±  2%  perf-profile.children.cycles-pp.perf_event_task
      0.10 ±  4%      -0.0        0.07        perf-profile.children.cycles-pp.__list_add_valid
      0.08            -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.cpu_cgroup_fork
      0.21            -0.0        0.18 ±  2%  perf-profile.children.cycles-pp.perf_iterate_sb
      0.20 ±  4%      -0.0        0.17 ±  2%  perf-profile.children.cycles-pp.unmap_page_range
      0.26 ±  3%      -0.0        0.23 ±  4%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.17 ±  2%      -0.0        0.15        perf-profile.children.cycles-pp.perf_event_task_output
      0.09            -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.task_rq_lock
      0.15 ±  3%      -0.0        0.12 ±  3%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.09 ±  5%      -0.0        0.07        perf-profile.children.cycles-pp.__x64_sys_newfstat
      0.20 ±  2%      -0.0        0.18        perf-profile.children.cycles-pp.__fget_light
      0.16 ±  5%      -0.0        0.14 ±  3%  perf-profile.children.cycles-pp.zap_pte_range
      0.12 ±  3%      -0.0        0.10        perf-profile.children.cycles-pp.allocate_slab
      0.12 ±  4%      -0.0        0.09 ±  5%  perf-profile.children.cycles-pp.restore_nameidata
      0.10 ±  8%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.vunmap_range_noflush
      0.19 ±  5%      -0.0        0.17 ±  2%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.07            -0.0        0.05        perf-profile.children.cycles-pp.idr_alloc_cyclic
      0.07            -0.0        0.05        perf-profile.children.cycles-pp.idr_alloc_u32
      0.22 ±  4%      -0.0        0.20 ±  2%  perf-profile.children.cycles-pp.enqueue_entity
      0.09 ±  5%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.obj_cgroup_charge
      0.07 ±  6%      -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.task_fork_fair
      0.08 ±  6%      -0.0        0.06        perf-profile.children.cycles-pp.__purge_vmap_area_lazy
      0.09 ±  5%      -0.0        0.07        perf-profile.children.cycles-pp.task_change_group_fair
      0.09 ±  5%      -0.0        0.07        perf-profile.children.cycles-pp.mntput
      0.08 ±  5%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.rb_erase
      0.07 ±  7%      -0.0        0.05        perf-profile.children.cycles-pp.should_failslab
      0.07 ±  7%      -0.0        0.05        perf-profile.children.cycles-pp.refill_stock
      0.11 ±  4%      -0.0        0.10 ±  4%  perf-profile.children.cycles-pp._mix_pool_bytes
      0.12 ±  4%      -0.0        0.10        perf-profile.children.cycles-pp.native_sched_clock
      0.09 ±  5%      -0.0        0.08        perf-profile.children.cycles-pp.perf_event_fork
      0.06            -0.0        0.05        perf-profile.children.cycles-pp.read_tsc
      0.05            +0.0        0.06        perf-profile.children.cycles-pp.futex_cleanup_begin
      0.05            +0.0        0.06        perf-profile.children.cycles-pp.task_tick_fair
      0.07            +0.0        0.08        perf-profile.children.cycles-pp.proc_fd_link
      0.07            +0.0        0.08        perf-profile.children.cycles-pp.switch_fpu_return
      0.06 ±  7%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.futex_wait_setup
      0.06            +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.10            +0.0        0.12 ±  4%  perf-profile.children.cycles-pp.tlb_flush_mmu
      0.10 ±  4%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.flush_tlb_mm_range
      0.06 ±  7%      +0.0        0.08        perf-profile.children.cycles-pp.pid_revalidate
      0.11            +0.0        0.13 ±  3%  perf-profile.children.cycles-pp.tlb_finish_mmu
      0.06 ±  8%      +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.pid_update_inode
      0.09            +0.0        0.11        perf-profile.children.cycles-pp.smp_call_function_many_cond
      0.09            +0.0        0.11        perf-profile.children.cycles-pp.on_each_cpu_cond_mask
      0.06 ±  8%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.tid_fd_revalidate
      0.24            +0.0        0.26 ±  3%  perf-profile.children.cycles-pp.update_process_times
      0.27            +0.0        0.29 ±  3%  perf-profile.children.cycles-pp.tick_sched_timer
      0.25            +0.0        0.27 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.16 ±  2%      +0.0        0.19 ±  2%  perf-profile.children.cycles-pp.scheduler_tick
      0.14 ±  3%      +0.0        0.16 ±  7%  perf-profile.children.cycles-pp.stress_fstat
      0.13 ±  6%      +0.0        0.16 ±  3%  perf-profile.children.cycles-pp.proc_pid_get_link
      0.09 ±  5%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.__x64_sys_rt_sigprocmask
      0.03 ± 70%      +0.0        0.06        perf-profile.children.cycles-pp.recalc_sigpending
      0.23 ±  2%      +0.0        0.25        perf-profile.children.cycles-pp.pick_link
      0.06            +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.try_grab_compound_head
      0.11 ±  7%      +0.0        0.14 ±  6%  perf-profile.children.cycles-pp.pthread_create@@GLIBC_2.2.5
      0.23 ±  2%      +0.0        0.26 ±  3%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.19 ±  2%      +0.0        0.23 ±  2%  perf-profile.children.cycles-pp.update_rq_clock
      0.14 ±  3%      +0.0        0.18 ±  2%  perf-profile.children.cycles-pp.__slab_free
      0.03 ± 70%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.schedule_tail
      0.10            +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.gup_pgd_range
      0.17 ±  7%      +0.0        0.20 ±  2%  perf-profile.children.cycles-pp.sigprocmask
      0.12            +0.0        0.16 ±  5%  perf-profile.children.cycles-pp.cpumask_next_and
      0.03 ± 70%      +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.llist_add_batch
      0.10 ±  4%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp.internal_get_user_pages_fast
      0.02 ±141%      +0.0        0.06        perf-profile.children.cycles-pp.task_dump_owner
      0.12 ±  4%      +0.0        0.16 ±  5%  perf-profile.children.cycles-pp.get_futex_key
      0.73 ±  3%      +0.0        0.78 ±  3%  perf-profile.children.cycles-pp.__GI___pthread_timedjoin_ex
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.available_idle_cpu
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.check_preempt_curr
      0.92 ±  3%      +0.1        0.97 ±  2%  perf-profile.children.cycles-pp.do_futex
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.__set_task_blocked
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.00            +0.1        0.06 ±  8%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.00            +0.1        0.06 ±  8%  perf-profile.children.cycles-pp.down_read
      0.00            +0.1        0.06 ±  8%  perf-profile.children.cycles-pp.security_task_free
     28.72            +0.1       28.78        perf-profile.children.cycles-pp.statx
      0.17            +0.1        0.23 ±  3%  perf-profile.children.cycles-pp.__unfreeze_partials
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.__set_current_blocked
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.memset_erms
      0.00            +0.1        0.07        perf-profile.children.cycles-pp.get_pid_task
      0.00            +0.1        0.08 ±  6%  perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      0.78            +0.1        0.86        perf-profile.children.cycles-pp.start_thread
      0.93 ±  2%      +0.1        1.05 ±  7%  perf-profile.children.cycles-pp.load_balance
      0.55            +0.1        0.68 ±  5%  perf-profile.children.cycles-pp.lockref_put_return
      4.80            +1.0        5.76        perf-profile.children.cycles-pp.vfs_getattr
      4.69            +1.0        5.67        perf-profile.children.cycles-pp.security_inode_getattr
      4.56            +1.0        5.54        perf-profile.children.cycles-pp.common_perm_cond
     22.55            +1.7       24.22        perf-profile.children.cycles-pp.__x64_sys_statx
     22.12            +1.8       23.90        perf-profile.children.cycles-pp.do_statx
     22.59            +2.0       24.62        perf-profile.children.cycles-pp.__lxstat64
     23.44            +2.1       25.52        perf-profile.children.cycles-pp.__xstat64
     37.10            +2.5       39.63        perf-profile.children.cycles-pp.user_path_at_empty
     19.79            +2.7       22.53        perf-profile.children.cycles-pp.__do_sys_newlstat
     20.65            +2.8       23.46        perf-profile.children.cycles-pp.__do_sys_newstat
     82.06            +3.4       85.49        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     81.30            +3.6       84.92        perf-profile.children.cycles-pp.do_syscall_64
     15.84            +4.8       20.62        perf-profile.children.cycles-pp.lockref_put_or_lock
     16.63            +4.8       21.42        perf-profile.children.cycles-pp.path_put
     16.87            +4.8       21.70        perf-profile.children.cycles-pp.dput
     27.55            +5.2       32.80        perf-profile.children.cycles-pp.filename_lookup
     26.97            +5.4       32.38        perf-profile.children.cycles-pp.path_lookupat
     20.95            +6.4       27.36        perf-profile.children.cycles-pp.complete_walk
     20.83            +6.4       27.27        perf-profile.children.cycles-pp.try_to_unlazy
     20.74            +6.5       27.27        perf-profile.children.cycles-pp.__legitimize_path
     20.26            +6.6       26.86        perf-profile.children.cycles-pp.lockref_get_not_dead
     59.92            +8.0       67.89        perf-profile.children.cycles-pp.vfs_statx
      3.29 ±  3%      -1.6        1.71 ±  2%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      2.81            -0.7        2.08        perf-profile.self.cycles-pp.syscall_return_via_sysret
      2.35            -0.6        1.70        perf-profile.self.cycles-pp.strncpy_from_user
      1.92            -0.5        1.45        perf-profile.self.cycles-pp.statx
      1.31 ±  2%      -0.4        0.87        perf-profile.self.cycles-pp.kmem_cache_free
      2.35 ±  3%      -0.4        1.96 ±  2%  perf-profile.self.cycles-pp.intel_idle
      1.23            -0.3        0.90        perf-profile.self.cycles-pp.syscall_exit_to_user_mode
      1.20            -0.3        0.88        perf-profile.self.cycles-pp.__entry_text_start
      1.19 ±  2%      -0.3        0.88        perf-profile.self.cycles-pp.kmem_cache_alloc
      1.09 ±  4%      -0.3        0.81 ±  7%  perf-profile.self.cycles-pp.alloc_vmap_area
      1.15            -0.3        0.89        perf-profile.self.cycles-pp.__might_resched
      1.41            -0.3        1.15        perf-profile.self.cycles-pp.find_idlest_group
      0.88            -0.2        0.65 ±  2%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.77 ±  3%      -0.2        0.53        perf-profile.self.cycles-pp.__check_object_size
      0.85            -0.2        0.63        perf-profile.self.cycles-pp.link_path_walk
      0.86            -0.2        0.63        perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.65            -0.2        0.45 ±  2%  perf-profile.self.cycles-pp.getname_flags
      0.74 ±  3%      -0.2        0.53 ±  3%  perf-profile.self.cycles-pp.shim_statx
      0.71            -0.2        0.51        perf-profile.self.cycles-pp.__check_heap_object
      0.69            -0.2        0.51        perf-profile.self.cycles-pp.do_syscall_64
      0.64            -0.2        0.47        perf-profile.self.cycles-pp.__lxstat64
      0.63 ±  2%      -0.2        0.47        perf-profile.self.cycles-pp.__xstat64
      0.88            -0.2        0.73        perf-profile.self.cycles-pp._raw_spin_lock
      0.58            -0.2        0.43 ±  5%  perf-profile.self.cycles-pp.step_into
      0.56            -0.1        0.42        perf-profile.self.cycles-pp.vfs_statx
      0.57            -0.1        0.44 ±  2%  perf-profile.self.cycles-pp.clear_page_erms
      0.47            -0.1        0.33        perf-profile.self.cycles-pp.filename_lookup
      0.55            -0.1        0.42        perf-profile.self.cycles-pp.__might_sleep
      0.47            -0.1        0.36        perf-profile.self.cycles-pp.syscall_enter_from_user_mode
      0.47 ±  2%      -0.1        0.36        perf-profile.self.cycles-pp.vfs_getattr_nosec
      0.41 ±  3%      -0.1        0.30        perf-profile.self.cycles-pp.__x64_sys_statx
      0.41            -0.1        0.31        perf-profile.self.cycles-pp.lookup_fast
      0.37            -0.1        0.27        perf-profile.self.cycles-pp.path_lookupat
      0.35 ±  3%      -0.1        0.26        perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
      0.31 ±  4%      -0.1        0.21        perf-profile.self.cycles-pp.user_path_at_empty
      0.34            -0.1        0.25        perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.34            -0.1        0.25        perf-profile.self.cycles-pp.walk_component
      0.33 ±  2%      -0.1        0.24        perf-profile.self.cycles-pp.do_statx
      0.31            -0.1        0.23 ±  2%  perf-profile.self.cycles-pp.path_init
      0.35            -0.1        0.26        perf-profile.self.cycles-pp.__fxstat64
      0.50 ±  2%      -0.1        0.42 ±  3%  perf-profile.self.cycles-pp.memcpy_erms
      0.36            -0.1        0.27 ±  4%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.83 ±  3%      -0.1        0.75        perf-profile.self.cycles-pp.__d_lookup_rcu
      0.27            -0.1        0.20 ±  2%  perf-profile.self.cycles-pp.inode_permission
      0.25            -0.1        0.18 ±  2%  perf-profile.self.cycles-pp.putname
      0.24            -0.1        0.17 ±  5%  perf-profile.self.cycles-pp.free_vmap_area_noflush
      0.22 ±  2%      -0.1        0.15 ±  3%  perf-profile.self.cycles-pp.find_vmap_area
      0.20 ±  4%      -0.1        0.14 ±  3%  perf-profile.self.cycles-pp.__vmalloc_area_node
      0.17 ±  2%      -0.1        0.11 ±  4%  perf-profile.self.cycles-pp.insert_vmap_area
      0.26 ±  3%      -0.1        0.20 ±  2%  perf-profile.self.cycles-pp.map_id_up
      0.39 ±  5%      -0.1        0.33        perf-profile.self.cycles-pp.generic_permission
      0.25 ±  3%      -0.1        0.19 ±  2%  perf-profile.self.cycles-pp.refcount_dec_not_one
      0.24            -0.1        0.18 ±  6%  perf-profile.self.cycles-pp.cp_statx
      0.18 ±  2%      -0.0        0.13 ±  3%  perf-profile.self.cycles-pp.__cond_resched
      0.12 ±  3%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.__alloc_pages_bulk
      0.25            -0.0        0.21 ±  2%  perf-profile.self.cycles-pp.cp_new_stat
      0.20 ±  2%      -0.0        0.16 ±  3%  perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
      0.16 ±  2%      -0.0        0.12        perf-profile.self.cycles-pp.terminate_walk
      0.12            -0.0        0.08 ±  6%  perf-profile.self.cycles-pp.pids_can_fork
      0.12 ± 24%      -0.0        0.08 ±  6%  perf-profile.self.cycles-pp.__lookup_mnt
      0.39 ±  3%      -0.0        0.35 ±  2%  perf-profile.self.cycles-pp.__legitimize_mnt
      0.19 ±  2%      -0.0        0.15 ±  3%  perf-profile.self.cycles-pp.page_counter_charge
      0.14 ±  3%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.try_to_unlazy
      0.14 ±  3%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.__x64_sys_newstat
      0.18 ±  7%      -0.0        0.14 ±  6%  perf-profile.self.cycles-pp.common_perm
      0.28            -0.0        0.24        perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.20            -0.0        0.16 ±  2%  perf-profile.self.cycles-pp.dput
      0.19 ±  2%      -0.0        0.16 ±  3%  perf-profile.self.cycles-pp.queued_write_lock_slowpath
      0.19 ±  4%      -0.0        0.15 ±  3%  perf-profile.self.cycles-pp.__might_fault
      0.15            -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.security_inode_permission
      0.15            -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.__do_sys_newlstat
      0.13 ±  3%      -0.0        0.09        perf-profile.self.cycles-pp.nd_jump_root
      0.12 ±  8%      -0.0        0.08        perf-profile.self.cycles-pp.rb_insert_color
      0.31            -0.0        0.28        perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.20            -0.0        0.17 ±  2%  perf-profile.self.cycles-pp.generic_fillattr
      0.14            -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.dup_task_struct
      0.11 ±  4%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.rcu_all_qs
      0.19 ±  2%      -0.0        0.16 ±  2%  perf-profile.self.cycles-pp._raw_write_lock_irq
      0.14 ±  5%      -0.0        0.11        perf-profile.self.cycles-pp.__x64_sys_newlstat
      0.06 ±  7%      -0.0        0.03 ± 70%  perf-profile.self.cycles-pp.__free_pages
      0.07 ±  7%      -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.dequeue_task_fair
      0.09 ±  5%      -0.0        0.06        perf-profile.self.cycles-pp.legitimize_links
      0.09 ±  5%      -0.0        0.06        perf-profile.self.cycles-pp.__list_add_valid
      0.06            -0.0        0.03 ± 70%  perf-profile.self.cycles-pp.___slab_alloc
      0.12 ±  3%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.__do_sys_newstat
      0.15 ±  3%      -0.0        0.13 ±  3%  perf-profile.self.cycles-pp.mntput_no_expire
      0.12 ±  4%      -0.0        0.09        perf-profile.self.cycles-pp._copy_to_user
      0.14 ±  3%      -0.0        0.11 ±  4%  perf-profile.self.cycles-pp.__legitimize_path
      0.19 ±  2%      -0.0        0.17        perf-profile.self.cycles-pp.__fget_light
      0.14 ±  3%      -0.0        0.12 ±  6%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.11 ±  4%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.zap_pte_range
      0.10            -0.0        0.08 ±  6%  perf-profile.self.cycles-pp.check_stack_object
      0.10 ±  4%      -0.0        0.08        perf-profile.self.cycles-pp.enqueue_entity
      0.10 ±  9%      -0.0        0.08        perf-profile.self.cycles-pp.propagate_protected_usage
      0.10 ±  4%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.vunmap_range_noflush
      0.08 ±  5%      -0.0        0.06        perf-profile.self.cycles-pp.__x64_sys_newfstat
      0.08 ±  5%      -0.0        0.06        perf-profile.self.cycles-pp.rb_erase
      0.11 ±  7%      -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.complete_walk
      0.10 ±  8%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.vfs_getattr
      0.09 ±  5%      -0.0        0.07        perf-profile.self.cycles-pp.cpumask_next
      0.11 ±  4%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.native_sched_clock
      0.11 ±  4%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp._mix_pool_bytes
      0.10 ±  4%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.security_inode_getattr
      0.11 ±  4%      -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.09 ±  5%      -0.0        0.08        perf-profile.self.cycles-pp.update_curr
      0.09 ±  5%      -0.0        0.08        perf-profile.self.cycles-pp.restore_nameidata
      0.06            -0.0        0.05        perf-profile.self.cycles-pp.mntput
      0.06            +0.0        0.07        perf-profile.self.cycles-pp.finish_task_switch
      0.18            +0.0        0.20 ±  2%  perf-profile.self.cycles-pp.update_load_avg
      0.11 ±  4%      +0.0        0.12 ±  3%  perf-profile.self.cycles-pp.__switch_to
      0.23 ±  2%      +0.0        0.25 ±  3%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.10 ±  9%      +0.0        0.13 ±  6%  perf-profile.self.cycles-pp.start_thread
      0.06            +0.0        0.09 ±  5%  perf-profile.self.cycles-pp.try_grab_compound_head
      0.11 ±  7%      +0.0        0.14 ±  6%  perf-profile.self.cycles-pp.pthread_create@@GLIBC_2.2.5
      0.03 ± 70%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.__GI___pthread_timedjoin_ex
      0.14 ±  3%      +0.0        0.18 ±  2%  perf-profile.self.cycles-pp.__slab_free
      0.03 ± 70%      +0.0        0.07 ±  6%  perf-profile.self.cycles-pp.llist_add_batch
      0.11            +0.0        0.16 ±  3%  perf-profile.self.cycles-pp.update_rq_clock
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.cpumask_next_and
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.gup_pgd_range
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.memset_erms
      0.00            +0.1        0.07        perf-profile.self.cycles-pp.get_pid_task
      0.58            +0.1        0.66 ±  6%  perf-profile.self.cycles-pp.update_sd_lb_stats
      0.06 ±  7%      +0.1        0.18 ±  7%  perf-profile.self.cycles-pp.select_task_rq_fair
      0.54            +0.1        0.68 ±  5%  perf-profile.self.cycles-pp.lockref_put_return
      4.33            +1.0        5.35        perf-profile.self.cycles-pp.common_perm_cond
     15.69            +4.8       20.45        perf-profile.self.cycles-pp.lockref_put_or_lock
     20.07            +6.6       26.62        perf-profile.self.cycles-pp.lockref_get_not_dead





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


-- 
0-DAY CI Kernel Test Service
https://01.org/lkp



View attachment "config-5.17.0-rc1-00026-g2cfb7a1b031b" of type "text/plain" (161384 bytes)

View attachment "job-script" of type "text/plain" (8421 bytes)

View attachment "job.yaml" of type "text/plain" (5807 bytes)

View attachment "reproduce" of type "text/plain" (527 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ