lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Sun, 21 Aug 2022 20:43:52 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Rik van Riel <riel@...riel.com>
CC:     <lkp@...ts.01.org>, <lkp@...el.com>,
        Andrew Morton <akpm@...ux-foundation.org>,
        Yang Shi <shy828301@...il.com>,
        Matthew Wilcox <willy@...radead.org>,
        LKML <linux-kernel@...r.kernel.org>,
        "Linux Memory Management List" <linux-mm@...ck.org>,
        <ying.huang@...el.com>, <feng.tang@...el.com>,
        <zhengjun.xing@...ux.intel.com>, <fengwei.yin@...el.com>
Subject: [mm]  96db82a66d:  will-it-scale.per_process_ops -95.3% regression



Greeting,

FYI, we noticed a -95.3% regression of will-it-scale.per_process_ops due to commit:


commit: 96db82a66d1db0e2966c02dc492e02eeb3a94a75 ("mm: align larger anonymous mappings on THP boundaries")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master

in testcase: will-it-scale
on test machine: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
with following parameters:

	nr_task: 50%
	mode: process
	test: malloc1
	cpufreq_governor: performance
	ucode: 0x5003302

test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale

In addition to that, the commit also has significant impact on the following tests:

+------------------+------------------------------------------------------------------------------------------------+
| testcase: change | kbuild: kbuild.buildtime_per_iteration -2.9% improvement                                       |
| test machine     | 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory                |
| test parameters  | cpufreq_governor=performance                                                                   |
|                  | disk=1HDD                                                                                      |
|                  | fs=ext4                                                                                        |
|                  | nr_task=200%                                                                                   |
|                  | runtime=300s                                                                                   |
|                  | target=autoksyms_recursive                                                                     |
|                  | ucode=0x5003302                                                                                |
+------------------+------------------------------------------------------------------------------------------------+
| testcase: change | phoronix-test-suite: phoronix-test-suite.darktable.ServerRoom.CPU-only.seconds 3.3% regression |
| test machine     | 12 threads 1 sockets Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz with 16G memory                   |
| test parameters  | cpufreq_governor=performance                                                                   |
|                  | option_a=Server Room                                                                           |
|                  | option_b=CPU-only                                                                              |
|                  | test=darktable-1.0.5                                                                           |
|                  | ucode=0xf0                                                                                     |
+------------------+------------------------------------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
  gcc-11/performance/x86_64-rhel-8.3/process/50%/debian-11.1-x86_64-20220510.cgz/lkp-csl-2sp9/malloc1/will-it-scale/0x5003302

commit: 
  848d022dec ("mm: fix use-after free of page_ext after race with memory-offline")
  96db82a66d ("mm: align larger anonymous mappings on THP boundaries")

848d022decb8dea1 96db82a66d1db0e2966c02dc492 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   1763244 ±  5%     -95.3%      82700 ±  5%  will-it-scale.44.processes
     49.58            -1.2%      49.00        will-it-scale.44.processes_idle
     40073 ±  5%     -95.3%       1879 ±  5%  will-it-scale.per_process_ops
   1763244 ±  5%     -95.3%      82700 ±  5%  will-it-scale.workload
     37986           +13.9%      43263        meminfo.Mapped
      0.67 ±  4%      +1.0        1.62        mpstat.cpu.all.irq%
      0.02 ±  4%      +0.1        0.08 ±  4%  mpstat.cpu.all.soft%
      1.34 ±  5%      -1.1        0.23 ±  5%  mpstat.cpu.all.usr%
 5.282e+08 ±  4%     -95.2%   25613304 ±  5%  numa-numastat.node0.local_node
 5.281e+08 ±  4%     -95.1%   25657770 ±  5%  numa-numastat.node0.numa_hit
 5.366e+08 ±  6%     -95.4%   24721514 ±  5%  numa-numastat.node1.local_node
 5.366e+08 ±  6%     -95.4%   24755860 ±  5%  numa-numastat.node1.numa_hit
      0.11 ±  4%     -81.2%       0.02        turbostat.IPC
     28381 ±  6%     -32.6%      19133 ±  6%  turbostat.POLL
     58.33            +6.3%      62.00        turbostat.PkgTmp
    229.42           +14.5%     262.68        turbostat.PkgWatt
     13.98          +122.0%      31.02        turbostat.RAMWatt
      2006 ±  7%     +18.7%       2380 ±  8%  numa-meminfo.node0.Active(anon)
     42618 ± 45%    +175.1%     117250 ± 34%  numa-meminfo.node1.AnonHugePages
    100247 ± 20%     +73.6%     174052 ± 24%  numa-meminfo.node1.AnonPages
    157340 ±  8%     +42.1%     223563 ± 18%  numa-meminfo.node1.AnonPages.max
    106255 ± 19%     +73.8%     184690 ± 23%  numa-meminfo.node1.Inactive
    106124 ± 19%     +74.0%     184620 ± 23%  numa-meminfo.node1.Inactive(anon)
    501.17 ±  7%     +14.0%     571.50 ±  5%  numa-vmstat.node0.nr_active_anon
    501.17 ±  7%     +14.0%     571.50 ±  5%  numa-vmstat.node0.nr_zone_active_anon
 5.281e+08 ±  4%     -95.1%   25657626 ±  5%  numa-vmstat.node0.numa_hit
 5.282e+08 ±  4%     -95.2%   25613161 ±  5%  numa-vmstat.node0.numa_local
     25062 ± 20%     +73.6%      43519 ± 24%  numa-vmstat.node1.nr_anon_pages
     26518 ± 19%     +73.9%      46123 ± 23%  numa-vmstat.node1.nr_inactive_anon
     26518 ± 19%     +74.0%      46129 ± 23%  numa-vmstat.node1.nr_zone_inactive_anon
 5.366e+08 ±  6%     -95.4%   24755753 ±  5%  numa-vmstat.node1.numa_hit
 5.366e+08 ±  6%     -95.4%   24721407 ±  5%  numa-vmstat.node1.numa_local
     67760            +4.5%      70794        proc-vmstat.nr_anon_pages
     69447            +8.7%      75502        proc-vmstat.nr_inactive_anon
      9511           +13.9%      10832        proc-vmstat.nr_mapped
     69447            +8.7%      75499        proc-vmstat.nr_zone_inactive_anon
 1.065e+09 ±  5%     -95.3%   50416124 ±  5%  proc-vmstat.numa_hit
 1.065e+09 ±  5%     -95.3%   50337312 ±  5%  proc-vmstat.numa_local
     92585 ± 11%    +367.5%     432813 ±  5%  proc-vmstat.numa_pte_updates
     51867 ±  2%      -5.3%      49128 ±  2%  proc-vmstat.pgactivate
 1.064e+09 ±  5%     -95.3%   50413156 ±  5%  proc-vmstat.pgalloc_normal
 5.323e+08 ±  5%     -95.2%   25678027 ±  5%  proc-vmstat.pgfault
 1.064e+09 ±  5%     -95.3%   50434902 ±  5%  proc-vmstat.pgfree
     10.83 ±  6%  +2.3e+08%   24836994 ±  5%  proc-vmstat.thp_fault_alloc
     12534 ±  7%     +18.8%      14885 ± 11%  sched_debug.cfs_rq:/.load.avg
     83309 ± 93%    +216.3%     263483 ± 54%  sched_debug.cfs_rq:/.load.max
     16435 ± 49%    +113.6%      35109 ± 42%  sched_debug.cfs_rq:/.load.stddev
   6269514 ±  7%     -15.9%    5274579 ±  7%  sched_debug.cfs_rq:/.min_vruntime.max
   1732678 ± 13%     -29.7%    1217567 ±  6%  sched_debug.cfs_rq:/.min_vruntime.stddev
   1732680 ± 13%     -29.7%    1217574 ±  6%  sched_debug.cfs_rq:/.spread0.stddev
    401.94 ±  5%     -37.5%     251.30 ±  5%  sched_debug.cfs_rq:/.util_est_enqueued.avg
    402.11 ±  2%     -38.9%     245.63 ±  8%  sched_debug.cfs_rq:/.util_est_enqueued.stddev
    202272 ± 46%     +80.9%     365877 ± 19%  sched_debug.cpu.avg_idle.min
    139913 ±  9%     -20.3%     111557 ± 10%  sched_debug.cpu.avg_idle.stddev
      2.64 ±  3%    +265.4%       9.63 ±  6%  sched_debug.cpu.clock.stddev
      8281 ±  3%      -6.4%       7752 ±  3%  sched_debug.cpu.curr->pid.max
      8.75 ±  7%    +264.6%      31.92        perf-stat.i.MPKI
 1.021e+10 ±  6%     -83.4%  1.697e+09 ±  4%  perf-stat.i.branch-instructions
      0.30 ±  2%      +0.0        0.33 ±  2%  perf-stat.i.branch-miss-rate%
  29728542 ±  4%     -79.8%    6010303 ±  5%  perf-stat.i.branch-misses
     15.35 ±  6%      +8.4       23.71 ±  2%  perf-stat.i.cache-miss-rate%
 3.941e+08           -40.9%   2.33e+08 ±  3%  perf-stat.i.cache-references
      1592            -1.7%       1566        perf-stat.i.context-switches
      2.73 ±  5%    +526.2%      17.12 ±  3%  perf-stat.i.cpi
    117.04            -1.9%     114.87        perf-stat.i.cpu-migrations
      2083 ±  7%      +8.6%       2263        perf-stat.i.cycles-between-cache-misses
      0.02 ±  2%      -0.0        0.01 ±  2%  perf-stat.i.dTLB-load-miss-rate%
   1869749 ±  5%     -91.3%     163394 ±  4%  perf-stat.i.dTLB-load-misses
 1.086e+10 ±  5%     -81.5%  2.011e+09 ±  4%  perf-stat.i.dTLB-loads
      0.14            -0.1        0.03        perf-stat.i.dTLB-store-miss-rate%
   7027160 ±  5%     -95.1%     347011 ±  5%  perf-stat.i.dTLB-store-misses
 4.955e+09 ±  5%     -77.5%  1.116e+09 ±  4%  perf-stat.i.dTLB-stores
     29.44           +14.4       43.87        perf-stat.i.iTLB-load-miss-rate%
  11859406 ±  5%     -85.4%    1734018 ±  4%  perf-stat.i.iTLB-load-misses
  28072704 ±  4%     -92.1%    2207285 ±  4%  perf-stat.i.iTLB-loads
 4.539e+10 ±  5%     -83.8%  7.348e+09 ±  4%  perf-stat.i.instructions
      3926            +8.9%       4274 ±  4%  perf-stat.i.instructions-per-iTLB-miss
      0.37 ±  5%     -83.8%       0.06 ±  4%  perf-stat.i.ipc
      0.01 ± 63%   +1854.5%       0.14 ± 57%  perf-stat.i.major-faults
    615.53           -12.3%     539.90        perf-stat.i.metric.K/sec
    300.17 ±  5%     -80.9%      57.45 ±  4%  perf-stat.i.metric.M/sec
   1755690 ±  5%     -95.2%      84703 ±  5%  perf-stat.i.minor-faults
     89.89           -80.8        9.07 ±  2%  perf-stat.i.node-load-miss-rate%
   7634484 ± 10%     -94.4%     424079 ±  2%  perf-stat.i.node-load-misses
    856205 ±  9%    +404.2%    4317026        perf-stat.i.node-loads
     99.78           -98.2        1.53 ±  6%  perf-stat.i.node-store-miss-rate%
   7019755 ±  3%     -91.5%     593413 ±  5%  perf-stat.i.node-store-misses
     11827 ± 14%  +3.3e+05%   39288635 ±  2%  perf-stat.i.node-stores
   1755690 ±  5%     -95.2%      84703 ±  5%  perf-stat.i.page-faults
      8.72 ±  7%    +263.3%      31.69        perf-stat.overall.MPKI
      0.29            +0.1        0.36 ±  2%  perf-stat.overall.branch-miss-rate%
     15.38 ±  7%      +8.2       23.62 ±  3%  perf-stat.overall.cache-miss-rate%
      2.72 ±  5%    +521.5%      16.91 ±  4%  perf-stat.overall.cpi
      2043 ±  8%     +10.5%       2258        perf-stat.overall.cycles-between-cache-misses
      0.02            -0.0        0.01        perf-stat.overall.dTLB-load-miss-rate%
      0.14            -0.1        0.03        perf-stat.overall.dTLB-store-miss-rate%
     29.69           +14.3       44.00        perf-stat.overall.iTLB-load-miss-rate%
      3827           +10.9%       4242 ±  4%  perf-stat.overall.instructions-per-iTLB-miss
      0.37 ±  5%     -83.9%       0.06 ±  4%  perf-stat.overall.ipc
     89.90           -81.0        8.90 ±  2%  perf-stat.overall.node-load-miss-rate%
     99.83           -98.3        1.49 ±  4%  perf-stat.overall.node-store-miss-rate%
   7800302          +244.2%   26850848        perf-stat.overall.path-length
 1.018e+10 ±  6%     -83.4%  1.691e+09 ±  4%  perf-stat.ps.branch-instructions
  29671967 ±  4%     -79.6%    6039841 ±  5%  perf-stat.ps.branch-misses
 3.928e+08           -40.9%   2.32e+08 ±  3%  perf-stat.ps.cache-references
      1587            -1.9%       1556        perf-stat.ps.context-switches
    116.91            -2.2%     114.35        perf-stat.ps.cpu-migrations
   1863496 ±  5%     -91.2%     163497 ±  4%  perf-stat.ps.dTLB-load-misses
 1.082e+10 ±  5%     -81.5%  2.004e+09 ±  4%  perf-stat.ps.dTLB-loads
   7003858 ±  5%     -95.1%     345551 ±  5%  perf-stat.ps.dTLB-store-misses
 4.939e+09 ±  5%     -77.5%  1.111e+09 ±  4%  perf-stat.ps.dTLB-stores
  11816254 ±  5%     -85.4%    1727549 ±  4%  perf-stat.ps.iTLB-load-misses
  27979724 ±  4%     -92.1%    2198096 ±  4%  perf-stat.ps.iTLB-loads
 4.524e+10 ±  5%     -83.8%  7.322e+09 ±  4%  perf-stat.ps.instructions
      0.01 ± 62%   +1899.9%       0.14 ± 60%  perf-stat.ps.major-faults
   1749859 ±  5%     -95.2%      84310 ±  5%  perf-stat.ps.minor-faults
   7610351 ± 10%     -94.4%     425738 ±  2%  perf-stat.ps.node-load-misses
    853549 ±  9%    +410.8%    4360216        perf-stat.ps.node-loads
   6996790 ±  3%     -91.6%     590637 ±  5%  perf-stat.ps.node-store-misses
     11825 ± 14%  +3.3e+05%   39145402 ±  2%  perf-stat.ps.node-stores
   1749859 ±  5%     -95.2%      84311 ±  5%  perf-stat.ps.page-faults
 1.376e+13 ±  5%     -83.9%  2.219e+12 ±  4%  perf-stat.total.instructions
     49.22 ± 14%     -47.4        1.80 ± 12%  perf-profile.calltrace.cycles-pp.__munmap
     49.08 ± 14%     -47.3        1.79 ± 12%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__munmap
     49.06 ± 14%     -47.3        1.79 ± 11%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__munmap
     49.02 ± 14%     -47.2        1.78 ± 12%  perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.__munmap
     49.02 ± 14%     -47.2        1.78 ± 11%  perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.__munmap
     48.92 ± 14%     -47.1        1.77 ± 11%  perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
     48.27 ± 15%     -46.6        1.72 ± 11%  perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64
     29.96 ± 12%     -29.1        0.88 ± 12%  perf-profile.calltrace.cycles-pp.tlb_finish_mmu.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
     26.96 ± 12%     -26.2        0.80 ± 12%  perf-profile.calltrace.cycles-pp.tlb_batch_pages_flush.tlb_finish_mmu.unmap_region.__do_munmap.__vm_munmap
     26.75 ± 12%     -26.0        0.79 ± 12%  perf-profile.calltrace.cycles-pp.release_pages.tlb_batch_pages_flush.tlb_finish_mmu.unmap_region.__do_munmap
     13.39 ± 10%     -13.4        0.00        perf-profile.calltrace.cycles-pp.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
     13.35 ± 12%     -13.4        0.00        perf-profile.calltrace.cycles-pp.__mem_cgroup_uncharge_list.release_pages.tlb_batch_pages_flush.tlb_finish_mmu.unmap_region
     13.07 ± 24%     -13.1        0.00        perf-profile.calltrace.cycles-pp.lru_add_drain.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
     13.07 ± 24%     -13.1        0.00        perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.unmap_region.__do_munmap.__vm_munmap
     13.06 ± 24%     -13.1        0.00        perf-profile.calltrace.cycles-pp.folio_batch_move_lru.lru_add_drain_cpu.lru_add_drain.unmap_region.__do_munmap
     12.02 ± 26%     -12.0        0.00        perf-profile.calltrace.cycles-pp.folio_lruvec_lock_irqsave.release_pages.tlb_batch_pages_flush.tlb_finish_mmu.unmap_region
     12.00 ± 26%     -12.0        0.00        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.folio_lruvec_lock_irqsave.release_pages.tlb_batch_pages_flush.tlb_finish_mmu
     11.78 ± 26%     -11.8        0.00        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.folio_lruvec_lock_irqsave.release_pages.tlb_batch_pages_flush
     11.58 ± 26%     -11.6        0.00        perf-profile.calltrace.cycles-pp.folio_lruvec_lock_irqsave.folio_batch_move_lru.lru_add_drain_cpu.lru_add_drain.unmap_region
     11.54 ± 26%     -11.5        0.00        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.folio_lruvec_lock_irqsave.folio_batch_move_lru.lru_add_drain_cpu.lru_add_drain
     11.32 ± 26%     -11.3        0.00        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.folio_lruvec_lock_irqsave.folio_batch_move_lru.lru_add_drain_cpu
      7.90 ± 14%      -7.9        0.00        perf-profile.calltrace.cycles-pp.uncharge_batch.__mem_cgroup_uncharge_list.release_pages.tlb_batch_pages_flush.tlb_finish_mmu
      5.84 ± 11%      -5.8        0.00        perf-profile.calltrace.cycles-pp.__mem_cgroup_charge.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      5.72 ± 10%      -5.7        0.00        perf-profile.calltrace.cycles-pp.__pte_alloc.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      5.66 ± 10%      -5.7        0.00        perf-profile.calltrace.cycles-pp.pte_alloc_one.__pte_alloc.do_anonymous_page.__handle_mm_fault.handle_mm_fault
      5.43 ± 11%      -5.4        0.00        perf-profile.calltrace.cycles-pp.uncharge_folio.__mem_cgroup_uncharge_list.release_pages.tlb_batch_pages_flush.tlb_finish_mmu
      5.09 ± 10%      -5.1        0.00        perf-profile.calltrace.cycles-pp.__alloc_pages.pte_alloc_one.__pte_alloc.do_anonymous_page.__handle_mm_fault
      3.61 ± 14%      -2.9        0.74 ± 11%  perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
      3.57 ± 14%      -2.8        0.74 ± 11%  perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__vm_munmap
      3.44 ± 14%      -2.7        0.72 ± 11%  perf-profile.calltrace.cycles-pp.zap_pmd_range.unmap_page_range.unmap_vmas.unmap_region.__do_munmap
      0.00            +0.6        0.60 ±  8%  perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages.__folio_alloc.vma_alloc_folio.do_huge_pmd_anonymous_page
      0.00            +0.6        0.61 ±  8%  perf-profile.calltrace.cycles-pp.__alloc_pages.__folio_alloc.vma_alloc_folio.do_huge_pmd_anonymous_page.__handle_mm_fault
      0.00            +0.6        0.62 ±  8%  perf-profile.calltrace.cycles-pp.__folio_alloc.vma_alloc_folio.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault
      0.00            +0.6        0.62 ±  8%  perf-profile.calltrace.cycles-pp.vma_alloc_folio.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      0.00            +0.6        0.62 ± 10%  perf-profile.calltrace.cycles-pp.zap_huge_pmd.zap_pmd_range.unmap_page_range.unmap_vmas.unmap_region
      0.00            +0.6        0.63 ± 11%  perf-profile.calltrace.cycles-pp.free_unref_page.release_pages.tlb_batch_pages_flush.tlb_finish_mmu.unmap_region
      0.00            +0.7        0.67 ±  8%  perf-profile.calltrace.cycles-pp.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
      0.00            +0.7        0.70 ± 18%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.00            +0.8        0.78 ± 17%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.clear_page_erms
      0.00            +0.8        0.79 ± 17%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.clear_page_erms.clear_huge_page
      0.00            +0.8        0.82 ± 17%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.clear_page_erms.clear_huge_page.__do_huge_pmd_anonymous_page
      0.00            +1.0        1.02 ± 15%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.clear_page_erms.clear_huge_page.__do_huge_pmd_anonymous_page.__handle_mm_fault
      0.00            +1.7        1.66 ±  9%  perf-profile.calltrace.cycles-pp.__cond_resched.clear_huge_page.__do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault
      0.00            +5.0        4.99 ±  9%  perf-profile.calltrace.cycles-pp.__might_resched.clear_huge_page.__do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault
     14.44 ± 10%     +51.5       65.96 ±  9%  perf-profile.calltrace.cycles-pp.asm_exc_page_fault
     14.42 ± 10%     +51.5       65.97 ±  9%  perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
     14.40 ± 10%     +51.6       65.98 ±  9%  perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     14.19 ± 10%     +51.8       65.95 ±  9%  perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     13.48 ± 10%     +52.4       65.93 ±  9%  perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.00           +56.2       56.22 ±  9%  perf-profile.calltrace.cycles-pp.clear_page_erms.clear_huge_page.__do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault
      0.00           +64.1       64.10 ±  9%  perf-profile.calltrace.cycles-pp.clear_huge_page.__do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      0.00           +65.2       65.23 ±  9%  perf-profile.calltrace.cycles-pp.__do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
     50.82 ± 14%     -48.7        2.14 ± 11%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     50.79 ± 14%     -48.6        2.14 ± 11%  perf-profile.children.cycles-pp.do_syscall_64
     49.25 ± 14%     -47.4        1.80 ± 12%  perf-profile.children.cycles-pp.__munmap
     49.03 ± 14%     -47.2        1.78 ± 12%  perf-profile.children.cycles-pp.__x64_sys_munmap
     49.02 ± 14%     -47.2        1.78 ± 11%  perf-profile.children.cycles-pp.__vm_munmap
     48.93 ± 14%     -47.2        1.77 ± 12%  perf-profile.children.cycles-pp.__do_munmap
     48.28 ± 15%     -46.6        1.72 ± 11%  perf-profile.children.cycles-pp.unmap_region
     29.96 ± 12%     -29.1        0.88 ± 12%  perf-profile.children.cycles-pp.tlb_finish_mmu
     26.96 ± 12%     -26.2        0.80 ± 12%  perf-profile.children.cycles-pp.tlb_batch_pages_flush
     26.89 ± 12%     -26.1        0.79 ± 12%  perf-profile.children.cycles-pp.release_pages
     23.61 ± 26%     -23.6        0.00        perf-profile.children.cycles-pp.folio_lruvec_lock_irqsave
     23.57 ± 26%     -23.5        0.07 ± 20%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     23.11 ± 26%     -22.5        0.65 ±  9%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
     13.40 ± 10%     -13.4        0.00        perf-profile.children.cycles-pp.do_anonymous_page
     13.36 ± 12%     -13.4        0.00        perf-profile.children.cycles-pp.__mem_cgroup_uncharge_list
     13.10 ± 24%     -13.1        0.00        perf-profile.children.cycles-pp.lru_add_drain
     13.09 ± 24%     -13.1        0.00        perf-profile.children.cycles-pp.lru_add_drain_cpu
     13.08 ± 24%     -13.0        0.10 ± 15%  perf-profile.children.cycles-pp.folio_batch_move_lru
      7.91 ± 14%      -7.9        0.04 ± 71%  perf-profile.children.cycles-pp.uncharge_batch
      5.86 ± 11%      -5.8        0.08 ± 20%  perf-profile.children.cycles-pp.__mem_cgroup_charge
      5.72 ± 10%      -5.7        0.00        perf-profile.children.cycles-pp.__pte_alloc
      5.44 ± 11%      -5.4        0.00        perf-profile.children.cycles-pp.uncharge_folio
      5.66 ± 10%      -5.2        0.45 ± 10%  perf-profile.children.cycles-pp.pte_alloc_one
      4.80 ± 11%      -4.7        0.07 ± 14%  perf-profile.children.cycles-pp.__memcg_kmem_charge_page
      5.36 ± 10%      -4.3        1.04 ±  9%  perf-profile.children.cycles-pp.__alloc_pages
      2.94 ±  9%      -2.9        0.06 ± 11%  perf-profile.children.cycles-pp.flush_tlb_mm_range
      3.61 ± 14%      -2.9        0.75 ± 11%  perf-profile.children.cycles-pp.unmap_vmas
      3.57 ± 14%      -2.8        0.74 ± 11%  perf-profile.children.cycles-pp.unmap_page_range
      2.86 ±  9%      -2.8        0.04 ± 45%  perf-profile.children.cycles-pp.flush_tlb_func
      3.51 ± 14%      -2.8        0.73 ± 11%  perf-profile.children.cycles-pp.zap_pmd_range
      2.80 ±  9%      -2.8        0.03 ± 70%  perf-profile.children.cycles-pp.native_flush_tlb_one_user
      2.25 ± 11%      -2.2        0.07 ± 16%  perf-profile.children.cycles-pp.charge_memcg
      2.09 ± 14%      -2.0        0.09 ± 21%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      1.80 ± 10%      -1.6        0.21 ± 14%  perf-profile.children.cycles-pp.__mmap
      1.55 ±  9%      -1.4        0.19 ± 15%  perf-profile.children.cycles-pp.vm_mmap_pgoff
      1.37 ± 10%      -1.3        0.07 ±  9%  perf-profile.children.cycles-pp.native_irq_return_iret
      1.28 ± 11%      -1.2        0.04 ± 71%  perf-profile.children.cycles-pp.kmem_cache_alloc
      1.38 ±  8%      -1.2        0.17 ± 14%  perf-profile.children.cycles-pp.do_mmap
      1.20 ±  8%      -1.1        0.14 ± 15%  perf-profile.children.cycles-pp.mmap_region
      0.93 ± 11%      -0.9        0.04 ± 71%  perf-profile.children.cycles-pp.lru_add_fn
      0.54 ± 20%      -0.5        0.05 ± 46%  perf-profile.children.cycles-pp.free_pgtables
      0.52 ± 21%      -0.5        0.04 ± 71%  perf-profile.children.cycles-pp.unlink_anon_vmas
      0.49 ± 16%      -0.5        0.02 ± 99%  perf-profile.children.cycles-pp.page_add_new_anon_rmap
      0.50 ± 14%      -0.4        0.07 ± 16%  perf-profile.children.cycles-pp.try_charge_memcg
      0.32 ± 16%      -0.3        0.02 ± 99%  perf-profile.children.cycles-pp.perf_event_mmap
      0.28 ± 17%      -0.3        0.02 ± 99%  perf-profile.children.cycles-pp.perf_event_mmap_event
      0.07 ± 18%      +0.0        0.12 ± 18%  perf-profile.children.cycles-pp.__mod_node_page_state
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.free_compound_page
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.__mem_cgroup_uncharge
      0.00            +0.1        0.07 ± 21%  perf-profile.children.cycles-pp.orc_find
      0.00            +0.1        0.09 ± 18%  perf-profile.children.cycles-pp.__orc_find
      0.00            +0.1        0.10 ± 16%  perf-profile.children.cycles-pp.folio_add_lru
      0.00            +0.1        0.11 ± 29%  perf-profile.children.cycles-pp.__unwind_start
      0.10 ± 10%      +0.2        0.25 ± 22%  perf-profile.children.cycles-pp.unwind_next_frame
      0.12 ± 10%      +0.2        0.29 ± 22%  perf-profile.children.cycles-pp.perf_callchain_kernel
      0.14 ± 10%      +0.2        0.34 ± 21%  perf-profile.children.cycles-pp.perf_callchain
      0.14 ± 10%      +0.2        0.34 ± 21%  perf-profile.children.cycles-pp.get_perf_callchain
      0.15 ± 10%      +0.2        0.37 ± 23%  perf-profile.children.cycles-pp.perf_prepare_sample
      0.17 ± 12%      +0.2        0.39 ± 21%  perf-profile.children.cycles-pp.perf_event_output_forward
      0.17 ± 12%      +0.2        0.40 ± 21%  perf-profile.children.cycles-pp.__perf_event_overflow
      0.17 ±  9%      +0.2        0.42 ± 21%  perf-profile.children.cycles-pp.perf_tp_event
      0.17 ± 12%      +0.3        0.44 ± 21%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      0.18 ± 11%      +0.3        0.48 ± 21%  perf-profile.children.cycles-pp.update_curr
      0.00            +0.3        0.31 ± 15%  perf-profile.children.cycles-pp.free_pcp_prepare
      0.30 ± 15%      +0.3        0.63 ±  8%  perf-profile.children.cycles-pp.vma_alloc_folio
      0.21 ± 12%      +0.3        0.55 ± 19%  perf-profile.children.cycles-pp.task_tick_fair
      0.00            +0.3        0.34 ± 10%  perf-profile.children.cycles-pp.__free_one_page
      0.27 ± 14%      +0.4        0.62 ±  7%  perf-profile.children.cycles-pp.__folio_alloc
      0.00            +0.4        0.36 ±  7%  perf-profile.children.cycles-pp.check_new_pages
      0.23 ± 12%      +0.4        0.62 ± 20%  perf-profile.children.cycles-pp.scheduler_tick
      0.24 ± 11%      +0.5        0.74 ± 20%  perf-profile.children.cycles-pp.update_process_times
      0.24 ± 11%      +0.5        0.74 ± 20%  perf-profile.children.cycles-pp.tick_sched_handle
      0.45 ± 15%      +0.5        0.96 ±  8%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.26 ± 11%      +0.5        0.76 ± 20%  perf-profile.children.cycles-pp.tick_sched_timer
      0.28 ± 10%      +0.6        0.85 ± 18%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.35 ± 12%      +0.6        0.94 ± 17%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.35 ± 12%      +0.6        0.95 ± 17%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      0.38 ± 11%      +0.6        0.99 ± 16%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      0.00            +0.6        0.62 ± 10%  perf-profile.children.cycles-pp.zap_huge_pmd
      0.13 ± 17%      +0.6        0.78 ±  9%  perf-profile.children.cycles-pp._raw_spin_lock
      0.14 ± 15%      +0.7        0.79 ±  8%  perf-profile.children.cycles-pp.rmqueue
      0.00            +0.7        0.67 ±  8%  perf-profile.children.cycles-pp.do_huge_pmd_anonymous_page
      0.00            +0.8        0.76 ±  7%  perf-profile.children.cycles-pp.rmqueue_bulk
      0.42 ± 11%      +0.8        1.21 ± 15%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.00            +0.8        0.84 ±  9%  perf-profile.children.cycles-pp.free_pcppages_bulk
      0.00            +1.2        1.19 ± 10%  perf-profile.children.cycles-pp.free_unref_page
      0.46 ± 15%      +1.3        1.73 ±  9%  perf-profile.children.cycles-pp.__cond_resched
      0.82 ± 17%      +4.6        5.43 ±  9%  perf-profile.children.cycles-pp.__might_resched
     14.50 ± 10%     +51.5       66.02 ±  9%  perf-profile.children.cycles-pp.asm_exc_page_fault
     14.44 ± 10%     +51.6       66.00 ±  9%  perf-profile.children.cycles-pp.exc_page_fault
     14.42 ± 10%     +51.6       65.99 ±  9%  perf-profile.children.cycles-pp.do_user_addr_fault
     14.21 ± 10%     +51.8       65.97 ±  9%  perf-profile.children.cycles-pp.handle_mm_fault
     13.49 ± 10%     +52.4       65.94 ±  9%  perf-profile.children.cycles-pp.__handle_mm_fault
      0.25 ± 15%     +56.5       56.80 ±  9%  perf-profile.children.cycles-pp.clear_page_erms
      0.00           +64.4       64.42 ±  9%  perf-profile.children.cycles-pp.clear_huge_page
      0.00           +65.2       65.23 ±  9%  perf-profile.children.cycles-pp.__do_huge_pmd_anonymous_page
     23.11 ± 26%     -22.5        0.65 ±  9%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      5.40 ± 12%      -5.4        0.00        perf-profile.self.cycles-pp.uncharge_folio
      2.79 ±  9%      -2.8        0.03 ± 70%  perf-profile.self.cycles-pp.native_flush_tlb_one_user
      1.37 ± 10%      -1.3        0.07 ±  9%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.47 ± 18%      -0.4        0.06 ± 17%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.00            +0.1        0.07 ± 21%  perf-profile.self.cycles-pp.orc_find
      0.05 ± 46%      +0.1        0.13 ± 15%  perf-profile.self.cycles-pp.get_page_from_freelist
      0.00            +0.1        0.08 ± 22%  perf-profile.self.cycles-pp.unwind_next_frame
      0.00            +0.1        0.09 ± 18%  perf-profile.self.cycles-pp.__orc_find
      0.00            +0.3        0.29 ± 15%  perf-profile.self.cycles-pp.free_pcp_prepare
      0.00            +0.3        0.32 ± 10%  perf-profile.self.cycles-pp.__free_one_page
      0.00            +0.4        0.36 ±  7%  perf-profile.self.cycles-pp.check_new_pages
      0.00            +0.9        0.87 ±  8%  perf-profile.self.cycles-pp.clear_huge_page
      0.22 ± 16%      +1.2        1.43 ±  9%  perf-profile.self.cycles-pp.__cond_resched
      0.81 ± 17%      +4.4        5.25 ±  9%  perf-profile.self.cycles-pp.__might_resched
      0.25 ± 15%     +55.6       55.85 ±  9%  perf-profile.self.cycles-pp.clear_page_erms


***************************************************************************************************
lkp-csl-2sp9: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/nr_task/rootfs/runtime/target/tbox_group/testcase/ucode:
  gcc-11/performance/1HDD/ext4/x86_64-rhel-8.3/200%/debian-11.1-x86_64-20220510.cgz/300s/autoksyms_recursive/lkp-csl-2sp9/kbuild/0x5003302

commit: 
  848d022dec ("mm: fix use-after free of page_ext after race with memory-offline")
  96db82a66d ("mm: align larger anonymous mappings on THP boundaries")

848d022decb8dea1 96db82a66d1db0e2966c02dc492 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     41.12            -2.9%      39.92        kbuild.buildtime_per_iteration
    328.73            -2.8%     319.60        kbuild.time.elapsed_time
    328.73            -2.8%     319.60        kbuild.time.elapsed_time.max
   2291743            -1.6%    2256093        kbuild.time.involuntary_context_switches
 4.284e+08           -40.9%  2.533e+08        kbuild.time.minor_page_faults
      4393            -1.1%       4347        kbuild.time.percent_of_cpu_this_job_got
      2145           -18.0%       1758        kbuild.time.system_time
     12299            -1.3%      12135        kbuild.time.user_time
     20036            +2.7%      20567        vmstat.system.cs
      8.97           -11.6%       7.93        iostat.cpu.system
     42.00            +1.8%      42.78        iostat.cpu.user
      0.16 ±  3%      +0.0        0.18        mpstat.cpu.all.soft%
      7.37            -1.1        6.23        mpstat.cpu.all.sys%
     77614           -13.1%      67462        meminfo.Active
     76662           -13.4%      66366        meminfo.Active(anon)
    225017 ±  2%    +787.1%    1996181        meminfo.AnonHugePages
 1.993e+08           -45.3%   1.09e+08        numa-numastat.node0.local_node
 1.993e+08           -45.3%   1.09e+08        numa-numastat.node0.numa_hit
 1.946e+08           -43.1%  1.107e+08        numa-numastat.node1.local_node
 1.946e+08           -43.1%  1.107e+08        numa-numastat.node1.numa_hit
  24833334 ± 22%     -31.7%   16959032 ±  4%  turbostat.C1E
     36.79 ± 38%     -22.4       14.43 ± 33%  turbostat.C1E%
   4531468 ±117%    +172.5%   12346791        turbostat.C6
     11.76 ±118%     +22.6       34.35 ± 13%  turbostat.C6%
     47.29 ±  4%      -6.4%      44.25 ±  5%  turbostat.CPU%c1
      1.19 ±138%    +263.3%       4.32 ± 54%  turbostat.CPU%c6
      0.82 ±141%    +271.4%       3.03 ± 67%  turbostat.Pkg%pc2
     17.17            +3.0%      17.67        turbostat.RAMWatt
     11825 ± 13%     +34.0%      15847 ± 15%  sched_debug.cfs_rq:/.load.avg
    234589 ± 71%    +120.9%     518312 ± 26%  sched_debug.cfs_rq:/.load.max
     31712 ± 56%    +110.5%      66766 ± 25%  sched_debug.cfs_rq:/.load.stddev
    153.50 ± 29%     -48.6%      78.94 ± 22%  sched_debug.cfs_rq:/.removed.util_avg.max
     23.38 ± 41%     -45.6%      12.72 ± 28%  sched_debug.cfs_rq:/.removed.util_avg.stddev
    -77932           -81.6%     -14318        sched_debug.cfs_rq:/.spread0.avg
   -293205           -17.7%    -241337        sched_debug.cfs_rq:/.spread0.min
    230794 ±  6%     -11.6%     203971 ±  5%  sched_debug.cpu.avg_idle.stddev
     67564 ±  6%     +33.1%      89894 ±  2%  sched_debug.cpu.nr_switches.max
      5388 ±  5%     +21.5%       6547 ±  4%  sched_debug.cpu.nr_switches.stddev
     99158 ± 35%    +917.4%    1008861        numa-meminfo.node0.AnonHugePages
   1274603 ±  4%     +16.0%    1478448        numa-meminfo.node0.AnonPages
   3791478 ±  2%     +42.5%    5402666 ±  3%  numa-meminfo.node0.AnonPages.max
   1289683 ±  4%     +16.5%    1503073        numa-meminfo.node0.Inactive
   1289018 ±  4%     +16.4%    1500072        numa-meminfo.node0.Inactive(anon)
     69616           -14.9%      59243        numa-meminfo.node1.Active
     68901           -15.1%      58469        numa-meminfo.node1.Active(anon)
    125807 ± 27%    +674.0%     973745 ±  2%  numa-meminfo.node1.AnonHugePages
   1455256 ±  4%      -9.3%    1319605        numa-meminfo.node1.AnonPages
   1519203 ±  3%      -9.2%    1379312        numa-meminfo.node1.Inactive
   1518954 ±  3%      -9.2%    1378887        numa-meminfo.node1.Inactive(anon)
    129186 ±  2%     -12.3%     113347 ±  8%  numa-meminfo.node1.Shmem
    316436 ±  4%     +17.0%     370130        numa-vmstat.node0.nr_anon_pages
     48.00 ± 36%    +925.0%     492.00        numa-vmstat.node0.nr_anon_transparent_hugepages
    320170 ±  4%     +17.4%     375726        numa-vmstat.node0.nr_inactive_anon
    320174 ±  4%     +17.3%     375720        numa-vmstat.node0.nr_zone_inactive_anon
 1.993e+08           -45.3%   1.09e+08        numa-vmstat.node0.numa_hit
 1.993e+08           -45.3%   1.09e+08        numa-vmstat.node0.numa_local
     17327           -16.1%      14545        numa-vmstat.node1.nr_active_anon
    362567 ±  3%      -9.1%     329589 ±  2%  numa-vmstat.node1.nr_anon_pages
     61.00 ± 27%    +676.5%     473.67 ±  2%  numa-vmstat.node1.nr_anon_transparent_hugepages
    378451 ±  3%      -9.0%     344349 ±  2%  numa-vmstat.node1.nr_inactive_anon
     32365 ±  2%     -12.4%      28352 ±  8%  numa-vmstat.node1.nr_shmem
     17327           -16.1%      14545        numa-vmstat.node1.nr_zone_active_anon
    378457 ±  3%      -9.0%     344355 ±  2%  numa-vmstat.node1.nr_zone_inactive_anon
 1.946e+08           -43.1%  1.107e+08        numa-vmstat.node1.numa_hit
 1.946e+08           -43.1%  1.107e+08        numa-vmstat.node1.numa_local
     18998           -14.8%      16177        proc-vmstat.nr_active_anon
    684009            +2.2%     699034        proc-vmstat.nr_anon_pages
    109.33 ±  2%    +783.5%     966.00        proc-vmstat.nr_anon_transparent_hugepages
    703490            +2.2%     719212        proc-vmstat.nr_inactive_anon
     29372            +4.6%      30737 ±  2%  proc-vmstat.nr_mapped
      5596            -1.4%       5520        proc-vmstat.nr_page_table_pages
     36984            -7.7%      34140        proc-vmstat.nr_shmem
     18998           -14.8%      16177        proc-vmstat.nr_zone_active_anon
    703490            +2.2%     719213        proc-vmstat.nr_zone_inactive_anon
 3.939e+08           -44.2%  2.197e+08        proc-vmstat.numa_hit
      1403 ±  3%   +1380.6%      20772        proc-vmstat.numa_huge_pte_updates
 3.939e+08           -44.2%  2.197e+08        proc-vmstat.numa_local
     29887 ± 22%    +310.5%     122701 ± 71%  proc-vmstat.numa_pages_migrated
   1335908 ±  5%    +742.0%   11248486        proc-vmstat.numa_pte_updates
    464541            -4.1%     445478        proc-vmstat.pgactivate
 3.937e+08           -44.2%  2.196e+08        proc-vmstat.pgalloc_normal
 4.305e+08           -40.7%  2.555e+08        proc-vmstat.pgfault
 3.936e+08           -44.2%  2.196e+08        proc-vmstat.pgfree
     29887 ± 22%    +310.5%     122701 ± 71%  proc-vmstat.pgmigrate_success
      7677         +4640.0%     363924        proc-vmstat.thp_fault_alloc
      3.24 ±  3%      +0.1        3.37        perf-stat.i.branch-miss-rate%
  7.23e+08            +2.5%  7.414e+08        perf-stat.i.branch-misses
 2.237e+08           +10.7%  2.477e+08        perf-stat.i.cache-misses
     20146            +2.6%      20668        perf-stat.i.context-switches
      1698            +3.4%       1756        perf-stat.i.cpu-migrations
      1162 ±  6%     -14.6%     992.74        perf-stat.i.cycles-between-cache-misses
      0.13 ± 10%      -0.0        0.11 ±  3%  perf-stat.i.dTLB-load-miss-rate%
  37005759           -54.7%   16772768        perf-stat.i.dTLB-load-misses
      0.08 ±  2%      -0.0        0.06        perf-stat.i.dTLB-store-miss-rate%
  10003597           -44.5%    5550930        perf-stat.i.dTLB-store-misses
     25.94 ±  2%      -1.1       24.85        perf-stat.i.iTLB-load-miss-rate%
  34748228           -18.1%   28470097        perf-stat.i.iTLB-load-misses
 1.891e+08            +7.2%  2.027e+08        perf-stat.i.iTLB-loads
      3035           +11.3%       3380        perf-stat.i.instructions-per-iTLB-miss
    761.92 ±  5%     +23.6%     941.69 ±  2%  perf-stat.i.metric.K/sec
   1294822           -39.0%     789411        perf-stat.i.minor-faults
   6745840            +1.5%    6848491        perf-stat.i.node-load-misses
     16.77 ±  9%      -3.7       13.12 ±  4%  perf-stat.i.node-store-miss-rate%
  21810340           +77.8%   38781630        perf-stat.i.node-stores
   1294873           -39.0%     789463        perf-stat.i.page-faults
      3.72            +0.1        3.78        perf-stat.overall.branch-miss-rate%
     24.07            +2.6       26.67        perf-stat.overall.cache-miss-rate%
      1.33            -1.4%       1.31        perf-stat.overall.cpi
    528.70           -10.2%     474.65        perf-stat.overall.cycles-between-cache-misses
      0.15            -0.1        0.07        perf-stat.overall.dTLB-load-miss-rate%
      0.09            -0.0        0.05        perf-stat.overall.dTLB-store-miss-rate%
     15.53            -3.2       12.31        perf-stat.overall.iTLB-load-miss-rate%
      2555           +23.0%       3144        perf-stat.overall.instructions-per-iTLB-miss
      0.75            +1.4%       0.76        perf-stat.overall.ipc
      7.04            +0.1        7.18        perf-stat.overall.node-load-miss-rate%
      6.27            -2.7        3.62        perf-stat.overall.node-store-miss-rate%
 3.671e+12            -2.3%  3.588e+12        perf-stat.overall.path-length
 7.201e+08            +2.6%  7.386e+08        perf-stat.ps.branch-misses
 2.228e+08           +10.7%  2.468e+08        perf-stat.ps.cache-misses
     20064            +2.7%      20596        perf-stat.ps.context-switches
      1691            +3.4%       1749        perf-stat.ps.cpu-migrations
  36860772           -54.7%   16710547        perf-stat.ps.dTLB-load-misses
   9963273           -44.5%    5530547        perf-stat.ps.dTLB-store-misses
  34608827           -18.0%   28365034        perf-stat.ps.iTLB-load-misses
 1.883e+08            +7.3%   2.02e+08        perf-stat.ps.iTLB-loads
   1289580           -39.0%     786562        perf-stat.ps.minor-faults
   6718950            +1.5%    6822890        perf-stat.ps.node-load-misses
  21722866           +77.9%   38636877        perf-stat.ps.node-stores
   1289631           -39.0%     786614        perf-stat.ps.page-faults
 2.937e+13            -2.3%   2.87e+13        perf-stat.total.instructions
      4.26 ±  5%      -2.7        1.59        perf-profile.calltrace.cycles-pp.c_lex_with_flags
      4.08 ±  9%      -2.0        2.09 ±  4%  perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      2.84 ±  9%      -1.8        1.00 ±  6%  perf-profile.calltrace.cycles-pp.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
      5.42 ±  7%      -1.8        3.60 ±  3%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      5.40 ±  7%      -1.8        3.59 ±  3%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.95 ±  8%      -1.5        2.49 ±  4%  perf-profile.calltrace.cycles-pp.asm_exc_page_fault
      3.81 ±  8%      -1.4        2.43 ±  4%  perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
      3.78 ±  8%      -1.4        2.41 ±  5%  perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      1.66 ±  7%      -1.3        0.34 ± 70%  perf-profile.calltrace.cycles-pp._cpp_create_definition
      3.48 ±  9%      -1.3        2.19 ±  5%  perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      2.37 ±  8%      -1.2        1.21 ±  2%  perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.37 ±  8%      -1.2        1.21 ±  2%  perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.37 ±  8%      -1.2        1.21 ±  2%  perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.14 ±  8%      -1.1        1.02 ±  3%  perf-profile.calltrace.cycles-pp.__mmput.exit_mm.do_exit.do_group_exit.__x64_sys_exit_group
      2.14 ±  8%      -1.1        1.02 ±  3%  perf-profile.calltrace.cycles-pp.exit_mm.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      2.13 ±  8%      -1.1        1.01 ±  3%  perf-profile.calltrace.cycles-pp.exit_mmap.__mmput.exit_mm.do_exit.do_group_exit
      1.97 ±  7%      -1.0        0.99 ±  4%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.__x64_sys_openat.do_syscall_64
      1.98 ±  7%      -1.0        1.00 ±  4%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.__x64_sys_openat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.45 ±  6%      -0.8        0.64 ±  5%  perf-profile.calltrace.cycles-pp.htab_find_slot_with_hash
      1.03 ±  9%      -0.7        0.36 ± 70%  perf-profile.calltrace.cycles-pp.asm_exc_page_fault.elf_read
      1.24 ±  9%      -0.6        0.62 ±  8%  perf-profile.calltrace.cycles-pp.elf_read
      1.27 ±  6%      -0.4        0.86        perf-profile.calltrace.cycles-pp.malloc
      0.72 ±  7%      -0.4        0.34 ± 70%  perf-profile.calltrace.cycles-pp.filemap_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.85 ±  7%      -0.2        0.63 ±  8%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
      0.82 ±  7%      -0.2        0.61 ±  7%  perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
      0.83 ±  7%      -0.2        0.62 ±  8%  perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
      0.85 ±  7%      -0.2        0.64 ±  8%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
      0.88 ±  8%      -0.2        0.67 ±  8%  perf-profile.calltrace.cycles-pp.read
      0.62 ±  4%      +0.2        0.83 ±  8%  perf-profile.calltrace.cycles-pp.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.57 ±  3%      +0.2        0.78 ±  7%  perf-profile.calltrace.cycles-pp.search_binary_handler.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve
      0.57 ±  3%      +0.2        0.78 ±  6%  perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.exec_binprm.bprm_execve.do_execveat_common
      0.91 ±  4%      +0.2        1.13 ±  6%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve
      0.91 ±  4%      +0.2        1.13 ±  6%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      0.91 ±  4%      +0.2        1.13 ±  6%  perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      0.91 ±  4%      +0.2        1.13 ±  6%  perf-profile.calltrace.cycles-pp.execve
      0.91 ±  4%      +0.2        1.13 ±  6%  perf-profile.calltrace.cycles-pp.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      0.57 ±  3%      +0.2        0.79 ±  6%  perf-profile.calltrace.cycles-pp.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64
      0.00            +0.6        0.56 ±  8%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      0.00            +0.6        0.64 ±  9%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      0.00            +0.7        0.69 ±  5%  perf-profile.calltrace.cycles-pp.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.00            +0.7        0.69 ± 11%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      0.00            +0.7        0.73 ± 16%  perf-profile.calltrace.cycles-pp.main
      0.17 ±141%      +0.8        0.93 ±  6%  perf-profile.calltrace.cycles-pp.jhash_string
      0.00            +0.8        0.76 ±  6%  perf-profile.calltrace.cycles-pp.__clone
      0.76 ± 12%      +0.8        1.53 ± 11%  perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_put_or_lock.dput.step_into.path_lookupat
      0.77 ± 11%      +0.8        1.56 ± 11%  perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.step_into.path_lookupat.filename_lookup
      0.79 ± 11%      +0.8        1.58 ±  9%  perf-profile.calltrace.cycles-pp.__lock_parent.dentry_kill.dput.step_into.path_lookupat
      0.79 ± 12%      +0.8        1.58 ±  9%  perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_put_or_lock.dput.step_into.link_path_walk
      0.85 ±  9%      +0.8        1.65 ± 11%  perf-profile.calltrace.cycles-pp.__lock_parent.dentry_kill.dput.step_into.link_path_walk
      0.00            +0.8        0.81 ±  8%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      0.80 ± 12%      +0.8        1.61 ± 10%  perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.step_into.link_path_walk.path_lookupat
      0.84 ± 10%      +0.8        1.68 ±  9%  perf-profile.calltrace.cycles-pp.dentry_kill.dput.step_into.path_lookupat.filename_lookup
      0.90 ±  9%      +0.8        1.75 ± 11%  perf-profile.calltrace.cycles-pp.dentry_kill.dput.step_into.link_path_walk.path_lookupat
      0.80 ± 12%      +0.9        1.68 ±  8%  perf-profile.calltrace.cycles-pp.try_to_unlazy.lookup_fast.walk_component.path_lookupat.filename_lookup
      0.80 ± 12%      +0.9        1.68 ±  8%  perf-profile.calltrace.cycles-pp.__legitimize_path.try_to_unlazy.lookup_fast.walk_component.path_lookupat
      0.87 ± 10%      +0.9        1.75 ± 12%  perf-profile.calltrace.cycles-pp.__legitimize_path.try_to_unlazy.lookup_fast.walk_component.link_path_walk
      0.87 ± 10%      +0.9        1.76 ± 13%  perf-profile.calltrace.cycles-pp.try_to_unlazy.lookup_fast.walk_component.link_path_walk.path_lookupat
      0.86 ±  7%      +0.9        1.78 ± 11%  perf-profile.calltrace.cycles-pp.d_alloc.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat
      0.96 ±  7%      +1.0        1.93 ±  9%  perf-profile.calltrace.cycles-pp.d_alloc.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk
      0.96 ±  8%      +1.0        1.96 ± 11%  perf-profile.calltrace.cycles-pp.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup
      0.98 ± 11%      +1.0        1.98 ±  6%  perf-profile.calltrace.cycles-pp.lookup_fast.walk_component.path_lookupat.filename_lookup.vfs_statx
      0.99 ±  7%      +1.0        2.02 ± 11%  perf-profile.calltrace.cycles-pp.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx
      0.17 ±141%      +1.0        1.20 ±  8%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.00            +1.1        1.06 ±  7%  perf-profile.calltrace.cycles-pp.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
      1.08 ± 12%      +1.1        2.15 ± 13%  perf-profile.calltrace.cycles-pp.lookup_fast.walk_component.link_path_walk.path_lookupat.filename_lookup
      1.11 ±  9%      +1.2        2.26 ±  9%  perf-profile.calltrace.cycles-pp.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat
      1.15 ±  9%      +1.2        2.32 ±  9%  perf-profile.calltrace.cycles-pp.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup
      0.76 ± 15%      +1.2        1.97 ±  3%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      0.77 ± 15%      +1.2        2.02 ±  4%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.53 ± 12%      +1.5        3.07 ± 10%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.lockref_put_or_lock.dput.step_into
      1.60 ±  9%      +1.6        3.15 ± 10%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__lock_parent.dentry_kill.dput
      1.64 ± 10%      +1.6        3.22 ± 10%  perf-profile.calltrace.cycles-pp._raw_spin_lock.__lock_parent.dentry_kill.dput.step_into
      1.60 ± 12%      +1.6        3.20 ± 12%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.lockref_put_or_lock.dput.terminate_walk
      1.61 ± 12%      +1.6        3.22 ± 12%  perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_put_or_lock.dput.terminate_walk.path_lookupat
      1.63 ± 11%      +1.6        3.25 ± 10%  perf-profile.calltrace.cycles-pp.dput.step_into.path_lookupat.filename_lookup.vfs_statx
      1.64 ± 13%      +1.6        3.28 ± 12%  perf-profile.calltrace.cycles-pp.lockref_put_or_lock.dput.terminate_walk.path_lookupat.filename_lookup
      1.63 ± 11%      +1.6        3.28 ± 10%  perf-profile.calltrace.cycles-pp.step_into.path_lookupat.filename_lookup.vfs_statx.vfs_fstatat
      1.66 ± 13%      +1.7        3.31 ± 12%  perf-profile.calltrace.cycles-pp.dput.terminate_walk.path_lookupat.filename_lookup.vfs_statx
      1.63 ±  8%      +1.7        3.29 ± 11%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.d_alloc.d_alloc_parallel.__lookup_slow
      1.67 ± 13%      +1.7        3.33 ± 12%  perf-profile.calltrace.cycles-pp.terminate_walk.path_lookupat.filename_lookup.vfs_statx.vfs_fstatat
      1.71 ± 11%      +1.7        3.38 ± 10%  perf-profile.calltrace.cycles-pp.dput.step_into.link_path_walk.path_lookupat.filename_lookup
      1.59 ± 11%      +1.7        3.27 ± 10%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.lockref_get_not_dead.__legitimize_path.try_to_unlazy
      1.61 ± 11%      +1.7        3.31 ± 10%  perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_get_not_dead.__legitimize_path.try_to_unlazy.lookup_fast
      1.74 ± 10%      +1.7        3.46 ± 10%  perf-profile.calltrace.cycles-pp.step_into.link_path_walk.path_lookupat.filename_lookup.vfs_statx
      1.66 ± 11%      +1.7        3.40 ± 10%  perf-profile.calltrace.cycles-pp.lockref_get_not_dead.__legitimize_path.try_to_unlazy.lookup_fast.walk_component
      1.70 ±  8%      +1.8        3.45 ± 11%  perf-profile.calltrace.cycles-pp._raw_spin_lock.d_alloc.d_alloc_parallel.__lookup_slow.walk_component
      1.26 ± 14%      +1.9        3.15 ±  6%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
      2.00 ±  9%      +2.1        4.09 ±  8%  perf-profile.calltrace.cycles-pp.walk_component.path_lookupat.filename_lookup.vfs_statx.vfs_fstatat
      1.42 ± 13%      +2.1        3.55 ±  6%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
      2.29 ± 10%      +2.3        4.58 ± 11%  perf-profile.calltrace.cycles-pp.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx
      4.28 ± 10%      +4.2        8.53 ±  9%  perf-profile.calltrace.cycles-pp.link_path_walk.path_lookupat.filename_lookup.vfs_statx.vfs_fstatat
     21.69 ± 19%      +8.9       30.62        perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
     21.70 ± 19%      +8.9       30.65        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
      9.79 ± 10%      +9.8       19.64 ±  9%  perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.vfs_statx.vfs_fstatat.__do_sys_newlstat
      9.81 ± 10%      +9.9       19.69 ±  9%  perf-profile.calltrace.cycles-pp.filename_lookup.vfs_statx.vfs_fstatat.__do_sys_newlstat.do_syscall_64
     10.01 ±  9%     +10.0       20.05 ±  9%  perf-profile.calltrace.cycles-pp.vfs_statx.vfs_fstatat.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
     10.32 ±  9%     +10.3       20.65 ±  9%  perf-profile.calltrace.cycles-pp.vfs_fstatat.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64
     10.43 ±  9%     +10.4       20.87 ±  9%  perf-profile.calltrace.cycles-pp.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64.glob64
     10.45 ±  9%     +10.5       20.94 ±  9%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__lxstat64.glob64.parse_file_seq
     10.47 ±  9%     +10.5       20.98 ±  9%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__lxstat64.glob64.parse_file_seq
     10.57 ±  9%     +10.6       21.17 ±  9%  perf-profile.calltrace.cycles-pp.__lxstat64.glob64.parse_file_seq
     10.78 ±  9%     +10.8       21.61 ±  8%  perf-profile.calltrace.cycles-pp.glob64.parse_file_seq
     10.88 ±  9%     +10.9       21.82 ±  8%  perf-profile.calltrace.cycles-pp.parse_file_seq
     23.41 ± 17%     +11.5       34.93        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
     23.37 ± 17%     +11.7       35.09        perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
     23.80 ± 16%     +12.5       36.34        perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     23.90 ± 16%     +12.7       36.58        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     23.91 ± 16%     +12.7       36.60        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     23.91 ± 16%     +12.7       36.60        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     24.23 ± 16%     +12.7       36.93        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      8.59 ±  7%      -4.4        4.20 ±  4%  perf-profile.children.cycles-pp.asm_exc_page_fault
      7.80 ±  7%      -3.9        3.94 ±  4%  perf-profile.children.cycles-pp.exc_page_fault
      7.74 ±  7%      -3.8        3.91 ±  4%  perf-profile.children.cycles-pp.do_user_addr_fault
      7.20 ±  7%      -3.5        3.69 ±  4%  perf-profile.children.cycles-pp.handle_mm_fault
      5.15 ±  7%      -3.5        1.65 ±  5%  perf-profile.children.cycles-pp.do_anonymous_page
      6.81 ±  7%      -3.3        3.54 ±  3%  perf-profile.children.cycles-pp.__handle_mm_fault
      4.31 ±  5%      -2.7        1.61        perf-profile.children.cycles-pp.c_lex_with_flags
      2.69 ±  8%      -2.0        0.68 ±  9%  perf-profile.children.cycles-pp.vma_alloc_folio
      2.74 ±  8%      -2.0        0.79 ±  7%  perf-profile.children.cycles-pp.__alloc_pages
      2.55 ±  8%      -1.9        0.64 ± 10%  perf-profile.children.cycles-pp.__folio_alloc
      2.47 ±  8%      -1.8        0.66 ±  8%  perf-profile.children.cycles-pp.get_page_from_freelist
      1.70 ±  7%      -1.2        0.51 ±  2%  perf-profile.children.cycles-pp._cpp_create_definition
      2.39 ±  7%      -1.2        1.24 ±  2%  perf-profile.children.cycles-pp.do_exit
      2.39 ±  7%      -1.2        1.24 ±  2%  perf-profile.children.cycles-pp.__x64_sys_exit_group
      2.39 ±  7%      -1.2        1.24 ±  2%  perf-profile.children.cycles-pp.do_group_exit
      2.27 ±  8%      -1.1        1.15 ±  3%  perf-profile.children.cycles-pp.__mmput
      2.27 ±  8%      -1.1        1.14 ±  3%  perf-profile.children.cycles-pp.exit_mmap
      2.14 ±  8%      -1.1        1.03 ±  3%  perf-profile.children.cycles-pp.exit_mm
      1.58 ±  9%      -1.0        0.54 ±  4%  perf-profile.children.cycles-pp.zap_pte_range
      1.60 ±  9%      -1.0        0.57 ±  6%  perf-profile.children.cycles-pp.zap_pmd_range
      1.65 ±  9%      -1.0        0.63 ±  6%  perf-profile.children.cycles-pp.unmap_vmas
      1.62 ±  9%      -1.0        0.60 ±  5%  perf-profile.children.cycles-pp.unmap_page_range
      1.34 ±  4%      -1.0        0.37 ±  2%  perf-profile.children.cycles-pp.build_decl
      1.59 ±  6%      -0.9        0.66 ±  2%  perf-profile.children.cycles-pp.__mem_cgroup_charge
      1.24 ± 11%      -0.8        0.42 ±  2%  perf-profile.children.cycles-pp.tlb_batch_pages_flush
      1.45 ±  6%      -0.8        0.64 ±  4%  perf-profile.children.cycles-pp.htab_find_slot_with_hash
      1.18 ± 11%      -0.8        0.38 ±  3%  perf-profile.children.cycles-pp.release_pages
      1.04 ±  3%      -0.8        0.25 ±  6%  perf-profile.children.cycles-pp.make_node
      0.96 ± 11%      -0.7        0.25 ± 11%  perf-profile.children.cycles-pp.rmqueue
      2.43 ±  6%      -0.7        1.72 ±  5%  perf-profile.children.cycles-pp.__x64_sys_openat
      1.22 ±  5%      -0.7        0.52 ±  3%  perf-profile.children.cycles-pp.open64
      2.41 ±  6%      -0.7        1.72 ±  4%  perf-profile.children.cycles-pp.do_sys_openat2
      1.39 ±  8%      -0.7        0.70 ±  5%  perf-profile.children.cycles-pp.elf_read
      1.09 ±  5%      -0.6        0.46        perf-profile.children.cycles-pp.charge_memcg
      0.95 ±  6%      -0.6        0.34 ±  2%  perf-profile.children.cycles-pp._cpp_lex_direct
      2.12 ±  7%      -0.6        1.53 ±  4%  perf-profile.children.cycles-pp.path_openat
      2.13 ±  7%      -0.6        1.54 ±  4%  perf-profile.children.cycles-pp.do_filp_open
      1.46 ±  7%      -0.6        0.90 ±  4%  perf-profile.children.cycles-pp.clear_page_erms
      0.81 ±  6%      -0.5        0.27 ±  3%  perf-profile.children.cycles-pp.try_charge_memcg
      0.62 ± 12%      -0.5        0.12 ±  6%  perf-profile.children.cycles-pp.rmqueue_bulk
      0.64 ± 13%      -0.5        0.14        perf-profile.children.cycles-pp.free_unref_page_list
      0.74 ±  4%      -0.5        0.26 ±  9%  perf-profile.children.cycles-pp.type_hash_canon
      0.55 ± 13%      -0.4        0.13 ±  3%  perf-profile.children.cycles-pp.free_pcppages_bulk
      1.30 ±  6%      -0.4        0.89        perf-profile.children.cycles-pp.malloc
      0.56 ±  7%      -0.4        0.17 ± 12%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.57 ±  6%      -0.4        0.22 ±  8%  perf-profile.children.cycles-pp.size_binop_loc
      0.48 ± 12%      -0.3        0.15 ±  3%  perf-profile.children.cycles-pp.folio_add_lru
      0.52 ± 10%      -0.3        0.19 ±  2%  perf-profile.children.cycles-pp.folio_batch_move_lru
      0.42 ± 13%      -0.3        0.09 ±  5%  perf-profile.children.cycles-pp.__free_one_page
      0.49 ±  5%      -0.3        0.17 ±  2%  perf-profile.children.cycles-pp.c_parser_declspecs
      0.43 ±  9%      -0.3        0.12 ± 16%  perf-profile.children.cycles-pp.build_function_type
      0.43 ±  6%      -0.3        0.15 ±  8%  perf-profile.children.cycles-pp._cpp_skip_block_comment
      0.35 ±  5%      -0.3        0.07 ± 23%  perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
      0.58 ±  6%      -0.3        0.31 ±  3%  perf-profile.children.cycles-pp.error_entry
      0.40 ±  8%      -0.3        0.13 ±  6%  perf-profile.children.cycles-pp.allocate_struct_function
      0.50 ±  5%      -0.3        0.23 ±  2%  perf-profile.children.cycles-pp.sync_regs
      0.46 ±  8%      -0.3        0.20 ±  4%  perf-profile.children.cycles-pp.ggc_internal_alloc
      0.35 ±  7%      -0.3        0.09 ± 10%  perf-profile.children.cycles-pp._cpp_handle_directive
      0.89 ±  7%      -0.3        0.64 ±  7%  perf-profile.children.cycles-pp.vfs_read
      0.79 ±  7%      -0.2        0.54 ±  5%  perf-profile.children.cycles-pp.filemap_read
      0.90 ±  7%      -0.2        0.65 ±  8%  perf-profile.children.cycles-pp.ksys_read
      0.36 ±  6%      -0.2        0.12 ± 13%  perf-profile.children.cycles-pp._cpp_clean_line
      0.37 ±  8%      -0.2        0.14 ±  5%  perf-profile.children.cycles-pp.pop_scope
      0.67 ±  6%      -0.2        0.44 ±  4%  perf-profile.children.cycles-pp.tlb_finish_mmu
      0.38 ±  8%      -0.2        0.15 ±  6%  perf-profile.children.cycles-pp.linemap_location_in_system_header_p
      0.58 ±  9%      -0.2        0.36        perf-profile.children.cycles-pp.copy_page_to_iter
      0.57 ±  9%      -0.2        0.35 ±  2%  perf-profile.children.cycles-pp._copy_to_iter
      0.30 ±  6%      -0.2        0.09 ± 14%  perf-profile.children.cycles-pp.linemap_enter_macro
      0.38 ±  9%      -0.2        0.16 ±  5%  perf-profile.children.cycles-pp.variably_modified_type_p
      0.30 ±  4%      -0.2        0.09 ±  5%  perf-profile.children.cycles-pp.tree_cons
      0.68 ±  6%      -0.2        0.47 ±  2%  perf-profile.children.cycles-pp.__do_munmap
      0.89 ±  7%      -0.2        0.68 ±  7%  perf-profile.children.cycles-pp.read
      0.69 ±  5%      -0.2        0.48        perf-profile.children.cycles-pp.cfree
      0.45 ±  4%      -0.2        0.25 ±  3%  perf-profile.children.cycles-pp.__vm_munmap
      0.36 ±  6%      -0.2        0.16 ±  5%  perf-profile.children.cycles-pp.layout_type
      0.53 ±  9%      -0.2        0.33        perf-profile.children.cycles-pp.copyout
      0.39 ±  6%      -0.2        0.19 ±  8%  perf-profile.children.cycles-pp.__x64_sys_munmap
      0.47 ±  5%      -0.2        0.28 ±  5%  perf-profile.children.cycles-pp.unmap_region
      0.43 ±  6%      -0.2        0.24 ±  3%  perf-profile.children.cycles-pp.location_get_source_line
      0.31 ±  2%      -0.2        0.13 ± 16%  perf-profile.children.cycles-pp.__munmap
      0.32 ±  3%      -0.2        0.15 ±  3%  perf-profile.children.cycles-pp.getenv
      0.55 ±  8%      -0.2        0.37 ±  6%  perf-profile.children.cycles-pp.alloc_empty_file
      0.37 ±  8%      -0.2        0.20 ±  8%  perf-profile.children.cycles-pp.operand_equal_p
      0.25 ±  3%      -0.2        0.08 ± 12%  perf-profile.children.cycles-pp.lookup_name
      0.54 ±  8%      -0.2        0.37 ±  7%  perf-profile.children.cycles-pp.__alloc_file
      0.28 ±  9%      -0.2        0.12 ±  6%  perf-profile.children.cycles-pp.__perf_sw_event
      0.70 ±  5%      -0.2        0.53 ±  3%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.25 ±  8%      -0.2        0.09 ±  5%  perf-profile.children.cycles-pp.pushdecl
      0.28 ±  6%      -0.2        0.12 ± 17%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.29 ± 11%      -0.1        0.15 ±  5%  perf-profile.children.cycles-pp.decl_attributes
      0.27 ±  4%      -0.1        0.13 ±  6%  perf-profile.children.cycles-pp.fold_binary_loc
      0.20 ± 10%      -0.1        0.06        perf-profile.children.cycles-pp.build1
      0.26 ± 10%      -0.1        0.11 ±  8%  perf-profile.children.cycles-pp.build2
      0.39 ±  7%      -0.1        0.25 ±  9%  perf-profile.children.cycles-pp.wp_page_copy
      0.23 ±  9%      -0.1        0.09 ± 15%  perf-profile.children.cycles-pp.wi::force_to_size
      0.23 ± 12%      -0.1        0.10 ±  4%  perf-profile.children.cycles-pp.lru_add_fn
      0.37 ±  7%      -0.1        0.24        perf-profile.children.cycles-pp.page_remove_rmap
      0.63 ±  7%      -0.1        0.50        perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.18 ± 10%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.elf_create_section
      0.22 ±  5%      -0.1        0.09 ± 10%  perf-profile.children.cycles-pp.fold_unary_loc
      0.26 ±  8%      -0.1        0.13 ±  9%  perf-profile.children.cycles-pp.build_binary_op
      0.21 ±  6%      -0.1        0.08 ±  5%  perf-profile.children.cycles-pp.build_null_declspecs
      0.25 ±  9%      -0.1        0.13 ± 22%  perf-profile.children.cycles-pp.task_tick_fair
      0.15 ± 10%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.set_source_range
      0.15 ±  6%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.get_range_from_loc
      0.18 ±  6%      -0.1        0.07 ±  6%  perf-profile.children.cycles-pp.c_parser_consume_token
      0.18 ±  9%      -0.1        0.08 ±  6%  perf-profile.children.cycles-pp.verify_sequence_points
      0.19 ±  6%      -0.1        0.08        perf-profile.children.cycles-pp.___perf_sw_event
      0.31 ±  9%      -0.1        0.20 ±  9%  perf-profile.children.cycles-pp.df_worklist_dataflow
      0.14 ± 11%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp._cpp_find_file
      0.14            -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.add_stmt
      0.17 ±  5%      -0.1        0.07        perf-profile.children.cycles-pp.build_call_array_loc
      0.17 ±  4%      -0.1        0.07 ± 11%  perf-profile.children.cycles-pp.linemap_line_start
      0.17 ± 11%      -0.1        0.07 ±  6%  perf-profile.children.cycles-pp.default_conversion
      0.17 ±  7%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.14 ±  3%      -0.1        0.05 ± 70%  perf-profile.children.cycles-pp.htab_traverse
      0.29 ±  7%      -0.1        0.19 ±  4%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.15 ± 10%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.fold_build2_loc
      0.13 ±  3%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp._cpp_pop_context
      0.36 ± 11%      -0.1        0.27 ± 10%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.12 ±  3%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.ira_init
      0.17 ±  7%      -0.1        0.08        perf-profile.children.cycles-pp.__close
      0.31 ± 12%      -0.1        0.22 ± 10%  perf-profile.children.cycles-pp.exit_to_user_mode_loop
      0.14 ± 10%      -0.1        0.06 ± 16%  perf-profile.children.cycles-pp.convert_lvalue_to_rvalue
      0.20 ± 14%      -0.1        0.12 ± 10%  perf-profile.children.cycles-pp.open_last_lookups
      0.20 ±  9%      -0.1        0.11 ±  4%  perf-profile.children.cycles-pp.do_open
      0.29 ± 10%      -0.1        0.21 ± 14%  perf-profile.children.cycles-pp.task_work_run
      0.12 ± 10%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.build_function_call_vec
      0.16 ±  3%      -0.1        0.08 ± 22%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.14 ±  6%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.get_combined_adhoc_loc
      0.11 ± 11%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.vmacache_find
      0.13 ±  6%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.convert
      0.19 ± 10%      -0.1        0.12 ±  6%  perf-profile.children.cycles-pp.find_vma
      0.13 ± 13%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.integer_zerop
      0.17 ±  2%      -0.1        0.09 ± 10%  perf-profile.children.cycles-pp.ht_lookup_with_hash
      0.19 ± 11%      -0.1        0.12 ± 14%  perf-profile.children.cycles-pp.constrain_operands
      0.22 ± 12%      -0.1        0.16 ±  3%  perf-profile.children.cycles-pp.dup_mm
      0.20 ± 11%      -0.1        0.14 ± 13%  perf-profile.children.cycles-pp.__fput
      0.10 ± 12%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.free_swap_cache
      0.21 ± 11%      -0.1        0.15 ±  3%  perf-profile.children.cycles-pp.dup_mmap
      0.13 ±  6%      -0.1        0.07 ± 23%  perf-profile.children.cycles-pp.get_ref_base_and_extent
      0.10 ± 17%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.cgroup_rstat_updated
      0.13 ±  3%      -0.1        0.07 ± 11%  perf-profile.children.cycles-pp.rtx_cost
      0.24 ± 16%      -0.1        0.19 ±  5%  perf-profile.children.cycles-pp.init_alias_analysis
      0.19 ±  9%      -0.1        0.13 ±  7%  perf-profile.children.cycles-pp.security_file_alloc
      0.10 ± 12%      -0.1        0.04 ± 76%  perf-profile.children.cycles-pp.apparmor_file_free_security
      0.13 ±  6%      -0.1        0.08 ± 12%  perf-profile.children.cycles-pp.__fxstat64
      0.13 ± 12%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.do_dentry_open
      0.12 ± 10%      -0.1        0.06 ± 14%  perf-profile.children.cycles-pp._IO_ferror
      0.26 ± 11%      -0.1        0.21 ±  6%  perf-profile.children.cycles-pp.execute_one_pass
      0.15 ± 11%      -0.1        0.10 ± 12%  perf-profile.children.cycles-pp.pre_and_rev_post_order_compute_fn
      0.13 ±  7%      -0.1        0.08 ±  5%  perf-profile.children.cycles-pp.finish_decl
      0.10 ±  8%      -0.0        0.05        perf-profile.children.cycles-pp.free_pages_and_swap_cache
      0.13 ± 10%      -0.0        0.08 ± 11%  perf-profile.children.cycles-pp.apparmor_file_alloc_security
      0.11 ± 11%      -0.0        0.06 ± 23%  perf-profile.children.cycles-pp.security_file_free
      0.10 ±  4%      -0.0        0.05        perf-profile.children.cycles-pp.free@plt
      0.08 ± 14%      -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.walk_tree_1
      0.12 ±  4%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.df_bb_refs_record
      0.27 ±  3%      -0.0        0.23 ±  2%  perf-profile.children.cycles-pp.free_pgtables
      0.21 ±  7%      -0.0        0.17 ± 14%  perf-profile.children.cycles-pp.calculate_dominance_info
      0.09 ±  5%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.__do_sys_newfstat
      0.09 ±  5%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.gimplify_expr
      0.11 ± 12%      -0.0        0.07        perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
      0.30 ±  5%      -0.0        0.26 ±  9%  perf-profile.children.cycles-pp.__split_vma
      0.07            -0.0        0.03 ± 70%  perf-profile.children.cycles-pp.finish_task_switch
      0.10 ± 12%      -0.0        0.07 ± 18%  perf-profile.children.cycles-pp.side_effects_p
      0.07 ± 12%      -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.df_insn_rescan
      0.17 ±  7%      -0.0        0.14 ±  6%  perf-profile.children.cycles-pp.__cgroup_throttle_swaprate
      0.10 ±  8%      -0.0        0.06 ± 14%  perf-profile.children.cycles-pp.update_stmt_operands
      0.14 ±  8%      -0.0        0.11 ± 12%  perf-profile.children.cycles-pp.bitmap_set_bit
      0.09 ± 27%      -0.0        0.06 ± 16%  perf-profile.children.cycles-pp.copy_page_range
      0.09 ± 28%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.copy_p4d_range
      0.10 ± 12%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.walk_stmt_load_store_addr_ops
      0.09 ±  9%      -0.0        0.06 ± 13%  perf-profile.children.cycles-pp.update_curr
      0.06 ±  7%      -0.0        0.03 ± 70%  perf-profile.children.cycles-pp.vm_area_dup
      0.10 ±  4%      -0.0        0.07 ± 23%  perf-profile.children.cycles-pp.ssa_propagation_engine::ssa_propagate
      0.12 ±  6%      -0.0        0.09 ± 15%  perf-profile.children.cycles-pp.update_load_avg
      0.13 ±  3%      -0.0        0.10 ±  8%  perf-profile.children.cycles-pp.__list_add_valid
      0.16 ±  7%      -0.0        0.13 ±  6%  perf-profile.children.cycles-pp.blk_cgroup_congested
      0.09 ±  9%      -0.0        0.06 ± 19%  perf-profile.children.cycles-pp.cleanup_tree_cfg
      0.09 ± 13%      -0.0        0.07        perf-profile.children.cycles-pp.unlink_anon_vmas
      0.15 ±  9%      -0.0        0.13 ±  7%  perf-profile.children.cycles-pp.__cond_resched
      0.08 ±  5%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.mark_irreducible_loops
      0.10 ±  4%      -0.0        0.09 ±  5%  perf-profile.children.cycles-pp.remove_unused_locals
      0.08 ±  5%      -0.0        0.07 ±  7%  perf-profile.children.cycles-pp.xas_load
      0.08 ± 10%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.lru_add_drain_cpu
      0.08            -0.0        0.06 ± 14%  perf-profile.children.cycles-pp.free_unref_page
      0.07            -0.0        0.06 ±  8%  perf-profile.children.cycles-pp.vn_reference_lookup
      0.07 ± 17%      +0.0        0.10 ±  8%  perf-profile.children.cycles-pp.generic_fillattr
      0.15 ±  3%      +0.0        0.17 ±  2%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.11 ± 11%      +0.0        0.14 ± 11%  perf-profile.children.cycles-pp.check_heap_object
      0.04 ± 71%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.__vmalloc_node_range
      0.08 ± 16%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.generic_permission
      0.06 ± 16%      +0.0        0.09 ±  9%  perf-profile.children.cycles-pp.__check_heap_object
      0.15 ±  5%      +0.0        0.18 ± 11%  perf-profile.children.cycles-pp.__d_add
      0.10 ± 12%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.slab_pre_alloc_hook
      0.16 ±  5%      +0.0        0.20 ±  8%  perf-profile.children.cycles-pp.simple_lookup
      0.08 ± 17%      +0.0        0.12 ± 10%  perf-profile.children.cycles-pp.path_init
      0.08 ± 17%      +0.0        0.12 ±  4%  perf-profile.children.cycles-pp.__legitimize_mnt
      0.03 ± 70%      +0.0        0.07        perf-profile.children.cycles-pp.common_perm_cond
      0.05 ±  8%      +0.0        0.09 ± 27%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.15 ±  5%      +0.0        0.19 ±  5%  perf-profile.children.cycles-pp.__might_fault
      0.04 ± 71%      +0.0        0.07 ±  6%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.10 ± 12%      +0.0        0.14 ±  5%  perf-profile.children.cycles-pp.simple_getattr
      0.02 ±141%      +0.0        0.06 ± 13%  perf-profile.children.cycles-pp.vfs_getattr_nosec
      0.12 ±  6%      +0.0        0.17 ±  7%  perf-profile.children.cycles-pp.down_read
      0.06 ± 13%      +0.0        0.11 ± 11%  perf-profile.children.cycles-pp.execute_file_commands
      0.27            +0.0        0.32 ± 10%  perf-profile.children.cycles-pp._dl_addr
      0.07 ± 11%      +0.0        0.12        perf-profile.children.cycles-pp.concat
      0.07 ± 12%      +0.1        0.12 ± 13%  perf-profile.children.cycles-pp.update_rq_clock
      0.02 ±141%      +0.1        0.07 ± 18%  perf-profile.children.cycles-pp.__close_nocancel
      0.02 ±141%      +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.path_put
      0.09 ± 14%      +0.1        0.14 ±  3%  perf-profile.children.cycles-pp.security_inode_getattr
      0.08 ± 10%      +0.1        0.13 ±  7%  perf-profile.children.cycles-pp.expand_argument
      0.09 ±  9%      +0.1        0.14 ±  8%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.09 ±  5%      +0.1        0.15 ±  3%  perf-profile.children.cycles-pp.update_sg_lb_stats
      0.02 ±141%      +0.1        0.07 ± 20%  perf-profile.children.cycles-pp.check_cpu_stall
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.vm_area_alloc
      0.02 ±141%      +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.02 ±141%      +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.__libc_start_main
      0.06 ±  7%      +0.1        0.12        perf-profile.children.cycles-pp.__memcpy_chk@plt
      0.08 ± 22%      +0.1        0.13 ± 12%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.00            +0.1        0.06 ±  8%  perf-profile.children.cycles-pp.note_gp_changes
      0.02 ±141%      +0.1        0.07 ± 17%  perf-profile.children.cycles-pp.strlen@plt
      0.00            +0.1        0.06 ± 16%  perf-profile.children.cycles-pp.__update_blocked_fair
      0.06 ±  8%      +0.1        0.11 ± 22%  perf-profile.children.cycles-pp.__generic_file_write_iter
      0.12 ±  4%      +0.1        0.17 ±  9%  perf-profile.children.cycles-pp._copy_to_user
      0.08 ± 10%      +0.1        0.14 ± 12%  perf-profile.children.cycles-pp.parse_variable_definition
      0.19 ±  2%      +0.1        0.25 ±  6%  perf-profile.children.cycles-pp.__dentry_kill
      0.06 ± 23%      +0.1        0.12 ±  6%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.collapse_continuations
      0.06 ±  8%      +0.1        0.12 ± 22%  perf-profile.children.cycles-pp.generic_file_write_iter
      0.06 ± 23%      +0.1        0.12 ±  7%  perf-profile.children.cycles-pp.update_blocked_averages
      0.02 ±141%      +0.1        0.08 ± 30%  perf-profile.children.cycles-pp.timerqueue_add
      0.09 ±  9%      +0.1        0.16 ± 13%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.07 ±  7%      +0.1        0.13 ±  3%  perf-profile.children.cycles-pp.worker_thread
      0.06 ±  7%      +0.1        0.13        perf-profile.children.cycles-pp.jhash
      0.02 ±141%      +0.1        0.08 ± 11%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.00            +0.1        0.07 ±  7%  perf-profile.children.cycles-pp.cpuidle_governor_latency_req
      0.00            +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.init_ttree
      0.00            +0.1        0.07 ± 25%  perf-profile.children.cycles-pp._IO_fgets
      0.07 ± 20%      +0.1        0.14 ± 26%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.23 ±  9%      +0.1        0.30 ±  4%  perf-profile.children.cycles-pp.__check_object_size
      0.25 ± 11%      +0.1        0.32 ±  4%  perf-profile.children.cycles-pp.__d_alloc
      0.05 ±  8%      +0.1        0.12 ±  7%  perf-profile.children.cycles-pp.define_variable_in_set
      0.03 ± 70%      +0.1        0.10 ±  4%  perf-profile.children.cycles-pp.process_one_work
      0.00            +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.memcpy_toio
      0.00            +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.drm_fb_helper_damage_work
      0.00            +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.drm_fb_helper_damage_blit_real
      0.00            +0.1        0.07 ± 23%  perf-profile.children.cycles-pp.ct_kernel_enter
      0.00            +0.1        0.07 ± 20%  perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
      0.46 ±  8%      +0.1        0.53 ±  2%  perf-profile.children.cycles-pp.ret_from_fork
      0.13 ±  9%      +0.1        0.20 ±  4%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.18 ±  5%      +0.1        0.25 ±  8%  perf-profile.children.cycles-pp.inode_permission
      0.00            +0.1        0.07 ± 23%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.07 ± 12%      +0.1        0.15 ± 22%  perf-profile.children.cycles-pp.vfs_write
      0.12 ± 21%      +0.1        0.19 ±  4%  perf-profile.children.cycles-pp.__entry_text_start
      0.20 ± 10%      +0.1        0.27 ±  4%  perf-profile.children.cycles-pp.kmem_cache_alloc_lru
      0.02 ±141%      +0.1        0.09 ± 10%  perf-profile.children.cycles-pp.try_variable_definition
      0.00            +0.1        0.08 ± 12%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.07 ± 11%      +0.1        0.15 ± 22%  perf-profile.children.cycles-pp.ksys_write
      0.12 ±  4%      +0.1        0.19 ±  2%  perf-profile.children.cycles-pp.update_sd_lb_stats
      0.07 ± 12%      +0.1        0.15 ±  8%  perf-profile.children.cycles-pp.read_tsc
      0.00            +0.1        0.08 ± 11%  perf-profile.children.cycles-pp.delay_tsc
      0.00            +0.1        0.08 ± 11%  perf-profile.children.cycles-pp.llseek
      0.14 ±  3%      +0.1        0.23 ±  2%  perf-profile.children.cycles-pp.cp_new_stat
      0.12            +0.1        0.20 ±  2%  perf-profile.children.cycles-pp.find_busiest_group
      0.40 ±  7%      +0.1        0.48 ±  2%  perf-profile.children.cycles-pp.kthread
      0.02 ±141%      +0.1        0.10 ± 22%  perf-profile.children.cycles-pp.ct_idle_exit
      0.08 ±  5%      +0.1        0.17 ± 14%  perf-profile.children.cycles-pp.find_next_token
      0.02 ±141%      +0.1        0.11 ± 19%  perf-profile.children.cycles-pp.generic_perform_write
      0.00            +0.1        0.09 ±  9%  perf-profile.children.cycles-pp.hrtimer_next_event_without
      0.07 ± 12%      +0.1        0.17 ±  7%  perf-profile.children.cycles-pp.native_sched_clock
      0.00            +0.1        0.10 ± 12%  perf-profile.children.cycles-pp.__hrtimer_next_event_base
      0.15            +0.1        0.25 ±  4%  perf-profile.children.cycles-pp.load_balance
      0.06 ± 13%      +0.1        0.17 ± 19%  perf-profile.children.cycles-pp.write
      0.09 ± 14%      +0.1        0.19 ±  8%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.11 ± 11%      +0.1        0.23 ±  5%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.12 ±  4%      +0.1        0.24 ±  5%  perf-profile.children.cycles-pp.target_environment
      0.05 ± 70%      +0.1        0.17 ± 28%  perf-profile.children.cycles-pp.tick_irq_enter
      0.07 ± 18%      +0.1        0.19 ±  6%  perf-profile.children.cycles-pp.io_serial_in
      0.05 ± 71%      +0.1        0.18 ± 25%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.10 ±  4%      +0.1        0.24 ±  5%  perf-profile.children.cycles-pp.rebalance_domains
      0.19 ± 15%      +0.1        0.33 ±  5%  perf-profile.children.cycles-pp.complete_walk
      0.75 ±  6%      +0.1        0.89 ±  7%  perf-profile.children.cycles-pp.update_process_times
      0.00            +0.2        0.15 ± 11%  perf-profile.children.cycles-pp.bfd_elf_final_link
      0.35 ±  7%      +0.2        0.50 ±  3%  perf-profile.children.cycles-pp.strncpy_from_user
      0.15 ±  3%      +0.2        0.30 ±  9%  perf-profile.children.cycles-pp.recursively_expand_for_file
      0.19 ±  2%      +0.2        0.36        perf-profile.children.cycles-pp.__xstat64
      0.09 ± 13%      +0.2        0.27        perf-profile.children.cycles-pp.wait_for_lsr
      0.18 ±  2%      +0.2        0.36 ± 19%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.asm_sysvec_irq_work
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.sysvec_irq_work
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.__sysvec_irq_work
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.irq_work_run
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.irq_work_single
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp._printk
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.vprintk_emit
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.console_unlock
      0.10 ± 14%      +0.2        0.28        perf-profile.children.cycles-pp.console_emit_next_record
      0.77 ±  5%      +0.2        0.95 ±  8%  perf-profile.children.cycles-pp.tick_sched_handle
      0.20 ±  4%      +0.2        0.39 ±  6%  perf-profile.children.cycles-pp.allocated_variable_expand_for_file
      0.10 ± 17%      +0.2        0.28        perf-profile.children.cycles-pp.serial8250_console_write
      0.10 ± 12%      +0.2        0.30        perf-profile.children.cycles-pp.irq_work_run_list
      0.83 ±  5%      +0.2        1.02 ±  5%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.41 ±  6%      +0.2        0.61 ±  5%  perf-profile.children.cycles-pp.__do_sys_newstat
      0.52 ±  7%      +0.2        0.74 ±  3%  perf-profile.children.cycles-pp.getname_flags
      0.88 ±  6%      +0.2        1.11 ±  6%  perf-profile.children.cycles-pp.tick_sched_timer
      0.34 ± 24%      +0.2        0.59 ± 19%  perf-profile.children.cycles-pp.ktime_get
      0.27 ±  6%      +0.2        0.52 ±  5%  perf-profile.children.cycles-pp.handle_function
      0.32 ± 22%      +0.3        0.57 ± 15%  perf-profile.children.cycles-pp.clockevents_program_event
      0.61 ±  4%      +0.3        0.87 ±  3%  perf-profile.children.cycles-pp.__d_lookup_rcu
      0.21 ±  7%      +0.3        0.47 ± 16%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.61 ±  6%      +0.3        0.89 ±  5%  perf-profile.children.cycles-pp.__irq_exit_rcu
      0.32 ±  3%      +0.3        0.61 ±  8%  perf-profile.children.cycles-pp.hash_find_slot
      0.34 ±  4%      +0.3        0.66 ±  5%  perf-profile.children.cycles-pp.variable_expand_string
      0.38 ±  6%      +0.4        0.76 ±  6%  perf-profile.children.cycles-pp.__clone
      1.17 ±  6%      +0.4        1.57 ±  7%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.09 ± 13%      +0.4        0.50 ± 10%  perf-profile.children.cycles-pp.bfd_hash_lookup
      1.12 ±  3%      +0.4        1.54 ±  4%  perf-profile.children.cycles-pp.execve
      0.52 ±  6%      +0.5        1.00 ±  6%  perf-profile.children.cycles-pp.jhash_string
      0.03 ± 70%      +0.6        0.59 ±  5%  perf-profile.children.cycles-pp.clear_huge_page
      0.03 ± 70%      +0.6        0.60 ±  4%  perf-profile.children.cycles-pp.__do_huge_pmd_anonymous_page
      0.37 ± 17%      +0.7        1.08 ±  8%  perf-profile.children.cycles-pp.menu_select
      0.09 ± 10%      +0.7        0.82 ± 15%  perf-profile.children.cycles-pp.main
      1.70 ±  9%      +0.8        2.47 ±  3%  perf-profile.children.cycles-pp.hrtimer_interrupt
      1.75 ±  9%      +0.8        2.53 ±  4%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      2.59 ±  8%      +1.3        3.89 ±  5%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      2.83 ±  8%      +1.6        4.38 ±  5%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      1.78 ± 12%      +1.7        3.44 ± 11%  perf-profile.children.cycles-pp.terminate_walk
      1.74 ± 10%      +1.7        3.43 ± 10%  perf-profile.children.cycles-pp.__lock_parent
      2.00 ±  9%      +1.8        3.79 ±  9%  perf-profile.children.cycles-pp.dentry_kill
      1.87 ±  9%      +1.8        3.70 ±  9%  perf-profile.children.cycles-pp.lockref_get_not_dead
      2.17 ±  5%      +1.8        4.01 ±  9%  perf-profile.children.cycles-pp.d_alloc
      1.95 ±  9%      +1.9        3.83 ±  9%  perf-profile.children.cycles-pp.__legitimize_path
      1.98 ±  8%      +1.9        3.86 ±  9%  perf-profile.children.cycles-pp.try_to_unlazy
      2.43 ±  8%      +2.0        4.46 ±  8%  perf-profile.children.cycles-pp.lookup_fast
      2.54 ±  6%      +2.1        4.62 ±  8%  perf-profile.children.cycles-pp.d_alloc_parallel
      2.67 ±  6%      +2.2        4.82 ±  8%  perf-profile.children.cycles-pp.__lookup_slow
      3.43 ± 12%      +3.3        6.74 ± 10%  perf-profile.children.cycles-pp.lockref_put_or_lock
      3.68 ±  9%      +3.3        7.03 ±  9%  perf-profile.children.cycles-pp.step_into
      5.56 ±  7%      +4.1        9.68 ±  8%  perf-profile.children.cycles-pp.link_path_walk
      5.21 ±  7%      +4.3        9.50 ±  8%  perf-profile.children.cycles-pp.walk_component
      5.57 ± 11%      +5.1       10.72 ± 10%  perf-profile.children.cycles-pp.dput
      8.74 ±  9%      +7.8       16.50 ± 10%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      9.17 ±  9%      +8.1       17.25 ± 10%  perf-profile.children.cycles-pp._raw_spin_lock
     20.94 ±  5%      +8.4       29.33 ±  5%  perf-profile.children.cycles-pp.do_syscall_64
     21.00 ±  5%      +8.4       29.41 ±  5%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     21.99 ± 19%      +8.9       30.90        perf-profile.children.cycles-pp.intel_idle
     22.00 ± 19%      +8.9       30.92        perf-profile.children.cycles-pp.mwait_idle_with_hints
     10.19 ±  9%     +10.0       20.17 ±  9%  perf-profile.children.cycles-pp.path_lookupat
     10.21 ±  9%     +10.0       20.22 ±  9%  perf-profile.children.cycles-pp.filename_lookup
     10.39 ±  9%     +10.2       20.59 ±  9%  perf-profile.children.cycles-pp.vfs_statx
     10.46 ±  9%     +10.5       20.92 ±  9%  perf-profile.children.cycles-pp.__do_sys_newlstat
     10.76 ±  9%     +10.5       21.30 ±  9%  perf-profile.children.cycles-pp.vfs_fstatat
     10.65 ±  9%     +10.7       21.31 ±  9%  perf-profile.children.cycles-pp.__lxstat64
     10.78 ±  9%     +10.8       21.62 ±  8%  perf-profile.children.cycles-pp.glob64
     10.90 ±  9%     +11.0       21.85 ±  8%  perf-profile.children.cycles-pp.parse_file_seq
     23.68 ± 17%     +11.7       35.41        perf-profile.children.cycles-pp.cpuidle_enter_state
     23.69 ± 17%     +11.7       35.42        perf-profile.children.cycles-pp.cpuidle_enter
     24.12 ± 16%     +12.6       36.69        perf-profile.children.cycles-pp.cpuidle_idle_call
     23.91 ± 16%     +12.7       36.60        perf-profile.children.cycles-pp.start_secondary
     24.23 ± 16%     +12.7       36.93        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     24.23 ± 16%     +12.7       36.93        perf-profile.children.cycles-pp.cpu_startup_entry
     24.23 ± 16%     +12.7       36.93        perf-profile.children.cycles-pp.do_idle
      4.24 ±  5%      -2.6        1.59        perf-profile.self.cycles-pp.c_lex_with_flags
      1.39 ±  7%      -0.9        0.47 ±  3%  perf-profile.self.cycles-pp._cpp_create_definition
      1.43 ±  6%      -0.8        0.63 ±  4%  perf-profile.self.cycles-pp.htab_find_slot_with_hash
      0.92 ±  6%      -0.6        0.34 ±  2%  perf-profile.self.cycles-pp._cpp_lex_direct
      1.42 ±  6%      -0.5        0.89 ±  4%  perf-profile.self.cycles-pp.clear_page_erms
      0.72 ±  6%      -0.5        0.23 ±  5%  perf-profile.self.cycles-pp.try_charge_memcg
      0.72 ±  4%      -0.5        0.26 ±  8%  perf-profile.self.cycles-pp.type_hash_canon
      0.67 ±  4%      -0.4        0.29 ±  5%  perf-profile.self.cycles-pp.build_decl
      0.56 ±  7%      -0.4        0.17 ± 12%  perf-profile.self.cycles-pp.__list_del_entry_valid
      1.23 ±  6%      -0.4        0.85        perf-profile.self.cycles-pp.malloc
      0.52 ±  3%      -0.3        0.19 ± 10%  perf-profile.self.cycles-pp.make_node
      0.53 ±  6%      -0.3        0.21 ±  9%  perf-profile.self.cycles-pp.size_binop_loc
      0.47 ±  5%      -0.3        0.16 ±  2%  perf-profile.self.cycles-pp.c_parser_declspecs
      0.52 ±  7%      -0.3        0.23 ±  7%  perf-profile.self.cycles-pp.zap_pte_range
      0.42 ±  5%      -0.3        0.14 ±  6%  perf-profile.self.cycles-pp._cpp_skip_block_comment
      0.35 ± 14%      -0.3        0.08 ±  6%  perf-profile.self.cycles-pp.__free_one_page
      0.49 ±  6%      -0.3        0.23 ±  4%  perf-profile.self.cycles-pp.sync_regs
      0.33 ±  6%      -0.3        0.07 ± 23%  perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
      0.45 ±  8%      -0.3        0.20 ±  4%  perf-profile.self.cycles-pp.ggc_internal_alloc
      0.34 ±  7%      -0.2        0.09 ± 10%  perf-profile.self.cycles-pp._cpp_handle_directive
      0.36 ±  5%      -0.2        0.12 ± 14%  perf-profile.self.cycles-pp._cpp_clean_line
      0.37 ±  8%      -0.2        0.14 ±  5%  perf-profile.self.cycles-pp.pop_scope
      0.37 ±  8%      -0.2        0.15 ±  6%  perf-profile.self.cycles-pp.linemap_location_in_system_header_p
      0.37 ±  9%      -0.2        0.15 ±  8%  perf-profile.self.cycles-pp.variably_modified_type_p
      0.35 ±  6%      -0.2        0.15 ±  8%  perf-profile.self.cycles-pp.layout_type
      0.29 ± 10%      -0.2        0.11 ± 14%  perf-profile.self.cycles-pp.build_function_type
      0.36 ±  6%      -0.2        0.18 ± 12%  perf-profile.self.cycles-pp.elf_read
      0.40 ±  6%      -0.2        0.23        perf-profile.self.cycles-pp.location_get_source_line
      0.32 ±  2%      -0.2        0.14 ±  3%  perf-profile.self.cycles-pp.getenv
      0.36 ±  9%      -0.2        0.19 ± 11%  perf-profile.self.cycles-pp.operand_equal_p
      0.70 ±  5%      -0.2        0.53 ±  3%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.60 ±  6%      -0.2        0.43 ±  3%  perf-profile.self.cycles-pp.cfree
      0.24 ±  3%      -0.2        0.08 ± 12%  perf-profile.self.cycles-pp.lookup_name
      0.29 ± 10%      -0.1        0.15 ±  3%  perf-profile.self.cycles-pp.decl_attributes
      0.23 ±  8%      -0.1        0.10 ±  9%  perf-profile.self.cycles-pp.__handle_mm_fault
      0.26 ±  6%      -0.1        0.13 ±  9%  perf-profile.self.cycles-pp.fold_binary_loc
      0.22 ±  9%      -0.1        0.09 ± 14%  perf-profile.self.cycles-pp.wi::force_to_size
      0.22 ±  5%      -0.1        0.09 ±  9%  perf-profile.self.cycles-pp.fold_unary_loc
      0.25 ±  9%      -0.1        0.13 ± 10%  perf-profile.self.cycles-pp.build_binary_op
      0.20 ± 10%      -0.1        0.08 ± 16%  perf-profile.self.cycles-pp.linemap_enter_macro
      0.20 ±  7%      -0.1        0.08        perf-profile.self.cycles-pp.build_null_declspecs
      0.20 ±  6%      -0.1        0.08 ± 12%  perf-profile.self.cycles-pp.pushdecl
      0.31 ±  9%      -0.1        0.20 ±  7%  perf-profile.self.cycles-pp.df_worklist_dataflow
      0.14 ±  8%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.set_source_range
      0.18 ±  9%      -0.1        0.07 ± 11%  perf-profile.self.cycles-pp.c_parser_consume_token
      0.15 ±  5%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.get_range_from_loc
      0.20 ±  6%      -0.1        0.10 ± 14%  perf-profile.self.cycles-pp.allocate_struct_function
      0.18 ±  9%      -0.1        0.08 ±  6%  perf-profile.self.cycles-pp.verify_sequence_points
      0.13 ±  9%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp._cpp_find_file
      0.14 ±  8%      -0.1        0.05 ± 72%  perf-profile.self.cycles-pp.__alloc_pages
      0.14            -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.htab_traverse
      0.19 ±  8%      -0.1        0.10 ±  4%  perf-profile.self.cycles-pp.build2
      0.16 ±  2%      -0.1        0.07 ± 11%  perf-profile.self.cycles-pp.linemap_line_start
      0.17 ± 10%      -0.1        0.07 ±  6%  perf-profile.self.cycles-pp.default_conversion
      0.15 ±  6%      -0.1        0.06 ±  7%  perf-profile.self.cycles-pp.___perf_sw_event
      0.22 ± 13%      -0.1        0.13 ± 12%  perf-profile.self.cycles-pp.release_pages
      0.12 ±  3%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp._cpp_pop_context
      0.12 ±  3%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.convert
      0.14 ± 10%      -0.1        0.06 ± 16%  perf-profile.self.cycles-pp.convert_lvalue_to_rvalue
      0.14 ±  3%      -0.1        0.06 ± 13%  perf-profile.self.cycles-pp.tree_cons
      0.13 ±  6%      -0.1        0.05 ± 70%  perf-profile.self.cycles-pp.handle_mm_fault
      0.12 ± 10%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.build_function_call_vec
      0.14 ± 11%      -0.1        0.06 ±  7%  perf-profile.self.cycles-pp.build_call_array_loc
      0.11 ± 18%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.integer_zerop
      0.52 ±  5%      -0.1        0.44        perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.13 ± 13%      -0.1        0.05        perf-profile.self.cycles-pp.build1
      0.11 ± 15%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp.__perf_sw_event
      0.12 ± 15%      -0.1        0.05 ±  8%  perf-profile.self.cycles-pp.page_remove_rmap
      0.11 ±  7%      -0.1        0.04 ± 73%  perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      0.12 ± 11%      -0.1        0.05        perf-profile.self.cycles-pp.fold_build2_loc
      0.15 ±  6%      -0.1        0.08 ± 10%  perf-profile.self.cycles-pp.ht_lookup_with_hash
      0.18 ± 11%      -0.1        0.12 ± 14%  perf-profile.self.cycles-pp.constrain_operands
      0.10 ± 12%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.vmacache_find
      0.10 ± 16%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.lru_add_fn
      0.11 ±  4%      -0.1        0.05 ±  8%  perf-profile.self.cycles-pp.do_user_addr_fault
      0.24 ± 14%      -0.1        0.18 ±  4%  perf-profile.self.cycles-pp.init_alias_analysis
      0.12 ± 10%      -0.1        0.07 ± 18%  perf-profile.self.cycles-pp.get_ref_base_and_extent
      0.13 ±  3%      -0.1        0.07 ± 11%  perf-profile.self.cycles-pp.rtx_cost
      0.09 ± 10%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp.asm_exc_page_fault
      0.09 ± 19%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp.cgroup_rstat_updated
      0.12 ± 10%      -0.1        0.07 ± 23%  perf-profile.self.cycles-pp.apparmor_file_alloc_security
      0.09 ± 13%      -0.1        0.04 ± 76%  perf-profile.self.cycles-pp.apparmor_file_free_security
      0.09 ±  5%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp._IO_ferror
      0.26 ±  9%      -0.0        0.21 ±  6%  perf-profile.self.cycles-pp.execute_one_pass
      0.10 ±  8%      -0.0        0.05        perf-profile.self.cycles-pp.get_combined_adhoc_loc
      0.13 ± 12%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.do_anonymous_page
      0.08 ± 14%      -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.walk_tree_1
      0.15 ±  6%      -0.0        0.10 ± 12%  perf-profile.self.cycles-pp.charge_memcg
      0.21 ±  7%      -0.0        0.17 ± 12%  perf-profile.self.cycles-pp.calculate_dominance_info
      0.15 ±  8%      -0.0        0.10 ± 12%  perf-profile.self.cycles-pp.pre_and_rev_post_order_compute_fn
      0.12 ±  7%      -0.0        0.08 ± 10%  perf-profile.self.cycles-pp.finish_decl
      0.09 ±  5%      -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.update_stmt_operands
      0.11 ±  8%      -0.0        0.07 ± 11%  perf-profile.self.cycles-pp.df_bb_refs_record
      0.14 ± 12%      -0.0        0.10 ± 17%  perf-profile.self.cycles-pp.copy_page
      0.09 ±  5%      -0.0        0.05 ±  8%  perf-profile.self.cycles-pp.gimplify_expr
      0.07 ± 12%      -0.0        0.04 ± 71%  perf-profile.self.cycles-pp.df_insn_rescan
      0.14 ± 11%      -0.0        0.11 ± 11%  perf-profile.self.cycles-pp.bitmap_set_bit
      0.10 ±  8%      -0.0        0.07 ± 18%  perf-profile.self.cycles-pp.side_effects_p
      0.09 ± 10%      -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.mem_cgroup_charge_statistics
      0.10 ±  4%      -0.0        0.07 ± 23%  perf-profile.self.cycles-pp.ssa_propagation_engine::ssa_propagate
      0.19 ±  7%      -0.0        0.16 ±  7%  perf-profile.self.cycles-pp.__mem_cgroup_charge
      0.09 ± 10%      -0.0        0.07 ±  7%  perf-profile.self.cycles-pp.walk_stmt_load_store_addr_ops
      0.09 ±  9%      -0.0        0.06 ± 19%  perf-profile.self.cycles-pp.cleanup_tree_cfg
      0.12 ±  6%      -0.0        0.10 ±  8%  perf-profile.self.cycles-pp.__list_add_valid
      0.08 ±  6%      -0.0        0.06 ± 16%  perf-profile.self.cycles-pp.find_vma
      0.08 ±  5%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.mark_irreducible_loops
      0.10 ±  4%      -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.remove_unused_locals
      0.07 ± 11%      +0.0        0.09 ±  5%  perf-profile.self.cycles-pp.page_add_file_rmap
      0.06 ±  7%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.07 ± 14%      +0.0        0.09 ± 14%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.06 ±  8%      +0.0        0.08 ± 12%  perf-profile.self.cycles-pp.d_alloc
      0.07 ± 17%      +0.0        0.10 ±  8%  perf-profile.self.cycles-pp.generic_fillattr
      0.06 ± 19%      +0.0        0.09 ±  9%  perf-profile.self.cycles-pp.__entry_text_start
      0.14 ±  3%      +0.0        0.17 ±  2%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.07 ± 12%      +0.0        0.10 ±  9%  perf-profile.self.cycles-pp.path_init
      0.07 ± 12%      +0.0        0.10 ±  9%  perf-profile.self.cycles-pp.generic_permission
      0.03 ± 70%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.common_perm_cond
      0.06 ± 16%      +0.0        0.09 ±  9%  perf-profile.self.cycles-pp.__check_heap_object
      0.10 ±  8%      +0.0        0.14 ± 15%  perf-profile.self.cycles-pp.inode_permission
      0.08 ± 16%      +0.0        0.12 ±  4%  perf-profile.self.cycles-pp.__legitimize_mnt
      0.10 ±  9%      +0.0        0.14 ± 11%  perf-profile.self.cycles-pp.down_read
      0.12 ± 10%      +0.0        0.17 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.08 ±  6%      +0.0        0.12 ±  6%  perf-profile.self.cycles-pp.update_sg_lb_stats
      0.03 ± 70%      +0.0        0.08 ± 16%  perf-profile.self.cycles-pp.__hrtimer_run_queues
      0.02 ±141%      +0.0        0.06 ± 13%  perf-profile.self.cycles-pp.lookup_fast
      0.07 ± 11%      +0.0        0.12 ±  4%  perf-profile.self.cycles-pp.concat
      0.25            +0.0        0.30 ±  9%  perf-profile.self.cycles-pp._dl_addr
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.__check_object_size
      0.09 ±  9%      +0.1        0.14 ±  8%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.02 ±141%      +0.1        0.07 ± 20%  perf-profile.self.cycles-pp.check_cpu_stall
      0.00            +0.1        0.05 ±  8%  perf-profile.self.cycles-pp.strlen@plt
      0.02 ±141%      +0.1        0.07 ± 11%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.02 ±141%      +0.1        0.07 ± 11%  perf-profile.self.cycles-pp.hrtimer_interrupt
      0.02 ±141%      +0.1        0.07 ± 11%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.00            +0.1        0.06 ±  8%  perf-profile.self.cycles-pp.collapse_continuations
      0.13 ±  6%      +0.1        0.19 ±  2%  perf-profile.self.cycles-pp.lockref_put_or_lock
      0.03 ± 70%      +0.1        0.09 ±  9%  perf-profile.self.cycles-pp.variable_expand_string
      0.00            +0.1        0.06 ± 13%  perf-profile.self.cycles-pp.walk_component
      0.08 ± 16%      +0.1        0.14 ± 12%  perf-profile.self.cycles-pp.parse_variable_definition
      0.05 ±  8%      +0.1        0.12 ±  4%  perf-profile.self.cycles-pp.define_variable_in_set
      0.02 ±141%      +0.1        0.08 ± 20%  perf-profile.self.cycles-pp.dput
      0.00            +0.1        0.06 ± 19%  perf-profile.self.cycles-pp._IO_fgets
      0.07 ± 17%      +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.step_into
      0.13 ±  9%      +0.1        0.19 ± 12%  perf-profile.self.cycles-pp.strncpy_from_user
      0.06 ±  7%      +0.1        0.13        perf-profile.self.cycles-pp.jhash
      0.00            +0.1        0.07 ±  7%  perf-profile.self.cycles-pp.security_inode_getattr
      0.16 ± 10%      +0.1        0.23 ± 10%  perf-profile.self.cycles-pp.d_alloc_parallel
      0.00            +0.1        0.07 ± 11%  perf-profile.self.cycles-pp.memcpy_toio
      0.00            +0.1        0.07 ± 12%  perf-profile.self.cycles-pp.__memcpy_chk@plt
      0.07 ± 11%      +0.1        0.15 ±  5%  perf-profile.self.cycles-pp.read_tsc
      0.02 ±141%      +0.1        0.10 ± 12%  perf-profile.self.cycles-pp.__lxstat64
      0.00            +0.1        0.08 ± 11%  perf-profile.self.cycles-pp.delay_tsc
      0.00            +0.1        0.08 ± 11%  perf-profile.self.cycles-pp.__hrtimer_next_event_base
      0.08 ±  5%      +0.1        0.17 ± 14%  perf-profile.self.cycles-pp.find_next_token
      0.07 ± 12%      +0.1        0.16 ± 10%  perf-profile.self.cycles-pp.native_sched_clock
      0.10 ±  4%      +0.1        0.20 ±  6%  perf-profile.self.cycles-pp.handle_function
      0.11 ±  8%      +0.1        0.21 ±  2%  perf-profile.self.cycles-pp.parse_file_seq
      0.02 ±141%      +0.1        0.12 ± 24%  perf-profile.self.cycles-pp.tick_nohz_next_event
      0.00            +0.1        0.11        perf-profile.self.cycles-pp.cpuidle_idle_call
      0.12 ±  4%      +0.1        0.23 ±  5%  perf-profile.self.cycles-pp.target_environment
      0.11 ± 11%      +0.1        0.23 ±  5%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.25 ±  5%      +0.1        0.37 ±  7%  perf-profile.self.cycles-pp.link_path_walk
      0.07 ± 18%      +0.1        0.19 ±  6%  perf-profile.self.cycles-pp.io_serial_in
      0.22 ± 13%      +0.1        0.36        perf-profile.self.cycles-pp.lockref_get_not_dead
      0.00            +0.1        0.14 ± 11%  perf-profile.self.cycles-pp.bfd_elf_final_link
      0.16 ±  2%      +0.2        0.33 ±  5%  perf-profile.self.cycles-pp.glob64
      0.29 ± 26%      +0.2        0.47 ± 22%  perf-profile.self.cycles-pp.ktime_get
      0.58 ±  7%      +0.2        0.77 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.60 ±  4%      +0.3        0.86 ±  3%  perf-profile.self.cycles-pp.__d_lookup_rcu
      0.31 ±  4%      +0.3        0.60 ±  8%  perf-profile.self.cycles-pp.hash_find_slot
      0.20 ± 12%      +0.3        0.55 ± 11%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.13 ± 34%      +0.4        0.51 ±  5%  perf-profile.self.cycles-pp.menu_select
      0.09 ±  9%      +0.4        0.50 ± 10%  perf-profile.self.cycles-pp.bfd_hash_lookup
      0.51 ±  5%      +0.5        0.99 ±  7%  perf-profile.self.cycles-pp.jhash_string
      0.06 ± 13%      +0.7        0.76 ± 16%  perf-profile.self.cycles-pp.main
      8.67 ± 10%      +7.7       16.35 ± 10%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
     21.99 ± 19%      +8.9       30.91        perf-profile.self.cycles-pp.mwait_idle_with_hints



***************************************************************************************************
lkp-cfl-d1: 12 threads 1 sockets Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz with 16G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/option_a/option_b/rootfs/tbox_group/test/testcase/ucode:
  gcc-11/performance/x86_64-rhel-8.3/Server Room/CPU-only/debian-x86_64-phoronix/lkp-cfl-d1/darktable-1.0.5/phoronix-test-suite/0xf0

commit: 
  848d022dec ("mm: fix use-after free of page_ext after race with memory-offline")
  96db82a66d ("mm: align larger anonymous mappings on THP boundaries")

848d022decb8dea1 96db82a66d1db0e2966c02dc492 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
           :6           17%           1:6     kmsg.microcode:Attempting_late_microcode_loading-it_is_dangerous_and_taints_the_kernel
           :6           17%           1:6     kmsg.microcode:You_should_switch_to_early_loading,if_possible
         %stddev     %change         %stddev
             \          |                \  
      5.68            +3.3%       5.86        phoronix-test-suite.darktable.ServerRoom.CPU-only.seconds
    227639           -12.0%     200323        phoronix-test-suite.time.minor_page_faults
    707.50 ± 26%     -30.6%     490.67 ± 21%  sched_debug.cfs_rq:/.util_est_enqueued.max
    737696 ±  4%     +17.2%     864470        meminfo.AnonHugePages
   1037552 ±  2%     +12.3%    1165051        meminfo.AnonPages
      7703 ±  2%      -8.8%       7023 ±  3%  perf-stat.i.minor-faults
   6669124            +7.4%    7162259        perf-stat.i.node-loads
      7711 ±  2%      -8.8%       7031 ±  3%  perf-stat.i.page-faults
      7531 ±  2%      -8.4%       6898 ±  3%  perf-stat.ps.minor-faults
   6519195            +7.9%    7033465        perf-stat.ps.node-loads
      7539 ±  2%      -8.4%       6906 ±  3%  perf-stat.ps.page-faults
    262421 ±  2%      +9.7%     287940        proc-vmstat.nr_anon_pages
    448389            +6.6%     478163        proc-vmstat.nr_inactive_anon
      1707            +3.7%       1769        proc-vmstat.nr_page_table_pages
    448389            +6.6%     478163        proc-vmstat.nr_zone_inactive_anon
    400584            -6.6%     373955        proc-vmstat.pgfault
    354358            -7.5%     327740        proc-vmstat.pgfree
      7580            +2.3%       7757        proc-vmstat.thp_fault_alloc





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


-- 
0-DAY CI Kernel Test Service
https://01.org/lkp



View attachment "config-6.0.0-rc1-00053-g96db82a66d1d" of type "text/plain" (164797 bytes)

View attachment "job-script" of type "text/plain" (8006 bytes)

View attachment "job.yaml" of type "text/plain" (5469 bytes)

View attachment "reproduce" of type "text/plain" (347 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ