lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date:   Mon, 17 Jan 2022 16:24:26 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Filipe Manana <fdmanana@...e.com>
Cc:     David Sterba <dsterba@...e.com>,
        LKML <linux-kernel@...r.kernel.org>,
        Linux Memory Management List <linux-mm@...ck.org>,
        lkp@...ts.01.org, lkp@...el.com, ying.huang@...el.com,
        feng.tang@...el.com, zhengjun.xing@...ux.intel.com,
        fengwei.yin@...el.com, linux-btrfs@...r.kernel.org
Subject: [btrfs]  1a61b300c0:  fsmark.files_per_sec -69.3% regression



Greeting,

FYI, we noticed a -69.3% regression of fsmark.files_per_sec due to commit:


commit: 1a61b300c09b1d034534372349e8f9d3aba6c392 ("btrfs: fix log tree cleanup after a transaction abort")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master

in testcase: fsmark
on test machine: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:

	iterations: 8
	disk: 1SSD
	nr_threads: 4
	fs: btrfs
	filesize: 8K
	test_size: 24G
	sync_method: fsyncBeforeClose
	nr_directories: 16d
	nr_files_per_directory: 256fpd
	cpufreq_governor: performance
	ucode: 0x5003006

test-description: The fsmark is a file system benchmark to test synchronous write workloads, for example, mail servers workload.
test-url: https://sourceforge.net/projects/fsmark/

In addition to that, the commit also has significant impact on the following tests:

+------------------+-------------------------------------------------------------------------------------+
| testcase: change | fsmark: fsmark.files_per_sec -79.6% regression                                      |
| test machine     | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters  | cpufreq_governor=performance                                                        |
|                  | disk=1SSD                                                                           |
|                  | filesize=9B                                                                         |
|                  | fs=btrfs                                                                            |
|                  | iterations=8                                                                        |
|                  | nr_directories=16d                                                                  |
|                  | nr_files_per_directory=256fpd                                                       |
|                  | nr_threads=4                                                                        |
|                  | sync_method=fsyncBeforeClose                                                        |
|                  | test_size=16G                                                                       |
|                  | ucode=0x5003006                                                                     |
+------------------+-------------------------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_directories/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
  gcc-9/performance/1SSD/8K/btrfs/8/x86_64-rhel-8.3/16d/256fpd/4/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap4/24G/fsmark/0x5003006

commit: 
  dd503c2d5d ("btrfs: remove write and wait of struct walk_control")
  1a61b300c0 ("btrfs: fix log tree cleanup after a transaction abort")

dd503c2d5db4f864 1a61b300c09b1d034534372349e 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   1693267           +27.7%    2162171        fsmark.app_overhead
     10798           -69.3%       3316        fsmark.files_per_sec
    309.11          +214.5%     972.20        fsmark.time.elapsed_time
    309.11          +214.5%     972.20        fsmark.time.elapsed_time.max
 3.284e+08            -5.2%  3.112e+08        fsmark.time.file_system_outputs
      1441 ±  4%    +149.9%       3601 ±  5%  fsmark.time.involuntary_context_switches
    186.17           +35.1%     251.50        fsmark.time.percent_of_cpu_this_job_got
    565.65          +330.6%       2435        fsmark.time.system_time
  16705992           +10.4%   18445401        fsmark.time.voluntary_context_switches
      2.68 ± 10%     +21.2%       3.25 ± 12%  iostat.cpu.system
  59912963          +189.9%  1.737e+08 ± 18%  turbostat.IRQ
 5.763e+10          +211.5%  1.795e+11        cpuidle..time
 1.422e+08          +161.1%  3.715e+08 ± 13%  cpuidle..usage
    360.08          +183.3%       1020        uptime.boot
     66292          +184.3%     188463        uptime.idle
      0.15 ±  2%      -0.1        0.03 ±  4%  mpstat.cpu.all.iowait%
      1.01 ±  2%      +0.3        1.34        mpstat.cpu.all.sys%
      0.04 ±  6%      -0.0        0.02 ±  2%  mpstat.cpu.all.usr%
      7453 ±  8%     -17.1%       6179 ±  4%  numa-vmstat.node1.nr_kernel_stack
      1708 ± 31%     -62.7%     636.83 ±109%  numa-vmstat.node3.nr_mapped
      7873 ± 16%     -47.9%       4100 ± 27%  numa-vmstat.node3.nr_shmem
    550115           -69.6%     167016        vmstat.io.bo
    132793           -64.2%      47581        vmstat.system.cs
    415010           -10.3%     372330 ± 13%  vmstat.system.in
      7453 ±  8%     -17.1%       6178 ±  4%  numa-meminfo.node1.KernelStack
      2842 ± 97%     -77.4%     642.00 ±202%  numa-meminfo.node2.Mapped
      6989 ± 40%     -64.6%       2475 ±113%  numa-meminfo.node3.Mapped
     30481 ± 17%     -46.7%      16242 ± 28%  numa-meminfo.node3.Shmem
     35959 ±110%   +1474.0%     565979 ± 31%  numa-numastat.node1.local_node
    111652 ± 27%    +484.9%     653045 ± 27%  numa-numastat.node1.numa_hit
    223279 ± 20%     +82.7%     407926 ± 20%  numa-numastat.node3.local_node
    310312 ± 15%     +59.5%     494965 ± 16%  numa-numastat.node3.numa_hit
   6974599 ±  2%     -27.2%    5074968 ±  4%  meminfo.Active
     12971 ±  2%     +64.3%      21312 ±  5%  meminfo.Active(anon)
   6961627 ±  2%     -27.4%    5053654 ±  4%  meminfo.Active(file)
     31060           -10.4%      27841        meminfo.KernelStack
     41619           -11.3%      36929        meminfo.Mapped
      3246 ±  2%     +63.7%       5315 ±  5%  proc-vmstat.nr_active_anon
   1740701 ±  2%     -27.4%    1263351 ±  4%  proc-vmstat.nr_active_file
     76345            -3.1%      73949        proc-vmstat.nr_anon_pages
  41235116            -5.2%   39106395        proc-vmstat.nr_dirtied
     43614            +3.7%      45222        proc-vmstat.nr_dirty
   5617766            -7.5%    5199209        proc-vmstat.nr_file_pages
  42179045            +1.1%   42663739        proc-vmstat.nr_free_pages
     84985            -6.7%      79262        proc-vmstat.nr_inactive_anon
   3223721            +1.9%    3283642        proc-vmstat.nr_inactive_file
     31071           -10.4%      27834        proc-vmstat.nr_kernel_stack
     10853           -12.6%       9483        proc-vmstat.nr_mapped
      1067            -6.2%       1001        proc-vmstat.nr_page_table_pages
     11852            -9.3%      10748 ±  3%  proc-vmstat.nr_shmem
    841480            +2.3%     860894        proc-vmstat.nr_slab_reclaimable
    356995            -1.5%     351806        proc-vmstat.nr_slab_unreclaimable
  41233733            -5.2%   39103309        proc-vmstat.nr_written
      3246 ±  2%     +63.7%       5315 ±  5%  proc-vmstat.nr_zone_active_anon
   1740701 ±  2%     -27.4%    1263351 ±  4%  proc-vmstat.nr_zone_active_file
     84985            -6.7%      79262        proc-vmstat.nr_zone_inactive_anon
   3223721            +1.9%    3283642        proc-vmstat.nr_zone_inactive_file
     43649            +3.6%      45237        proc-vmstat.nr_zone_write_pending
  10743944           +11.0%   11920715        proc-vmstat.numa_hit
  10486008           +11.2%   11660052        proc-vmstat.numa_local
    256213 ±  4%     +30.9%     335278 ±  4%  proc-vmstat.numa_pte_updates
   1427645 ±  3%     -23.9%    1085954 ±  9%  proc-vmstat.pgactivate
  10759480           +11.1%   11959093        proc-vmstat.pgalloc_normal
   1493167          +163.2%    3930462        proc-vmstat.pgfault
  10721038 ±  2%     +11.8%   11989241        proc-vmstat.pgfree
 1.717e+08            -5.2%  1.628e+08        proc-vmstat.pgpgout
     80248          +176.9%     222186 ±  2%  proc-vmstat.pgreuse
     10.92 ± 41%    +251.5%      38.40 ± 28%  perf-stat.i.MPKI
 1.686e+09           -25.0%  1.264e+09 ±  2%  perf-stat.i.branch-instructions
      1.02 ± 51%      +1.1        2.15 ± 44%  perf-stat.i.branch-miss-rate%
     11.78 ± 18%      -8.4        3.34 ± 10%  perf-stat.i.cache-miss-rate%
   8696874 ± 16%     -40.1%    5206070 ± 34%  perf-stat.i.cache-misses
  93006209 ± 40%    +113.7%  1.988e+08 ± 27%  perf-stat.i.cache-references
    133991           -64.4%      47669        perf-stat.i.context-switches
      1.61 ± 10%     +77.9%       2.86 ± 12%  perf-stat.i.cpi
    207.27            -4.3%     198.27        perf-stat.i.cpu-migrations
      1734 ±  6%    +116.5%       3755 ± 31%  perf-stat.i.cycles-between-cache-misses
  2.27e+09           -36.4%  1.444e+09 ±  2%  perf-stat.i.dTLB-loads
 1.079e+09           -51.3%   5.25e+08 ±  3%  perf-stat.i.dTLB-stores
   2773451 ±  3%     -36.8%    1752389 ±  7%  perf-stat.i.iTLB-load-misses
   6627866 ±  6%     -45.5%    3612274 ± 21%  perf-stat.i.iTLB-loads
 8.541e+09           -36.0%  5.466e+09 ±  2%  perf-stat.i.instructions
      0.63 ±  8%     -41.7%       0.37 ± 12%  perf-stat.i.ipc
      1.25           -67.0%       0.41 ±  7%  perf-stat.i.major-faults
     26.22           -33.4%      17.47 ±  3%  perf-stat.i.metric.M/sec
      4353           -11.6%       3849        perf-stat.i.minor-faults
     28.34 ± 13%     +20.4       48.76 ±  3%  perf-stat.i.node-load-miss-rate%
   1784907           -68.1%     569781        perf-stat.i.node-loads
     17.67 ± 27%     +14.5       32.19 ± 10%  perf-stat.i.node-store-miss-rate%
   1006231 ±  3%     -64.7%     355642 ±  6%  perf-stat.i.node-stores
      4355           -11.6%       3849        perf-stat.i.page-faults
     10.89 ± 40%    +235.4%      36.51 ± 28%  perf-stat.overall.MPKI
      1.03 ± 49%      +1.1        2.12 ± 44%  perf-stat.overall.branch-miss-rate%
      9.93 ± 14%      -7.4        2.56 ±  8%  perf-stat.overall.cache-miss-rate%
      1.59 ±  9%     +73.4%       2.76 ± 12%  perf-stat.overall.cpi
      1579 ±  5%    +100.2%       3162 ± 24%  perf-stat.overall.cycles-between-cache-misses
      0.63 ±  8%     -41.9%       0.37 ± 12%  perf-stat.overall.ipc
     24.89 ± 13%     +21.3       46.16 ±  8%  perf-stat.overall.node-load-miss-rate%
     17.64 ± 25%     +13.7       31.38 ± 15%  perf-stat.overall.node-store-miss-rate%
 1.681e+09           -24.9%  1.263e+09 ±  2%  perf-stat.ps.branch-instructions
   8670511 ± 16%     -40.0%    5200670 ± 34%  perf-stat.ps.cache-misses
  92696590 ± 40%    +114.2%  1.986e+08 ± 27%  perf-stat.ps.cache-references
    133536           -64.3%      47605        perf-stat.ps.context-switches
    206.59            -4.1%     198.06        perf-stat.ps.cpu-migrations
 2.262e+09           -36.2%  1.443e+09 ±  2%  perf-stat.ps.dTLB-loads
 1.075e+09           -51.2%  5.244e+08 ±  3%  perf-stat.ps.dTLB-stores
   2764305 ±  3%     -36.7%    1750404 ±  7%  perf-stat.ps.iTLB-load-misses
   6605641 ±  6%     -45.4%    3608091 ± 21%  perf-stat.ps.iTLB-loads
 8.513e+09           -35.9%   5.46e+09 ±  2%  perf-stat.ps.instructions
      1.25           -67.0%       0.41 ±  7%  perf-stat.ps.major-faults
      4337           -11.4%       3844        perf-stat.ps.minor-faults
   1779749           -68.0%     569282        perf-stat.ps.node-loads
   1003217 ±  3%     -64.6%     355265 ±  6%  perf-stat.ps.node-stores
      4338           -11.4%       3844        perf-stat.ps.page-faults
  2.64e+12          +101.3%  5.315e+12 ±  2%  perf-stat.total.instructions
     47976 ± 15%    +257.9%     171687 ± 19%  softirqs.CPU0.RCU
     47168          +180.0%     132067 ±  4%  softirqs.CPU0.SCHED
     51434 ± 22%    +275.5%     193128 ± 21%  softirqs.CPU1.RCU
     43547 ± 15%    +239.0%     147607 ± 22%  softirqs.CPU1.SCHED
     53628 ± 22%    +260.3%     193225 ± 12%  softirqs.CPU10.RCU
     46209 ±  7%    +240.8%     157488 ± 16%  softirqs.CPU10.SCHED
     41543 ± 19%    +270.4%     153875 ± 18%  softirqs.CPU100.RCU
     41317          +198.7%     123436 ±  2%  softirqs.CPU100.SCHED
     42175 ± 18%    +264.2%     153611 ± 18%  softirqs.CPU101.RCU
     41592 ±  2%    +191.0%     121049 ±  3%  softirqs.CPU101.SCHED
     43980 ± 19%    +249.1%     153528 ± 16%  softirqs.CPU102.RCU
     41317 ±  2%    +202.6%     125009        softirqs.CPU102.SCHED
     41478 ± 19%    +265.9%     151785 ± 18%  softirqs.CPU103.RCU
     40483 ±  3%    +201.7%     122122 ±  2%  softirqs.CPU103.SCHED
     40685 ± 18%    +254.6%     144288 ± 16%  softirqs.CPU104.RCU
     40294 ±  3%    +189.8%     116773 ±  4%  softirqs.CPU104.SCHED
     42983 ± 18%    +250.3%     150574 ± 19%  softirqs.CPU105.RCU
     41556          +191.9%     121290 ±  7%  softirqs.CPU105.SCHED
     43022 ± 17%    +257.3%     153739 ± 19%  softirqs.CPU106.RCU
     37758 ± 25%    +216.4%     119467 ±  6%  softirqs.CPU106.SCHED
     42788 ± 21%    +258.1%     153241 ± 15%  softirqs.CPU107.RCU
     41843 ±  2%    +183.8%     118749 ±  7%  softirqs.CPU107.SCHED
     42845 ± 15%    +267.4%     157401 ± 18%  softirqs.CPU108.RCU
     42237          +187.3%     121351 ±  4%  softirqs.CPU108.SCHED
     42293 ± 17%    +236.1%     142135 ± 16%  softirqs.CPU109.RCU
     41362 ±  2%    +200.8%     124425 ±  3%  softirqs.CPU109.SCHED
     48453 ± 12%    +261.6%     175223 ± 19%  softirqs.CPU11.RCU
     48735 ± 18%    +183.4%     138131 ± 13%  softirqs.CPU11.SCHED
     40644 ± 20%    +253.7%     143757 ± 17%  softirqs.CPU110.RCU
     41110 ±  3%    +190.2%     119302 ±  4%  softirqs.CPU110.SCHED
     41486 ± 18%    +261.4%     149920 ± 16%  softirqs.CPU111.RCU
     41832 ±  2%    +191.0%     121750 ±  3%  softirqs.CPU111.SCHED
     39377 ± 18%    +226.7%     128641 ± 18%  softirqs.CPU112.RCU
     40013 ±  8%    +204.3%     121773 ±  3%  softirqs.CPU112.SCHED
     49821 ± 27%    +202.9%     150883 ± 14%  softirqs.CPU113.RCU
     44545 ± 12%    +210.8%     138439 ±  9%  softirqs.CPU113.SCHED
     41024 ± 21%    +232.3%     136334 ± 18%  softirqs.CPU114.RCU
     42679 ±  2%    +174.9%     117341 ±  6%  softirqs.CPU114.SCHED
     51244 ± 29%    +196.3%     151833 ± 13%  softirqs.CPU115.RCU
     45818 ±  8%    +208.4%     141320 ± 10%  softirqs.CPU115.SCHED
     48095 ± 14%    +196.4%     142558 ± 20%  softirqs.CPU116.RCU
     44696 ±  5%    +190.3%     129754 ± 18%  softirqs.CPU116.SCHED
     43739 ± 18%    +212.5%     136681 ± 18%  softirqs.CPU117.RCU
     43118 ±  3%    +183.4%     122201 ±  4%  softirqs.CPU117.SCHED
     47700 ± 26%    +218.8%     152070 ± 25%  softirqs.CPU118.RCU
     44380 ±  6%    +187.7%     127669 ± 27%  softirqs.CPU118.SCHED
     47016 ± 16%    +203.3%     142611 ± 18%  softirqs.CPU119.RCU
     41382 ± 19%    +179.5%     115658 ± 18%  softirqs.CPU119.SCHED
     44608 ± 18%    +279.6%     169333 ± 17%  softirqs.CPU12.RCU
     43775 ±  2%    +193.5%     128499 ±  2%  softirqs.CPU12.SCHED
     44136 ± 17%    +223.6%     142847 ± 16%  softirqs.CPU120.RCU
     43181          +198.7%     128978        softirqs.CPU120.SCHED
     39889 ± 20%    +211.9%     124411 ± 17%  softirqs.CPU121.RCU
     39687 ± 18%    +225.4%     129141        softirqs.CPU121.SCHED
     40695 ± 19%    +205.1%     124161 ± 14%  softirqs.CPU122.RCU
     42719          +201.9%     128991        softirqs.CPU122.SCHED
     42156 ± 17%    +234.7%     141093 ± 13%  softirqs.CPU123.RCU
     40098 ± 16%    +222.4%     129267        softirqs.CPU123.SCHED
     42220 ± 18%    +239.9%     143519 ± 14%  softirqs.CPU124.RCU
     43005          +199.6%     128831        softirqs.CPU124.SCHED
     42387 ± 18%    +241.0%     144536 ± 13%  softirqs.CPU125.RCU
     42942          +199.7%     128688        softirqs.CPU125.SCHED
     41968 ± 17%    +238.0%     141872 ± 14%  softirqs.CPU126.RCU
     43047          +199.2%     128796        softirqs.CPU126.SCHED
     40429 ± 18%    +229.9%     133370 ± 15%  softirqs.CPU127.RCU
     42890          +200.5%     128904        softirqs.CPU127.SCHED
     48217 ± 16%    +244.5%     166100 ± 13%  softirqs.CPU128.RCU
     42893          +199.7%     128534        softirqs.CPU128.SCHED
     48941 ± 17%    +262.6%     177454 ± 15%  softirqs.CPU129.RCU
     42940          +176.2%     118609 ± 18%  softirqs.CPU129.SCHED
     55036 ± 23%    +233.4%     183509 ± 10%  softirqs.CPU13.RCU
     52316 ± 21%    +207.1%     160681 ± 14%  softirqs.CPU13.SCHED
     48310 ± 16%    +253.7%     170891 ± 13%  softirqs.CPU130.RCU
     42924          +199.8%     128689        softirqs.CPU130.SCHED
     50605 ± 18%    +261.4%     182894 ± 15%  softirqs.CPU131.RCU
     42946          +199.8%     128751        softirqs.CPU131.SCHED
     50618 ± 17%    +257.9%     181155 ± 14%  softirqs.CPU132.RCU
     42950          +199.9%     128823        softirqs.CPU132.SCHED
     47107 ± 16%    +228.9%     154953 ± 14%  softirqs.CPU133.RCU
     42859          +199.7%     128457        softirqs.CPU133.SCHED
     47255 ± 16%    +253.5%     167059 ± 13%  softirqs.CPU134.RCU
     42869          +199.9%     128578        softirqs.CPU134.SCHED
     48997 ± 17%    +263.0%     177884 ± 16%  softirqs.CPU135.RCU
     43088          +198.5%     128617        softirqs.CPU135.SCHED
     48290 ± 17%    +231.1%     159866 ± 12%  softirqs.CPU136.RCU
     42871          +199.7%     128486        softirqs.CPU136.SCHED
     50797 ± 18%    +253.8%     179726 ± 15%  softirqs.CPU137.RCU
     42855          +200.4%     128740        softirqs.CPU137.SCHED
     50699 ± 17%    +250.8%     177866 ± 19%  softirqs.CPU138.RCU
     42914          +199.5%     128513        softirqs.CPU138.SCHED
     50423 ± 17%    +245.4%     174159 ± 15%  softirqs.CPU139.RCU
     42979          +199.6%     128778        softirqs.CPU139.SCHED
     52819 ± 20%    +219.3%     168636 ± 18%  softirqs.CPU14.RCU
     43159 ± 13%    +209.6%     133628 ± 16%  softirqs.CPU14.SCHED
     46894 ± 16%    +278.5%     177496 ± 16%  softirqs.CPU140.RCU
     43124          +198.4%     128690        softirqs.CPU140.SCHED
     49658 ± 17%    +245.7%     171649 ± 12%  softirqs.CPU141.RCU
     43089          +197.8%     128335        softirqs.CPU141.SCHED
     46164 ± 29%    +291.6%     180797 ± 15%  softirqs.CPU142.RCU
     42946          +200.1%     128881        softirqs.CPU142.SCHED
     49975 ± 17%    +233.4%     166629 ± 20%  softirqs.CPU143.RCU
     43226          +197.7%     128696        softirqs.CPU143.SCHED
     47691 ± 16%    +254.9%     169272 ± 16%  softirqs.CPU144.RCU
     39846 ± 18%    +219.0%     127096 ±  3%  softirqs.CPU144.SCHED
     47014 ± 16%    +237.7%     158783 ±  9%  softirqs.CPU145.RCU
     42817          +196.6%     127008 ±  2%  softirqs.CPU145.SCHED
     44737 ± 18%    +238.4%     151384 ± 13%  softirqs.CPU146.RCU
     42881          +196.0%     126941 ±  3%  softirqs.CPU146.SCHED
     48710 ± 18%    +263.8%     177218 ± 15%  softirqs.CPU147.RCU
     42869          +198.1%     127792 ±  2%  softirqs.CPU147.SCHED
     48313 ± 19%    +266.6%     177140 ± 17%  softirqs.CPU148.RCU
     42667          +197.8%     127064 ±  2%  softirqs.CPU148.SCHED
     48745 ± 19%    +267.5%     179137 ± 17%  softirqs.CPU149.RCU
     42779          +191.5%     124719 ±  5%  softirqs.CPU149.SCHED
     55797 ± 22%    +202.4%     168757 ± 25%  softirqs.CPU15.RCU
     47221 ± 11%    +185.3%     134730 ± 17%  softirqs.CPU15.SCHED
     49276 ± 18%    +263.5%     179135 ± 16%  softirqs.CPU150.RCU
     42737          +198.9%     127761 ±  2%  softirqs.CPU150.SCHED
     48546 ± 19%    +257.1%     173353 ± 14%  softirqs.CPU151.RCU
     42744          +197.7%     127256 ±  2%  softirqs.CPU151.SCHED
     47510 ± 19%    +268.4%     175050 ± 17%  softirqs.CPU152.RCU
     43159          +195.2%     127387 ±  2%  softirqs.CPU152.SCHED
     47736 ± 17%    +254.1%     169020 ± 14%  softirqs.CPU153.RCU
     42572          +198.8%     127216 ±  2%  softirqs.CPU153.SCHED
     49147 ± 18%    +260.8%     177322 ± 15%  softirqs.CPU154.RCU
     42684          +192.1%     124671 ±  6%  softirqs.CPU154.SCHED
     49797 ± 19%    +259.2%     178865 ± 16%  softirqs.CPU155.RCU
     42812          +191.2%     124665 ±  4%  softirqs.CPU155.SCHED
     45522 ± 16%    +257.2%     162586 ± 14%  softirqs.CPU156.RCU
     42444 ±  2%    +198.5%     126691 ±  2%  softirqs.CPU156.SCHED
     45992 ± 17%    +253.9%     162770 ± 14%  softirqs.CPU157.RCU
     42499          +198.1%     126676 ±  3%  softirqs.CPU157.SCHED
     48781 ± 19%    +259.2%     175202 ± 17%  softirqs.CPU158.RCU
     42565          +199.9%     127672 ±  2%  softirqs.CPU158.SCHED
     43221 ± 13%    +282.9%     165496 ± 15%  softirqs.CPU159.RCU
     42456          +199.7%     127247 ±  2%  softirqs.CPU159.SCHED
     43889 ± 15%    +217.8%     139494 ± 20%  softirqs.CPU16.RCU
     43807 ±  4%    +189.4%     126785 ±  4%  softirqs.CPU16.SCHED
     46851 ± 18%    +223.7%     151649 ± 20%  softirqs.CPU160.RCU
     42661          +198.0%     127128 ±  3%  softirqs.CPU160.SCHED
     48331 ± 17%    +229.3%     159146 ± 19%  softirqs.CPU161.RCU
     43157          +194.8%     127235 ±  2%  softirqs.CPU161.SCHED
     43141 ± 20%    +214.8%     135819 ± 22%  softirqs.CPU162.RCU
     42300 ±  2%    +199.3%     126619 ±  3%  softirqs.CPU162.SCHED
     46485 ± 17%    +234.6%     155555 ± 18%  softirqs.CPU163.RCU
     42606          +196.8%     126464 ±  3%  softirqs.CPU163.SCHED
     50580 ± 17%    +217.2%     160421 ± 15%  softirqs.CPU164.RCU
     43720 ±  5%    +208.9%     135065 ± 11%  softirqs.CPU164.SCHED
     46832 ± 16%    +227.4%     153312 ± 18%  softirqs.CPU165.RCU
     43201          +194.5%     127249 ±  2%  softirqs.CPU165.SCHED
     48015 ± 16%    +239.6%     163069 ± 18%  softirqs.CPU166.RCU
     42996          +196.3%     127414 ±  2%  softirqs.CPU166.SCHED
     49610 ± 17%    +217.9%     157708 ± 16%  softirqs.CPU167.RCU
     42104 ±  6%    +181.6%     118568 ± 14%  softirqs.CPU167.SCHED
     45412 ± 18%    +242.1%     155368 ± 15%  softirqs.CPU168.RCU
     37913 ± 28%    +235.9%     127357 ±  2%  softirqs.CPU168.SCHED
     42364 ± 17%    +237.9%     143165 ± 16%  softirqs.CPU169.RCU
     42947          +196.9%     127511 ±  2%  softirqs.CPU169.SCHED
     41809 ± 16%    +226.8%     136639 ± 18%  softirqs.CPU17.RCU
     43062 ±  2%    +184.6%     122557 ±  3%  softirqs.CPU17.SCHED
     41355 ± 18%    +235.0%     138528 ± 17%  softirqs.CPU170.RCU
     42981          +195.6%     127038 ±  2%  softirqs.CPU170.SCHED
     44314 ± 17%    +254.2%     156976 ± 15%  softirqs.CPU171.RCU
     42797          +198.4%     127690 ±  2%  softirqs.CPU171.SCHED
     42907 ± 18%    +255.1%     152357 ± 15%  softirqs.CPU172.RCU
     42782          +197.2%     127138 ±  2%  softirqs.CPU172.SCHED
     44525 ± 17%    +249.4%     155577 ± 16%  softirqs.CPU173.RCU
     42965          +196.8%     127535 ±  2%  softirqs.CPU173.SCHED
     44451 ± 17%    +253.6%     157160 ± 16%  softirqs.CPU174.RCU
     39726 ± 17%    +202.8%     120305 ± 12%  softirqs.CPU174.SCHED
     43013 ± 17%    +243.7%     147830 ± 15%  softirqs.CPU175.RCU
     42875          +196.2%     127007 ±  2%  softirqs.CPU175.SCHED
     48247 ± 17%    +265.0%     176099 ± 13%  softirqs.CPU176.RCU
     42918          +196.9%     127435 ±  2%  softirqs.CPU176.SCHED
     47684 ± 16%    +259.4%     171352 ± 13%  softirqs.CPU177.RCU
     42930          +197.0%     127486 ±  2%  softirqs.CPU177.SCHED
     48461 ± 17%    +270.9%     179734 ± 14%  softirqs.CPU178.RCU
     42903          +197.0%     127416 ±  2%  softirqs.CPU178.SCHED
     49351 ± 18%    +258.6%     176969 ± 15%  softirqs.CPU179.RCU
     42835          +198.0%     127641 ±  2%  softirqs.CPU179.SCHED
     42112 ± 18%    +232.2%     139876 ± 18%  softirqs.CPU18.RCU
     41917 ±  6%    +188.8%     121070 ±  6%  softirqs.CPU18.SCHED
     46700 ± 15%    +256.6%     166553 ± 15%  softirqs.CPU180.RCU
     42770          +197.1%     127081 ±  2%  softirqs.CPU180.SCHED
     46319 ± 16%    +251.4%     162763 ± 13%  softirqs.CPU181.RCU
     42811          +196.3%     126870 ±  2%  softirqs.CPU181.SCHED
     49048 ± 17%    +269.2%     181069 ± 15%  softirqs.CPU182.RCU
     42901          +197.1%     127479 ±  2%  softirqs.CPU182.SCHED
     46991 ± 15%    +243.9%     161593 ± 13%  softirqs.CPU183.RCU
     42758          +197.2%     127081 ±  2%  softirqs.CPU183.SCHED
     48663 ± 16%    +259.0%     174707 ± 13%  softirqs.CPU184.RCU
     42692          +198.8%     127565 ±  2%  softirqs.CPU184.SCHED
     49390 ± 17%    +261.0%     178275 ± 14%  softirqs.CPU185.RCU
     42892          +197.0%     127411 ±  2%  softirqs.CPU185.SCHED
     40647 ± 24%    +281.6%     155111 ± 16%  softirqs.CPU186.RCU
     43084          +194.4%     126861 ±  2%  softirqs.CPU186.SCHED
     49093 ± 15%    +270.0%     181656 ± 15%  softirqs.CPU187.RCU
     42737          +197.7%     127220 ±  2%  softirqs.CPU187.SCHED
     48869 ± 18%    +273.1%     182329 ± 16%  softirqs.CPU188.RCU
     42782          +197.7%     127359 ±  2%  softirqs.CPU188.SCHED
     46694 ± 16%    +266.7%     171220 ± 14%  softirqs.CPU189.RCU
     42509          +199.1%     127150 ±  2%  softirqs.CPU189.SCHED
     40050 ± 19%    +240.9%     136513 ± 18%  softirqs.CPU19.RCU
     39309 ± 17%    +209.7%     121760 ±  6%  softirqs.CPU19.SCHED
     48637 ± 17%    +272.5%     181180 ± 16%  softirqs.CPU190.RCU
     42877 ±  2%    +206.4%     131354 ±  7%  softirqs.CPU190.SCHED
     47627 ± 15%    +254.5%     168848 ± 13%  softirqs.CPU191.RCU
     28001 ± 23%    +240.7%      95412 ± 29%  softirqs.CPU191.SCHED
     54426 ± 18%    +221.3%     174885 ± 23%  softirqs.CPU2.RCU
     44916 ±  6%    +187.0%     128892 ± 25%  softirqs.CPU2.SCHED
     40331 ± 19%    +231.5%     133709 ± 17%  softirqs.CPU20.RCU
     39401 ± 17%    +221.4%     126625 ±  5%  softirqs.CPU20.SCHED
     39891 ± 19%    +243.9%     137191 ± 19%  softirqs.CPU21.RCU
     39521 ± 17%    +236.4%     132930 ± 17%  softirqs.CPU22.RCU
     42309          +189.2%     122370 ±  5%  softirqs.CPU22.SCHED
     39369 ± 19%    +243.9%     135409 ± 18%  softirqs.CPU23.RCU
     41982          +197.6%     124944        softirqs.CPU23.SCHED
     43827 ± 17%    +230.4%     144800 ± 17%  softirqs.CPU24.RCU
     43392          +175.1%     119368 ± 19%  softirqs.CPU24.SCHED
     39340 ± 18%    +215.8%     124243 ± 20%  softirqs.CPU25.RCU
     42674          +201.6%     128703        softirqs.CPU25.SCHED
     41063 ± 17%    +220.5%     131589 ± 16%  softirqs.CPU26.RCU
     44950 ± 10%    +190.5%     130563 ±  3%  softirqs.CPU26.SCHED
     42200 ± 17%    +245.9%     145986 ± 14%  softirqs.CPU27.RCU
     43888 ±  3%    +197.5%     130586 ±  3%  softirqs.CPU27.SCHED
     42448 ± 18%    +239.8%     144233 ± 14%  softirqs.CPU28.RCU
     42899          +201.1%     129177        softirqs.CPU28.SCHED
     40082 ± 18%    +264.6%     146157 ± 13%  softirqs.CPU29.RCU
     53587 ± 20%    +141.1%     129212        softirqs.CPU29.SCHED
     45978 ± 24%    +264.0%     167357 ± 22%  softirqs.CPU3.RCU
     42350 ±  4%    +194.7%     124827 ±  2%  softirqs.CPU3.SCHED
     42308 ± 17%    +238.6%     143261 ± 14%  softirqs.CPU30.RCU
     44139 ±  4%    +190.6%     128281        softirqs.CPU30.SCHED
     39958 ± 21%    +241.3%     136377 ± 15%  softirqs.CPU31.RCU
     61474 ± 32%    +109.1%     128561        softirqs.CPU31.SCHED
     50434 ± 15%    +237.7%     170309 ± 11%  softirqs.CPU32.RCU
     43540 ±  3%    +196.0%     128860        softirqs.CPU32.SCHED
     50391 ± 16%    +251.2%     176949 ± 15%  softirqs.CPU33.RCU
     45705 ± 13%    +181.7%     128738        softirqs.CPU33.SCHED
     49965 ± 15%    +253.6%     176666 ± 13%  softirqs.CPU34.RCU
     42883          +199.7%     128527        softirqs.CPU34.SCHED
     51875 ± 17%    +259.2%     186362 ± 13%  softirqs.CPU35.RCU
     43448 ±  2%    +195.8%     128522        softirqs.CPU35.SCHED
     52075 ± 15%    +254.3%     184529 ± 13%  softirqs.CPU36.RCU
     42919          +199.6%     128584        softirqs.CPU36.SCHED
     48685 ± 16%    +229.1%     160202 ± 14%  softirqs.CPU37.RCU
     42690          +200.9%     128461        softirqs.CPU37.SCHED
     49203 ± 16%    +249.0%     171741 ± 13%  softirqs.CPU38.RCU
     42846          +182.4%     120982 ± 17%  softirqs.CPU38.SCHED
     50971 ± 16%    +253.9%     180392 ± 16%  softirqs.CPU39.RCU
     42890          +200.2%     128754        softirqs.CPU39.SCHED
     50852 ± 20%    +276.7%     191550 ± 14%  softirqs.CPU4.RCU
     44115 ±  6%    +253.5%     155969 ± 16%  softirqs.CPU4.SCHED
     49870 ± 15%    +226.2%     162692 ± 13%  softirqs.CPU40.RCU
     42850          +205.4%     130844 ±  4%  softirqs.CPU40.SCHED
     11.83 ± 17%  +42850.7%       5082 ±222%  softirqs.CPU40.TIMER
     51256 ± 16%    +258.7%     183849 ± 15%  softirqs.CPU41.RCU
     46670 ± 17%    +175.6%     128620        softirqs.CPU41.SCHED
     52995 ± 13%    +243.3%     181911 ± 17%  softirqs.CPU42.RCU
     42980          +198.9%     128479        softirqs.CPU42.SCHED
     52444 ± 16%    +240.5%     178580 ± 15%  softirqs.CPU43.RCU
     43010          +197.9%     128145        softirqs.CPU43.SCHED
     50509 ± 15%    +261.1%     182399 ± 15%  softirqs.CPU44.RCU
     43255 ±  2%    +198.5%     129135        softirqs.CPU44.SCHED
     51524 ± 16%    +241.7%     176076 ± 12%  softirqs.CPU45.RCU
     43126          +197.9%     128493        softirqs.CPU45.SCHED
     52276 ± 17%    +250.2%     183055 ± 13%  softirqs.CPU46.RCU
     42954          +199.6%     128692        softirqs.CPU46.SCHED
     52168 ± 16%    +228.4%     171301 ± 20%  softirqs.CPU47.RCU
     42939          +200.2%     128907        softirqs.CPU47.SCHED
     53681 ± 15%    +231.6%     178016 ± 14%  softirqs.CPU48.RCU
     43740 ±  2%    +191.9%     127684 ±  2%  softirqs.CPU48.SCHED
     49552 ± 16%    +237.7%     167333 ±  8%  softirqs.CPU49.RCU
     42962          +196.1%     127208 ±  2%  softirqs.CPU49.SCHED
     49029 ± 14%    +255.8%     174467 ± 18%  softirqs.CPU5.RCU
     43874 ±  4%    +199.9%     131564 ±  5%  softirqs.CPU5.SCHED
     50757 ± 21%    +215.7%     160254 ± 14%  softirqs.CPU50.RCU
     44004 ±  5%    +193.6%     129191 ±  3%  softirqs.CPU50.SCHED
     51333 ± 16%    +264.0%     186847 ± 13%  softirqs.CPU51.RCU
     43064          +173.7%     117859 ± 18%  softirqs.CPU51.SCHED
     51372 ± 16%    +259.9%     184905 ± 15%  softirqs.CPU52.RCU
     42624          +199.8%     127808 ±  2%  softirqs.CPU52.SCHED
     52646 ± 16%    +268.1%     193772 ± 12%  softirqs.CPU53.RCU
     43279 ±  2%    +214.7%     136197 ± 13%  softirqs.CPU53.SCHED
     51606 ± 16%    +261.5%     186539 ± 14%  softirqs.CPU54.RCU
     42691          +198.2%     127300 ±  2%  softirqs.CPU54.SCHED
     50188 ± 15%    +252.5%     176918 ± 13%  softirqs.CPU55.RCU
     39940 ± 16%    +220.0%     127793        softirqs.CPU55.SCHED
     50110 ± 16%    +279.9%     190347 ± 12%  softirqs.CPU56.RCU
     43453 ±  2%    +218.5%     138402 ± 16%  softirqs.CPU56.SCHED
     49678 ± 15%    +260.7%     179197 ± 11%  softirqs.CPU57.RCU
     42419          +204.0%     128955 ±  2%  softirqs.CPU57.SCHED
     51036 ± 17%    +264.3%     185947 ± 13%  softirqs.CPU58.RCU
     42674          +200.9%     128427        softirqs.CPU58.SCHED
     52214 ± 18%    +268.3%     192302 ± 11%  softirqs.CPU59.RCU
     42919          +215.3%     135304 ± 11%  softirqs.CPU59.SCHED
     45835 ± 20%    +246.6%     158888 ± 15%  softirqs.CPU6.RCU
     42428          +200.5%     127488 ±  2%  softirqs.CPU6.SCHED
     47933 ± 15%    +255.5%     170407 ± 13%  softirqs.CPU60.RCU
     42799          +202.9%     129618 ±  4%  softirqs.CPU60.SCHED
     49088 ± 16%    +246.0%     169846 ± 11%  softirqs.CPU61.RCU
     43356 ±  2%    +193.9%     127410 ±  2%  softirqs.CPU61.SCHED
     53333 ± 18%    +254.6%     189122 ± 11%  softirqs.CPU62.RCU
     43861 ±  4%    +209.8%     135861 ± 12%  softirqs.CPU62.SCHED
     53241 ± 22%    +236.8%     179298 ± 13%  softirqs.CPU63.RCU
     44674 ±  8%    +205.8%     136632 ± 14%  softirqs.CPU63.SCHED
     49905 ± 14%    +215.5%     157474 ± 18%  softirqs.CPU64.RCU
     43368 ±  2%    +198.3%     129382 ±  2%  softirqs.CPU64.SCHED
     48982 ± 16%    +226.6%     160001 ± 18%  softirqs.CPU65.RCU
     43072          +197.4%     128104        softirqs.CPU65.SCHED
     45954 ± 20%    +196.8%     136398 ± 22%  softirqs.CPU66.RCU
     42649          +199.1%     127549 ±  2%  softirqs.CPU66.SCHED
     47346 ± 17%    +231.5%     156959 ± 14%  softirqs.CPU67.RCU
     42757          +197.7%     127294 ±  2%  softirqs.CPU67.SCHED
     21.00 ± 78%  +35142.1%       7400 ±221%  softirqs.CPU67.TIMER
     48696 ± 17%    +234.0%     162652 ± 22%  softirqs.CPU68.RCU
     42961          +196.8%     127499 ±  2%  softirqs.CPU68.SCHED
     46723 ± 19%    +241.6%     159592 ± 14%  softirqs.CPU69.RCU
     42165 ±  2%    +208.5%     130068 ±  5%  softirqs.CPU69.SCHED
     46511 ± 12%    +311.3%     191298 ± 11%  softirqs.CPU7.RCU
     42704 ±  2%    +267.8%     157047 ± 15%  softirqs.CPU7.SCHED
     48338 ± 18%    +244.8%     166664 ± 17%  softirqs.CPU70.RCU
     42794          +198.1%     127548 ±  2%  softirqs.CPU70.SCHED
     46911 ± 19%    +238.4%     158759 ± 18%  softirqs.CPU71.RCU
     43148          +195.7%     127600 ±  2%  softirqs.CPU71.SCHED
     47114 ± 16%    +241.6%     160935 ± 15%  softirqs.CPU72.RCU
     42568          +191.3%     123982 ±  6%  softirqs.CPU72.SCHED
     44503 ± 17%    +240.8%     151658 ± 15%  softirqs.CPU73.RCU
     42500          +184.6%     120955 ± 16%  softirqs.CPU73.SCHED
     43480 ± 19%    +230.4%     143673 ± 18%  softirqs.CPU74.RCU
     42477          +183.4%     120389 ± 11%  softirqs.CPU74.SCHED
     45923 ± 17%    +246.7%     159220 ± 14%  softirqs.CPU75.RCU
     42440          +199.4%     127053 ±  2%  softirqs.CPU75.SCHED
     45853 ± 19%    +242.4%     156991 ± 15%  softirqs.CPU76.RCU
     42526          +201.0%     127994 ±  3%  softirqs.CPU76.SCHED
     45711 ± 17%    +246.0%     158164 ± 16%  softirqs.CPU77.RCU
     42384          +199.7%     127037 ±  2%  softirqs.CPU77.SCHED
     45632 ± 16%    +245.0%     157419 ± 14%  softirqs.CPU78.RCU
     42568          +197.3%     126542 ±  2%  softirqs.CPU78.SCHED
     45016 ± 17%    +236.6%     151502 ± 14%  softirqs.CPU79.RCU
     42256          +199.1%     126390 ±  2%  softirqs.CPU79.SCHED
     45137 ± 11%    +272.8%     168281 ± 19%  softirqs.CPU8.RCU
     44416 ±  9%    +209.3%     137371 ± 16%  softirqs.CPU8.SCHED
     49887 ± 17%    +265.9%     182560 ± 13%  softirqs.CPU80.RCU
     42640          +195.7%     126093 ±  2%  softirqs.CPU80.SCHED
     47646 ± 15%    +262.9%     172885 ± 13%  softirqs.CPU81.RCU
     42582          +196.8%     126400 ±  2%  softirqs.CPU81.SCHED
     49622 ± 18%    +270.0%     183592 ± 14%  softirqs.CPU82.RCU
     42458          +198.6%     126761 ±  2%  softirqs.CPU82.SCHED
     49861 ± 17%    +258.5%     178732 ± 14%  softirqs.CPU83.RCU
     42577          +198.4%     127038 ±  2%  softirqs.CPU83.SCHED
     47320 ± 15%    +253.2%     167129 ± 13%  softirqs.CPU84.RCU
     42307          +198.2%     126152 ±  2%  softirqs.CPU84.SCHED
     47744 ± 15%    +250.8%     167497 ± 12%  softirqs.CPU85.RCU
     42189          +199.4%     126299 ±  3%  softirqs.CPU85.SCHED
     48849 ± 19%    +275.9%     183609 ± 14%  softirqs.CPU86.RCU
     42347          +199.8%     126939 ±  2%  softirqs.CPU86.SCHED
     47686 ± 16%    +242.0%     163098 ± 13%  softirqs.CPU87.RCU
     42395          +199.0%     126761 ±  2%  softirqs.CPU87.SCHED
     48776 ± 16%    +259.3%     175253 ± 13%  softirqs.CPU88.RCU
     42344          +182.2%     119513 ± 12%  softirqs.CPU88.SCHED
     50336 ± 17%    +258.6%     180495 ± 13%  softirqs.CPU89.RCU
     42601          +197.1%     126559 ±  2%  softirqs.CPU89.SCHED
     44394 ± 14%    +259.4%     159563 ± 18%  softirqs.CPU9.RCU
     42487          +199.3%     127156 ±  3%  softirqs.CPU9.SCHED
     46308 ± 19%    +242.4%     158563 ± 16%  softirqs.CPU90.RCU
     42469          +197.7%     126423 ±  2%  softirqs.CPU90.SCHED
     50144 ± 16%    +268.2%     184632 ± 15%  softirqs.CPU91.RCU
     42500          +197.7%     126505 ±  2%  softirqs.CPU91.SCHED
     50364 ± 17%    +264.4%     183530 ± 15%  softirqs.CPU92.RCU
     42544          +197.9%     126755 ±  2%  softirqs.CPU92.SCHED
     47189 ± 17%    +268.9%     174087 ± 13%  softirqs.CPU93.RCU
     42182          +200.0%     126554 ±  2%  softirqs.CPU93.SCHED
     50818 ± 18%    +263.4%     184692 ± 15%  softirqs.CPU94.RCU
     42768          +196.9%     126978 ±  2%  softirqs.CPU94.SCHED
     49496 ± 15%    +247.3%     171917 ± 11%  softirqs.CPU95.RCU
     22401 ± 11%    +270.9%      83076 ± 46%  softirqs.CPU95.SCHED
     42634 ± 18%    +266.4%     156208 ± 19%  softirqs.CPU96.RCU
     41316 ± 17%    +269.4%     152640 ± 18%  softirqs.CPU97.RCU
     41578 ±  3%    +195.2%     122722 ±  2%  softirqs.CPU97.SCHED
     41991 ± 20%    +266.1%     153710 ± 17%  softirqs.CPU98.RCU
     40589 ±  5%    +197.9%     120925 ±  3%  softirqs.CPU98.SCHED
     43012 ± 18%    +254.8%     152628 ± 18%  softirqs.CPU99.RCU
     42041 ±  2%    +191.2%     122444 ±  2%  softirqs.CPU99.SCHED
     18511 ± 46%    +211.2%      57608 ± 27%  softirqs.NET_RX
   9023846 ± 15%    +248.2%   31418582 ± 12%  softirqs.RCU
   8211849          +197.7%   24442961        softirqs.SCHED
     60379 ±  2%    +163.2%     158940 ±  3%  softirqs.TIMER
      6.22 ±  4%      -4.2        2.04 ± 22%  perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents
     62.31 ±  2%      -4.2       58.15 ±  2%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     62.31 ±  2%      -4.2       58.15 ±  2%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     62.27 ±  2%      -4.2       58.11 ±  2%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      4.96 ±  5%      -4.0        1.01 ± 41%  perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     62.50 ±  2%      -3.8       58.74 ±  2%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     56.59 ±  2%      -3.8       52.83 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      5.68 ±  4%      -3.6        2.04 ± 22%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
      5.68 ±  4%      -3.6        2.04 ± 22%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
      5.67 ±  4%      -3.6        2.04 ± 22%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log
      5.10 ±  9%      -3.4        1.73 ± 24%  perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range
      5.09 ±  9%      -3.4        1.72 ± 24%  perf-profile.calltrace.cycles-pp.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc
      4.90 ±  9%      -3.3        1.63 ± 24%  perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages
      4.88 ±  9%      -3.2        1.63 ± 24%  perf-profile.calltrace.cycles-pp.csum_one_extent_buffer.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages
      2.94 ±  4%      -1.9        1.08 ± 28%  perf-profile.calltrace.cycles-pp.check_leaf.csum_one_extent_buffer.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio
      3.21 ±  3%      -1.7        1.52 ± 25%  perf-profile.calltrace.cycles-pp.open64
      3.20 ±  3%      -1.7        1.52 ± 25%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.open64
      3.19 ±  3%      -1.7        1.51 ± 25%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
      3.19 ±  3%      -1.7        1.52 ± 25%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
      3.18 ±  3%      -1.7        1.51 ± 25%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
      3.14 ±  3%      -1.6        1.49 ± 25%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.13 ±  3%      -1.6        1.49 ± 25%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      2.62 ± 12%      -1.5        1.08 ± 28%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      2.72 ± 11%      -1.3        1.40 ± 44%  perf-profile.calltrace.cycles-pp.ret_from_fork
      2.72 ± 11%      -1.3        1.40 ± 44%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      2.24 ± 12%      -1.3        0.92 ± 30%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      1.96 ± 11%      -1.3        0.69 ± 54%  perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
      2.37 ±  3%      -1.2        1.16 ± 26%  perf-profile.calltrace.cycles-pp.btrfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      1.58 ±  6%      -1.1        0.44 ± 74%  perf-profile.calltrace.cycles-pp.start_ordered_ops.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
      1.59 ±  9%      -1.1        0.45 ± 73%  perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread.kthread
      2.94 ±  4%      -1.0        1.92 ±  8%  perf-profile.calltrace.cycles-pp.copy_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
      1.30 ±  2%      -1.0        0.32 ±102%  perf-profile.calltrace.cycles-pp.btrfs_get_32.check_leaf.csum_one_extent_buffer.btree_csum_one_bio.btrfs_submit_metadata_bio
      1.30 ±  7%      -1.0        0.34 ±100%  perf-profile.calltrace.cycles-pp.write
      1.29 ±  7%      -1.0        0.33 ±100%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
      1.29 ±  7%      -1.0        0.33 ±100%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
      1.28 ±  7%      -1.0        0.33 ±100%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
      1.27 ±  7%      -0.9        0.33 ±100%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
      1.25 ±  7%      -0.9        0.32 ±101%  perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.59 ±  6%      -0.9        0.68 ± 24%  perf-profile.calltrace.cycles-pp.btrfs_wait_ordered_range.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
      1.20 ±  6%      -0.9        0.30 ±100%  perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
      1.19 ±  6%      -0.9        0.30 ±100%  perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write
      1.55 ±  5%      -0.9        0.69 ± 16%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      1.53 ±  5%      -0.8        0.68 ± 15%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      0.89 ±  6%      -0.6        0.33 ±101%  perf-profile.calltrace.cycles-pp.btrfs_new_inode.btrfs_create.path_openat.do_filp_open.do_sys_openat2
      1.93 ±  2%      -0.5        1.43 ±  6%  perf-profile.calltrace.cycles-pp.btrfs_csum_file_blocks.log_csums.copy_items.btrfs_log_inode.btrfs_log_inode_parent
      1.93 ±  2%      -0.5        1.43 ±  6%  perf-profile.calltrace.cycles-pp.log_csums.copy_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
      1.27 ±  3%      -0.2        1.05 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_lookup_csum.btrfs_csum_file_blocks.log_csums.copy_items.btrfs_log_inode
      1.26 ±  3%      -0.2        1.05 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks.log_csums.copy_items
      1.49 ±  9%      +0.2        1.72 ±  8%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      6.84 ±  3%      +1.3        8.16 ±  5%  perf-profile.calltrace.cycles-pp.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
      0.36 ± 71%      +1.4        1.78 ± 20%  perf-profile.calltrace.cycles-pp.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
      5.75 ±  4%      +1.5        7.27 ±  4%  perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
      0.00            +1.6        1.56 ± 22%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block
      0.00            +1.6        1.57 ± 22%  perf-profile.calltrace.cycles-pp._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block
      0.00            +1.6        1.61 ± 22%  perf-profile.calltrace.cycles-pp.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
      0.00            +2.1        2.08 ± 10%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block
      0.00            +2.1        2.09 ± 10%  perf-profile.calltrace.cycles-pp._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block
      0.00            +2.1        2.12 ± 10%  perf-profile.calltrace.cycles-pp.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block
      0.00            +2.1        2.12 ± 10%  perf-profile.calltrace.cycles-pp.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
      1.10 ±  6%      +2.2        3.26 ± 12%  perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
      0.00            +2.2        2.18 ± 10%  perf-profile.calltrace.cycles-pp.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
      1.78 ±  3%      +2.6        4.36 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode
      1.77 ±  3%      +2.6        4.36 ± 11%  perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items
      0.71 ±  4%      +2.8        3.49 ± 19%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
      2.89 ±  3%      +2.8        5.72 ±  7%  perf-profile.calltrace.cycles-pp.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
      2.89 ±  3%      +2.8        5.72 ±  7%  perf-profile.calltrace.cycles-pp.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
      2.83 ±  3%      +2.8        5.68 ±  7%  perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent
      0.00            +4.0        3.95 ± 17%  perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents
      0.00            +4.0        4.04 ± 14%  perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log
      0.68 ±  6%      +4.6        5.31 ± 14%  perf-profile.calltrace.cycles-pp.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
      0.68 ±  7%      +4.6        5.31 ± 14%  perf-profile.calltrace.cycles-pp.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
      1.83 ±  5%      +4.9        6.76 ± 15%  perf-profile.calltrace.cycles-pp.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
      0.00            +5.2        5.16 ± 15%  perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log
      0.00            +5.2        5.18 ± 15%  perf-profile.calltrace.cycles-pp.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file
      0.00            +5.2        5.18 ± 13%  perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
      0.00            +5.2        5.20 ± 13%  perf-profile.calltrace.cycles-pp.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
     12.75 ±  3%      +5.5       18.25 ±  9%  perf-profile.calltrace.cycles-pp.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
      8.80 ±  3%      +6.2       15.01 ±  8%  perf-profile.calltrace.cycles-pp.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
      8.79 ±  3%      +6.2       15.00 ±  8%  perf-profile.calltrace.cycles-pp.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync
     26.42 ±  3%      +8.4       34.83 ±  7%  perf-profile.calltrace.cycles-pp.fsync
     26.33 ±  3%      +8.5       34.79 ±  7%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.fsync
     26.32 ±  3%      +8.5       34.78 ±  7%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
     26.30 ±  3%      +8.5       34.77 ±  7%  perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
     26.29 ±  3%      +8.5       34.76 ±  7%  perf-profile.calltrace.cycles-pp.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
     26.30 ±  3%      +8.5       34.77 ±  7%  perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
      7.77 ±  4%      -5.1        2.72 ± 24%  perf-profile.children.cycles-pp.do_writepages
      7.76 ±  4%      -5.0        2.72 ± 24%  perf-profile.children.cycles-pp.filemap_fdatawrite_range
      7.75 ±  4%      -5.0        2.71 ± 23%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
     62.31 ±  2%      -4.2       58.15 ±  2%  perf-profile.children.cycles-pp.start_secondary
      6.22 ±  4%      -4.1        2.15 ± 25%  perf-profile.children.cycles-pp.btree_write_cache_pages
      5.00 ±  5%      -4.0        1.03 ± 41%  perf-profile.children.cycles-pp.poll_idle
     62.50 ±  2%      -3.8       58.73 ±  2%  perf-profile.children.cycles-pp.do_idle
     62.50 ±  2%      -3.8       58.74 ±  2%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     62.50 ±  2%      -3.8       58.74 ±  2%  perf-profile.children.cycles-pp.cpu_startup_entry
      5.65 ±  4%      -3.7        1.97 ± 26%  perf-profile.children.cycles-pp.submit_one_bio
      5.33 ±  5%      -3.5        1.83 ± 27%  perf-profile.children.cycles-pp.btrfs_submit_metadata_bio
      5.14 ±  5%      -3.4        1.74 ± 27%  perf-profile.children.cycles-pp.btree_csum_one_bio
      5.12 ±  5%      -3.4        1.73 ± 27%  perf-profile.children.cycles-pp.csum_one_extent_buffer
      6.04 ±  4%      -3.1        2.96 ± 19%  perf-profile.children.cycles-pp.perf_tp_event
      5.72 ±  4%      -3.0        2.72 ± 18%  perf-profile.children.cycles-pp.__schedule
      5.88 ±  4%      -3.0        2.89 ± 19%  perf-profile.children.cycles-pp.perf_swevent_overflow
      5.86 ±  3%      -3.0        2.88 ± 19%  perf-profile.children.cycles-pp.__perf_event_overflow
      5.84 ±  3%      -3.0        2.87 ± 19%  perf-profile.children.cycles-pp.perf_event_output_forward
      5.05 ±  3%      -2.5        2.52 ± 19%  perf-profile.children.cycles-pp.perf_prepare_sample
      4.79 ±  3%      -2.4        2.41 ± 19%  perf-profile.children.cycles-pp.perf_callchain
      4.78 ±  3%      -2.4        2.40 ± 19%  perf-profile.children.cycles-pp.get_perf_callchain
      3.42 ±  3%      -2.2        1.18 ± 32%  perf-profile.children.cycles-pp.check_leaf
      4.18 ±  3%      -2.2        2.02 ± 19%  perf-profile.children.cycles-pp.schedule
      3.92 ±  3%      -1.9        1.97 ± 18%  perf-profile.children.cycles-pp.perf_callchain_kernel
      3.21 ±  3%      -1.7        1.52 ± 24%  perf-profile.children.cycles-pp.open64
      3.22 ±  3%      -1.7        1.57 ± 24%  perf-profile.children.cycles-pp.do_sys_open
      3.22 ±  3%      -1.6        1.57 ± 24%  perf-profile.children.cycles-pp.do_sys_openat2
      3.17 ±  3%      -1.6        1.54 ± 24%  perf-profile.children.cycles-pp.do_filp_open
      3.16 ±  3%      -1.6        1.54 ± 24%  perf-profile.children.cycles-pp.path_openat
      2.50 ±  9%      -1.6        0.93 ± 24%  perf-profile.children.cycles-pp.asm_common_interrupt
      2.49 ±  9%      -1.6        0.92 ± 25%  perf-profile.children.cycles-pp.common_interrupt
      2.62 ± 12%      -1.5        1.08 ± 28%  perf-profile.children.cycles-pp.worker_thread
      2.42 ±  9%      -1.5        0.90 ± 25%  perf-profile.children.cycles-pp.__common_interrupt
      2.42 ±  9%      -1.5        0.90 ± 25%  perf-profile.children.cycles-pp.handle_edge_irq
      2.40 ±  9%      -1.5        0.88 ± 25%  perf-profile.children.cycles-pp.handle_irq_event
      2.39 ±  9%      -1.5        0.88 ± 25%  perf-profile.children.cycles-pp.handle_irq_event_percpu
      2.36 ±  9%      -1.5        0.87 ± 25%  perf-profile.children.cycles-pp.__handle_irq_event_percpu
      3.01 ±  3%      -1.5        1.52 ± 19%  perf-profile.children.cycles-pp.unwind_next_frame
      2.35 ±  9%      -1.5        0.87 ± 25%  perf-profile.children.cycles-pp.nvme_irq
      2.61 ±  6%      -1.4        1.19 ± 24%  perf-profile.children.cycles-pp.try_to_wake_up
      2.22 ±  9%      -1.4        0.82 ± 25%  perf-profile.children.cycles-pp.blk_mq_end_request_batch
      2.14 ± 10%      -1.4        0.79 ± 24%  perf-profile.children.cycles-pp.blk_update_request
      2.60 ±  8%      -1.3        1.27 ± 27%  perf-profile.children.cycles-pp.btrfs_insert_empty_items
      2.73 ± 11%      -1.3        1.40 ± 44%  perf-profile.children.cycles-pp.ret_from_fork
      2.72 ± 11%      -1.3        1.40 ± 44%  perf-profile.children.cycles-pp.kthread
      2.24 ± 12%      -1.3        0.92 ± 30%  perf-profile.children.cycles-pp.process_one_work
      2.34 ±  4%      -1.3        1.05 ± 20%  perf-profile.children.cycles-pp.perf_trace_sched_switch
      2.37 ±  3%      -1.2        1.16 ± 26%  perf-profile.children.cycles-pp.btrfs_create
      1.96 ± 11%      -1.2        0.77 ± 33%  perf-profile.children.cycles-pp.btrfs_work_helper
      1.86 ± 10%      -1.2        0.68 ± 24%  perf-profile.children.cycles-pp.btrfs_end_bio
      1.72 ±  6%      -1.2        0.54 ± 19%  perf-profile.children.cycles-pp.read_extent_buffer
      1.86 ±  4%      -1.1        0.72 ± 23%  perf-profile.children.cycles-pp.folio_wait_bit
      1.73 ±  2%      -1.1        0.62 ± 36%  perf-profile.children.cycles-pp.btrfs_get_32
      1.67 ±  6%      -1.1        0.55 ± 25%  perf-profile.children.cycles-pp.__filemap_fdatawait_range
      1.67 ±  6%      -1.1        0.56 ± 25%  perf-profile.children.cycles-pp.filemap_fdatawait_range
      1.80 ±  4%      -1.1        0.69 ± 22%  perf-profile.children.cycles-pp.io_schedule
      2.12 ±  4%      -1.1        1.03 ± 19%  perf-profile.children.cycles-pp.dequeue_task_fair
      1.72 ±  9%      -1.1        0.65 ± 22%  perf-profile.children.cycles-pp.__wake_up_common
      2.09 ±  4%      -1.1        1.02 ± 19%  perf-profile.children.cycles-pp.dequeue_entity
      1.39 ± 21%      -1.0        0.34 ±113%  perf-profile.children.cycles-pp.btrfs_commit_transaction
      2.95 ±  4%      -1.0        1.92 ±  8%  perf-profile.children.cycles-pp.copy_items
      1.55 ±  6%      -1.0        0.53 ± 25%  perf-profile.children.cycles-pp.folio_wait_writeback
      1.59 ±  9%      -1.0        0.60 ± 22%  perf-profile.children.cycles-pp.btrfs_finish_ordered_io
      1.58 ±  6%      -1.0        0.60 ± 21%  perf-profile.children.cycles-pp.start_ordered_ops
      1.85 ±  6%      -1.0        0.87 ± 24%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      1.52 ±  6%      -1.0        0.56 ± 20%  perf-profile.children.cycles-pp.extent_writepages
      1.52 ±  6%      -1.0        0.56 ± 21%  perf-profile.children.cycles-pp.btrfs_fdatawrite_range
      1.69 ±  7%      -0.9        0.76 ± 25%  perf-profile.children.cycles-pp.ksys_write
      2.08 ±  4%      -0.9        1.16 ± 15%  perf-profile.children.cycles-pp.update_curr
      1.68 ±  7%      -0.9        0.76 ± 26%  perf-profile.children.cycles-pp.vfs_write
      1.59 ±  6%      -0.9        0.68 ± 24%  perf-profile.children.cycles-pp.btrfs_wait_ordered_range
      1.66 ±  7%      -0.9        0.74 ± 26%  perf-profile.children.cycles-pp.new_sync_write
      1.95 ±  4%      -0.9        1.09 ± 15%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      1.55 ±  5%      -0.9        0.70 ± 17%  perf-profile.children.cycles-pp.schedule_idle
      1.22 ±  7%      -0.9        0.36 ± 18%  perf-profile.children.cycles-pp.btrfs_check_node
      1.27 ± 11%      -0.8        0.43 ± 22%  perf-profile.children.cycles-pp.folio_end_writeback
      1.18 ±  2%      -0.8        0.40 ± 22%  perf-profile.children.cycles-pp.copy_extent_buffer_full
      1.19 ±  9%      -0.8        0.41 ± 18%  perf-profile.children.cycles-pp.extent_write_cache_pages
      1.18 ±  2%      -0.8        0.40 ± 22%  perf-profile.children.cycles-pp.copy_page
      1.30 ±  7%      -0.8        0.54 ± 25%  perf-profile.children.cycles-pp.write
      1.20 ±  6%      -0.7        0.49 ± 25%  perf-profile.children.cycles-pp.btrfs_file_write_iter
      1.11 ± 10%      -0.7        0.40 ± 22%  perf-profile.children.cycles-pp.read_block_for_search
      1.19 ±  6%      -0.7        0.49 ± 25%  perf-profile.children.cycles-pp.btrfs_buffered_write
      1.09 ± 11%      -0.7        0.39 ± 24%  perf-profile.children.cycles-pp.folio_wake_bit
      1.01 ± 10%      -0.7        0.34 ± 22%  perf-profile.children.cycles-pp.__extent_writepage
      1.04 ± 11%      -0.7        0.38 ± 24%  perf-profile.children.cycles-pp.wake_page_function
      2.15 ±  3%      -0.6        1.50 ±  6%  perf-profile.children.cycles-pp.btrfs_csum_file_blocks
      1.00 ±  6%      -0.6        0.36 ± 25%  perf-profile.children.cycles-pp.btrfs_add_link
      1.15 ±  7%      -0.6        0.52 ± 18%  perf-profile.children.cycles-pp.__unwind_start
      0.96 ±  6%      -0.6        0.33 ± 19%  perf-profile.children.cycles-pp.find_extent_buffer
      0.96 ±  6%      -0.6        0.34 ± 24%  perf-profile.children.cycles-pp.btrfs_insert_dir_item
      1.12 ± 11%      -0.6        0.50 ± 22%  perf-profile.children.cycles-pp.end_bio_extent_writepage
      1.26 ±  2%      -0.6        0.68 ± 17%  perf-profile.children.cycles-pp.__orc_find
      0.79 ± 11%      -0.6        0.23 ± 22%  perf-profile.children.cycles-pp.writepage_delalloc
      0.80 ±  8%      -0.5        0.26 ± 26%  perf-profile.children.cycles-pp.insert_with_overflow
      0.73 ±  7%      -0.5        0.20 ± 24%  perf-profile.children.cycles-pp.btrfs_reserve_extent
      0.66 ± 12%      -0.5        0.15 ± 33%  perf-profile.children.cycles-pp.end_bio_extent_buffer_writepage
      0.69 ± 11%      -0.5        0.19 ± 25%  perf-profile.children.cycles-pp.btrfs_run_delalloc_range
      1.93 ±  2%      -0.5        1.43 ±  6%  perf-profile.children.cycles-pp.log_csums
      0.68 ± 10%      -0.5        0.18 ± 25%  perf-profile.children.cycles-pp.cow_file_range
      0.77 ±  6%      -0.5        0.28 ± 20%  perf-profile.children.cycles-pp.find_extent_buffer_nolock
      0.67 ±  7%      -0.5        0.18 ± 24%  perf-profile.children.cycles-pp.find_free_extent
      1.02 ±  5%      -0.5        0.55 ± 18%  perf-profile.children.cycles-pp.orc_find
      0.56 ±  8%      -0.4        0.12 ±119%  perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction
      0.66 ±  6%      -0.4        0.23 ± 37%  perf-profile.children.cycles-pp.setup_items_for_insert
      0.71 ± 11%      -0.4        0.28 ± 20%  perf-profile.children.cycles-pp.insert_reserved_file_extent
      0.70 ±  8%      -0.4        0.28 ± 23%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.66 ±  5%      -0.4        0.26 ± 21%  perf-profile.children.cycles-pp.generic_bin_search
      0.67 ±  6%      -0.4        0.26 ± 21%  perf-profile.children.cycles-pp.btrfs_lookup_match_dir
      0.79 ±  3%      -0.4        0.39 ± 25%  perf-profile.children.cycles-pp.perf_callchain_user
      0.62 ±  7%      -0.4        0.23 ± 24%  perf-profile.children.cycles-pp.btrfs_comp_cpu_keys
      0.66 ±  9%      -0.4        0.26 ± 23%  perf-profile.children.cycles-pp.autoremove_wake_function
      0.62 ±  4%      -0.4        0.22 ± 20%  perf-profile.children.cycles-pp.write_one_eb
      0.42 ± 18%      -0.4        0.03 ±103%  perf-profile.children.cycles-pp.__irqentry_text_start
      0.58 ±  5%      -0.4        0.19 ± 28%  perf-profile.children.cycles-pp.check_setget_bounds
      0.75 ±  4%      -0.4        0.37 ± 25%  perf-profile.children.cycles-pp.__get_user_nocheck_8
      1.12 ±  6%      -0.4        0.76 ± 20%  perf-profile.children.cycles-pp.__btrfs_tree_read_lock
      0.66 ±  4%      -0.3        0.31 ± 18%  perf-profile.children.cycles-pp.btrfs_update_root
      0.63 ±  8%      -0.3        0.28 ± 21%  perf-profile.children.cycles-pp.perf_output_sample
      0.89 ±  6%      -0.3        0.55 ± 23%  perf-profile.children.cycles-pp.btrfs_new_inode
      0.78 ±  5%      -0.3        0.44 ± 35%  perf-profile.children.cycles-pp.btrfs_read_lock_root_node
      0.55 ±  6%      -0.3        0.21 ± 22%  perf-profile.children.cycles-pp.btrfs_lookup_dir_item
      0.80 ±  8%      -0.3        0.48 ± 21%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.51 ±  6%      -0.3        0.20 ± 27%  perf-profile.children.cycles-pp.folio_mark_dirty
      0.49 ±  6%      -0.3        0.18 ± 26%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      1.40 ±  3%      -0.3        1.09 ±  3%  perf-profile.children.cycles-pp.btrfs_lookup_csum
      0.61 ±  8%      -0.3        0.31 ± 16%  perf-profile.children.cycles-pp.unwind_get_return_address
      0.47 ± 10%      -0.3        0.16 ± 23%  perf-profile.children.cycles-pp.btrfs_get_64
      0.48 ±  7%      -0.3        0.18 ± 25%  perf-profile.children.cycles-pp.filemap_dirty_folio
      0.69 ±  3%      -0.3        0.39 ± 18%  perf-profile.children.cycles-pp.asm_exc_page_fault
      0.42 ±  9%      -0.3        0.12 ± 25%  perf-profile.children.cycles-pp.down_read
      0.47 ± 10%      -0.3        0.18 ± 25%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.48 ±  5%      -0.3        0.19 ± 24%  perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty
      0.46 ± 12%      -0.3        0.18 ± 23%  perf-profile.children.cycles-pp.csum_tree_block
      0.53 ±  6%      -0.3        0.25 ± 20%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.45 ±  5%      -0.3        0.18 ± 27%  perf-profile.children.cycles-pp.btrfs_start_ordered_extent
      0.56 ±  8%      -0.3        0.29 ± 19%  perf-profile.children.cycles-pp.__kernel_text_address
      0.44 ±  5%      -0.3        0.18 ± 24%  perf-profile.children.cycles-pp.set_extent_buffer_dirty
      0.46 ± 22%      -0.3        0.20 ± 27%  perf-profile.children.cycles-pp.pagecache_get_page
      0.54 ±  5%      -0.3        0.28 ± 26%  perf-profile.children.cycles-pp.btrfs_release_path
      0.45 ± 23%      -0.3        0.19 ± 27%  perf-profile.children.cycles-pp.__filemap_get_folio
      0.42 ± 21%      -0.3        0.16 ± 16%  perf-profile.children.cycles-pp.alloc_extent_buffer
      0.43 ± 13%      -0.3        0.18 ± 22%  perf-profile.children.cycles-pp.btrfs_drop_extents
      0.44 ±  5%      -0.3        0.19 ± 27%  perf-profile.children.cycles-pp.queue_work_on
      0.44 ±  5%      -0.2        0.19 ± 27%  perf-profile.children.cycles-pp.__queue_work
      0.42 ±  7%      -0.2        0.18 ± 21%  perf-profile.children.cycles-pp.perf_output_copy
      0.42 ±  8%      -0.2        0.18 ± 27%  perf-profile.children.cycles-pp.end_extent_writepage
      0.49 ±  9%      -0.2        0.26 ± 18%  perf-profile.children.cycles-pp.kernel_text_address
      0.42 ±  8%      -0.2        0.18 ± 27%  perf-profile.children.cycles-pp.btrfs_mark_ordered_io_finished
      0.38 ± 11%      -0.2        0.15 ± 23%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.91 ±  8%      -0.2        0.68 ± 20%  perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      0.41 ±  9%      -0.2        0.18 ± 21%  perf-profile.children.cycles-pp.memcpy_erms
      0.34 ± 13%      -0.2        0.11 ± 24%  perf-profile.children.cycles-pp.__folio_end_writeback
      0.42 ± 10%      -0.2        0.19 ±  7%  perf-profile.children.cycles-pp.split_leaf
      0.32 ± 10%      -0.2        0.10 ± 13%  perf-profile.children.cycles-pp.btrfs_free_tree_block
      0.32 ±  7%      -0.2        0.11 ± 37%  perf-profile.children.cycles-pp.btrfs_dirty_pages
      0.34 ±  6%      -0.2        0.14 ± 28%  perf-profile.children.cycles-pp.btrfs_lookup
      0.50 ±  6%      -0.2        0.29 ± 19%  perf-profile.children.cycles-pp.write_all_supers
      0.34 ±  6%      -0.2        0.14 ± 28%  perf-profile.children.cycles-pp.btrfs_lookup_dentry
      0.37 ± 11%      -0.2        0.17 ± 27%  perf-profile.children.cycles-pp.copy_page_from_iter_atomic
      0.31 ±  7%      -0.2        0.12 ± 21%  perf-profile.children.cycles-pp.btrfs_check_ref_name_override
      0.35 ±  9%      -0.2        0.16 ± 29%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.36 ± 11%      -0.2        0.16 ± 28%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.36 ± 11%      -0.2        0.16 ± 26%  perf-profile.children.cycles-pp.copyin
      0.36 ± 11%      -0.2        0.18 ± 18%  perf-profile.children.cycles-pp.btrfs_map_bio
      0.22 ± 13%      -0.2        0.04 ±106%  perf-profile.children.cycles-pp.check_dir_item
      0.41 ±  9%      -0.2        0.23 ± 40%  perf-profile.children.cycles-pp.__libc_write
      0.30 ± 17%      -0.2        0.12 ± 29%  perf-profile.children.cycles-pp.btrfs_lookup_file_extent
      0.22 ±  7%      -0.2        0.04 ±100%  perf-profile.children.cycles-pp.btrfs_lookup_csums_range
      0.41 ±  9%      -0.2        0.23 ± 40%  perf-profile.children.cycles-pp.generic_file_write_iter
      0.41 ±  9%      -0.2        0.23 ± 40%  perf-profile.children.cycles-pp.__generic_file_write_iter
      0.41 ±  9%      -0.2        0.23 ± 40%  perf-profile.children.cycles-pp.generic_perform_write
      0.33 ±  9%      -0.2        0.16 ± 30%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.32 ± 10%      -0.2        0.15 ± 17%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.31 ± 11%      -0.2        0.14 ± 24%  perf-profile.children.cycles-pp.btrfs_submit_data_bio
      0.29 ±  7%      -0.2        0.12 ± 32%  perf-profile.children.cycles-pp.prepare_pages
      0.28 ± 10%      -0.2        0.10 ± 23%  perf-profile.children.cycles-pp.__folio_mark_dirty
      0.38 ± 12%      -0.2        0.21 ± 20%  perf-profile.children.cycles-pp.btrfs_next_old_leaf
      0.25 ±  5%      -0.2        0.08 ± 23%  perf-profile.children.cycles-pp.__folio_start_writeback
      0.26 ± 12%      -0.2        0.09 ± 30%  perf-profile.children.cycles-pp.check_extent_data_item
      0.30 ±  6%      -0.2        0.14 ± 31%  perf-profile.children.cycles-pp.btrfs_update_inode
      0.22 ± 21%      -0.2        0.06 ± 16%  perf-profile.children.cycles-pp.memmove
      0.32 ± 18%      -0.2        0.16 ± 18%  perf-profile.children.cycles-pp.__module_address
      0.25 ±  7%      -0.2        0.10 ± 15%  perf-profile.children.cycles-pp.pin_down_extent
      0.22 ± 16%      -0.2        0.07 ± 12%  perf-profile.children.cycles-pp.__reserve_bytes
      0.22 ±  8%      -0.2        0.07 ± 58%  perf-profile.children.cycles-pp.btrfs_set_token_32
      0.30 ±  7%      -0.1        0.16 ± 24%  perf-profile.children.cycles-pp.btrfs_search_forward
      0.26 ±  6%      -0.1        0.12 ± 32%  perf-profile.children.cycles-pp.btrfs_delayed_update_inode
      0.22 ± 18%      -0.1        0.08 ± 14%  perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes
      0.29 ± 11%      -0.1        0.14 ± 25%  perf-profile.children.cycles-pp.submit_bio_noacct
      0.20 ± 12%      -0.1        0.06 ± 26%  perf-profile.children.cycles-pp.push_leaf_right
      0.20 ± 31%      -0.1        0.06 ± 49%  perf-profile.children.cycles-pp.filemap_add_folio
      0.26 ± 11%      -0.1        0.12 ± 28%  perf-profile.children.cycles-pp.enqueue_entity
      0.18 ± 23%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.mark_extent_buffer_accessed
      0.23 ± 13%      -0.1        0.09 ± 26%  perf-profile.children.cycles-pp.btrfs_end_super_write
      0.28 ± 10%      -0.1        0.14 ± 25%  perf-profile.children.cycles-pp.blk_mq_submit_bio
      0.19 ± 12%      -0.1        0.05 ± 51%  perf-profile.children.cycles-pp.memcpy_extent_buffer
      0.17 ± 12%      -0.1        0.04 ±101%  perf-profile.children.cycles-pp.btrfs_get_token_32
      0.19 ± 30%      -0.1        0.05 ± 49%  perf-profile.children.cycles-pp.__filemap_add_folio
      0.19 ± 14%      -0.1        0.06 ± 51%  perf-profile.children.cycles-pp.btrfs_root_node
      0.29 ± 13%      -0.1        0.16 ± 33%  perf-profile.children.cycles-pp.finish_task_switch
      0.24 ± 14%      -0.1        0.11 ± 22%  perf-profile.children.cycles-pp.btrfs_write_check
      0.22 ±  5%      -0.1        0.10 ± 15%  perf-profile.children.cycles-pp.stack_access_ok
      0.21 ±  7%      -0.1        0.09 ± 24%  perf-profile.children.cycles-pp.start_transaction
      0.17 ±  2%      -0.1        0.05 ± 73%  perf-profile.children.cycles-pp.folio_clear_dirty_for_io
      0.16 ± 27%      -0.1        0.04 ±101%  perf-profile.children.cycles-pp.btrfs_lookup_inode
      0.16 ± 20%      -0.1        0.03 ±103%  perf-profile.children.cycles-pp.block_group_cache_tree_search
      0.20 ± 16%      -0.1        0.08 ± 21%  perf-profile.children.cycles-pp.xas_load
      0.30 ± 12%      -0.1        0.17 ± 22%  perf-profile.children.cycles-pp.find_next_csum_offset
      0.22 ± 12%      -0.1        0.10 ± 21%  perf-profile.children.cycles-pp.dentry_needs_remove_privs
      0.22 ± 14%      -0.1        0.10 ± 21%  perf-profile.children.cycles-pp.file_remove_privs
      0.19 ± 10%      -0.1        0.07 ± 28%  perf-profile.children.cycles-pp.btrfs_copy_from_user
      0.24 ±  9%      -0.1        0.12 ± 33%  perf-profile.children.cycles-pp.__poll
      0.24 ±  9%      -0.1        0.12 ± 33%  perf-profile.children.cycles-pp.__x64_sys_poll
      0.24 ±  9%      -0.1        0.12 ± 33%  perf-profile.children.cycles-pp.do_sys_poll
      0.20 ± 11%      -0.1        0.09 ± 32%  perf-profile.children.cycles-pp.free_extent_buffer
      0.21 ± 13%      -0.1        0.09 ± 21%  perf-profile.children.cycles-pp.cap_inode_need_killpriv
      0.14 ± 11%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.find_get_pages_range_tag
      0.24 ± 20%      -0.1        0.13 ± 18%  perf-profile.children.cycles-pp.is_module_text_address
      0.21 ± 13%      -0.1        0.10 ± 22%  perf-profile.children.cycles-pp.security_inode_need_killpriv
      0.15 ± 19%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.__push_leaf_right
      0.18 ±  5%      -0.1        0.07 ± 46%  perf-profile.children.cycles-pp.down_write
      0.14 ± 17%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.read_tree_block
      0.20 ± 13%      -0.1        0.09 ± 20%  perf-profile.children.cycles-pp.__vfs_getxattr
      0.20 ± 10%      -0.1        0.09 ± 14%  perf-profile.children.cycles-pp.submit_extent_page
      0.15 ± 12%      -0.1        0.04 ± 72%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      0.16 ± 12%      -0.1        0.04 ± 75%  perf-profile.children.cycles-pp.nvme_queue_rq
      0.14 ± 19%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.btrfs_read_node_slot
      0.22 ± 21%      -0.1        0.11 ± 15%  perf-profile.children.cycles-pp.__module_text_address
      0.16 ± 13%      -0.1        0.05 ± 74%  perf-profile.children.cycles-pp.blk_mq_flush_plug_list
      0.16 ± 13%      -0.1        0.05 ± 74%  perf-profile.children.cycles-pp.blk_flush_plug
      0.16 ± 12%      -0.1        0.06 ± 51%  perf-profile.children.cycles-pp.__blk_mq_try_issue_directly
      0.23 ±  8%      -0.1        0.12 ± 44%  perf-profile.children.cycles-pp.btrfs_free_path
      0.17 ± 17%      -0.1        0.07 ± 53%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.23 ±  9%      -0.1        0.13 ± 27%  perf-profile.children.cycles-pp.update_load_avg
      0.20 ± 13%      -0.1        0.10 ± 26%  perf-profile.children.cycles-pp.__extent_writepage_io
      0.21 ±  7%      -0.1        0.10 ± 19%  perf-profile.children.cycles-pp.mkdir
      0.15 ± 13%      -0.1        0.05 ± 75%  perf-profile.children.cycles-pp.blk_mq_request_issue_directly
      0.13 ±  7%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.inode_tree_add
      0.17 ±  4%      -0.1        0.07 ± 17%  perf-profile.children.cycles-pp.__might_resched
      0.18 ± 13%      -0.1        0.08 ± 21%  perf-profile.children.cycles-pp.btrfs_getxattr
      0.14 ±  9%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.btrfs_csum_one_bio
      0.14 ± 15%      -0.1        0.04 ± 72%  perf-profile.children.cycles-pp.alloc_extent_state
      0.16 ± 10%      -0.1        0.07 ± 25%  perf-profile.children.cycles-pp.blk_finish_plug
      0.12 ± 10%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__crc32c_pcl_intel_finup
      0.12 ± 27%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.btrfs_insert_delayed_dir_index
      0.15 ± 13%      -0.1        0.06 ± 46%  perf-profile.children.cycles-pp.__perf_event_header__init_id
      0.19 ±  6%      -0.1        0.10 ± 19%  perf-profile.children.cycles-pp.__x64_sys_mkdir
      0.13 ± 17%      -0.1        0.04 ± 75%  perf-profile.children.cycles-pp.find_free_extent_clustered
      0.16 ±  3%      -0.1        0.08 ± 17%  perf-profile.children.cycles-pp.insert_state
      0.12 ±  9%      -0.1        0.03 ±103%  perf-profile.children.cycles-pp.btrfs_get_or_create_delayed_node
      0.18 ± 14%      -0.1        0.09 ± 11%  perf-profile.children.cycles-pp.__close
      0.11 ± 31%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
      0.12 ±  8%      -0.1        0.03 ±105%  perf-profile.children.cycles-pp.btrfs_leaf_free_space
      0.19 ±  8%      -0.1        0.10 ± 21%  perf-profile.children.cycles-pp.mutex_lock
      0.18 ±  7%      -0.1        0.10 ± 19%  perf-profile.children.cycles-pp.release_extent_buffer
      0.15 ± 13%      -0.1        0.07 ± 20%  perf-profile.children.cycles-pp.___slab_alloc
      0.14 ± 17%      -0.1        0.06 ± 16%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.15 ± 14%      -0.1        0.07 ± 23%  perf-profile.children.cycles-pp.__slab_alloc
      0.15 ± 14%      -0.1        0.07 ± 18%  perf-profile.children.cycles-pp.btrfs_lookup_xattr
      0.11 ±  5%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.___perf_sw_event
      0.14 ±  4%      -0.1        0.06 ± 25%  perf-profile.children.cycles-pp.set_next_entity
      0.13 ±  7%      -0.1        0.05 ± 47%  perf-profile.children.cycles-pp.memzero_extent_buffer
      0.11 ± 15%      -0.1        0.03 ±102%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.16 ±  8%      -0.1        0.08 ± 17%  perf-profile.children.cycles-pp.do_mkdirat
      0.16 ± 10%      -0.1        0.09 ±  8%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.12 ± 23%      -0.1        0.04 ± 72%  perf-profile.children.cycles-pp.btrfs_alloc_from_cluster
      0.19 ±  7%      -0.1        0.11 ± 30%  perf-profile.children.cycles-pp.__etree_search
      0.12 ± 12%      -0.1        0.04 ±101%  perf-profile.children.cycles-pp.new_inode
      0.13 ± 18%      -0.1        0.06 ± 18%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.14 ± 10%      -0.1        0.07 ± 26%  perf-profile.children.cycles-pp.kmem_cache_free
      0.14 ± 19%      -0.1        0.06 ± 23%  perf-profile.children.cycles-pp.__alloc_pages
      0.15 ± 10%      -0.1        0.08 ± 12%  perf-profile.children.cycles-pp.filename_create
      0.10 ± 11%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.dput
      0.26 ±  9%      -0.1        0.19 ± 11%  perf-profile.children.cycles-pp.exc_page_fault
      0.10 ±  7%      -0.1        0.02 ± 99%  perf-profile.children.cycles-pp.mutex_unlock
      0.10 ±  8%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.allocate_slab
      0.11 ± 15%      -0.1        0.04 ± 73%  perf-profile.children.cycles-pp.kernelmode_fixup_or_oops
      0.15 ±  9%      -0.1        0.08 ± 39%  perf-profile.children.cycles-pp.perf_poll
      0.10 ± 10%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.btrfs_alloc_reserved_file_extent
      0.15 ± 11%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.10 ±  8%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__cond_resched
      0.12 ± 11%      -0.1        0.05 ± 45%  perf-profile.children.cycles-pp.__vsprintf_chk
      0.20 ± 13%      -0.1        0.13 ± 16%  perf-profile.children.cycles-pp.unlock_up
      0.14 ± 14%      -0.1        0.07 ± 21%  perf-profile.children.cycles-pp.write_dev_supers
      0.12 ±  9%      -0.1        0.05 ± 47%  perf-profile.children.cycles-pp.filename_parentat
      0.10 ± 10%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.btrfs_add_delayed_data_ref
      0.10 ± 12%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.shmem_getpage_gfp
      0.10 ± 12%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.shmem_write_begin
      0.11 ± 15%      -0.1        0.05 ± 76%  perf-profile.children.cycles-pp.new_inode_pseudo
      0.11 ±  9%      -0.1        0.05 ± 47%  perf-profile.children.cycles-pp.path_parentat
      0.10 ± 17%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.09 ± 13%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.clear_state_bit
      0.23 ±  5%      -0.1        0.17 ± 14%  perf-profile.children.cycles-pp.btrfs_log_all_xattrs
      0.10 ± 13%      -0.1        0.05 ± 75%  perf-profile.children.cycles-pp.alloc_inode
      0.08 ± 17%      -0.1        0.02 ± 99%  perf-profile.children.cycles-pp.vfprintf
      0.09 ± 15%      -0.1        0.04 ± 75%  perf-profile.children.cycles-pp.up_write
      0.12 ± 14%      -0.1        0.06 ±  7%  perf-profile.children.cycles-pp.task_work_run
      0.10 ± 11%      -0.0        0.06 ± 13%  perf-profile.children.cycles-pp.__fput
      0.08 ± 13%      -0.0        0.04 ± 71%  perf-profile.children.cycles-pp.do_open
      0.11 ± 22%      -0.0        0.07 ± 11%  perf-profile.children.cycles-pp.push_leaf_left
      0.14 ± 10%      -0.0        0.11 ± 10%  perf-profile.children.cycles-pp.link_path_walk
      0.18 ±  9%      +0.1        0.24 ±  9%  perf-profile.children.cycles-pp.task_tick_fair
      0.95 ± 14%      +0.3        1.24 ± 12%  perf-profile.children.cycles-pp.scheduler_tick
      0.62 ±  6%      +0.4        1.02 ± 16%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      6.31 ±  4%      +1.1        7.38 ±  3%  perf-profile.children.cycles-pp.btrfs_write_marked_extents
      6.84 ±  3%      +1.3        8.16 ±  5%  perf-profile.children.cycles-pp.btrfs_log_inode
      0.95 ± 11%      +1.4        2.30 ± 18%  perf-profile.children.cycles-pp.btrfs_alloc_tree_block
      0.50 ±  6%      +1.6        2.11 ± 20%  perf-profile.children.cycles-pp.set_extent_bit
      0.21 ±  9%      +2.1        2.28 ± 10%  perf-profile.children.cycles-pp.__clear_extent_bit
      0.16 ±  5%      +2.1        2.26 ± 11%  perf-profile.children.cycles-pp.clear_extent_bit
      3.14 ±  3%      +2.2        5.30 ±  9%  perf-profile.children.cycles-pp.btrfs_cow_block
      3.12 ±  3%      +2.2        5.29 ±  9%  perf-profile.children.cycles-pp.__btrfs_cow_block
      0.00            +2.3        2.32 ± 10%  perf-profile.children.cycles-pp.delete_tree_block
      3.43 ±  3%      +2.5        5.93 ± 13%  perf-profile.children.cycles-pp.mutex_spin_on_owner
      2.89 ±  3%      +2.8        5.72 ±  7%  perf-profile.children.cycles-pp.btrfs_truncate_inode_items
      2.89 ±  3%      +2.8        5.72 ±  7%  perf-profile.children.cycles-pp.truncate_inode_items
      2.35 ±  4%      +3.3        5.64 ± 17%  perf-profile.children.cycles-pp.osq_lock
      1.58 ±  6%      +3.3        4.90 ± 11%  perf-profile.children.cycles-pp._raw_spin_lock
      0.30 ± 16%      +3.9        4.20 ± 15%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.68 ±  6%      +4.6        5.31 ± 14%  perf-profile.children.cycles-pp.btrfs_wait_tree_log_extents
      0.68 ±  6%      +4.6        5.31 ± 14%  perf-profile.children.cycles-pp.__btrfs_wait_marked_extents
     12.75 ±  3%      +5.5       18.25 ±  9%  perf-profile.children.cycles-pp.btrfs_sync_log
     32.39 ±  3%      +5.6       38.03 ±  5%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     32.38 ±  3%      +5.6       38.02 ±  5%  perf-profile.children.cycles-pp.do_syscall_64
      5.70 ±  3%      +5.7       11.38 ± 15%  perf-profile.children.cycles-pp.__mutex_lock
      8.80 ±  3%      +6.2       15.01 ±  8%  perf-profile.children.cycles-pp.btrfs_log_dentry_safe
      8.79 ±  3%      +6.2       15.00 ±  8%  perf-profile.children.cycles-pp.btrfs_log_inode_parent
      0.12 ± 32%      +8.2        8.32 ± 16%  perf-profile.children.cycles-pp.rb_next
     26.42 ±  3%      +8.4       34.83 ±  7%  perf-profile.children.cycles-pp.fsync
     26.30 ±  3%      +8.5       34.76 ±  7%  perf-profile.children.cycles-pp.btrfs_sync_file
     26.30 ±  3%      +8.5       34.77 ±  7%  perf-profile.children.cycles-pp.__x64_sys_fsync
     26.30 ±  3%      +8.5       34.77 ±  7%  perf-profile.children.cycles-pp.do_fsync
      0.09 ± 10%     +10.3       10.39 ± 14%  perf-profile.children.cycles-pp.find_first_extent_bit
      0.02 ±142%     +10.4       10.38 ± 14%  perf-profile.children.cycles-pp.find_first_extent_bit_state
      4.06 ±  5%      -3.3        0.78 ± 41%  perf-profile.self.cycles-pp.poll_idle
      1.64 ±  5%      -1.1        0.52 ± 22%  perf-profile.self.cycles-pp.read_extent_buffer
      1.32 ±  2%      -0.9        0.45 ± 32%  perf-profile.self.cycles-pp.btrfs_get_32
      1.15 ±  3%      -0.8        0.39 ± 22%  perf-profile.self.cycles-pp.copy_page
      1.36 ±  4%      -0.6        0.71 ± 18%  perf-profile.self.cycles-pp._raw_spin_lock
      1.26 ±  2%      -0.6        0.68 ± 17%  perf-profile.self.cycles-pp.__orc_find
      1.00 ±  9%      -0.5        0.47 ± 23%  perf-profile.self.cycles-pp.unwind_next_frame
      0.63 ±  5%      -0.4        0.22 ± 25%  perf-profile.self.cycles-pp.check_leaf
      0.58 ±  8%      -0.4        0.21 ± 23%  perf-profile.self.cycles-pp.btrfs_comp_cpu_keys
      0.52 ±  4%      -0.3        0.17 ± 28%  perf-profile.self.cycles-pp.check_setget_bounds
      0.40 ±  9%      -0.3        0.14 ± 19%  perf-profile.self.cycles-pp.find_extent_buffer_nolock
      0.68 ±  9%      -0.3        0.43 ± 23%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.35 ± 10%      -0.2        0.10 ± 27%  perf-profile.self.cycles-pp.down_read
      0.42 ±  6%      -0.2        0.20 ± 27%  perf-profile.self.cycles-pp.__get_user_nocheck_8
      0.40 ±  9%      -0.2        0.17 ± 24%  perf-profile.self.cycles-pp.memcpy_erms
      0.37 ± 11%      -0.2        0.15 ± 23%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.34 ±  6%      -0.2        0.13 ± 26%  perf-profile.self.cycles-pp.btrfs_get_64
      0.35 ± 11%      -0.2        0.16 ± 28%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.29 ±  8%      -0.2        0.12 ± 22%  perf-profile.self.cycles-pp.generic_bin_search
      0.28 ±  8%      -0.2        0.11 ± 18%  perf-profile.self.cycles-pp.__schedule
      0.35 ±  9%      -0.2        0.19 ± 16%  perf-profile.self.cycles-pp.orc_find
      0.31 ± 19%      -0.2        0.16 ± 17%  perf-profile.self.cycles-pp.__module_address
      0.21 ± 11%      -0.2        0.06 ± 18%  perf-profile.self.cycles-pp.memmove
      0.25 ±  8%      -0.1        0.11 ± 29%  perf-profile.self.cycles-pp.btrfs_search_slot
      0.16 ±  6%      -0.1        0.04 ±101%  perf-profile.self.cycles-pp.__btrfs_cow_block
      0.16 ± 15%      -0.1        0.04 ± 77%  perf-profile.self.cycles-pp.btrfs_set_token_32
      0.21 ±  4%      -0.1        0.09 ± 16%  perf-profile.self.cycles-pp.stack_access_ok
      0.18 ±  7%      -0.1        0.06 ± 52%  perf-profile.self.cycles-pp.btrfs_root_node
      0.14 ±  9%      -0.1        0.03 ±101%  perf-profile.self.cycles-pp.btrfs_get_token_32
      0.21 ±  5%      -0.1        0.11 ± 20%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.20 ±  8%      -0.1        0.10 ± 23%  perf-profile.self.cycles-pp.perf_callchain_kernel
      0.17 ±  5%      -0.1        0.07 ± 18%  perf-profile.self.cycles-pp.__might_resched
      0.16 ± 17%      -0.1        0.07 ± 21%  perf-profile.self.cycles-pp.xas_load
      0.14 ±  8%      -0.1        0.06 ± 46%  perf-profile.self.cycles-pp.down_write
      0.14 ±  5%      -0.1        0.05 ± 45%  perf-profile.self.cycles-pp.perf_output_copy
      0.12 ±  6%      -0.1        0.04 ±101%  perf-profile.self.cycles-pp.kmem_cache_free
      0.12 ±  8%      -0.1        0.04 ± 72%  perf-profile.self.cycles-pp.memzero_extent_buffer
      0.10 ±  7%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.___perf_sw_event
      0.10 ±  7%      -0.1        0.02 ± 99%  perf-profile.self.cycles-pp.inode_tree_add
      0.10 ± 13%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.kernel_text_address
      0.17 ±  8%      -0.1        0.10 ± 27%  perf-profile.self.cycles-pp.__etree_search
      0.14 ±  6%      -0.1        0.08 ± 24%  perf-profile.self.cycles-pp.mutex_lock
      0.09 ± 15%      -0.1        0.03 ±103%  perf-profile.self.cycles-pp.up_write
      0.08 ± 13%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.free_extent_buffer
      0.07 ± 15%      -0.0        0.04 ± 72%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.06 ± 32%      +0.0        0.11 ± 39%  perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
      0.14 ± 18%      +0.1        0.20 ± 15%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.58 ±  7%      +0.4        0.99 ± 16%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      0.00            +2.1        2.09 ± 12%  perf-profile.self.cycles-pp.find_first_extent_bit_state
      3.38 ±  3%      +2.5        5.86 ± 13%  perf-profile.self.cycles-pp.mutex_spin_on_owner
      2.31 ±  4%      +3.3        5.59 ± 17%  perf-profile.self.cycles-pp.osq_lock
      0.30 ± 15%      +3.8        4.08 ± 15%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      0.11 ± 32%      +7.9        8.04 ± 16%  perf-profile.self.cycles-pp.rb_next


***************************************************************************************************
lkp-csl-2ap4: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_directories/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
  gcc-9/performance/1SSD/9B/btrfs/8/x86_64-rhel-8.3/16d/256fpd/4/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap4/16G/fsmark/0x5003006

commit: 
  dd503c2d5d ("btrfs: remove write and wait of struct walk_control")
  1a61b300c0 ("btrfs: fix log tree cleanup after a transaction abort")

dd503c2d5db4f864 1a61b300c09b1d034534372349e 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   2244545           +22.9%    2758277        fsmark.app_overhead
     13249 ±  2%     -79.6%       2697        fsmark.files_per_sec
    336.80 ±  2%    +368.8%       1578        fsmark.time.elapsed_time
    336.80 ±  2%    +368.8%       1578        fsmark.time.elapsed_time.max
  2.97e+08 ±  2%      +3.5%  3.073e+08        fsmark.time.file_system_outputs
      1518 ± 14%    +276.6%       5717 ±  2%  fsmark.time.involuntary_context_switches
    150.83           +58.9%     239.67        fsmark.time.percent_of_cpu_this_job_got
    495.22 ±  4%    +661.6%       3771        fsmark.time.system_time
  10447820           -10.8%    9322318        fsmark.time.voluntary_context_switches
  6.28e+10 ±  2%    +365.7%  2.924e+11        cpuidle..time
 1.269e+08 ± 20%    +302.3%  5.104e+08 ± 20%  cpuidle..usage
  57547330 ± 22%    +335.0%  2.504e+08 ± 25%  turbostat.IRQ
     84.94 ±  2%    -100.0%       0.00        turbostat.PkgWatt
    386.64 ±  2%    +321.7%       1630        uptime.boot
     71228 ±  2%    +324.3%     302205        uptime.idle
      0.15 ±  4%      -0.1        0.02 ±  3%  mpstat.cpu.all.iowait%
      0.82 ±  5%      +0.5        1.27        mpstat.cpu.all.sys%
      0.04            -0.0        0.02 ±  4%  mpstat.cpu.all.usr%
    106253 ± 69%   +1076.7%    1250289 ± 52%  numa-numastat.node1.local_node
    190300 ± 39%    +602.7%    1337292 ± 49%  numa-numastat.node1.numa_hit
    216240 ± 82%    +747.8%    1833203 ±136%  numa-numastat.node3.local_node
    294059 ± 53%    +547.5%    1903933 ±129%  numa-numastat.node3.numa_hit
    411999           -77.6%      92286        vmstat.io.bo
  26486798           -28.0%   19073084        vmstat.memory.cache
      1.00          +100.0%       2.00        vmstat.procs.r
     67089 ±  2%     -78.0%      14778        vmstat.system.cs
      9672 ±  7%     -15.3%       8190 ± 13%  numa-meminfo.node0.KernelStack
      7037 ±  5%     -11.6%       6221 ±  7%  numa-meminfo.node1.KernelStack
      2525 ±152%     -98.5%      38.17 ± 15%  numa-meminfo.node2.Mapped
      8280 ± 32%   +9252.2%     774412 ±219%  numa-meminfo.node3.Active
      7168 ±  8%    +106.4%      14799 ± 35%  numa-meminfo.node3.Active(anon)
     18538 ± 46%   +2914.9%     558907 ±209%  numa-meminfo.node3.KReclaimable
     18538 ± 46%   +2914.9%     558907 ±209%  numa-meminfo.node3.SReclaimable
      9679 ±  8%     -15.4%       8187 ± 13%  numa-vmstat.node0.nr_kernel_stack
      7039 ±  5%     -11.6%       6222 ±  7%  numa-vmstat.node1.nr_kernel_stack
      1796 ±  8%    +106.0%       3700 ± 35%  numa-vmstat.node3.nr_active_anon
      4640 ± 46%   +2912.0%     139768 ±209%  numa-vmstat.node3.nr_slab_reclaimable
      1796 ±  8%    +106.0%       3700 ± 35%  numa-vmstat.node3.nr_zone_active_anon
    534483 ± 15%    +223.9%    1731211 ±107%  numa-vmstat.node3.numa_hit
    430615 ± 22%    +280.3%    1637437 ±116%  numa-vmstat.node3.numa_local
  11415411 ±  2%     -60.8%    4476212 ±  3%  meminfo.Active
     12176 ±  3%    +123.3%      27193 ±  2%  meminfo.Active(anon)
  11403234 ±  2%     -61.0%    4449019 ±  3%  meminfo.Active(file)
  23361738           -32.3%   15805338        meminfo.Cached
    272329           -14.2%     233545        meminfo.Dirty
     30627           -11.2%      27204        meminfo.KernelStack
  29731200           -26.5%   21846541        meminfo.Memused
     37689 ±  2%     +26.7%      47741        meminfo.Shmem
  30540485           -27.9%   22026958        meminfo.max_used_kB
      3038 ±  3%    +123.7%       6797 ±  2%  proc-vmstat.nr_active_anon
   2850306 ±  2%     -61.0%    1112326 ±  3%  proc-vmstat.nr_active_file
     79182            -3.2%      76623        proc-vmstat.nr_anon_pages
  37250006 ±  2%      +3.7%   38642606        proc-vmstat.nr_dirtied
     68085           -14.2%      58414        proc-vmstat.nr_dirty
   5839686           -32.3%    3951870        proc-vmstat.nr_file_pages
  41996583            +4.7%   43966332        proc-vmstat.nr_free_pages
     85461            -4.5%      81650        proc-vmstat.nr_inactive_anon
   2338534            -6.5%    2186147        proc-vmstat.nr_inactive_file
     30634           -11.2%      27203        proc-vmstat.nr_kernel_stack
     10032            -7.9%       9243        proc-vmstat.nr_mapped
      1062            -6.9%     989.17        proc-vmstat.nr_page_table_pages
      9335           +27.8%      11928        proc-vmstat.nr_shmem
    800757            +2.3%     819391        proc-vmstat.nr_slab_reclaimable
    369020            -4.6%     352061        proc-vmstat.nr_slab_unreclaimable
  37248723 ±  2%      +3.7%   38639214        proc-vmstat.nr_written
      3038 ±  3%    +123.7%       6797 ±  2%  proc-vmstat.nr_zone_active_anon
   2850306 ±  2%     -61.0%    1112326 ±  3%  proc-vmstat.nr_zone_active_file
     85461            -4.5%      81650        proc-vmstat.nr_zone_inactive_anon
   2338534            -6.5%    2186147        proc-vmstat.nr_zone_inactive_file
     68163           -14.2%      58457        proc-vmstat.nr_zone_write_pending
  10406307            +5.5%   10978428        proc-vmstat.numa_hit
  10147588            +5.6%   10719407        proc-vmstat.numa_local
    318544 ±  7%     +25.8%     400574 ±  4%  proc-vmstat.numa_pte_updates
   2820943 ±  4%     -61.3%    1091827 ±  8%  proc-vmstat.pgactivate
  10418164            +6.0%   11038540        proc-vmstat.pgalloc_normal
   1576108          +290.3%    6151439        proc-vmstat.pgfault
 1.402e+08 ±  2%      +4.1%   1.46e+08        proc-vmstat.pgpgout
     86238          +305.7%     349864        proc-vmstat.pgreuse
     18.60 ± 50%    +137.4%      44.17 ± 31%  perf-stat.i.MPKI
 1.227e+09 ±  2%     -13.9%  1.056e+09 ±  3%  perf-stat.i.branch-instructions
     12.58 ± 46%      -9.6        2.96 ±  7%  perf-stat.i.cache-miss-rate%
  10514212 ± 10%     -58.0%    4416388 ± 36%  perf-stat.i.cache-misses
     67622 ±  2%     -78.1%      14779        perf-stat.i.context-switches
      1.97 ± 13%     +66.7%       3.28 ± 12%  perf-stat.i.cpi
    202.44            -4.1%     194.22        perf-stat.i.cpu-migrations
      1259 ±  6%    +227.7%       4126 ± 35%  perf-stat.i.cycles-between-cache-misses
  1.66e+09 ±  2%     -30.5%  1.153e+09 ±  3%  perf-stat.i.dTLB-loads
 8.328e+08 ±  2%     -54.2%  3.818e+08 ±  5%  perf-stat.i.dTLB-stores
   2445823 ±  6%     -38.7%    1499909 ±  9%  perf-stat.i.iTLB-load-misses
 6.241e+09 ±  2%     -30.4%  4.344e+09 ±  4%  perf-stat.i.instructions
      0.52 ± 13%     -38.9%       0.32 ± 12%  perf-stat.i.ipc
      1.16 ±  2%     -76.8%       0.27 ± 13%  perf-stat.i.major-faults
     19.38 ±  2%     -27.4%      14.07        perf-stat.i.metric.M/sec
      4223           -11.2%       3751        perf-stat.i.minor-faults
     34.13 ± 25%     +18.0       52.09 ±  9%  perf-stat.i.node-load-miss-rate%
   1032812 ± 50%     -61.0%     403177 ± 20%  perf-stat.i.node-load-misses
   1813182 ±  7%     -75.5%     443843 ±  7%  perf-stat.i.node-loads
    379204 ± 57%     -63.8%     137132 ± 13%  perf-stat.i.node-store-misses
    842872 ± 14%     -72.9%     228776 ±  8%  perf-stat.i.node-stores
      4224           -11.2%       3751        perf-stat.i.page-faults
     18.27 ± 49%    +133.0%      42.55 ± 31%  perf-stat.overall.MPKI
     11.65 ± 43%      -9.3        2.36 ±  8%  perf-stat.overall.cache-miss-rate%
      1.94 ± 13%     +65.0%       3.20 ± 12%  perf-stat.overall.cpi
      1149 ±  7%    +203.0%       3483 ± 28%  perf-stat.overall.cycles-between-cache-misses
      0.53 ± 13%     -39.5%       0.32 ± 12%  perf-stat.overall.ipc
 1.224e+09 ±  2%     -13.7%  1.056e+09 ±  3%  perf-stat.ps.branch-instructions
  10484718 ± 10%     -57.9%    4413301 ± 36%  perf-stat.ps.cache-misses
     67413 ±  2%     -78.1%      14762        perf-stat.ps.context-switches
    201.83            -3.8%     194.11        perf-stat.ps.cpu-migrations
 1.655e+09 ±  2%     -30.4%  1.152e+09 ±  3%  perf-stat.ps.dTLB-loads
 8.303e+08 ±  2%     -54.1%  3.815e+08 ±  5%  perf-stat.ps.dTLB-stores
   2438383 ±  6%     -38.5%    1498800 ±  9%  perf-stat.ps.iTLB-load-misses
 6.222e+09 ±  2%     -30.2%  4.341e+09 ±  4%  perf-stat.ps.instructions
      1.16 ±  2%     -76.7%       0.27 ± 13%  perf-stat.ps.major-faults
      4207           -10.9%       3748        perf-stat.ps.minor-faults
   1029887 ± 50%     -60.9%     402840 ± 20%  perf-stat.ps.node-load-misses
   1808344 ±  7%     -75.5%     443539 ±  7%  perf-stat.ps.node-loads
    378187 ± 57%     -63.8%     137029 ± 13%  perf-stat.ps.node-store-misses
    840484 ± 14%     -72.8%     228574 ±  8%  perf-stat.ps.node-stores
      4208           -10.9%       3748        perf-stat.ps.page-faults
 2.104e+12 ±  4%    +226.3%  6.866e+12 ±  4%  perf-stat.total.instructions
     64.88 ±  4%     -11.1       53.82 ±  4%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     64.38 ±  4%     -10.8       53.60 ±  4%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     64.38 ±  4%     -10.8       53.60 ±  4%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     64.34 ±  4%     -10.8       53.57 ±  4%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     58.96 ±  5%      -9.0       49.92 ±  5%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     58.20 ±  5%      -8.9       49.28 ±  5%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      5.66 ± 10%      -4.9        0.72 ± 10%  perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents
     39.59 ±  9%      -4.7       34.85 ±  8%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      5.39 ±  9%      -4.7        0.72 ±  9%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
      5.39 ±  9%      -4.7        0.72 ±  9%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
      5.37 ±  9%      -4.7        0.72 ±  9%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log
      4.40 ±  9%      -4.1        0.29 ±100%  perf-profile.calltrace.cycles-pp.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc
      4.40 ±  9%      -4.0        0.37 ± 71%  perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range
      4.61 ± 11%      -3.9        0.66 ± 12%  perf-profile.calltrace.cycles-pp.open64
      4.59 ± 11%      -3.9        0.66 ± 11%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.open64
      4.59 ± 10%      -3.9        0.66 ± 11%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
      4.58 ± 10%      -3.9        0.66 ± 11%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
      4.57 ± 10%      -3.9        0.66 ± 11%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
      4.50 ± 10%      -3.9        0.65 ± 11%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.49 ± 10%      -3.8        0.65 ± 11%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      3.40 ± 10%      -3.1        0.26 ±100%  perf-profile.calltrace.cycles-pp.btrfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
      1.38 ± 19%      -1.1        0.26 ±100%  perf-profile.calltrace.cycles-pp.record__finish_output.cmd_record.cmd_sched.run_builtin.main
      1.38 ± 19%      -1.1        0.26 ±100%  perf-profile.calltrace.cycles-pp.perf_session__process_events.record__finish_output.cmd_record.cmd_sched.run_builtin
      1.49 ± 17%      -0.9        0.62 ±  3%  perf-profile.calltrace.cycles-pp.cmd_record.cmd_sched.run_builtin.main.__libc_start_main
      1.49 ± 17%      -0.9        0.62 ±  3%  perf-profile.calltrace.cycles-pp.cmd_sched.run_builtin.main.__libc_start_main
      1.53 ± 19%      -0.9        0.67 ±  5%  perf-profile.calltrace.cycles-pp.__libc_start_main
      1.53 ± 19%      -0.9        0.67 ±  5%  perf-profile.calltrace.cycles-pp.main.__libc_start_main
      1.53 ± 19%      -0.9        0.67 ±  5%  perf-profile.calltrace.cycles-pp.run_builtin.main.__libc_start_main
      0.79 ± 19%      +1.3        2.10 ± 30%  perf-profile.calltrace.cycles-pp.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
      3.29 ±  7%      +1.6        4.86 ± 19%  perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.wait_log_commit.btrfs_sync_log.btrfs_sync_file
      0.00            +2.0        1.97 ± 30%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block
      0.00            +2.0        1.98 ± 30%  perf-profile.calltrace.cycles-pp._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block
      0.00            +2.0        2.00 ± 30%  perf-profile.calltrace.cycles-pp.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
      5.49 ±  9%      +3.0        8.47 ±  7%  perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
      5.48 ±  9%      +3.0        8.51 ±  6%  perf-profile.calltrace.cycles-pp.wait_log_commit.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
      0.00            +3.1        3.14 ± 36%  perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
      4.22 ±  8%      +4.1        8.35 ±  6%  perf-profile.calltrace.cycles-pp.__mutex_lock.wait_log_commit.btrfs_sync_log.btrfs_sync_file.do_fsync
      5.13 ± 13%      +4.5        9.62 ± 20%  perf-profile.calltrace.cycles-pp.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
      0.00            +4.6        4.58 ± 20%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
      2.58 ± 12%      +4.6        7.20 ±  5%  perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode
      2.57 ± 12%      +4.6        7.20 ±  5%  perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items
      0.00            +4.8        4.82 ± 15%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block
      0.00            +4.8        4.82 ± 15%  perf-profile.calltrace.cycles-pp._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block
      0.00            +4.8        4.84 ± 15%  perf-profile.calltrace.cycles-pp.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block
      0.00            +4.8        4.84 ± 15%  perf-profile.calltrace.cycles-pp.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
      0.00            +4.9        4.88 ± 14%  perf-profile.calltrace.cycles-pp.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
      0.00            +6.0        5.97 ±  7%  perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log
      3.28 ± 13%      +6.0        9.32 ± 20%  perf-profile.calltrace.cycles-pp.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
      3.28 ± 13%      +6.0        9.32 ± 20%  perf-profile.calltrace.cycles-pp.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
      0.00            +6.1        6.08 ±  6%  perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents
      3.22 ± 13%      +6.1        9.32 ± 20%  perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent
      0.88 ±  6%      +7.1        7.97 ±  6%  perf-profile.calltrace.cycles-pp.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
      0.86 ±  6%      +7.1        7.97 ±  6%  perf-profile.calltrace.cycles-pp.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
      0.50 ± 45%      +7.2        7.73 ±  6%  perf-profile.calltrace.cycles-pp.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
      0.00            +7.7        7.71 ±  7%  perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
      0.00            +7.7        7.73 ±  7%  perf-profile.calltrace.cycles-pp.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
      0.00            +7.9        7.89 ±  6%  perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log
      0.00            +7.9        7.91 ±  6%  perf-profile.calltrace.cycles-pp.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file
     14.56 ±  8%     +10.9       25.48 ±  6%  perf-profile.calltrace.cycles-pp.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
      5.85 ± 12%     +11.5       17.36 ± 10%  perf-profile.calltrace.cycles-pp.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
      5.84 ± 13%     +11.5       17.36 ± 10%  perf-profile.calltrace.cycles-pp.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync
     23.60 ±  9%     +19.6       43.17 ±  5%  perf-profile.calltrace.cycles-pp.fsync
     23.49 ±  9%     +19.7       43.15 ±  5%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.fsync
     23.48 ±  9%     +19.7       43.15 ±  5%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
     23.46 ±  9%     +19.7       43.14 ±  5%  perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
     23.46 ±  9%     +19.7       43.14 ±  5%  perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
     23.45 ±  9%     +19.7       43.14 ±  5%  perf-profile.calltrace.cycles-pp.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
     64.88 ±  4%     -11.1       53.82 ±  4%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     64.88 ±  4%     -11.1       53.82 ±  4%  perf-profile.children.cycles-pp.cpu_startup_entry
     64.87 ±  4%     -11.1       53.82 ±  4%  perf-profile.children.cycles-pp.do_idle
     64.38 ±  4%     -10.8       53.60 ±  4%  perf-profile.children.cycles-pp.start_secondary
     59.43 ±  5%      -9.3       50.13 ±  5%  perf-profile.children.cycles-pp.cpuidle_enter
     59.40 ±  5%      -9.3       50.11 ±  5%  perf-profile.children.cycles-pp.cpuidle_enter_state
      7.94 ±  9%      -7.0        0.99 ±  9%  perf-profile.children.cycles-pp.filemap_fdatawrite_range
      7.94 ±  9%      -7.0        0.99 ±  9%  perf-profile.children.cycles-pp.do_writepages
      7.92 ±  9%      -6.9        0.98 ±  9%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
      5.66 ± 10%      -4.9        0.72 ± 10%  perf-profile.children.cycles-pp.btree_write_cache_pages
      4.61 ± 11%      -3.9        0.66 ± 12%  perf-profile.children.cycles-pp.open64
      4.65 ± 10%      -3.9        0.73 ± 10%  perf-profile.children.cycles-pp.do_sys_open
      4.64 ± 10%      -3.9        0.73 ± 10%  perf-profile.children.cycles-pp.do_sys_openat2
      4.41 ±  9%      -3.9        0.53 ± 10%  perf-profile.children.cycles-pp.submit_one_bio
      4.40 ±  9%      -3.9        0.53 ± 11%  perf-profile.children.cycles-pp.btrfs_submit_metadata_bio
      4.57 ± 10%      -3.9        0.72 ± 10%  perf-profile.children.cycles-pp.do_filp_open
      4.57 ± 10%      -3.9        0.72 ± 10%  perf-profile.children.cycles-pp.path_openat
      4.12 ±  9%      -3.6        0.47 ± 11%  perf-profile.children.cycles-pp.btree_csum_one_bio
      4.10 ±  9%      -3.6        0.47 ± 12%  perf-profile.children.cycles-pp.csum_one_extent_buffer
      3.33 ± 45%      -3.1        0.20 ± 34%  perf-profile.children.cycles-pp.poll_idle
      3.76 ±  7%      -3.1        0.68 ± 10%  perf-profile.children.cycles-pp.__schedule
      3.90 ±  8%      -3.0        0.87 ± 12%  perf-profile.children.cycles-pp.perf_tp_event
      3.80 ±  8%      -3.0        0.85 ± 11%  perf-profile.children.cycles-pp.perf_swevent_overflow
      3.80 ±  8%      -3.0        0.85 ± 11%  perf-profile.children.cycles-pp.__perf_event_overflow
      3.78 ±  8%      -2.9        0.84 ± 11%  perf-profile.children.cycles-pp.perf_event_output_forward
      3.40 ± 10%      -2.9        0.46 ± 15%  perf-profile.children.cycles-pp.btrfs_create
      3.30 ±  9%      -2.5        0.76 ± 12%  perf-profile.children.cycles-pp.perf_prepare_sample
      3.13 ±  9%      -2.4        0.71 ± 12%  perf-profile.children.cycles-pp.perf_callchain
      3.12 ±  9%      -2.4        0.71 ± 11%  perf-profile.children.cycles-pp.get_perf_callchain
      2.83 ±  8%      -2.3        0.48 ± 10%  perf-profile.children.cycles-pp.schedule
      2.38 ±  9%      -2.0        0.34 ± 18%  perf-profile.children.cycles-pp.btrfs_insert_empty_items
      2.27 ± 12%      -2.0        0.27 ± 12%  perf-profile.children.cycles-pp.start_ordered_ops
      2.26 ± 11%      -2.0        0.26 ± 12%  perf-profile.children.cycles-pp.btrfs_fdatawrite_range
      2.25 ± 11%      -2.0        0.26 ± 11%  perf-profile.children.cycles-pp.extent_writepages
      2.22 ± 11%      -2.0        0.26 ± 11%  perf-profile.children.cycles-pp.extent_write_cache_pages
      2.44 ±  9%      -1.9        0.58 ± 11%  perf-profile.children.cycles-pp.perf_callchain_kernel
      2.02 ± 12%      -1.8        0.22 ± 12%  perf-profile.children.cycles-pp.__extent_writepage
      2.00 ± 12%      -1.8        0.22 ± 12%  perf-profile.children.cycles-pp.writepage_delalloc
      1.95 ±  7%      -1.7        0.24 ± 11%  perf-profile.children.cycles-pp.read_extent_buffer
      1.92 ± 12%      -1.7        0.21 ± 14%  perf-profile.children.cycles-pp.btrfs_run_delalloc_range
      1.90 ± 12%      -1.7        0.20 ± 16%  perf-profile.children.cycles-pp.cow_file_range
      1.89 ± 10%      -1.7        0.23 ± 10%  perf-profile.children.cycles-pp.btrfs_check_node
      2.01 ± 10%      -1.6        0.37 ± 15%  perf-profile.children.cycles-pp.ksys_write
      1.99 ± 10%      -1.6        0.36 ± 14%  perf-profile.children.cycles-pp.vfs_write
      1.95 ±  9%      -1.6        0.36 ± 13%  perf-profile.children.cycles-pp.new_sync_write
      1.67 ± 18%      -1.5        0.16 ± 16%  perf-profile.children.cycles-pp.check_leaf
      1.78 ± 10%      -1.5        0.29 ± 18%  perf-profile.children.cycles-pp.write
      1.59 ± 13%      -1.4        0.16 ± 15%  perf-profile.children.cycles-pp.cow_file_range_inline
      1.86 ±  9%      -1.4        0.44 ±  7%  perf-profile.children.cycles-pp.unwind_next_frame
      1.62 ± 11%      -1.4        0.24 ± 14%  perf-profile.children.cycles-pp.btrfs_file_write_iter
      1.61 ± 11%      -1.4        0.24 ± 14%  perf-profile.children.cycles-pp.btrfs_buffered_write
      1.51 ±  9%      -1.3        0.17 ± 19%  perf-profile.children.cycles-pp.btrfs_add_link
      1.45 ±  9%      -1.3        0.16 ± 18%  perf-profile.children.cycles-pp.btrfs_insert_dir_item
      1.54 ±  8%      -1.3        0.26 ± 12%  perf-profile.children.cycles-pp.try_to_wake_up
      1.48 ±  7%      -1.3        0.22 ± 11%  perf-profile.children.cycles-pp.perf_trace_sched_switch
      1.49 ± 11%      -1.2        0.25 ± 12%  perf-profile.children.cycles-pp.dequeue_task_fair
      1.41 ± 11%      -1.2        0.17 ± 14%  perf-profile.children.cycles-pp.copy_extent_buffer_full
      1.41 ± 11%      -1.2        0.18 ± 12%  perf-profile.children.cycles-pp.copy_page
      1.46 ± 11%      -1.2        0.25 ± 12%  perf-profile.children.cycles-pp.dequeue_entity
      1.36 ± 11%      -1.2        0.18 ± 20%  perf-profile.children.cycles-pp.asm_common_interrupt
      1.34 ± 11%      -1.2        0.18 ± 20%  perf-profile.children.cycles-pp.common_interrupt
      1.29 ± 11%      -1.1        0.17 ± 17%  perf-profile.children.cycles-pp.__common_interrupt
      1.28 ± 12%      -1.1        0.17 ± 18%  perf-profile.children.cycles-pp.handle_edge_irq
      1.25 ± 14%      -1.1        0.14 ± 17%  perf-profile.children.cycles-pp.read_block_for_search
      1.26 ± 11%      -1.1        0.16 ± 16%  perf-profile.children.cycles-pp.handle_irq_event
      1.26 ± 11%      -1.1        0.16 ± 18%  perf-profile.children.cycles-pp.handle_irq_event_percpu
      1.24 ± 11%      -1.1        0.16 ± 16%  perf-profile.children.cycles-pp.__handle_irq_event_percpu
      1.24 ± 12%      -1.1        0.16 ± 17%  perf-profile.children.cycles-pp.nvme_irq
      1.17 ±  8%      -1.0        0.13 ± 23%  perf-profile.children.cycles-pp.insert_with_overflow
      1.16 ±  8%      -1.0        0.16 ± 15%  perf-profile.children.cycles-pp.__wake_up_common
      1.18 ±  9%      -1.0        0.18 ± 25%  perf-profile.children.cycles-pp.btrfs_new_inode
      1.12 ±  7%      -1.0        0.13 ±  8%  perf-profile.children.cycles-pp.folio_wait_bit
      1.12 ± 11%      -1.0        0.14 ± 19%  perf-profile.children.cycles-pp.blk_mq_end_request_batch
      1.50 ± 10%      -1.0        0.53 ± 15%  perf-profile.children.cycles-pp.update_curr
      1.09 ± 11%      -1.0        0.12 ± 19%  perf-profile.children.cycles-pp.find_extent_buffer
      1.07 ±  7%      -1.0        0.12 ± 11%  perf-profile.children.cycles-pp.io_schedule
      1.07 ± 12%      -0.9        0.12 ± 18%  perf-profile.children.cycles-pp.blk_update_request
      1.41 ± 11%      -0.9        0.50 ± 16%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      1.08 ±  8%      -0.9        0.17 ± 13%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      1.00 ± 13%      -0.9        0.10 ± 13%  perf-profile.children.cycles-pp.btrfs_drop_extents
      1.38 ± 19%      -0.9        0.50 ±  4%  perf-profile.children.cycles-pp.record__finish_output
      1.38 ± 19%      -0.9        0.50 ±  4%  perf-profile.children.cycles-pp.perf_session__process_events
      1.49 ± 17%      -0.9        0.62 ±  3%  perf-profile.children.cycles-pp.cmd_record
      1.49 ± 17%      -0.9        0.62 ±  3%  perf-profile.children.cycles-pp.cmd_sched
      1.53 ± 19%      -0.9        0.67 ±  5%  perf-profile.children.cycles-pp.__libc_start_main
      1.53 ± 19%      -0.9        0.67 ±  5%  perf-profile.children.cycles-pp.main
      1.53 ± 19%      -0.9        0.67 ±  5%  perf-profile.children.cycles-pp.run_builtin
      1.15 ± 10%      -0.8        0.32 ± 16%  perf-profile.children.cycles-pp.kthread
      0.96 ± 14%      -0.8        0.13 ± 19%  perf-profile.children.cycles-pp.btrfs_lookup_match_dir
      1.15 ± 10%      -0.8        0.32 ± 16%  perf-profile.children.cycles-pp.ret_from_fork
      1.00 ±  7%      -0.8        0.17 ± 15%  perf-profile.children.cycles-pp.btrfs_update_root
      0.98 ± 11%      -0.8        0.18 ± 21%  perf-profile.children.cycles-pp.worker_thread
      0.94 ± 11%      -0.8        0.18 ± 21%  perf-profile.children.cycles-pp.process_one_work
      0.85 ± 11%      -0.7        0.10 ± 20%  perf-profile.children.cycles-pp.find_extent_buffer_nolock
      0.94 ±  8%      -0.7        0.19 ±  8%  perf-profile.children.cycles-pp.schedule_idle
      0.83 ± 17%      -0.7        0.09 ± 24%  perf-profile.children.cycles-pp.btrfs_get_32
      0.85 ± 11%      -0.7        0.13 ± 22%  perf-profile.children.cycles-pp.write_one_eb
      1.19 ± 17%      -0.7        0.47 ±  3%  perf-profile.children.cycles-pp.process_simple
      0.74 ± 13%      -0.7        0.04 ± 71%  perf-profile.children.cycles-pp.btrfs_end_bio
      0.72 ± 12%      -0.7        0.06 ± 50%  perf-profile.children.cycles-pp.btrfs_work_helper
      0.70 ± 13%      -0.7        0.04 ± 72%  perf-profile.children.cycles-pp.folio_end_writeback
      0.77 ± 15%      -0.7        0.10 ± 18%  perf-profile.children.cycles-pp.btrfs_lookup_dir_item
      0.72 ± 12%      -0.7        0.06 ± 50%  perf-profile.children.cycles-pp.btrfs_async_run_delayed_root
      0.70 ± 12%      -0.7        0.04 ± 72%  perf-profile.children.cycles-pp.end_bio_extent_buffer_writepage
      0.72 ± 11%      -0.6        0.10 ± 20%  perf-profile.children.cycles-pp.generic_bin_search
      0.69 ±  9%      -0.6        0.09 ± 30%  perf-profile.children.cycles-pp.setup_items_for_insert
      0.79 ±  9%      -0.6        0.20 ± 10%  perf-profile.children.cycles-pp.__orc_find
      0.62 ± 16%      -0.6        0.04 ± 72%  perf-profile.children.cycles-pp.btrfs_lookup_file_extent
      0.67 ± 14%      -0.6        0.09 ± 16%  perf-profile.children.cycles-pp.prepare_pages
      0.75 ± 10%      -0.6        0.18 ± 13%  perf-profile.children.cycles-pp.write_all_supers
      0.64 ± 10%      -0.6        0.09 ± 12%  perf-profile.children.cycles-pp.folio_mark_dirty
      0.69 ± 12%      -0.5        0.16 ± 21%  perf-profile.children.cycles-pp.__btrfs_tree_read_lock
      0.62 ± 10%      -0.5        0.08 ± 13%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      0.66 ± 12%      -0.5        0.13 ± 21%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.63 ± 10%      -0.5        0.10 ± 22%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.78 ± 20%      -0.5        0.26 ±  9%  perf-profile.children.cycles-pp.__ordered_events__flush
      0.77 ± 20%      -0.5        0.25 ±  9%  perf-profile.children.cycles-pp.perf_session__process_user_event
      0.58 ±  9%      -0.5        0.07 ± 15%  perf-profile.children.cycles-pp.folio_wake_bit
      0.67 ± 10%      -0.5        0.16 ±  9%  perf-profile.children.cycles-pp.__unwind_start
      0.60 ±  9%      -0.5        0.08 ± 13%  perf-profile.children.cycles-pp.filemap_dirty_folio
      0.60 ± 10%      -0.5        0.10 ± 24%  perf-profile.children.cycles-pp.split_leaf
      0.58 ± 10%      -0.5        0.09 ± 23%  perf-profile.children.cycles-pp.autoremove_wake_function
      0.56 ±  9%      -0.5        0.07 ± 14%  perf-profile.children.cycles-pp.wake_page_function
      0.62 ±  9%      -0.5        0.12 ± 20%  perf-profile.children.cycles-pp.perf_callchain_user
      0.56 ± 11%      -0.5        0.08 ± 21%  perf-profile.children.cycles-pp.btrfs_comp_cpu_keys
      0.76 ± 20%      -0.5        0.28 ±  8%  perf-profile.children.cycles-pp.perf_session__deliver_event
      0.55 ±  8%      -0.5        0.07 ± 14%  perf-profile.children.cycles-pp.btrfs_release_path
      0.53 ± 17%      -0.5        0.05 ± 48%  perf-profile.children.cycles-pp.btrfs_get_64
      0.64 ± 12%      -0.5        0.16 ±  7%  perf-profile.children.cycles-pp.orc_find
      0.82 ± 11%      -0.5        0.34 ± 10%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.55 ± 10%      -0.5        0.08 ± 17%  perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty
      0.58 ±  9%      -0.5        0.12 ± 17%  perf-profile.children.cycles-pp.__get_user_nocheck_8
      0.52 ± 28%      -0.4        0.08 ± 22%  perf-profile.children.cycles-pp.alloc_extent_buffer
      0.51 ± 11%      -0.4        0.07 ± 14%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.50 ±  9%      -0.4        0.07 ± 21%  perf-profile.children.cycles-pp.set_extent_buffer_dirty
      0.50 ±  9%      -0.4        0.07 ± 14%  perf-profile.children.cycles-pp.csum_tree_block
      0.46 ± 11%      -0.4        0.05 ± 46%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.57 ± 11%      -0.4        0.16 ± 19%  perf-profile.children.cycles-pp.btrfs_read_lock_root_node
      0.48 ± 17%      -0.4        0.07 ± 16%  perf-profile.children.cycles-pp.btrfs_lookup
      0.48 ± 17%      -0.4        0.07 ± 16%  perf-profile.children.cycles-pp.btrfs_lookup_dentry
      0.55 ± 16%      -0.4        0.15 ± 21%  perf-profile.children.cycles-pp.copy_items
      0.44 ± 15%      -0.4        0.05 ± 46%  perf-profile.children.cycles-pp.prepare_uptodate_page
      0.43 ± 16%      -0.4        0.05 ± 47%  perf-profile.children.cycles-pp.btrfs_readpage
      0.50 ± 12%      -0.4        0.12 ± 27%  perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      0.44 ± 33%      -0.4        0.06 ± 51%  perf-profile.children.cycles-pp.pagecache_get_page
      0.40 ± 16%      -0.4        0.03 ±100%  perf-profile.children.cycles-pp.check_setget_bounds
      0.43 ± 34%      -0.4        0.06 ± 51%  perf-profile.children.cycles-pp.__filemap_get_folio
      0.41 ± 14%      -0.4        0.04 ± 73%  perf-profile.children.cycles-pp.btrfs_update_inode
      0.41 ± 13%      -0.4        0.05 ± 47%  perf-profile.children.cycles-pp.btrfs_check_ref_name_override
      0.55 ±  7%      -0.3        0.20 ± 12%  perf-profile.children.cycles-pp.asm_exc_page_fault
      0.35 ± 13%      -0.3        0.03 ±101%  perf-profile.children.cycles-pp.btrfs_delayed_update_inode
      0.38 ±  9%      -0.3        0.06 ±  7%  perf-profile.children.cycles-pp.perf_output_sample
      0.37 ± 15%      -0.3        0.05 ± 47%  perf-profile.children.cycles-pp.btrfs_write_check
      0.41 ± 12%      -0.3        0.09 ± 22%  perf-profile.children.cycles-pp.unwind_get_return_address
      0.34 ± 10%      -0.3        0.03 ±100%  perf-profile.children.cycles-pp.btrfs_dirty_pages
      0.36 ± 15%      -0.3        0.05 ± 51%  perf-profile.children.cycles-pp.btrfs_reserve_extent
      0.34 ± 16%      -0.3        0.04 ± 73%  perf-profile.children.cycles-pp.file_remove_privs
      0.35 ± 10%      -0.3        0.06 ± 52%  perf-profile.children.cycles-pp.btrfs_free_tree_block
      0.33 ± 16%      -0.3        0.04 ± 73%  perf-profile.children.cycles-pp.dentry_needs_remove_privs
      0.33 ± 11%      -0.3        0.04 ± 71%  perf-profile.children.cycles-pp.__folio_mark_dirty
      0.38 ± 13%      -0.3        0.08 ± 20%  perf-profile.children.cycles-pp.__kernel_text_address
      0.31 ± 15%      -0.3        0.04 ± 73%  perf-profile.children.cycles-pp.find_free_extent
      0.33 ± 11%      -0.3        0.07 ± 21%  perf-profile.children.cycles-pp.kernel_text_address
      0.31 ± 11%      -0.2        0.07 ± 47%  perf-profile.children.cycles-pp.rwsem_wake
      0.29 ±  5%      -0.2        0.05 ± 45%  perf-profile.children.cycles-pp.mkdir
      0.28 ± 17%      -0.2        0.05 ± 74%  perf-profile.children.cycles-pp.btrfs_map_bio
      0.31 ±  6%      -0.2        0.08 ± 24%  perf-profile.children.cycles-pp.wake_up_q
      0.26 ±  7%      -0.2        0.04 ± 71%  perf-profile.children.cycles-pp.__x64_sys_mkdir
      0.24 ± 13%      -0.2        0.02 ± 99%  perf-profile.children.cycles-pp.perf_output_copy
      0.28 ± 14%      -0.2        0.06 ± 14%  perf-profile.children.cycles-pp.btrfs_end_super_write
      0.25 ± 13%      -0.2        0.04 ± 71%  perf-profile.children.cycles-pp.memcpy_erms
      0.25 ± 14%      -0.2        0.04 ± 72%  perf-profile.children.cycles-pp.mutex_lock
      0.26 ± 18%      -0.2        0.06 ± 49%  perf-profile.children.cycles-pp.submit_bio_noacct
      0.23 ± 13%      -0.2        0.03 ±100%  perf-profile.children.cycles-pp.down_read
      0.26 ± 16%      -0.2        0.06 ± 47%  perf-profile.children.cycles-pp.blk_mq_submit_bio
      0.27 ±  8%      -0.2        0.08 ± 20%  perf-profile.children.cycles-pp.__close
      0.22 ± 21%      -0.2        0.03 ± 70%  perf-profile.children.cycles-pp.__might_resched
      0.24 ±  8%      -0.2        0.05 ± 46%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.21 ±  6%      -0.2        0.02 ± 99%  perf-profile.children.cycles-pp.do_mkdirat
      0.27 ± 10%      -0.2        0.08 ± 13%  perf-profile.children.cycles-pp.__libc_write
      0.26 ± 10%      -0.2        0.08 ± 17%  perf-profile.children.cycles-pp.generic_file_write_iter
      0.26 ± 10%      -0.2        0.08 ± 17%  perf-profile.children.cycles-pp.__generic_file_write_iter
      0.26 ± 10%      -0.2        0.08 ± 17%  perf-profile.children.cycles-pp.generic_perform_write
      0.26 ±  8%      -0.2        0.08 ± 20%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.21 ± 13%      -0.2        0.04 ± 73%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.21 ± 19%      -0.2        0.04 ± 72%  perf-profile.children.cycles-pp.write_dev_supers
      0.26 ± 12%      -0.2        0.08 ± 19%  perf-profile.children.cycles-pp.unlock_up
      0.24 ±  5%      -0.2        0.07 ± 18%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.20 ±  3%      -0.1        0.06 ± 46%  perf-profile.children.cycles-pp.task_work_run
      0.19 ± 12%      -0.1        0.05 ± 71%  perf-profile.children.cycles-pp.__etree_search
      0.22 ± 70%      -0.1        0.08 ± 24%  perf-profile.children.cycles-pp._find_next_bit
      0.22 ±  5%      -0.1        0.08 ±  5%  perf-profile.children.cycles-pp.link_path_walk
      0.35 ±  9%      -0.1        0.22 ±  7%  perf-profile.children.cycles-pp.machines__deliver_event
      0.16 ± 17%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.push_leaf_left
      0.17 ±  4%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.__fput
      0.27 ± 18%      -0.1        0.16 ± 13%  perf-profile.children.cycles-pp.ordered_events__queue
      0.15 ±  7%      -0.1        0.05 ± 47%  perf-profile.children.cycles-pp.update_load_avg
      0.13 ± 22%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.do_sys_poll
      0.13 ± 22%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__x64_sys_poll
      0.13 ± 22%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__poll
      0.24 ± 10%      -0.1        0.13 ± 12%  perf-profile.children.cycles-pp.exc_page_fault
      0.25 ± 18%      -0.1        0.15 ± 13%  perf-profile.children.cycles-pp.queue_event
      0.14 ± 33%      -0.1        0.04 ± 73%  perf-profile.children.cycles-pp.finish_task_switch
      0.21 ±  7%      -0.1        0.12 ±  8%  perf-profile.children.cycles-pp.build_id__mark_dso_hit
      0.14 ± 15%      -0.1        0.07 ± 14%  perf-profile.children.cycles-pp.newidle_balance
      0.14 ±  6%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.walk_component
      0.11 ±  9%      -0.0        0.07 ± 17%  perf-profile.children.cycles-pp.idle_cpu
      0.14 ±  8%      -0.0        0.11 ±  5%  perf-profile.children.cycles-pp.thread__find_map
      0.07 ± 11%      -0.0        0.04 ± 45%  perf-profile.children.cycles-pp.user_path_at_empty
      0.11 ±  9%      -0.0        0.08 ±  8%  perf-profile.children.cycles-pp.handle_mm_fault
      0.10 ± 11%      -0.0        0.08 ± 10%  perf-profile.children.cycles-pp.__handle_mm_fault
      0.17 ± 15%      +0.2        0.33 ± 18%  perf-profile.children.cycles-pp.task_tick_fair
      1.13 ± 18%      +1.1        2.20 ± 29%  perf-profile.children.cycles-pp.btrfs_alloc_tree_block
      0.75 ± 12%      +1.4        2.13 ± 30%  perf-profile.children.cycles-pp.set_extent_bit
      0.18 ± 27%      +1.7        1.90 ±102%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      5.79 ± 10%      +2.7        8.47 ±  7%  perf-profile.children.cycles-pp.btrfs_write_marked_extents
      5.48 ±  9%      +3.0        8.51 ±  6%  perf-profile.children.cycles-pp.wait_log_commit
      3.61 ± 11%      +3.8        7.38 ±  5%  perf-profile.children.cycles-pp.btrfs_cow_block
      3.60 ± 11%      +3.8        7.38 ±  5%  perf-profile.children.cycles-pp.__btrfs_cow_block
      3.61 ±  6%      +4.4        8.01 ±  5%  perf-profile.children.cycles-pp.mutex_spin_on_owner
      5.14 ± 13%      +4.5        9.62 ± 20%  perf-profile.children.cycles-pp.btrfs_log_inode
      0.26 ± 16%      +4.6        4.88 ± 14%  perf-profile.children.cycles-pp.__clear_extent_bit
      0.07 ± 29%      +4.8        4.85 ± 15%  perf-profile.children.cycles-pp.clear_extent_bit
      0.00            +4.9        4.91 ± 14%  perf-profile.children.cycles-pp.delete_tree_block
      1.83 ±  9%      +5.5        7.34 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock
      3.28 ± 13%      +6.0        9.32 ± 20%  perf-profile.children.cycles-pp.truncate_inode_items
      3.28 ± 13%      +6.0        9.32 ± 20%  perf-profile.children.cycles-pp.btrfs_truncate_inode_items
      0.34 ± 15%      +6.6        6.92 ±  6%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      1.33 ± 17%      +6.8        8.08 ±  7%  perf-profile.children.cycles-pp.osq_lock
      0.88 ±  6%      +7.1        7.97 ±  6%  perf-profile.children.cycles-pp.btrfs_wait_tree_log_extents
      0.86 ±  6%      +7.1        7.97 ±  6%  perf-profile.children.cycles-pp.__btrfs_wait_marked_extents
     14.57 ±  8%     +10.9       25.48 ±  6%  perf-profile.children.cycles-pp.btrfs_sync_log
      4.93 ±  8%     +11.2       16.09 ±  6%  perf-profile.children.cycles-pp.__mutex_lock
      5.85 ± 12%     +11.5       17.36 ± 10%  perf-profile.children.cycles-pp.btrfs_log_dentry_safe
      5.84 ± 13%     +11.5       17.36 ± 10%  perf-profile.children.cycles-pp.btrfs_log_inode_parent
      0.18 ± 31%     +12.2       12.40 ±  6%  perf-profile.children.cycles-pp.rb_next
     31.52 ±  9%     +13.5       45.01 ±  5%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     31.50 ±  9%     +13.5       45.01 ±  5%  perf-profile.children.cycles-pp.do_syscall_64
      0.11 ± 34%     +15.5       15.64 ±  6%  perf-profile.children.cycles-pp.find_first_extent_bit
      0.02 ±149%     +15.6       15.64 ±  6%  perf-profile.children.cycles-pp.find_first_extent_bit_state
     23.60 ±  9%     +19.6       43.17 ±  5%  perf-profile.children.cycles-pp.fsync
     23.46 ±  9%     +19.7       43.14 ±  5%  perf-profile.children.cycles-pp.__x64_sys_fsync
     23.46 ±  9%     +19.7       43.14 ±  5%  perf-profile.children.cycles-pp.do_fsync
     23.45 ±  9%     +19.7       43.14 ±  5%  perf-profile.children.cycles-pp.btrfs_sync_file
      2.92 ± 48%      -2.7        0.17 ± 32%  perf-profile.self.cycles-pp.poll_idle
      1.90 ±  8%      -1.7        0.23 ± 10%  perf-profile.self.cycles-pp.read_extent_buffer
      1.38 ± 10%      -1.2        0.18 ± 12%  perf-profile.self.cycles-pp.copy_page
      1.61 ±  9%      -1.2        0.44 ± 10%  perf-profile.self.cycles-pp._raw_spin_lock
      0.79 ±  9%      -0.6        0.20 ± 10%  perf-profile.self.cycles-pp.__orc_find
      0.65 ± 17%      -0.6        0.07 ± 48%  perf-profile.self.cycles-pp.btrfs_get_32
      0.62 ± 12%      -0.5        0.14 ± 15%  perf-profile.self.cycles-pp.unwind_next_frame
      0.52 ± 11%      -0.5        0.06 ± 48%  perf-profile.self.cycles-pp.btrfs_comp_cpu_keys
      0.45 ± 14%      -0.4        0.05 ± 46%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.42 ± 16%      -0.4        0.04 ± 45%  perf-profile.self.cycles-pp.find_extent_buffer_nolock
      0.66 ±  9%      -0.4        0.30 ± 10%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.33 ± 13%      -0.3        0.02 ± 99%  perf-profile.self.cycles-pp.check_setget_bounds
      0.34 ±  9%      -0.3        0.04 ± 73%  perf-profile.self.cycles-pp.generic_bin_search
      0.32 ± 18%      -0.3        0.04 ± 71%  perf-profile.self.cycles-pp.btrfs_search_slot
      0.31 ±  8%      -0.3        0.04 ± 71%  perf-profile.self.cycles-pp.__get_user_nocheck_8
      0.26 ± 13%      -0.2        0.05 ± 45%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.24 ± 12%      -0.2        0.04 ± 71%  perf-profile.self.cycles-pp.memcpy_erms
      0.20 ±  8%      -0.2        0.03 ± 70%  perf-profile.self.cycles-pp.__might_resched
      0.22 ± 12%      -0.2        0.06 ± 11%  perf-profile.self.cycles-pp.orc_find
      0.18 ±  9%      -0.1        0.04 ± 71%  perf-profile.self.cycles-pp.__etree_search
      0.21 ± 69%      -0.1        0.08 ± 24%  perf-profile.self.cycles-pp._find_next_bit
      0.24 ± 18%      -0.1        0.15 ± 13%  perf-profile.self.cycles-pp.queue_event
      0.10 ± 10%      -0.0        0.07 ± 16%  perf-profile.self.cycles-pp.idle_cpu
      0.16 ± 30%      +1.7        1.88 ±102%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      0.00            +3.3        3.29 ± 10%  perf-profile.self.cycles-pp.find_first_extent_bit_state
      3.56 ±  7%      +4.4        7.93 ±  5%  perf-profile.self.cycles-pp.mutex_spin_on_owner
      0.34 ± 15%      +6.4        6.77 ±  6%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      1.31 ± 17%      +6.7        7.98 ±  7%  perf-profile.self.cycles-pp.osq_lock
      0.16 ± 24%     +11.9       12.04 ±  6%  perf-profile.self.cycles-pp.rb_next
     63652 ±  4%    +342.1%     281400 ± 22%  softirqs.CPU0.RCU
     49340 ±  3%    +323.7%     209037 ±  4%  softirqs.CPU0.SCHED
     77569 ± 22%    +301.1%     311142 ± 16%  softirqs.CPU1.RCU
     51305 ±  5%    +440.7%     277414 ± 12%  softirqs.CPU1.SCHED
     63598 ±  7%    +393.4%     313821 ± 12%  softirqs.CPU10.RCU
     46668 ±  3%    +442.9%     253366 ± 12%  softirqs.CPU10.SCHED
     56913 ±  8%    +372.7%     269022 ± 24%  softirqs.CPU100.RCU
     44647 ±  4%    +342.7%     197632 ±  4%  softirqs.CPU100.SCHED
     54306 ±  5%    +428.0%     286713 ± 24%  softirqs.CPU101.RCU
     43536 ±  5%    +352.3%     196901 ±  3%  softirqs.CPU101.SCHED
     57307 ±  5%    +403.7%     288668 ± 24%  softirqs.CPU102.RCU
     44116 ±  5%    +344.9%     196272 ±  3%  softirqs.CPU102.SCHED
     55926 ±  5%    +396.2%     277483 ± 24%  softirqs.CPU103.RCU
     43612 ±  5%    +344.3%     193773 ±  3%  softirqs.CPU103.SCHED
     52019 ± 12%    +409.4%     264966 ± 25%  softirqs.CPU104.RCU
     37370 ± 24%    +406.0%     189092 ±  4%  softirqs.CPU104.SCHED
     58110 ±  5%    +399.9%     290468 ± 23%  softirqs.CPU105.RCU
     43964 ±  5%    +350.1%     197899 ±  4%  softirqs.CPU105.SCHED
     57196 ±  4%    +389.7%     280102 ± 24%  softirqs.CPU106.RCU
     43755 ±  5%    +350.2%     196999 ±  3%  softirqs.CPU106.SCHED
     57359 ±  5%    +401.5%     287675 ± 24%  softirqs.CPU107.RCU
     43586 ±  5%    +348.2%     195346 ±  4%  softirqs.CPU107.SCHED
     58033 ±  5%    +394.4%     286918 ± 23%  softirqs.CPU108.RCU
     43774 ±  4%    +348.7%     196415 ±  3%  softirqs.CPU108.SCHED
     55569 ±  9%    +396.6%     275947 ± 24%  softirqs.CPU109.RCU
     40526 ± 16%    +379.0%     194101 ±  3%  softirqs.CPU109.SCHED
     63823 ± 12%    +356.7%     291484 ± 21%  softirqs.CPU11.RCU
     46707 ±  7%    +339.0%     205048 ±  4%  softirqs.CPU11.SCHED
     55191 ±  4%    +376.4%     262942 ± 18%  softirqs.CPU110.RCU
     42677 ±  5%    +346.8%     190674 ±  4%  softirqs.CPU110.SCHED
     57155 ±  6%    +390.3%     280242 ± 21%  softirqs.CPU111.RCU
     43508 ±  5%    +346.8%     194411 ±  3%  softirqs.CPU111.SCHED
     48597 ±  5%    +408.8%     247256 ± 24%  softirqs.CPU112.RCU
     43644 ±  5%    +306.3%     177304 ± 19%  softirqs.CPU112.SCHED
     57125 ± 24%    +395.7%     283157 ± 16%  softirqs.CPU113.RCU
     46364 ±  8%    +424.7%     243265 ± 13%  softirqs.CPU113.SCHED
     51740 ±  7%    +404.6%     261059 ± 22%  softirqs.CPU114.RCU
     42019 ± 18%    +374.5%     199368 ±  3%  softirqs.CPU114.SCHED
     58832 ± 23%    +385.0%     285311 ± 13%  softirqs.CPU115.RCU
     46274 ±  9%    +479.9%     268326 ± 11%  softirqs.CPU115.SCHED
     54480 ±  7%    +377.9%     260376 ± 20%  softirqs.CPU116.RCU
     45349 ±  5%    +350.6%     204338 ±  3%  softirqs.CPU116.SCHED
     53106 ± 10%    +369.5%     249325 ± 20%  softirqs.CPU117.RCU
     44834 ±  2%    +346.3%     200104 ±  3%  softirqs.CPU117.SCHED
     69617 ± 19%    +310.4%     285713 ± 13%  softirqs.CPU118.RCU
     49272 ±  4%    +427.5%     259921 ± 10%  softirqs.CPU118.SCHED
     56984 ±  4%    +356.1%     259910 ± 20%  softirqs.CPU119.RCU
     44993 ±  5%    +356.8%     205534 ±  3%  softirqs.CPU119.SCHED
      3971 ± 82%    +570.9%      26643 ± 33%  softirqs.CPU12.NET_RX
     60932 ±  6%    +379.2%     291960 ± 20%  softirqs.CPU12.RCU
     45366 ±  4%    +350.9%     204570 ±  4%  softirqs.CPU12.SCHED
     52992 ± 10%    +348.7%     237785 ± 16%  softirqs.CPU120.RCU
     42449 ± 18%    +377.7%     202781 ±  4%  softirqs.CPU120.SCHED
     47849 ± 10%    +365.3%     222632 ± 12%  softirqs.CPU121.RCU
     45212 ±  3%    +338.1%     198056 ±  9%  softirqs.CPU121.SCHED
     49431 ± 10%    +365.1%     229896 ± 12%  softirqs.CPU122.RCU
     45367 ±  4%    +352.7%     205373 ±  2%  softirqs.CPU122.SCHED
     53860 ± 12%    +336.8%     235268 ± 14%  softirqs.CPU123.RCU
     42520 ± 15%    +385.5%     206453 ±  2%  softirqs.CPU123.SCHED
     53023 ± 12%    +354.0%     240730 ± 13%  softirqs.CPU124.RCU
     45270 ±  3%    +355.2%     206090 ±  2%  softirqs.CPU124.SCHED
     53843 ± 12%    +323.7%     228115 ± 10%  softirqs.CPU125.RCU
     45383 ±  3%    +354.5%     206269 ±  2%  softirqs.CPU125.SCHED
     50612 ± 10%    +354.2%     229899 ± 14%  softirqs.CPU126.RCU
     43458 ± 11%    +373.3%     205690 ±  2%  softirqs.CPU126.SCHED
     47811 ± 10%    +354.5%     217312 ± 15%  softirqs.CPU127.RCU
     45393 ±  3%    +350.9%     204676 ±  2%  softirqs.CPU127.SCHED
     60930 ± 11%    +344.5%     270847 ± 15%  softirqs.CPU128.RCU
     44984 ±  4%    +355.5%     204927 ±  2%  softirqs.CPU128.SCHED
     63281 ± 16%    +319.1%     265212 ± 17%  softirqs.CPU129.RCU
     44936 ±  3%    +357.9%     205778 ±  2%  softirqs.CPU129.SCHED
      2554 ±126%    +781.9%      22525 ± 79%  softirqs.CPU13.NET_RX
     59587 ±  8%    +411.2%     304622 ± 15%  softirqs.CPU13.RCU
     44708 ±  6%    +430.8%     237330 ± 17%  softirqs.CPU13.SCHED
     61517 ± 11%    +357.2%     281242 ± 11%  softirqs.CPU130.RCU
     44925 ±  3%    +356.9%     205246 ±  2%  softirqs.CPU130.SCHED
     65236 ± 16%    +349.5%     293206 ± 12%  softirqs.CPU131.RCU
     45403 ±  3%    +352.8%     205592 ±  2%  softirqs.CPU131.SCHED
     62192 ± 14%    +375.4%     295674 ± 13%  softirqs.CPU132.RCU
     42904 ± 14%    +378.8%     205413 ±  2%  softirqs.CPU132.SCHED
     58253 ±  6%    +364.4%     270520 ± 13%  softirqs.CPU133.RCU
     45293 ±  2%    +351.7%     204596 ±  2%  softirqs.CPU133.SCHED
     61163 ± 10%    +351.1%     275886 ±  8%  softirqs.CPU134.RCU
     45033 ±  3%    +354.5%     204692 ±  2%  softirqs.CPU134.SCHED
     64743 ± 17%    +338.5%     283887 ±  9%  softirqs.CPU135.RCU
     45320 ±  3%    +354.4%     205955 ±  2%  softirqs.CPU135.SCHED
     59767 ± 10%    +362.4%     276383 ± 11%  softirqs.CPU136.RCU
     45304 ±  3%    +352.6%     205044 ±  2%  softirqs.CPU136.SCHED
     66245 ± 16%    +347.1%     296169 ± 11%  softirqs.CPU137.RCU
     45400 ±  3%    +346.8%     202857 ±  4%  softirqs.CPU137.SCHED
     12.67 ± 15%  +28681.6%       3645 ±222%  softirqs.CPU137.TIMER
     63311 ± 19%    +356.8%     289197 ± 14%  softirqs.CPU138.RCU
     45374 ±  3%    +353.9%     205954 ±  2%  softirqs.CPU138.SCHED
     65646 ± 15%    +327.8%     280826 ± 12%  softirqs.CPU139.RCU
     45240 ±  3%    +340.2%     199168 ±  2%  softirqs.CPU139.SCHED
     16.00 ± 25%  +56830.2%       9108 ±215%  softirqs.CPU139.TIMER
     60185 ±  6%    +371.6%     283832 ± 24%  softirqs.CPU14.RCU
     41827 ± 17%    +379.4%     200505 ±  2%  softirqs.CPU14.SCHED
     65300 ± 18%    +342.3%     288816 ± 12%  softirqs.CPU140.RCU
     45340 ±  3%    +353.8%     205747 ±  2%  softirqs.CPU140.SCHED
     62410 ± 13%    +350.8%     281343 ± 10%  softirqs.CPU141.RCU
     45172 ±  4%    +354.8%     205421 ±  2%  softirqs.CPU141.SCHED
     66114 ± 16%    +345.3%     294423 ± 12%  softirqs.CPU142.RCU
     44910 ±  5%    +357.8%     205590 ±  2%  softirqs.CPU142.SCHED
     59908 ± 26%    +365.1%     278631 ± 16%  softirqs.CPU143.RCU
     45322 ±  3%    +354.2%     205841 ±  2%  softirqs.CPU143.SCHED
     58563 ± 17%    +355.5%     266765 ± 19%  softirqs.CPU144.RCU
     45398 ±  3%    +269.3%     167665 ± 32%  softirqs.CPU144.SCHED
     57117 ± 14%    +353.1%     258821 ± 16%  softirqs.CPU145.RCU
     44873 ±  3%    +359.9%     206370 ±  2%  softirqs.CPU145.SCHED
     53695 ± 12%    +379.9%     257672 ± 15%  softirqs.CPU146.RCU
     45108 ±  3%    +356.0%     205710 ±  2%  softirqs.CPU146.SCHED
     60494 ± 19%    +362.9%     280037 ± 11%  softirqs.CPU147.RCU
     45342 ±  2%    +355.8%     206659        softirqs.CPU147.SCHED
     61708 ± 17%    +355.0%     280785 ± 12%  softirqs.CPU148.RCU
     44963 ±  2%    +325.1%     191135 ± 17%  softirqs.CPU148.SCHED
     62685 ± 19%    +354.7%     285033 ± 12%  softirqs.CPU149.RCU
     44887 ±  2%    +359.8%     206389        softirqs.CPU149.SCHED
     60025 ±  9%    +374.5%     284843 ± 22%  softirqs.CPU15.RCU
     46873 ± 12%    +305.0%     189826 ± 15%  softirqs.CPU15.SCHED
     63745 ± 17%    +341.1%     281196 ± 13%  softirqs.CPU150.RCU
     45400 ±  3%    +354.2%     206227 ±  2%  softirqs.CPU150.SCHED
     59142 ± 17%    +391.8%     290854 ± 13%  softirqs.CPU151.RCU
     45063 ±  3%    +356.8%     205846 ±  2%  softirqs.CPU151.SCHED
     62173 ± 19%    +368.5%     291301 ± 12%  softirqs.CPU152.RCU
     44941 ±  3%    +359.9%     206698        softirqs.CPU152.SCHED
     60823 ± 14%    +362.7%     281461 ± 14%  softirqs.CPU153.RCU
     45298 ±  3%    +354.9%     206063 ±  2%  softirqs.CPU153.SCHED
     63059 ± 18%    +374.1%     298987 ± 12%  softirqs.CPU154.RCU
     44578 ±  2%    +362.7%     206273 ±  2%  softirqs.CPU154.SCHED
     63445 ± 19%    +372.1%     299518 ± 11%  softirqs.CPU155.RCU
     45381 ±  3%    +355.2%     206577        softirqs.CPU155.SCHED
     56287 ± 13%    +384.0%     272439 ± 15%  softirqs.CPU156.RCU
     44609 ±  3%    +360.3%     205323 ±  2%  softirqs.CPU156.SCHED
     58413 ± 13%    +368.8%     273828 ± 14%  softirqs.CPU157.RCU
     44570 ±  3%    +360.9%     205442 ±  2%  softirqs.CPU157.SCHED
     62362 ± 18%    +356.1%     284451 ± 12%  softirqs.CPU158.RCU
     44831 ±  2%    +360.7%     206536        softirqs.CPU158.SCHED
     58942 ± 12%    +362.7%     272740 ± 18%  softirqs.CPU159.RCU
     44870 ±  2%    +358.8%     205858 ±  2%  softirqs.CPU159.SCHED
     52648 ±  7%    +370.0%     247431 ± 19%  softirqs.CPU16.RCU
     45545 ±  4%    +303.5%     183786 ± 18%  softirqs.CPU16.SCHED
     54794 ± 18%    +404.5%     276449 ±  9%  softirqs.CPU160.RCU
     45248 ±  3%    +356.2%     206408        softirqs.CPU160.SCHED
     56431 ± 17%    +402.2%     283391 ±  9%  softirqs.CPU161.RCU
     45258 ±  3%    +356.5%     206609        softirqs.CPU161.SCHED
     50149 ± 16%    +394.1%     247814 ± 18%  softirqs.CPU162.RCU
     44263 ±  3%    +363.7%     205261 ±  2%  softirqs.CPU162.SCHED
     56212 ± 17%    +385.9%     273156 ±  9%  softirqs.CPU163.RCU
     44865 ±  3%    +359.1%     205966 ±  2%  softirqs.CPU163.SCHED
     56988 ± 22%    +399.2%     284493 ±  9%  softirqs.CPU164.RCU
     45379 ±  2%    +355.2%     206584        softirqs.CPU164.SCHED
     54719 ± 15%    +390.0%     268124 ± 13%  softirqs.CPU165.RCU
     44588 ±  3%    +361.1%     205613 ±  2%  softirqs.CPU165.SCHED
     58206 ± 18%    +373.3%     275474 ± 18%  softirqs.CPU166.RCU
     44633 ±  3%    +362.5%     206428        softirqs.CPU166.SCHED
     57704 ± 17%    +395.9%     286158 ± 10%  softirqs.CPU167.RCU
     45202 ±  2%    +356.6%     206389 ±  2%  softirqs.CPU167.SCHED
     55062 ± 14%    +354.5%     250266 ± 17%  softirqs.CPU168.RCU
     42774 ± 17%    +348.3%     191774 ± 18%  softirqs.CPU168.SCHED
     51581 ± 16%    +352.2%     233273 ± 12%  softirqs.CPU169.RCU
     45634 ±  3%    +357.5%     208756        softirqs.CPU169.SCHED
    109.33 ±150%   +2088.3%       2392 ±157%  softirqs.CPU169.TIMER
     51076 ±  8%    +400.3%     255559 ± 22%  softirqs.CPU17.RCU
     43946 ±  8%    +355.4%     200130 ±  3%  softirqs.CPU17.SCHED
     49451 ± 11%    +385.0%     239833 ± 13%  softirqs.CPU170.RCU
     45525 ±  3%    +357.1%     208092        softirqs.CPU170.SCHED
     57199 ± 17%    +349.3%     257006 ±  9%  softirqs.CPU171.RCU
     45644 ±  3%    +355.7%     208002        softirqs.CPU171.SCHED
     17.67 ± 42%  +36935.8%       6543 ±219%  softirqs.CPU171.TIMER
     55843 ± 18%    +347.9%     250126 ±  8%  softirqs.CPU172.RCU
     45312 ±  4%    +358.8%     207902        softirqs.CPU172.SCHED
     56791 ± 17%    +357.4%     259792 ±  8%  softirqs.CPU173.RCU
     45497 ±  3%    +356.9%     207893        softirqs.CPU173.SCHED
     56186 ± 17%    +357.9%     257270 ±  9%  softirqs.CPU174.RCU
     45426 ±  3%    +357.6%     207862        softirqs.CPU174.SCHED
     54313 ± 14%    +354.2%     246718 ±  8%  softirqs.CPU175.RCU
     45485 ±  3%    +356.4%     207576        softirqs.CPU175.SCHED
     57429 ± 18%    +392.5%     282841 ± 17%  softirqs.CPU176.RCU
     45934 ±  3%    +352.6%     207919        softirqs.CPU176.SCHED
     57061 ± 13%    +377.7%     272553 ± 14%  softirqs.CPU177.RCU
     45238 ±  4%    +359.9%     208050        softirqs.CPU177.SCHED
     59204 ± 16%    +390.7%     290508 ± 11%  softirqs.CPU178.RCU
     44756 ±  4%    +364.7%     207983        softirqs.CPU178.SCHED
     61089 ± 16%    +381.9%     294400 ± 12%  softirqs.CPU179.RCU
     45622 ±  3%    +356.1%     208097        softirqs.CPU179.SCHED
     53248 ±  7%    +389.6%     260710 ± 20%  softirqs.CPU18.RCU
     42303 ± 15%    +380.1%     203100 ±  3%  softirqs.CPU18.SCHED
     56495 ± 11%    +381.1%     271819 ± 12%  softirqs.CPU180.RCU
     45165 ±  4%    +324.4%     191661 ± 18%  softirqs.CPU180.SCHED
     56109 ± 12%    +374.0%     265983 ± 12%  softirqs.CPU181.RCU
     45113 ±  3%    +360.7%     207829        softirqs.CPU181.SCHED
     61889 ± 16%    +361.8%     285815 ±  9%  softirqs.CPU182.RCU
     45606 ±  3%    +356.1%     208024        softirqs.CPU182.SCHED
     57114 ± 11%    +389.6%     279620 ± 16%  softirqs.CPU183.RCU
     45233 ±  4%    +344.6%     201088 ±  7%  softirqs.CPU183.SCHED
     61548 ± 15%    +375.1%     292441 ± 12%  softirqs.CPU184.RCU
     45836 ±  2%    +360.2%     210937 ±  3%  softirqs.CPU184.SCHED
     63265 ± 17%    +376.7%     301557 ± 13%  softirqs.CPU185.RCU
     45427 ±  3%    +387.2%     221324 ± 14%  softirqs.CPU185.SCHED
     55427 ±  8%    +393.6%     273596 ± 19%  softirqs.CPU186.RCU
     45019 ±  5%    +371.4%     212211 ±  4%  softirqs.CPU186.SCHED
     61836 ± 16%    +375.6%     294062 ± 18%  softirqs.CPU187.RCU
     45495 ±  4%    +389.6%     222739 ± 14%  softirqs.CPU187.SCHED
     63091 ± 18%    +363.7%     292538 ± 17%  softirqs.CPU188.RCU
     45246 ±  3%    +369.7%     212530 ±  4%  softirqs.CPU188.SCHED
     60039 ± 14%    +365.2%     279312 ± 15%  softirqs.CPU189.RCU
     45293 ±  3%    +372.8%     214132 ±  6%  softirqs.CPU189.SCHED
     49889 ±  7%    +395.7%     247286 ± 23%  softirqs.CPU19.RCU
     44310 ±  4%    +356.3%     202195        softirqs.CPU19.SCHED
     61474 ± 17%    +369.3%     288500 ± 23%  softirqs.CPU190.RCU
     45783 ±  3%    +395.9%     227022 ± 18%  softirqs.CPU190.SCHED
     56580 ± 15%    +392.8%     278821 ± 13%  softirqs.CPU191.RCU
     38811 ± 25%    +284.3%     149137 ± 26%  softirqs.CPU191.SCHED
     68047 ±  9%    +304.3%     275101 ± 22%  softirqs.CPU2.RCU
     45157 ± 18%    +355.3%     205616 ±  4%  softirqs.CPU2.SCHED
     51325 ±  2%    +392.8%     252926 ± 22%  softirqs.CPU20.RCU
     44653 ±  4%    +347.1%     199634 ±  3%  softirqs.CPU20.SCHED
     50340 ±  7%    +386.5%     244919 ± 20%  softirqs.CPU21.RCU
     41791 ± 16%    +371.4%     197016 ±  3%  softirqs.CPU21.SCHED
     51067 ±  8%    +390.5%     250469 ± 22%  softirqs.CPU22.RCU
     42769 ± 14%    +366.6%     199543 ±  3%  softirqs.CPU22.SCHED
     51188 ±  6%    +387.8%     249670 ± 24%  softirqs.CPU23.RCU
     44890 ±  3%    +345.1%     199786 ±  3%  softirqs.CPU23.SCHED
     52297 ± 10%    +357.2%     239089 ± 16%  softirqs.CPU24.RCU
     46179 ±  2%    +348.4%     207072 ±  3%  softirqs.CPU24.SCHED
     47969 ± 10%    +360.0%     220664 ± 14%  softirqs.CPU25.RCU
     45420 ±  3%    +351.8%     205216 ±  2%  softirqs.CPU25.SCHED
     82.33 ±127%   +6649.8%       5557 ±137%  softirqs.CPU25.TIMER
     49379 ± 10%    +358.5%     226384 ± 14%  softirqs.CPU26.RCU
     45515 ±  3%    +357.8%     208350 ±  4%  softirqs.CPU26.SCHED
     20.50 ± 97%  +33919.5%       6974 ±139%  softirqs.CPU26.TIMER
     55152 ± 11%    +329.1%     236637 ± 14%  softirqs.CPU27.RCU
     45778 ±  3%    +349.3%     205684 ±  2%  softirqs.CPU27.SCHED
     54946 ± 12%    +337.3%     240300 ± 13%  softirqs.CPU28.RCU
     42795 ± 11%    +383.6%     206975 ±  2%  softirqs.CPU28.SCHED
     55072 ± 13%    +317.2%     229748 ± 10%  softirqs.CPU29.RCU
     46681 ±  5%    +341.5%     206110        softirqs.CPU29.SCHED
     64262 ±  6%    +353.4%     291339 ± 21%  softirqs.CPU3.RCU
     45244 ±  3%    +352.0%     204498 ±  4%  softirqs.CPU3.SCHED
     52963 ± 10%    +330.5%     228029 ± 14%  softirqs.CPU30.RCU
     44973 ±  3%    +364.7%     209004 ±  5%  softirqs.CPU30.SCHED
     47012 ± 15%    +360.5%     216483 ± 15%  softirqs.CPU31.RCU
     48839 ± 12%    +320.1%     205164 ±  3%  softirqs.CPU31.SCHED
     62062 ±  9%    +344.0%     275539 ± 14%  softirqs.CPU32.RCU
     44656 ±  3%    +359.3%     205125 ±  2%  softirqs.CPU32.SCHED
     64600 ± 14%    +318.1%     270075 ± 17%  softirqs.CPU33.RCU
     44995 ±  3%    +356.5%     205428 ±  2%  softirqs.CPU33.SCHED
     62063 ± 11%    +358.6%     284614 ± 11%  softirqs.CPU34.RCU
     46874 ±  6%    +336.9%     204784 ±  2%  softirqs.CPU34.SCHED
     64581 ± 13%    +353.8%     293098 ± 11%  softirqs.CPU35.RCU
     46826 ±  7%    +342.6%     207236 ±  3%  softirqs.CPU35.SCHED
     62382 ± 14%    +378.1%     298226 ± 11%  softirqs.CPU36.RCU
     49083 ± 16%    +319.3%     205786 ±  2%  softirqs.CPU36.SCHED
     58767 ±  6%    +359.5%     270030 ± 12%  softirqs.CPU37.RCU
     45319 ±  3%    +350.7%     204245 ±  2%  softirqs.CPU37.SCHED
     61252 ±  9%    +353.6%     277816 ± 10%  softirqs.CPU38.RCU
     45140 ±  3%    +352.4%     204200 ±  2%  softirqs.CPU38.SCHED
     64814 ± 14%    +345.4%     288672 ±  8%  softirqs.CPU39.RCU
     45445 ±  3%    +352.5%     205627 ±  2%  softirqs.CPU39.SCHED
     72447 ± 15%    +322.2%     305901 ± 18%  softirqs.CPU4.RCU
     48515 ±  3%    +438.5%     261238 ± 11%  softirqs.CPU4.SCHED
     60628 ±  8%    +360.2%     278994 ± 10%  softirqs.CPU40.RCU
     44990 ±  3%    +358.8%     206425 ±  3%  softirqs.CPU40.SCHED
     66477 ± 14%    +356.4%     303430 ± 11%  softirqs.CPU41.RCU
     45648 ±  3%    +354.4%     207413 ±  3%  softirqs.CPU41.SCHED
     67773 ± 17%    +326.5%     289049 ± 19%  softirqs.CPU42.RCU
     42284 ± 15%    +386.9%     205884        softirqs.CPU42.SCHED
     66206 ± 14%    +336.1%     288703 ± 13%  softirqs.CPU43.RCU
     45434 ±  3%    +351.9%     205307 ±  2%  softirqs.CPU43.SCHED
     11.67 ± 25%  +46575.7%       5445 ±194%  softirqs.CPU43.TIMER
     66411 ± 16%    +344.1%     294945 ± 11%  softirqs.CPU44.RCU
     45627 ±  2%    +351.2%     205878        softirqs.CPU44.SCHED
     63997 ± 12%    +352.1%     289319 ± 10%  softirqs.CPU45.RCU
     45702 ±  3%    +349.2%     205309 ±  2%  softirqs.CPU45.SCHED
     66475 ± 16%    +354.3%     302004 ± 11%  softirqs.CPU46.RCU
     45399 ±  4%    +353.2%     205728 ±  2%  softirqs.CPU46.SCHED
     64940 ± 13%    +338.2%     284588 ± 15%  softirqs.CPU47.RCU
     45948 ±  3%    +347.1%     205433 ±  2%  softirqs.CPU47.SCHED
     60645 ± 17%    +359.7%     278803 ± 20%  softirqs.CPU48.RCU
     45368 ±  2%    +353.2%     205613 ±  2%  softirqs.CPU48.SCHED
     59256 ± 12%    +360.7%     272994 ± 16%  softirqs.CPU49.RCU
     45210 ±  3%    +354.9%     205646 ±  2%  softirqs.CPU49.SCHED
     68114 ± 14%    +327.1%     290884 ± 20%  softirqs.CPU5.RCU
     56403 ± 51%    +245.9%     195106 ± 17%  softirqs.CPU5.SCHED
     57773 ±  9%    +361.9%     266846 ± 16%  softirqs.CPU50.RCU
     42648 ± 16%    +381.4%     205329 ±  2%  softirqs.CPU50.SCHED
     63894 ± 16%    +354.5%     290411 ± 12%  softirqs.CPU51.RCU
     45821 ±  4%    +345.1%     203948 ±  3%  softirqs.CPU51.SCHED
     62871 ± 17%    +357.0%     287303 ± 12%  softirqs.CPU52.RCU
     45508 ±  2%    +352.9%     206120        softirqs.CPU52.SCHED
     67967 ± 15%    +324.9%     288781 ± 12%  softirqs.CPU53.RCU
     47032 ± 10%    +303.8%     189894 ± 19%  softirqs.CPU53.SCHED
     65244 ± 15%    +333.5%     282855 ± 12%  softirqs.CPU54.RCU
     45663 ±  3%    +347.0%     204113 ±  3%  softirqs.CPU54.SCHED
     59563 ± 16%    +390.3%     292045 ± 13%  softirqs.CPU55.RCU
     45424 ±  3%    +352.5%     205550 ±  2%  softirqs.CPU55.SCHED
     68697 ± 16%    +336.1%     299594 ± 11%  softirqs.CPU56.RCU
     47117 ± 11%    +337.2%     206013        softirqs.CPU56.SCHED
     62397 ± 12%    +363.5%     289229 ± 14%  softirqs.CPU57.RCU
     42533 ± 12%    +344.9%     189219 ± 18%  softirqs.CPU57.SCHED
     64451 ± 16%    +376.4%     307026 ± 11%  softirqs.CPU58.RCU
     45128 ±  4%    +354.9%     205272        softirqs.CPU58.SCHED
     67900 ± 14%    +353.2%     307718 ± 10%  softirqs.CPU59.RCU
     46343 ±  8%    +345.0%     206239        softirqs.CPU59.SCHED
     63234 ±  6%    +356.1%     288392 ± 22%  softirqs.CPU6.RCU
     44442 ±  7%    +359.3%     204137 ±  4%  softirqs.CPU6.SCHED
     59115 ±  9%    +378.5%     282874 ± 16%  softirqs.CPU60.RCU
     45396 ±  3%    +352.0%     205203 ±  2%  softirqs.CPU60.SCHED
     59494 ±  9%    +368.0%     278421 ± 14%  softirqs.CPU61.RCU
     45655 ±  3%    +349.7%     205298 ±  2%  softirqs.CPU61.SCHED
     65960 ± 14%    +341.6%     291281 ± 11%  softirqs.CPU62.RCU
     46434 ±  6%    +344.1%     206206        softirqs.CPU62.SCHED
     61572 ± 10%    +339.5%     270610 ± 20%  softirqs.CPU63.RCU
     40841 ± 19%    +403.7%     205723 ±  2%  softirqs.CPU63.SCHED
     64.83 ±124%   +8867.4%       5813 ±162%  softirqs.CPU63.TIMER
     55899 ± 17%    +402.1%     280642 ± 10%  softirqs.CPU64.RCU
     45271 ±  3%    +354.9%     205920 ±  2%  softirqs.CPU64.SCHED
     56599 ± 19%    +404.9%     285780 ±  9%  softirqs.CPU65.RCU
     45115 ±  3%    +357.2%     206261        softirqs.CPU65.SCHED
     50803 ± 16%    +402.1%     255070 ± 20%  softirqs.CPU66.RCU
     45109 ±  2%    +355.2%     205323 ±  2%  softirqs.CPU66.SCHED
     57587 ± 17%    +387.2%     280551 ± 11%  softirqs.CPU67.RCU
     44830 ±  2%    +359.2%     205864 ±  2%  softirqs.CPU67.SCHED
     58698 ± 20%    +392.8%     289238 ±  9%  softirqs.CPU68.RCU
     45091 ±  3%    +357.3%     206205        softirqs.CPU68.SCHED
     55763 ± 16%    +391.3%     273967 ± 13%  softirqs.CPU69.RCU
     45122 ±  2%    +356.5%     205996 ±  2%  softirqs.CPU69.SCHED
     67476 ± 16%    +369.9%     317099 ± 15%  softirqs.CPU7.RCU
     46833 ±  5%    +389.0%     229008 ± 27%  softirqs.CPU7.SCHED
     58868 ± 17%    +376.5%     280531 ± 17%  softirqs.CPU70.RCU
     45317 ±  2%    +354.2%     205815        softirqs.CPU70.SCHED
     58439 ± 18%    +395.2%     289404 ± 10%  softirqs.CPU71.RCU
     44994 ±  3%    +358.1%     206131 ±  2%  softirqs.CPU71.SCHED
     56194 ± 14%    +369.1%     263625 ± 15%  softirqs.CPU72.RCU
     45606 ±  2%    +365.5%     212316 ±  4%  softirqs.CPU72.SCHED
     53492 ± 15%    +384.8%     259308 ± 18%  softirqs.CPU73.RCU
     42384 ± 18%    +431.9%     225421 ± 17%  softirqs.CPU73.SCHED
     50421 ± 11%    +406.3%     255290 ± 15%  softirqs.CPU74.RCU
     45056 ±  3%    +365.8%     209866 ±  3%  softirqs.CPU74.SCHED
     58777 ± 18%    +365.5%     273592 ±  8%  softirqs.CPU75.RCU
     41914 ± 18%    +399.4%     209311 ±  2%  softirqs.CPU75.SCHED
     57403 ± 17%    +370.0%     269822 ± 10%  softirqs.CPU76.RCU
     45059 ±  3%    +385.7%     218874 ± 13%  softirqs.CPU76.SCHED
     58353 ± 16%    +361.4%     269221 ±  8%  softirqs.CPU77.RCU
     45602 ±  2%    +355.4%     207662 ±  2%  softirqs.CPU77.SCHED
     57557 ± 17%    +361.9%     265888 ±  8%  softirqs.CPU78.RCU
     45130 ±  3%    +360.3%     207718        softirqs.CPU78.SCHED
     55270 ± 15%    +382.6%     266740 ± 13%  softirqs.CPU79.RCU
     45451 ±  3%    +375.0%     215880 ±  9%  softirqs.CPU79.SCHED
     63442 ± 14%    +344.3%     281856 ± 23%  softirqs.CPU8.RCU
     45979 ±  9%    +338.6%     201664 ±  7%  softirqs.CPU8.SCHED
     60531 ± 15%    +351.2%     273091 ± 13%  softirqs.CPU80.RCU
     45469 ±  2%    +356.2%     207450        softirqs.CPU80.SCHED
     57455 ± 14%    +380.5%     276047 ± 14%  softirqs.CPU81.RCU
     45116 ±  2%    +359.3%     207237        softirqs.CPU81.SCHED
     61087 ± 16%    +395.8%     302853 ± 14%  softirqs.CPU82.RCU
     45382 ±  2%    +369.5%     213085 ±  5%  softirqs.CPU82.SCHED
     62548 ± 16%    +387.7%     305020 ± 13%  softirqs.CPU83.RCU
     45310 ±  2%    +356.8%     206982        softirqs.CPU83.SCHED
     57140 ± 11%    +384.5%     276871 ± 12%  softirqs.CPU84.RCU
     45086 ±  3%    +360.7%     207726        softirqs.CPU84.SCHED
     57323 ± 12%    +380.8%     275640 ± 13%  softirqs.CPU85.RCU
     44947 ±  3%    +367.6%     210170 ±  3%  softirqs.CPU85.SCHED
     61528 ± 23%    +379.2%     294822 ±  9%  softirqs.CPU86.RCU
     44995 ±  3%    +359.1%     206572        softirqs.CPU86.SCHED
     57346 ± 11%    +389.3%     280586 ± 16%  softirqs.CPU87.RCU
     45045 ±  3%    +365.4%     209654 ±  3%  softirqs.CPU87.SCHED
     62158 ± 16%    +363.4%     288048 ± 10%  softirqs.CPU88.RCU
     45696 ±  3%    +353.3%     207149        softirqs.CPU88.SCHED
     63807 ± 17%    +362.8%     295316 ± 10%  softirqs.CPU89.RCU
     44745 ±  3%    +362.3%     206843        softirqs.CPU89.SCHED
     60946 ±  9%    +379.3%     292107 ± 21%  softirqs.CPU9.RCU
     45163 ±  6%    +319.5%     189443 ± 16%  softirqs.CPU9.SCHED
     56147 ±  9%    +389.5%     274854 ± 18%  softirqs.CPU90.RCU
     45042 ±  3%    +358.9%     206712        softirqs.CPU90.SCHED
     63372 ± 16%    +352.6%     286837 ± 12%  softirqs.CPU91.RCU
     44906 ±  3%    +361.6%     207303        softirqs.CPU91.SCHED
     63607 ± 17%    +366.1%     296504 ± 15%  softirqs.CPU92.RCU
     45203 ±  3%    +358.6%     207307        softirqs.CPU92.SCHED
     60249 ± 14%    +363.4%     279200 ± 14%  softirqs.CPU93.RCU
     45105 ±  4%    +359.6%     207292        softirqs.CPU93.SCHED
     63877 ± 16%    +341.6%     282102 ± 18%  softirqs.CPU94.RCU
     45311 ±  3%    +320.0%     190313 ± 18%  softirqs.CPU94.SCHED
     59543 ± 15%    +376.4%     283663 ± 14%  softirqs.CPU95.RCU
     23940 ± 15%    +553.1%     156351 ± 36%  softirqs.CPU95.SCHED
     58260 ±  8%    +356.8%     266158 ± 27%  softirqs.CPU96.RCU
     41169 ± 11%    +363.7%     190900 ±  5%  softirqs.CPU96.SCHED
     54490 ± 11%    +388.3%     266082 ± 24%  softirqs.CPU97.RCU
     44509 ±  5%    +344.1%     197655 ±  3%  softirqs.CPU97.SCHED
     58098 ± 10%    +367.1%     271353 ± 24%  softirqs.CPU98.RCU
     43164 ±  6%    +315.5%     179359 ± 16%  softirqs.CPU98.SCHED
     58008 ±  9%    +391.1%     284903 ± 24%  softirqs.CPU99.RCU
     44783 ±  5%    +332.6%     193736 ±  3%  softirqs.CPU99.SCHED
     20297 ± 52%    +243.9%      69801 ± 33%  softirqs.NET_RX
  11324902 ± 10%    +366.3%   52803478 ± 11%  softirqs.RCU
   8624664 ±  3%    +357.9%   39489702        softirqs.SCHED
     64250 ±  2%    +284.5%     247050 ±  5%  softirqs.TIMER





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.16.0-rc8-00117-g1a61b300c09b" of type "text/plain" (173412 bytes)

View attachment "job-script" of type "text/plain" (8262 bytes)

View attachment "job.yaml" of type "text/plain" (5673 bytes)

View attachment "reproduce" of type "text/plain" (526 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ