lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Thu, 3 Mar 2022 16:33:10 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Tim Murray <timmurray@...gle.com>
Cc:     Jaegeuk Kim <jaegeuk@...nel.org>,
        LKML <linux-kernel@...r.kernel.org>,
        Linux Memory Management List <linux-mm@...ck.org>,
        lkp@...ts.01.org, lkp@...el.com, ying.huang@...el.com,
        feng.tang@...el.com, zhengjun.xing@...ux.intel.com,
        fengwei.yin@...el.com
Subject: [f2fs]  e4544b63a7:  aim7.jobs-per-min -26.7% regression


(please be noted we reported "[f2fs] ae7d29380b: aim7.jobs-per-min -29.5% regression"
on https://lists.01.org/hyperkitty/list/lkp@lists.01.org/thread/C7ZFECOTJH34SXUR6JFXZDCQDRPS27XP/
before when it's still on branch: jaegeuk-f2fs/dev-test,
now we still found it causing regression on linux-next/master, also we noticed there
is a fix commit "c7f91bd410290 f2fs: Restore rwsem lockdep support"
but we found regression not recovered on this fix, so we report again)


Greeting,

FYI, we noticed a -26.7% regression of aim7.jobs-per-min due to commit:


commit: e4544b63a7ee49e7fbebf35ece0a6acd3b9617ae ("f2fs: move f2fs to use reader-unfair rwsems")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master

in testcase: aim7
on test machine: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
with following parameters:

	disk: 4BRD_12G
	md: RAID0
	fs: f2fs
	test: sync_disk_rw
	load: 100
	cpufreq_governor: performance
	ucode: 0x500320a

test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/

In addition to that, the commit also has significant impact on the following tests:

+------------------+----------------------------------------------------------------------------------+
| testcase: change | aim7: aim7.jobs-per-min -28.4% regression                                        |
| test machine     | 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory  |
| test parameters  | cpufreq_governor=performance                                                     |
|                  | disk=4BRD_12G                                                                    |
|                  | fs=f2fs                                                                          |
|                  | load=100                                                                         |
|                  | md=RAID0                                                                         |
|                  | test=sync_disk_rw                                                                |
|                  | ucode=0x5003006                                                                  |
+------------------+----------------------------------------------------------------------------------+
| testcase: change | aim7: aim7.jobs-per-min -84.3% regression                                        |
| test machine     | 96 threads 2 sockets Ice Lake with 256G memory                                   |
| test parameters  | cpufreq_governor=performance                                                     |
|                  | disk=1BRD_48G                                                                    |
|                  | fs=f2fs                                                                          |
|                  | load=200                                                                         |
|                  | test=sync_disk_rw                                                                |
|                  | ucode=0xb000280                                                                  |
+------------------+----------------------------------------------------------------------------------+
| testcase: change | aim7: aim7.jobs-per-min -77.3% regression                                        |
| test machine     | 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory  |
| test parameters  | cpufreq_governor=performance                                                     |
|                  | disk=1BRD_48G                                                                    |
|                  | fs=f2fs                                                                          |
|                  | load=200                                                                         |
|                  | test=sync_disk_rw                                                                |
|                  | ucode=0xd000280                                                                  |
+------------------+----------------------------------------------------------------------------------+
| testcase: change | aim7: aim7.jobs-per-min -70.8% regression                                        |
| test machine     | 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory |
| test parameters  | cpufreq_governor=performance                                                     |
|                  | disk=1BRD_48G                                                                    |
|                  | fs=f2fs                                                                          |
|                  | load=200                                                                         |
|                  | test=sync_disk_rw                                                                |
|                  | ucode=0x7002302                                                                  |
+------------------+----------------------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/4BRD_12G/f2fs/x86_64-rhel-8.3/100/RAID0/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp9/sync_disk_rw/aim7/0x500320a

commit: 
  dd81e1c7d5 ("Merge tag 'powerpc-5.17-2' of git://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux")
  e4544b63a7 ("f2fs: move f2fs to use reader-unfair rwsems")

dd81e1c7d5fb126e e4544b63a7ee49e7fbebf35ece0 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      9978           -26.7%       7313 ±  2%  aim7.jobs-per-min
     60.15           +36.5%      82.11 ±  2%  aim7.time.elapsed_time
     60.15           +36.5%      82.11 ±  2%  aim7.time.elapsed_time.max
  86454336            -4.8%   82328562        aim7.time.file_system_outputs
   1260157           -38.4%     776761        aim7.time.involuntary_context_switches
      9671           +63.3%      15797 ±  3%  aim7.time.minor_page_faults
    632.42          +676.7%       4912 ±  2%  aim7.time.system_time
  31621531           +13.3%   35841551        aim7.time.voluntary_context_switches
 4.552e+09           -54.1%  2.091e+09 ±  2%  cpuidle..time
  38581492           -29.4%   27250516 ±  3%  cpuidle..usage
     86.88           -65.2%      30.24        iostat.cpu.idle
     12.86          +440.3%      69.50        iostat.cpu.system
     97.09           +24.1%     120.45 ±  2%  uptime.boot
      7319           -32.3%       4957 ±  3%  uptime.idle
     86.57           -57.9       28.64        mpstat.cpu.all.idle%
      0.08            +0.0        0.10 ±  3%  mpstat.cpu.all.soft%
     12.06           +57.9       69.96        mpstat.cpu.all.sys%
   4265528 ±  3%     -15.8%    3590110        numa-numastat.node0.local_node
   4301858 ±  2%     -15.5%    3635818        numa-numastat.node0.numa_hit
   4414095 ±  2%     -14.8%    3760555        numa-numastat.node1.local_node
   4457744 ±  2%     -14.9%    3794659        numa-numastat.node1.numa_hit
     86.33           -65.3%      30.00        vmstat.cpu.id
     12.00          +475.0%      69.00        vmstat.cpu.sy
    679863           -29.3%     480775        vmstat.io.bo
      9.33 ± 10%    +560.7%      61.67        vmstat.procs.r
   1131254           -25.2%     845926        vmstat.system.cs
    232063           +28.4%     297944 ±  7%  vmstat.system.in
     26261 ±  4%    +166.2%      69919 ±  6%  meminfo.Active
     20883 ±  5%    +195.6%      61737 ±  6%  meminfo.Active(anon)
      5377 ±  2%     +52.1%       8181 ±  2%  meminfo.Active(file)
     77019           +22.4%      94261 ±  4%  meminfo.AnonHugePages
     84083           -11.1%      74713        meminfo.Inactive(file)
     33624           +16.6%      39219        meminfo.Mapped
  18344714            -9.5%   16593518        meminfo.Memused
     30859 ±  3%    +148.3%      76619 ±  5%  meminfo.Shmem
    437.00 ± 39%    +302.9%       1760 ±  3%  meminfo.Writeback
  18346630            -9.5%   16594683        meminfo.max_used_kB
    475.33          +322.9%       2010        turbostat.Avg_MHz
     17.31           +55.0       72.30        turbostat.Busy%
      2753            +1.3%       2787        turbostat.Bzy_MHz
   4305528          +231.1%   14253828 ±  3%  turbostat.C1
      4.30 ±  2%      +3.5        7.78 ±  7%  turbostat.C1%
  34109110           -64.3%   12176611 ± 13%  turbostat.C1E
     78.72           -66.4       12.30 ± 50%  turbostat.C1E%
     55047 ± 43%   +1143.9%     684721 ± 63%  turbostat.C6
      0.56 ± 52%      +7.7        8.23 ± 66%  turbostat.C6%
     82.55           -69.2%      25.39 ±  7%  turbostat.CPU%c1
  14662404           +73.4%   25424942 ±  9%  turbostat.IRQ
     54.00            +8.6%      58.67        turbostat.PkgTmp
    159.42           +28.1%     204.27        turbostat.PkgWatt
     58.79            -1.8%      57.72        turbostat.RAMWatt
      4519 ± 20%     +48.1%       6692 ±  3%  numa-meminfo.node0.Active
      2973 ± 33%     +70.0%       5056 ±  2%  numa-meminfo.node0.Active(file)
     72916 ±  4%     +22.3%      89175 ±  4%  numa-meminfo.node0.AnonHugePages
     41387           -10.5%      37023        numa-meminfo.node0.Inactive(file)
      9562 ±  7%     +15.5%      11045        numa-meminfo.node0.KernelStack
      3322 ± 38%     +61.5%       5364 ±  2%  numa-meminfo.node0.PageTables
     21743          +190.8%      63230 ±  6%  numa-meminfo.node1.Active
     19338 ±  5%    +210.8%      60101 ±  7%  numa-meminfo.node1.Active(anon)
     42553           -11.4%      37720        numa-meminfo.node1.Inactive(file)
      8504 ±  8%     -17.5%       7015        numa-meminfo.node1.KernelStack
      1528 ± 19%    +751.7%      13020 ± 93%  numa-meminfo.node1.Mapped
      2959 ± 43%     -69.5%     901.67 ± 19%  numa-meminfo.node1.PageTables
     78251 ±  4%     -17.1%      64867 ±  2%  numa-meminfo.node1.SUnreclaim
     20024 ±  6%    +228.3%      65740 ±  6%  numa-meminfo.node1.Shmem
    352.67 ± 25%    +266.5%       1292 ± 14%  numa-meminfo.node1.Writeback
    733.67 ± 32%     +72.1%       1262 ±  2%  numa-vmstat.node0.nr_active_file
     10366           -10.2%       9309 ±  2%  numa-vmstat.node0.nr_inactive_file
      9567 ±  7%     +15.4%      11041        numa-vmstat.node0.nr_kernel_stack
    832.00 ± 37%     +60.7%       1337 ±  3%  numa-vmstat.node0.nr_page_table_pages
    733.67 ± 32%     +72.1%       1262 ±  2%  numa-vmstat.node0.nr_zone_active_file
     10364           -10.2%       9308 ±  2%  numa-vmstat.node0.nr_zone_inactive_file
      4451 ±  2%     -12.7%       3887 ±  3%  numa-vmstat.node0.nr_zone_write_pending
      4814 ±  5%    +211.5%      14996 ±  7%  numa-vmstat.node1.nr_active_anon
     10591           -10.3%       9498        numa-vmstat.node1.nr_inactive_file
      8514 ±  8%     -17.6%       7018        numa-vmstat.node1.nr_kernel_stack
    467.67 ± 27%    +615.3%       3345 ± 93%  numa-vmstat.node1.nr_mapped
    742.00 ± 43%     -69.4%     227.00 ± 19%  numa-vmstat.node1.nr_page_table_pages
      4986 ±  5%    +229.7%      16439 ±  6%  numa-vmstat.node1.nr_shmem
     19561 ±  4%     -17.1%      16215 ±  2%  numa-vmstat.node1.nr_slab_unreclaimable
     97.00 ± 30%    +219.6%     310.00 ±  2%  numa-vmstat.node1.nr_writeback
      4814 ±  5%    +211.5%      14996 ±  7%  numa-vmstat.node1.nr_zone_active_anon
     10589           -10.3%       9498        numa-vmstat.node1.nr_zone_inactive_file
   2767104 ±  7%     -10.2%    2484087 ± 10%  numa-vmstat.node1.numa_local
      5199 ±  4%    +196.8%      15433 ±  6%  proc-vmstat.nr_active_anon
      1323           +54.7%       2047 ±  2%  proc-vmstat.nr_active_file
  10796536            -4.7%   10285714        proc-vmstat.nr_dirtied
   2817394            +1.5%    2859147        proc-vmstat.nr_dirty_background_threshold
   5641678            +1.5%    5725285        proc-vmstat.nr_dirty_threshold
    668359            +1.5%     678413        proc-vmstat.nr_file_pages
  28347195            +1.5%   28766875        proc-vmstat.nr_free_pages
     67487            +2.3%      69016        proc-vmstat.nr_inactive_anon
     20963           -10.8%      18701        proc-vmstat.nr_inactive_file
      8659           +16.3%      10071        proc-vmstat.nr_mapped
      7694 ±  3%    +149.0%      19154 ±  5%  proc-vmstat.nr_shmem
     34245            -2.4%      33433        proc-vmstat.nr_slab_reclaimable
    109.67 ± 23%    +312.2%     452.00 ±  4%  proc-vmstat.nr_writeback
  10753492            -4.7%   10246115        proc-vmstat.nr_written
      5199 ±  4%    +196.8%      15433 ±  6%  proc-vmstat.nr_zone_active_anon
      1323           +54.7%       2047 ±  2%  proc-vmstat.nr_zone_active_file
     67487            +2.3%      69016        proc-vmstat.nr_zone_inactive_anon
     20963           -10.8%      18701        proc-vmstat.nr_zone_inactive_file
      7473 ±  3%      +9.8%       8202        proc-vmstat.nr_zone_write_pending
      2519 ±  2%    +238.6%       8528 ±  5%  proc-vmstat.numa_hint_faults
      1478 ±  2%    +298.8%       5897 ±  5%  proc-vmstat.numa_hint_faults_local
   8760986           -15.2%    7431885        proc-vmstat.numa_hit
   8681011           -15.3%    7352072        proc-vmstat.numa_local
    947.33 ±  4%     +82.8%       1731 ±  4%  proc-vmstat.numa_pages_migrated
      5655 ± 39%    +130.8%      13052        proc-vmstat.numa_pte_updates
     16049 ±  2%     +73.6%      27865 ±  4%  proc-vmstat.pgactivate
   8768768           -15.2%    7439827        proc-vmstat.pgalloc_normal
      9865           -36.6%       6252 ±  6%  proc-vmstat.pgdeactivate
    336322           +24.1%     417504        proc-vmstat.pgfault
   1715624            +2.7%    1762666        proc-vmstat.pgfree
    947.33 ±  4%     +82.8%       1731 ±  4%  proc-vmstat.pgmigrate_success
  43055686            -4.8%   41010292        proc-vmstat.pgpgout
     19077 ±  2%     +32.0%      25176        proc-vmstat.pgreuse
     19724           -37.6%      12300 ±  6%  proc-vmstat.pgrotated
 3.212e+09           +73.6%  5.575e+09        perf-stat.i.branch-instructions
  46408388           +19.9%   55635668        perf-stat.i.branch-misses
     18.37            +1.4       19.79        perf-stat.i.cache-miss-rate%
  71783743            -6.8%   66894966        perf-stat.i.cache-misses
  3.64e+08           -13.6%  3.143e+08 ±  2%  perf-stat.i.cache-references
   1175973           -26.2%     867946        perf-stat.i.context-switches
      2.56          +159.9%       6.67 ±  2%  perf-stat.i.cpi
 4.203e+10          +325.6%  1.789e+11        perf-stat.i.cpu-cycles
     28248          +272.5%     105225        perf-stat.i.cpu-migrations
      1418 ±  3%     +94.9%       2764 ±  5%  perf-stat.i.cycles-between-cache-misses
   3524200 ±  3%     +12.2%    3953541 ±  4%  perf-stat.i.dTLB-load-misses
 4.883e+09           +45.5%  7.104e+09        perf-stat.i.dTLB-loads
      0.01 ±  4%      +0.0        0.02 ± 40%  perf-stat.i.dTLB-store-miss-rate%
  2.07e+09           -19.5%  1.667e+09        perf-stat.i.dTLB-stores
     33.63            +4.0       37.60        perf-stat.i.iTLB-load-miss-rate%
   7946600           -23.5%    6080185 ±  2%  perf-stat.i.iTLB-load-misses
  15545961           -31.4%   10662684 ±  2%  perf-stat.i.iTLB-loads
 1.668e+10           +54.9%  2.583e+10        perf-stat.i.instructions
      2349           +76.8%       4154        perf-stat.i.instructions-per-iTLB-miss
      0.41           -57.1%       0.18 ±  4%  perf-stat.i.ipc
      2.10 ± 23%     -30.4%       1.46 ±  9%  perf-stat.i.major-faults
      0.48          +325.6%       2.03        perf-stat.i.metric.GHz
    119.62           +39.2%     166.50        perf-stat.i.metric.M/sec
     89.69            +0.9       90.55        perf-stat.i.node-load-miss-rate%
  32390308            -8.0%   29805668        perf-stat.i.node-load-misses
   2784797           -13.9%    2397028        perf-stat.i.node-loads
  13193625            -6.6%   12317889        perf-stat.i.node-store-misses
   1086843           -10.9%     968243        perf-stat.i.node-stores
     21.82           -44.2%      12.17        perf-stat.overall.MPKI
      1.45            -0.4        1.00        perf-stat.overall.branch-miss-rate%
     19.72            +1.6       21.28        perf-stat.overall.cache-miss-rate%
      2.52          +174.8%       6.93        perf-stat.overall.cpi
    585.53          +356.9%       2675 ±  2%  perf-stat.overall.cycles-between-cache-misses
      0.07 ±  2%      -0.0        0.06 ±  5%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ±  4%      +0.0        0.01 ± 13%  perf-stat.overall.dTLB-store-miss-rate%
     33.83            +2.5       36.32 ±  2%  perf-stat.overall.iTLB-load-miss-rate%
      2099          +102.5%       4251 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.40           -63.6%       0.14        perf-stat.overall.ipc
 3.158e+09           +74.4%  5.509e+09        perf-stat.ps.branch-instructions
  45638775           +20.4%   54971063        perf-stat.ps.branch-misses
  70571438            -6.3%   66107192        perf-stat.ps.cache-misses
 3.579e+08           -13.2%  3.106e+08 ±  2%  perf-stat.ps.cache-references
   1156109           -25.8%     857744        perf-stat.ps.context-switches
 4.132e+10          +327.8%  1.768e+11        perf-stat.ps.cpu-cycles
     27770          +274.5%     103989        perf-stat.ps.cpu-migrations
   3464601 ±  3%     +12.8%    3907119 ±  4%  perf-stat.ps.dTLB-load-misses
 4.801e+09           +46.2%   7.02e+09        perf-stat.ps.dTLB-loads
 2.035e+09           -19.1%  1.647e+09        perf-stat.ps.dTLB-stores
   7812679           -23.1%    6008510 ±  2%  perf-stat.ps.iTLB-load-misses
  15284035           -31.1%   10536964 ±  2%  perf-stat.ps.iTLB-loads
  1.64e+10           +55.7%  2.553e+10        perf-stat.ps.instructions
      2.07 ± 23%     -30.2%       1.44 ±  9%  perf-stat.ps.major-faults
  31843231            -7.5%   29454978        perf-stat.ps.node-load-misses
   2737765           -13.5%    2369026        perf-stat.ps.node-loads
  12970733            -6.2%   12172439        perf-stat.ps.node-store-misses
   1068457           -10.5%     956624        perf-stat.ps.node-stores
 1.005e+12          +110.9%   2.12e+12        perf-stat.total.instructions
     50.73           -38.5       12.25        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     50.09           -38.0       12.08        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     50.09           -38.0       12.08        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     50.07           -38.0       12.08        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     45.78           -34.8       10.96        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     45.70           -34.8       10.95        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     44.11           -33.8       10.29        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      5.57            -4.8        0.80        perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair.__schedule
      5.31 ±  4%      -4.5        0.79        perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair
      5.89 ±  2%      -3.9        2.01        perf-profile.calltrace.cycles-pp.load_balance.newidle_balance.pick_next_task_fair.__schedule.schedule
      4.49 ±  4%      -3.9        0.64        perf-profile.calltrace.cycles-pp.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      4.80 ±  6%      -3.5        1.34 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
      4.49 ±  6%      -3.3        1.20 ±  3%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      3.75 ±  7%      -2.8        0.96 ±  4%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data
      7.02 ±  5%      -2.2        4.83 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
      6.66 ±  5%      -2.0        4.71 ±  3%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      2.46 ±  2%      -1.6        0.86 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      2.17            -1.5        0.64 ±  3%  perf-profile.calltrace.cycles-pp.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.16            -1.5        0.64 ±  2%  perf-profile.calltrace.cycles-pp.find_get_pages_range_tag.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.04            -1.3        0.75 ±  3%  perf-profile.calltrace.cycles-pp.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.01            -1.3        0.73 ±  3%  perf-profile.calltrace.cycles-pp.schedule_timeout.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter
      1.97            -1.3        0.71 ±  2%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_for_completion.f2fs_issue_flush
      1.97            -1.2        0.72 ±  3%  perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file
      3.09            -1.1        1.95 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      1.70            -1.1        0.58 ±  2%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.wait_for_completion
      1.70            -1.1        0.58 ±  2%  perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.schedule_timeout
      1.42            -1.1        0.34 ± 70%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      1.39            -1.0        0.34 ± 70%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      1.63 ±  4%      -0.8        0.85 ± 70%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle
      2.79 ±  6%      -0.7        2.05 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      2.48 ±  6%      -0.6        1.87 ±  5%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page
      2.21            -0.5        1.68 ±  4%  perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page
      1.69            -0.2        1.49 ±  4%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page
      0.57 ±  9%      +0.2        0.82 ±  7%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter
      1.65 ±  4%      +0.3        1.94 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +0.6        0.59 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00            +0.6        0.59 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +0.6        0.60 ±  3%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond.f2fs_write_cache_pages
      0.20 ±141%      +0.6        0.80 ±  6%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file
      0.00            +0.7        0.74 ±  2%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.87 ±  5%      +0.8        1.63 ±  5%  perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      0.00            +0.8        0.78 ±  3%  perf-profile.calltrace.cycles-pp.__schedule.schedule.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00            +0.8        0.78 ±  3%  perf-profile.calltrace.cycles-pp.schedule.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      0.58 ±  5%      +0.9        1.43 ±  6%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data
      0.00            +1.0        1.03        perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00            +1.2        1.17 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00            +1.2        1.17 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page
      0.00            +1.2        1.17 ±  3%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.2        1.25 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00            +1.3        1.26 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +1.3        1.26 ±  2%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +1.3        1.28 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data
      0.00            +1.3        1.28 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      0.00            +1.3        1.29 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages
      0.00            +1.3        1.30 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00            +1.3        1.30 ±  4%  perf-profile.calltrace.cycles-pp.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      0.00            +1.3        1.31 ±  2%  perf-profile.calltrace.cycles-pp.__schedule.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.3        1.31 ±  2%  perf-profile.calltrace.cycles-pp.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      6.14 ±  3%      +1.4        7.53        perf-profile.calltrace.cycles-pp.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      6.13 ±  3%      +1.4        7.53        perf-profile.calltrace.cycles-pp.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.4        1.41 ±  3%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +1.6        1.56 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.6        1.56 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00            +1.6        1.57 ±  3%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +1.6        1.61        perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond
      0.00            +1.6        1.64 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +1.6        1.64 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page
      0.00            +1.6        1.65 ±  4%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00            +1.9        1.88 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +1.9        1.88 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00            +1.9        1.88 ±  4%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     15.20            +2.4       17.59        perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      9.66 ±  4%      +2.5       12.18 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
      9.46 ±  4%      +2.7       12.13 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      0.00            +2.8        2.77        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages
      2.60            +2.8        5.37 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00            +2.8        2.78        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.8        2.78        perf-profile.calltrace.cycles-pp.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      1.92 ±  2%      +3.2        5.14        perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +3.3        3.26 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page
      0.00            +3.3        3.27 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page
      0.00            +3.5        3.51 ±  2%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      0.00            +3.6        3.62        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page
      0.00            +3.6        3.63        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00            +3.6        3.65        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages
      0.00            +3.7        3.66        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +3.7        3.67        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +3.8        3.80 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00            +3.8        3.81 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +3.8        3.85 ±  3%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +4.1        4.06        perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.00 ±  2%      +4.7        6.74        perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +4.8        4.76        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00            +4.8        4.77        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +4.8        4.82        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +5.1        5.07        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page
      0.00            +5.1        5.08        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +5.1        5.14        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      1.75            +5.3        7.10 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
      2.42            +5.8        8.20        perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00            +5.8        5.85        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00            +5.9        5.87        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +5.9        5.92        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +6.8        6.82 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages
      0.00            +6.9        6.86 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00            +7.0        6.95 ±  3%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      2.87            +7.2       10.09 ±  3%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
     13.30 ±  3%      +9.2       22.51 ±  2%  perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     13.24 ±  3%      +9.2       22.48 ±  2%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     13.23 ±  3%      +9.3       22.48 ±  2%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
     13.21 ±  3%      +9.3       22.48 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file
     13.08 ±  3%      +9.4       22.43 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
      0.00           +17.5       17.52 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00           +17.6       17.57 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00           +17.7       17.74 ±  2%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.11           +21.0       23.11 ±  2%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     22.69           +25.7       48.42        perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     47.25           +39.9       87.15        perf-profile.calltrace.cycles-pp.write
     46.98           +40.1       87.05        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     46.97           +40.1       87.05        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     46.90           +40.1       87.02        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     46.88           +40.1       87.02        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     46.79           +40.2       87.00        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     46.77           +40.2       86.99        perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     45.22           +41.3       86.55        perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
     50.73           -38.5       12.25        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     50.73           -38.5       12.25        perf-profile.children.cycles-pp.cpu_startup_entry
     50.72           -38.5       12.25        perf-profile.children.cycles-pp.do_idle
     50.09           -38.0       12.08        perf-profile.children.cycles-pp.start_secondary
     46.36           -35.3       11.11        perf-profile.children.cycles-pp.cpuidle_enter
     46.35           -35.2       11.11        perf-profile.children.cycles-pp.cpuidle_enter_state
     44.82           -33.8       10.99        perf-profile.children.cycles-pp.intel_idle
     10.44           -10.4        0.00        perf-profile.children.cycles-pp.rwsem_down_read_slowpath
     12.98 ±  4%      -8.7        4.23 ±  2%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
     11.09            -6.0        5.06        perf-profile.children.cycles-pp.__schedule
      9.61            -5.0        4.56        perf-profile.children.cycles-pp.schedule
      4.56            -4.4        0.13 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      7.94            -4.2        3.70        perf-profile.children.cycles-pp.pick_next_task_fair
     10.18 ±  6%      -4.2        5.95        perf-profile.children.cycles-pp.osq_lock
      7.60 ±  6%      -4.2        3.40 ±  2%  perf-profile.children.cycles-pp.f2fs_submit_page_write
      7.44            -3.9        3.54        perf-profile.children.cycles-pp.newidle_balance
      4.51 ±  4%      -3.9        0.64        perf-profile.children.cycles-pp.set_node_addr
      6.43            -3.6        2.79        perf-profile.children.cycles-pp.find_busiest_group
      6.36            -3.6        2.75        perf-profile.children.cycles-pp.update_sd_lb_stats
      6.82            -3.6        3.26        perf-profile.children.cycles-pp.load_balance
      2.75            -2.5        0.21 ±  2%  perf-profile.children.cycles-pp.rwsem_wake
      7.02 ±  5%      -2.2        4.83 ±  3%  perf-profile.children.cycles-pp.f2fs_outplace_write_data
      2.23            -2.1        0.15 ±  5%  perf-profile.children.cycles-pp.wake_up_q
      2.39            -1.8        0.59 ±  2%  perf-profile.children.cycles-pp.submit_bio_noacct
      2.38            -1.8        0.59        perf-profile.children.cycles-pp.__submit_bio
      2.46 ±  2%      -1.6        0.86 ±  2%  perf-profile.children.cycles-pp.f2fs_issue_flush
      2.23            -1.6        0.66 ±  3%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      2.22            -1.6        0.66 ±  3%  perf-profile.children.cycles-pp.find_get_pages_range_tag
      2.58            -1.4        1.22        perf-profile.children.cycles-pp.try_to_wake_up
      2.05            -1.3        0.75 ±  3%  perf-profile.children.cycles-pp.wait_for_completion
      1.76            -1.3        0.46 ±  2%  perf-profile.children.cycles-pp.__submit_merged_bio
      2.01            -1.3        0.74 ±  2%  perf-profile.children.cycles-pp.schedule_timeout
      2.30 ±  2%      -1.2        1.05 ± 10%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      1.75            -1.2        0.53        perf-profile.children.cycles-pp.rwsem_spin_on_owner
      1.46 ±  2%      -1.0        0.44 ±  2%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      1.33 ±  2%      -1.0        0.35 ±  3%  perf-profile.children.cycles-pp.ret_from_fork
      1.33 ±  2%      -1.0        0.35 ±  3%  perf-profile.children.cycles-pp.kthread
      1.29            -1.0        0.31        perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      1.29            -1.0        0.34        perf-profile.children.cycles-pp.f2fs_buffered_write_iter
      1.27            -0.9        0.34        perf-profile.children.cycles-pp.generic_perform_write
      1.45            -0.9        0.52 ±  2%  perf-profile.children.cycles-pp.schedule_idle
      1.33            -0.9        0.44        perf-profile.children.cycles-pp.ttwu_do_activate
      1.48 ±  3%      -0.9        0.59 ±  2%  perf-profile.children.cycles-pp._raw_spin_lock
      4.75 ±  2%      -0.9        3.90 ±  4%  perf-profile.children.cycles-pp.f2fs_allocate_data_block
      1.29            -0.8        0.46        perf-profile.children.cycles-pp.enqueue_task_fair
      1.11 ±  2%      -0.8        0.29 ±  2%  perf-profile.children.cycles-pp.brd_submit_bio
      0.99            -0.8        0.18        perf-profile.children.cycles-pp.menu_select
      1.09 ±  2%      -0.8        0.29 ±  2%  perf-profile.children.cycles-pp.brd_do_bvec
      1.08 ±  2%      -0.8        0.31 ±  5%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      1.07 ±  2%      -0.8        0.30 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
      1.01            -0.7        0.34        perf-profile.children.cycles-pp.enqueue_entity
      0.98            -0.6        0.35 ±  2%  perf-profile.children.cycles-pp.sched_ttwu_pending
      1.15            -0.6        0.55 ±  2%  perf-profile.children.cycles-pp.dequeue_task_fair
      1.08 ±  2%      -0.6        0.50        perf-profile.children.cycles-pp.idle_cpu
      0.80 ±  4%      -0.5        0.26 ±  3%  perf-profile.children.cycles-pp.issue_flush_thread
      0.70 ±  3%      -0.5        0.18        perf-profile.children.cycles-pp.f2fs_write_begin
      0.99            -0.5        0.48        perf-profile.children.cycles-pp.dequeue_entity
      0.72            -0.5        0.23 ±  4%  perf-profile.children.cycles-pp.__pagevec_release
      0.67            -0.5        0.18 ±  2%  perf-profile.children.cycles-pp.f2fs_write_end_io
      0.71            -0.5        0.22 ±  5%  perf-profile.children.cycles-pp.release_pages
      0.67 ±  4%      -0.5        0.19 ±  6%  perf-profile.children.cycles-pp.folio_mark_dirty
      0.64 ±  6%      -0.5        0.17 ± 11%  perf-profile.children.cycles-pp.start_kernel
      0.50 ±  3%      -0.5        0.03 ± 70%  perf-profile.children.cycles-pp.ktime_get
      0.89            -0.4        0.44        perf-profile.children.cycles-pp.update_load_avg
      0.52            -0.4        0.09        perf-profile.children.cycles-pp.worker_thread
      0.57 ±  2%      -0.4        0.15 ±  3%  perf-profile.children.cycles-pp.brd_insert_page
      0.60 ±  3%      -0.4        0.24        perf-profile.children.cycles-pp.cpumask_next_and
      0.52            -0.4        0.16        perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.42 ±  4%      -0.4        0.07 ±  7%  perf-profile.children.cycles-pp.__lookup_nat_cache
      0.41 ±  3%      -0.3        0.07        perf-profile.children.cycles-pp.__submit_flush_wait
      0.41            -0.3        0.07        perf-profile.children.cycles-pp.blkdev_issue_flush
      0.68            -0.3        0.34 ±  2%  perf-profile.children.cycles-pp.mutex_spin_on_owner
      0.56 ±  2%      -0.3        0.23 ±  4%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.41 ±  4%      -0.3        0.08 ±  6%  perf-profile.children.cycles-pp.md_submit_bio
      0.44 ±  2%      -0.3        0.12 ±  8%  perf-profile.children.cycles-pp.__get_node_page
      0.40 ±  2%      -0.3        0.07        perf-profile.children.cycles-pp.submit_bio_wait
      0.45 ±  2%      -0.3        0.13 ± 12%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      0.45 ±  2%      -0.3        0.13 ± 12%  perf-profile.children.cycles-pp.filemap_dirty_folio
      0.45 ±  2%      -0.3        0.14 ±  3%  perf-profile.children.cycles-pp.xas_find_marked
      0.35            -0.3        0.06 ±  7%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.45            -0.3        0.16 ±  2%  perf-profile.children.cycles-pp.update_rq_clock
      0.50 ±  3%      -0.3        0.22 ±  2%  perf-profile.children.cycles-pp._find_next_bit
      0.39 ±  3%      -0.3        0.11 ±  4%  perf-profile.children.cycles-pp.folio_end_writeback
      0.34 ±  2%      -0.3        0.06        perf-profile.children.cycles-pp.md_handle_request
      0.43 ±  2%      -0.3        0.15 ± 11%  perf-profile.children.cycles-pp.__folio_start_writeback
      0.37 ±  2%      -0.3        0.09        perf-profile.children.cycles-pp.f2fs_write_end
      0.34            -0.3        0.06        perf-profile.children.cycles-pp.process_one_work
      0.39 ±  6%      -0.3        0.11 ± 11%  perf-profile.children.cycles-pp.f2fs_set_node_page_dirty
      0.37 ±  2%      -0.3        0.11 ±  4%  perf-profile.children.cycles-pp.f2fs_submit_merged_ipu_write
      0.36            -0.3        0.10 ±  4%  perf-profile.children.cycles-pp.f2fs_is_valid_blkaddr
      0.36 ±  7%      -0.3        0.10 ±  9%  perf-profile.children.cycles-pp.pagecache_get_page
      0.35            -0.3        0.10 ±  4%  perf-profile.children.cycles-pp.__folio_end_writeback
      0.35 ±  6%      -0.3        0.10 ±  8%  perf-profile.children.cycles-pp.__filemap_get_folio
      0.31 ±  4%      -0.2        0.06 ±  8%  perf-profile.children.cycles-pp.raid0_make_request
      0.29 ±  4%      -0.2        0.05        perf-profile.children.cycles-pp.__radix_tree_lookup
      0.41 ±  2%      -0.2        0.17 ±  2%  perf-profile.children.cycles-pp.tick_sched_timer
      0.36            -0.2        0.12 ±  4%  perf-profile.children.cycles-pp.up_read
      0.34 ±  2%      -0.2        0.10        perf-profile.children.cycles-pp.set_next_entity
      0.27            -0.2        0.03 ± 70%  perf-profile.children.cycles-pp.__list_add_valid
      0.38 ±  2%      -0.2        0.16 ±  5%  perf-profile.children.cycles-pp.tick_sched_handle
      0.31 ±  5%      -0.2        0.09        perf-profile.children.cycles-pp.down_write
      0.33 ±  6%      -0.2        0.11 ±  7%  perf-profile.children.cycles-pp.f2fs_update_data_blkaddr
      0.33 ±  6%      -0.2        0.11 ±  7%  perf-profile.children.cycles-pp.f2fs_set_data_blkaddr
      0.29 ±  3%      -0.2        0.07 ±  7%  perf-profile.children.cycles-pp.f2fs_write_inode
      0.28 ±  5%      -0.2        0.07 ±  7%  perf-profile.children.cycles-pp.f2fs_update_inode_page
      0.37 ±  3%      -0.2        0.16 ±  5%  perf-profile.children.cycles-pp.update_process_times
      0.28 ±  4%      -0.2        0.08 ±  6%  perf-profile.children.cycles-pp.update_sit_entry
      0.36 ±  2%      -0.2        0.16        perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.27 ±  3%      -0.2        0.07        perf-profile.children.cycles-pp.f2fs_set_data_page_dirty
      0.45 ±  3%      -0.2        0.25        perf-profile.children.cycles-pp.update_curr
      0.27 ±  3%      -0.2        0.08 ± 14%  perf-profile.children.cycles-pp.__folio_mark_dirty
      0.28            -0.2        0.09 ±  5%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.30 ±  2%      -0.2        0.12 ±  8%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.33 ±  2%      -0.2        0.16 ±  5%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.23 ±  2%      -0.2        0.06        perf-profile.children.cycles-pp.llist_add_batch
      0.22 ±  7%      -0.2        0.05        perf-profile.children.cycles-pp.mutex_lock
      0.24 ±  6%      -0.2        0.08        perf-profile.children.cycles-pp.__switch_to_asm
      0.44            -0.2        0.28        perf-profile.children.cycles-pp.finish_task_switch
      0.25            -0.2        0.09 ±  5%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.22 ±  2%      -0.2        0.06        perf-profile.children.cycles-pp.__smp_call_single_queue
      0.23 ±  3%      -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.native_sched_clock
      0.22 ±  3%      -0.2        0.07        perf-profile.children.cycles-pp.__switch_to
      0.22 ±  5%      -0.1        0.07        perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.19 ±  2%      -0.1        0.05        perf-profile.children.cycles-pp.llist_reverse_order
      0.18 ± 11%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.21 ±  6%      -0.1        0.07        perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.21 ±  2%      -0.1        0.08        perf-profile.children.cycles-pp.__alloc_pages
      0.30            -0.1        0.17 ±  2%  perf-profile.children.cycles-pp.complete
      0.16            -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.locate_dirty_segment
      0.19 ±  2%      -0.1        0.06 ±  7%  perf-profile.children.cycles-pp.up_write
      0.25            -0.1        0.13 ±  7%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.15 ±  8%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.__fput
      0.15 ±  8%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.__dentry_kill
      0.15 ±  8%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.evict
      0.20 ±  2%      -0.1        0.08 ±  6%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.21 ±  8%      -0.1        0.10 ±  4%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.14 ± 17%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.xas_load
      0.25 ±  5%      -0.1        0.14 ±  5%  perf-profile.children.cycles-pp.update_blocked_averages
      0.15 ±  8%      -0.1        0.05        perf-profile.children.cycles-pp.task_work_run
      0.15 ±  8%      -0.1        0.05        perf-profile.children.cycles-pp.__close
      0.15 ±  8%      -0.1        0.05        perf-profile.children.cycles-pp.dput
      0.16 ±  6%      -0.1        0.06 ±  8%  perf-profile.children.cycles-pp.cpuacct_charge
      0.20            -0.1        0.11 ±  8%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.20 ±  4%      -0.1        0.12 ±  4%  perf-profile.children.cycles-pp.scheduler_tick
      0.19 ±  4%      -0.1        0.11 ±  4%  perf-profile.children.cycles-pp.update_cfs_group
      0.25 ±  4%      -0.1        0.17        perf-profile.children.cycles-pp.swake_up_locked
      0.12            -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.prep_new_page
      0.12 ±  4%      -0.1        0.05        perf-profile.children.cycles-pp.kernel_init_free_pages
      0.12 ±  4%      -0.1        0.05        perf-profile.children.cycles-pp.clear_page_erms
      0.10 ±  4%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.reweight_entity
      0.22 ±  6%      -0.0        0.17 ±  8%  perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
      0.10 ±  4%      -0.0        0.05        perf-profile.children.cycles-pp.perf_tp_event
      0.10 ±  4%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.f2fs_wait_on_node_pages_writeback
      0.11 ±  7%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp.available_idle_cpu
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.set_task_cpu
      0.26            +0.1        0.31        perf-profile.children.cycles-pp.select_task_rq_fair
      0.00            +0.1        0.08 ±  6%  perf-profile.children.cycles-pp.task_tick_fair
      0.00            +0.1        0.08 ± 12%  perf-profile.children.cycles-pp.f2fs_wait_on_page_writeback
      0.00            +0.2        0.18        perf-profile.children.cycles-pp.select_idle_cpu
      0.02 ±141%      +0.2        0.21        perf-profile.children.cycles-pp.select_idle_sibling
      3.08 ±  2%      +0.2        3.31 ±  5%  perf-profile.children.cycles-pp.__mutex_lock
      0.00            +0.3        0.28 ±  4%  perf-profile.children.cycles-pp.down_read_trylock
      0.08 ± 27%      +0.3        0.40 ±  6%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.07 ±  6%      +0.9        0.97        perf-profile.children.cycles-pp.autoremove_wake_function
      0.08 ±  5%      +0.9        1.01        perf-profile.children.cycles-pp.__wake_up_common
      6.14 ±  3%      +1.4        7.53        perf-profile.children.cycles-pp.f2fs_do_write_node_page
     15.20            +2.4       17.59        perf-profile.children.cycles-pp.__write_node_page
      9.66 ±  4%      +2.5       12.18 ±  2%  perf-profile.children.cycles-pp.f2fs_write_single_data_page
      9.46 ±  4%      +2.7       12.13 ±  2%  perf-profile.children.cycles-pp.f2fs_do_write_data_page
      2.60            +2.8        5.37 ±  3%  perf-profile.children.cycles-pp.f2fs_need_inode_block_update
      2.00 ±  2%      +4.7        6.74        perf-profile.children.cycles-pp.f2fs_need_dentry_mark
      2.42            +5.8        8.20        perf-profile.children.cycles-pp.f2fs_is_checkpointed_node
      3.68            +8.6       12.25        perf-profile.children.cycles-pp.f2fs_get_node_info
     13.30 ±  3%      +9.2       22.51 ±  2%  perf-profile.children.cycles-pp.file_write_and_wait_range
     13.24 ±  3%      +9.2       22.48 ±  2%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
     13.23 ±  3%      +9.3       22.48 ±  2%  perf-profile.children.cycles-pp.do_writepages
     13.21 ±  3%      +9.3       22.48 ±  2%  perf-profile.children.cycles-pp.f2fs_write_data_pages
     13.08 ±  3%      +9.4       22.43 ±  2%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
      0.12 ±  8%     +10.1       10.18        perf-profile.children.cycles-pp.__wake_up_common_lock
      0.00           +11.6       11.63 ±  2%  perf-profile.children.cycles-pp.finish_wait
     22.69           +25.7       48.42        perf-profile.children.cycles-pp.f2fs_fsync_node_pages
      4.99           +28.3       33.28        perf-profile.children.cycles-pp.__submit_merged_write_cond
     47.29           +39.9       87.17        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     47.27           +39.9       87.16        perf-profile.children.cycles-pp.write
     47.28           +39.9       87.17        perf-profile.children.cycles-pp.do_syscall_64
     46.90           +40.1       87.03        perf-profile.children.cycles-pp.ksys_write
     46.88           +40.1       87.03        perf-profile.children.cycles-pp.vfs_write
     46.79           +40.2       87.00        perf-profile.children.cycles-pp.new_sync_write
     46.77           +40.2       86.99        perf-profile.children.cycles-pp.f2fs_file_write_iter
     45.22           +41.3       86.55        perf-profile.children.cycles-pp.f2fs_do_sync_file
      0.00           +48.2       48.15        perf-profile.children.cycles-pp.prepare_to_wait_event
      5.27           +64.0       69.27        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      1.81 ±  3%     +67.8       69.63        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     44.59           -33.7       10.92        perf-profile.self.cycles-pp.intel_idle
     10.09 ±  6%      -4.2        5.92        perf-profile.self.cycles-pp.osq_lock
      4.75            -2.7        2.05        perf-profile.self.cycles-pp.update_sd_lb_stats
      1.77            -1.2        0.52 ±  3%  perf-profile.self.cycles-pp.find_get_pages_range_tag
      1.71            -1.2        0.52        perf-profile.self.cycles-pp.rwsem_spin_on_owner
      1.33 ±  2%      -0.9        0.45 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.73            -0.6        0.15 ±  3%  perf-profile.self.cycles-pp.rwsem_down_write_slowpath
      1.06 ±  2%      -0.6        0.50        perf-profile.self.cycles-pp.idle_cpu
      0.72            -0.5        0.23 ±  3%  perf-profile.self.cycles-pp.__schedule
      0.56 ±  2%      -0.5        0.10        perf-profile.self.cycles-pp.menu_select
      0.67            -0.5        0.21 ±  5%  perf-profile.self.cycles-pp.release_pages
      0.68            -0.3        0.34 ±  2%  perf-profile.self.cycles-pp.mutex_spin_on_owner
      0.41            -0.3        0.09        perf-profile.self.cycles-pp.f2fs_fsync_node_pages
      0.45 ±  2%      -0.3        0.14 ±  3%  perf-profile.self.cycles-pp.xas_find_marked
      0.38 ±  2%      -0.3        0.10 ±  4%  perf-profile.self.cycles-pp.brd_do_bvec
      0.35 ±  2%      -0.3        0.08 ±  5%  perf-profile.self.cycles-pp.enqueue_entity
      0.46 ±  2%      -0.3        0.20 ±  4%  perf-profile.self.cycles-pp._find_next_bit
      0.35            -0.3        0.10 ±  4%  perf-profile.self.cycles-pp.f2fs_is_valid_blkaddr
      0.33 ± 22%      -0.2        0.09        perf-profile.self.cycles-pp.__percpu_counter_sum
      0.36            -0.2        0.12 ±  4%  perf-profile.self.cycles-pp.up_read
      0.29 ±  5%      -0.2        0.05        perf-profile.self.cycles-pp.__radix_tree_lookup
      0.26            -0.2        0.03 ± 70%  perf-profile.self.cycles-pp.__list_add_valid
      0.80 ±  4%      -0.2        0.57        perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.33            -0.2        0.12        perf-profile.self.cycles-pp.update_rq_clock
      0.28 ±  5%      -0.2        0.08 ±  6%  perf-profile.self.cycles-pp.update_sit_entry
      0.35 ±  3%      -0.2        0.15        perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.28 ±  4%      -0.2        0.08        perf-profile.self.cycles-pp.down_write
      0.28 ±  3%      -0.2        0.10 ±  4%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.23 ±  2%      -0.2        0.06        perf-profile.self.cycles-pp.llist_add_batch
      0.33            -0.2        0.16 ±  5%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.28 ±  5%      -0.2        0.12        perf-profile.self.cycles-pp.newidle_balance
      0.24 ±  6%      -0.2        0.08        perf-profile.self.cycles-pp.__switch_to_asm
      0.21 ±  4%      -0.2        0.06        perf-profile.self.cycles-pp.ttwu_queue_wakelist
      0.22 ±  2%      -0.2        0.07 ±  6%  perf-profile.self.cycles-pp.native_sched_clock
      0.22 ±  2%      -0.1        0.07        perf-profile.self.cycles-pp.__switch_to
      0.20 ±  8%      -0.1        0.05        perf-profile.self.cycles-pp.mutex_lock
      0.20 ±  2%      -0.1        0.05 ±  8%  perf-profile.self.cycles-pp.__filemap_get_folio
      0.19 ±  2%      -0.1        0.05        perf-profile.self.cycles-pp.llist_reverse_order
      0.21 ±  3%      -0.1        0.07 ±  7%  perf-profile.self.cycles-pp.f2fs_allocate_data_block
      0.21 ±  2%      -0.1        0.07 ±  7%  perf-profile.self.cycles-pp.f2fs_do_sync_file
      0.33 ±  4%      -0.1        0.19        perf-profile.self.cycles-pp.update_load_avg
      0.19 ±  4%      -0.1        0.07 ±  7%  perf-profile.self.cycles-pp.cpumask_next_and
      0.19 ±  2%      -0.1        0.06 ±  7%  perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
      0.19 ±  2%      -0.1        0.06 ±  7%  perf-profile.self.cycles-pp.up_write
      0.21 ±  8%      -0.1        0.09        perf-profile.self.cycles-pp.__update_load_avg_se
      0.16 ±  6%      -0.1        0.06 ±  8%  perf-profile.self.cycles-pp.cpuacct_charge
      0.14 ±  3%      -0.1        0.05        perf-profile.self.cycles-pp.dequeue_task_fair
      0.16 ±  2%      -0.1        0.08 ±  6%  perf-profile.self.cycles-pp.finish_task_switch
      0.18 ±  5%      -0.1        0.10 ±  4%  perf-profile.self.cycles-pp.update_cfs_group
      0.15 ±  5%      -0.1        0.07        perf-profile.self.cycles-pp.try_to_wake_up
      0.13 ±  9%      -0.1        0.06 ±  8%  perf-profile.self.cycles-pp.flush_smp_call_function_queue
      0.12 ±  4%      -0.1        0.05        perf-profile.self.cycles-pp.clear_page_erms
      0.26 ±  4%      -0.1        0.20 ±  2%  perf-profile.self.cycles-pp.load_balance
      0.15 ±  6%      -0.0        0.13 ±  3%  perf-profile.self.cycles-pp.update_curr
      0.11 ±  7%      +0.0        0.15 ±  5%  perf-profile.self.cycles-pp.available_idle_cpu
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.select_idle_cpu
      0.00            +0.2        0.24        perf-profile.self.cycles-pp.prepare_to_wait_event
      0.00            +0.3        0.28 ±  2%  perf-profile.self.cycles-pp.down_read_trylock
      5.26           +64.0       69.27        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath


***************************************************************************************************
lkp-csl-2sp9: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/4BRD_12G/f2fs/x86_64-rhel-8.3/100/RAID0/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp9/sync_disk_rw/aim7/0x5003006

commit: 
  dd81e1c7d5 ("Merge tag 'powerpc-5.17-2' of git://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux")
  e4544b63a7 ("f2fs: move f2fs to use reader-unfair rwsems")

dd81e1c7d5fb126e e4544b63a7ee49e7fbebf35ece0 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      9906           -28.4%       7090 ±  2%  aim7.jobs-per-min
     60.59           +39.8%      84.69 ±  2%  aim7.time.elapsed_time
     60.59           +39.8%      84.69 ±  2%  aim7.time.elapsed_time.max
  86565317            -4.6%   82609528        aim7.time.file_system_outputs
   1270786 ±  2%     -39.5%     768683 ±  2%  aim7.time.involuntary_context_switches
      9732           +62.3%      15792        aim7.time.minor_page_faults
    626.92 ±  2%    +714.1%       5103 ±  2%  aim7.time.system_time
  31655631           +15.7%   36625324        aim7.time.voluntary_context_switches
 4.614e+09           -54.1%   2.12e+09        cpuidle..time
  38849547           -27.2%   28280820        cpuidle..usage
     87.07           -65.4%      30.09        iostat.cpu.idle
     12.67 ±  3%    +449.7%      69.65        iostat.cpu.system
     86.75           -58.2       28.54        mpstat.cpu.all.idle%
     11.88 ±  3%     +58.2       70.08        mpstat.cpu.all.sys%
    100.27           +22.5%     122.80 ±  2%  uptime.boot
      7593 ±  2%     -34.6%       4968 ±  3%  uptime.idle
     34.99 ±  4%      -3.7%      33.68 ±  4%  boot-time.boot
     16.17 ±  9%      -7.7%      14.93 ± 10%  boot-time.dhcp
      2723 ±  4%      -4.0%       2614 ±  5%  boot-time.idle
   4253025           -14.0%    3657579 ±  3%  numa-numastat.node0.local_node
   4298702           -14.5%    3676699 ±  2%  numa-numastat.node0.numa_hit
   4388572 ±  2%     -17.3%    3627513 ±  3%  numa-numastat.node1.local_node
   4422807 ±  2%     -16.6%    3688297 ±  3%  numa-numastat.node1.numa_hit
     86.33           -65.6%      29.67        vmstat.cpu.id
     12.33 ±  3%    +459.5%      69.00        vmstat.cpu.sy
    673698           -30.8%     466051        vmstat.io.bo
      9.67 ±  9%    +551.7%      63.00        vmstat.procs.r
   1121558           -25.7%     833207        vmstat.system.cs
    234510 ±  2%     +32.6%     310900        vmstat.system.in
     25364 ±  4%    +203.9%      77087 ±  5%  meminfo.Active
     19734 ±  6%    +248.1%      68690 ±  7%  meminfo.Active(anon)
      5629 ±  4%     +49.1%       8395 ±  2%  meminfo.Active(file)
     80138 ±  2%     +22.7%      98298 ±  2%  meminfo.AnonHugePages
     83799           -10.1%      75348        meminfo.Inactive(file)
     33634           +17.9%      39639        meminfo.Mapped
  18358339           -10.3%   16476181        meminfo.Memused
     29667 ±  4%    +182.9%      83919 ±  6%  meminfo.Shmem
    358.33 ± 22%    +259.1%       1286 ± 33%  meminfo.Writeback
  18359748           -10.3%   16477422        meminfo.max_used_kB
    468.67 ±  2%    +331.7%       2023        turbostat.Avg_MHz
     17.07 ±  2%     +55.6       72.71        turbostat.Busy%
      2751            +1.4%       2789        turbostat.Bzy_MHz
   4252328 ±  2%    +232.4%   14135410        turbostat.C1
      4.18 ±  2%      +3.1        7.27        turbostat.C1%
  34437096           -60.3%   13661464 ±  3%  turbostat.C1E
     79.04           -62.4       16.60 ± 30%  turbostat.C1E%
     82.78           -68.2%      26.29 ±  6%  turbostat.CPU%c1
     53.00           +12.6%      59.67        turbostat.CoreTmp
  14972112           +83.1%   27413037        turbostat.IRQ
     53.00           +12.6%      59.67        turbostat.PkgTmp
    158.98           +28.9%     204.96        turbostat.PkgWatt
     58.54            -1.2%      57.85        turbostat.RAMWatt
     68548 ± 18%     +30.1%      89169 ± 10%  numa-meminfo.node0.AnonHugePages
   2609293           -32.7%    1756149 ± 57%  numa-meminfo.node0.FilePages
  10692310 ±  2%     -17.5%    8825889 ± 11%  numa-meminfo.node0.MemUsed
   2552310           -33.3%    1701845 ± 59%  numa-meminfo.node0.Unevictable
     20091 ±  6%    +253.4%      70995 ±  6%  numa-meminfo.node1.Active
     18324 ±  7%    +266.4%      67134 ±  6%  numa-meminfo.node1.Active(anon)
      1767 ±  6%    +118.5%       3861 ± 24%  numa-meminfo.node1.Active(file)
     62770 ±  2%   +1437.0%     964802 ±103%  numa-meminfo.node1.FilePages
     41410           -11.3%      36722        numa-meminfo.node1.Inactive(file)
     38431 ±  5%     +38.1%      53089 ± 31%  numa-meminfo.node1.KReclaimable
      1030 ±  7%   +1209.3%      13490 ± 87%  numa-meminfo.node1.Mapped
     38431 ±  5%     +38.1%      53089 ± 31%  numa-meminfo.node1.SReclaimable
     19088 ±  6%    +281.8%      72880 ±  7%  numa-meminfo.node1.Shmem
    106871 ±  5%     +18.2%     126282 ± 10%  numa-meminfo.node1.Slab
    175.33 ± 22%  +4.9e+05%     851161 ±118%  numa-meminfo.node1.Unevictable
    316.00 ± 26%    +156.1%     809.33 ± 33%  numa-meminfo.node1.Writeback
    652411           -32.7%     439050 ± 57%  numa-vmstat.node0.nr_file_pages
     10661            -9.5%       9645        numa-vmstat.node0.nr_inactive_file
    638077           -33.3%     425461 ± 59%  numa-vmstat.node0.nr_unevictable
     76.00 ± 31%    +190.8%     221.00 ± 19%  numa-vmstat.node0.nr_writeback
     10661            -9.5%       9645        numa-vmstat.node0.nr_zone_inactive_file
    638077           -33.3%     425461 ± 59%  numa-vmstat.node0.nr_zone_unevictable
      4845 ±  4%     -13.5%       4190 ±  4%  numa-vmstat.node0.nr_zone_write_pending
   3851529           -14.7%    3286217 ±  7%  numa-vmstat.node0.numa_hit
   3806477           -14.2%    3265483 ±  7%  numa-vmstat.node0.numa_local
      4564 ±  8%    +267.7%      16783 ±  6%  numa-vmstat.node1.nr_active_anon
    435.00 ±  3%    +121.8%     965.00 ± 24%  numa-vmstat.node1.nr_active_file
     15745 ±  2%   +1432.2%     241250 ±103%  numa-vmstat.node1.nr_file_pages
     10421           -11.5%       9224        numa-vmstat.node1.nr_inactive_file
    258.33 ±  7%   +1244.8%       3474 ± 86%  numa-vmstat.node1.nr_mapped
      4756 ±  7%    +283.1%      18219 ±  7%  numa-vmstat.node1.nr_shmem
      9591 ±  5%     +38.4%      13273 ± 31%  numa-vmstat.node1.nr_slab_reclaimable
     43.33 ± 23%  +4.9e+05%     212790 ±118%  numa-vmstat.node1.nr_unevictable
     73.33 ± 33%    +287.7%     284.33 ± 16%  numa-vmstat.node1.nr_writeback
      4564 ±  8%    +267.7%      16783 ±  6%  numa-vmstat.node1.nr_zone_active_anon
    435.00 ±  3%    +121.8%     965.00 ± 24%  numa-vmstat.node1.nr_zone_active_file
     10419           -11.5%       9224        numa-vmstat.node1.nr_zone_inactive_file
     43.33 ± 23%  +4.9e+05%     212790 ±118%  numa-vmstat.node1.nr_zone_unevictable
      4833 ±  6%     -14.6%       4126 ±  3%  numa-vmstat.node1.nr_zone_write_pending
      4934 ±  6%    +248.0%      17172 ±  7%  proc-vmstat.nr_active_anon
      1413 ±  4%     +48.5%       2098 ±  2%  proc-vmstat.nr_active_file
  10819468            -4.6%   10317972        proc-vmstat.nr_dirtied
   2815140            +1.7%    2862098        proc-vmstat.nr_dirty_background_threshold
   5637165            +1.7%    5731195        proc-vmstat.nr_dirty_threshold
    668051            +1.8%     680232        proc-vmstat.nr_file_pages
  28324567            +1.7%   28796253        proc-vmstat.nr_free_pages
     68055            +1.4%      69025        proc-vmstat.nr_inactive_anon
     20939           -10.1%      18822        proc-vmstat.nr_inactive_file
      8663           +17.3%      10159        proc-vmstat.nr_mapped
      7417 ±  4%    +182.9%      20979 ±  6%  proc-vmstat.nr_shmem
     34084            -1.6%      33522        proc-vmstat.nr_slab_reclaimable
     74.67 ± 47%    +431.7%     397.00 ± 25%  proc-vmstat.nr_writeback
  10776634            -4.6%   10277772        proc-vmstat.nr_written
      4934 ±  6%    +248.0%      17172 ±  7%  proc-vmstat.nr_zone_active_anon
      1413 ±  4%     +48.5%       2098 ±  2%  proc-vmstat.nr_zone_active_file
     68055            +1.4%      69025        proc-vmstat.nr_zone_inactive_anon
     20939           -10.1%      18822        proc-vmstat.nr_zone_inactive_file
      9111 ±  3%      -8.1%       8369        proc-vmstat.nr_zone_write_pending
      4296 ± 60%     +97.3%       8477 ±  2%  proc-vmstat.numa_hint_faults
      1576 ± 14%    +264.4%       5743 ±  4%  proc-vmstat.numa_hint_faults_local
   8723644           -15.6%    7366610        proc-vmstat.numa_hit
   8643732           -15.7%    7286707        proc-vmstat.numa_local
     15558 ±  4%     +92.4%      29936 ±  5%  proc-vmstat.pgactivate
   8731532           -15.5%    7374524        proc-vmstat.pgalloc_normal
      9875           -35.5%       6365 ±  5%  proc-vmstat.pgdeactivate
    340704           +24.9%     425445        proc-vmstat.pgfault
   1720430            +3.0%    1771822        proc-vmstat.pgfree
  43110466            -4.6%   41148513        proc-vmstat.pgpgout
     19123           +34.1%      25635 ±  3%  proc-vmstat.pgreuse
     19745           -36.7%      12508 ±  5%  proc-vmstat.pgrotated
     19.38           -30.3%      13.50 ± 23%  perf-stat.i.MPKI
 3.189e+09           +73.4%   5.53e+09        perf-stat.i.branch-instructions
  46555527 ±  2%     +18.7%   55278064        perf-stat.i.branch-misses
     18.27            +1.4       19.70        perf-stat.i.cache-miss-rate%
  70430074            -7.2%   65328234        perf-stat.i.cache-misses
 3.619e+08           -14.3%  3.103e+08        perf-stat.i.cache-references
   1169939           -26.8%     856977        perf-stat.i.context-switches
      2.54          +162.8%       6.66 ±  3%  perf-stat.i.cpi
 4.157e+10 ±  2%    +332.8%  1.799e+11        perf-stat.i.cpu-cycles
     27900          +279.3%     105823        perf-stat.i.cpu-migrations
      1319 ±  4%    +132.1%       3062 ±  7%  perf-stat.i.cycles-between-cache-misses
   3050049 ±  3%     +16.8%    3561030 ±  7%  perf-stat.i.dTLB-load-misses
 4.871e+09           +44.2%  7.026e+09        perf-stat.i.dTLB-loads
      0.01 ±  3%      +0.0        0.01 ± 53%  perf-stat.i.dTLB-store-miss-rate%
    168434 ±  6%     -10.5%     150827 ±  4%  perf-stat.i.dTLB-store-misses
 2.074e+09           -20.2%  1.655e+09        perf-stat.i.dTLB-stores
     33.12            +3.4       36.55 ±  2%  perf-stat.i.iTLB-load-miss-rate%
   7805140           -23.4%    5979299 ±  4%  perf-stat.i.iTLB-load-misses
  15708273           -34.1%   10356852 ±  2%  perf-stat.i.iTLB-loads
 1.658e+10           +54.2%  2.556e+10        perf-stat.i.instructions
      2348 ±  2%     +80.3%       4234 ±  3%  perf-stat.i.instructions-per-iTLB-miss
      0.41           -56.6%       0.18 ±  5%  perf-stat.i.ipc
      2.13 ± 11%     -28.9%       1.52 ±  5%  perf-stat.i.major-faults
      0.47 ±  2%    +332.8%       2.04        perf-stat.i.metric.GHz
    767.32           -11.6%     678.07 ±  4%  perf-stat.i.metric.K/sec
    119.24           +38.3%     164.97        perf-stat.i.metric.M/sec
  32026246            -7.8%   29524133        perf-stat.i.node-load-misses
   2741192           -14.1%    2355999        perf-stat.i.node-loads
  13057055            -6.5%   12207837        perf-stat.i.node-store-misses
   1090894           -12.8%     951653        perf-stat.i.node-stores
     21.83           -44.4%      12.14        perf-stat.overall.MPKI
      1.46            -0.5        1.00        perf-stat.overall.branch-miss-rate%
     19.46            +1.6       21.05        perf-stat.overall.cache-miss-rate%
      2.51          +180.7%       7.04        perf-stat.overall.cpi
    590.22          +366.6%       2754        perf-stat.overall.cycles-between-cache-misses
      0.06 ±  2%      -0.0        0.05 ±  7%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ±  5%      +0.0        0.01 ±  3%  perf-stat.overall.dTLB-store-miss-rate%
     33.20            +3.4       36.59        perf-stat.overall.iTLB-load-miss-rate%
      2124          +101.5%       4281 ±  3%  perf-stat.overall.instructions-per-iTLB-miss
      0.40           -64.4%       0.14        perf-stat.overall.ipc
 3.136e+09           +74.3%  5.467e+09        perf-stat.ps.branch-instructions
  45795098 ±  2%     +19.3%   54641207        perf-stat.ps.branch-misses
  69278385            -6.8%   64589920        perf-stat.ps.cache-misses
  3.56e+08           -13.8%  3.068e+08        perf-stat.ps.cache-references
   1150809           -26.4%     847302        perf-stat.ps.context-switches
 4.089e+10 ±  2%    +335.0%  1.779e+11        perf-stat.ps.cpu-cycles
     27444          +281.3%     104632        perf-stat.ps.cpu-migrations
   3000171 ±  3%     +17.4%    3522315 ±  7%  perf-stat.ps.dTLB-load-misses
 4.791e+09           +45.0%  6.947e+09        perf-stat.ps.dTLB-loads
    165678 ±  6%     -10.0%     149175 ±  4%  perf-stat.ps.dTLB-store-misses
  2.04e+09           -19.8%  1.636e+09        perf-stat.ps.dTLB-stores
   7677575           -23.0%    5911409 ±  3%  perf-stat.ps.iTLB-load-misses
  15451579           -33.7%   10239236 ±  2%  perf-stat.ps.iTLB-loads
 1.631e+10           +55.0%  2.527e+10        perf-stat.ps.instructions
      2.10 ± 11%     -28.7%       1.50 ±  5%  perf-stat.ps.major-faults
  31502576            -7.3%   29190451        perf-stat.ps.node-load-misses
   2696363           -13.6%    2329952        perf-stat.ps.node-loads
  12843536            -6.0%   12069090        perf-stat.ps.node-store-misses
   1073039           -12.3%     940643        perf-stat.ps.node-stores
  1.01e+12          +113.8%   2.16e+12        perf-stat.total.instructions
     50.96           -38.7       12.26        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     50.27           -38.1       12.13        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     50.26           -38.1       12.13        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     50.24           -38.1       12.12        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     45.97           -35.0       10.99        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     45.89           -34.9       10.99        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     44.30           -34.0       10.29        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      5.69 ±  3%      -4.9        0.76 ±  2%  perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair.__schedule
      5.42 ±  8%      -4.7        0.75 ±  2%  perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair
      6.03 ±  3%      -4.4        1.60 ± 17%  perf-profile.calltrace.cycles-pp.load_balance.newidle_balance.pick_next_task_fair.__schedule.schedule
      4.52 ±  6%      -3.8        0.70 ±  2%  perf-profile.calltrace.cycles-pp.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      4.25 ±  6%      -3.7        0.54 ±  4%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      4.58 ±  5%      -3.4        1.22 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
      4.25 ±  5%      -3.2        1.09 ±  6%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      3.52 ±  6%      -2.6        0.88 ±  7%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data
      6.81 ±  4%      -2.5        4.34 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
      6.45 ±  4%      -2.2        4.23 ±  6%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      2.50 ±  4%      -1.7        0.84 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      2.19            -1.6        0.62 ±  5%  perf-profile.calltrace.cycles-pp.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.18            -1.6        0.62 ±  5%  perf-profile.calltrace.cycles-pp.find_get_pages_range_tag.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.09 ±  4%      -1.3        0.75 ±  3%  perf-profile.calltrace.cycles-pp.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.05 ±  4%      -1.3        0.73 ±  2%  perf-profile.calltrace.cycles-pp.schedule_timeout.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter
      2.00 ±  4%      -1.3        0.71 ±  3%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_for_completion.f2fs_issue_flush
      2.01 ±  4%      -1.3        0.72 ±  3%  perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file
      1.72 ±  4%      -1.1        0.57 ±  3%  perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.schedule_timeout
      2.90 ±  4%      -1.1        1.76 ±  8%  perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      1.72 ±  4%      -1.1        0.58 ±  4%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.wait_for_completion
      1.43            -1.1        0.34 ± 70%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      1.46            -0.9        0.51        perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      2.60 ±  8%      -0.8        1.81 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      2.30 ±  8%      -0.7        1.65 ±  7%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page
      2.07 ±  5%      -0.6        1.50 ± 10%  perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page
      1.66 ±  4%      -0.4        1.24 ±  3%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle
      1.56 ±  7%      -0.2        1.33 ± 11%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page
      0.88 ±  6%      +0.6        1.45 ±  9%  perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      0.00            +0.6        0.57 ±  6%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond.f2fs_write_cache_pages
      0.18 ±141%      +0.6        0.83 ±  8%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +0.7        0.65 ±  4%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.59 ±  9%      +0.7        1.27 ± 10%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data
      0.00            +0.7        0.74 ±  6%  perf-profile.calltrace.cycles-pp.__schedule.schedule.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00            +0.7        0.74 ±  6%  perf-profile.calltrace.cycles-pp.schedule.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      0.00            +0.8        0.81 ±  8%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file
      5.75 ±  6%      +1.0        6.71 ±  3%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      5.76 ±  6%      +1.0        6.71 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +1.0        0.97        perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00            +1.1        1.11 ±  7%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data
      0.00            +1.1        1.11 ± 10%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages
      0.00            +1.1        1.12 ± 10%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00            +1.1        1.12 ±  7%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      0.00            +1.1        1.12 ± 10%  perf-profile.calltrace.cycles-pp.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      0.00            +1.2        1.24        perf-profile.calltrace.cycles-pp.__schedule.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.2        1.24        perf-profile.calltrace.cycles-pp.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +1.2        1.24 ±  7%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +1.3        1.25 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page
      0.00            +1.3        1.26 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00            +1.3        1.26 ±  4%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.4        1.43 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +1.4        1.43 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00            +1.4        1.44 ±  3%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +1.5        1.53 ±  3%  perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond
      0.00            +1.7        1.70 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00            +1.7        1.71 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.7        1.71 ±  3%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +1.8        1.77        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page
      0.00            +1.8        1.77        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +1.8        1.78        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00            +2.0        2.04 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00            +2.0        2.04 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.0        2.05 ±  3%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +2.5        2.46 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00            +2.5        2.46        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.5        2.47        perf-profile.calltrace.cycles-pp.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.9        2.88 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page
      0.00            +2.9        2.89 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page
     14.97            +2.9       17.91        perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      9.47 ±  2%      +3.1       12.57        perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
      0.00            +3.1        3.11 ±  2%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      9.27 ±  3%      +3.2       12.52        perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      2.66            +3.6        6.25 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      2.03 ±  6%      +3.8        5.80 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +4.0        4.01 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages
      0.00            +4.0        4.02 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +4.1        4.14 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page
      0.00            +4.2        4.15 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00            +4.2        4.20 ±  4%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +4.4        4.45 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00            +4.5        4.46 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +4.5        4.48 ±  2%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +4.5        4.51 ±  3%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +5.4        5.42 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00            +5.4        5.43 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +5.5        5.49 ±  4%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.09 ±  4%      +5.5        7.61 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +5.8        5.77 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page
      0.00            +5.8        5.78 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +5.9        5.86 ±  4%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00            +6.1        6.08 ±  8%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages
      0.00            +6.1        6.11 ±  8%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
      2.84            +6.2        9.03 ±  7%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
      0.00            +6.2        6.19 ±  8%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      1.78 ±  2%      +6.2        7.99 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00            +6.7        6.68 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00            +6.7        6.69 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      2.52 ±  3%      +6.7        9.27 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00            +6.8        6.76 ±  4%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     13.10 ±  2%      +8.7       21.82 ±  3%  perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     13.04 ±  2%      +8.8       21.80 ±  3%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     13.03 ±  2%      +8.8       21.80 ±  3%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
     13.02 ±  2%      +8.8       21.79 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file
     12.88            +8.9       21.75 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
      0.00           +15.6       15.61        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00           +15.7       15.66        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00           +15.8       15.82        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.07 ±  3%     +18.6       20.71        perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     22.55           +24.6       47.18        perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     46.97           +40.2       87.15        perf-profile.calltrace.cycles-pp.write
     46.70           +40.4       87.06        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     46.69           +40.4       87.06        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     46.62           +40.4       87.03        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     46.61           +40.4       87.02        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     46.53           +40.5       87.00        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     46.50           +40.5       86.99        perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     44.98           +41.6       86.57        perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
     50.96           -38.7       12.26        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     50.96           -38.7       12.26        perf-profile.children.cycles-pp.cpu_startup_entry
     50.95           -38.7       12.25        perf-profile.children.cycles-pp.do_idle
     50.27           -38.1       12.13        perf-profile.children.cycles-pp.start_secondary
     46.60           -35.5       11.11        perf-profile.children.cycles-pp.cpuidle_enter
     46.59           -35.5       11.11        perf-profile.children.cycles-pp.cpuidle_enter_state
     45.05           -34.1       10.99        perf-profile.children.cycles-pp.intel_idle
     10.72 ±  2%     -10.7        0.00        perf-profile.children.cycles-pp.rwsem_down_read_slowpath
     12.55 ±  2%      -8.6        3.92 ±  3%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
     11.34 ±  2%      -6.2        5.17 ±  3%  perf-profile.children.cycles-pp.__schedule
      9.83 ±  2%      -5.1        4.68 ±  3%  perf-profile.children.cycles-pp.schedule
      4.77 ±  6%      -4.7        0.12 ±  6%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      8.10 ±  3%      -4.3        3.80 ±  3%  perf-profile.children.cycles-pp.pick_next_task_fair
      9.54 ±  5%      -4.2        5.36 ±  5%  perf-profile.children.cycles-pp.osq_lock
      7.18 ±  5%      -4.1        3.04 ±  4%  perf-profile.children.cycles-pp.f2fs_submit_page_write
      7.60 ±  3%      -4.0        3.65 ±  3%  perf-profile.children.cycles-pp.newidle_balance
      4.54 ±  6%      -3.8        0.71 ±  3%  perf-profile.children.cycles-pp.set_node_addr
      6.57 ±  3%      -3.7        2.89 ±  3%  perf-profile.children.cycles-pp.find_busiest_group
      6.49 ±  3%      -3.6        2.86 ±  3%  perf-profile.children.cycles-pp.update_sd_lb_stats
      6.97 ±  3%      -3.6        3.36 ±  3%  perf-profile.children.cycles-pp.load_balance
      2.78            -2.6        0.20 ±  4%  perf-profile.children.cycles-pp.rwsem_wake
      6.81 ±  4%      -2.5        4.34 ±  6%  perf-profile.children.cycles-pp.f2fs_outplace_write_data
      2.25            -2.1        0.15 ±  3%  perf-profile.children.cycles-pp.wake_up_q
      2.37            -1.8        0.56 ±  2%  perf-profile.children.cycles-pp.__submit_bio
      2.37            -1.8        0.57        perf-profile.children.cycles-pp.submit_bio_noacct
      2.50 ±  4%      -1.7        0.85 ±  3%  perf-profile.children.cycles-pp.f2fs_issue_flush
      2.25            -1.6        0.64 ±  5%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      2.24            -1.6        0.64 ±  5%  perf-profile.children.cycles-pp.find_get_pages_range_tag
      2.62            -1.4        1.25        perf-profile.children.cycles-pp.try_to_wake_up
      2.09 ±  4%      -1.3        0.75 ±  3%  perf-profile.children.cycles-pp.wait_for_completion
      2.05 ±  4%      -1.3        0.74 ±  3%  perf-profile.children.cycles-pp.schedule_timeout
     12.21 ±  4%      -1.3       10.93 ±  4%  perf-profile.children.cycles-pp.do_write_page
      1.72            -1.3        0.45 ±  2%  perf-profile.children.cycles-pp.__submit_merged_bio
      1.74            -1.2        0.50        perf-profile.children.cycles-pp.rwsem_spin_on_owner
      2.35 ±  3%      -1.2        1.11 ±  2%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      4.57 ±  3%      -1.1        3.51 ±  4%  perf-profile.children.cycles-pp.f2fs_allocate_data_block
      1.40 ±  2%      -1.1        0.35 ±  2%  perf-profile.children.cycles-pp.ret_from_fork
      1.40 ±  2%      -1.0        0.35 ±  2%  perf-profile.children.cycles-pp.kthread
      1.50 ±  6%      -1.0        0.46        perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      1.29 ±  2%      -1.0        0.30 ±  3%  perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      1.49 ±  2%      -1.0        0.52        perf-profile.children.cycles-pp.schedule_idle
      1.27            -0.9        0.33 ±  2%  perf-profile.children.cycles-pp.f2fs_buffered_write_iter
      1.50 ±  2%      -0.9        0.58 ±  2%  perf-profile.children.cycles-pp._raw_spin_lock
      1.25            -0.9        0.33 ±  3%  perf-profile.children.cycles-pp.generic_perform_write
      1.32 ±  3%      -0.9        0.45        perf-profile.children.cycles-pp.ttwu_do_activate
      1.29 ±  3%      -0.8        0.46        perf-profile.children.cycles-pp.enqueue_task_fair
      1.09            -0.8        0.28        perf-profile.children.cycles-pp.brd_do_bvec
      1.10            -0.8        0.28 ±  2%  perf-profile.children.cycles-pp.brd_submit_bio
      0.95            -0.8        0.18 ±  2%  perf-profile.children.cycles-pp.menu_select
      1.07 ±  5%      -0.7        0.32 ±  2%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      1.05 ±  6%      -0.7        0.32        perf-profile.children.cycles-pp.hrtimer_interrupt
      0.99 ±  3%      -0.7        0.34        perf-profile.children.cycles-pp.enqueue_entity
      0.97            -0.6        0.36        perf-profile.children.cycles-pp.sched_ttwu_pending
      1.10 ±  3%      -0.6        0.51 ±  3%  perf-profile.children.cycles-pp.idle_cpu
      0.84 ±  3%      -0.6        0.25        perf-profile.children.cycles-pp.issue_flush_thread
      1.16 ±  2%      -0.6        0.58 ±  2%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.69 ±  9%      -0.6        0.13 ± 29%  perf-profile.children.cycles-pp.start_kernel
      1.01 ±  2%      -0.5        0.49 ±  2%  perf-profile.children.cycles-pp.dequeue_entity
      0.68 ±  3%      -0.5        0.18 ± 10%  perf-profile.children.cycles-pp.folio_mark_dirty
      0.72            -0.5        0.22 ±  4%  perf-profile.children.cycles-pp.__pagevec_release
      0.68 ±  2%      -0.5        0.18 ±  4%  perf-profile.children.cycles-pp.f2fs_write_begin
      0.71            -0.5        0.22 ±  4%  perf-profile.children.cycles-pp.release_pages
      0.64            -0.5        0.17 ±  4%  perf-profile.children.cycles-pp.f2fs_write_end_io
      0.54 ±  4%      -0.4        0.09 ±  5%  perf-profile.children.cycles-pp.worker_thread
      0.48 ±  9%      -0.4        0.03 ± 70%  perf-profile.children.cycles-pp.ktime_get
      0.89 ±  2%      -0.4        0.45        perf-profile.children.cycles-pp.update_load_avg
      0.57 ±  3%      -0.4        0.15        perf-profile.children.cycles-pp.brd_insert_page
      0.44 ±  4%      -0.4        0.06 ±  7%  perf-profile.children.cycles-pp.__submit_flush_wait
      0.44 ±  4%      -0.4        0.06 ±  7%  perf-profile.children.cycles-pp.blkdev_issue_flush
      0.42 ±  5%      -0.4        0.06        perf-profile.children.cycles-pp.submit_bio_wait
      0.61 ±  4%      -0.4        0.25 ±  3%  perf-profile.children.cycles-pp.cpumask_next_and
      0.43 ±  6%      -0.4        0.07        perf-profile.children.cycles-pp.__lookup_nat_cache
      0.43 ±  5%      -0.4        0.07        perf-profile.children.cycles-pp.md_submit_bio
      0.52 ±  2%      -0.4        0.17 ±  2%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.66 ±  2%      -0.4        0.31        perf-profile.children.cycles-pp.mutex_spin_on_owner
      0.48            -0.3        0.13 ±  3%  perf-profile.children.cycles-pp.xas_find_marked
      0.57 ±  6%      -0.3        0.24        perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.46 ±  5%      -0.3        0.13 ± 14%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      0.46 ±  5%      -0.3        0.13 ± 14%  perf-profile.children.cycles-pp.filemap_dirty_folio
      0.44 ±  2%      -0.3        0.12 ±  6%  perf-profile.children.cycles-pp.__get_node_page
      0.36 ±  4%      -0.3        0.06 ±  8%  perf-profile.children.cycles-pp.md_handle_request
      0.40 ±  5%      -0.3        0.11 ± 12%  perf-profile.children.cycles-pp.f2fs_set_node_page_dirty
      0.51 ±  3%      -0.3        0.23 ±  2%  perf-profile.children.cycles-pp._find_next_bit
      0.45 ±  2%      -0.3        0.17 ±  4%  perf-profile.children.cycles-pp.update_rq_clock
      0.38 ±  5%      -0.3        0.10 ±  4%  perf-profile.children.cycles-pp.f2fs_submit_merged_ipu_write
      0.37 ±  2%      -0.3        0.09        perf-profile.children.cycles-pp.f2fs_write_end
      0.42 ±  4%      -0.3        0.14 ± 11%  perf-profile.children.cycles-pp.__folio_start_writeback
      0.39 ±  9%      -0.3        0.12 ±  4%  perf-profile.children.cycles-pp.up_read
      0.37            -0.3        0.09 ±  5%  perf-profile.children.cycles-pp.f2fs_is_valid_blkaddr
      0.34 ±  2%      -0.3        0.06 ±  7%  perf-profile.children.cycles-pp.process_one_work
      0.32 ±  6%      -0.3        0.05        perf-profile.children.cycles-pp.raid0_make_request
      0.37 ±  4%      -0.3        0.10 ±  8%  perf-profile.children.cycles-pp.folio_end_writeback
      0.37 ±  7%      -0.3        0.10 ±  9%  perf-profile.children.cycles-pp.pagecache_get_page
      0.33 ±  2%      -0.3        0.07 ±  7%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.36 ±  7%      -0.3        0.10 ±  8%  perf-profile.children.cycles-pp.__filemap_get_folio
      0.33 ±  2%      -0.2        0.09 ± 10%  perf-profile.children.cycles-pp.__folio_end_writeback
      0.41 ±  7%      -0.2        0.18 ±  2%  perf-profile.children.cycles-pp.tick_sched_timer
      0.33 ±  3%      -0.2        0.10        perf-profile.children.cycles-pp.set_next_entity
      0.28            -0.2        0.05 ±  8%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.29 ±  4%      -0.2        0.07 ± 14%  perf-profile.children.cycles-pp.f2fs_update_inode_page
      0.33 ±  5%      -0.2        0.11 ± 17%  perf-profile.children.cycles-pp.f2fs_update_data_blkaddr
      0.33 ±  5%      -0.2        0.11 ± 17%  perf-profile.children.cycles-pp.f2fs_set_data_blkaddr
      0.31 ±  5%      -0.2        0.09 ±  5%  perf-profile.children.cycles-pp.down_write
      0.30 ±  3%      -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.f2fs_write_inode
      0.37 ± 10%      -0.2        0.16 ±  3%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.28            -0.2        0.07 ± 11%  perf-profile.children.cycles-pp.update_sit_entry
      0.37 ±  9%      -0.2        0.17 ±  4%  perf-profile.children.cycles-pp.tick_sched_handle
      0.27            -0.2        0.07 ±  7%  perf-profile.children.cycles-pp.f2fs_set_data_page_dirty
      0.29            -0.2        0.09        perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.36 ± 10%      -0.2        0.17 ±  2%  perf-profile.children.cycles-pp.update_process_times
      0.45            -0.2        0.26        perf-profile.children.cycles-pp.update_curr
      0.32 ± 14%      -0.2        0.13 ±  3%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.32 ±  2%      -0.2        0.13 ±  3%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.27 ±  4%      -0.2        0.08 ± 20%  perf-profile.children.cycles-pp.__folio_mark_dirty
      0.34            -0.2        0.15        perf-profile.children.cycles-pp.__list_del_entry_valid
      0.24            -0.2        0.06 ±  7%  perf-profile.children.cycles-pp.llist_add_batch
      0.24 ±  3%      -0.2        0.06        perf-profile.children.cycles-pp.__smp_call_single_queue
      0.45 ±  6%      -0.2        0.28 ±  3%  perf-profile.children.cycles-pp.finish_task_switch
      0.27 ± 13%      -0.2        0.10        perf-profile.children.cycles-pp.__softirqentry_text_start
      0.25 ±  7%      -0.2        0.09        perf-profile.children.cycles-pp.sched_clock_cpu
      0.25 ±  3%      -0.2        0.08 ±  5%  perf-profile.children.cycles-pp.__switch_to_asm
      0.21 ±  2%      -0.2        0.05 ±  8%  perf-profile.children.cycles-pp.mutex_lock
      0.23 ±  8%      -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.native_sched_clock
      0.22 ±  2%      -0.2        0.07        perf-profile.children.cycles-pp.__switch_to
      0.18 ±  2%      -0.2        0.03 ± 70%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.20 ±  4%      -0.2        0.05        perf-profile.children.cycles-pp.llist_reverse_order
      0.19 ±  2%      -0.1        0.06        perf-profile.children.cycles-pp.up_write
      0.31 ±  5%      -0.1        0.17 ±  2%  perf-profile.children.cycles-pp.complete
      0.21 ±  3%      -0.1        0.08        perf-profile.children.cycles-pp.__alloc_pages
      0.20            -0.1        0.08 ± 12%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.19 ±  4%      -0.1        0.07        perf-profile.children.cycles-pp.get_page_from_freelist
      0.16 ± 21%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.xas_load
      0.19 ±  2%      -0.1        0.08 ± 12%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.22 ±  5%      -0.1        0.10        perf-profile.children.cycles-pp.__update_load_avg_se
      0.26 ±  3%      -0.1        0.14        perf-profile.children.cycles-pp.update_blocked_averages
      0.14 ±  3%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.__dentry_kill
      0.14            -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.evict
      0.14            -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.f2fs_evict_inode
      0.16 ±  5%      -0.1        0.06        perf-profile.children.cycles-pp.cpuacct_charge
      0.15 ±  3%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.__close
      0.15 ±  3%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.task_work_run
      0.26 ±  5%      -0.1        0.17        perf-profile.children.cycles-pp.swake_up_locked
      0.14 ±  3%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.dput
      0.14 ±  3%      -0.1        0.05 ±  8%  perf-profile.children.cycles-pp.__fput
      0.19 ±  6%      -0.1        0.11 ±  4%  perf-profile.children.cycles-pp.update_cfs_group
      0.20 ±  7%      -0.1        0.12 ±  3%  perf-profile.children.cycles-pp.scheduler_tick
      0.12 ± 10%      -0.1        0.05        perf-profile.children.cycles-pp.prep_new_page
      0.10 ±  8%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.reweight_entity
      0.11 ±  7%      -0.1        0.05        perf-profile.children.cycles-pp.kernel_init_free_pages
      0.11 ±  7%      -0.1        0.05        perf-profile.children.cycles-pp.clear_page_erms
      0.11 ±  4%      -0.1        0.05        perf-profile.children.cycles-pp.perf_tp_event
      0.10            -0.1        0.05        perf-profile.children.cycles-pp.rebalance_domains
      0.22 ±  6%      -0.0        0.17 ±  7%  perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
      0.10 ±  8%      -0.0        0.07 ± 14%  perf-profile.children.cycles-pp.f2fs_wait_on_node_pages_writeback
      0.11 ±  7%      +0.0        0.16 ±  3%  perf-profile.children.cycles-pp.available_idle_cpu
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.set_task_cpu
      0.26 ±  5%      +0.1        0.32 ±  2%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.00            +0.1        0.06 ± 19%  perf-profile.children.cycles-pp.f2fs_wait_on_page_writeback
      0.00            +0.1        0.08        perf-profile.children.cycles-pp.task_tick_fair
      0.00            +0.2        0.19 ±  4%  perf-profile.children.cycles-pp.select_idle_cpu
      0.02 ±141%      +0.2        0.22 ±  3%  perf-profile.children.cycles-pp.select_idle_sibling
      0.00            +0.3        0.28        perf-profile.children.cycles-pp.down_read_trylock
      0.07 ± 12%      +0.3        0.42 ±  5%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.07 ± 14%      +0.9        0.99        perf-profile.children.cycles-pp.autoremove_wake_function
      0.08 ± 12%      +0.9        1.02        perf-profile.children.cycles-pp.__wake_up_common
      5.76 ±  6%      +1.0        6.71 ±  3%  perf-profile.children.cycles-pp.f2fs_do_write_node_page
     14.97            +2.9       17.91        perf-profile.children.cycles-pp.__write_node_page
      9.47 ±  2%      +3.1       12.57        perf-profile.children.cycles-pp.f2fs_write_single_data_page
      9.27 ±  3%      +3.2       12.52        perf-profile.children.cycles-pp.f2fs_do_write_data_page
      2.66            +3.6        6.25 ±  3%  perf-profile.children.cycles-pp.f2fs_need_inode_block_update
      2.09 ±  4%      +5.5        7.61 ±  3%  perf-profile.children.cycles-pp.f2fs_need_dentry_mark
      2.52 ±  3%      +6.7        9.27 ±  3%  perf-profile.children.cycles-pp.f2fs_is_checkpointed_node
     13.10            +8.7       21.82 ±  3%  perf-profile.children.cycles-pp.file_write_and_wait_range
     13.04 ±  2%      +8.8       21.80 ±  3%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
     13.03 ±  2%      +8.8       21.80 ±  3%  perf-profile.children.cycles-pp.do_writepages
     13.02 ±  2%      +8.8       21.79 ±  3%  perf-profile.children.cycles-pp.f2fs_write_data_pages
     12.88 ±  2%      +8.9       21.75 ±  3%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
      0.11 ± 12%      +9.8        9.89        perf-profile.children.cycles-pp.__wake_up_common_lock
      3.81 ±  4%     +10.0       13.81 ±  3%  perf-profile.children.cycles-pp.f2fs_get_node_info
      0.00           +11.8       11.84        perf-profile.children.cycles-pp.finish_wait
     22.55           +24.6       47.18        perf-profile.children.cycles-pp.f2fs_fsync_node_pages
      4.92           +24.9       29.81 ±  3%  perf-profile.children.cycles-pp.__submit_merged_write_cond
     47.00           +40.2       87.18        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     46.99           +40.2       87.16        perf-profile.children.cycles-pp.write
     46.98           +40.2       87.18        perf-profile.children.cycles-pp.do_syscall_64
     46.62           +40.4       87.03        perf-profile.children.cycles-pp.ksys_write
     46.61           +40.4       87.03        perf-profile.children.cycles-pp.vfs_write
     46.53           +40.5       87.01        perf-profile.children.cycles-pp.new_sync_write
     46.50           +40.5       86.99        perf-profile.children.cycles-pp.f2fs_file_write_iter
     44.98           +41.6       86.57        perf-profile.children.cycles-pp.f2fs_do_sync_file
      0.00           +48.9       48.88        perf-profile.children.cycles-pp.prepare_to_wait_event
      5.41 ±  4%     +64.5       69.90        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      1.72 ±  5%     +68.5       70.27        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     44.80           -33.9       10.92        perf-profile.self.cycles-pp.intel_idle
      9.47 ±  5%      -4.1        5.32 ±  5%  perf-profile.self.cycles-pp.osq_lock
      4.87 ±  3%      -2.7        2.14 ±  3%  perf-profile.self.cycles-pp.update_sd_lb_stats
      1.77            -1.3        0.51 ±  5%  perf-profile.self.cycles-pp.find_get_pages_range_tag
      1.70            -1.2        0.49        perf-profile.self.cycles-pp.rwsem_spin_on_owner
      1.34            -0.9        0.46 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.71            -0.6        0.14 ±  3%  perf-profile.self.cycles-pp.rwsem_down_write_slowpath
      1.07 ±  3%      -0.6        0.50 ±  4%  perf-profile.self.cycles-pp.idle_cpu
      0.74            -0.5        0.22 ±  5%  perf-profile.self.cycles-pp.__schedule
      0.68            -0.5        0.21 ±  4%  perf-profile.self.cycles-pp.release_pages
      0.55 ±  2%      -0.4        0.10 ±  4%  perf-profile.self.cycles-pp.menu_select
      0.43 ±  3%      -0.4        0.08        perf-profile.self.cycles-pp.f2fs_fsync_node_pages
      0.65 ±  3%      -0.3        0.31        perf-profile.self.cycles-pp.mutex_spin_on_owner
      0.47 ±  2%      -0.3        0.13 ±  6%  perf-profile.self.cycles-pp.xas_find_marked
      0.38 ±  2%      -0.3        0.09 ±  5%  perf-profile.self.cycles-pp.brd_do_bvec
      0.39 ±  8%      -0.3        0.12 ±  4%  perf-profile.self.cycles-pp.up_read
      0.35            -0.3        0.08 ±  5%  perf-profile.self.cycles-pp.enqueue_entity
      0.36 ±  2%      -0.3        0.09 ±  5%  perf-profile.self.cycles-pp.f2fs_is_valid_blkaddr
      0.46 ±  2%      -0.3        0.21 ±  2%  perf-profile.self.cycles-pp._find_next_bit
      0.80            -0.2        0.57        perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.28 ±  3%      -0.2        0.05 ±  8%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.36 ± 10%      -0.2        0.15 ±  6%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.28 ±  4%      -0.2        0.08 ±  6%  perf-profile.self.cycles-pp.down_write
      0.27 ±  3%      -0.2        0.07 ± 11%  perf-profile.self.cycles-pp.update_sit_entry
      0.33 ±  3%      -0.2        0.13 ±  3%  perf-profile.self.cycles-pp.update_rq_clock
      0.28 ±  5%      -0.2        0.10 ±  4%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.33 ±  2%      -0.2        0.15        perf-profile.self.cycles-pp.__list_del_entry_valid
      0.24            -0.2        0.06 ±  7%  perf-profile.self.cycles-pp.llist_add_batch
      0.28 ±  7%      -0.2        0.11 ± 23%  perf-profile.self.cycles-pp.__percpu_counter_sum
      0.29 ±  3%      -0.2        0.12        perf-profile.self.cycles-pp.newidle_balance
      0.25 ±  3%      -0.2        0.08 ±  5%  perf-profile.self.cycles-pp.__switch_to_asm
      0.19 ±  2%      -0.2        0.03 ± 70%  perf-profile.self.cycles-pp.mutex_lock
      0.22 ±  2%      -0.2        0.07        perf-profile.self.cycles-pp.__switch_to
      0.23 ±  7%      -0.2        0.07 ±  6%  perf-profile.self.cycles-pp.native_sched_clock
      0.21 ±  6%      -0.2        0.06        perf-profile.self.cycles-pp.ttwu_queue_wakelist
      0.20 ±  4%      -0.2        0.05        perf-profile.self.cycles-pp.llist_reverse_order
      0.20 ±  4%      -0.1        0.06 ±  7%  perf-profile.self.cycles-pp.f2fs_do_sync_file
      0.20 ±  7%      -0.1        0.06 ±  7%  perf-profile.self.cycles-pp.f2fs_allocate_data_block
      0.19 ±  2%      -0.1        0.05        perf-profile.self.cycles-pp.__filemap_get_folio
      0.19 ±  2%      -0.1        0.07 ±  7%  perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
      0.19 ±  2%      -0.1        0.06        perf-profile.self.cycles-pp.up_write
      0.21 ±  6%      -0.1        0.09        perf-profile.self.cycles-pp.__update_load_avg_se
      0.32 ±  2%      -0.1        0.20        perf-profile.self.cycles-pp.update_load_avg
      0.19 ±  6%      -0.1        0.07        perf-profile.self.cycles-pp.cpumask_next_and
      0.15 ±  5%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp.__write_node_page
      0.16 ±  5%      -0.1        0.06 ±  8%  perf-profile.self.cycles-pp.cpuacct_charge
      0.16 ±  5%      -0.1        0.07 ±  7%  perf-profile.self.cycles-pp.try_to_wake_up
      0.16 ± 10%      -0.1        0.07        perf-profile.self.cycles-pp.finish_task_switch
      0.14            -0.1        0.06        perf-profile.self.cycles-pp.dequeue_task_fair
      0.11 ±  8%      -0.1        0.03 ± 70%  perf-profile.self.cycles-pp.dequeue_entity
      0.18 ±  9%      -0.1        0.11 ±  4%  perf-profile.self.cycles-pp.update_cfs_group
      0.13 ±  3%      -0.1        0.05 ±  8%  perf-profile.self.cycles-pp.flush_smp_call_function_queue
      0.27 ±  4%      -0.1        0.20 ±  2%  perf-profile.self.cycles-pp.load_balance
      0.11 ±  7%      -0.1        0.05        perf-profile.self.cycles-pp.clear_page_erms
      0.15 ±  5%      -0.0        0.13 ±  3%  perf-profile.self.cycles-pp.update_curr
      0.11 ±  7%      +0.0        0.16 ±  3%  perf-profile.self.cycles-pp.available_idle_cpu
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.select_idle_cpu
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.00            +0.2        0.24 ±  3%  perf-profile.self.cycles-pp.prepare_to_wait_event
      0.00            +0.3        0.28        perf-profile.self.cycles-pp.down_read_trylock
      5.41 ±  5%     +64.5       69.90        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath



***************************************************************************************************
lkp-icl-2sp1: 96 threads 2 sockets Ice Lake with 256G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/1BRD_48G/f2fs/x86_64-rhel-8.3/200/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp1/sync_disk_rw/aim7/0xb000280

commit: 
  dd81e1c7d5 ("Merge tag 'powerpc-5.17-2' of git://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux")
  e4544b63a7 ("f2fs: move f2fs to use reader-unfair rwsems")

dd81e1c7d5fb126e e4544b63a7ee49e7fbebf35ece0 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     12483           -84.3%       1962        aim7.jobs-per-min
     96.14          +536.0%     611.49        aim7.time.elapsed_time
     96.14          +536.0%     611.49        aim7.time.elapsed_time.max
 1.692e+08            +1.8%  1.723e+08        aim7.time.file_system_outputs
      6160 ±  4%  +1.1e+05%    6694136        aim7.time.involuntary_context_switches
     18099          +664.3%     138328        aim7.time.minor_page_faults
      1299 ±  2%   +4081.0%      54312        aim7.time.system_time
  58056898          +290.6%  2.267e+08        aim7.time.voluntary_context_switches
 7.893e+09           -55.5%  3.514e+09        cpuidle..time
  73095489           -20.9%   57810565        cpuidle..usage
     85.58           -92.7%       6.29        iostat.cpu.idle
     14.22 ±  2%    +558.2%      93.61        iostat.cpu.system
    145.34          +355.2%     661.63        uptime.boot
     11998           -35.9%       7689 ±  5%  uptime.idle
   6742969           -17.4%    5571083        numa-numastat.node0.local_node
   6823709           -17.4%    5639266        numa-numastat.node0.numa_hit
   6798264           -14.5%    5815068        numa-numastat.node1.local_node
   6804464           -14.3%    5833861        numa-numastat.node1.numa_hit
     85.35           -79.4        5.99        mpstat.cpu.all.idle%
      0.08 ±  4%      -0.0        0.04        mpstat.cpu.all.iowait%
      0.84            -0.1        0.76        mpstat.cpu.all.irq%
      0.07 ±  4%      -0.0        0.06 ±  3%  mpstat.cpu.all.soft%
     13.56 ±  2%     +79.5       93.09        mpstat.cpu.all.sys%
      0.10            -0.0        0.06 ±  4%  mpstat.cpu.all.usr%
     85.00           -93.3%       5.67 ±  8%  vmstat.cpu.id
     13.50 ±  3%    +588.9%      93.00        vmstat.cpu.sy
    846764           -83.5%     139684        vmstat.io.bo
     11.00 ±  9%    +933.3%     113.67        vmstat.procs.r
   1183936           -59.7%     477355        vmstat.system.cs
    211025           +56.6%     330512 ±  2%  vmstat.system.in
    533.50          +464.7%       3012        turbostat.Avg_MHz
     16.94           +77.2       94.16        turbostat.Busy%
      3150            +1.6%       3199        turbostat.Bzy_MHz
    579094 ±  5%     -22.8%     447105 ±  2%  turbostat.C1
      0.33 ± 51%      -0.3        0.01        turbostat.C1%
  71295956           -20.5%   56653835        turbostat.C1E
     73.94           -68.7        5.28 ± 11%  turbostat.C1E%
      9.78 ± 10%      -9.1        0.67 ± 93%  turbostat.C6%
  20957361          +869.3%  2.031e+08 ±  2%  turbostat.IRQ
     56908          +353.4%     257999 ±  3%  meminfo.Active
     39602          +530.7%     249767 ±  3%  meminfo.Active(anon)
     17306           -52.4%       8231        meminfo.Active(file)
    105917           +79.9%     190493        meminfo.AnonHugePages
    594255           +40.5%     834703        meminfo.Committed_AS
     63409 ±  4%     -42.0%      36801        meminfo.Dirty
    291621           +20.5%     351546        meminfo.Inactive(anon)
    169783           -11.8%     149753        meminfo.KReclaimable
     38138          +136.7%      90271        meminfo.Mapped
  28475029           -34.0%   18798070        meminfo.Memused
    636.00 ±  3%    +177.4%       1764 ± 24%  meminfo.Mlocked
      9850 ±  3%      -5.1%       9345 ±  4%  meminfo.PageTables
    169783           -11.8%     149753        meminfo.SReclaimable
     58115          +490.9%     343429 ±  2%  meminfo.Shmem
  28483719           -33.5%   18949734        meminfo.max_used_kB
      9581 ± 13%     +51.7%      14539        numa-meminfo.node0.Active
    934.00          +881.5%       9167        numa-meminfo.node0.Active(anon)
      8647 ± 14%     -37.9%       5371        numa-meminfo.node0.Active(file)
     95760           +76.3%     168809 ± 16%  numa-meminfo.node0.AnonHugePages
     31891 ± 10%     -39.6%      19270        numa-meminfo.node0.Dirty
     23476 ± 55%    +147.4%      58089 ±  4%  numa-meminfo.node0.Mapped
  14415585 ±  6%     -26.1%   10649512        numa-meminfo.node0.MemUsed
    372.50 ± 76%    +373.3%       1763 ± 24%  numa-meminfo.node0.Mlocked
     18462          +194.6%      54386 ±  7%  numa-meminfo.node0.Shmem
     47350          +414.4%     243549 ±  3%  numa-meminfo.node1.Active
     38668          +522.4%     240689 ±  4%  numa-meminfo.node1.Active(anon)
      8681 ± 15%     -67.1%       2859 ±  2%  numa-meminfo.node1.Active(file)
     32058 ±  7%     -44.9%      17649        numa-meminfo.node1.Dirty
    117743           +28.0%     150756 ± 14%  numa-meminfo.node1.Inactive
     40960 ±  5%    +102.5%      82950 ± 26%  numa-meminfo.node1.Inactive(anon)
     76782           -11.7%      67806        numa-meminfo.node1.Inactive(file)
     78459 ± 27%     -39.3%      47626 ±  7%  numa-meminfo.node1.KReclaimable
      9789 ± 17%     -27.9%       7059        numa-meminfo.node1.KernelStack
  14079524 ±  7%     -42.2%    8143366        numa-meminfo.node1.MemUsed
      4192 ± 74%     -82.2%     746.67 ± 13%  numa-meminfo.node1.PageTables
     78459 ± 27%     -39.3%      47626 ±  7%  numa-meminfo.node1.SReclaimable
    103123 ±  6%      -7.3%      95605        numa-meminfo.node1.SUnreclaim
     39654          +630.2%     289555 ±  2%  numa-meminfo.node1.Shmem
    181582 ±  7%     -21.1%     143232 ±  3%  numa-meminfo.node1.Slab
   1254572 ± 86%     -95.3%      59268 ±140%  numa-meminfo.node1.Unevictable
    232.50          +870.5%       2256        numa-vmstat.node0.nr_active_anon
      2156 ± 15%     -37.8%       1342        numa-vmstat.node0.nr_active_file
      8229 ± 10%     -41.7%       4795        numa-vmstat.node0.nr_dirty
      6054 ± 54%    +139.0%      14470 ±  4%  numa-vmstat.node0.nr_mapped
     91.00 ± 75%    +384.2%     440.67 ± 24%  numa-vmstat.node0.nr_mlock
      4614          +189.5%      13357 ±  6%  numa-vmstat.node0.nr_shmem
    232.50          +870.5%       2256        numa-vmstat.node0.nr_zone_active_anon
      2156 ± 15%     -37.8%       1342        numa-vmstat.node0.nr_zone_active_file
      6890 ±  2%     -28.6%       4922        numa-vmstat.node0.nr_zone_write_pending
   5033122 ±  4%      -8.0%    4630395 ±  3%  numa-vmstat.node0.numa_hit
   4948093 ±  4%      -7.8%    4561425 ±  3%  numa-vmstat.node0.numa_local
      9649          +523.1%      60122 ±  4%  numa-vmstat.node1.nr_active_anon
      2164 ± 14%     -67.0%     714.00 ±  2%  numa-vmstat.node1.nr_active_file
   4707044           +13.9%    5363169        numa-vmstat.node1.nr_dirtied
      8055 ± 11%     -45.3%       4407        numa-vmstat.node1.nr_dirty
     10262 ±  5%     +98.4%      20358 ± 27%  numa-vmstat.node1.nr_inactive_anon
     19206           -11.7%      16955        numa-vmstat.node1.nr_inactive_file
      9811 ± 17%     -28.1%       7058        numa-vmstat.node1.nr_kernel_stack
      1055 ± 74%     -82.4%     185.67 ± 13%  numa-vmstat.node1.nr_page_table_pages
      9896          +627.2%      71971 ±  2%  numa-vmstat.node1.nr_shmem
     19597 ± 27%     -39.2%      11906 ±  7%  numa-vmstat.node1.nr_slab_reclaimable
     25785 ±  6%      -7.3%      23901        numa-vmstat.node1.nr_slab_unreclaimable
    313642 ± 86%     -95.3%      14816 ±140%  numa-vmstat.node1.nr_unevictable
   4684528           +14.0%    5341105        numa-vmstat.node1.nr_written
      9649          +523.1%      60122 ±  4%  numa-vmstat.node1.nr_zone_active_anon
      2164 ± 14%     -67.0%     714.00 ±  2%  numa-vmstat.node1.nr_zone_active_file
     10262 ±  5%     +98.4%      20358 ± 27%  numa-vmstat.node1.nr_zone_inactive_anon
     19205           -11.7%      16955        numa-vmstat.node1.nr_zone_inactive_file
    313642 ± 86%     -95.3%      14816 ±140%  numa-vmstat.node1.nr_zone_unevictable
      6901 ±  3%     -35.1%       4478        numa-vmstat.node1.nr_zone_write_pending
   4486602 ±  5%     -17.9%    3684591 ±  4%  numa-vmstat.node1.numa_hit
   4440568 ±  5%     -18.4%    3621361 ±  4%  numa-vmstat.node1.numa_local
      9901          +536.1%      62980 ±  3%  proc-vmstat.nr_active_anon
      4336           -52.6%       2057        proc-vmstat.nr_active_file
     68316            -5.5%      64565        proc-vmstat.nr_anon_pages
  21148734            +1.8%   21537941        proc-vmstat.nr_dirtied
     15918 ±  8%     -42.1%       9218        proc-vmstat.nr_dirty
   5849571            +4.1%    6091176        proc-vmstat.nr_dirty_background_threshold
  11713447            +4.1%   12197246        proc-vmstat.nr_dirty_threshold
    694874            +9.5%     761213        proc-vmstat.nr_file_pages
  58823752            +4.1%   61248436        proc-vmstat.nr_free_pages
     72904           +20.1%      87544        proc-vmstat.nr_inactive_anon
     38227            -7.4%      35404        proc-vmstat.nr_inactive_file
     21036            -8.2%      19316        proc-vmstat.nr_kernel_stack
      9777          +127.9%      22280        proc-vmstat.nr_mapped
    158.50 ±  3%    +178.0%     440.67 ± 24%  proc-vmstat.nr_mlock
      2457 ±  3%      -4.9%       2336 ±  4%  proc-vmstat.nr_page_table_pages
     14529          +492.2%      86047 ±  2%  proc-vmstat.nr_shmem
     42465           -11.8%      37438        proc-vmstat.nr_slab_reclaimable
     59654            -1.9%      58528        proc-vmstat.nr_slab_unreclaimable
  21062816            +1.9%   21461542        proc-vmstat.nr_written
      9901          +536.1%      62980 ±  3%  proc-vmstat.nr_zone_active_anon
      4336           -52.6%       2057        proc-vmstat.nr_zone_active_file
     72904           +20.1%      87544        proc-vmstat.nr_zone_inactive_anon
     38227            -7.4%      35404        proc-vmstat.nr_zone_inactive_file
     13650 ±  2%     -31.0%       9415        proc-vmstat.nr_zone_write_pending
      6159         +3856.2%     243662        proc-vmstat.numa_hint_faults
      3574 ±  2%   +4123.5%     150947 ±  2%  proc-vmstat.numa_hint_faults_local
  13630061           -15.8%   11475136        proc-vmstat.numa_hit
  13543124           -15.9%   11388160        proc-vmstat.numa_local
      2201 ± 11%   +1251.0%      29742 ± 31%  proc-vmstat.numa_pages_migrated
     32942         +1067.5%     384615        proc-vmstat.numa_pte_updates
     30788         +1735.5%     565120        proc-vmstat.pgactivate
  13629985           -15.8%   11475237        proc-vmstat.pgalloc_normal
    464647          +395.9%    2304278        proc-vmstat.pgfault
   3169981           +53.8%    4874411        proc-vmstat.pgfree
      2201 ± 11%   +1251.0%      29742 ± 31%  proc-vmstat.pgmigrate_success
  84250926            +1.9%   85851960        proc-vmstat.pgpgout
     29076          +373.8%     137766        proc-vmstat.pgreuse
     32.86 ±  3%     -39.4%      19.92 ±  3%  perf-stat.i.MPKI
 2.756e+09            +3.0%  2.838e+09        perf-stat.i.branch-instructions
      2.05 ±  4%      -1.2        0.81 ±  7%  perf-stat.i.branch-miss-rate%
  35951043           -39.5%   21764863        perf-stat.i.branch-misses
     28.77            -9.4       19.39        perf-stat.i.cache-miss-rate%
 1.136e+08           -56.1%   49846483        perf-stat.i.cache-misses
 3.656e+08           -30.1%  2.556e+08        perf-stat.i.cache-references
   1215541           -60.6%     478901        perf-stat.i.context-switches
      4.10          +435.8%      21.97        perf-stat.i.cpi
 5.345e+10          +440.2%  2.887e+11        perf-stat.i.cpu-cycles
     66411 ±  2%     +44.2%      95797        perf-stat.i.cpu-migrations
      1525 ±  5%    +281.4%       5817        perf-stat.i.cycles-between-cache-misses
      0.16 ±  5%      -0.1        0.04 ± 15%  perf-stat.i.dTLB-load-miss-rate%
   3023623           -59.2%    1234888        perf-stat.i.dTLB-load-misses
      0.03 ±  6%      -0.0        0.01 ± 11%  perf-stat.i.dTLB-store-miss-rate%
    294812           -74.0%      76526        perf-stat.i.dTLB-store-misses
  1.76e+09           -45.4%  9.608e+08        perf-stat.i.dTLB-stores
  1.34e+10            -2.7%  1.304e+10        perf-stat.i.instructions
      0.25 ±  2%     -80.0%       0.05 ±  2%  perf-stat.i.ipc
      2.08           -81.1%       0.39 ±  4%  perf-stat.i.major-faults
      0.56          +440.2%       3.01        perf-stat.i.metric.GHz
    839.16           -60.2%     334.10 ±  2%  perf-stat.i.metric.K/sec
     87.52            -9.5%      79.18        perf-stat.i.metric.M/sec
      3594            -2.4%       3507        perf-stat.i.minor-faults
     90.71            +3.7       94.43        perf-stat.i.node-load-miss-rate%
  25173486           -47.0%   13342739        perf-stat.i.node-load-misses
   1990993           -63.0%     737592        perf-stat.i.node-loads
     44.15            -2.1       42.01        perf-stat.i.node-store-miss-rate%
  20372419           -64.9%    7153908        perf-stat.i.node-store-misses
  24828843           -60.8%    9722644        perf-stat.i.node-stores
      3596            -2.4%       3508        perf-stat.i.page-faults
     27.29           -28.2%      19.60        perf-stat.overall.MPKI
      1.30            -0.5        0.77        perf-stat.overall.branch-miss-rate%
     31.07           -11.6       19.50        perf-stat.overall.cache-miss-rate%
      3.99          +455.1%      22.14        perf-stat.overall.cpi
    470.62 ±  2%   +1130.9%       5792        perf-stat.overall.cycles-between-cache-misses
      0.09            -0.1        0.03        perf-stat.overall.dTLB-load-miss-rate%
      0.02            -0.0        0.01        perf-stat.overall.dTLB-store-miss-rate%
      0.25           -82.0%       0.05        perf-stat.overall.ipc
     92.67            +2.1       94.76        perf-stat.overall.node-load-miss-rate%
     45.07            -2.7       42.38        perf-stat.overall.node-store-miss-rate%
 2.726e+09            +4.0%  2.834e+09        perf-stat.ps.branch-instructions
  35568993           -38.9%   21733078        perf-stat.ps.branch-misses
 1.124e+08           -55.7%   49768816        perf-stat.ps.cache-misses
 3.617e+08           -29.4%  2.552e+08        perf-stat.ps.cache-references
   1202229           -60.2%     478124        perf-stat.ps.context-switches
 5.287e+10          +445.3%  2.883e+11        perf-stat.ps.cpu-cycles
     65684 ±  3%     +45.6%      95643        perf-stat.ps.cpu-migrations
   2991936           -58.6%    1240028        perf-stat.ps.dTLB-load-misses
  3.49e+09            +1.5%  3.543e+09        perf-stat.ps.dTLB-loads
    291762           -73.8%      76570        perf-stat.ps.dTLB-store-misses
 1.741e+09           -44.9%  9.597e+08        perf-stat.ps.dTLB-stores
 1.325e+10            -1.8%  1.302e+10        perf-stat.ps.instructions
      2.06           -81.0%       0.39 ±  4%  perf-stat.ps.major-faults
      3555            -1.4%       3505        perf-stat.ps.minor-faults
  24897847           -46.5%   13321377        perf-stat.ps.node-load-misses
   1969209           -62.6%     737076        perf-stat.ps.node-loads
  20149400           -64.6%    7140855        perf-stat.ps.node-store-misses
  24557175           -60.5%    9709014        perf-stat.ps.node-stores
      3557            -1.5%       3505        perf-stat.ps.page-faults
 1.284e+12          +521.0%  7.972e+12        perf-stat.total.instructions
     18.77           -18.8        0.00        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     18.60           -18.6        0.00        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     18.58           -18.6        0.00        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     18.54           -18.5        0.00        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     17.80 ±  3%     -17.8        0.00        perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
     17.12 ±  3%     -17.1        0.00        perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
     13.68 ±  4%     -13.7        0.00        perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
     13.22 ±  4%     -13.2        0.00        perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
     12.74           -12.7        0.00        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     12.56           -12.6        0.00        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     11.96 ±  4%     -12.0        0.00        perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data
     26.24 ±  2%     -10.6       15.69 ±  3%  perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     26.17 ±  2%     -10.5       15.69 ±  3%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     26.16 ±  2%     -10.5       15.69 ±  3%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
     26.14 ±  2%     -10.5       15.69 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file
     25.93 ±  2%     -10.2       15.68 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
     10.22           -10.2        0.00        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      9.25            -9.2        0.00        perf-profile.calltrace.cycles-pp.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      9.24            -9.2        0.00        perf-profile.calltrace.cycles-pp.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      8.64 ±  3%      -8.6        0.00        perf-profile.calltrace.cycles-pp.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      8.17 ±  3%      -8.2        0.00        perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      6.54            -6.5        0.00        perf-profile.calltrace.cycles-pp.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      6.48            -6.5        0.00        perf-profile.calltrace.cycles-pp.find_get_pages_range_tag.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
     20.78 ±  2%      -5.9       14.89        perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
      5.83            -5.8        0.00        perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
     20.54 ±  2%      -5.7       14.88        perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
     25.66            -3.4       22.25        perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.18 ±  3%      -1.2        1.03 ± 59%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +0.7        0.68        perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.__write_node_page
      0.00            +0.7        0.71        perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages
      0.00            +0.7        0.72        perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
     41.07            +1.6       42.71        perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00            +1.6        1.65        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page
      0.00            +1.6        1.65        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00            +1.6        1.65        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.7        1.67        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +1.7        1.67        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page
      0.00            +1.7        1.67        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00            +2.1        2.09        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00            +2.1        2.09        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.1        2.10        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.3        2.28        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00            +2.3        2.29        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.3        2.29        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +2.4        2.35        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00            +2.4        2.36        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.4        2.36        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +5.7        5.70        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages
      0.00            +5.7        5.70        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +6.5        6.46        perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      3.66 ±  6%     +11.4       15.09        perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +12.5       12.54        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page
      0.00           +12.6       12.56        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00           +12.7       12.68        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      1.71 ±  5%     +12.9       14.57        perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00           +13.1       13.06        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page
      0.00           +13.1       13.07        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00           +13.2       13.19        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      3.30 ±  7%     +15.7       19.01        perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00           +16.4       16.43        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00           +16.4       16.45        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00           +16.6       16.60        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +17.0       17.03        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00           +17.1       17.06        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +17.2       17.21        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.48 ±  2%     +17.4       19.88        perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      3.06 ±  5%     +17.7       20.72        perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00           +17.9       17.92        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00           +17.9       17.94        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +18.1       18.10        perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     79.76           +19.6       99.33        perf-profile.calltrace.cycles-pp.write
     79.41           +19.9       99.27        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     79.38           +19.9       99.27        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     79.23           +20.0       99.27        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     79.21           +20.1       99.26        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     79.08           +20.2       99.26        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     79.06           +20.2       99.26        perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     76.57           +22.6       99.14        perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
     27.22           -26.8        0.42 ±  2%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
     26.37 ±  2%     -25.8        0.56 ± 15%  perf-profile.children.cycles-pp.do_write_page
     23.81 ±  2%     -23.5        0.32 ±  4%  perf-profile.children.cycles-pp.osq_lock
     18.77           -18.3        0.46        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     18.77           -18.3        0.46        perf-profile.children.cycles-pp.cpu_startup_entry
     18.76           -18.3        0.46        perf-profile.children.cycles-pp.do_idle
     18.60           -18.1        0.46        perf-profile.children.cycles-pp.start_secondary
     17.81 ±  3%     -17.6        0.25 ±  5%  perf-profile.children.cycles-pp.f2fs_outplace_write_data
     16.83 ±  4%     -16.7        0.15 ±  6%  perf-profile.children.cycles-pp.f2fs_submit_page_write
     12.68 ±  6%     -12.7        0.00        perf-profile.children.cycles-pp.rwsem_down_read_slowpath
     12.87           -12.6        0.27        perf-profile.children.cycles-pp.cpuidle_enter
     12.84           -12.6        0.27        perf-profile.children.cycles-pp.cpuidle_enter_state
     12.19 ±  7%     -12.1        0.06 ±  7%  perf-profile.children.cycles-pp._raw_spin_lock_irq
     26.25 ±  2%     -10.6       15.69 ±  3%  perf-profile.children.cycles-pp.file_write_and_wait_range
     26.17 ±  2%     -10.5       15.69 ±  3%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
     26.16 ±  2%     -10.5       15.69 ±  3%  perf-profile.children.cycles-pp.do_writepages
     26.14 ±  2%     -10.5       15.69 ±  3%  perf-profile.children.cycles-pp.f2fs_write_data_pages
     25.94 ±  2%     -10.3       15.68 ±  3%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
     10.38           -10.1        0.24        perf-profile.children.cycles-pp.intel_idle
      9.25            -8.9        0.34 ± 22%  perf-profile.children.cycles-pp.f2fs_do_write_node_page
      8.96            -8.7        0.24 ±  8%  perf-profile.children.cycles-pp.f2fs_allocate_data_block
      8.66 ±  3%      -8.3        0.31        perf-profile.children.cycles-pp.set_node_addr
      6.62            -6.5        0.16 ±  7%  perf-profile.children.cycles-pp.__mutex_lock
      6.62            -6.3        0.31 ±  3%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      6.60            -6.3        0.30        perf-profile.children.cycles-pp.find_get_pages_range_tag
     20.78 ±  2%      -5.9       14.89        perf-profile.children.cycles-pp.f2fs_write_single_data_page
     20.54 ±  2%      -5.7       14.88        perf-profile.children.cycles-pp.f2fs_do_write_data_page
      6.57 ±  2%      -5.3        1.29 ± 48%  perf-profile.children.cycles-pp.__submit_merged_write_cond
      5.78            -4.4        1.42 ±  2%  perf-profile.children.cycles-pp.__schedule
      3.74            -3.7        0.05        perf-profile.children.cycles-pp.rwsem_wake
     25.66            -3.4       22.25        perf-profile.children.cycles-pp.__write_node_page
      2.73            -2.6        0.09        perf-profile.children.cycles-pp.submit_bio_noacct
      2.73            -2.6        0.09        perf-profile.children.cycles-pp.__submit_bio
      2.86            -2.6        0.22        perf-profile.children.cycles-pp._raw_spin_lock
      3.92 ±  3%      -2.6        1.37 ±  2%  perf-profile.children.cycles-pp.schedule
      3.29            -2.5        0.79        perf-profile.children.cycles-pp.try_to_wake_up
      2.54            -2.4        0.10 ±  4%  perf-profile.children.cycles-pp.__pagevec_release
      2.52            -2.4        0.10 ±  4%  perf-profile.children.cycles-pp.release_pages
      2.48 ±  2%      -2.4        0.07 ±  7%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      2.32            -2.2        0.08        perf-profile.children.cycles-pp.__submit_merged_bio
      2.20            -2.1        0.06        perf-profile.children.cycles-pp.f2fs_buffered_write_iter
      2.20            -2.1        0.07        perf-profile.children.cycles-pp.generic_perform_write
      2.10            -2.0        0.06        perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      1.94            -1.9        0.07        perf-profile.children.cycles-pp.schedule_idle
      1.97 ±  3%      -1.7        0.31 ±  3%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      1.69 ±  4%      -1.4        0.26 ±  3%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      1.44 ±  2%      -1.4        0.05        perf-profile.children.cycles-pp.brd_submit_bio
      1.42 ±  2%      -1.4        0.05        perf-profile.children.cycles-pp.brd_do_bvec
      1.40            -1.2        0.22        perf-profile.children.cycles-pp.sched_ttwu_pending
      1.45            -1.2        0.28        perf-profile.children.cycles-pp.ttwu_do_activate
      1.40            -1.2        0.24        perf-profile.children.cycles-pp.dequeue_task_fair
      2.08 ±  6%      -1.1        0.94 ±  3%  perf-profile.children.cycles-pp.pick_next_task_fair
      1.30            -1.1        0.16 ±  2%  perf-profile.children.cycles-pp.dequeue_entity
      1.38            -1.1        0.30        perf-profile.children.cycles-pp.enqueue_task_fair
      1.22 ±  2%      -1.0        0.25        perf-profile.children.cycles-pp.update_load_avg
      1.08            -0.9        0.19 ±  2%  perf-profile.children.cycles-pp.enqueue_entity
      1.04 ±  2%      -0.9        0.18 ±  2%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      0.97 ±  3%      -0.8        0.17 ±  2%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.72            -0.6        0.10 ±  4%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      1.16 ± 11%      -0.6        0.57 ±  2%  perf-profile.children.cycles-pp.find_busiest_group
      1.16 ± 11%      -0.6        0.57 ±  2%  perf-profile.children.cycles-pp.update_sd_lb_stats
      1.43 ± 10%      -0.5        0.88 ±  2%  perf-profile.children.cycles-pp.newidle_balance
      0.55            -0.5        0.05        perf-profile.children.cycles-pp.flush_smp_call_function_queue
      1.32 ± 11%      -0.5        0.82 ±  3%  perf-profile.children.cycles-pp.load_balance
      0.49            -0.4        0.05 ±  8%  perf-profile.children.cycles-pp.llist_add_batch
      0.56            -0.4        0.13 ±  3%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.47            -0.4        0.06 ±  8%  perf-profile.children.cycles-pp.__smp_call_single_queue
      0.46 ±  3%      -0.4        0.06        perf-profile.children.cycles-pp.__list_del_entry_valid
      0.45 ±  4%      -0.4        0.06        perf-profile.children.cycles-pp.__list_add_valid
      0.47 ±  4%      -0.4        0.09        perf-profile.children.cycles-pp.update_rq_clock
      0.53            -0.4        0.16 ±  2%  perf-profile.children.cycles-pp.update_curr
      0.41 ±  2%      -0.3        0.08 ±  5%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.36            -0.3        0.05 ±  8%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.38 ±  6%      -0.3        0.08 ± 10%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.35            -0.3        0.05        perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.38 ±  2%      -0.3        0.08 ±  5%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.34 ±  7%      -0.3        0.07 ±  7%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.36            -0.3        0.10        perf-profile.children.cycles-pp.tick_sched_timer
      0.32            -0.3        0.06 ±  7%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.32 ±  4%      -0.2        0.07        perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.27 ±  3%      -0.2        0.03 ± 70%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.32            -0.2        0.10 ±  4%  perf-profile.children.cycles-pp.tick_sched_handle
      0.31            -0.2        0.10 ±  4%  perf-profile.children.cycles-pp.update_process_times
      0.28 ±  3%      -0.2        0.07        perf-profile.children.cycles-pp.available_idle_cpu
      0.52            -0.2        0.32        perf-profile.children.cycles-pp.select_task_rq_fair
      0.28            -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.__close
      0.27 ±  3%      -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.dput
      0.27 ±  3%      -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.__fput
      0.27 ±  3%      -0.2        0.08 ±  6%  perf-profile.children.cycles-pp.task_work_run
      0.26            -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.__dentry_kill
      0.26            -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.evict
      0.26            -0.2        0.07 ±  6%  perf-profile.children.cycles-pp.f2fs_evict_inode
      0.26 ±  5%      -0.1        0.11 ±  4%  perf-profile.children.cycles-pp._find_next_bit
      0.18 ± 16%      -0.1        0.07        perf-profile.children.cycles-pp.idle_cpu
      0.18            -0.1        0.07 ±  6%  perf-profile.children.cycles-pp.scheduler_tick
      0.10 ±  5%      -0.1        0.03 ± 70%  perf-profile.children.cycles-pp.update_blocked_averages
      0.16 ±  9%      -0.1        0.10 ±  4%  perf-profile.children.cycles-pp.cpumask_next_and
      0.10            -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.update_cfs_rq_h_load
      0.09            -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.reweight_entity
      0.05            +0.1        0.12 ±  6%  perf-profile.children.cycles-pp.down_read_trylock
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.f2fs_remove_inode_page
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.truncate_node
      0.00            +0.1        0.08        perf-profile.children.cycles-pp.cpumask_next_wrap
      0.12 ±  4%      +0.1        0.24        perf-profile.children.cycles-pp.select_idle_sibling
      0.08 ±  6%      +0.1        0.21        perf-profile.children.cycles-pp.select_idle_cpu
      0.08 ±  6%      +0.1        0.22        perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.08 ±  5%      +0.1        0.23 ±  2%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.10 ±  4%      +0.2        0.27        perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.09            +0.5        0.57        perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.06 ±  9%      +0.7        0.78        perf-profile.children.cycles-pp.__wake_up_common
      0.02 ±100%      +0.7        0.76        perf-profile.children.cycles-pp.autoremove_wake_function
     41.09            +1.6       42.71        perf-profile.children.cycles-pp.f2fs_fsync_node_pages
      0.08 ± 12%      +6.7        6.78        perf-profile.children.cycles-pp.__wake_up_common_lock
      0.00           +10.2       10.18        perf-profile.children.cycles-pp.finish_wait
      3.30 ±  7%     +15.7       19.01        perf-profile.children.cycles-pp.f2fs_need_dentry_mark
      2.48 ±  2%     +17.4       19.88        perf-profile.children.cycles-pp.f2fs_need_inode_block_update
      3.07 ±  5%     +17.6       20.72        perf-profile.children.cycles-pp.f2fs_is_checkpointed_node
     79.91           +19.5       99.41        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     79.82           +19.5       99.33        perf-profile.children.cycles-pp.write
     79.88           +19.5       99.41        perf-profile.children.cycles-pp.do_syscall_64
     79.24           +20.0       99.28        perf-profile.children.cycles-pp.ksys_write
     79.22           +20.1       99.28        perf-profile.children.cycles-pp.vfs_write
     79.10           +20.2       99.27        perf-profile.children.cycles-pp.new_sync_write
     79.06           +20.2       99.26        perf-profile.children.cycles-pp.f2fs_file_write_iter
     76.58           +22.6       99.14        perf-profile.children.cycles-pp.f2fs_do_sync_file
      5.38 ±  6%     +24.4       29.76        perf-profile.children.cycles-pp.f2fs_get_node_info
      0.00           +79.3       79.29        perf-profile.children.cycles-pp.prepare_to_wait_event
     14.18 ±  8%     +80.5       94.72        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      3.16 ±  4%     +91.7       94.86        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     23.71 ±  2%     -23.4        0.32 ±  5%  perf-profile.self.cycles-pp.osq_lock
     10.34           -10.1        0.23 ±  2%  perf-profile.self.cycles-pp.intel_idle
      5.68            -5.4        0.27        perf-profile.self.cycles-pp.find_get_pages_range_tag
      2.44 ±  2%      -2.4        0.06 ±  7%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      2.44            -2.4        0.09 ±  9%  perf-profile.self.cycles-pp.release_pages
      2.19            -2.0        0.15 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock
      1.16            -0.9        0.26        perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.82            -0.7        0.08 ±  6%  perf-profile.self.cycles-pp.__schedule
      0.56 ±  3%      -0.4        0.11        perf-profile.self.cycles-pp.update_load_avg
      0.86 ±  9%      -0.4        0.42 ±  2%  perf-profile.self.cycles-pp.update_sd_lb_stats
      0.49            -0.4        0.05        perf-profile.self.cycles-pp.llist_add_batch
      0.46 ±  2%      -0.4        0.06        perf-profile.self.cycles-pp.__list_del_entry_valid
      0.44 ±  4%      -0.4        0.06        perf-profile.self.cycles-pp.__list_add_valid
      0.32            -0.3        0.06        perf-profile.self.cycles-pp.update_rq_clock
      0.31            -0.2        0.06        perf-profile.self.cycles-pp.__update_load_avg_se
      0.28 ±  3%      -0.2        0.07 ±  7%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.26            -0.2        0.05 ±  8%  perf-profile.self.cycles-pp.update_curr
      0.27 ±  3%      -0.2        0.07 ±  7%  perf-profile.self.cycles-pp.available_idle_cpu
      0.22 ±  6%      -0.1        0.09 ±  5%  perf-profile.self.cycles-pp._find_next_bit
      0.17 ± 17%      -0.1        0.07        perf-profile.self.cycles-pp.idle_cpu
      0.10            -0.0        0.05 ±  8%  perf-profile.self.cycles-pp.update_cfs_rq_h_load
      0.08            -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.load_balance
      0.02 ±100%      +0.1        0.08        perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.05            +0.1        0.12 ±  6%  perf-profile.self.cycles-pp.down_read_trylock
      0.00            +0.1        0.07        perf-profile.self.cycles-pp.select_idle_cpu
      0.00            +0.2        0.21        perf-profile.self.cycles-pp.prepare_to_wait_event
     14.16 ±  8%     +80.6       94.72        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath



***************************************************************************************************
lkp-icl-2sp2: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/1BRD_48G/f2fs/x86_64-rhel-8.3/200/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp2/sync_disk_rw/aim7/0xd000280

commit: 
  dd81e1c7d5 ("Merge tag 'powerpc-5.17-2' of git://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux")
  e4544b63a7 ("f2fs: move f2fs to use reader-unfair rwsems")

dd81e1c7d5fb126e e4544b63a7ee49e7fbebf35ece0 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     13633           -77.3%       3096 ±  5%  aim7.jobs-per-min
     88.04          +341.7%     388.89 ±  5%  aim7.time.elapsed_time
     88.04          +341.7%     388.89 ±  5%  aim7.time.elapsed_time.max
 1.671e+08            +2.5%  1.713e+08        aim7.time.file_system_outputs
      3146        +1.4e+05%    4477159 ± 10%  aim7.time.involuntary_context_switches
     17550          +452.1%      96887 ±  8%  aim7.time.minor_page_faults
      1064         +3932.5%      42928 ±  6%  aim7.time.system_time
  52811785          +169.1%  1.421e+08 ±  4%  aim7.time.voluntary_context_switches
 1.035e+10           -43.4%   5.86e+09 ±  3%  cpuidle..time
     53.54 ±  3%      +9.3%      58.52        boot-time.boot
      6323 ±  3%     +10.1%       6961        boot-time.idle
     90.21           -86.9%      11.80 ±  2%  iostat.cpu.idle
      9.62 ±  2%    +815.6%      88.06        iostat.cpu.system
    145.59          +210.8%     452.54 ±  5%  uptime.boot
     16844           -22.5%      13050        uptime.idle
   6803710           -16.8%    5661011        numa-numastat.node0.local_node
   6886643           -17.3%    5694296        numa-numastat.node0.numa_hit
   7081222           -19.0%    5733563        numa-numastat.node1.local_node
   7113452           -18.2%    5816389        numa-numastat.node1.numa_hit
    325.00 ±  4%    +607.9%       2300        turbostat.Avg_MHz
     12.53 ±  4%     +76.2       88.69        turbostat.Busy%
     89.48           -77.8       11.70 ±  2%  turbostat.C1%
  76767041          +151.7%  1.932e+08 ± 12%  turbostat.IRQ
     68.33            +2.9%      70.33        turbostat.PkgTmp
     90.03           -78.7       11.35 ±  2%  mpstat.cpu.all.idle%
      0.08 ±  4%      -0.0        0.05        mpstat.cpu.all.iowait%
      1.08            -0.2        0.91        mpstat.cpu.all.irq%
      0.05 ±  5%      +0.0        0.06 ±  2%  mpstat.cpu.all.soft%
      8.67 ±  2%     +78.9       87.53        mpstat.cpu.all.sys%
      0.08 ±  3%      +0.0        0.10 ±  6%  mpstat.cpu.all.usr%
     90.00           -87.4%      11.33 ±  4%  vmstat.cpu.id
      9.00          +870.4%      87.33        vmstat.cpu.sy
    911223           -76.1%     217956 ±  5%  vmstat.io.bo
   2953485           +12.5%    3321359        vmstat.memory.cache
     11.67 ±  4%    +962.9%     124.00        vmstat.procs.r
   1178152           -51.2%     574772        vmstat.system.cs
    841212           -41.7%     490576 ±  7%  vmstat.system.in
     48446          +485.0%     283422        meminfo.Active
     32563 ±  2%    +740.0%     273524        meminfo.Active(anon)
     15882           -37.7%       9897 ±  2%  meminfo.Active(file)
    109226           +70.6%     186381        meminfo.AnonHugePages
   2770717           +13.9%    3157035        meminfo.Cached
    574199           +66.6%     956851        meminfo.Committed_AS
     67205 ±  7%     -39.5%      40685        meminfo.Dirty
    441022           +32.9%     586094        meminfo.Inactive
    288732           +54.8%     447100        meminfo.Inactive(anon)
     37886          +372.8%     179143 ±  3%  meminfo.Mapped
  29076961           -29.6%   20478103        meminfo.Memused
     51044          +795.5%     457079        meminfo.Shmem
  29078359           -29.0%   20639335        meminfo.max_used_kB
     11003 ±  7%    +104.6%      22512 ±  3%  numa-meminfo.node0.Active
      2114 ± 34%    +683.2%      16556 ±  3%  numa-meminfo.node0.Active(anon)
      8888           -33.0%       5955 ±  2%  numa-meminfo.node0.Active(file)
     98683 ±  7%     +86.7%     184213        numa-meminfo.node0.AnonHugePages
    253596 ±  6%     +19.8%     303757        numa-meminfo.node0.AnonPages.max
     33181 ± 11%     -37.0%      20905        numa-meminfo.node0.Dirty
    336631 ±  3%     +22.9%     413798 ±  2%  numa-meminfo.node0.Inactive
    259159 ±  4%     +32.0%     342173 ±  3%  numa-meminfo.node0.Inactive(anon)
     25630 ± 51%    +312.3%     105682 ±  6%  numa-meminfo.node0.Mapped
  15090064 ±  7%     -23.2%   11588163        numa-meminfo.node0.MemUsed
     14572 ± 22%    +648.6%     109087 ±  9%  numa-meminfo.node0.Shmem
     37487          +596.2%     261004        numa-meminfo.node1.Active
     30450          +744.2%     257060        numa-meminfo.node1.Active(anon)
      7037           -44.0%       3943 ±  4%  numa-meminfo.node1.Active(file)
     33343 ±  7%     -40.5%      19836        numa-meminfo.node1.Dirty
    104755 ±  9%     +65.2%     173024 ±  7%  numa-meminfo.node1.Inactive
     29644 ± 36%    +256.2%     105604 ± 12%  numa-meminfo.node1.Inactive(anon)
     75111           -10.2%      67420        numa-meminfo.node1.Inactive(file)
     72282 ± 26%     -32.8%      48578 ±  5%  numa-meminfo.node1.KReclaimable
     12295 ±107%    +494.6%      73103 ±  7%  numa-meminfo.node1.Mapped
  14009653 ±  7%     -36.5%    8902458        numa-meminfo.node1.MemUsed
     72282 ± 26%     -32.8%      48578 ±  5%  numa-meminfo.node1.SReclaimable
     36473 ±  9%    +856.3%     348796 ±  2%  numa-meminfo.node1.Shmem
    159721 ±  9%     -11.3%     141602 ±  4%  numa-meminfo.node1.Slab
    528.33 ± 34%    +721.9%       4342 ±  3%  numa-vmstat.node0.nr_active_anon
      2226           -33.1%       1488 ±  2%  numa-vmstat.node0.nr_active_file
      8578 ± 10%     -38.9%       5240        numa-vmstat.node0.nr_dirty
     64795 ±  4%     +31.5%      85199 ±  3%  numa-vmstat.node0.nr_inactive_anon
      6619 ± 50%    +298.3%      26367 ±  6%  numa-vmstat.node0.nr_mapped
      3643 ± 22%    +645.6%      27161 ±  8%  numa-vmstat.node0.nr_shmem
    528.33 ± 34%    +722.0%       4343 ±  3%  numa-vmstat.node0.nr_zone_active_anon
      2226           -33.1%       1488 ±  2%  numa-vmstat.node0.nr_zone_active_file
     64795 ±  4%     +31.5%      85199 ±  3%  numa-vmstat.node0.nr_zone_inactive_anon
      7124           -24.6%       5370        numa-vmstat.node0.nr_zone_write_pending
   5299307 ±  4%      -7.7%    4889023        numa-vmstat.node0.numa_hit
      7612          +748.8%      64610        numa-vmstat.node1.nr_active_anon
      1761           -44.1%     985.00 ±  4%  numa-vmstat.node1.nr_active_file
   4475967           +12.0%    5014630        numa-vmstat.node1.nr_dirtied
      8347 ± 10%     -40.4%       4972        numa-vmstat.node1.nr_dirty
      7422 ± 36%    +251.3%      26075 ± 12%  numa-vmstat.node1.nr_inactive_anon
      3116 ±108%    +475.1%      17921 ±  7%  numa-vmstat.node1.nr_mapped
      9118 ±  9%    +856.4%      87207 ±  2%  numa-vmstat.node1.nr_shmem
     18074 ± 26%     -32.8%      12139 ±  5%  numa-vmstat.node1.nr_slab_reclaimable
   4454020           +12.1%    4992908        numa-vmstat.node1.nr_written
      7612          +748.8%      64610        numa-vmstat.node1.nr_zone_active_anon
      1761           -44.1%     985.00 ±  4%  numa-vmstat.node1.nr_zone_active_file
      7422 ± 36%    +251.3%      26075 ± 12%  numa-vmstat.node1.nr_zone_inactive_anon
      6982           -27.8%       5044        numa-vmstat.node1.nr_zone_write_pending
   4439843 ±  5%     -18.9%    3598683        numa-vmstat.node1.numa_hit
   4365472 ±  4%     -20.5%    3471629        numa-vmstat.node1.numa_local
      8140 ±  2%    +741.0%      68464        proc-vmstat.nr_active_anon
      3981           -37.8%       2474 ±  2%  proc-vmstat.nr_active_file
     67617            -2.5%      65931        proc-vmstat.nr_anon_pages
  20880986            +2.5%   21407324        proc-vmstat.nr_dirtied
     16797 ±  9%     -39.2%      10208        proc-vmstat.nr_dirty
   5833529            +3.7%    6048136        proc-vmstat.nr_dirty_background_threshold
  11681323            +3.7%   12111061        proc-vmstat.nr_dirty_threshold
    692727           +14.0%     789639        proc-vmstat.nr_file_pages
  58663572            +3.7%   60817628        proc-vmstat.nr_free_pages
     72192           +55.2%     112058        proc-vmstat.nr_inactive_anon
     38094            -8.8%      34752        proc-vmstat.nr_inactive_file
     25366            -4.3%      24285        proc-vmstat.nr_kernel_stack
      9721          +364.1%      45122 ±  3%  proc-vmstat.nr_mapped
     12761          +798.4%     114643        proc-vmstat.nr_shmem
     45666            -8.9%      41614        proc-vmstat.nr_slab_reclaimable
  20795895            +2.6%   21329600        proc-vmstat.nr_written
      8140 ±  2%    +741.0%      68464        proc-vmstat.nr_zone_active_anon
      3981           -37.8%       2474 ±  2%  proc-vmstat.nr_zone_active_file
     72192           +55.2%     112058        proc-vmstat.nr_zone_inactive_anon
     38094            -8.8%      34752        proc-vmstat.nr_zone_inactive_file
     14042           -26.0%      10385        proc-vmstat.nr_zone_write_pending
      4754         +5195.2%     251753 ±  4%  proc-vmstat.numa_hint_faults
      2781 ±  2%   +4781.3%     135764 ±  5%  proc-vmstat.numa_hint_faults_local
  14006143           -17.8%   11514659        proc-vmstat.numa_hit
  13887953           -17.9%   11398547        proc-vmstat.numa_local
      1903         +1392.1%      28399 ±  5%  proc-vmstat.numa_pages_migrated
      7967 ± 26%   +5369.8%     435781 ±  5%  proc-vmstat.numa_pte_updates
     29920         +1763.7%     557616        proc-vmstat.pgactivate
  14014518           -17.8%   11526104        proc-vmstat.pgalloc_normal
     19529            -4.2%      18708 ±  2%  proc-vmstat.pgdeactivate
    396700          +327.1%    1694421 ±  4%  proc-vmstat.pgfault
   3094702           +44.0%    4457852        proc-vmstat.pgfree
      1903         +1392.1%      28399 ±  5%  proc-vmstat.pgmigrate_success
  83222972            +2.5%   85326458        proc-vmstat.pgpgout
     23323          +257.1%      83281 ±  4%  proc-vmstat.pgreuse
     39049            -4.3%      37385 ±  2%  proc-vmstat.pgrotated
     15.90 ±  3%     -25.1%      11.91        perf-stat.i.MPKI
 3.519e+09 ±  4%    +100.2%  7.044e+09        perf-stat.i.branch-instructions
      0.94 ±  5%      -0.4        0.55        perf-stat.i.branch-miss-rate%
  32297349           +15.6%   37320651        perf-stat.i.branch-misses
     29.54           -15.5       14.03        perf-stat.i.cache-miss-rate%
  91913432           -42.0%   53308607        perf-stat.i.cache-misses
 2.897e+08           +30.4%  3.777e+08        perf-stat.i.cache-references
   1210985           -52.2%     578441        perf-stat.i.context-switches
      2.81 ±  6%    +230.8%       9.30        perf-stat.i.cpi
 4.486e+10 ±  8%    +556.0%  2.943e+11        perf-stat.i.cpu-cycles
     35459          +300.2%     141913        perf-stat.i.cpu-migrations
      2706 ± 53%    +112.9%       5761        perf-stat.i.cycles-between-cache-misses
      0.06 ±  4%      -0.0        0.04 ±  8%  perf-stat.i.dTLB-load-miss-rate%
  4.35e+09           +93.6%  8.421e+09        perf-stat.i.dTLB-loads
      0.02 ± 10%      -0.0        0.01 ±  5%  perf-stat.i.dTLB-store-miss-rate%
    295192 ± 11%     -49.2%     149935 ±  6%  perf-stat.i.dTLB-store-misses
 1.922e+09           -24.2%  1.458e+09        perf-stat.i.dTLB-stores
 1.677e+10 ±  3%     +86.1%   3.12e+10        perf-stat.i.instructions
      0.37 ±  6%     -69.7%       0.11        perf-stat.i.ipc
      2.04 ±  3%     -61.4%       0.79 ±  5%  perf-stat.i.major-faults
      0.35 ±  8%    +556.0%       2.30        perf-stat.i.metric.GHz
    459.69           -38.6%     282.19        perf-stat.i.metric.K/sec
     78.73 ±  2%     +71.7%     135.15        perf-stat.i.metric.M/sec
      3414           +18.7%       4052        perf-stat.i.minor-faults
     94.15            +1.7       95.85        perf-stat.i.node-load-miss-rate%
  28815204           -32.8%   19364821        perf-stat.i.node-load-misses
   1436041           -46.8%     763611        perf-stat.i.node-loads
     49.83            -8.1       41.77        perf-stat.i.node-store-miss-rate%
  13112467           -53.3%    6124219 ±  2%  perf-stat.i.node-store-misses
  11700482           -28.1%    8413600        perf-stat.i.node-stores
      3416           +18.7%       4053        perf-stat.i.page-faults
     17.29 ±  3%     -30.0%      12.10        perf-stat.overall.MPKI
      0.92 ±  3%      -0.4        0.53        perf-stat.overall.branch-miss-rate%
     31.73           -17.6       14.11        perf-stat.overall.cache-miss-rate%
      2.67 ±  5%    +253.1%       9.43        perf-stat.overall.cpi
    488.19 ±  8%   +1031.8%       5525 ±  2%  perf-stat.overall.cycles-between-cache-misses
      0.07 ±  4%      -0.0        0.04 ±  8%  perf-stat.overall.dTLB-load-miss-rate%
      0.02 ± 11%      -0.0        0.01 ±  5%  perf-stat.overall.dTLB-store-miss-rate%
      0.38 ±  5%     -71.8%       0.11        perf-stat.overall.ipc
     95.25            +0.9       96.20        perf-stat.overall.node-load-miss-rate%
     52.85           -10.7       42.10        perf-stat.overall.node-store-miss-rate%
  3.48e+09 ±  4%    +102.0%  7.031e+09        perf-stat.ps.branch-instructions
  31936467           +16.6%   37233323        perf-stat.ps.branch-misses
  90890160           -41.5%   53183020        perf-stat.ps.cache-misses
 2.864e+08           +31.6%  3.769e+08        perf-stat.ps.cache-references
   1197506           -51.8%     577002        perf-stat.ps.context-switches
 4.436e+10 ±  8%    +562.1%  2.937e+11        perf-stat.ps.cpu-cycles
     35064          +303.7%     141572        perf-stat.ps.cpu-migrations
 4.301e+09           +95.4%  8.404e+09        perf-stat.ps.dTLB-loads
    291900 ± 11%     -48.8%     149597 ±  6%  perf-stat.ps.dTLB-store-misses
   1.9e+09           -23.4%  1.455e+09        perf-stat.ps.dTLB-stores
 1.658e+10 ±  3%     +87.8%  3.114e+10        perf-stat.ps.instructions
      2.02 ±  3%     -61.3%       0.78 ±  5%  perf-stat.ps.major-faults
      3374           +20.1%       4054        perf-stat.ps.minor-faults
  28494441           -32.2%   19318149        perf-stat.ps.node-load-misses
   1420047           -46.3%     762579        perf-stat.ps.node-loads
  12966465           -52.9%    6105973 ±  2%  perf-stat.ps.node-store-misses
  11570198           -27.4%    8396598        perf-stat.ps.node-stores
      3376           +20.1%       4055        perf-stat.ps.page-faults
 1.482e+12 ±  3%    +721.1%  1.217e+13 ±  5%  perf-stat.total.instructions
     26.76 ± 15%     -25.9        0.87        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     26.57 ± 15%     -25.7        0.86        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     26.55 ± 15%     -25.7        0.86        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     26.49 ± 15%     -25.6        0.86        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     22.39 ± 20%     -21.8        0.61 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     22.34 ± 20%     -21.7        0.61 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     16.55 ± 12%     -16.0        0.57 ±  2%  perf-profile.calltrace.cycles-pp.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     14.98 ±  5%     -14.8        0.17 ±141%  perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
     14.15 ±  6%     -14.1        0.00        perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
     10.26 ±  6%     -10.3        0.00        perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
     10.22 ±  9%     -10.2        0.00        perf-profile.calltrace.cycles-pp.asm_sysvec_call_function_single.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter
     11.79 ±  7%     -10.2        1.62 ± 38%  perf-profile.calltrace.cycles-pp.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
     11.79 ±  7%     -10.2        1.62 ± 38%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      9.70 ±  6%      -9.7        0.00        perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
     24.05 ±  5%      -8.7       15.37 ±  3%  perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     23.97 ±  5%      -8.6       15.36 ±  3%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      8.60 ±  6%      -8.6        0.00        perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data
     23.95 ±  5%      -8.6       15.36 ±  3%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
     23.93 ±  5%      -8.6       15.36 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file
     23.68 ±  5%      -8.3       15.35 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
      8.23 ± 21%      -8.2        0.00        perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter
      8.14 ±  9%      -8.1        0.00        perf-profile.calltrace.cycles-pp.asm_sysvec_reschedule_ipi.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter
      6.81 ±  7%      -6.8        0.00        perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      5.97 ± 14%      -6.0        0.00        perf-profile.calltrace.cycles-pp.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.do_idle
      5.75 ±  5%      -5.8        0.00        perf-profile.calltrace.cycles-pp.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      5.45 ±  7%      -5.5        0.00        perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page
      5.30 ±  6%      -5.3        0.00        perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      4.95 ±  6%      -4.1        0.86 ± 29%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
     17.93 ±  5%      -3.6       14.36 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
     17.67 ±  5%      -3.3       14.35 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      0.00            +0.5        0.54 ±  5%  perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +1.1        1.09 ± 45%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page
      0.00            +1.1        1.10 ± 45%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page
      0.00            +1.2        1.15 ± 45%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      0.00            +1.9        1.93 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00            +1.9        1.93 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page
      0.00            +1.9        1.93 ±  4%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.1        2.06 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page
      0.00            +2.1        2.06 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +2.1        2.06 ±  4%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00            +2.4        2.36 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00            +2.4        2.36 ±  3%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.4        2.37 ±  3%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.6        2.60 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00            +2.6        2.60 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.6        2.61 ±  3%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +2.8        2.76 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.8        2.76 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00            +2.8        2.76 ±  4%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.59 ±  6%      +4.8        7.42 ± 45%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +6.3        6.29 ± 46%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00            +6.3        6.30 ± 46%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +6.4        6.35 ± 46%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +6.6        6.60 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +6.6        6.60 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages
      0.00            +7.2        7.19 ±  4%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +11.4       11.42 ±  5%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page
      0.00           +11.4       11.43 ±  5%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00           +11.5       11.51 ±  5%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00           +11.5       11.54 ±  5%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page
      0.00           +11.6       11.55 ±  5%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00           +11.6       11.64 ±  5%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      2.16 ±  5%     +11.8       13.95 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      1.59 ±  5%     +12.3       13.89 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
     34.95 ±  5%     +12.3       47.29 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00           +13.5       13.49 ±  4%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00           +13.5       13.50 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00           +13.6       13.60 ±  4%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +14.1       14.12 ±  5%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00           +14.1       14.14 ±  5%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +14.2       14.24 ±  5%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.15 ±  5%     +14.2       16.40 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00           +15.2       15.15 ±  5%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00           +15.2       15.16 ±  5%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +15.3       15.28 ±  5%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.09 ±  6%     +15.3       17.42 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      2.26 ±  5%     +16.1       18.31 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     71.79 ±  5%     +27.1       98.92        perf-profile.calltrace.cycles-pp.write
     71.39 ±  5%     +27.5       98.87        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     71.36 ±  5%     +27.5       98.87        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     71.24 ±  5%     +27.6       98.86        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     71.21 ±  5%     +27.6       98.86        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     71.08 ±  5%     +27.8       98.85        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     71.03 ±  5%     +27.8       98.85        perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     68.74 ±  5%     +30.0       98.73        perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
     26.76 ± 15%     -25.9        0.87        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     26.76 ± 15%     -25.9        0.87        perf-profile.children.cycles-pp.cpu_startup_entry
     26.73 ± 15%     -25.9        0.87        perf-profile.children.cycles-pp.do_idle
     26.57 ± 15%     -25.7        0.86        perf-profile.children.cycles-pp.start_secondary
     25.94 ±  6%     -23.9        1.99 ± 34%  perf-profile.children.cycles-pp.do_write_page
     22.84 ±  6%     -22.1        0.69 ± 11%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
     22.56 ± 20%     -21.9        0.62 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter
     22.52 ± 20%     -21.9        0.62 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter_state
     22.43 ±  6%     -21.9        0.57 ± 17%  perf-profile.children.cycles-pp.osq_lock
     16.68 ± 12%     -16.1        0.58        perf-profile.children.cycles-pp.acpi_idle_enter
     16.54 ± 12%     -16.0        0.57 ±  2%  perf-profile.children.cycles-pp.acpi_idle_do_entry
     14.99 ±  5%     -14.6        0.40 ± 16%  perf-profile.children.cycles-pp.f2fs_outplace_write_data
     14.86 ±  6%     -14.5        0.36 ± 23%  perf-profile.children.cycles-pp.f2fs_submit_page_write
     11.79 ±  7%     -10.2        1.62 ± 38%  perf-profile.children.cycles-pp.f2fs_do_write_node_page
     10.34 ±  6%     -10.0        0.34 ± 10%  perf-profile.children.cycles-pp.f2fs_allocate_data_block
      8.95 ±  5%      -9.0        0.00        perf-profile.children.cycles-pp.rwsem_down_read_slowpath
     24.05 ±  5%      -8.7       15.37 ±  3%  perf-profile.children.cycles-pp.file_write_and_wait_range
     23.97 ±  5%      -8.6       15.36 ±  3%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
     23.95 ±  5%      -8.6       15.36 ±  3%  perf-profile.children.cycles-pp.do_writepages
     23.94 ±  5%      -8.6       15.36 ±  3%  perf-profile.children.cycles-pp.f2fs_write_data_pages
     23.68 ±  5%      -8.3       15.35 ±  3%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
      7.71 ±  7%      -7.5        0.23 ± 12%  perf-profile.children.cycles-pp.__mutex_lock
      6.35 ±  5%      -6.3        0.06 ±  8%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      6.63 ±  8%      -6.2        0.46        perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      5.77 ±  5%      -5.4        0.37 ±  3%  perf-profile.children.cycles-pp.set_node_addr
      5.67 ± 12%      -5.2        0.44 ±  6%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      4.37 ±  5%      -4.2        0.21 ±  2%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      4.36 ±  5%      -4.2        0.21 ±  2%  perf-profile.children.cycles-pp.find_get_pages_range_tag
      4.30 ±  9%      -4.1        0.19        perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi
      3.67 ±  5%      -3.6        0.07 ±  7%  perf-profile.children.cycles-pp.rwsem_wake
     17.93 ±  5%      -3.6       14.36 ±  4%  perf-profile.children.cycles-pp.f2fs_write_single_data_page
      5.82 ±  5%      -3.4        2.45 ±  3%  perf-profile.children.cycles-pp.__schedule
     17.67 ±  5%      -3.3       14.35 ±  4%  perf-profile.children.cycles-pp.f2fs_do_write_data_page
      3.47 ±  5%      -3.3        0.16 ± 40%  perf-profile.children.cycles-pp.f2fs_space_for_roll_forward
      3.44 ±  5%      -3.3        0.16 ± 40%  perf-profile.children.cycles-pp.__percpu_counter_sum
      3.07 ±  6%      -3.0        0.05        perf-profile.children.cycles-pp.wake_up_q
      2.82 ±  5%      -2.7        0.10 ±  8%  perf-profile.children.cycles-pp.__submit_bio
      2.81 ±  5%      -2.7        0.10 ±  8%  perf-profile.children.cycles-pp.submit_bio_noacct
      2.68 ±  5%      -2.6        0.09 ±  9%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      2.77 ±  6%      -2.5        0.27        perf-profile.children.cycles-pp.sysvec_call_function_single
      3.18 ±  6%      -2.5        0.69        perf-profile.children.cycles-pp.try_to_wake_up
      2.44 ±  5%      -2.4        0.09 ±  9%  perf-profile.children.cycles-pp.__submit_merged_bio
      2.30 ±  7%      -2.1        0.24        perf-profile.children.cycles-pp.__sysvec_call_function_single
      2.30            -2.0        0.34 ±  5%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      1.94 ±  5%      -1.9        0.07 ±  6%  perf-profile.children.cycles-pp.f2fs_buffered_write_iter
      4.17 ±  5%      -1.8        2.32 ±  3%  perf-profile.children.cycles-pp.schedule
      1.91 ±  5%      -1.8        0.09 ±  5%  perf-profile.children.cycles-pp.generic_perform_write
      1.98 ±  6%      -1.7        0.26 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock
      1.75 ±  5%      -1.6        0.14        perf-profile.children.cycles-pp.schedule_idle
      1.67 ±  6%      -1.5        0.19        perf-profile.children.cycles-pp.sched_ttwu_pending
      1.49 ±  4%      -1.4        0.06 ±  7%  perf-profile.children.cycles-pp.__pagevec_release
      1.47 ±  4%      -1.4        0.06 ±  7%  perf-profile.children.cycles-pp.release_pages
      1.45 ±  5%      -1.4        0.06 ±  8%  perf-profile.children.cycles-pp.folio_mark_dirty
      1.41 ±  6%      -1.4        0.05 ±  8%  perf-profile.children.cycles-pp.brd_submit_bio
      1.39 ±  6%      -1.3        0.05 ±  8%  perf-profile.children.cycles-pp.brd_do_bvec
      1.36 ± 13%      -1.3        0.05        perf-profile.children.cycles-pp.menu_select
      1.48 ±  5%      -1.3        0.23        perf-profile.children.cycles-pp.ttwu_do_activate
      1.46            -1.2        0.25 ±  3%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      1.45 ±  5%      -1.2        0.26        perf-profile.children.cycles-pp.enqueue_task_fair
      1.18 ±  4%      -1.1        0.05        perf-profile.children.cycles-pp.xas_find_marked
      1.36            -1.1        0.24 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
      1.34 ±  7%      -1.1        0.27        perf-profile.children.cycles-pp.dequeue_task_fair
      1.24 ±  6%      -1.0        0.20 ±  2%  perf-profile.children.cycles-pp.dequeue_entity
      1.22 ±  6%      -1.0        0.19        perf-profile.children.cycles-pp.enqueue_entity
      1.05 ±  5%      -0.8        0.27        perf-profile.children.cycles-pp.update_load_avg
      0.82 ±  4%      -0.6        0.19        perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.75 ±  6%      -0.6        0.13 ±  6%  perf-profile.children.cycles-pp.f2fs_issue_flush
      0.70 ±  6%      -0.6        0.10        perf-profile.children.cycles-pp.update_rq_clock
      0.53 ±  6%      -0.5        0.05        perf-profile.children.cycles-pp.native_irq_return_iret
      0.61 ±  6%      -0.5        0.14        perf-profile.children.cycles-pp.update_curr
      0.54 ±  6%      -0.5        0.08 ±  6%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.52 ±  7%      -0.5        0.07        perf-profile.children.cycles-pp.ttwu_queue_wakelist
      2.31 ±  5%      -0.4        1.89 ±  4%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.50 ±  2%      -0.4        0.09 ±  9%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.45 ±  4%      -0.4        0.05        perf-profile.children.cycles-pp.__list_add_valid
      0.45 ±  6%      -0.4        0.06        perf-profile.children.cycles-pp.ret_from_fork
      0.45 ±  6%      -0.4        0.06        perf-profile.children.cycles-pp.kthread
      0.50 ±  7%      -0.4        0.13 ± 40%  perf-profile.children.cycles-pp.f2fs_submit_merged_ipu_write
      0.43 ±  3%      -0.4        0.06        perf-profile.children.cycles-pp.sched_clock_cpu
      0.42 ±  6%      -0.4        0.05        perf-profile.children.cycles-pp.issue_flush_thread
      0.50 ±  6%      -0.4        0.14 ±  3%  perf-profile.children.cycles-pp.tick_sched_timer
      0.39            -0.3        0.07 ±  6%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.45 ±  7%      -0.3        0.14        perf-profile.children.cycles-pp.tick_sched_handle
      0.42 ±  3%      -0.3        0.11 ±  7%  perf-profile.children.cycles-pp.wait_for_completion
      0.40 ±  6%      -0.3        0.09        perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.44 ±  7%      -0.3        0.14 ±  3%  perf-profile.children.cycles-pp.update_process_times
      0.34 ± 11%      -0.3        0.06        perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.39 ±  3%      -0.3        0.11 ±  7%  perf-profile.children.cycles-pp.schedule_timeout
      0.32 ±  8%      -0.3        0.06        perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.39 ±  5%      -0.2        0.18 ±  5%  perf-profile.children.cycles-pp._find_next_bit
      0.28 ±  4%      -0.2        0.08        perf-profile.children.cycles-pp.finish_task_switch
      0.48 ±  7%      -0.2        0.28 ±  3%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.25 ± 10%      -0.2        0.06        perf-profile.children.cycles-pp.__update_load_avg_se
      0.23 ± 11%      -0.2        0.05        perf-profile.children.cycles-pp.__close
      0.22 ± 12%      -0.2        0.05        perf-profile.children.cycles-pp.task_work_run
      0.26 ±  4%      -0.2        0.09 ±  5%  perf-profile.children.cycles-pp.available_idle_cpu
      0.22 ± 11%      -0.2        0.05        perf-profile.children.cycles-pp.dput
      0.22 ± 11%      -0.2        0.05        perf-profile.children.cycles-pp.__fput
      0.22 ± 11%      -0.2        0.05        perf-profile.children.cycles-pp.__dentry_kill
      0.22 ± 11%      -0.2        0.05        perf-profile.children.cycles-pp.evict
      0.21 ±  9%      -0.2        0.05        perf-profile.children.cycles-pp.f2fs_evict_inode
      0.21 ±  8%      -0.2        0.05        perf-profile.children.cycles-pp.update_cfs_group
      1.49 ±  5%      -0.1        1.34 ±  5%  perf-profile.children.cycles-pp.find_busiest_group
      1.47 ±  5%      -0.1        1.33 ±  5%  perf-profile.children.cycles-pp.update_sd_lb_stats
      0.25 ±  8%      -0.1        0.11        perf-profile.children.cycles-pp.scheduler_tick
      0.11 ±  4%      -0.0        0.08        perf-profile.children.cycles-pp.update_blocked_averages
      0.22 ±  7%      -0.0        0.19 ±  6%  perf-profile.children.cycles-pp.idle_cpu
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.cpumask_next_wrap
      0.06 ± 13%      +0.1        0.13 ±  7%  perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.task_tick_fair
      0.02 ±141%      +0.1        0.11        perf-profile.children.cycles-pp.down_read_trylock
      0.07 ±  7%      +0.1        0.21 ±  2%  perf-profile.children.cycles-pp.select_idle_sibling
      1.67 ±  5%      +0.2        1.82 ±  4%  perf-profile.children.cycles-pp.newidle_balance
      0.00            +0.2        0.19 ±  2%  perf-profile.children.cycles-pp.select_idle_cpu
      0.13 ±  6%      +0.4        0.50 ±  5%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.05 ±  8%      +0.6        0.66        perf-profile.children.cycles-pp.__wake_up_common
      0.03 ± 70%      +0.6        0.64        perf-profile.children.cycles-pp.autoremove_wake_function
      0.08 ±  5%      +8.6        8.72 ±  4%  perf-profile.children.cycles-pp.__wake_up_common_lock
     34.96 ±  5%     +12.3       47.29 ±  4%  perf-profile.children.cycles-pp.f2fs_fsync_node_pages
      0.00           +12.4       12.42        perf-profile.children.cycles-pp.finish_wait
      2.16 ±  5%     +14.2       16.40 ±  4%  perf-profile.children.cycles-pp.f2fs_need_dentry_mark
      2.09 ±  6%     +15.3       17.42 ±  5%  perf-profile.children.cycles-pp.f2fs_need_inode_block_update
      2.26 ±  5%     +16.0       18.31 ±  5%  perf-profile.children.cycles-pp.f2fs_is_checkpointed_node
      3.76 ±  5%     +24.1       27.90 ±  5%  perf-profile.children.cycles-pp.f2fs_get_node_info
     71.83 ±  5%     +27.1       98.92        perf-profile.children.cycles-pp.write
     71.85 ±  5%     +27.1       98.97        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     71.82 ±  5%     +27.2       98.97        perf-profile.children.cycles-pp.do_syscall_64
     71.24 ±  5%     +27.6       98.87        perf-profile.children.cycles-pp.ksys_write
     71.22 ±  5%     +27.7       98.87        perf-profile.children.cycles-pp.vfs_write
     71.08 ±  5%     +27.8       98.86        perf-profile.children.cycles-pp.new_sync_write
     71.04 ±  5%     +27.8       98.85        perf-profile.children.cycles-pp.f2fs_file_write_iter
     68.74 ±  5%     +30.0       98.73        perf-profile.children.cycles-pp.f2fs_do_sync_file
      0.00           +73.3       73.31        perf-profile.children.cycles-pp.prepare_to_wait_event
      9.27 ±  4%     +84.1       93.35        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      4.61 ±  3%     +88.8       93.46        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     22.33 ±  6%     -21.8        0.57 ± 17%  perf-profile.self.cycles-pp.osq_lock
     10.94 ± 13%     -10.6        0.37 ±  2%  perf-profile.self.cycles-pp.acpi_idle_do_entry
      3.23 ±  5%      -3.1        0.16        perf-profile.self.cycles-pp.find_get_pages_range_tag
      2.58 ±  5%      -2.5        0.09 ±  9%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      1.81 ±  6%      -1.6        0.17        perf-profile.self.cycles-pp._raw_spin_lock
      1.37 ±  4%      -1.3        0.06        perf-profile.self.cycles-pp.release_pages
      1.13 ±  4%      -1.1        0.03 ± 70%  perf-profile.self.cycles-pp.xas_find_marked
      1.26 ±  4%      -1.0        0.23 ±  4%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.64 ±  7%      -0.6        0.09        perf-profile.self.cycles-pp.__schedule
      0.53 ±  6%      -0.5        0.05        perf-profile.self.cycles-pp.native_irq_return_iret
      0.53 ±  6%      -0.5        0.07 ±  6%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.48 ±  7%      -0.4        0.07 ±  7%  perf-profile.self.cycles-pp.update_rq_clock
      0.44 ±  4%      -0.4        0.05        perf-profile.self.cycles-pp.__list_add_valid
      0.43 ±  3%      -0.3        0.12 ±  3%  perf-profile.self.cycles-pp.update_load_avg
      0.36 ±  7%      -0.3        0.09 ±  5%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.29 ±  3%      -0.2        0.05        perf-profile.self.cycles-pp.update_curr
      0.34 ±  5%      -0.2        0.15 ±  3%  perf-profile.self.cycles-pp._find_next_bit
      0.23 ± 10%      -0.2        0.05        perf-profile.self.cycles-pp.__update_load_avg_se
      0.25 ±  5%      -0.2        0.08        perf-profile.self.cycles-pp.available_idle_cpu
      0.21 ±  8%      -0.2        0.05        perf-profile.self.cycles-pp.update_cfs_group
      1.09 ±  5%      -0.1        0.98 ±  4%  perf-profile.self.cycles-pp.update_sd_lb_stats
      0.21 ±  7%      -0.0        0.18 ±  6%  perf-profile.self.cycles-pp.idle_cpu
      0.07 ±  7%      +0.1        0.12 ±  6%  perf-profile.self.cycles-pp.load_balance
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.select_idle_cpu
      0.02 ±141%      +0.1        0.11 ±  4%  perf-profile.self.cycles-pp.down_read_trylock
      0.00            +0.1        0.13        perf-profile.self.cycles-pp.prepare_to_wait_event
      9.26 ±  4%     +84.1       93.35        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath



***************************************************************************************************
lkp-cpl-4sp1: 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/1BRD_48G/f2fs/x86_64-rhel-8.3/200/debian-10.4-x86_64-20200603.cgz/lkp-cpl-4sp1/sync_disk_rw/aim7/0x7002302

commit: 
  dd81e1c7d5 ("Merge tag 'powerpc-5.17-2' of git://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux")
  e4544b63a7 ("f2fs: move f2fs to use reader-unfair rwsems")

dd81e1c7d5fb126e e4544b63a7ee49e7fbebf35ece0 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      9023           -70.8%       2633 ±  4%  aim7.jobs-per-min
    133.01          +243.4%     456.72 ±  4%  aim7.time.elapsed_time
    133.01          +243.4%     456.72 ±  4%  aim7.time.elapsed_time.max
     10962 ±  5%  +23090.1%    2542101 ±  6%  aim7.time.involuntary_context_switches
      2826            -2.5%       2754        aim7.time.maximum_resident_set_size
     30640 ±  5%    +454.9%     170035 ±  7%  aim7.time.minor_page_faults
      2925 ±  4%   +1767.2%      54628 ±  4%  aim7.time.system_time
      6.57 ±  6%    +124.2%      14.73 ±  8%  aim7.time.user_time
  65839654          +103.2%  1.338e+08 ±  3%  aim7.time.voluntary_context_switches
 1.608e+10           -41.7%  9.368e+09 ±  2%  cpuidle..time
     52.73 ±  5%      +9.0%      57.49        boot-time.boot
      6941 ±  5%      +9.9%       7626        boot-time.idle
     83.98           -82.2%      14.91 ±  2%  iostat.cpu.idle
     15.74 ±  3%    +439.8%      84.94        iostat.cpu.system
    190.73          +172.8%     520.31 ±  4%  uptime.boot
     23476 ±  2%     -25.4%      17502 ±  2%  uptime.idle
     83.78           -69.2       14.55 ±  2%  mpstat.cpu.all.idle%
      0.08 ± 10%      -0.0        0.05 ±  6%  mpstat.cpu.all.iowait%
      0.80 ±  4%      -0.1        0.71        mpstat.cpu.all.irq%
     15.06 ±  3%     +69.4       84.51        mpstat.cpu.all.sys%
      0.19            -0.1        0.09 ±  4%  mpstat.cpu.all.usr%
     83.67           -82.9%      14.33 ±  3%  vmstat.cpu.id
     15.33 ±  3%    +452.2%      84.67        vmstat.cpu.sy
    621825           -70.1%     185967 ±  4%  vmstat.io.bo
     21.00 ± 10%    +503.2%     126.67        vmstat.procs.r
    972937           -49.4%     492366        vmstat.system.cs
   3246118           -11.9%    2858570 ±  2%  numa-numastat.node1.local_node
   3303585           -12.0%    2908254 ±  2%  numa-numastat.node1.numa_hit
   3135174 ±  2%     -12.5%    2743411        numa-numastat.node2.local_node
   3178730           -11.6%    2808652        numa-numastat.node2.numa_hit
   3765442           -17.2%    3117446 ±  2%  numa-numastat.node3.local_node
   3795016           -16.9%    3154743        numa-numastat.node3.numa_hit
     17177           -47.9%       8948 ±  2%  meminfo.Active(file)
    142005           +32.7%     188500        meminfo.AnonHugePages
   1224077           -24.4%     925740        meminfo.Committed_AS
     68682 ±  9%     -40.3%      40998        meminfo.Dirty
    895183           -34.5%     586098        meminfo.Inactive
    748295           -40.4%     446216 ±  2%  meminfo.Inactive(anon)
    396841 ±  9%     -54.3%     181234 ±  5%  meminfo.Mapped
  27415214           -27.7%   19813647        meminfo.Memused
    675386 ±  2%     -39.1%     411177 ±  2%  meminfo.Shmem
    994.00 ± 14%     -50.7%     490.00 ± 10%  meminfo.Writeback
  27417659           -27.2%   19970691        meminfo.max_used_kB
    581.67 ±  3%    +386.6%       2830        turbostat.Avg_MHz
     18.02 ±  3%     +68.0       86.04        turbostat.Busy%
      3233            +2.0%       3296        turbostat.Bzy_MHz
   6275606 ±  2%     +66.5%   10446899 ±  8%  turbostat.C1
      2.27 ±  7%      -1.2        1.03 ±  4%  turbostat.C1%
  89353368           -17.6%   73670735 ±  9%  turbostat.C1E
     74.69 ±  4%     -63.9       10.78 ±  2%  turbostat.C1E%
     80.62           -83.5%      13.28        turbostat.CPU%c1
  41908830          +275.6%  1.574e+08 ± 16%  turbostat.IRQ
     49.67 ±  2%     +12.1%      55.67 ±  3%  turbostat.PkgTmp
    378.68           +26.9%     480.36        turbostat.PkgWatt
     39.52 ±  2%      -4.7%      37.68        turbostat.RAMWatt
     52818 ±  3%      +8.6%      57373 ±  3%  proc-vmstat.nr_active_anon
      4297           -47.9%       2236 ±  2%  proc-vmstat.nr_active_file
     70914            -6.7%      66149        proc-vmstat.nr_anon_pages
     18087 ±  9%     -43.3%      10263        proc-vmstat.nr_dirty
   2592031            +7.3%    2782297        proc-vmstat.nr_dirty_background_threshold
   5190400            +7.3%    5571398        proc-vmstat.nr_dirty_threshold
    849437            -8.3%     778715        proc-vmstat.nr_file_pages
  26050640            +7.3%   27959782        proc-vmstat.nr_free_pages
    188213           -40.6%     111868 ±  2%  proc-vmstat.nr_inactive_anon
     36616            -4.5%      34978        proc-vmstat.nr_inactive_file
     27761            -7.1%      25785        proc-vmstat.nr_kernel_stack
    101009 ±  9%     -54.7%      45776 ±  4%  proc-vmstat.nr_mapped
      2454            -7.1%       2280        proc-vmstat.nr_page_table_pages
    170156 ±  2%     -39.4%     103160 ±  2%  proc-vmstat.nr_shmem
     46943            -8.2%      43099        proc-vmstat.nr_slab_reclaimable
    332.00 ± 20%     -63.2%     122.33 ±  5%  proc-vmstat.nr_writeback
     52818 ±  3%      +8.6%      57373 ±  3%  proc-vmstat.nr_zone_active_anon
      4297           -47.9%       2236 ±  2%  proc-vmstat.nr_zone_active_file
    188213           -40.6%     111868 ±  2%  proc-vmstat.nr_zone_inactive_anon
     36616            -4.5%      34978        proc-vmstat.nr_zone_inactive_file
     17322 ±  8%     -39.5%      10475        proc-vmstat.nr_zone_write_pending
    248503 ±  6%     +49.2%     370838 ±  3%  proc-vmstat.numa_hint_faults
     85952 ± 11%    +102.1%     173717 ±  8%  proc-vmstat.numa_hint_faults_local
  13399838           -12.1%   11775591        proc-vmstat.numa_hit
  13204028           -12.3%   11579798        proc-vmstat.numa_local
      7649 ± 60%    +695.1%      60823 ± 17%  proc-vmstat.numa_pages_migrated
    431655 ±  6%     +36.8%     590543 ±  3%  proc-vmstat.numa_pte_updates
     47974         +1007.6%     531369        proc-vmstat.pgactivate
  13411344           -12.1%   11784147        proc-vmstat.pgalloc_normal
     19653            -2.3%      19207        proc-vmstat.pgdeactivate
   1191636 ±  2%    +111.8%    2523476 ±  3%  proc-vmstat.pgfault
   3359965           +44.7%    4860911        proc-vmstat.pgfree
      7649 ± 60%    +695.1%      60823 ± 17%  proc-vmstat.pgmigrate_success
     43664          +174.2%     119718 ±  3%  proc-vmstat.pgreuse
     39295            -2.3%      38392        proc-vmstat.pgrotated
    150754 ± 67%     +63.2%     246013 ±  6%  numa-meminfo.node0.AnonPages.max
     18133 ±  8%     -41.3%      10638        numa-meminfo.node0.Dirty
    821082 ±133%    +115.3%    1767949 ± 61%  numa-meminfo.node0.FilePages
    850.33 ± 47%    +594.5%       5905 ± 57%  numa-meminfo.node0.PageTables
     84047 ± 12%     +32.2%     111126 ±  6%  numa-meminfo.node0.SUnreclaim
    133420 ± 11%     +45.5%     194184 ± 17%  numa-meminfo.node0.Slab
    757135 ±140%    +123.2%    1689707 ± 63%  numa-meminfo.node0.Unevictable
      3868           -53.7%       1789 ±  3%  numa-meminfo.node1.Active(file)
    993.67 ±141%   +2776.0%      28578 ± 73%  numa-meminfo.node1.AnonHugePages
     18175 ±  8%     -40.0%      10909        numa-meminfo.node1.Dirty
    203419 ± 37%     -69.7%      61649 ± 22%  numa-meminfo.node1.FilePages
      5448 ±  2%     -10.5%       4876 ±  3%  numa-meminfo.node1.KernelStack
     51418 ± 18%     -52.9%      24226 ± 35%  numa-meminfo.node1.Mapped
   6199397           -32.1%    4212105        numa-meminfo.node1.MemUsed
      2811 ± 62%    +135.0%       6606 ± 22%  numa-meminfo.node2.Active(anon)
      5167 ± 16%     -53.6%       2395 ± 35%  numa-meminfo.node2.Active(file)
     18314 ±  9%     -46.2%       9856 ±  4%  numa-meminfo.node2.Dirty
   1705745 ± 65%     -51.0%     835428 ±130%  numa-meminfo.node2.FilePages
     37586            -9.6%      33987 ±  3%  numa-meminfo.node2.Inactive(file)
     69606 ± 46%     -48.1%      36151 ± 65%  numa-meminfo.node2.KReclaimable
      8407 ± 25%     -23.3%       6451 ± 28%  numa-meminfo.node2.KernelStack
     57525 ± 25%     -38.2%      35574 ± 42%  numa-meminfo.node2.Mapped
  25320269 ±  4%     +10.9%   28070115 ±  3%  numa-meminfo.node2.MemFree
   7701909 ± 13%     -35.7%    4952063 ± 21%  numa-meminfo.node2.MemUsed
     69606 ± 46%     -48.1%      36151 ± 65%  numa-meminfo.node2.SReclaimable
      7547 ±107%    +349.6%      33932 ± 38%  numa-meminfo.node2.Shmem
    154242 ± 31%     -30.3%     107529 ± 29%  numa-meminfo.node2.Slab
   1655330 ± 67%     -53.8%     765071 ±141%  numa-meminfo.node2.Unevictable
    193071 ±  4%      +8.2%     208882 ±  3%  numa-meminfo.node3.Active(anon)
      4427 ± 20%     -59.5%       1793 ±  4%  numa-meminfo.node3.Active(file)
     18059 ±  9%     -47.9%       9414        numa-meminfo.node3.Dirty
    668283 ±  4%     -32.6%     450427 ± 21%  numa-meminfo.node3.FilePages
    567429 ± 21%     -67.4%     184903 ± 13%  numa-meminfo.node3.Inactive
    530849 ± 22%     -71.2%     152907 ± 16%  numa-meminfo.node3.Inactive(anon)
     36579           -12.5%      31995        numa-meminfo.node3.Inactive(file)
      7283 ± 25%     -26.6%       5344 ± 11%  numa-meminfo.node3.KernelStack
    238607 ± 14%     -69.4%      72943        numa-meminfo.node3.Mapped
   6641259           -31.6%    4545156 ±  2%  numa-meminfo.node3.MemUsed
      3685 ±106%     -88.7%     416.00 ± 15%  numa-meminfo.node3.PageTables
    617405 ±  3%     -48.5%     318247        numa-meminfo.node3.Shmem
      4399           -39.2%       2675        numa-vmstat.node0.nr_dirty
    205234 ±133%    +115.3%     441938 ± 61%  numa-vmstat.node0.nr_file_pages
    211.67 ± 47%    +596.7%       1474 ± 57%  numa-vmstat.node0.nr_page_table_pages
     21011 ± 12%     +32.2%      27781 ±  6%  numa-vmstat.node0.nr_slab_unreclaimable
    189283 ±140%    +123.2%     422426 ± 63%  numa-vmstat.node0.nr_unevictable
    108.00 ±  2%     -55.2%      48.33 ±  9%  numa-vmstat.node0.nr_writeback
    189283 ±140%    +123.2%     422426 ± 63%  numa-vmstat.node0.nr_zone_unevictable
      4191           -34.5%       2744        numa-vmstat.node0.nr_zone_write_pending
    963.33           -53.6%     447.00 ±  3%  numa-vmstat.node1.nr_active_file
   2449050           +17.5%    2876554 ±  2%  numa-vmstat.node1.nr_dirtied
      4451           -38.3%       2745        numa-vmstat.node1.nr_dirty
     50842 ± 38%     -69.8%      15356 ± 22%  numa-vmstat.node1.nr_file_pages
      5446 ±  2%     -10.5%       4876 ±  3%  numa-vmstat.node1.nr_kernel_stack
     12751 ± 17%     -52.0%       6122 ± 34%  numa-vmstat.node1.nr_mapped
    107.33 ± 18%     -58.4%      44.67 ±  5%  numa-vmstat.node1.nr_writeback
   2437553           +17.5%    2863940 ±  2%  numa-vmstat.node1.nr_written
    963.33           -53.6%     447.00 ±  3%  numa-vmstat.node1.nr_zone_active_file
      4240           -34.0%       2799        numa-vmstat.node1.nr_zone_write_pending
   2288218 ±  7%     -21.7%    1792298 ±  5%  numa-vmstat.node1.numa_hit
   2209607 ±  8%     -22.1%    1721115 ±  6%  numa-vmstat.node1.numa_local
    704.33 ± 62%    +133.1%       1642 ± 22%  numa-vmstat.node2.nr_active_anon
      1287 ± 16%     -53.5%     598.33 ± 35%  numa-vmstat.node2.nr_active_file
      4488 ±  2%     -44.7%       2482 ±  4%  numa-vmstat.node2.nr_dirty
    426502 ± 65%     -51.0%     208784 ±130%  numa-vmstat.node2.nr_file_pages
   6333076 ±  4%     +10.8%    7016951 ±  3%  numa-vmstat.node2.nr_free_pages
      9467           -10.2%       8506 ±  3%  numa-vmstat.node2.nr_inactive_file
      8420 ± 25%     -23.4%       6448 ± 28%  numa-vmstat.node2.nr_kernel_stack
     14413 ± 25%     -37.6%       8994 ± 42%  numa-vmstat.node2.nr_mapped
      1890 ±107%    +344.5%       8402 ± 38%  numa-vmstat.node2.nr_shmem
     17394 ± 46%     -48.0%       9038 ± 65%  numa-vmstat.node2.nr_slab_reclaimable
    413832 ± 67%     -53.8%     191267 ±141%  numa-vmstat.node2.nr_unevictable
    107.33 ± 16%     -64.6%      38.00 ± 13%  numa-vmstat.node2.nr_writeback
    704.33 ± 62%    +133.1%       1642 ± 22%  numa-vmstat.node2.nr_zone_active_anon
      1287 ± 16%     -53.5%     598.33 ± 35%  numa-vmstat.node2.nr_zone_active_file
      9467           -10.2%       8506 ±  3%  numa-vmstat.node2.nr_zone_inactive_file
    413832 ± 67%     -53.8%     191267 ±141%  numa-vmstat.node2.nr_zone_unevictable
      4262           -40.5%       2535 ±  5%  numa-vmstat.node2.nr_zone_write_pending
   2787785 ± 18%     -27.8%    2011540 ± 20%  numa-vmstat.node2.numa_hit
   2729197 ± 19%     -29.3%    1928712 ± 21%  numa-vmstat.node2.numa_local
     47937 ±  4%      +8.6%      52081 ±  3%  numa-vmstat.node3.nr_active_anon
      1102 ± 20%     -59.4%     448.00 ±  4%  numa-vmstat.node3.nr_active_file
      4460 ±  2%     -47.1%       2361        numa-vmstat.node3.nr_dirty
    165419 ±  4%     -32.0%     112471 ± 21%  numa-vmstat.node3.nr_file_pages
    131364 ± 22%     -70.9%      38244 ± 17%  numa-vmstat.node3.nr_inactive_anon
      9174 ±  2%     -12.9%       7995        numa-vmstat.node3.nr_inactive_file
      7289 ± 25%     -26.7%       5344 ± 11%  numa-vmstat.node3.nr_kernel_stack
     57899 ± 14%     -68.5%      18264        numa-vmstat.node3.nr_mapped
    921.67 ±106%     -88.6%     104.67 ± 15%  numa-vmstat.node3.nr_page_table_pages
    152671 ±  3%     -48.0%      79429        numa-vmstat.node3.nr_shmem
    103.33 ± 16%     -56.5%      45.00 ±  4%  numa-vmstat.node3.nr_writeback
     47937 ±  4%      +8.6%      52081 ±  3%  numa-vmstat.node3.nr_zone_active_anon
      1102 ± 20%     -59.4%     448.00 ±  4%  numa-vmstat.node3.nr_zone_active_file
    131364 ± 22%     -70.9%      38244 ± 17%  numa-vmstat.node3.nr_zone_inactive_anon
      9175 ±  2%     -12.9%       7995        numa-vmstat.node3.nr_zone_inactive_file
      4251           -43.8%       2387        numa-vmstat.node3.nr_zone_write_pending
 2.966e+09           +28.6%  3.813e+09        perf-stat.i.branch-instructions
  33960441 ±  2%     +31.8%   44745148        perf-stat.i.branch-misses
     41.66           -14.5       27.13        perf-stat.i.cache-miss-rate%
  99821813 ±  2%     -28.2%   71639046        perf-stat.i.cache-misses
 2.316e+08 ±  3%     +12.8%  2.613e+08        perf-stat.i.cache-references
    996227           -50.3%     495444        perf-stat.i.context-switches
      5.94 ±  3%    +278.4%      22.49        perf-stat.i.cpi
 8.402e+10 ±  3%    +385.4%  4.078e+11        perf-stat.i.cpu-cycles
     40611 ±  3%    +166.9%     108409        perf-stat.i.cpu-migrations
    998.32 ±  7%    +465.2%       5642        perf-stat.i.cycles-between-cache-misses
      0.25 ± 15%      -0.1        0.11 ±  7%  perf-stat.i.dTLB-load-miss-rate%
   8934527 ±  7%     -44.7%    4939324 ±  5%  perf-stat.i.dTLB-load-misses
 3.796e+09           +33.3%  5.058e+09        perf-stat.i.dTLB-loads
      0.04 ± 20%      -0.0        0.02 ± 18%  perf-stat.i.dTLB-store-miss-rate%
    459447 ±  7%     -53.5%     213525 ± 15%  perf-stat.i.dTLB-store-misses
 1.614e+09           -22.7%  1.248e+09        perf-stat.i.dTLB-stores
     20.22 ±  3%      +5.5       25.70        perf-stat.i.iTLB-load-miss-rate%
   3979357 ±  2%     -45.7%    2162498 ±  3%  perf-stat.i.iTLB-load-misses
  16841042           -62.9%    6240320 ±  2%  perf-stat.i.iTLB-loads
 1.438e+10           +24.7%  1.794e+10        perf-stat.i.instructions
      3707 ±  3%    +132.8%       8632 ±  4%  perf-stat.i.instructions-per-iTLB-miss
      0.20 ±  4%     -75.8%       0.05        perf-stat.i.ipc
      2.30           -70.6%       0.68 ±  2%  perf-stat.i.major-faults
      0.58 ±  3%    +385.4%       2.83        perf-stat.i.metric.GHz
    688.00 ±  3%     -35.6%     443.31 ±  2%  perf-stat.i.metric.K/sec
     59.66           +20.8%      72.06        perf-stat.i.metric.M/sec
      8034           -35.6%       5172        perf-stat.i.minor-faults
     93.35            -1.9       91.44        perf-stat.i.node-load-miss-rate%
  46997176 ±  3%     -16.2%   39393426        perf-stat.i.node-load-misses
   3008057 ±  5%     +19.6%    3598593 ±  2%  perf-stat.i.node-loads
     91.88            +4.0       95.90        perf-stat.i.node-store-miss-rate%
  15310460 ±  2%     -30.9%   10580432        perf-stat.i.node-store-misses
    953036           -62.0%     362234 ±  4%  perf-stat.i.node-stores
      8036           -35.6%       5173        perf-stat.i.page-faults
     16.10 ±  2%      -9.6%      14.56        perf-stat.overall.MPKI
      1.14 ±  2%      +0.0        1.17        perf-stat.overall.branch-miss-rate%
     43.11           -15.7       27.41        perf-stat.overall.cache-miss-rate%
      5.84 ±  2%    +289.2%      22.73        perf-stat.overall.cpi
    841.56          +576.7%       5695        perf-stat.overall.cycles-between-cache-misses
      0.23 ±  8%      -0.1        0.10 ±  5%  perf-stat.overall.dTLB-load-miss-rate%
      0.03 ±  8%      -0.0        0.02 ± 15%  perf-stat.overall.dTLB-store-miss-rate%
     19.11 ±  2%      +6.6       25.75        perf-stat.overall.iTLB-load-miss-rate%
      3616 ±  2%    +129.6%       8304 ±  3%  perf-stat.overall.instructions-per-iTLB-miss
      0.17 ±  2%     -74.3%       0.04        perf-stat.overall.ipc
     93.99            -2.4       91.63        perf-stat.overall.node-load-miss-rate%
     94.14            +2.5       96.69        perf-stat.overall.node-store-miss-rate%
 2.944e+09           +29.3%  3.807e+09        perf-stat.ps.branch-instructions
  33703990 ±  2%     +32.5%   44648438        perf-stat.ps.branch-misses
  99059836 ±  2%     -27.8%   71496503        perf-stat.ps.cache-misses
 2.299e+08 ±  3%     +13.5%  2.608e+08        perf-stat.ps.cache-references
    988599           -50.0%     494339        perf-stat.ps.context-switches
 8.339e+10 ±  3%    +388.2%  4.071e+11        perf-stat.ps.cpu-cycles
     40304 ±  3%    +168.4%     108180        perf-stat.ps.cpu-migrations
   8862497 ±  7%     -44.2%    4945004 ±  5%  perf-stat.ps.dTLB-load-misses
 3.767e+09           +34.1%   5.05e+09        perf-stat.ps.dTLB-loads
    455874 ±  7%     -53.2%     213210 ± 15%  perf-stat.ps.dTLB-store-misses
 1.602e+09           -22.2%  1.246e+09        perf-stat.ps.dTLB-stores
   3948894 ±  2%     -45.3%    2159829 ±  3%  perf-stat.ps.iTLB-load-misses
  16712123           -62.7%    6225920 ±  2%  perf-stat.ps.iTLB-loads
 1.427e+10           +25.5%  1.791e+10        perf-stat.ps.instructions
      2.28           -70.5%       0.67 ±  2%  perf-stat.ps.major-faults
      7966           -35.1%       5167        perf-stat.ps.minor-faults
  46640466 ±  3%     -15.7%   39316797        perf-stat.ps.node-load-misses
   2985172 ±  5%     +20.3%    3592617 ±  2%  perf-stat.ps.node-loads
  15192323 ±  2%     -30.5%   10556476        perf-stat.ps.node-store-misses
    945665           -61.7%     361913 ±  4%  perf-stat.ps.node-stores
      7968           -35.1%       5168        perf-stat.ps.page-faults
 1.918e+12          +327.9%  8.206e+12 ±  4%  perf-stat.total.instructions
     46.10           -37.2        8.88        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     45.77           -37.0        8.80        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     45.76           -37.0        8.80        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     45.75           -37.0        8.80        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     43.33           -34.9        8.47        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     43.26           -34.8        8.47        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     41.45           -33.2        8.20        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     13.42           -13.2        0.18 ±141%  perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
     13.15 ±  2%     -13.0        0.17 ±141%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
     13.68 ±  3%     -12.7        0.99 ± 35%  perf-profile.calltrace.cycles-pp.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
     13.68 ±  3%     -12.7        0.99 ± 35%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      8.69 ±  7%      -8.7        0.00        perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      7.90 ±  8%      -7.9        0.00        perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page
      7.88 ±  2%      -7.9        0.00        perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
      7.65 ±  2%      -7.6        0.00        perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      7.25 ±  8%      -7.2        0.00        perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page
      7.02 ±  2%      -7.0        0.00        perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data
      5.06 ±  3%      -5.1        0.00        perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
     17.60            -2.7       14.91 ±  9%  perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     17.57            -2.7       14.90 ±  9%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     17.56            -2.7       14.90 ±  9%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
     17.55            -2.7       14.90 ±  9%  perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file
     17.41 ±  2%      -2.5       14.89 ±  9%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
     15.10            -1.5       13.57 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
     14.90            -1.3       13.55 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      1.36            +2.1        3.48 ± 48%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +2.3        2.34        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +2.3        2.34        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page
      0.00            +2.3        2.34        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00            +2.7        2.66        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page
      0.00            +2.7        2.67        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00            +2.7        2.67        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.8        2.77 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00            +2.8        2.77 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.8        2.78 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00            +2.8        2.78 ±  2%  perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +2.8        2.78        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.8        2.78        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +2.8        2.83 ± 50%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.00            +2.8        2.83 ± 50%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.8        2.85 ± 50%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.9        2.88        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +2.9        2.88        perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00            +2.9        2.88        perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
     18.64 ±  3%      +4.5       23.11        perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +6.4        6.45 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages
      0.00            +6.4        6.45        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +7.0        6.96        perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +10.2       10.22 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page
      0.00           +10.2       10.23 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00           +10.3       10.30 ±  2%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00           +11.6       11.63 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page
      0.00           +11.6       11.64 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.00           +11.7       11.73 ±  2%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00           +12.0       12.01 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.00           +12.0       12.02 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +12.1       12.11 ±  2%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.83 ±  3%     +12.2       12.99 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
      0.00           +12.7       12.70 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      0.00           +12.7       12.72 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00           +12.8       12.81 ±  2%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.17           +13.1       15.31 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00           +13.7       13.67 ±  2%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file
      0.00           +13.7       13.68 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
      1.10 ± 10%     +13.7       14.84 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00           +13.8       13.78 ±  2%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      1.22 ±  8%     +14.9       16.15 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      1.68 ±  3%     +15.3       17.02        perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     25.25 ±  3%     +18.0       43.21 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     53.14           +37.8       90.94        perf-profile.calltrace.cycles-pp.write
     53.02           +37.9       90.91        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     53.01           +37.9       90.91        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     52.96           +37.9       90.90        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     52.96           +37.9       90.90        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     52.91           +38.0       90.89        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     52.90           +38.0       90.89        perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     51.86           +38.9       90.78        perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
     46.10           -37.2        8.88        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     46.10           -37.2        8.88        perf-profile.children.cycles-pp.cpu_startup_entry
     46.09           -37.2        8.88        perf-profile.children.cycles-pp.do_idle
     45.77           -37.0        8.80        perf-profile.children.cycles-pp.start_secondary
     43.65           -35.1        8.54        perf-profile.children.cycles-pp.cpuidle_enter
     43.64           -35.1        8.54        perf-profile.children.cycles-pp.cpuidle_enter_state
     42.27           -33.8        8.44        perf-profile.children.cycles-pp.intel_idle
     26.83 ±  2%     -25.4        1.41 ± 29%  perf-profile.children.cycles-pp.do_write_page
     23.61 ±  3%     -23.0        0.62 ± 26%  perf-profile.children.cycles-pp.osq_lock
     15.99           -15.4        0.56 ± 13%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
     13.75 ±  5%     -13.2        0.57 ± 18%  perf-profile.children.cycles-pp.f2fs_allocate_data_block
     13.43           -13.0        0.44 ± 16%  perf-profile.children.cycles-pp.f2fs_outplace_write_data
     13.69 ±  3%     -12.7        0.99 ± 35%  perf-profile.children.cycles-pp.f2fs_do_write_node_page
     12.59           -12.3        0.29 ± 26%  perf-profile.children.cycles-pp.f2fs_submit_page_write
     12.27 ±  6%     -11.8        0.44 ± 20%  perf-profile.children.cycles-pp.__mutex_lock
      6.55 ±  3%      -6.5        0.00        perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      5.42 ±  4%      -5.4        0.00        perf-profile.children.cycles-pp._raw_spin_lock_irq
      4.25 ± 41%      -4.1        0.12 ± 33%  perf-profile.children.cycles-pp.f2fs_space_for_roll_forward
      4.23 ± 41%      -4.1        0.12 ± 37%  perf-profile.children.cycles-pp.__percpu_counter_sum
     17.60            -2.7       14.91 ±  9%  perf-profile.children.cycles-pp.file_write_and_wait_range
     17.57            -2.7       14.90 ±  9%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
     17.56            -2.7       14.90 ±  9%  perf-profile.children.cycles-pp.do_writepages
     17.55            -2.7       14.90 ±  9%  perf-profile.children.cycles-pp.f2fs_write_data_pages
     17.41 ±  2%      -2.5       14.89 ±  9%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
      2.71 ±  3%      -2.4        0.35 ±  3%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      2.71 ±  3%      -2.4        0.35 ±  3%  perf-profile.children.cycles-pp.find_get_pages_range_tag
      2.10 ±  4%      -1.8        0.27 ±  4%  perf-profile.children.cycles-pp.set_node_addr
      1.82 ±  2%      -1.8        0.05        perf-profile.children.cycles-pp.rwsem_wake
     15.10            -1.5       13.57 ±  2%  perf-profile.children.cycles-pp.f2fs_write_single_data_page
      1.99 ±  2%      -1.4        0.55 ±  8%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
     14.90            -1.3       13.55 ±  2%  perf-profile.children.cycles-pp.f2fs_do_write_data_page
      1.34 ±  2%      -1.2        0.09 ±  5%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      1.16 ±  2%      -1.0        0.11 ±  4%  perf-profile.children.cycles-pp.__submit_bio
      1.14 ±  2%      -1.0        0.11 ±  4%  perf-profile.children.cycles-pp.submit_bio_noacct
      1.36 ±  3%      -1.0        0.34        perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      0.99 ±  2%      -0.9        0.07 ± 14%  perf-profile.children.cycles-pp.mutex_spin_on_owner
      0.97 ±  2%      -0.9        0.09 ±  9%  perf-profile.children.cycles-pp.__submit_merged_bio
      1.00 ±  2%      -0.9        0.14 ±  3%  perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      1.41 ±  2%      -0.8        0.57        perf-profile.children.cycles-pp.try_to_wake_up
      0.88 ±  2%      -0.8        0.07 ±  7%  perf-profile.children.cycles-pp.f2fs_buffered_write_iter
      0.88 ±  2%      -0.8        0.07        perf-profile.children.cycles-pp.generic_perform_write
      0.86 ±  2%      -0.8        0.09 ±  5%  perf-profile.children.cycles-pp.__pagevec_release
      0.85 ±  2%      -0.8        0.09 ±  5%  perf-profile.children.cycles-pp.release_pages
      0.94 ±  6%      -0.7        0.25 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock
      0.91 ±  3%      -0.7        0.24 ±  3%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      0.91 ±  3%      -0.7        0.23 ±  2%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.65 ±  4%      -0.6        0.07 ±  7%  perf-profile.children.cycles-pp.brd_submit_bio
      0.64 ±  4%      -0.6        0.06 ±  7%  perf-profile.children.cycles-pp.brd_do_bvec
      0.59 ± 10%      -0.6        0.03 ± 70%  perf-profile.children.cycles-pp.menu_select
      0.58 ±  7%      -0.5        0.03 ± 70%  perf-profile.children.cycles-pp.folio_mark_dirty
      0.55 ±  2%      -0.4        0.12        perf-profile.children.cycles-pp.schedule_idle
      0.48 ±  3%      -0.4        0.05        perf-profile.children.cycles-pp.xas_find_marked
      0.64            -0.4        0.22 ±  2%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.58 ±  2%      -0.4        0.23 ±  2%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.52 ±  3%      -0.3        0.18 ±  2%  perf-profile.children.cycles-pp.dequeue_entity
      0.55            -0.3        0.21 ±  2%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.40 ±  3%      -0.3        0.07 ±  6%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.50 ±  6%      -0.3        0.19        perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.54            -0.3        0.23 ±  2%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.46            -0.3        0.16 ±  2%  perf-profile.children.cycles-pp.enqueue_entity
      0.30 ± 10%      -0.3        0.04 ± 71%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.33            -0.3        0.07 ± 12%  perf-profile.children.cycles-pp.start_kernel
      0.30 ± 12%      -0.3        0.04 ± 71%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.41 ±  6%      -0.2        0.16        perf-profile.children.cycles-pp.tick_sched_timer
      0.38 ±  4%      -0.2        0.16 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.38 ±  4%      -0.2        0.15        perf-profile.children.cycles-pp.update_process_times
      0.43            -0.2        0.23 ±  2%  perf-profile.children.cycles-pp.update_load_avg
      0.33 ±  2%      -0.2        0.14        perf-profile.children.cycles-pp.f2fs_issue_flush
      0.28 ±  8%      -0.2        0.10 ±  9%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.24            -0.2        0.06 ±  8%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.25 ±  5%      -0.2        0.07        perf-profile.children.cycles-pp.update_rq_clock
      0.22            -0.2        0.05        perf-profile.children.cycles-pp.flush_smp_call_function_queue
      0.25 ±  9%      -0.2        0.09 ± 10%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.22 ±  7%      -0.2        0.06        perf-profile.children.cycles-pp.update_cfs_group
      0.21 ±  5%      -0.2        0.06        perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.20            -0.1        0.06        perf-profile.children.cycles-pp.ret_from_fork
      0.20            -0.1        0.06        perf-profile.children.cycles-pp.kthread
      0.23 ±  2%      -0.1        0.13        perf-profile.children.cycles-pp.update_curr
      0.23 ±  3%      -0.1        0.13 ±  3%  perf-profile.children.cycles-pp.scheduler_tick
      0.20 ±  4%      -0.1        0.12 ±  3%  perf-profile.children.cycles-pp.wait_for_completion
      0.18 ±  4%      -0.1        0.12        perf-profile.children.cycles-pp.schedule_timeout
      0.09 ±  5%      -0.0        0.05        perf-profile.children.cycles-pp.__update_load_avg_se
      0.11 ±  4%      -0.0        0.07        perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.12 ±  4%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.available_idle_cpu
      0.23 ±  2%      -0.0        0.21        perf-profile.children.cycles-pp.select_task_rq_fair
      0.08 ±  5%      -0.0        0.07        perf-profile.children.cycles-pp.finish_task_switch
      0.08 ±  6%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.task_tick_fair
      0.06 ± 14%      +0.0        0.10        perf-profile.children.cycles-pp.cpumask_next_and
      0.00            +0.1        0.09 ±  5%  perf-profile.children.cycles-pp.down_read_trylock
      0.00            +0.1        0.12        perf-profile.children.cycles-pp.select_idle_cpu
      0.00            +0.1        0.12 ± 10%  perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
      0.00            +0.1        0.15 ±  3%  perf-profile.children.cycles-pp.select_idle_sibling
      0.00            +0.2        0.15        perf-profile.children.cycles-pp.sysvec_call_function_single
      0.00            +0.2        0.15        perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.00            +0.2        0.17        perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      2.12            +0.3        2.47 ±  3%  perf-profile.children.cycles-pp.schedule
      0.04 ± 73%      +0.4        0.44 ±  4%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.00            +0.5        0.53        perf-profile.children.cycles-pp.autoremove_wake_function
      0.00            +0.6        0.55        perf-profile.children.cycles-pp.__wake_up_common
      1.04 ±  4%      +0.6        1.61 ±  3%  perf-profile.children.cycles-pp.update_sd_lb_stats
      1.05 ±  4%      +0.6        1.63 ±  3%  perf-profile.children.cycles-pp.find_busiest_group
      1.34 ±  3%      +0.8        2.11 ±  4%  perf-profile.children.cycles-pp.pick_next_task_fair
      1.14 ±  4%      +0.8        1.98 ±  4%  perf-profile.children.cycles-pp.load_balance
      1.18 ±  3%      +0.9        2.08 ±  4%  perf-profile.children.cycles-pp.newidle_balance
     18.64 ±  3%      +4.5       23.11        perf-profile.children.cycles-pp.__write_node_page
      0.00            +7.8        7.76 ±  3%  perf-profile.children.cycles-pp.__wake_up_common_lock
      2.17           +13.1       15.31 ±  2%  perf-profile.children.cycles-pp.f2fs_need_inode_block_update
      0.00           +13.9       13.87        perf-profile.children.cycles-pp.finish_wait
      1.23 ±  8%     +14.9       16.15 ±  2%  perf-profile.children.cycles-pp.f2fs_need_dentry_mark
      1.68 ±  3%     +15.3       17.02        perf-profile.children.cycles-pp.f2fs_is_checkpointed_node
     25.25 ±  3%     +18.0       43.21 ±  4%  perf-profile.children.cycles-pp.f2fs_fsync_node_pages
      1.94 ±  7%     +25.9       27.87        perf-profile.children.cycles-pp.f2fs_get_node_info
     53.38           +37.6       90.99        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     53.37           +37.6       90.99        perf-profile.children.cycles-pp.do_syscall_64
     53.16           +37.8       90.94        perf-profile.children.cycles-pp.write
     52.97           +37.9       90.90        perf-profile.children.cycles-pp.ksys_write
     52.97           +37.9       90.90        perf-profile.children.cycles-pp.vfs_write
     52.92           +38.0       90.90        perf-profile.children.cycles-pp.new_sync_write
     52.90           +38.0       90.89        perf-profile.children.cycles-pp.f2fs_file_write_iter
     51.87           +38.9       90.78        perf-profile.children.cycles-pp.f2fs_do_sync_file
      0.00           +64.6       64.55        perf-profile.children.cycles-pp.prepare_to_wait_event
      9.42 ± 14%     +75.8       85.22        perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      4.60 ± 35%     +80.7       85.34        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
     42.15           -33.7        8.42        perf-profile.self.cycles-pp.intel_idle
     23.46 ±  3%     -22.8        0.62 ± 26%  perf-profile.self.cycles-pp.osq_lock
      2.23 ±  3%      -1.9        0.30 ±  4%  perf-profile.self.cycles-pp.find_get_pages_range_tag
      1.33            -1.2        0.09        perf-profile.self.cycles-pp.rwsem_spin_on_owner
      0.99 ±  2%      -0.9        0.07 ± 14%  perf-profile.self.cycles-pp.mutex_spin_on_owner
      0.83 ±  2%      -0.7        0.09 ±  5%  perf-profile.self.cycles-pp.release_pages
      0.77 ±  2%      -0.6        0.16 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock
      0.47 ±  3%      -0.4        0.05        perf-profile.self.cycles-pp.xas_find_marked
      0.53            -0.3        0.23 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.26 ±  3%      -0.2        0.08 ±  6%  perf-profile.self.cycles-pp.__schedule
      0.24            -0.2        0.06 ±  8%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.20 ±  6%      -0.1        0.06        perf-profile.self.cycles-pp.update_cfs_group
      0.19 ±  6%      -0.1        0.05        perf-profile.self.cycles-pp.update_rq_clock
      0.22 ±  3%      -0.1        0.11 ±  4%  perf-profile.self.cycles-pp.update_load_avg
      0.11 ±  4%      -0.0        0.07        perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.09 ±  5%      -0.0        0.05        perf-profile.self.cycles-pp.__update_load_avg_se
      0.12 ±  4%      -0.0        0.08 ±  5%  perf-profile.self.cycles-pp.available_idle_cpu
      0.05 ±  8%      +0.1        0.14 ±  6%  perf-profile.self.cycles-pp.load_balance
      0.00            +0.1        0.09        perf-profile.self.cycles-pp.down_read_trylock
      0.00            +0.1        0.12        perf-profile.self.cycles-pp.prepare_to_wait_event
      0.76 ±  3%      +0.5        1.28 ±  3%  perf-profile.self.cycles-pp.update_sd_lb_stats
      9.42 ± 14%     +75.8       85.22        perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.17.0-rc1-00033-ge4544b63a7ee" of type "text/plain" (174625 bytes)

View attachment "job-script" of type "text/plain" (8232 bytes)

View attachment "job.yaml" of type "text/plain" (5550 bytes)

View attachment "reproduce" of type "text/plain" (1009 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ