lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [day] [month] [year] [list]
Message-ID: <20220619143432.GA34471@xsang-OptiPlex-9020>
Date:   Sun, 19 Jun 2022 22:34:32 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Tianchen Ding <dtcccc@...ux.alibaba.com>
Cc:     0day robot <lkp@...el.com>,
        Valentin Schneider <vschneid@...hat.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...ux.intel.com, fengwei.yin@...el.com,
        Ingo Molnar <mingo@...hat.com>,
        Peter Zijlstra <peterz@...radead.org>,
        Juri Lelli <juri.lelli@...hat.com>,
        Vincent Guittot <vincent.guittot@...aro.org>,
        Dietmar Eggemann <dietmar.eggemann@....com>,
        Steven Rostedt <rostedt@...dmis.org>,
        Ben Segall <bsegall@...gle.com>, Mel Gorman <mgorman@...e.de>,
        Daniel Bristot de Oliveira <bristot@...hat.com>,
        aubrey.li@...ux.intel.com, yu.c.chen@...el.com
Subject: [sched]  5e442b260e:  aim7.jobs-per-min 9.3% improvement



Greeting,

FYI, we noticed a 9.3% improvement of aim7.jobs-per-min due to commit:


commit: 5e442b260e53d036f2ab264dde4d11925be22b5e ("[PATCH v4 2/2] sched: Remove the limitation of WF_ON_CPU on wakelist if wakee cpu is idle")
url: https://github.com/intel-lab-lkp/linux/commits/Tianchen-Ding/sched-Queue-task-on-wakelist-in-the-same-llc-if-the-wakee-cpu-is-idle/20220609-003924
base: https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git 991d8d8142cad94f9c5c05db25e67fa83d6f772a
patch link: https://lore.kernel.org/lkml/20220608163518.324276-3-dtcccc@linux.alibaba.com

in testcase: aim7
on test machine: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
with following parameters:

	disk: 4BRD_12G
	md: RAID0
	fs: f2fs
	test: sync_disk_rw
	load: 100
	cpufreq_governor: performance
	ucode: 0x500320a

test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-11/performance/4BRD_12G/f2fs/x86_64-rhel-8.3/100/RAID0/debian-11.1-x86_64-20220510.cgz/lkp-csl-2sp9/sync_disk_rw/aim7/0x500320a

commit: 
  6943434cff ("sched: Fix the check of nr_running at queue wakelist")
  5e442b260e ("sched: Remove the limitation of WF_ON_CPU on wakelist if wakee cpu is idle")

6943434cff4c20fc 5e442b260e53d036f2ab264dde4 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      9920            +9.3%      10844        aim7.jobs-per-min
     60.51            -8.5%      55.36        aim7.time.elapsed_time
     60.51            -8.5%      55.36        aim7.time.elapsed_time.max
  86515865            -1.9%   84838461        aim7.time.file_system_outputs
   1297393           -13.4%    1124186 ±  2%  aim7.time.involuntary_context_switches
     10200           +12.2%      11440        aim7.time.minor_page_faults
    661.25           +37.2%     907.50        aim7.time.system_time
 4.548e+09           -16.7%   3.79e+09 ±  2%  cpuidle..time
      7166           -10.5%       6415        uptime.idle
     86.25            -7.6%      79.73        iostat.cpu.idle
     13.39           +48.3%      19.86 ±  2%  iostat.cpu.system
      0.08 ±  5%      +0.0        0.09 ±  6%  mpstat.cpu.all.soft%
     12.58            +6.6       19.18 ±  2%  mpstat.cpu.all.sys%
      0.26 ±  2%      +0.0        0.30 ±  3%  mpstat.cpu.all.usr%
     27190 ±  4%     +15.6%      31440 ±  5%  meminfo.Active
     21735 ±  5%     +24.1%      26980 ±  6%  meminfo.Active(anon)
      5455 ±  2%     -18.3%       4459 ±  4%  meminfo.Active(file)
     24216 ±  5%     +28.3%      31064 ±  7%  meminfo.Shmem
     86.00            -7.9%      79.17        vmstat.cpu.id
    676787            +6.4%     720377        vmstat.io.bo
     10.50 ±  7%     +44.4%      15.17 ±  8%  vmstat.procs.r
   1122807            +5.0%    1179464        vmstat.system.cs
      3750           -14.8%       3194 ±  2%  numa-meminfo.node0.Active(file)
     22239 ±  5%     +21.1%      26942 ±  7%  numa-meminfo.node1.Active
     20530 ±  5%     +25.2%      25712 ±  8%  numa-meminfo.node1.Active(anon)
      1708 ±  5%     -28.0%       1230 ±  9%  numa-meminfo.node1.Active(file)
      2039 ± 23%     +34.3%       2737 ± 12%  numa-meminfo.node1.Mapped
     22333 ±  6%     +29.6%      28936 ±  9%  numa-meminfo.node1.Shmem
    937.83           -14.8%     798.67 ±  2%  numa-vmstat.node0.nr_active_file
    937.83           -14.8%     798.67 ±  2%  numa-vmstat.node0.nr_zone_active_file
      5132 ±  5%     +25.3%       6428 ±  8%  numa-vmstat.node1.nr_active_anon
    427.33 ±  5%     -28.1%     307.17 ±  9%  numa-vmstat.node1.nr_active_file
    511.00 ± 23%     +34.2%     686.00 ± 12%  numa-vmstat.node1.nr_mapped
      5583 ±  6%     +29.6%       7234 ±  9%  numa-vmstat.node1.nr_shmem
      5132 ±  5%     +25.3%       6428 ±  8%  numa-vmstat.node1.nr_zone_active_anon
    427.33 ±  5%     -28.1%     307.17 ±  9%  numa-vmstat.node1.nr_zone_active_file
    492.00           +43.4%     705.67 ±  2%  turbostat.Avg_MHz
     17.96            +7.7       25.71 ±  2%  turbostat.Busy%
     69.72 ± 12%     -11.2       58.53 ± 12%  turbostat.C1E%
     80.05 ±  2%     -11.0%      71.23 ±  2%  turbostat.CPU%c1
      0.12 ±  4%     -13.0%       0.10        turbostat.IPC
    142122 ±  2%     +52.1%     216146 ± 62%  turbostat.POLL
    161.90            +5.2%     170.29        turbostat.PkgWatt
     14.78            +1.6%      15.02        turbostat.RAMWatt
      5433 ±  5%     +24.1%       6745 ±  6%  proc-vmstat.nr_active_anon
      1363 ±  2%     -18.3%       1114 ±  4%  proc-vmstat.nr_active_file
  10797839            -1.8%   10600669        proc-vmstat.nr_dirtied
      7721            +4.5%       8067        proc-vmstat.nr_mapped
      6054 ±  5%     +28.3%       7765 ±  7%  proc-vmstat.nr_shmem
  10754613            -1.8%   10558790        proc-vmstat.nr_written
      5433 ±  5%     +24.1%       6745 ±  6%  proc-vmstat.nr_zone_active_anon
      1363 ±  2%     -18.3%       1114 ±  4%  proc-vmstat.nr_zone_active_file
      8583 ±  6%     +11.3%       9552 ±  3%  proc-vmstat.nr_zone_write_pending
      3115 ±  5%     +54.3%       4807 ± 13%  proc-vmstat.numa_hint_faults
      1778 ±  7%     +66.5%       2961 ± 22%  proc-vmstat.numa_hint_faults_local
   8722671            +3.3%    9008440        proc-vmstat.numa_hit
   8642594            +3.3%    8928093        proc-vmstat.numa_local
      1152 ±  4%     +24.9%       1439 ±  2%  proc-vmstat.numa_pages_migrated
      7348 ± 15%     +91.2%      14051 ± 71%  proc-vmstat.numa_pte_updates
   8722226            +3.3%    9007744        proc-vmstat.pgalloc_normal
      9855            -2.7%       9584        proc-vmstat.pgdeactivate
    286759            -1.7%     281849        proc-vmstat.pgfault
      1152 ±  4%     +24.9%       1439 ±  2%  proc-vmstat.pgmigrate_success
  43053856            -1.9%   42247834        proc-vmstat.pgpgout
     14114 ±  3%      -5.9%      13276        proc-vmstat.pgreuse
     19705            -2.9%      19124        proc-vmstat.pgrotated
     51.22 ± 14%     +99.7%     102.29 ± 22%  sched_debug.cfs_rq:/.load_avg.avg
      1.00          -100.0%       0.00        sched_debug.cfs_rq:/.load_avg.min
    162.84 ± 18%     +76.3%     287.15 ± 12%  sched_debug.cfs_rq:/.load_avg.stddev
     56415 ±  7%     -86.7%       7529 ± 24%  sched_debug.cfs_rq:/.min_vruntime.avg
     75534 ±  5%     -68.4%      23853 ± 11%  sched_debug.cfs_rq:/.min_vruntime.max
     47673 ±  2%     -94.3%       2727 ± 37%  sched_debug.cfs_rq:/.min_vruntime.min
     28.67 ± 30%    +146.9%      70.80 ± 32%  sched_debug.cfs_rq:/.removed.load_avg.avg
    137.06 ± 25%     +85.4%     254.15 ± 14%  sched_debug.cfs_rq:/.removed.load_avg.stddev
     11.12 ± 38%    +170.7%      30.11 ± 26%  sched_debug.cfs_rq:/.removed.runnable_avg.avg
     57.12 ± 28%     +98.3%     113.25 ± 13%  sched_debug.cfs_rq:/.removed.runnable_avg.stddev
     11.12 ± 38%    +170.7%      30.11 ± 26%  sched_debug.cfs_rq:/.removed.util_avg.avg
     57.12 ± 28%     +98.3%     113.25 ± 13%  sched_debug.cfs_rq:/.removed.util_avg.stddev
    240.78 ±  3%     +47.9%     356.02 ±  3%  sched_debug.cfs_rq:/.runnable_avg.avg
      2.75 ± 65%    -100.0%       0.00        sched_debug.cfs_rq:/.runnable_avg.min
    223.17 ±  4%     +59.5%     355.95 ±  5%  sched_debug.cfs_rq:/.runnable_avg.stddev
    239.55 ±  3%     +48.4%     355.55 ±  3%  sched_debug.cfs_rq:/.util_avg.avg
      2.83 ± 62%    -100.0%       0.00        sched_debug.cfs_rq:/.util_avg.min
    222.22 ±  4%     +60.1%     355.68 ±  5%  sched_debug.cfs_rq:/.util_avg.stddev
    606.17 ±  7%     +36.8%     829.50        sched_debug.cfs_rq:/.util_est_enqueued.max
     89.20 ±  9%     +35.8%     121.09 ±  6%  sched_debug.cfs_rq:/.util_est_enqueued.stddev
    443616           +69.7%     752987 ±  2%  sched_debug.cpu.avg_idle.avg
     18395 ± 16%     -84.0%       2934 ± 12%  sched_debug.cpu.avg_idle.min
    177786 ±  6%     +54.0%     273718 ±  3%  sched_debug.cpu.avg_idle.stddev
     63844           -46.9%      33904        sched_debug.cpu.clock.avg
     63848           -46.9%      33908        sched_debug.cpu.clock.max
     63840           -46.9%      33896        sched_debug.cpu.clock.min
     63455           -46.6%      33856        sched_debug.cpu.clock_task.avg
     63529           -46.6%      33897        sched_debug.cpu.clock_task.max
     61757           -47.9%      32171        sched_debug.cpu.clock_task.min
    766.51 ± 18%     -40.9%     453.33 ± 11%  sched_debug.cpu.curr->pid.avg
      5396           -24.8%       4057        sched_debug.cpu.curr->pid.max
      1685 ±  6%     -26.5%       1238 ±  5%  sched_debug.cpu.curr->pid.stddev
    396511           -99.4%       2514        sched_debug.cpu.nr_switches.avg
    428394           -91.7%      35391 ± 17%  sched_debug.cpu.nr_switches.max
    381259           -99.9%     509.83 ±  8%  sched_debug.cpu.nr_switches.min
      8858 ± 12%     -51.4%       4305 ± 10%  sched_debug.cpu.nr_switches.stddev
      5.08 ± 77%    -100.0%       0.00        sched_debug.cpu.nr_uninterruptible.min
     63841           -46.9%      33902        sched_debug.cpu_clk
     63273           -47.3%      33334        sched_debug.ktime
     67566           -44.3%      37648        sched_debug.sched_clk
  3.48e+09           +27.2%  4.426e+09 ±  2%  perf-stat.i.branch-instructions
  52687234           +29.6%   68303668 ±  2%  perf-stat.i.branch-misses
  77656199           +17.3%   91125490        perf-stat.i.cache-misses
 4.048e+08           +11.8%  4.524e+08        perf-stat.i.cache-references
   1165867            +5.7%    1232531        perf-stat.i.context-switches
 4.346e+10           +43.9%  6.251e+10        perf-stat.i.cpu-cycles
     28996           +93.3%      56042        perf-stat.i.cpu-migrations
 4.873e+09           +26.7%  6.175e+09 ±  2%  perf-stat.i.dTLB-loads
 2.068e+09           +11.2%  2.301e+09        perf-stat.i.dTLB-stores
   7815990            +5.0%    8209588 ±  2%  perf-stat.i.iTLB-load-misses
  15259480            +9.2%   16667346        perf-stat.i.iTLB-loads
 1.736e+10           +27.1%  2.207e+10 ±  2%  perf-stat.i.instructions
      2661           +17.1%       3116        perf-stat.i.instructions-per-iTLB-miss
      0.43 ±  2%      -9.1%       0.39 ±  3%  perf-stat.i.ipc
      2.51 ±  8%     +11.6%       2.80 ±  4%  perf-stat.i.major-faults
      0.49           +43.9%       0.71        perf-stat.i.metric.GHz
    837.28 ±  6%     +18.8%     994.41 ±  6%  perf-stat.i.metric.K/sec
    122.95           +23.3%     151.64        perf-stat.i.metric.M/sec
      2965            +6.1%       3146        perf-stat.i.minor-faults
  33431211           +17.0%   39123224        perf-stat.i.node-load-misses
   3068926           +14.9%    3526873        perf-stat.i.node-loads
  13176282           +19.4%   15735332        perf-stat.i.node-store-misses
   1109004            +5.1%    1165168        perf-stat.i.node-stores
      2967            +6.1%       3149        perf-stat.i.page-faults
     23.31           -12.1%      20.50 ±  2%  perf-stat.overall.MPKI
      1.51            +0.0        1.54        perf-stat.overall.branch-miss-rate%
     19.18            +1.0       20.14        perf-stat.overall.cache-miss-rate%
      2.50           +13.2%       2.83        perf-stat.overall.cpi
    559.65           +22.6%     686.03        perf-stat.overall.cycles-between-cache-misses
     33.87            -0.9       33.00        perf-stat.overall.iTLB-load-miss-rate%
      2221           +21.0%       2688        perf-stat.overall.instructions-per-iTLB-miss
      0.40           -11.6%       0.35        perf-stat.overall.ipc
 3.423e+09           +26.9%  4.345e+09 ±  2%  perf-stat.ps.branch-instructions
  51819421           +29.4%   67056140 ±  2%  perf-stat.ps.branch-misses
  76365741           +17.1%   89449011        perf-stat.ps.cache-misses
 3.981e+08           +11.6%  4.442e+08        perf-stat.ps.cache-references
   1146487            +5.5%    1209844        perf-stat.ps.context-switches
 4.274e+10           +43.6%  6.137e+10        perf-stat.ps.cpu-cycles
     28515           +92.9%      55010        perf-stat.ps.cpu-migrations
 4.792e+09           +26.5%  6.062e+09 ±  2%  perf-stat.ps.dTLB-loads
 2.034e+09           +11.0%  2.259e+09        perf-stat.ps.dTLB-stores
   7686303            +4.8%    8058885 ±  2%  perf-stat.ps.iTLB-load-misses
  15006082            +9.0%   16360918        perf-stat.ps.iTLB-loads
 1.708e+10           +26.9%  2.167e+10 ±  2%  perf-stat.ps.instructions
      2.47 ±  8%     +11.4%       2.75 ±  4%  perf-stat.ps.major-faults
      2914            +5.9%       3088        perf-stat.ps.minor-faults
  32875499           +16.8%   38403159        perf-stat.ps.node-load-misses
   3017916           +14.7%    3461949        perf-stat.ps.node-loads
  12957246           +19.2%   15445720        perf-stat.ps.node-store-misses
   1090561            +4.9%    1143718        perf-stat.ps.node-stores
      2917            +5.9%       3090        perf-stat.ps.page-faults
 1.052e+12           +16.2%  1.222e+12        perf-stat.total.instructions
     46.00            -6.6       39.37        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
     50.29            -6.6       43.68        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     46.67            -6.5       40.18        perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     49.62            -6.5       43.14        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     49.60            -6.5       43.12        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     49.62            -6.5       43.14        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     43.76            -6.3       37.50        perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
     45.56            -6.2       39.31        perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
     44.62            -6.2       38.38        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
      1.80            -0.7        1.12 ±  2%  perf-profile.calltrace.cycles-pp.rwsem_wake.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      1.33            -0.6        0.74 ±  3%  perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      1.29            -0.6        0.71 ±  3%  perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.__write_node_page.f2fs_fsync_node_pages
      1.34            -0.4        0.90 ±  2%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      1.31            -0.4        0.88 ±  3%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      2.16            -0.4        1.78 ±  2%  perf-profile.calltrace.cycles-pp.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.15            -0.4        1.78 ±  2%  perf-profile.calltrace.cycles-pp.find_get_pages_range_tag.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      1.00 ±  7%      -0.4        0.63 ±  4%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
      0.92 ±  6%      -0.3        0.58 ±  5%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
      1.32 ±  2%      -0.3        1.03 ±  3%  perf-profile.calltrace.cycles-pp.ret_from_fork
      1.32 ±  2%      -0.3        1.03 ±  3%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      2.58 ±  2%      -0.2        2.37 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.79 ±  5%      -0.2        0.59 ±  4%  perf-profile.calltrace.cycles-pp.issue_flush_thread.kthread.ret_from_fork
      0.91 ±  4%      -0.2        0.71 ±  2%  perf-profile.calltrace.cycles-pp.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
      2.40            -0.2        2.22 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      1.51 ±  2%      -0.2        1.34        perf-profile.calltrace.cycles-pp.f2fs_buffered_write_iter.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
      1.48 ±  2%      -0.2        1.32        perf-profile.calltrace.cycles-pp.generic_perform_write.f2fs_buffered_write_iter.f2fs_file_write_iter.new_sync_write.vfs_write
      0.98            -0.2        0.82        perf-profile.calltrace.cycles-pp.__submit_merged_bio.__submit_merged_write_cond.f2fs_write_cache_pages.__f2fs_write_data_pages.do_writepages
      0.95            -0.2        0.80        perf-profile.calltrace.cycles-pp.__submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond.f2fs_write_cache_pages.__f2fs_write_data_pages
      0.94            -0.1        0.80        perf-profile.calltrace.cycles-pp.__submit_bio.__submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond.f2fs_write_cache_pages
      2.27 ±  2%      -0.1        2.15        perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.75 ±  2%      -0.1        0.63 ±  2%  perf-profile.calltrace.cycles-pp.__submit_bio.__submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond.f2fs_fsync_node_pages
      0.76 ±  2%      -0.1        0.64 ±  2%  perf-profile.calltrace.cycles-pp.__submit_merged_bio.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.75 ±  3%      -0.1        0.63 ±  2%  perf-profile.calltrace.cycles-pp.__submit_bio_noacct.__submit_merged_bio.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
      2.02            -0.1        1.91 ±  2%  perf-profile.calltrace.cycles-pp.__wait_for_common.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      2.95            -0.1        2.84 ±  2%  perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_write_cache_pages.__f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
      1.96            -0.1        1.86 ±  2%  perf-profile.calltrace.cycles-pp.schedule_timeout.__wait_for_common.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter
      1.95            -0.1        1.85 ±  2%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.__wait_for_common.f2fs_issue_flush
      1.04 ±  4%      -0.1        0.95 ±  3%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages.__f2fs_write_data_pages
      0.68 ±  4%      -0.1        0.60 ±  2%  perf-profile.calltrace.cycles-pp.release_pages.__pagevec_release.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.69 ±  4%      -0.1        0.60 ±  2%  perf-profile.calltrace.cycles-pp.__pagevec_release.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.66 ±  2%      -0.1        0.58 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_write_begin.generic_perform_write.f2fs_buffered_write_iter.f2fs_file_write_iter.new_sync_write
      1.70            -0.1        1.62 ±  2%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.__wait_for_common
      1.06 ±  4%      -0.1        0.98 ±  3%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages.__f2fs_write_data_pages.do_writepages
      1.04 ±  2%      -0.0        1.00        perf-profile.calltrace.cycles-pp.__schedule.schedule.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file
      0.70 ±  2%      +0.0        0.75 ±  3%  perf-profile.calltrace.cycles-pp.__schedule.schedule.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page
      0.72            +0.0        0.76 ±  3%  perf-profile.calltrace.cycles-pp.schedule.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.83 ±  2%      +0.1        0.90 ±  2%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.rwsem_down_read_slowpath.f2fs_fsync_node_pages
      0.60 ±  3%      +0.1        0.70 ±  9%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.57 ±  3%      +0.1        0.67 ±  9%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page
      1.49            +0.1        1.60 ±  5%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      1.27            +0.1        1.39 ±  7%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.set_node_addr.__write_node_page
      1.01            +0.2        1.21 ±  3%  perf-profile.calltrace.cycles-pp.__schedule.schedule.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page
      1.01 ±  2%      +0.2        1.22 ±  3%  perf-profile.calltrace.cycles-pp.schedule.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.56 ±  6%      +0.2        0.77 ± 13%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      0.91 ±  7%      +0.2        1.13 ± 14%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_write_slowpath.set_node_addr.__write_node_page
      0.46 ± 44%      +0.2        0.70 ±  4%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages.__f2fs_write_data_pages.do_writepages
      1.37 ±  2%      +0.3        1.64 ±  2%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.rwsem_down_read_slowpath.f2fs_get_node_info
      1.85 ±  2%      +0.3        2.13 ±  7%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.56 ±  7%      +0.3        0.84 ± 13%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.60 ±  6%      +0.3        0.88 ± 13%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      3.77            +0.3        4.10 ±  2%  perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.rwsem_down_read_slowpath
      1.99 ±  3%      +0.4        2.35 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.36 ± 71%      +0.4        0.73 ± 12%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page
      1.76 ±  3%      +0.4        2.15 ±  6%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      5.72 ±  4%      +0.5        6.18 ±  2%  perf-profile.calltrace.cycles-pp.load_balance.newidle_balance.pick_next_task_fair.__schedule.schedule
      0.76            +0.5        1.25        perf-profile.calltrace.cycles-pp.sched_ttwu_pending.flush_smp_call_function_queue.do_idle.cpu_startup_entry.start_secondary
      0.00            +0.5        0.54 ±  4%  perf-profile.calltrace.cycles-pp.__schedule.schedule.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages
      0.00            +0.5        0.54 ±  4%  perf-profile.calltrace.cycles-pp.schedule.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_write_cache_pages.__f2fs_write_data_pages
      1.15            +0.6        1.72        perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      4.54 ±  7%      +0.6        5.11 ±  6%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data
      0.00            +0.6        0.59 ±  8%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      4.96 ±  7%      +0.6        5.58 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00            +0.7        0.66 ±  2%  perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_queue
      4.64 ±  7%      +0.7        5.32 ±  6%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      0.00            +0.8        0.83 ±  2%  perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_queue.do_idle
      0.00            +0.9        0.86 ±  2%  perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_queue.do_idle.cpu_startup_entry
      1.27 ±  6%      +1.1        2.32 ± 14%  perf-profile.calltrace.cycles-pp.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      1.22 ±  6%      +1.1        2.28 ± 14%  perf-profile.calltrace.cycles-pp.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.66 ± 10%      +1.1        1.73 ± 16%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file.f2fs_file_write_iter
      0.61 ± 10%      +1.1        1.68 ± 17%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file
      0.62 ± 14%      +1.5        2.08 ±  8%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data
      0.91 ±  9%      +1.6        2.53 ±  7%  perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
      1.68 ±  6%      +1.7        3.38 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
     13.52 ±  2%      +2.2       15.67 ±  2%  perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     13.46 ±  3%      +2.2       15.62 ±  2%  perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     13.43 ±  3%      +2.2       15.59 ±  2%  perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
     13.42 ±  3%      +2.2       15.58 ±  2%  perf-profile.calltrace.cycles-pp.__f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file
     13.30 ±  3%      +2.2       15.46 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.__f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
      1.54 ±  5%      +2.2        3.74 ±  5%  perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page
      7.19 ±  5%      +2.3        9.51 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.__f2fs_write_data_pages
      9.79 ±  3%      +2.3       12.11 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.__f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
      9.58 ±  3%      +2.3       11.91 ±  2%  perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.__f2fs_write_data_pages.do_writepages
      6.84 ±  5%      +2.3        9.19 ±  4%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      2.03 ±  4%      +2.3        4.38 ±  4%  perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page
      2.87 ±  4%      +2.4        5.22 ±  4%  perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      2.35 ±  6%      +2.4        4.76 ±  9%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page
      2.82 ±  5%      +2.5        5.31 ±  9%  perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
      2.55 ±  5%      +2.5        5.06 ±  9%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page
      5.68 ±  7%      +3.0        8.72 ±  6%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page
     22.62            +4.4       27.00        perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
     15.10            +4.6       19.71        perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      5.95 ±  3%      +4.8       10.79 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      5.95 ±  3%      +4.8       10.78 ±  6%  perf-profile.calltrace.cycles-pp.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
     47.72            +7.0       54.68        perf-profile.calltrace.cycles-pp.write
     47.44            +7.0       54.45        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     47.43            +7.0       54.44        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     47.33            +7.0       54.36        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     47.34            +7.0       54.37        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     47.23            +7.0       54.27        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     47.21            +7.0       54.26        perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     45.44            +7.2       52.68        perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
     47.29            -6.6       40.68        perf-profile.children.cycles-pp.cpuidle_idle_call
     50.29            -6.6       43.68        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     50.29            -6.6       43.68        perf-profile.children.cycles-pp.cpu_startup_entry
     50.27            -6.6       43.67        perf-profile.children.cycles-pp.do_idle
     49.62            -6.5       43.14        perf-profile.children.cycles-pp.start_secondary
     46.17            -6.4       39.81        perf-profile.children.cycles-pp.cpuidle_enter
     46.15            -6.4       39.80        perf-profile.children.cycles-pp.cpuidle_enter_state
     44.71            -5.9       38.76        perf-profile.children.cycles-pp.intel_idle
     44.68            -5.9       38.74        perf-profile.children.cycles-pp.mwait_idle_with_hints
      2.59            -1.0        1.62        perf-profile.children.cycles-pp.try_to_wake_up
      2.74            -0.9        1.85        perf-profile.children.cycles-pp.rwsem_wake
      2.22            -0.9        1.34        perf-profile.children.cycles-pp.wake_up_q
      1.37            -0.4        0.92 ±  2%  perf-profile.children.cycles-pp.schedule_idle
      2.21            -0.4        1.83 ±  2%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      2.30            -0.4        1.92        perf-profile.children.cycles-pp.__submit_bio_noacct
      2.30            -0.4        1.92        perf-profile.children.cycles-pp.__submit_bio
      2.20            -0.4        1.83 ±  2%  perf-profile.children.cycles-pp.find_get_pages_range_tag
      1.44            -0.3        1.10 ±  3%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      2.40 ±  9%      -0.3        2.06 ±  9%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      1.32 ±  2%      -0.3        1.03 ±  3%  perf-profile.children.cycles-pp.ret_from_fork
      1.32 ±  2%      -0.3        1.03 ±  3%  perf-profile.children.cycles-pp.kthread
      1.75            -0.3        1.47        perf-profile.children.cycles-pp.__submit_merged_bio
      1.04 ±  2%      -0.3        0.78 ±  5%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      1.03 ±  2%      -0.3        0.77 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.93 ±  4%      -0.2        0.72 ±  2%  perf-profile.children.cycles-pp.menu_select
      2.58            -0.2        2.37 ±  2%  perf-profile.children.cycles-pp.f2fs_need_inode_block_update
      0.80 ±  4%      -0.2        0.59 ±  3%  perf-profile.children.cycles-pp.issue_flush_thread
      1.08            -0.2        0.90        perf-profile.children.cycles-pp.brd_submit_bio
      2.40            -0.2        2.22 ±  2%  perf-profile.children.cycles-pp.f2fs_issue_flush
      1.07            -0.2        0.89        perf-profile.children.cycles-pp.brd_do_bvec
      1.51 ±  2%      -0.2        1.34        perf-profile.children.cycles-pp.f2fs_buffered_write_iter
      1.18            -0.2        1.01        perf-profile.children.cycles-pp.ttwu_do_activate
      1.50 ±  2%      -0.2        1.33        perf-profile.children.cycles-pp.generic_perform_write
      1.14 ±  2%      -0.2        0.98        perf-profile.children.cycles-pp.enqueue_task_fair
      0.48 ±  3%      -0.2        0.33 ±  2%  perf-profile.children.cycles-pp.update_rq_clock
      0.30 ±  3%      -0.1        0.15 ±  7%  perf-profile.children.cycles-pp.set_next_entity
      0.49 ±  3%      -0.1        0.35 ±  5%  perf-profile.children.cycles-pp.ktime_get
      0.56 ±  2%      -0.1        0.43 ±  3%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      2.12            -0.1        2.00 ±  2%  perf-profile.children.cycles-pp.__wait_for_common
      0.36 ±  6%      -0.1        0.26 ±  7%  perf-profile.children.cycles-pp.clockevents_program_event
      0.45 ±  5%      -0.1        0.35 ±  3%  perf-profile.children.cycles-pp.md_submit_bio
      0.56 ±  2%      -0.1        0.46 ±  2%  perf-profile.children.cycles-pp.brd_insert_page
      0.40 ±  2%      -0.1        0.31 ±  3%  perf-profile.children.cycles-pp.tick_sched_timer
      0.34 ± 10%      -0.1        0.25 ±  4%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.72 ±  4%      -0.1        0.62 ±  2%  perf-profile.children.cycles-pp.release_pages
      0.51            -0.1        0.42 ±  3%  perf-profile.children.cycles-pp.worker_thread
      0.49 ±  2%      -0.1        0.41 ±  3%  perf-profile.children.cycles-pp.rwsem_mark_wake
      0.68 ±  2%      -0.1        0.60 ±  3%  perf-profile.children.cycles-pp.f2fs_write_end_io
      0.40 ±  4%      -0.1        0.32 ±  5%  perf-profile.children.cycles-pp.blkdev_issue_flush
      0.72 ±  4%      -0.1        0.64 ±  2%  perf-profile.children.cycles-pp.__pagevec_release
      0.66 ±  2%      -0.1        0.58 ±  2%  perf-profile.children.cycles-pp.f2fs_write_begin
      0.40 ±  4%      -0.1        0.32 ±  4%  perf-profile.children.cycles-pp.__submit_flush_wait
      0.38 ±  5%      -0.1        0.30 ±  3%  perf-profile.children.cycles-pp.md_handle_request
      0.75 ±  4%      -0.1        0.67 ±  3%  perf-profile.children.cycles-pp.down_read
      0.39 ±  3%      -0.1        0.31 ±  5%  perf-profile.children.cycles-pp.submit_bio_wait
      0.10 ±  4%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.check_preempt_curr
      0.84            -0.1        0.77 ±  2%  perf-profile.children.cycles-pp.enqueue_entity
      0.47 ±  3%      -0.1        0.39 ±  6%  perf-profile.children.cycles-pp.xas_find_marked
      0.32 ±  2%      -0.1        0.25 ±  3%  perf-profile.children.cycles-pp.update_process_times
      0.84            -0.1        0.77        perf-profile.children.cycles-pp.update_load_avg
      0.33 ±  3%      -0.1        0.26 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.34 ±  5%      -0.1        0.26 ±  4%  perf-profile.children.cycles-pp.raid0_make_request
      0.16 ±  8%      -0.1        0.09 ±  7%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.35 ±  7%      -0.1        0.29 ±  5%  perf-profile.children.cycles-pp.__filemap_get_folio
      0.21 ± 16%      -0.1        0.14 ±  9%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.36 ±  7%      -0.1        0.29 ±  4%  perf-profile.children.cycles-pp.pagecache_get_page
      0.39 ±  4%      -0.1        0.33 ±  3%  perf-profile.children.cycles-pp.__get_node_page
      0.44 ±  3%      -0.1        0.38 ±  3%  perf-profile.children.cycles-pp.prepare_write_begin
      0.38            -0.1        0.32 ±  2%  perf-profile.children.cycles-pp.copy_to_brd
      0.42 ±  4%      -0.1        0.36 ±  5%  perf-profile.children.cycles-pp.finish_task_switch
      0.12 ±  6%      -0.1        0.06 ± 11%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.36 ±  3%      -0.1        0.30 ±  5%  perf-profile.children.cycles-pp.f2fs_is_valid_blkaddr
      0.25 ±  4%      -0.1        0.19 ±  6%  perf-profile.children.cycles-pp.submit_flushes
      0.32 ±  3%      -0.1        0.26 ±  6%  perf-profile.children.cycles-pp.down_write
      0.34 ±  2%      -0.1        0.28 ±  5%  perf-profile.children.cycles-pp.process_one_work
      0.22 ±  6%      -0.1        0.16 ±  5%  perf-profile.children.cycles-pp.md_flush_request
      0.41 ±  4%      -0.0        0.36 ±  6%  perf-profile.children.cycles-pp.folio_end_writeback
      0.32 ±  2%      -0.0        0.27 ±  3%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.28 ±  4%      -0.0        0.22 ±  4%  perf-profile.children.cycles-pp.f2fs_write_inode
      0.30 ±  6%      -0.0        0.25 ±  4%  perf-profile.children.cycles-pp.complete
      0.25 ±  4%      -0.0        0.20 ±  5%  perf-profile.children.cycles-pp.f2fs_update_inode_page
      0.25 ±  4%      -0.0        0.20 ±  2%  perf-profile.children.cycles-pp.__switch_to
      0.12 ±  6%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.tick_nohz_idle_exit
      0.30 ±  2%      -0.0        0.26        perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.21 ±  4%      -0.0        0.16 ±  3%  perf-profile.children.cycles-pp.scheduler_tick
      0.39 ±  3%      -0.0        0.35 ±  3%  perf-profile.children.cycles-pp.f2fs_submit_merged_ipu_write
      0.14 ±  3%      -0.0        0.10 ±  7%  perf-profile.children.cycles-pp.__cond_resched
      0.29 ±  3%      -0.0        0.25 ±  4%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.20 ±  3%      -0.0        0.16 ±  3%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.25 ±  2%      -0.0        0.22 ±  3%  perf-profile.children.cycles-pp.__list_add_valid
      0.26 ±  3%      -0.0        0.23 ±  4%  perf-profile.children.cycles-pp.__irq_exit_rcu
      0.26 ±  2%      -0.0        0.22 ±  3%  perf-profile.children.cycles-pp.__mem_cgroup_flush_stats
      0.26 ±  2%      -0.0        0.22 ±  3%  perf-profile.children.cycles-pp.cgroup_rstat_flush_irqsafe
      0.26 ±  2%      -0.0        0.22 ±  3%  perf-profile.children.cycles-pp.cgroup_rstat_flush_locked
      0.16 ±  6%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.queue_work_on
      0.32 ±  3%      -0.0        0.28 ±  2%  perf-profile.children.cycles-pp.balance_dirty_pages_ratelimited
      0.26 ±  2%      -0.0        0.22 ±  3%  perf-profile.children.cycles-pp.mem_cgroup_wb_stats
      0.26 ±  3%      -0.0        0.23 ±  3%  perf-profile.children.cycles-pp.update_sit_entry
      0.24 ±  2%      -0.0        0.21 ±  2%  perf-profile.children.cycles-pp.__switch_to_asm
      0.24 ±  3%      -0.0        0.20 ±  4%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.15 ±  9%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.__queue_work
      0.34 ±  3%      -0.0        0.30 ±  3%  perf-profile.children.cycles-pp.f2fs_write_end
      0.22 ±  4%      -0.0        0.19 ±  5%  perf-profile.children.cycles-pp.native_sched_clock
      0.26 ±  2%      -0.0        0.23 ±  3%  perf-profile.children.cycles-pp.balance_dirty_pages
      0.17 ±  4%      -0.0        0.14 ±  2%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.11 ±  8%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.15 ±  6%      -0.0        0.12 ±  3%  perf-profile.children.cycles-pp.bio_alloc_bioset
      0.20 ±  2%      -0.0        0.18 ±  6%  perf-profile.children.cycles-pp.mutex_lock
      0.20 ±  3%      -0.0        0.17 ±  4%  perf-profile.children.cycles-pp.mem_cgroup_css_rstat_flush
      0.16 ±  5%      -0.0        0.13 ±  3%  perf-profile.children.cycles-pp.wake_q_add
      0.15 ±  6%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.f2fs_update_inode
      0.08 ±  8%      -0.0        0.05 ±  7%  perf-profile.children.cycles-pp.__wake_up_common
      0.15 ±  5%      -0.0        0.12 ±  3%  perf-profile.children.cycles-pp.kmem_cache_free
      0.08 ±  5%      -0.0        0.06 ±  6%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.21 ±  2%      -0.0        0.18 ±  6%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.19 ±  4%      -0.0        0.17 ±  5%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.13 ±  5%      -0.0        0.11 ±  3%  perf-profile.children.cycles-pp.folio_clear_dirty_for_io
      0.14 ±  6%      -0.0        0.12 ±  4%  perf-profile.children.cycles-pp.__has_merged_page
      0.10 ±  9%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.read_tsc
      0.09 ± 12%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.06 ±  7%      -0.0        0.04 ± 45%  perf-profile.children.cycles-pp.tick_nohz_idle_enter
      0.12 ±  4%      -0.0        0.10 ±  3%  perf-profile.children.cycles-pp.__might_resched
      0.11 ±  8%      -0.0        0.09 ±  5%  perf-profile.children.cycles-pp.cpumask_next
      0.11 ±  8%      -0.0        0.09 ± 11%  perf-profile.children.cycles-pp.read_node_page
      0.13 ±  2%      -0.0        0.11 ±  6%  perf-profile.children.cycles-pp.copy_page_from_iter_atomic
      0.10 ±  8%      -0.0        0.08 ±  7%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.10 ±  8%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.mempool_alloc
      0.10 ±  5%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.__bio_alloc
      0.09 ±  5%      -0.0        0.08 ±  6%  perf-profile.children.cycles-pp.reweight_entity
      0.08 ±  5%      -0.0        0.07 ±  8%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.08 ±  5%      -0.0        0.07 ±  5%  perf-profile.children.cycles-pp.xas_set_mark
      0.08 ±  5%      -0.0        0.07 ±  5%  perf-profile.children.cycles-pp.__is_cp_guaranteed
      0.07 ±  5%      -0.0        0.06        perf-profile.children.cycles-pp.switch_fpu_return
      0.11 ±  3%      +0.0        0.13 ±  6%  perf-profile.children.cycles-pp.available_idle_cpu
      0.30 ±  2%      +0.0        0.34 ±  4%  perf-profile.children.cycles-pp.select_task_rq
      0.27 ±  2%      +0.0        0.31 ±  2%  perf-profile.children.cycles-pp.__flush_smp_call_function_queue
      0.21 ±  3%      +0.0        0.26 ±  3%  perf-profile.children.cycles-pp.__smp_call_single_queue
      0.25 ±  2%      +0.0        0.30 ±  4%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.22 ±  2%      +0.0        0.26 ±  4%  perf-profile.children.cycles-pp.llist_add_batch
      0.02 ±141%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.task_h_load
      0.44            +0.0        0.49 ±  3%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.task_tick_fair
      0.00            +0.1        0.05 ±  7%  perf-profile.children.cycles-pp.select_idle_core
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.select_idle_cpu
      0.01 ±223%      +0.1        0.09 ±  8%  perf-profile.children.cycles-pp.select_idle_sibling
      0.20 ±  4%      +0.1        0.29 ±  3%  perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
      0.15 ±  5%      +0.1        0.26 ±  2%  perf-profile.children.cycles-pp.find_busiest_queue
      0.91            +0.1        1.02 ±  2%  perf-profile.children.cycles-pp.idle_cpu
      0.40 ±  2%      +0.1        0.52 ±  8%  perf-profile.children.cycles-pp.__lookup_nat_cache
      1.50            +0.1        1.63 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock
      6.38            +0.2        6.62        perf-profile.children.cycles-pp.update_sd_lb_stats
      6.11            +0.2        6.34        perf-profile.children.cycles-pp.update_sg_lb_stats
      6.47            +0.2        6.70        perf-profile.children.cycles-pp.find_busiest_group
      7.91            +0.2        8.16        perf-profile.children.cycles-pp.pick_next_task_fair
      9.53            +0.3        9.80        perf-profile.children.cycles-pp.schedule
      0.65 ±  5%      +0.3        0.93 ±  3%  perf-profile.children.cycles-pp.mutex_spin_on_owner
      3.70 ±  2%      +0.4        4.12 ±  6%  perf-profile.children.cycles-pp.f2fs_get_node_info
      7.46            +0.4        7.90        perf-profile.children.cycles-pp.newidle_balance
      6.83            +0.5        7.30        perf-profile.children.cycles-pp.load_balance
      0.88            +0.5        1.38        perf-profile.children.cycles-pp.sched_ttwu_pending
      1.17            +0.6        1.74        perf-profile.children.cycles-pp.flush_smp_call_function_queue
     10.44            +0.9       11.29 ±  3%  perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      4.83 ±  4%      +0.9        5.72 ±  9%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      1.95 ±  2%      +1.0        2.96 ± 10%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      1.27 ±  6%      +1.1        2.32 ± 14%  perf-profile.children.cycles-pp.f2fs_space_for_roll_forward
      1.22 ±  6%      +1.1        2.28 ± 14%  perf-profile.children.cycles-pp.__percpu_counter_sum
     13.52 ±  3%      +2.2       15.68 ±  2%  perf-profile.children.cycles-pp.file_write_and_wait_range
     13.46 ±  3%      +2.2       15.62 ±  2%  perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
     13.43 ±  3%      +2.2       15.59 ±  2%  perf-profile.children.cycles-pp.do_writepages
     13.42 ±  3%      +2.2       15.58 ±  2%  perf-profile.children.cycles-pp.__f2fs_write_data_pages
     13.30 ±  3%      +2.2       15.46 ±  2%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
      5.68 ±  2%      +2.3        7.97 ±  6%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      7.20 ±  5%      +2.3        9.51 ±  4%  perf-profile.children.cycles-pp.f2fs_outplace_write_data
      9.79 ±  3%      +2.3       12.11 ±  2%  perf-profile.children.cycles-pp.f2fs_write_single_data_page
      9.59 ±  3%      +2.3       11.92 ±  2%  perf-profile.children.cycles-pp.f2fs_do_write_data_page
      7.78 ±  5%      +3.1       10.89 ±  6%  perf-profile.children.cycles-pp.f2fs_submit_page_write
     10.38 ±  4%      +3.4       13.79 ±  4%  perf-profile.children.cycles-pp.rwsem_optimistic_spin
     13.28 ±  2%      +3.7       16.98 ±  3%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      2.95 ±  3%      +4.0        6.91 ±  5%  perf-profile.children.cycles-pp.__mutex_lock
      4.55 ±  3%      +4.1        8.60 ±  4%  perf-profile.children.cycles-pp.f2fs_allocate_data_block
     22.62            +4.4       27.00        perf-profile.children.cycles-pp.f2fs_fsync_node_pages
     15.10            +4.6       19.71        perf-profile.children.cycles-pp.__write_node_page
      5.95 ±  3%      +4.8       10.79 ±  6%  perf-profile.children.cycles-pp.f2fs_do_write_node_page
     47.75            +7.0       54.71        perf-profile.children.cycles-pp.write
     47.72            +7.0       54.72        perf-profile.children.cycles-pp.do_syscall_64
     47.73            +7.0       54.73        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     47.35            +7.0       54.38        perf-profile.children.cycles-pp.ksys_write
     47.34            +7.0       54.37        perf-profile.children.cycles-pp.vfs_write
     47.24            +7.0       54.28        perf-profile.children.cycles-pp.new_sync_write
     47.21            +7.0       54.26        perf-profile.children.cycles-pp.f2fs_file_write_iter
     10.20 ±  3%      +7.1       17.30 ±  5%  perf-profile.children.cycles-pp.osq_lock
     12.80 ±  2%      +7.2       19.98 ±  4%  perf-profile.children.cycles-pp.do_write_page
     45.44            +7.2       52.69        perf-profile.children.cycles-pp.f2fs_do_sync_file
     44.42            -5.9       38.53        perf-profile.self.cycles-pp.mwait_idle_with_hints
      1.74            -0.3        1.43 ±  2%  perf-profile.self.cycles-pp.find_get_pages_range_tag
      0.56            -0.2        0.38        perf-profile.self.cycles-pp.__schedule
      0.40 ±  4%      -0.1        0.28 ±  6%  perf-profile.self.cycles-pp.ktime_get
      0.36 ±  3%      -0.1        0.24 ±  3%  perf-profile.self.cycles-pp.update_rq_clock
      0.79 ±  3%      -0.1        0.68        perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.53            -0.1        0.42 ±  2%  perf-profile.self.cycles-pp.menu_select
      1.36            -0.1        1.25 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.30 ±  4%      -0.1        0.21 ±  2%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.68 ±  4%      -0.1        0.60 ±  2%  perf-profile.self.cycles-pp.release_pages
      0.46 ±  4%      -0.1        0.39 ±  5%  perf-profile.self.cycles-pp.xas_find_marked
      0.16 ±  7%      -0.1        0.08 ±  8%  perf-profile.self.cycles-pp.switch_mm_irqs_off
      0.69 ±  4%      -0.1        0.62 ±  3%  perf-profile.self.cycles-pp.down_read
      0.52 ±  4%      -0.1        0.46 ±  2%  perf-profile.self.cycles-pp.rwsem_optimistic_spin
      0.68 ±  2%      -0.1        0.62 ±  3%  perf-profile.self.cycles-pp.rwsem_down_read_slowpath
      0.36 ±  4%      -0.1        0.30 ±  5%  perf-profile.self.cycles-pp.f2fs_is_valid_blkaddr
      0.37 ±  3%      -0.1        0.32 ±  2%  perf-profile.self.cycles-pp.copy_to_brd
      0.36 ±  4%      -0.1        0.31 ±  4%  perf-profile.self.cycles-pp.f2fs_fsync_node_pages
      0.28 ±  3%      -0.0        0.24 ±  5%  perf-profile.self.cycles-pp.down_write
      0.32 ±  2%      -0.0        0.27 ±  3%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.20 ±  3%      -0.0        0.15 ±  2%  perf-profile.self.cycles-pp.__update_load_avg_se
      0.12 ±  6%      -0.0        0.08 ±  7%  perf-profile.self.cycles-pp.do_idle
      0.14 ± 11%      -0.0        0.10 ± 16%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.24 ±  3%      -0.0        0.20        perf-profile.self.cycles-pp.__switch_to
      0.26 ±  4%      -0.0        0.22 ±  4%  perf-profile.self.cycles-pp.rwsem_mark_wake
      0.45 ±  4%      -0.0        0.40 ±  6%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.28 ±  2%      -0.0        0.24 ±  4%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.25 ±  2%      -0.0        0.21 ±  3%  perf-profile.self.cycles-pp.__list_add_valid
      0.24 ±  3%      -0.0        0.20 ±  2%  perf-profile.self.cycles-pp.__switch_to_asm
      0.20 ±  3%      -0.0        0.17 ±  2%  perf-profile.self.cycles-pp.rwsem_down_write_slowpath
      0.26 ±  4%      -0.0        0.23 ±  3%  perf-profile.self.cycles-pp.update_sit_entry
      0.19 ±  7%      -0.0        0.16 ±  4%  perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
      0.29 ±  3%      -0.0        0.26 ±  4%  perf-profile.self.cycles-pp.newidle_balance
      0.30 ±  3%      -0.0        0.27        perf-profile.self.cycles-pp.enqueue_entity
      0.17 ±  4%      -0.0        0.14 ±  4%  perf-profile.self.cycles-pp.finish_task_switch
      0.19 ±  3%      -0.0        0.16 ±  2%  perf-profile.self.cycles-pp.__filemap_get_folio
      0.21 ±  5%      -0.0        0.19 ±  5%  perf-profile.self.cycles-pp.native_sched_clock
      0.16 ±  5%      -0.0        0.13 ±  3%  perf-profile.self.cycles-pp.wake_q_add
      0.11 ±  8%      -0.0        0.09 ±  8%  perf-profile.self.cycles-pp.submit_flushes
      0.14 ±  6%      -0.0        0.12 ±  7%  perf-profile.self.cycles-pp.try_to_wake_up
      0.08 ±  5%      -0.0        0.06 ±  6%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.12 ±  5%      -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.__might_resched
      0.10 ±  9%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.wake_up_q
      0.18 ±  2%      -0.0        0.16 ±  5%  perf-profile.self.cycles-pp.mutex_lock
      0.14 ±  6%      -0.0        0.12 ±  5%  perf-profile.self.cycles-pp.__has_merged_page
      0.07 ±  5%      -0.0        0.05 ± 44%  perf-profile.self.cycles-pp.schedule
      0.10 ±  9%      -0.0        0.08 ±  4%  perf-profile.self.cycles-pp.read_tsc
      0.19 ±  3%      -0.0        0.17 ±  4%  perf-profile.self.cycles-pp.mem_cgroup_css_rstat_flush
      0.08 ±  6%      -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.cpuidle_idle_call
      0.15 ±  4%      -0.0        0.13 ±  5%  perf-profile.self.cycles-pp.prepare_task_switch
      0.08 ±  5%      -0.0        0.07 ±  5%  perf-profile.self.cycles-pp.__is_cp_guaranteed
      0.09 ±  4%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.kmem_cache_free
      0.08            -0.0        0.07 ±  5%  perf-profile.self.cycles-pp.xas_set_mark
      0.10 ±  4%      +0.0        0.12 ±  3%  perf-profile.self.cycles-pp.__mutex_lock
      0.12 ±  5%      +0.0        0.15 ±  3%  perf-profile.self.cycles-pp.__flush_smp_call_function_queue
      0.22 ±  2%      +0.0        0.26 ±  4%  perf-profile.self.cycles-pp.llist_add_batch
      0.02 ±141%      +0.0        0.06 ±  7%  perf-profile.self.cycles-pp.task_h_load
      0.13 ±  2%      +0.1        0.22 ±  4%  perf-profile.self.cycles-pp.find_busiest_queue
      0.87            +0.1        0.99 ±  2%  perf-profile.self.cycles-pp.idle_cpu
      0.64 ±  4%      +0.3        0.92 ±  3%  perf-profile.self.cycles-pp.mutex_spin_on_owner
      5.67 ±  2%      +2.3        7.96 ±  6%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
     10.12 ±  3%      +7.1       17.18 ±  5%  perf-profile.self.cycles-pp.osq_lock




Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


-- 
0-DAY CI Kernel Test Service
https://01.org/lkp



View attachment "config-5.18.0-rc5-00024-g5e442b260e53" of type "text/plain" (162621 bytes)

View attachment "job-script" of type "text/plain" (8462 bytes)

View attachment "job.yaml" of type "text/plain" (5682 bytes)

View attachment "reproduce" of type "text/plain" (1009 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ