lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Wed, 7 Apr 2021 16:38:51 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Jaegeuk Kim <jaegeuk@...nel.org>
Cc:     Chao Yu <yuchao0@...wei.com>, LKML <linux-kernel@...r.kernel.org>,
        linux-f2fs-devel@...ts.sourceforge.net, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com
Subject: [f2fs]  b5d15199a2:  stress-ng.link.ops_per_sec 175.3% improvement



Greeting,

FYI, we noticed a 175.3% improvement of stress-ng.link.ops_per_sec due to commit:


commit: b5d15199a26f6dce624b43c82764cdb3827e7c89 ("f2fs: set checkpoint_merge by default")
https://git.kernel.org/cgit/linux/kernel/git/jaegeuk/f2fs.git dev


in testcase: stress-ng
on test machine: 48 threads Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 112G memory
with following parameters:

	nr_threads: 10%
	disk: 1HDD
	testtime: 60s
	fs: f2fs
	class: filesystem
	test: link
	cpufreq_governor: performance
	ucode: 0x42e






Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml
        bin/lkp run                    compatible-job.yaml

=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  filesystem/gcc-9/performance/1HDD/f2fs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-ivb-2ep1/link/stress-ng/60s/0x42e

commit: 
  be1ee45d51 ("f2fs: Fix a hungtask problem in atomic write")
  b5d15199a2 ("f2fs: set checkpoint_merge by default")

be1ee45d51384161 b5d15199a26f6dce624b43c8276 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     84.50 ± 12%    +172.4%     230.17 ± 26%  stress-ng.link.ops
      1.38 ± 12%    +175.3%       3.81 ± 27%  stress-ng.link.ops_per_sec
   6708992 ±  8%     -26.8%    4912632 ± 12%  stress-ng.time.file_system_outputs
     39.50 ± 11%     +63.3%      64.50 ± 23%  stress-ng.time.percent_of_cpu_this_job_got
      3.69 ± 11%    +131.1%       8.53 ± 25%  stress-ng.time.user_time
    571620 ±  9%     -39.3%     346948 ± 13%  stress-ng.time.voluntary_context_switches
    220063 ±171%     -83.0%      37321 ±  8%  sched_debug.cfs_rq:/.load.max
     94.99            -0.9%      94.10        iostat.cpu.idle
      3.01 ± 10%     +26.3%       3.80 ± 10%  iostat.cpu.system
      0.79 ± 12%      +0.5        1.29 ± 15%  mpstat.cpu.all.sys%
      0.32 ±  5%      +0.1        0.47 ± 13%  mpstat.cpu.all.usr%
     49650 ±  8%     -29.7%      34908 ± 14%  vmstat.io.bo
     18950 ±  8%     -23.9%      14412 ± 10%  vmstat.system.cs
      3061 ± 52%    +143.3%       7449 ± 46%  numa-meminfo.node0.Active
     12235 ± 12%     -35.5%       7889 ± 43%  numa-meminfo.node1.Active
     10313 ± 16%     -40.8%       6101 ± 56%  numa-meminfo.node1.Active(file)
    728.00 ±  7%     +18.8%     865.17 ±  7%  slabinfo.biovec-64.active_objs
    728.00 ±  7%     +18.8%     865.17 ±  7%  slabinfo.biovec-64.num_objs
      5573 ±  4%     -18.5%       4540 ± 11%  slabinfo.f2fs_free_nid.active_objs
      5573 ±  4%     -18.5%       4540 ± 11%  slabinfo.f2fs_free_nid.num_objs
    219.50 ± 38%     +54.6%     339.33 ± 20%  perf-sched.total_wait_and_delay.count.ms
      3.51 ± 95%    +360.1%      16.14 ± 60%  perf-sched.total_wait_time.max.ms
      5.00 ± 44%     +90.0%       9.50 ± 24%  perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      0.72 ± 73%    +162.4%       1.88 ± 36%  perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
      1.61 ±101%    +114.7%       3.45 ±  8%  perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      2.81 ±119%    +207.2%       8.64 ± 52%  perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
    191458 ± 11%     -36.9%     120899 ± 21%  interrupts.CAL:Function_call_interrupts
    165.83 ± 36%     +91.6%     317.67 ± 54%  interrupts.CPU31.NMI:Non-maskable_interrupts
    165.83 ± 36%     +91.6%     317.67 ± 54%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
    874.00 ± 21%    +245.6%       3020 ± 90%  interrupts.CPU4.CAL:Function_call_interrupts
      5.83 ±142%   +1420.0%      88.67 ±110%  interrupts.CPU4.RES:Rescheduling_interrupts
     13961 ± 11%     +28.4%      17930 ± 10%  interrupts.NMI:Non-maskable_interrupts
     13961 ± 11%     +28.4%      17930 ± 10%  interrupts.PMI:Performance_monitoring_interrupts
    238306 ±  6%     -29.3%     168365 ± 14%  softirqs.BLOCK
      6431 ± 54%     -83.2%       1082 ±221%  softirqs.CPU12.BLOCK
      5735 ± 68%     -83.7%     932.17 ±213%  softirqs.CPU14.BLOCK
      6049 ± 73%     -81.3%       1130 ±218%  softirqs.CPU15.BLOCK
      7303 ± 79%     -84.1%       1160 ±215%  softirqs.CPU42.BLOCK
    237746 ±  6%     -39.6%     143605 ± 47%  softirqs.CPU8.TASKLET
    237963 ±  6%     -29.1%     168684 ± 14%  softirqs.TASKLET
    718.67 ±  2%      +4.6%     752.00 ±  2%  proc-vmstat.nr_active_anon
    838351 ±  8%     -26.5%     616506 ± 12%  proc-vmstat.nr_dirtied
     36.83 ± 70%    +150.2%      92.17 ± 29%  proc-vmstat.nr_dirty
     79.83 ±  3%     +28.0%     102.17 ± 13%  proc-vmstat.nr_inactive_file
    822410 ±  8%     -30.3%     573093 ± 15%  proc-vmstat.nr_written
    718.67 ±  2%      +4.6%     752.00 ±  2%  proc-vmstat.nr_zone_active_anon
     79.83 ±  3%     +28.0%     102.17 ± 13%  proc-vmstat.nr_zone_inactive_file
     50.00 ± 31%     +93.0%      96.50 ± 30%  proc-vmstat.nr_zone_write_pending
    284698            +5.4%     300117        proc-vmstat.numa_hit
    241296 ±  2%      +6.4%     256695        proc-vmstat.numa_local
      1685 ±  2%      +6.1%       1788 ±  3%  proc-vmstat.pgactivate
    297293            +6.7%     317174 ±  2%  proc-vmstat.pgalloc_normal
    228557 ±  2%      +8.3%     247591 ±  3%  proc-vmstat.pgfree
   3289890 ±  8%     -30.3%    2292780 ± 15%  proc-vmstat.pgpgout
     23.88 ±  7%     -34.2%      15.71 ± 19%  perf-stat.i.MPKI
 4.305e+08 ±  6%     +55.7%  6.705e+08 ± 16%  perf-stat.i.branch-instructions
      4.74 ±  6%      -1.3        3.42 ± 20%  perf-stat.i.branch-miss-rate%
     19545 ±  9%     -24.3%      14791 ± 11%  perf-stat.i.context-switches
      3.26 ±  6%     -23.6%       2.49 ± 19%  perf-stat.i.cpi
 5.444e+09 ±  6%     +18.5%  6.454e+09 ±  5%  perf-stat.i.cpu-cycles
    771.80 ±  6%     +18.0%     910.63 ±  7%  perf-stat.i.cycles-between-cache-misses
   3667727 ±  6%     +54.5%    5666146 ± 15%  perf-stat.i.dTLB-load-misses
 5.089e+08 ±  6%     +61.9%  8.239e+08 ± 16%  perf-stat.i.dTLB-loads
    646004 ±  5%     +51.6%     979611 ± 16%  perf-stat.i.dTLB-store-misses
 4.139e+08 ±  4%     +50.6%  6.235e+08 ± 14%  perf-stat.i.dTLB-stores
 2.063e+09 ±  6%     +59.6%  3.293e+09 ± 16%  perf-stat.i.instructions
      1597 ± 12%     +45.5%       2323 ± 24%  perf-stat.i.instructions-per-iTLB-miss
      0.34 ±  5%     +39.1%       0.48 ± 16%  perf-stat.i.ipc
      0.11 ±  6%     +18.5%       0.13 ±  5%  perf-stat.i.metric.GHz
     29.03 ±  5%     +54.9%      44.96 ± 15%  perf-stat.i.metric.M/sec
     18.12 ±  8%     -36.1%      11.57 ± 14%  perf-stat.overall.MPKI
      4.50 ±  4%      -1.5        2.99 ± 15%  perf-stat.overall.branch-miss-rate%
      2.64 ±  4%     -24.2%       2.00 ± 13%  perf-stat.overall.cpi
    774.42 ±  6%     +17.7%     911.87 ±  7%  perf-stat.overall.cycles-between-cache-misses
      1574 ± 11%     +49.2%       2349 ± 23%  perf-stat.overall.instructions-per-iTLB-miss
      0.38 ±  4%     +34.0%       0.51 ± 13%  perf-stat.overall.ipc
 4.246e+08 ±  6%     +55.5%  6.602e+08 ± 16%  perf-stat.ps.branch-instructions
     19233 ±  9%     -24.3%      14553 ± 11%  perf-stat.ps.context-switches
 5.363e+09 ±  6%     +18.5%  6.353e+09 ±  5%  perf-stat.ps.cpu-cycles
   3610993 ±  6%     +54.4%    5576813 ± 16%  perf-stat.ps.dTLB-load-misses
 5.016e+08 ±  6%     +61.7%  8.111e+08 ± 16%  perf-stat.ps.dTLB-loads
    636014 ±  5%     +51.6%     964160 ± 16%  perf-stat.ps.dTLB-store-misses
 4.077e+08 ±  4%     +50.5%  6.137e+08 ± 14%  perf-stat.ps.dTLB-stores
 2.035e+09 ±  6%     +59.4%  3.242e+09 ± 16%  perf-stat.ps.instructions
 1.307e+11 ±  6%     +57.3%  2.056e+11 ± 16%  perf-stat.total.instructions
     80.71 ±  3%     -10.1       70.64 ±  8%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     79.24 ±  3%      -9.9       69.32 ±  8%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     79.24 ±  3%      -9.9       69.32 ±  8%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     79.15 ±  3%      -9.9       69.25 ±  8%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     72.10 ±  3%      -8.0       64.12 ±  7%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     71.26 ±  3%      -7.9       63.38 ±  7%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      4.81 ± 16%      -4.8        0.00        perf-profile.calltrace.cycles-pp.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.81 ± 16%      -4.8        0.00        perf-profile.calltrace.cycles-pp.ksys_sync.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.81 ± 16%      -4.8        0.00        perf-profile.calltrace.cycles-pp.iterate_supers.ksys_sync.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.81 ± 16%      -4.8        0.00        perf-profile.calltrace.cycles-pp.f2fs_issue_checkpoint.iterate_supers.ksys_sync.__x64_sys_sync.do_syscall_64
      4.80 ± 15%      -4.8        0.00        perf-profile.calltrace.cycles-pp.f2fs_write_checkpoint.f2fs_issue_checkpoint.iterate_supers.ksys_sync.__x64_sys_sync
      4.79 ± 15%      -4.8        0.00        perf-profile.calltrace.cycles-pp.block_operations.f2fs_write_checkpoint.f2fs_issue_checkpoint.iterate_supers.ksys_sync
      3.79 ± 14%      -1.6        2.19 ± 34%  perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.f2fs_sync_dirty_inodes.block_operations.f2fs_write_checkpoint
      3.79 ± 14%      -1.6        2.19 ± 34%  perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range.f2fs_sync_dirty_inodes.block_operations
      2.46 ± 16%      -1.0        1.44 ± 34%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range.f2fs_sync_dirty_inodes
      1.24 ± 18%      -0.8        0.40 ±108%  perf-profile.calltrace.cycles-pp.blk_finish_plug.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range.f2fs_sync_dirty_inodes
      1.23 ± 18%      -0.8        0.39 ±109%  perf-profile.calltrace.cycles-pp.blk_mq_flush_plug_list.blk_flush_plug_list.blk_finish_plug.f2fs_write_data_pages.do_writepages
      1.23 ± 18%      -0.8        0.40 ±108%  perf-profile.calltrace.cycles-pp.blk_flush_plug_list.blk_finish_plug.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range
      1.22 ± 19%      -0.8        0.39 ±109%  perf-profile.calltrace.cycles-pp.blk_mq_sched_insert_requests.blk_mq_flush_plug_list.blk_flush_plug_list.blk_finish_plug.f2fs_write_data_pages
      1.46 ± 37%      -0.8        0.70 ± 48%  perf-profile.calltrace.cycles-pp.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      1.45 ± 37%      -0.7        0.70 ± 48%  perf-profile.calltrace.cycles-pp.common_interrupt.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      1.29 ± 39%      -0.7        0.60 ± 49%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.common_interrupt.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter
      1.28 ± 39%      -0.7        0.58 ± 49%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.common_interrupt.asm_common_interrupt.cpuidle_enter_state
      2.63 ± 11%      -0.6        2.00 ± 19%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.60 ± 48%      +0.5        1.09 ± 24%  perf-profile.calltrace.cycles-pp.f2fs_get_dnode_of_data.f2fs_get_read_data_page.f2fs_find_data_page.__f2fs_find_entry.f2fs_find_entry
      0.32 ±100%      +0.6        0.94 ± 24%  perf-profile.calltrace.cycles-pp.__get_node_page.f2fs_get_dnode_of_data.f2fs_get_read_data_page.f2fs_find_data_page.__f2fs_find_entry
      0.44 ± 74%      +0.7        1.10 ± 28%  perf-profile.calltrace.cycles-pp.__get_node_page.f2fs_get_dnode_of_data.f2fs_reserve_block.f2fs_get_new_data_page.f2fs_add_regular_entry
      0.87 ± 35%      +0.7        1.61 ± 27%  perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.do_linkat.__x64_sys_link.do_syscall_64
      0.00            +0.7        0.75 ± 24%  perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.f2fs_get_new_data_page.f2fs_add_regular_entry.f2fs_add_dentry
      0.09 ±223%      +0.8        0.84 ± 22%  perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.f2fs_get_new_data_page.f2fs_add_regular_entry.f2fs_add_dentry.f2fs_do_add_link
      0.91 ± 33%      +0.8        1.69 ± 27%  perf-profile.calltrace.cycles-pp.filename_lookup.do_linkat.__x64_sys_link.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +0.8        0.79 ± 27%  perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.09 ±223%      +0.8        0.90 ± 29%  perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
      0.10 ±223%      +0.8        0.93 ± 32%  perf-profile.calltrace.cycles-pp.__lookup_hash.filename_create.do_linkat.__x64_sys_link.do_syscall_64
      0.46 ± 75%      +0.8        1.29 ± 27%  perf-profile.calltrace.cycles-pp.f2fs_get_dnode_of_data.f2fs_reserve_block.f2fs_get_new_data_page.f2fs_add_regular_entry.f2fs_add_dentry
      0.81 ± 19%      +0.9        1.73 ± 27%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      0.65 ± 53%      +0.9        1.58 ± 28%  perf-profile.calltrace.cycles-pp.f2fs_reserve_block.f2fs_get_new_data_page.f2fs_add_regular_entry.f2fs_add_dentry.f2fs_do_add_link
      0.33 ±100%      +0.9        1.27 ± 30%  perf-profile.calltrace.cycles-pp.f2fs_find_target_dentry.__f2fs_find_entry.f2fs_find_entry.f2fs_unlink.vfs_unlink
      0.18 ±141%      +0.9        1.12 ± 31%  perf-profile.calltrace.cycles-pp.filename_lookup.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.0        0.98 ± 24%  perf-profile.calltrace.cycles-pp.__do_sys_newlstat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.08 ± 20%      +1.0        2.07 ± 25%  perf-profile.calltrace.cycles-pp.f2fs_get_read_data_page.f2fs_find_data_page.__f2fs_find_entry.f2fs_find_entry.f2fs_unlink
      0.00            +1.0        0.99 ± 30%  perf-profile.calltrace.cycles-pp.path_lookupat.filename_lookup.user_statfs.__do_sys_statfs.do_syscall_64
      0.90 ± 18%      +1.0        1.89 ± 31%  perf-profile.calltrace.cycles-pp.filename_create.do_linkat.__x64_sys_link.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.40 ± 18%      +1.2        2.65 ± 26%  perf-profile.calltrace.cycles-pp.f2fs_find_data_page.__f2fs_find_entry.f2fs_find_entry.f2fs_unlink.vfs_unlink
      0.98 ± 54%      +1.5        2.52 ± 25%  perf-profile.calltrace.cycles-pp.f2fs_get_new_data_page.f2fs_add_regular_entry.f2fs_add_dentry.f2fs_do_add_link.f2fs_link
      1.05 ± 21%      +1.6        2.60 ± 29%  perf-profile.calltrace.cycles-pp.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.14 ± 21%      +1.7        2.83 ± 29%  perf-profile.calltrace.cycles-pp.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.01 ± 18%      +2.0        4.05 ± 27%  perf-profile.calltrace.cycles-pp.__f2fs_find_entry.f2fs_find_entry.f2fs_unlink.vfs_unlink.do_unlinkat
      2.53 ± 23%      +2.2        4.68 ± 23%  perf-profile.calltrace.cycles-pp.f2fs_link.vfs_link.do_linkat.__x64_sys_link.do_syscall_64
      2.13 ± 17%      +2.2        4.34 ± 28%  perf-profile.calltrace.cycles-pp.f2fs_find_entry.f2fs_unlink.vfs_unlink.do_unlinkat.do_syscall_64
      0.00            +2.2        2.21 ± 34%  perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.f2fs_sync_dirty_inodes.block_operations.f2fs_write_checkpoint.__write_checkpoint_sync
      1.67 ± 53%      +2.2        3.89 ± 23%  perf-profile.calltrace.cycles-pp.f2fs_add_regular_entry.f2fs_add_dentry.f2fs_do_add_link.f2fs_link.vfs_link
      1.68 ± 53%      +2.2        3.90 ± 23%  perf-profile.calltrace.cycles-pp.f2fs_add_dentry.f2fs_do_add_link.f2fs_link.vfs_link.do_linkat
      0.00            +2.3        2.27 ± 35%  perf-profile.calltrace.cycles-pp.f2fs_sync_dirty_inodes.block_operations.f2fs_write_checkpoint.__write_checkpoint_sync.__checkpoint_and_complete_reqs
      2.61 ± 23%      +2.3        4.93 ± 23%  perf-profile.calltrace.cycles-pp.vfs_link.do_linkat.__x64_sys_link.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.80 ± 52%      +2.4        4.21 ± 22%  perf-profile.calltrace.cycles-pp.f2fs_do_add_link.f2fs_link.vfs_link.do_linkat.__x64_sys_link
      2.85 ± 17%      +2.5        5.33 ± 28%  perf-profile.calltrace.cycles-pp.f2fs_unlink.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.00 ± 17%      +2.6        5.61 ± 28%  perf-profile.calltrace.cycles-pp.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +2.8        2.79 ± 34%  perf-profile.calltrace.cycles-pp.block_operations.f2fs_write_checkpoint.__write_checkpoint_sync.__checkpoint_and_complete_reqs.issue_checkpoint_thread
      0.00            +2.8        2.80 ± 34%  perf-profile.calltrace.cycles-pp.issue_checkpoint_thread.kthread.ret_from_fork
      0.00            +2.8        2.80 ± 34%  perf-profile.calltrace.cycles-pp.__checkpoint_and_complete_reqs.issue_checkpoint_thread.kthread.ret_from_fork
      0.00            +2.8        2.80 ± 34%  perf-profile.calltrace.cycles-pp.__write_checkpoint_sync.__checkpoint_and_complete_reqs.issue_checkpoint_thread.kthread.ret_from_fork
      0.00            +2.8        2.80 ± 34%  perf-profile.calltrace.cycles-pp.f2fs_write_checkpoint.__write_checkpoint_sync.__checkpoint_and_complete_reqs.issue_checkpoint_thread.kthread
      1.33 ± 21%      +2.8        4.16 ± 18%  perf-profile.calltrace.cycles-pp.ret_from_fork
      1.33 ± 21%      +2.8        4.16 ± 18%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      3.34 ± 16%      +3.0        6.31 ± 28%  perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.06 ± 20%      +4.8        9.82 ± 25%  perf-profile.calltrace.cycles-pp.do_linkat.__x64_sys_link.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.08 ± 20%      +4.8        9.86 ± 25%  perf-profile.calltrace.cycles-pp.__x64_sys_link.do_syscall_64.entry_SYSCALL_64_after_hwframe
     16.01 ± 15%      +6.4       22.40 ± 25%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     80.71 ±  3%     -10.1       70.64 ±  8%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     80.71 ±  3%     -10.1       70.64 ±  8%  perf-profile.children.cycles-pp.cpu_startup_entry
     80.70 ±  3%     -10.1       70.64 ±  8%  perf-profile.children.cycles-pp.do_idle
     79.24 ±  3%      -9.9       69.32 ±  8%  perf-profile.children.cycles-pp.start_secondary
     73.43 ±  3%      -8.1       65.35 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter
     73.33 ±  3%      -8.0       65.28 ±  8%  perf-profile.children.cycles-pp.cpuidle_enter_state
      4.81 ± 16%      -4.8        0.00        perf-profile.children.cycles-pp.__x64_sys_sync
      4.81 ± 16%      -4.8        0.00        perf-profile.children.cycles-pp.ksys_sync
      4.81 ± 16%      -4.8        0.00        perf-profile.children.cycles-pp.iterate_supers
      4.81 ± 16%      -4.8        0.00        perf-profile.children.cycles-pp.f2fs_issue_checkpoint
      4.79 ± 15%      -2.0        2.79 ± 34%  perf-profile.children.cycles-pp.block_operations
      4.80 ± 15%      -2.0        2.80 ± 34%  perf-profile.children.cycles-pp.f2fs_write_checkpoint
      3.89 ± 14%      -1.6        2.27 ± 35%  perf-profile.children.cycles-pp.f2fs_sync_dirty_inodes
      3.82 ± 14%      -1.6        2.21 ± 34%  perf-profile.children.cycles-pp.__filemap_fdatawrite_range
      3.80 ± 14%      -1.6        2.21 ± 34%  perf-profile.children.cycles-pp.f2fs_write_data_pages
      3.80 ± 14%      -1.6        2.22 ± 34%  perf-profile.children.cycles-pp.do_writepages
      4.29 ±  6%      -1.5        2.75 ± 19%  perf-profile.children.cycles-pp.__softirqentry_text_start
      4.20 ± 12%      -1.4        2.83 ± 18%  perf-profile.children.cycles-pp.irq_exit_rcu
      6.28 ± 11%      -1.1        5.23 ± 10%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      2.48 ± 16%      -1.0        1.46 ± 33%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
      1.50 ± 39%      -0.7        0.78 ± 30%  perf-profile.children.cycles-pp.asm_common_interrupt
      1.50 ± 40%      -0.7        0.78 ± 30%  perf-profile.children.cycles-pp.common_interrupt
      0.94 ± 22%      -0.7        0.26 ± 34%  perf-profile.children.cycles-pp.tasklet_action_common
      1.23 ± 18%      -0.6        0.61 ± 41%  perf-profile.children.cycles-pp.blk_mq_flush_plug_list
      1.22 ± 18%      -0.6        0.60 ± 42%  perf-profile.children.cycles-pp.blk_mq_sched_insert_requests
      1.24 ± 18%      -0.6        0.62 ± 41%  perf-profile.children.cycles-pp.blk_finish_plug
      1.23 ± 18%      -0.6        0.62 ± 41%  perf-profile.children.cycles-pp.blk_flush_plug_list
      1.13 ± 19%      -0.6        0.56 ± 42%  perf-profile.children.cycles-pp.__blk_mq_run_hw_queue
      1.13 ± 19%      -0.6        0.56 ± 43%  perf-profile.children.cycles-pp.__blk_mq_delay_run_hw_queue
      1.13 ± 19%      -0.6        0.56 ± 42%  perf-profile.children.cycles-pp.blk_mq_sched_dispatch_requests
      1.13 ± 19%      -0.6        0.55 ± 42%  perf-profile.children.cycles-pp.__blk_mq_sched_dispatch_requests
      1.12 ± 19%      -0.6        0.55 ± 42%  perf-profile.children.cycles-pp.__blk_mq_do_dispatch_sched
      0.96 ± 23%      -0.5        0.42 ± 45%  perf-profile.children.cycles-pp.blk_complete_reqs
      1.11 ± 26%      -0.5        0.58 ± 14%  perf-profile.children.cycles-pp.__schedule
      1.01 ± 20%      -0.5        0.49 ± 45%  perf-profile.children.cycles-pp.blk_mq_dispatch_rq_list
      0.97 ± 21%      -0.5        0.46 ± 47%  perf-profile.children.cycles-pp.scsi_queue_rq
      0.63 ± 26%      -0.5        0.16 ± 34%  perf-profile.children.cycles-pp.sci_controller_process_completions
      0.63 ± 32%      -0.5        0.17 ± 34%  perf-profile.children.cycles-pp.isci_host_completion_routine
      0.81 ± 25%      -0.4        0.38 ± 41%  perf-profile.children.cycles-pp.scsi_end_request
      0.81 ± 25%      -0.4        0.38 ± 41%  perf-profile.children.cycles-pp.scsi_io_completion
      0.58 ± 27%      -0.4        0.15 ± 35%  perf-profile.children.cycles-pp.sci_io_request_tc_completion
      0.56 ± 27%      -0.3        0.26 ± 20%  perf-profile.children.cycles-pp.schedule_idle
      0.55 ± 31%      -0.3        0.26 ± 40%  perf-profile.children.cycles-pp.blk_update_request
      0.57 ± 11%      -0.3        0.31 ± 39%  perf-profile.children.cycles-pp.__submit_merged_write_cond
      0.56 ± 21%      -0.3        0.30 ± 28%  perf-profile.children.cycles-pp.try_to_wake_up
      0.58 ± 23%      -0.2        0.33 ± 14%  perf-profile.children.cycles-pp.schedule
      1.72 ±  8%      -0.2        1.48 ± 11%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.43 ± 12%      -0.2        0.22 ± 39%  perf-profile.children.cycles-pp.__submit_merged_bio
      0.42 ± 11%      -0.2        0.21 ± 40%  perf-profile.children.cycles-pp.submit_bio
      0.40 ±  9%      -0.2        0.20 ± 39%  perf-profile.children.cycles-pp.submit_bio_noacct
      0.24 ± 38%      -0.2        0.05 ±130%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.54 ±  9%      -0.2        0.36 ± 14%  perf-profile.children.cycles-pp.cpuidle_governor_latency_req
      0.73 ± 10%      -0.2        0.56 ± 12%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.33 ± 25%      -0.2        0.17 ± 24%  perf-profile.children.cycles-pp.io_schedule
      0.63 ± 11%      -0.2        0.48 ± 14%  perf-profile.children.cycles-pp.sched_clock
      0.38 ± 21%      -0.2        0.22 ± 33%  perf-profile.children.cycles-pp.wake_up_page_bit
      0.28 ± 27%      -0.2        0.13 ± 16%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.27 ± 39%      -0.1        0.12 ± 23%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      0.25 ± 27%      -0.1        0.11 ± 18%  perf-profile.children.cycles-pp.dequeue_entity
      0.60 ± 12%      -0.1        0.46 ± 12%  perf-profile.children.cycles-pp.native_sched_clock
      0.26 ± 29%      -0.1        0.14 ± 20%  perf-profile.children.cycles-pp.__lock_page
      0.27 ± 21%      -0.1        0.15 ± 31%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.39 ±  9%      -0.1        0.28 ± 17%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.23 ± 17%      -0.1        0.12 ± 17%  perf-profile.children.cycles-pp.update_load_avg
      0.22 ± 27%      -0.1        0.12 ± 26%  perf-profile.children.cycles-pp.rwsem_wake
      0.19 ± 33%      -0.1        0.09 ± 32%  perf-profile.children.cycles-pp.isci_request_execute
      0.23 ± 17%      -0.1        0.13 ± 25%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.19 ± 23%      -0.1        0.10 ± 19%  perf-profile.children.cycles-pp.wake_up_q
      0.22 ± 23%      -0.1        0.14 ± 17%  perf-profile.children.cycles-pp.menu_reflect
      0.19 ± 15%      -0.1        0.11 ± 32%  perf-profile.children.cycles-pp.enqueue_entity
      0.18 ± 15%      -0.1        0.10 ± 11%  perf-profile.children.cycles-pp.pm_qos_read_value
      0.13 ± 22%      -0.1        0.06 ± 60%  perf-profile.children.cycles-pp.__bio_alloc
      0.13 ± 44%      -0.1        0.06 ± 48%  perf-profile.children.cycles-pp.finish_task_switch
      0.13 ± 17%      -0.1        0.07 ± 55%  perf-profile.children.cycles-pp.wait_on_page_bit
      0.14 ± 19%      -0.1        0.08 ± 31%  perf-profile.children.cycles-pp.wait_on_page_writeback
      0.15 ± 18%      -0.1        0.09 ± 12%  perf-profile.children.cycles-pp.call_cpuidle
      0.14 ± 18%      -0.0        0.10 ± 22%  perf-profile.children.cycles-pp.cpuidle_not_available
      0.06 ± 49%      +0.1        0.12 ± 20%  perf-profile.children.cycles-pp.mutex_lock
      0.01 ±223%      +0.1        0.07 ± 28%  perf-profile.children.cycles-pp.PageHuge
      0.02 ±144%      +0.1        0.09 ± 34%  perf-profile.children.cycles-pp.security_inode_getattr
      0.02 ±143%      +0.1        0.10 ± 38%  perf-profile.children.cycles-pp.vfs_getattr
      0.01 ±223%      +0.1        0.09 ± 32%  perf-profile.children.cycles-pp.lockref_get
      0.07 ± 17%      +0.1        0.15 ± 30%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.07 ± 55%      +0.1        0.14 ± 43%  perf-profile.children.cycles-pp.f2fs_balance_fs
      0.00            +0.1        0.08 ± 37%  perf-profile.children.cycles-pp.f2fs_getattr
      0.07 ± 56%      +0.1        0.17 ± 21%  perf-profile.children.cycles-pp.__dentry_kill
      0.08 ± 37%      +0.1        0.18 ± 35%  perf-profile.children.cycles-pp.__kmalloc
      0.07 ± 23%      +0.1        0.17 ± 38%  perf-profile.children.cycles-pp.__x64_sys_unlink
      0.12 ± 30%      +0.1        0.22 ± 22%  perf-profile.children.cycles-pp.__d_lookup_rcu
      0.07 ± 22%      +0.1        0.18 ± 36%  perf-profile.children.cycles-pp.path_put
      0.05 ± 74%      +0.1        0.15 ± 29%  perf-profile.children.cycles-pp.__d_free_external
      0.11 ± 34%      +0.1        0.22 ± 41%  perf-profile.children.cycles-pp.__virt_addr_valid
      0.11 ± 29%      +0.1        0.23 ± 33%  perf-profile.children.cycles-pp.__legitimize_mnt
      0.10 ± 12%      +0.1        0.22 ± 30%  perf-profile.children.cycles-pp._copy_to_user
      0.20 ± 16%      +0.1        0.32 ± 25%  perf-profile.children.cycles-pp._find_next_bit
      0.08 ± 53%      +0.1        0.20 ± 29%  perf-profile.children.cycles-pp.do_statfs_native
      0.06 ± 78%      +0.1        0.18 ± 29%  perf-profile.children.cycles-pp.__traverse_mounts
      0.06 ± 75%      +0.1        0.18 ± 39%  perf-profile.children.cycles-pp.smpboot_thread_fn
      0.21 ± 13%      +0.1        0.35 ± 33%  perf-profile.children.cycles-pp.d_lookup
      0.15 ± 11%      +0.1        0.29 ± 25%  perf-profile.children.cycles-pp.make_kuid
      0.11 ± 25%      +0.1        0.24 ± 28%  perf-profile.children.cycles-pp.mark_page_accessed
      0.15 ± 21%      +0.1        0.28 ± 28%  perf-profile.children.cycles-pp.map_id_range_down
      0.21 ± 13%      +0.1        0.35 ± 33%  perf-profile.children.cycles-pp.lookup_dcache
      0.14 ± 26%      +0.1        0.28 ± 23%  perf-profile.children.cycles-pp.rcu_do_batch
      0.02 ±142%      +0.1        0.16 ± 43%  perf-profile.children.cycles-pp.run_ksoftirqd
      0.14 ± 39%      +0.1        0.28 ± 28%  perf-profile.children.cycles-pp.xas_start
      0.15 ± 14%      +0.1        0.29 ± 37%  perf-profile.children.cycles-pp.down_write
      0.10 ± 18%      +0.2        0.25 ± 42%  perf-profile.children.cycles-pp.lockref_put_return
      0.16 ± 12%      +0.2        0.32 ± 34%  perf-profile.children.cycles-pp.generic_permission
      0.14 ± 23%      +0.2        0.30 ± 32%  perf-profile.children.cycles-pp.f2fs_init_inode_metadata
      0.17 ± 19%      +0.2        0.33 ± 29%  perf-profile.children.cycles-pp.__might_sleep
      0.10 ± 65%      +0.2        0.27 ± 44%  perf-profile.children.cycles-pp.f2fs_inode_dirtied
      0.14 ± 21%      +0.2        0.32 ± 28%  perf-profile.children.cycles-pp.f2fs_room_for_filename
      0.13 ± 25%      +0.2        0.32 ± 24%  perf-profile.children.cycles-pp.path_init
      0.10 ± 65%      +0.2        0.29 ± 42%  perf-profile.children.cycles-pp.f2fs_mark_inode_dirty_sync
      0.22 ± 26%      +0.2        0.41 ± 19%  perf-profile.children.cycles-pp.done_path_create
      0.29 ± 18%      +0.2        0.50 ± 33%  perf-profile.children.cycles-pp.__d_lookup
      0.19 ± 27%      +0.2        0.41 ± 29%  perf-profile.children.cycles-pp.f2fs_hash_filename
      0.23 ±  6%      +0.2        0.46 ± 42%  perf-profile.children.cycles-pp.unlock_page
      0.26 ± 26%      +0.2        0.50 ± 28%  perf-profile.children.cycles-pp.read_node_page
      0.26 ± 22%      +0.2        0.50 ± 31%  perf-profile.children.cycles-pp.___might_sleep
      0.36 ± 17%      +0.2        0.60 ± 31%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.19 ± 17%      +0.2        0.43 ± 35%  perf-profile.children.cycles-pp.__d_alloc
      0.24 ± 26%      +0.3        0.54 ± 26%  perf-profile.children.cycles-pp.f2fs_setup_filename
      0.18 ± 21%      +0.3        0.50 ± 34%  perf-profile.children.cycles-pp.f2fs_statfs
      0.17 ± 55%      +0.3        0.49 ± 27%  perf-profile.children.cycles-pp.__f2fs_setup_filename
      0.35 ± 30%      +0.3        0.69 ± 25%  perf-profile.children.cycles-pp.xas_load
      0.25 ± 20%      +0.3        0.59 ± 31%  perf-profile.children.cycles-pp.d_alloc
      0.24 ± 17%      +0.4        0.61 ± 30%  perf-profile.children.cycles-pp.statfs_by_dentry
      0.36 ± 19%      +0.4        0.74 ± 30%  perf-profile.children.cycles-pp.inode_permission
      0.36 ± 23%      +0.4        0.74 ± 25%  perf-profile.children.cycles-pp.dput
      0.19 ± 38%      +0.4        0.58 ± 34%  perf-profile.children.cycles-pp.lockref_get_not_dead
      0.25 ± 22%      +0.4        0.64 ± 31%  perf-profile.children.cycles-pp.vfs_statfs
      0.39 ± 24%      +0.4        0.81 ± 26%  perf-profile.children.cycles-pp.path_parentat
      0.86 ± 11%      +0.4        1.29 ± 17%  perf-profile.children.cycles-pp._raw_spin_lock
      0.29 ± 29%      +0.4        0.72 ± 34%  perf-profile.children.cycles-pp.__check_object_size
      0.42 ± 21%      +0.5        0.89 ± 26%  perf-profile.children.cycles-pp.filename_parentat
      0.35 ± 15%      +0.5        0.83 ± 27%  perf-profile.children.cycles-pp.__entry_text_start
      0.36 ± 31%      +0.5        0.84 ± 22%  perf-profile.children.cycles-pp.grab_cache_page_write_begin
      0.32 ± 21%      +0.5        0.81 ± 27%  perf-profile.children.cycles-pp.vfs_statx
      0.32 ± 28%      +0.5        0.83 ± 32%  perf-profile.children.cycles-pp.__legitimize_path
      0.52 ± 17%      +0.6        1.07 ± 31%  perf-profile.children.cycles-pp.__lookup_hash
      0.32 ± 34%      +0.6        0.87 ± 34%  perf-profile.children.cycles-pp.complete_walk
      0.44 ± 25%      +0.6        1.03 ± 30%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.39 ± 18%      +0.6        0.98 ± 24%  perf-profile.children.cycles-pp.__do_sys_newlstat
      0.35 ± 29%      +0.6        0.95 ± 32%  perf-profile.children.cycles-pp.try_to_unlazy
      0.47 ± 28%      +0.7        1.12 ± 32%  perf-profile.children.cycles-pp.strncpy_from_user
      0.52 ± 24%      +0.7        1.21 ± 31%  perf-profile.children.cycles-pp.user_path_at_empty
      0.54 ± 25%      +0.7        1.27 ± 30%  perf-profile.children.cycles-pp.f2fs_find_target_dentry
      0.80 ± 25%      +0.8        1.59 ± 28%  perf-profile.children.cycles-pp.f2fs_reserve_block
      0.69 ± 22%      +0.9        1.55 ± 32%  perf-profile.children.cycles-pp.getname_flags
      0.84 ± 20%      +0.9        1.76 ± 28%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      1.31 ± 22%      +0.9        2.24 ± 25%  perf-profile.children.cycles-pp.__get_node_page
      1.57 ± 19%      +0.9        2.51 ± 24%  perf-profile.children.cycles-pp.f2fs_get_dnode_of_data
      1.09 ± 19%      +1.0        2.07 ± 25%  perf-profile.children.cycles-pp.f2fs_get_read_data_page
      0.90 ± 18%      +1.0        1.90 ± 31%  perf-profile.children.cycles-pp.filename_create
      1.00 ± 27%      +1.0        2.04 ± 26%  perf-profile.children.cycles-pp.link_path_walk
      1.40 ± 19%      +1.3        2.66 ± 26%  perf-profile.children.cycles-pp.f2fs_find_data_page
      1.22 ± 26%      +1.3        2.53 ± 25%  perf-profile.children.cycles-pp.f2fs_get_new_data_page
      1.72 ± 22%      +1.4        3.10 ± 25%  perf-profile.children.cycles-pp.pagecache_get_page
      1.05 ± 21%      +1.6        2.60 ± 29%  perf-profile.children.cycles-pp.user_statfs
      1.38 ± 25%      +1.6        2.96 ± 26%  perf-profile.children.cycles-pp.path_lookupat
      1.50 ± 24%      +1.7        3.19 ± 27%  perf-profile.children.cycles-pp.filename_lookup
      1.15 ± 22%      +1.7        2.84 ± 28%  perf-profile.children.cycles-pp.__do_sys_statfs
      2.06 ± 24%      +1.8        3.90 ± 23%  perf-profile.children.cycles-pp.f2fs_add_regular_entry
      2.20 ± 23%      +2.0        4.21 ± 22%  perf-profile.children.cycles-pp.f2fs_do_add_link
      2.01 ± 18%      +2.1        4.06 ± 27%  perf-profile.children.cycles-pp.__f2fs_find_entry
      2.53 ± 23%      +2.2        4.68 ± 23%  perf-profile.children.cycles-pp.f2fs_link
      2.14 ± 17%      +2.2        4.34 ± 28%  perf-profile.children.cycles-pp.f2fs_find_entry
      1.68 ± 53%      +2.2        3.90 ± 23%  perf-profile.children.cycles-pp.f2fs_add_dentry
      2.61 ± 23%      +2.3        4.94 ± 23%  perf-profile.children.cycles-pp.vfs_link
      2.85 ± 17%      +2.5        5.33 ± 28%  perf-profile.children.cycles-pp.f2fs_unlink
      3.01 ± 17%      +2.6        5.61 ± 28%  perf-profile.children.cycles-pp.vfs_unlink
      0.00            +2.8        2.80 ± 34%  perf-profile.children.cycles-pp.issue_checkpoint_thread
      0.00            +2.8        2.80 ± 34%  perf-profile.children.cycles-pp.__checkpoint_and_complete_reqs
      0.00            +2.8        2.80 ± 34%  perf-profile.children.cycles-pp.__write_checkpoint_sync
      1.33 ± 21%      +2.8        4.16 ± 18%  perf-profile.children.cycles-pp.kthread
      1.33 ± 21%      +2.8        4.17 ± 17%  perf-profile.children.cycles-pp.ret_from_fork
      3.35 ± 16%      +3.0        6.32 ± 28%  perf-profile.children.cycles-pp.do_unlinkat
      5.06 ± 20%      +4.8        9.83 ± 25%  perf-profile.children.cycles-pp.do_linkat
      5.08 ± 20%      +4.8        9.87 ± 25%  perf-profile.children.cycles-pp.__x64_sys_link
     16.55 ± 14%      +6.3       22.81 ± 25%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.25 ± 27%      -0.2        0.09 ± 41%  perf-profile.self.cycles-pp.tasklet_action_common
      0.57 ± 11%      -0.1        0.43 ± 12%  perf-profile.self.cycles-pp.native_sched_clock
      0.39 ±  9%      -0.1        0.28 ± 17%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.17 ± 20%      -0.1        0.08 ± 24%  perf-profile.self.cycles-pp.__schedule
      0.38 ±  8%      -0.1        0.31 ± 16%  perf-profile.self.cycles-pp.__hrtimer_run_queues
      0.17 ± 20%      -0.1        0.10 ± 15%  perf-profile.self.cycles-pp.pm_qos_read_value
      0.09 ± 27%      -0.1        0.03 ±102%  perf-profile.self.cycles-pp.update_load_avg
      0.15 ± 20%      -0.1        0.09 ±  8%  perf-profile.self.cycles-pp.call_cpuidle
      0.12 ± 25%      -0.0        0.07 ± 14%  perf-profile.self.cycles-pp.menu_reflect
      0.07 ± 14%      +0.1        0.12 ± 31%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.04 ± 72%      +0.1        0.10 ± 26%  perf-profile.self.cycles-pp.statfs_by_dentry
      0.01 ±223%      +0.1        0.08 ± 31%  perf-profile.self.cycles-pp.__kmalloc
      0.02 ±141%      +0.1        0.09 ± 35%  perf-profile.self.cycles-pp.do_syscall_64
      0.02 ±141%      +0.1        0.08 ± 20%  perf-profile.self.cycles-pp.mutex_lock
      0.04 ±107%      +0.1        0.10 ± 32%  perf-profile.self.cycles-pp.walk_component
      0.06 ± 13%      +0.1        0.13 ± 29%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.07 ± 55%      +0.1        0.14 ± 43%  perf-profile.self.cycles-pp.f2fs_balance_fs
      0.01 ±223%      +0.1        0.09 ± 32%  perf-profile.self.cycles-pp.lockref_get
      0.05 ± 74%      +0.1        0.12 ± 19%  perf-profile.self.cycles-pp.getname_flags
      0.08 ± 37%      +0.1        0.17 ± 36%  perf-profile.self.cycles-pp.f2fs_reserve_block
      0.09 ± 14%      +0.1        0.18 ± 26%  perf-profile.self.cycles-pp.down_write
      0.07 ± 22%      +0.1        0.17 ± 51%  perf-profile.self.cycles-pp.generic_permission
      0.03 ±103%      +0.1        0.14 ± 31%  perf-profile.self.cycles-pp.f2fs_find_data_page
      0.11 ± 34%      +0.1        0.21 ± 38%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.20 ± 15%      +0.1        0.31 ± 27%  perf-profile.self.cycles-pp._find_next_bit
      0.11 ± 30%      +0.1        0.22 ± 34%  perf-profile.self.cycles-pp.__legitimize_mnt
      0.08 ± 19%      +0.1        0.21 ± 37%  perf-profile.self.cycles-pp.inode_permission
      0.13 ± 35%      +0.1        0.25 ± 30%  perf-profile.self.cycles-pp.xas_start
      0.18 ± 25%      +0.1        0.31 ± 29%  perf-profile.self.cycles-pp.f2fs_get_dnode_of_data
      0.11 ± 39%      +0.1        0.24 ± 32%  perf-profile.self.cycles-pp.f2fs_add_regular_entry
      0.14 ± 20%      +0.1        0.27 ± 26%  perf-profile.self.cycles-pp.map_id_range_down
      0.10 ± 27%      +0.1        0.23 ± 28%  perf-profile.self.cycles-pp.mark_page_accessed
      0.10 ± 18%      +0.1        0.24 ± 44%  perf-profile.self.cycles-pp.lockref_put_return
      0.09 ± 31%      +0.1        0.24 ± 22%  perf-profile.self.cycles-pp.path_init
      0.12 ± 18%      +0.2        0.27 ± 28%  perf-profile.self.cycles-pp.f2fs_get_read_data_page
      0.23 ± 12%      +0.2        0.38 ± 37%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.14 ± 26%      +0.2        0.29 ± 28%  perf-profile.self.cycles-pp.__might_sleep
      0.14 ± 29%      +0.2        0.30 ± 25%  perf-profile.self.cycles-pp.strncpy_from_user
      0.09 ± 25%      +0.2        0.26 ± 34%  perf-profile.self.cycles-pp.__check_object_size
      0.14 ± 18%      +0.2        0.31 ± 36%  perf-profile.self.cycles-pp.f2fs_statfs
      0.17 ± 30%      +0.2        0.34 ± 25%  perf-profile.self.cycles-pp.read_node_page
      0.21 ±  8%      +0.2        0.40 ± 21%  perf-profile.self.cycles-pp.unlock_page
      0.16 ± 25%      +0.2        0.35 ± 34%  perf-profile.self.cycles-pp.__get_node_page
      0.20 ± 31%      +0.2        0.42 ± 24%  perf-profile.self.cycles-pp.xas_load
      0.19 ± 28%      +0.2        0.41 ± 30%  perf-profile.self.cycles-pp.f2fs_hash_filename
      0.26 ± 21%      +0.2        0.50 ± 31%  perf-profile.self.cycles-pp.___might_sleep
      0.24 ± 26%      +0.3        0.52 ± 27%  perf-profile.self.cycles-pp.link_path_walk
      0.19 ± 40%      +0.4        0.56 ± 34%  perf-profile.self.cycles-pp.lockref_get_not_dead
      0.81 ± 11%      +0.4        1.22 ± 17%  perf-profile.self.cycles-pp._raw_spin_lock
      0.35 ± 15%      +0.5        0.83 ± 27%  perf-profile.self.cycles-pp.__entry_text_start
      0.44 ± 25%      +0.6        1.02 ± 30%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.52 ± 24%      +0.7        1.22 ± 30%  perf-profile.self.cycles-pp.f2fs_find_target_dentry
      0.83 ± 22%      +0.8        1.60 ± 26%  perf-profile.self.cycles-pp.pagecache_get_page
      0.76 ± 20%      +0.9        1.67 ± 28%  perf-profile.self.cycles-pp.syscall_exit_to_user_mode


                                                                                
                            stress-ng.link.ops_per_sec                          
                                                                                
    6 +---------------------------------------------------------------------+   
  5.5 |-+                O                         O     O        O         |   
      |                                                                     |   
    5 |-+                                      O     O                      |   
  4.5 |-+                                                                   |   
      |     O                                    O     O            O       |   
    4 |-+     O       O      O           O                      O     O     |   
  3.5 |-+       O              O           O                                |   
    3 |-+                                                                   |   
      |   O       O        O     O   O O                    O               |   
  2.5 |-+                                    O                O             |   
    2 |-+           O              O                                        |   
      |.+.     .+.+.        .+.   .+.               .+.                    .|   
  1.5 |-+ +.+.+     +.+..+.+   +.+   +.+.+.+. .+.+.+   +.+..+.+. .+. .+.+.+ |   
    1 +---------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.12.0-rc2-00431-gb5d15199a26f" of type "text/plain" (172853 bytes)

View attachment "job-script" of type "text/plain" (8197 bytes)

View attachment "job.yaml" of type "text/plain" (5794 bytes)

View attachment "reproduce" of type "text/plain" (526 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ