lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20161129175052.GB12371@yexl-desktop>
Date:   Wed, 30 Nov 2016 01:50:52 +0800
From:   kernel test robot <xiaolong.ye@...el.com>
To:     Jeff Layton <jlayton@...hat.com>
Cc:     LKML <linux-kernel@...r.kernel.org>,
        Jeff Layton <jeff.layton@...marydata.com>, lkp@...org
Subject: [lkp] [fs]  27a23abdf6:  vm-scalability.throughput 44.7% improvement


Greeting,

FYI, we noticed a 44.7% improvement of vm-scalability.throughput due to commit:


commit 27a23abdf63184c5853c6e5004cf584b880d26fb ("fs: only set S_VERSION when updating times if it has been queried")
git://git.samba.org/jlayton/linux iversion

in testcase: vm-scalability
on test machine: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory
with following parameters:

	runtime: 300s
	size: 1T
	test: msync-mt
	cpufreq_governor: performance

test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/



Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/size/tbox_group/test/testcase:
  gcc-6/performance/x86_64-rhel-7.2/debian-x86_64-2016-08-31.cgz/300s/1T/lkp-ivb-d02/msync-mt/vm-scalability

commit: 
  5846f3b347 ("fs: ensure we set the INODE_I_VERSION_QUERIED flag when loading from disk")
  27a23abdf6 ("fs: only set S_VERSION when updating times if it has been queried")

5846f3b347857111 27a23abdf63184c5853c6e5004 
---------------- -------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
         %stddev     %change         %stddev
             \          |                \  
   1875009 ±  0%     +44.7%    2713468 ±  0%  vm-scalability.throughput
 7.198e+08 ±  0%     +42.4%  1.025e+09 ±  0%  vm-scalability.time.file_system_outputs
   1995780 ±  5%     +11.1%    2217616 ±  3%  vm-scalability.time.involuntary_context_switches
 2.354e+08 ±  0%     +12.3%  2.643e+08 ±  0%  vm-scalability.time.minor_page_faults
    253.75 ±  0%      -6.7%     236.67 ±  0%  vm-scalability.time.percent_of_cpu_this_job_got
      1634 ±  0%     -26.4%       1202 ±  0%  vm-scalability.time.system_time
    627.39 ±  0%     +43.6%     900.65 ±  0%  vm-scalability.time.user_time
 1.337e+08 ±  1%     -23.2%  1.027e+08 ±  0%  vm-scalability.time.voluntary_context_switches
 1.432e+08 ±  0%     +63.4%  2.341e+08 ±  0%  interrupts.CAL:Function_call_interrupts
    930176 ±  0%     -10.4%     833574 ±  0%  softirqs.SCHED
      1130 ±  8%     +14.8%       1297 ±  6%  slabinfo.cred_jar.num_objs
      5232 ±  7%     +26.1%       6598 ±  3%  slabinfo.kmalloc-64.active_objs
      5232 ±  7%     +27.9%       6693 ±  5%  slabinfo.kmalloc-64.num_objs
    403566 ±  0%     +42.7%     576015 ±  0%  vmstat.io.bo
    302951 ±  1%     -23.0%     233307 ±  0%  vmstat.system.cs
    172265 ±  0%     +59.8%     275353 ±  0%  vmstat.system.in
     80.29 ±  0%      +1.3%      81.31 ±  0%  turbostat.%Busy
      2643 ±  0%      +1.3%       2677 ±  0%  turbostat.Avg_MHz
     16.17 ±  1%     -16.2%      13.55 ±  1%  turbostat.CPU%c1
      0.04 ± 22%    +157.8%       0.10 ± 39%  turbostat.CPU%c3
      3.50 ±  5%     +43.9%       5.04 ±  5%  turbostat.CPU%c6
  3.58e+08 ±  1%     -51.4%  1.739e+08 ±  1%  cpuidle.C1-IVB.time
 1.092e+08 ±  1%     -39.0%   66666567 ±  1%  cpuidle.C1-IVB.usage
 3.014e+08 ±  2%     +47.7%  4.452e+08 ±  1%  cpuidle.C6-IVB.time
    390381 ±  1%     +39.5%     544769 ±  0%  cpuidle.C6-IVB.usage
  12016507 ± 11%     -29.8%    8437750 ± 15%  cpuidle.POLL.time
   2631079 ±  4%     -21.5%    2065701 ±  8%  cpuidle.POLL.usage
 1.932e+12 ±  0%     +19.9%  2.317e+12 ±  0%  perf-stat.branch-instructions
      0.37 ±  0%     -35.1%       0.24 ±  0%  perf-stat.branch-miss-rate%
 7.219e+09 ±  0%     -22.2%  5.618e+09 ±  1%  perf-stat.branch-misses
     26.99 ±  0%     +44.7%      39.05 ±  0%  perf-stat.cache-miss-rate%
 1.937e+10 ±  1%     +43.0%  2.771e+10 ±  0%  perf-stat.cache-misses
 2.701e+08 ±  1%     -23.2%  2.076e+08 ±  0%  perf-stat.context-switches
   2275837 ±  3%      -6.0%    2138633 ±  4%  perf-stat.cpu-migrations
      0.42 ± 22%     -22.4%       0.32 ±  8%  perf-stat.dTLB-load-miss-rate%
 1.974e+12 ±  0%     +10.9%  2.189e+12 ±  0%  perf-stat.dTLB-loads
 1.125e+12 ±  0%      +7.6%   1.21e+12 ±  0%  perf-stat.dTLB-stores
     41.66 ±  1%     +18.9%      49.53 ±  0%  perf-stat.iTLB-load-miss-rate%
 1.246e+09 ±  1%      -6.6%  1.164e+09 ±  0%  perf-stat.iTLB-load-misses
 1.744e+09 ±  1%     -32.0%  1.186e+09 ±  0%  perf-stat.iTLB-loads
 8.184e+12 ±  0%     +15.8%  9.477e+12 ±  0%  perf-stat.instructions
      6570 ±  1%     +24.0%       8144 ±  0%  perf-stat.instructions-per-iTLB-miss
      0.85 ±  0%     +15.3%       0.98 ±  0%  perf-stat.ipc
 2.291e+08 ±  0%     +11.4%  2.552e+08 ±  0%  perf-stat.minor-faults
 2.291e+08 ±  0%     +11.4%  2.552e+08 ±  0%  perf-stat.page-faults
     18612 ±173%     -29.0%      13211 ± 70%  latency_stats.avg.balance_dirty_pages.balance_dirty_pages_ratelimited.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      3448 ±173%   +3084.5%     109808 ±126%  latency_stats.avg.call_rwsem_down_write_failed.path_openat.do_filp_open.do_sys_open.SyS_open.entry_SYSCALL_64_fastpath
    164779 ± 45%    +937.8%    1710049 ±132%  latency_stats.avg.max
   9316788 ±  2%     -74.2%    2401982 ±  1%  latency_stats.hits.call_rwsem_down_write_failed.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
     60275 ± 11%     -98.8%     723.67 ± 15%  latency_stats.hits.call_rwsem_down_write_failed.xfs_ilock.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
  10460952 ±  2%     -99.5%      54387 ±  1%  latency_stats.hits.call_rwsem_down_write_failed.xfs_ilock.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      6644 ±102%   +1139.5%      82360 ± 83%  latency_stats.max.balance_dirty_pages.balance_dirty_pages_ratelimited.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
     50765 ±173%     -73.2%      13583 ± 70%  latency_stats.max.balance_dirty_pages.balance_dirty_pages_ratelimited.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      3448 ±173%   +3084.5%     109808 ±126%  latency_stats.max.call_rwsem_down_write_failed.path_openat.do_filp_open.do_sys_open.SyS_open.entry_SYSCALL_64_fastpath
     21289 ± 32%     -60.8%       8345 ± 21%  latency_stats.max.call_rwsem_down_write_failed.xfs_ilock.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
    188896 ± 35%    +920.0%    1926824 ±109%  latency_stats.max.max
      1584 ± 83%   +2121.8%      35210 ±124%  latency_stats.max.pipe_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
     38120 ±  9%    +699.6%     304826 ± 87%  latency_stats.max.wait_on_page_bit_killable.__lock_page_or_retry.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
    245991 ±101%   +2594.7%    6628814 ± 50%  latency_stats.sum.balance_dirty_pages.balance_dirty_pages_ratelimited.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
   2959446 ±173%     -70.2%     881433 ±100%  latency_stats.sum.balance_dirty_pages.balance_dirty_pages_ratelimited.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
 1.106e+08 ±  2%     -84.2%   17511262 ±  2%  latency_stats.sum.call_rwsem_down_read_failed.xfs_ilock.xfs_ilock_data_map_shared.__xfs_get_blocks.xfs_get_blocks.do_mpage_readpage.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead.filemap_fault
      3448 ±173%   +3084.5%     109808 ±126%  latency_stats.sum.call_rwsem_down_write_failed.path_openat.do_filp_open.do_sys_open.SyS_open.entry_SYSCALL_64_fastpath
   1052706 ± 10%     -81.3%     196388 ± 10%  latency_stats.sum.call_rwsem_down_write_failed.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault
   1724048 ±  6%     -98.1%      33076 ± 18%  latency_stats.sum.call_rwsem_down_write_failed.xfs_ilock.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
  65197018 ±  2%     -97.9%    1361430 ±  7%  latency_stats.sum.call_rwsem_down_write_failed.xfs_ilock.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      4850 ± 74%    +718.5%      39697 ±104%  latency_stats.sum.pipe_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
      1910 ± 53%    +157.6%       4919 ± 48%  proc-vmstat.allocstall_movable
     12328 ± 84%     -84.8%       1868 ±141%  proc-vmstat.compact_isolated
      6519 ± 85%     -84.8%     988.00 ±141%  proc-vmstat.compact_migrate_scanned
      8597 ±  7%     +50.6%      12950 ±  8%  proc-vmstat.kswapd_high_wmark_hit_quickly
      8549 ±  5%     +53.8%      13146 ± 15%  proc-vmstat.kswapd_low_wmark_hit_quickly
  89960322 ±  0%     +42.4%  1.281e+08 ±  0%  proc-vmstat.nr_dirtied
    242.25 ± 43%    +262.6%     878.33 ± 71%  proc-vmstat.nr_pages_scanned
    781.75 ± 54%  +3.4e+06%   26492929 ± 83%  proc-vmstat.nr_vmscan_immediate_reclaim
    169.25 ±148%  +85080.3%     144167 ± 75%  proc-vmstat.nr_vmscan_write
  89934329 ±  0%     +42.5%  1.281e+08 ±  0%  proc-vmstat.nr_written
 1.529e+08 ±  0%     +41.3%   2.16e+08 ±  0%  proc-vmstat.numa_hit
 1.529e+08 ±  0%     +41.3%   2.16e+08 ±  0%  proc-vmstat.numa_local
     18374 ±  6%     +46.0%      26827 ± 10%  proc-vmstat.pageoutrun
  91616308 ±  0%     +42.2%  1.302e+08 ±  1%  proc-vmstat.pgactivate
 1.156e+08 ±  5%     +48.9%  1.721e+08 ±  9%  proc-vmstat.pgalloc_normal
  57204038 ±  2%     +44.4%   82585962 ±  1%  proc-vmstat.pgdeactivate
 2.805e+08 ±  0%     +17.0%  3.282e+08 ±  0%  proc-vmstat.pgfault
 1.518e+08 ±  1%     +42.1%  2.158e+08 ±  0%  proc-vmstat.pgfree
      6049 ± 85%     -85.7%     868.00 ±141%  proc-vmstat.pgmigrate_success
      3632 ±  3%     +15.7%       4201 ±  0%  proc-vmstat.pgpgin
 3.598e+08 ±  0%     +42.4%  5.125e+08 ±  0%  proc-vmstat.pgpgout
  57208615 ±  2%     +44.4%   82590561 ±  1%  proc-vmstat.pgrefill
   1342923 ± 31%    +119.4%    2945897 ±  8%  proc-vmstat.pgrotated
  39633539 ±  3%    +129.5%   90958270 ± 29%  proc-vmstat.pgscan_direct
 1.971e+08 ±  3%     +46.1%  2.881e+08 ±  3%  proc-vmstat.pgscan_kswapd
   1054030 ± 28%     +73.8%    1831908 ± 26%  proc-vmstat.pgsteal_direct
  96725698 ±  2%     +45.7%  1.409e+08 ±  3%  proc-vmstat.pgsteal_kswapd
  27324643 ±  2%     +44.2%   39400907 ±  1%  proc-vmstat.workingset_refault
     24191 ± 25%     -56.7%      10478 ± 49%  sched_debug.cfs_rq:/.min_vruntime.stddev
     36.57 ± 16%     +53.9%      56.29 ± 11%  sched_debug.cfs_rq:/.runnable_load_avg.min
    -11184 ±-71%     -89.4%      -1190 ±-188%  sched_debug.cfs_rq:/.spread0.avg
    -51996 ±-33%     -66.7%     -17324 ±-64%  sched_debug.cfs_rq:/.spread0.min
     24192 ± 25%     -56.7%      10479 ± 49%  sched_debug.cfs_rq:/.spread0.stddev
    106.12 ± 14%     +40.1%     148.72 ±  8%  sched_debug.cfs_rq:/.util_avg.stddev
    161360 ± 11%     +44.6%     233250 ± 16%  sched_debug.cpu.avg_idle.avg
    248824 ±  8%     +53.0%     380730 ± 18%  sched_debug.cpu.avg_idle.max
     61098 ±  8%     +61.4%      98618 ± 26%  sched_debug.cpu.avg_idle.stddev
     43.68 ± 12%     +96.6%      85.89 ± 35%  sched_debug.cpu.cpu_load[1].min
     46.10 ± 13%    +121.0%     101.87 ± 25%  sched_debug.cpu.cpu_load[2].min
     55.13 ± 13%    +105.7%     113.42 ± 16%  sched_debug.cpu.cpu_load[3].min
     60.32 ± 15%     +96.9%     118.78 ± 19%  sched_debug.cpu.cpu_load[4].min
      3868 ± 11%     +26.0%       4872 ± 12%  sched_debug.cpu.nr_load_updates.stddev
  32143238 ±  1%     -22.7%   24857641 ±  0%  sched_debug.cpu.nr_switches.avg
  34824253 ±  1%     -21.3%   27397413 ±  3%  sched_debug.cpu.nr_switches.max
  30678305 ±  1%     -24.8%   23081497 ±  0%  sched_debug.cpu.nr_switches.min
      1095 ± 17%     -32.0%     745.24 ±  3%  sched_debug.cpu.nr_uninterruptible.max
    824.46 ± 12%     -24.2%     624.90 ±  9%  sched_debug.cpu.nr_uninterruptible.stddev
  32194984 ±  1%     -22.6%   24920945 ±  0%  sched_debug.cpu.sched_count.avg
  34874301 ±  1%     -21.3%   27459859 ±  3%  sched_debug.cpu.sched_count.max
  30731176 ±  1%     -24.7%   23147150 ±  0%  sched_debug.cpu.sched_count.min
  15048852 ±  1%     -25.3%   11247844 ±  0%  sched_debug.cpu.sched_goidle.avg
  15511954 ±  0%     -24.1%   11770336 ±  0%  sched_debug.cpu.sched_goidle.max
  14785332 ±  1%     -26.4%   10883202 ±  0%  sched_debug.cpu.sched_goidle.min
  16733610 ±  1%     -21.8%   13092776 ±  0%  sched_debug.cpu.ttwu_count.avg
  18176852 ±  1%     -20.7%   14412533 ±  2%  sched_debug.cpu.ttwu_count.max
  15905821 ±  2%     -23.5%   12168901 ±  0%  sched_debug.cpu.ttwu_count.min
    518505 ±  5%     -11.2%     460302 ±  1%  sched_debug.cpu.ttwu_local.min
      0.99 ±  8%     -14.6%       0.85 ± 16%  sched_debug.rt_rq:/.rt_time.avg
      3.96 ±  8%     -14.7%       3.37 ± 16%  sched_debug.rt_rq:/.rt_time.max
      1.71 ±  8%     -14.8%       1.46 ± 16%  sched_debug.rt_rq:/.rt_time.stddev
      2.60 ±  6%     -37.4%       1.63 ±  6%  perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
      1.08 ± 21%     +61.1%       1.74 ± 16%  perf-profile.calltrace.cycles-pp.__blk_mq_complete_request.blk_mq_complete_request.loop_queue_work.kthread_worker_fn.kthread
      7.15 ±  3%     +22.1%       8.74 ±  9%  perf-profile.calltrace.cycles-pp.__do_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
     34.48 ± 25%     -71.4%       9.87 ± 71%  perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
      2.65 ± 21%     +57.3%       4.16 ± 16%  perf-profile.calltrace.cycles-pp.__generic_file_write_iter.generic_file_write_iter.vfs_iter_write.lo_write_bvec.loop_queue_work
      1.23 ± 14%     -47.5%       0.64 ±  9%  perf-profile.calltrace.cycles-pp.__lock_page.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page
      1.18 ± 18%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.__lock_page.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault
      1.65 ±  8%     +65.3%       2.73 ±  7%  perf-profile.calltrace.cycles-pp.__lock_page_or_retry.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault
      1.11 ± 27%     +63.8%       1.83 ±  6%  perf-profile.calltrace.cycles-pp.__sched_text_start.bit_wait_io.__wait_on_bit.wait_on_page_bit_killable.__lock_page_or_retry
      1.78 ± 14%     -79.4%       0.37 ± 71%  perf-profile.calltrace.cycles-pp.__sched_text_start.bit_wait_io.__wait_on_bit_lock.__lock_page.iomap_page_mkwrite
      1.71 ±  5%     -23.1%       1.31 ± 11%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_preempt_disabled.cpu_startup_entry.start_secondary
      2.07 ±  6%     -25.1%       1.55 ±  3%  perf-profile.calltrace.cycles-pp.__tick_nohz_idle_enter.tick_nohz_idle_enter.cpu_startup_entry.start_secondary
      1.52 ±  8%     +54.1%       2.35 ±  7%  perf-profile.calltrace.cycles-pp.__wait_on_bit.wait_on_page_bit_killable.__lock_page_or_retry.filemap_fault.xfs_filemap_fault
      2.22 ± 13%     -71.5%       0.63 ± 11%  perf-profile.calltrace.cycles-pp.__wait_on_bit_lock.__lock_page.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite
      2.38 ± 12%     -41.4%       1.39 ± 35%  perf-profile.calltrace.cycles-pp.__wake_up.__wake_up_bit.unlock_page.do_wp_page.handle_mm_fault
      2.42 ± 11%     -41.8%       1.41 ± 34%  perf-profile.calltrace.cycles-pp.__wake_up_bit.unlock_page.do_wp_page.handle_mm_fault.__do_page_fault
      1.94 ± 10%     -32.2%       1.31 ± 35%  perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up.__wake_up_bit.unlock_page.do_wp_page
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.calltrace.cycles-pp.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work.worker_thread
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn
      1.85 ±  3%     -45.6%       1.01 ± 24%  perf-profile.calltrace.cycles-pp.__xfs_get_blocks.xfs_get_blocks.do_mpage_readpage.mpage_readpages.xfs_vm_readpages
      5.86 ±  4%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_trans_commit.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite
      1.03 ± 12%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp._raw_spin_lock.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      4.12 ±  3%     -14.3%       3.53 ±  7%  perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.default_wake_function.wake_bit_function
      1.01 ± 22%     +65.8%       1.67 ± 15%  perf-profile.calltrace.cycles-pp.bio_endio.blk_update_request.blk_mq_end_request.__blk_mq_complete_request.blk_mq_complete_request
      1.13 ± 27%     +62.8%       1.84 ±  6%  perf-profile.calltrace.cycles-pp.bit_wait_io.__wait_on_bit.wait_on_page_bit_killable.__lock_page_or_retry.filemap_fault
      1.81 ± 14%     -79.2%       0.38 ± 70%  perf-profile.calltrace.cycles-pp.bit_wait_io.__wait_on_bit_lock.__lock_page.iomap_page_mkwrite.xfs_filemap_page_mkwrite
      1.08 ± 21%     +61.1%       1.74 ± 16%  perf-profile.calltrace.cycles-pp.blk_mq_complete_request.loop_queue_work.kthread_worker_fn.kthread.ret_from_fork
      1.08 ± 21%     +60.9%       1.73 ± 16%  perf-profile.calltrace.cycles-pp.blk_mq_end_request.__blk_mq_complete_request.blk_mq_complete_request.loop_queue_work.kthread_worker_fn
      1.04 ± 22%     +63.1%       1.70 ± 16%  perf-profile.calltrace.cycles-pp.blk_update_request.blk_mq_end_request.__blk_mq_complete_request.blk_mq_complete_request.loop_queue_work
      3.54 ± 11%     -49.5%       1.79 ±  1%  perf-profile.calltrace.cycles-pp.call_cpuidle.cpu_startup_entry.rest_init.start_kernel.x86_64_start_reservations
     11.68 ±  9%     -27.8%       8.43 ±  2%  perf-profile.calltrace.cycles-pp.call_cpuidle.cpu_startup_entry.start_secondary
      1.61 ± 17%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin
      1.93 ± 16%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.xfs_ilock.xfs_vn_update_time.file_update_time
      0.89 ± 29%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_write.xfs_iunlock.xfs_inode_item_unlock.xfs_trans_free_items
      3.70 ± 15%     +46.9%       5.44 ± 16%  perf-profile.calltrace.cycles-pp.clear_page_dirty_for_io.write_cache_pages.xfs_vm_writepages.do_writepages.__writeback_single_inode
      6.09 ± 13%     -40.6%       3.62 ±  5%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.rest_init.start_kernel.x86_64_start_reservations.x86_64_start_kernel
     19.48 ±  8%     -25.5%      14.51 ±  1%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary
      3.52 ± 11%     -49.5%       1.78 ±  0%  perf-profile.calltrace.cycles-pp.cpuidle_enter.call_cpuidle.cpu_startup_entry.rest_init.start_kernel
     11.63 ±  9%     -27.8%       8.40 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter.call_cpuidle.cpu_startup_entry.start_secondary
      3.45 ± 11%     -49.2%       1.75 ±  0%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.call_cpuidle.cpu_startup_entry.rest_init
     11.40 ±  9%     -28.1%       8.20 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.call_cpuidle.cpu_startup_entry.start_secondary
     34.72 ± 25%     -71.2%       9.99 ± 71%  perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
     10.85 ± 11%     -61.1%       4.22 ± 33%  perf-profile.calltrace.cycles-pp.do_page_mkwrite.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault
     15.75 ±  4%     -56.3%       6.88 ±  7%  perf-profile.calltrace.cycles-pp.do_page_mkwrite.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
     16.95 ± 59%    +145.4%      41.59 ± 20%  perf-profile.calltrace.cycles-pp.do_unit
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.calltrace.cycles-pp.do_unlinkat.sys_unlinkat.entry_SYSCALL_64_fastpath.unlinkat
     13.92 ± 11%     -54.6%       6.32 ± 32%  perf-profile.calltrace.cycles-pp.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback
      1.96 ± 15%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.down_write.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply
      2.17 ± 15%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.down_write.xfs_ilock.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite
      0.77 ± 24%     +69.1%       1.29 ± 17%  perf-profile.calltrace.cycles-pp.end_buffer_async_write.xfs_destroy_ioend.xfs_end_bio.bio_endio.blk_update_request
      0.19 ±173%    +405.6%       0.97 ± 15%  perf-profile.calltrace.cycles-pp.end_page_writeback.end_buffer_async_write.xfs_destroy_ioend.xfs_end_bio.bio_endio
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_fastpath.unlinkat
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.calltrace.cycles-pp.evict.iput.do_unlinkat.sys_unlinkat.entry_SYSCALL_64_fastpath
      5.19 ± 12%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page.handle_mm_fault
      7.63 ±  4%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault.__do_page_fault
      6.58 ±  3%     +22.9%       8.09 ±  9%  perf-profile.calltrace.cycles-pp.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault.__do_page_fault
      2.68 ± 16%     +49.1%       4.00 ± 15%  perf-profile.calltrace.cycles-pp.flush_tlb_page.ptep_clear_flush.page_mkclean_one.rmap_walk_file.rmap_walk
      2.75 ± 21%     +56.9%       4.32 ± 16%  perf-profile.calltrace.cycles-pp.generic_file_write_iter.vfs_iter_write.lo_write_bvec.loop_queue_work.kthread_worker_fn
      2.52 ± 21%     +56.7%       3.96 ± 16%  perf-profile.calltrace.cycles-pp.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.vfs_iter_write.lo_write_bvec
     32.93 ± 25%     -72.2%       9.15 ± 71%  perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
     14.29 ±  4%     -32.9%       9.59 ±  3%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.call_cpuidle.cpu_startup_entry
      5.15 ± 11%     -28.3%       3.69 ± 32%  perf-profile.calltrace.cycles-pp.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page.handle_mm_fault
      7.42 ±  5%     -18.0%       6.09 ±  7%  perf-profile.calltrace.cycles-pp.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault.__do_page_fault
      2.63 ±  6%     +22.2%       3.21 ±  9%  perf-profile.calltrace.cycles-pp.iomap_page_mkwrite_actor.iomap_apply.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite
      1.83 ± 22%     +62.7%       2.98 ± 15%  perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.vfs_iter_write
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.calltrace.cycles-pp.iput.do_unlinkat.sys_unlinkat.entry_SYSCALL_64_fastpath.unlinkat
      4.46 ±  4%     +51.9%       6.78 ± 11%  perf-profile.calltrace.cycles-pp.kswapd.kthread.ret_from_fork
     14.70 ±  5%     +49.9%      22.03 ±  7%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      4.10 ± 20%     +58.8%       6.51 ± 16%  perf-profile.calltrace.cycles-pp.kthread_worker_fn.kthread.ret_from_fork
      2.87 ± 20%     +59.0%       4.56 ± 17%  perf-profile.calltrace.cycles-pp.lo_write_bvec.loop_queue_work.kthread_worker_fn.kthread.ret_from_fork
      4.06 ± 20%     +58.9%       6.45 ± 16%  perf-profile.calltrace.cycles-pp.loop_queue_work.kthread_worker_fn.kthread.ret_from_fork
      1.73 ± 21%     +64.4%       2.84 ± 14%  perf-profile.calltrace.cycles-pp.memcpy_erms.iov_iter_copy_from_user_atomic.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      2.60 ± 15%     +47.8%       3.85 ± 15%  perf-profile.calltrace.cycles-pp.native_flush_tlb_others.flush_tlb_page.ptep_clear_flush.page_mkclean_one.rmap_walk_file
      0.00 ± -1%      +Inf%       1.04 ± 16%  perf-profile.calltrace.cycles-pp.native_irq_return_iret.do_unit
     34.86 ± 25%     -71.2%      10.03 ± 71%  perf-profile.calltrace.cycles-pp.page_fault
      3.20 ± 16%     +48.3%       4.74 ± 16%  perf-profile.calltrace.cycles-pp.page_mkclean.clear_page_dirty_for_io.write_cache_pages.xfs_vm_writepages.do_writepages
      2.91 ± 16%     +49.3%       4.34 ± 15%  perf-profile.calltrace.cycles-pp.page_mkclean_one.rmap_walk_file.rmap_walk.page_mkclean.clear_page_dirty_for_io
      0.91 ± 11%     +52.4%       1.39 ± 13%  perf-profile.calltrace.cycles-pp.page_referenced.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node
      6.09 ± 15%     +42.5%       8.68 ± 14%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      2.75 ± 16%     +48.1%       4.07 ± 15%  perf-profile.calltrace.cycles-pp.ptep_clear_flush.page_mkclean_one.rmap_walk_file.rmap_walk.page_mkclean
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.calltrace.cycles-pp.rest_init.start_kernel.x86_64_start_reservations.x86_64_start_kernel
     14.70 ±  5%     +49.9%      22.03 ±  7%  perf-profile.calltrace.cycles-pp.ret_from_fork
      3.17 ± 15%     +48.7%       4.71 ± 15%  perf-profile.calltrace.cycles-pp.rmap_walk.page_mkclean.clear_page_dirty_for_io.write_cache_pages.xfs_vm_writepages
      0.82 ± 10%     +55.2%       1.28 ± 14%  perf-profile.calltrace.cycles-pp.rmap_walk.page_referenced.shrink_page_list.shrink_inactive_list.shrink_node_memcg
      0.66 ±  8%     +46.0%       0.96 ± 10%  perf-profile.calltrace.cycles-pp.rmap_walk.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_node_memcg
      3.11 ± 15%     +49.3%       4.65 ± 15%  perf-profile.calltrace.cycles-pp.rmap_walk_file.rmap_walk.page_mkclean.clear_page_dirty_for_io.write_cache_pages
      0.72 ±  9%     +57.1%       1.12 ± 14%  perf-profile.calltrace.cycles-pp.rmap_walk_file.rmap_walk.page_referenced.shrink_page_list.shrink_inactive_list
      1.58 ± 17%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.xfs_ilock.xfs_file_iomap_begin_delay
      1.77 ± 21%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.xfs_ilock.xfs_vn_update_time
      0.87 ± 28%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_write.xfs_iunlock.xfs_inode_item_unlock
      1.65 ± 20%     -47.6%       0.86 ± 18%  perf-profile.calltrace.cycles-pp.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task
      1.83 ±  4%     -23.5%       1.40 ± 10%  perf-profile.calltrace.cycles-pp.schedule.schedule_preempt_disabled.cpu_startup_entry.start_secondary
      1.12 ± 34%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.__sched_text_start.bit_wait_io.__wait_on_bit_lock
      1.91 ±  5%     -23.0%       1.47 ± 11%  perf-profile.calltrace.cycles-pp.schedule_preempt_disabled.cpu_startup_entry.start_secondary
      0.73 ± 62%    +115.3%       1.57 ±  8%  perf-profile.calltrace.cycles-pp.schedule_timeout.__sched_text_start.bit_wait_io.__wait_on_bit.wait_on_page_bit_killable
      1.29 ± 30%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.schedule_timeout.__sched_text_start.bit_wait_io.__wait_on_bit_lock.__lock_page
      4.07 ±  5%     +50.1%       6.10 ± 11%  perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_node_memcg.shrink_node.kswapd.kthread
      4.46 ±  4%     +52.0%       6.77 ± 11%  perf-profile.calltrace.cycles-pp.shrink_node.kswapd.kthread.ret_from_fork
      4.42 ±  4%     +52.0%       6.72 ± 11%  perf-profile.calltrace.cycles-pp.shrink_node_memcg.shrink_node.kswapd.kthread.ret_from_fork
      3.46 ±  5%     +50.6%       5.21 ± 11%  perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node.kswapd
      2.55 ± 15%     +46.9%       3.75 ± 15%  perf-profile.calltrace.cycles-pp.smp_call_function_many.native_flush_tlb_others.flush_tlb_page.ptep_clear_flush.page_mkclean_one
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.calltrace.cycles-pp.start_kernel.x86_64_start_reservations.x86_64_start_kernel
     19.74 ±  8%     -25.6%      14.69 ±  2%  perf-profile.calltrace.cycles-pp.start_secondary
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.calltrace.cycles-pp.sys_unlinkat.entry_SYSCALL_64_fastpath.unlinkat
      2.17 ±  7%     -25.4%       1.62 ±  3%  perf-profile.calltrace.cycles-pp.tick_nohz_idle_enter.cpu_startup_entry.start_secondary
      1.19 ± 13%     -30.5%       0.82 ±  7%  perf-profile.calltrace.cycles-pp.tick_nohz_idle_exit.cpu_startup_entry.start_secondary
      0.87 ± 14%     -35.8%       0.56 ±  2%  perf-profile.calltrace.cycles-pp.tick_nohz_restart_sched_tick.tick_nohz_idle_exit.cpu_startup_entry.start_secondary
      1.76 ±  7%     -26.7%       1.29 ±  3%  perf-profile.calltrace.cycles-pp.tick_nohz_stop_sched_tick.__tick_nohz_idle_enter.tick_nohz_idle_enter.cpu_startup_entry.start_secondary
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.calltrace.cycles-pp.truncate_inode_pages_final.evict.iput.do_unlinkat.sys_unlinkat
      0.62 ±  2%     +47.3%       0.92 ± 31%  perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.truncate_inode_pages_final.evict.iput.do_unlinkat
      0.68 ±  8%     +46.7%       0.99 ± 10%  perf-profile.calltrace.cycles-pp.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node
      1.13 ± 38%     -78.2%       0.25 ±141%  perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_write
      4.37 ±  2%     -14.2%       3.75 ±  7%  perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.default_wake_function.wake_bit_function.__wake_up_common
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.calltrace.cycles-pp.unlinkat
      2.45 ± 11%     -41.1%       1.44 ± 34%  perf-profile.calltrace.cycles-pp.unlock_page.do_wp_page.handle_mm_fault.__do_page_fault.do_page_fault
      1.06 ± 23%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.up_write.xfs_iunlock.xfs_inode_item_unlock.xfs_trans_free_items.xfs_log_commit_cil
      2.81 ± 20%     +55.9%       4.37 ± 16%  perf-profile.calltrace.cycles-pp.vfs_iter_write.lo_write_bvec.loop_queue_work.kthread_worker_fn.kthread
      1.57 ±  8%     +53.9%       2.42 ±  7%  perf-profile.calltrace.cycles-pp.wait_on_page_bit_killable.__lock_page_or_retry.filemap_fault.xfs_filemap_fault.__do_fault
      1.16 ± 39%     -78.5%       0.25 ±141%  perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_write.xfs_iunlock
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread
      6.09 ± 15%     +42.5%       8.69 ± 14%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      6.08 ± 15%     +42.5%       8.66 ± 14%  perf-profile.calltrace.cycles-pp.write_cache_pages.xfs_vm_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.calltrace.cycles-pp.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.calltrace.cycles-pp.x86_64_start_kernel
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.calltrace.cycles-pp.x86_64_start_reservations.x86_64_start_kernel
      0.98 ± 22%     +67.0%       1.64 ± 16%  perf-profile.calltrace.cycles-pp.xfs_destroy_ioend.xfs_end_bio.bio_endio.blk_update_request.blk_mq_end_request
      1.98 ± 15%     +37.5%       2.72 ± 11%  perf-profile.calltrace.cycles-pp.xfs_do_writepage.write_cache_pages.xfs_vm_writepages.do_writepages.__writeback_single_inode
      0.99 ± 22%     +67.2%       1.65 ± 16%  perf-profile.calltrace.cycles-pp.xfs_end_bio.bio_endio.blk_update_request.blk_mq_end_request.__blk_mq_complete_request
      6.07 ±  4%     -33.0%       4.07 ±  8%  perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin.iomap_apply.iomap_page_mkwrite.xfs_filemap_page_mkwrite.do_page_mkwrite
      5.80 ±  4%     -35.0%       3.77 ±  8%  perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_page_mkwrite.xfs_filemap_page_mkwrite
      7.04 ±  3%     +21.8%       8.58 ±  9%  perf-profile.calltrace.cycles-pp.xfs_filemap_fault.__do_fault.handle_mm_fault.__do_page_fault.do_page_fault
     10.78 ± 11%     -61.3%       4.17 ± 33%  perf-profile.calltrace.cycles-pp.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page.handle_mm_fault.__do_page_fault
     15.67 ±  4%     -56.7%       6.79 ±  7%  perf-profile.calltrace.cycles-pp.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault.__do_page_fault.do_page_fault
      1.87 ±  4%     -44.6%       1.04 ± 24%  perf-profile.calltrace.cycles-pp.xfs_get_blocks.do_mpage_readpage.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead
      2.01 ± 16%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_page_mkwrite
      2.23 ± 15%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite
      1.25 ±  3%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_inode_item_unlock.xfs_trans_free_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_trans_commit
      1.11 ± 22%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_iunlock.xfs_inode_item_unlock.xfs_trans_free_items.xfs_log_commit_cil.__xfs_trans_commit
      4.90 ±  4%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_trans_commit.xfs_vn_update_time.file_update_time
      0.95 ± 50%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_log_reserve.xfs_trans_reserve.xfs_trans_alloc.xfs_vn_update_time.file_update_time
      1.23 ± 14%     +37.7%       1.70 ± 12%  perf-profile.calltrace.cycles-pp.xfs_start_page_writeback.xfs_do_writepage.write_cache_pages.xfs_vm_writepages.do_writepages
      2.81 ±  9%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_trans_alloc.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite
      5.99 ±  4%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_trans_commit.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite
      1.48 ±  4%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_trans_free_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_trans_commit.xfs_vn_update_time
      1.62 ± 20%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_trans_reserve.xfs_trans_alloc.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.calltrace.cycles-pp.xfs_vm_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb
      4.98 ± 12%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.do_wp_page
      7.29 ±  4%    -100.0%       0.00 ± -1%  perf-profile.calltrace.cycles-pp.xfs_vn_update_time.file_update_time.xfs_filemap_page_mkwrite.do_page_mkwrite.handle_mm_fault
      3.72 ±  6%     -27.8%       2.69 ±  4%  perf-profile.children.cycles-pp.__account_scheduler_latency
      1.39 ± 23%     +55.6%       2.17 ± 19%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
      0.72 ± 38%     +67.0%       1.21 ± 26%  perf-profile.children.cycles-pp.__alloc_pages_slowpath
      1.08 ± 21%     +61.1%       1.74 ± 16%  perf-profile.children.cycles-pp.__blk_mq_complete_request
      1.30 ±  9%     +19.0%       1.55 ± 11%  perf-profile.children.cycles-pp.__block_commit_write
      1.25 ±  2%     +32.3%       1.65 ±  6%  perf-profile.children.cycles-pp.__block_write_begin_int
      9.79 ±  8%     +24.3%      12.16 ± 11%  perf-profile.children.cycles-pp.__do_fault
     46.18 ±  3%     -33.1%      30.87 ±  7%  perf-profile.children.cycles-pp.__do_page_fault
      2.66 ± 21%     +56.9%       4.17 ± 16%  perf-profile.children.cycles-pp.__generic_file_write_iter
      2.62 ±  4%     -46.6%       1.40 ± 16%  perf-profile.children.cycles-pp.__lock_page
      1.66 ±  8%     +65.3%       2.74 ±  8%  perf-profile.children.cycles-pp.__lock_page_or_retry
      1.29 ± 10%     -22.0%       1.01 ±  9%  perf-profile.children.cycles-pp.__might_sleep
      1.18 ± 24%     +49.8%       1.76 ± 22%  perf-profile.children.cycles-pp.__page_cache_alloc
      0.81 ±  3%     +20.5%       0.97 ±  5%  perf-profile.children.cycles-pp.__radix_tree_lookup
      2.33 ±  6%     -29.3%       1.64 ±  4%  perf-profile.children.cycles-pp.__save_stack_trace
      6.04 ±  3%     -22.4%       4.69 ±  8%  perf-profile.children.cycles-pp.__schedule
      2.80 ±  1%     -24.8%       2.11 ±  3%  perf-profile.children.cycles-pp.__tick_nohz_idle_enter
      1.53 ±  8%     +54.3%       2.36 ±  7%  perf-profile.children.cycles-pp.__wait_on_bit
      2.57 ±  5%     -38.7%       1.58 ± 16%  perf-profile.children.cycles-pp.__wait_on_bit_lock
      7.02 ±  3%     -13.6%       6.06 ±  6%  perf-profile.children.cycles-pp.__wake_up
      7.23 ±  3%     -13.4%       6.26 ±  5%  perf-profile.children.cycles-pp.__wake_up_bit
      6.16 ±  3%      -9.3%       5.58 ±  6%  perf-profile.children.cycles-pp.__wake_up_common
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.children.cycles-pp.__writeback_inodes_wb
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.children.cycles-pp.__writeback_single_inode
      2.08 ±  3%     -32.5%       1.40 ±  2%  perf-profile.children.cycles-pp.__xfs_get_blocks
      5.88 ±  4%     -99.0%       0.06 ± 23%  perf-profile.children.cycles-pp.__xfs_trans_commit
      2.92 ±  6%     -28.1%       2.10 ±  6%  perf-profile.children.cycles-pp._raw_spin_lock
      2.11 ±  2%     -21.6%       1.66 ± 10%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      5.86 ±  2%     -27.9%       4.22 ±  6%  perf-profile.children.cycles-pp.activate_task
      1.27 ± 12%     +35.2%       1.72 ± 15%  perf-profile.children.cycles-pp.add_to_page_cache_lru
      1.46 ± 22%     +55.2%       2.27 ± 18%  perf-profile.children.cycles-pp.alloc_pages_current
      1.01 ± 22%     +65.8%       1.67 ± 15%  perf-profile.children.cycles-pp.bio_endio
      1.08 ± 21%     +60.7%       1.74 ± 16%  perf-profile.children.cycles-pp.blk_mq_complete_request
      1.08 ± 21%     +60.9%       1.73 ± 16%  perf-profile.children.cycles-pp.blk_mq_end_request
      1.04 ± 22%     +63.1%       1.70 ± 16%  perf-profile.children.cycles-pp.blk_update_request
      1.31 ±  8%     +18.6%       1.56 ± 12%  perf-profile.children.cycles-pp.block_commit_write
     15.23 ±  4%     -32.8%      10.23 ±  2%  perf-profile.children.cycles-pp.call_cpuidle
      1.04 ±  9%     +63.4%       1.70 ± 24%  perf-profile.children.cycles-pp.call_function_interrupt
      4.10 ±  6%     -93.8%       0.25 ±  9%  perf-profile.children.cycles-pp.call_rwsem_down_write_failed
      2.82 ±  4%     -64.2%       1.01 ± 10%  perf-profile.children.cycles-pp.call_rwsem_wake
      4.38 ± 15%     +44.2%       6.31 ± 14%  perf-profile.children.cycles-pp.clear_page_dirty_for_io
     25.57 ±  3%     -29.1%      18.14 ±  2%  perf-profile.children.cycles-pp.cpu_startup_entry
     15.17 ±  4%     -32.8%      10.19 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter
     14.86 ±  4%     -33.1%       9.95 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter_state
      0.65 ±  6%     +54.5%       1.00 ±  6%  perf-profile.children.cycles-pp.create_empty_buffers
      0.83 ±  4%     +51.1%       1.25 ±  5%  perf-profile.children.cycles-pp.create_page_buffers
      2.12 ±  4%     -23.9%       1.61 ±  7%  perf-profile.children.cycles-pp.deactivate_task
      5.97 ±  3%      -9.3%       5.42 ±  6%  perf-profile.children.cycles-pp.default_wake_function
      1.62 ±  6%     -24.1%       1.23 ±  5%  perf-profile.children.cycles-pp.dequeue_entity
      1.86 ±  4%     -24.0%       1.41 ±  5%  perf-profile.children.cycles-pp.dequeue_task_fair
     46.50 ±  3%     -32.9%      31.22 ±  8%  perf-profile.children.cycles-pp.do_page_fault
     26.60 ±  4%     -58.3%      11.10 ± 11%  perf-profile.children.cycles-pp.do_page_mkwrite
      0.68 ± 39%     +66.1%       1.13 ± 27%  perf-profile.children.cycles-pp.do_try_to_free_pages
     16.95 ± 59%    +145.4%      41.59 ± 20%  perf-profile.children.cycles-pp.do_unit
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.children.cycles-pp.do_unlinkat
     13.93 ± 11%     -54.5%       6.34 ± 32%  perf-profile.children.cycles-pp.do_wp_page
      6.50 ± 14%     +39.2%       9.04 ± 12%  perf-profile.children.cycles-pp.do_writepages
      1.96 ±  3%     -13.9%       1.69 ±  3%  perf-profile.children.cycles-pp.down_read
      4.68 ±  6%     -88.8%       0.53 ± 13%  perf-profile.children.cycles-pp.down_write
      0.77 ± 24%     +69.3%       1.30 ± 17%  perf-profile.children.cycles-pp.end_buffer_async_write
      0.53 ± 27%     +84.9%       0.98 ± 15%  perf-profile.children.cycles-pp.end_page_writeback
      5.34 ±  2%     -27.7%       3.86 ±  7%  perf-profile.children.cycles-pp.enqueue_entity
      5.53 ±  2%     -27.2%       4.03 ±  7%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.children.cycles-pp.evict
     12.92 ±  5%     -96.3%       0.48 ± 11%  perf-profile.children.cycles-pp.file_update_time
      9.21 ±  8%     +25.0%      11.52 ± 11%  perf-profile.children.cycles-pp.filemap_fault
      0.81 ±  8%     +48.1%       1.20 ± 21%  perf-profile.children.cycles-pp.flush_smp_call_function_queue
      2.74 ± 15%     +48.5%       4.07 ± 14%  perf-profile.children.cycles-pp.flush_tlb_page
      2.76 ± 20%     +56.6%       4.33 ± 16%  perf-profile.children.cycles-pp.generic_file_write_iter
      2.54 ± 21%     +56.1%       3.96 ± 16%  perf-profile.children.cycles-pp.generic_perform_write
      0.96 ±  9%     +47.9%       1.42 ± 22%  perf-profile.children.cycles-pp.generic_smp_call_function_single_interrupt
      1.06 ±  1%     -22.8%       0.82 ±  9%  perf-profile.children.cycles-pp.get_next_timer_interrupt
     47.30 ±  3%     -31.1%      32.58 ±  3%  perf-profile.children.cycles-pp.handle_mm_fault
      1.14 ±  8%     -29.7%       0.80 ±  7%  perf-profile.children.cycles-pp.hrtimer_start_range_ns
     14.32 ±  4%     -32.8%       9.62 ±  3%  perf-profile.children.cycles-pp.intel_idle
      8.94 ±  4%     -14.6%       7.64 ±  9%  perf-profile.children.cycles-pp.iomap_apply
     12.58 ±  4%     -22.2%       9.79 ± 10%  perf-profile.children.cycles-pp.iomap_page_mkwrite
      2.65 ±  6%     +24.3%       3.29 ±  8%  perf-profile.children.cycles-pp.iomap_page_mkwrite_actor
      1.83 ± 22%     +62.6%       2.98 ± 15%  perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.children.cycles-pp.iput
      1.25 ±  5%     -53.2%       0.59 ±  4%  perf-profile.children.cycles-pp.kmem_cache_alloc
      1.53 ±  8%    -100.0%       0.00 ± -1%  perf-profile.children.cycles-pp.kmem_zone_alloc
      4.46 ±  4%     +51.9%       6.78 ± 11%  perf-profile.children.cycles-pp.kswapd
     14.70 ±  5%     +49.9%      22.03 ±  7%  perf-profile.children.cycles-pp.kthread
      4.10 ± 20%     +58.8%       6.51 ± 16%  perf-profile.children.cycles-pp.kthread_worker_fn
      2.87 ± 20%     +59.1%       4.57 ± 17%  perf-profile.children.cycles-pp.lo_write_bvec
      4.06 ± 20%     +58.9%       6.45 ± 16%  perf-profile.children.cycles-pp.loop_queue_work
      1.00 ±  7%     +27.3%       1.27 ±  9%  perf-profile.children.cycles-pp.mark_buffer_dirty
      1.75 ± 21%     +64.1%       2.88 ± 14%  perf-profile.children.cycles-pp.memcpy_erms
      2.80 ± 15%     +47.1%       4.12 ± 13%  perf-profile.children.cycles-pp.native_flush_tlb_others
      1.47 ±  3%     +29.2%       1.90 ± 13%  perf-profile.children.cycles-pp.native_irq_return_iret
      2.63 ±  7%     -34.2%       1.73 ± 10%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
     46.66 ±  3%     -32.8%      31.34 ±  8%  perf-profile.children.cycles-pp.page_fault
      3.77 ± 16%     +45.5%       5.48 ± 14%  perf-profile.children.cycles-pp.page_mkclean
      3.15 ± 15%     +48.1%       4.67 ± 13%  perf-profile.children.cycles-pp.page_mkclean_one
      1.38 ± 12%     +46.9%       2.03 ± 21%  perf-profile.children.cycles-pp.page_referenced
      1.37 ±  7%     -25.8%       1.02 ±  9%  perf-profile.children.cycles-pp.pick_next_task_fair
      6.09 ± 15%     +42.5%       8.68 ± 14%  perf-profile.children.cycles-pp.process_one_work
      2.81 ± 16%     +47.3%       4.14 ± 14%  perf-profile.children.cycles-pp.ptep_clear_flush
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.children.cycles-pp.rest_init
     14.70 ±  5%     +49.8%      22.03 ±  7%  perf-profile.children.cycles-pp.ret_from_fork
      5.59 ±  7%     +45.7%       8.15 ±  3%  perf-profile.children.cycles-pp.rmap_walk
      5.29 ±  8%     +46.4%       7.75 ±  4%  perf-profile.children.cycles-pp.rmap_walk_file
      4.01 ±  6%     -93.9%       0.24 ±  6%  perf-profile.children.cycles-pp.rwsem_down_write_failed
      2.14 ± 10%     -96.3%       0.08 ±  0%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      2.78 ±  4%     -64.3%       0.99 ± 11%  perf-profile.children.cycles-pp.rwsem_wake
      2.75 ±  6%     -29.9%       1.93 ±  3%  perf-profile.children.cycles-pp.save_stack_trace_tsk
      6.35 ±  3%     -23.0%       4.89 ±  8%  perf-profile.children.cycles-pp.schedule
      2.63 ±  4%     -26.1%       1.95 ± 10%  perf-profile.children.cycles-pp.schedule_preempt_disabled
      0.48 ± 11%     +61.8%       0.78 ± 32%  perf-profile.children.cycles-pp.shrink_active_list
      4.55 ±  9%     +53.0%       6.96 ± 13%  perf-profile.children.cycles-pp.shrink_inactive_list
      5.14 ±  8%     +53.9%       7.91 ± 14%  perf-profile.children.cycles-pp.shrink_node
      5.10 ±  8%     +53.7%       7.84 ± 13%  perf-profile.children.cycles-pp.shrink_node_memcg
      3.78 ±  8%     +49.7%       5.65 ± 12%  perf-profile.children.cycles-pp.shrink_page_list
      0.97 ±  9%     +61.2%       1.56 ± 22%  perf-profile.children.cycles-pp.smp_call_function_interrupt
      2.75 ± 15%     +46.6%       4.03 ± 13%  perf-profile.children.cycles-pp.smp_call_function_many
      1.16 ±  8%     +44.6%       1.67 ± 21%  perf-profile.children.cycles-pp.smp_call_function_single_interrupt
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.children.cycles-pp.start_kernel
     19.74 ±  8%     -25.6%      14.69 ±  2%  perf-profile.children.cycles-pp.start_secondary
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.children.cycles-pp.sys_unlinkat
      2.93 ±  1%     -25.3%       2.19 ±  3%  perf-profile.children.cycles-pp.tick_nohz_idle_enter
      1.55 ±  7%     -29.0%       1.10 ±  8%  perf-profile.children.cycles-pp.tick_nohz_idle_exit
      1.12 ±  7%     -32.4%       0.76 ±  3%  perf-profile.children.cycles-pp.tick_nohz_restart_sched_tick
      2.39 ±  2%     -25.9%       1.77 ±  4%  perf-profile.children.cycles-pp.tick_nohz_stop_sched_tick
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.children.cycles-pp.truncate_inode_pages_final
      0.62 ±  2%     +47.3%       0.92 ± 31%  perf-profile.children.cycles-pp.truncate_inode_pages_range
      0.68 ± 39%     +66.1%       1.13 ± 27%  perf-profile.children.cycles-pp.try_to_free_pages
      0.69 ±  8%     +48.9%       1.02 ± 10%  perf-profile.children.cycles-pp.try_to_unmap
      8.49 ±  1%     -25.7%       6.30 ±  5%  perf-profile.children.cycles-pp.try_to_wake_up
      6.24 ±  2%     -28.1%       4.48 ±  7%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.63 ±  2%     +47.7%       0.93 ± 32%  perf-profile.children.cycles-pp.unlinkat
      7.55 ±  2%     -11.8%       6.66 ±  5%  perf-profile.children.cycles-pp.unlock_page
      1.52 ±  4%     -21.7%       1.19 ±  6%  perf-profile.children.cycles-pp.up_read
      2.44 ±  7%     -61.5%       0.94 ±  8%  perf-profile.children.cycles-pp.up_write
      2.81 ± 20%     +56.0%       4.39 ± 16%  perf-profile.children.cycles-pp.vfs_iter_write
      1.58 ±  8%     +53.3%       2.43 ±  7%  perf-profile.children.cycles-pp.wait_on_page_bit_killable
      6.05 ±  3%      -9.4%       5.48 ±  6%  perf-profile.children.cycles-pp.wake_bit_function
      2.62 ±  3%     -64.5%       0.93 ±  9%  perf-profile.children.cycles-pp.wake_up_q
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.children.cycles-pp.wb_workfn
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.children.cycles-pp.wb_writeback
      6.09 ± 15%     +42.5%       8.69 ± 14%  perf-profile.children.cycles-pp.worker_thread
      6.49 ± 14%     +39.2%       9.03 ± 12%  perf-profile.children.cycles-pp.write_cache_pages
      6.09 ± 15%     +42.3%       8.67 ± 14%  perf-profile.children.cycles-pp.writeback_sb_inodes
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.children.cycles-pp.x86_64_start_kernel
      6.17 ± 13%     -40.5%       3.67 ±  5%  perf-profile.children.cycles-pp.x86_64_start_reservations
      0.98 ± 22%     +67.0%       1.64 ± 16%  perf-profile.children.cycles-pp.xfs_destroy_ioend
      2.10 ± 13%     +34.8%       2.84 ± 10%  perf-profile.children.cycles-pp.xfs_do_writepage
      0.99 ± 22%     +67.2%       1.65 ± 16%  perf-profile.children.cycles-pp.xfs_end_bio
      6.08 ±  4%     -31.4%       4.17 ±  9%  perf-profile.children.cycles-pp.xfs_file_iomap_begin
      5.82 ±  4%     -33.9%       3.85 ±  8%  perf-profile.children.cycles-pp.xfs_file_iomap_begin_delay
      9.71 ±  7%     +23.8%      12.03 ± 10%  perf-profile.children.cycles-pp.xfs_filemap_fault
     26.49 ±  4%     -58.6%      10.98 ± 11%  perf-profile.children.cycles-pp.xfs_filemap_page_mkwrite
      2.12 ±  4%     -31.4%       1.45 ±  3%  perf-profile.children.cycles-pp.xfs_get_blocks
      6.06 ±  6%     -74.5%       1.55 ±  6%  perf-profile.children.cycles-pp.xfs_ilock
      1.04 ±  2%    -100.0%       0.00 ± -1%  perf-profile.children.cycles-pp.xfs_inode_item_format
      1.40 ±  4%    -100.0%       0.00 ± -1%  perf-profile.children.cycles-pp.xfs_inode_item_unlock
      3.60 ±  4%     -58.4%       1.50 ±  8%  perf-profile.children.cycles-pp.xfs_iunlock
      4.95 ±  4%     -98.9%       0.05 ±  8%  perf-profile.children.cycles-pp.xfs_log_commit_cil
      1.60 ±  9%    -100.0%       0.00 ± -1%  perf-profile.children.cycles-pp.xfs_log_reserve
      1.32 ± 13%     +33.8%       1.77 ± 11%  perf-profile.children.cycles-pp.xfs_start_page_writeback
      2.83 ±  9%     -98.6%       0.04 ± 73%  perf-profile.children.cycles-pp.xfs_trans_alloc
      6.01 ±  4%     -98.9%       0.07 ± 25%  perf-profile.children.cycles-pp.xfs_trans_commit
      1.78 ±  4%    -100.0%       0.00 ± -1%  perf-profile.children.cycles-pp.xfs_trans_free_items
      1.84 ±  8%    -100.0%       0.00 ± -1%  perf-profile.children.cycles-pp.xfs_trans_reserve
      6.50 ± 14%     +39.2%       9.04 ± 12%  perf-profile.children.cycles-pp.xfs_vm_writepages
     12.31 ±  5%     -98.7%       0.16 ± 20%  perf-profile.children.cycles-pp.xfs_vn_update_time
      0.81 ±  3%     +20.5%       0.97 ±  5%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.98 ±  6%     -24.6%       0.74 ± 10%  perf-profile.self.cycles-pp.__schedule
      1.45 ±  6%     -12.0%       1.28 ±  6%  perf-profile.self.cycles-pp._raw_spin_lock
      1.45 ± 15%     +36.6%       1.98 ± 20%  perf-profile.self.cycles-pp.do_mpage_readpage
      4.59 ± 59%    +295.3%      18.14 ± 20%  perf-profile.self.cycles-pp.do_unit
     14.32 ±  4%     -32.8%       9.62 ±  3%  perf-profile.self.cycles-pp.intel_idle
      1.75 ± 21%     +64.1%       2.88 ± 14%  perf-profile.self.cycles-pp.memcpy_erms
      1.47 ±  3%     +29.2%       1.90 ± 13%  perf-profile.self.cycles-pp.native_irq_return_iret
      2.63 ±  7%     -34.2%       1.73 ± 10%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      2.14 ± 10%     -96.3%       0.08 ±  0%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      1.55 ± 13%     +65.5%       2.57 ± 12%  perf-profile.self.cycles-pp.smp_call_function_many
      0.82 ±  7%     +20.7%       0.99 ±  5%  perf-profile.self.cycles-pp.up_read



                               perf-stat.instructions

  1e+13 ++-------------O-------O----O---O-O---------------------------------+
  9e+12 O+O O O  O O O   O O O    O   O     O O O  O O O O                  |
        *. .*.*..*.*.*.*.*. .*.  .*.*. .*.*.*.*.  .*.*.*.*.*   *.    .*.    |
  8e+12 ++*                *   *.     *         *.         :   : *..*   *.*.*
  7e+12 ++                                                 :   :            |
        |                                                   :  :            |
  6e+12 ++                                                  : :             |
  5e+12 ++                                                  : :             |
  4e+12 ++                                                  : :             |
        |                                                   : :             |
  3e+12 ++                                                  : :             |
  2e+12 ++                                                   ::             |
        |                                                    :              |
  1e+12 ++                                                   :              |
      0 ++---------------------------------------------------*--------------+


                                perf-stat.cache-misses

    3e+10 ++----------------------------------------------------------------+
          O O O O O O O O  O O O O O O O O O O O O O O O O                  |
  2.5e+10 ++                                                                |
          |                                                                 |
          |                                                     *.          |
    2e+10 *+*.*.*.*.*.*.*..*. .*.*.*.*.*.*.*.*.*.*.*.*.*.*..*   : *.*.*.*.*.*
          |                  *                              :   :           |
  1.5e+10 ++                                                :  :            |
          |                                                  : :            |
    1e+10 ++                                                 : :            |
          |                                                  : :            |
          |                                                  : :            |
    5e+09 ++                                                  :             |
          |                                                   :             |
        0 ++--------------------------------------------------*-------------+


                             perf-stat.branch-instructions

  2.5e+12 ++----------------------------------------------------------------+
          O O O O O O O O  O O O O O O O O O O O O O O O O                  |
          |                                                                 |
    2e+12 *+*.*.*.*.*.*.*..*. .*.*.*.*.*.*.*.*.*.*.*.*.*.*..*   *.*.*.*.*.*.*
          |                  *                              :   :           |
          |                                                 :   :           |
  1.5e+12 ++                                                 : :            |
          |                                                  : :            |
    1e+12 ++                                                 : :            |
          |                                                  : :            |
          |                                                  : :            |
    5e+11 ++                                                 : :            |
          |                                                   :             |
          |                                                   :             |
        0 ++--------------------------------------------------*-------------+


                               perf-stat.branch-misses

  8e+09 ++---------------*--------------------------------------------------+
        |.*.      .*.*.*  + .*.*..*. .*.       .*..                .*.*.*.*.|
  7e+09 *+  *.*..*         *        *   *.*.*.*    *.*.*.*.*   *.*.         *
  6e+09 ++                                                 :   :            |
        O O O O  O O O O O O O O  O O O O O O O O  O O O O :   :            |
  5e+09 ++                                                  :  :            |
        |                                                   : :             |
  4e+09 ++                                                  : :             |
        |                                                   : :             |
  3e+09 ++                                                  : :             |
  2e+09 ++                                                  : :             |
        |                                                    ::             |
  1e+09 ++                                                   :              |
        |                                                    :              |
      0 ++---------------------------------------------------*--------------+


                              perf-stat.context-switches

  3.5e+08 ++----------------------------------------------------------------+
          |                                                                 |
    3e+08 ++*.       .*.  .*          .*.       .*.                .*.      |
          *   *.*.*.*   *.  +   .*. .*   *.*.*.*   *.*.*.*..*   *.*   *.*.*.*
  2.5e+08 ++                 *.*   *                        :   :           |
          O         O O    O   O       O                    :   :           |
    2e+08 ++O O O O     O    O   O O O   O O O O O O O O O   : :            |
          |                                                  : :            |
  1.5e+08 ++                                                 : :            |
          |                                                  : :            |
    1e+08 ++                                                 : :            |
          |                                                  : :            |
    5e+07 ++                                                  :             |
          |                                                   :             |
        0 ++--------------------------------------------------*-------------+


                           perf-stat.cache-miss-rate_

  40 O+O-O----O-O-O--O-O-O-O-O----O-O-O--O-O-O-O-O--O-O-O-------------------+
     |      O                   O                                           |
  35 ++                                                                     |
  30 ++                                                                     |
     *. .*..*.*.*.  .*.          .*. .*..*.*.*. .*..*.*.*.*    *.        .*.*
  25 ++*          *.   *.*.*.*..*   *          *          :    : *.*.*..*   |
     |                                                    :   :             |
  20 ++                                                    :  :             |
     |                                                     :  :             |
  15 ++                                                    :  :             |
  10 ++                                                    : :              |
     |                                                     : :              |
   5 ++                                                     ::              |
     |                                                      :               |
   0 ++-----------------------------------------------------*---------------+


                            perf-stat.branch-miss-rate_

  0.45 ++-------------------------------------------------------------------+
       |               .*.                                                  |
   0.4 ++*.      .*.*.*   *..*.*.*. .*.        .*.                .*..*.*.*.*
  0.35 *+  *.*..*                  *   *..*.*.*   *.*.*..*.*   *.*          |
       |                                                   :   :            |
   0.3 ++                                                  :   :            |
  0.25 O+    O    O O            O            O   O   O  O  : :             |
       | O O    O     O O O  O O   O O O  O O   O   O       : :             |
   0.2 ++                                                   : :             |
  0.15 ++                                                   : :             |
       |                                                    : :             |
   0.1 ++                                                   : :             |
  0.05 ++                                                    :              |
       |                                                     :              |
     0 ++----------------------------------------------------*--------------+


                                   perf-stat.ipc

  1.2 ++--------------------------------------------------------------------+
      |                                                                     |
    1 ++         O O O  O O O O   O  O O O O    O   O                       |
      O O O  O O                O            O    O   O O                   |
      *.*.*..*.*.*.*.*..*.*.*.*.*.*..*.*.*.*.*..*.*.*.*.*..*   *.*.*.*..*.*.*
  0.8 ++                                                   :   :            |
      |                                                    :   :            |
  0.6 ++                                                    : :             |
      |                                                     : :             |
  0.4 ++                                                    : :             |
      |                                                     : :             |
      |                                                     : :             |
  0.2 ++                                                     :              |
      |                                                      :              |
    0 ++-----------------------------------------------------*--------------+


                           vm-scalability.time.user_time

  1000 ++-------------------------------------------------------------------+
   900 ++O O    O     O            O   O  O O O O O O O                     |
       O     O    O O   O O  O O O   O                   O                  |
   800 ++                                                                   |
   700 ++                                                                   |
       *. .*.*..*.*. .*.     *. .*.*. .*..*.*.*. .*.*.*..*.*   *.*.  .*.*.*.*
   600 ++*          *   *    : *     *          *          :   :   *.       |
   500 ++               :   :                              :   :            |
   400 ++                :  :                               : :             |
       |                 :  :                               : :             |
   300 ++                : :                                : :             |
   200 ++                : :                                : :             |
       |                  ::                                 :              |
   100 ++                 :                                  :              |
     0 ++-----------------*----------------------------------*--------------+


                          vm-scalability.time.system_time

  1800 ++-------------------------------------------------------------------+
       |.*.*.*..*.*.*.*.*    *.*.*. .*.*..*.*. .*.*.*.*..*.*   *.*.*..*.*.*.*
  1600 *+               :    :     *          *            :   :            |
  1400 ++               :    :                             :   :            |
       O     O    O O   :   :O   O   O    O                :   :            |
  1200 ++O O    O     O O:O :  O   O   O    O O O O O O  O  : :             |
  1000 ++                :  :                               : :             |
       |                 :  :                               : :             |
   800 ++                : :                                : :             |
   600 ++                : :                                : :             |
       |                 : :                                : :             |
   400 ++                 ::                                 :              |
   200 ++                 :                                  :              |
       |                  :                                  :              |
     0 ++-----------------*----------------------------------*--------------+


                  vm-scalability.time.percent_of_cpu_this_job_got

  300 ++--------------------------------------------------------------------+
      |                                                                     |
  250 *+*.*..*.*.*.*.*..*   *.*.*.*..*.*.*.*.*..*.*.*.*.*..*   *.*.*.*..*.*.*
      O O O  O O O O O  O O O O O O  O O O O O  O O O O O  :   :            |
      |                 :   :                              :   :            |
  200 ++                 :  :                               :  :            |
      |                  : :                                : :             |
  150 ++                 : :                                : :             |
      |                  : :                                : :             |
  100 ++                 : :                                : :             |
      |                  : :                                : :             |
      |                   ::                                 ::             |
   50 ++                  :                                  :              |
      |                   :                                  :              |
    0 ++------------------*----------------------------------*--------------+


                         vm-scalability.time.minor_page_faults

    3e+08 ++----------------------------------------------------------------+
          | O O         O  O     O   O O O O O   O                          |
  2.5e+08 O+    O O O O      O O   O           O   O O O O                  |
          *.*.*.*.*.*.*.*..*   *.*.*.*.*.*.*.*.*.*.*.*.*.*..*   *.*.*.*.*.*.*
          |                :   :                            :   :           |
    2e+08 ++               :   :                            :   :           |
          |                 : :                              : :            |
  1.5e+08 ++                : :                              : :            |
          |                 : :                              : :            |
    1e+08 ++                : :                              : :            |
          |                 : :                              : :            |
          |                 : :                              : :            |
    5e+07 ++                 :                                :             |
          |                  :                                :             |
        0 ++-----------------*--------------------------------*-------------+


                    vm-scalability.time.voluntary_context_switches

  1.6e+08 ++----------------------------------------------------------------+
          | *.        *.  .*           *.        *.                .*.      |
  1.4e+08 ++  *.*.*. +  *. :    .*.   +  *.*.*. +  *.*.*.  .*   *.*   *.*.*.|
  1.2e+08 *+        *      :   *   *.*         *         *. :   :           *
          |                :   :                            :   :           |
    1e+08 O+O O O O O O O  O:O O O   O O O O O O O O O O O   :  :           |
          |                 : :    O                         : :            |
    8e+07 ++                : :                              : :            |
          |                 : :                              : :            |
    6e+07 ++                : :                              : :            |
    4e+07 ++                : :                              : :            |
          |                  ::                               ::            |
    2e+07 ++                 :                                :             |
          |                  :                                :             |
        0 ++-----------------*--------------------------------*-------------+


                        vm-scalability.time.file_system_outputs

  1.2e+09 ++----------------------------------------------------------------+
          |                                                                 |
    1e+09 ++O O O O O O O  O O O O O O O O O O O O O O O O                  |
          O                                                                 |
          |                                                                 |
    8e+08 *+ .*.*.*.   .*..    *. .*.*. .*.*.*.*. .*.*.*.*..    *.          |
          | *       *.*    *   : *     *         *          *   : *.*.*.*.*.*
    6e+08 ++               :   :                            :   :           |
          |                 : :                              : :            |
    4e+08 ++                : :                              : :            |
          |                 : :                              : :            |
          |                 : :                              : :            |
    2e+08 ++                 :                                :             |
          |                  :                                :             |
        0 ++-----------------*--------------------------------*-------------+


                               vm-scalability.throughput

    3e+06 ++----------------------------------------------------------------+
          | O O   O O O O  O O O O   O O O O O O O O O O O                  |
  2.5e+06 O+    O                  O                                        |
          |                                                                 |
          |                                                 O               |
    2e+06 *+ .*.*.*.*. .*.. .*.*.*.*.*. .*.*.*.*. .*.*.*.*..*   *.*. .*.*.*.*
          | *         *    *           *         *          :   :   *       |
  1.5e+06 ++                                                :   :           |
          |                                                  : :            |
    1e+06 ++                                                 : :            |
          |                                                  : :            |
          |                                                  : :            |
   500000 ++                                                  :             |
          |                                                   :             |
        0 ++--------------------------------------------------*-------------+


                        interrupts.CAL:Function_call_interrupts

    3e+08 ++----------------------------------------------------------------+
          |                                                                 |
  2.5e+08 ++    O                  O                                        |
          | O O   O O O O  O O O O   O O O O O O O O O O O                  |
          O                                                                 |
    2e+08 ++                                                                |
          |                                                                 |
  1.5e+08 *+ .*.*.*.*. .*..    *. .*.*. .*.*.*.*. .*.*.*.*..*   *.*. .*.*.*.*
          | *         *        : *     *         *          :   :   *       |
    1e+08 ++               *  :                              : :            |
          |                :  :                              : :            |
          |                 : :                              : :            |
    5e+07 ++                : :                              : :            |
          |                  :                                :             |
        0 ++-----------------*------------------------------O-*-------------+


                                    vmstat.io.bo

  700000 ++-----------------------------------------------------------------+
         |                                                                  |
  600000 ++O O O O      O O     O O O   O  O O   O   O                      |
         O         O  O     O O       O        O   O   O O                  |
  500000 ++                                                                 |
         |                                                                  |
  400000 *+*.*.*.*.*..*.*.*.*.*.*.*.*.*.*..*.*.*.*.*.*.*.*.O   *..*.*.*.*.*.*
         |                                                 :   :            |
  300000 ++                                                 :  :            |
         |                                                  : :             |
  200000 ++                                                 : :             |
         |                                                  : :             |
  100000 ++                                                  ::             |
         |                                                   :              |
       0 ++--------------------------------------------------*--------------+


                                  vmstat.system.in

  350000 ++-----------------------------------------------------------------+
         |                                                                  |
  300000 ++    O                  O     O                                   |
         | O O   O O  O O O O O O   O O    O O O O O O O O                  |
  250000 O+                                                                 |
         |                                                 O                |
  200000 ++                                                                 |
         *. .*.*.*.*.. .*. .*.*. .*.*. .*..*.*.*. .*.*.*.*.*   *..*. .*.*.*.*
  150000 ++*          *   *     *     *          *         :   :    *       |
         |                                                  : :             |
  100000 ++                                                 : :             |
         |                                                  : :             |
   50000 ++                                                 : :             |
         |                                                   :              |
       0 ++--------------------------------------------------*--------------+


                                  vmstat.system.cs

  350000 ++*--------------*-----------*----------*--------------------------+
         |+ +        .*. + +         + +        + +       .*       .*.      |
  300000 *+  *.*.*.*.   *   *.*.*.*.*   *..*.*.*   *.*.*.* :   *..*   *.*.*.*
         |                                                 O   :            |
  250000 O+  O     O  O   O O O       O                    :   :            |
         | O   O O      O       O O O   O  O O O O O O O O  :  :            |
  200000 ++                                                 : :             |
         |                                                  : :             |
  150000 ++                                                 : :             |
         |                                                  : :             |
  100000 ++                                                 : :             |
         |                                                   ::             |
   50000 ++                                                  :              |
         |                                                   :              |
       0 ++--------------------------------------------------*--------------+

	[*] bisect-good sample
	[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Xiaolong

View attachment "config-4.9.0-rc6-00029-g27a23ab" of type "text/plain" (153605 bytes)

View attachment "job-script" of type "text/plain" (6895 bytes)

View attachment "job.yaml" of type "text/plain" (4560 bytes)

View attachment "reproduce" of type "text/plain" (28418 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ