lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Sun, 12 Sep 2021 23:52:28 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Zhang Yi <yi.zhang@...wei.com>
Cc:     Theodore Ts'o <tytso@....edu>, Jan Kara <jack@...e.cz>,
        LKML <linux-kernel@...r.kernel.org>,
        Linux Memory Management List <linux-mm@...ck.org>,
        lkp@...ts.01.org, lkp@...el.com, ying.huang@...el.com,
        feng.tang@...el.com, zhengjun.xing@...ux.intel.com
Subject: [ext4]  cc883236b7:  aim7.jobs-per-min 69.4% improvement



Greeting,

FYI, we noticed a 69.4% improvement of aim7.jobs-per-min due to commit:


commit: cc883236b79297f6266ca6f4e7f24f3fd3c736c1 ("ext4: drop unnecessary journal handle in delalloc write")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master


in testcase: aim7
on test machine: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
with following parameters:

	disk: 4BRD_12G
	md: RAID0
	fs: ext4
	test: disk_rw
	load: 3000
	cpufreq_governor: performance
	ucode: 0x5003006

test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/

In addition to that, the commit also has significant impact on the following tests:

+------------------+---------------------------------------------------------------------------------+
| testcase: change | aim7: aim7.jobs-per-min 83.1% improvement                                       |
| test machine     | 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory |
| test parameters  | cpufreq_governor=performance                                                    |
|                  | disk=4BRD_12G                                                                   |
|                  | fs=ext4                                                                         |
|                  | load=3000                                                                       |
|                  | md=RAID1                                                                        |
|                  | test=disk_rw                                                                    |
|                  | ucode=0x5003006                                                                 |
+------------------+---------------------------------------------------------------------------------+
| testcase: change | aim7: aim7.jobs-per-min 68.6% improvement                                       |
| test machine     | 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory |
| test parameters  | cpufreq_governor=performance                                                    |
|                  | disk=1BRD_48G                                                                   |
|                  | fs=ext4                                                                         |
|                  | load=3000                                                                       |
|                  | test=disk_rw                                                                    |
|                  | ucode=0xd000280                                                                 |
+------------------+---------------------------------------------------------------------------------+




Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml  # generate the yaml file for lkp run
        bin/lkp run                    generated-yaml-file

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/4BRD_12G/ext4/x86_64-rhel-8.3/3000/RAID0/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp9/disk_rw/aim7/0x5003006

commit: 
  6984aef598 ("ext4: factor out write end code of inline file")
  cc883236b7 ("ext4: drop unnecessary journal handle in delalloc write")

6984aef59814fb5c cc883236b79297f6266ca6f4e7f 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     84031           +69.4%     142324 ± 10%  aim7.jobs-per-min
    214.46           -40.2%     128.30 ± 11%  aim7.time.elapsed_time
    214.46           -40.2%     128.30 ± 11%  aim7.time.elapsed_time.max
   1745045 ±  3%     -56.9%     751261 ± 14%  aim7.time.involuntary_context_switches
    227826           -12.0%     200495 ±  2%  aim7.time.minor_page_faults
     17669           -42.4%      10174 ± 12%  aim7.time.system_time
    185912           -35.5%     119833 ± 12%  aim7.time.voluntary_context_switches
    253.24           -33.9%     167.34 ±  8%  uptime.boot
      6.27 ±  2%     +64.2%      10.29 ± 10%  iostat.cpu.idle
     93.31            -4.6%      89.05        iostat.cpu.system
      5.42 ±  2%      +3.6        8.98 ± 10%  mpstat.cpu.all.idle%
      0.03 ±  4%      +0.0        0.05 ±  9%  mpstat.cpu.all.soft%
      0.42 ±  2%      +0.2        0.65 ± 11%  mpstat.cpu.all.usr%
      5.28 ±  8%     +65.5%       8.74 ± 12%  turbostat.CPU%c1
  39514227           -38.5%   24314676 ± 11%  turbostat.IRQ
    209.72            +2.1%     214.03        turbostat.PkgWatt
     58.24            +4.1%      60.65 ±  2%  turbostat.RAMWatt
      6306 ±  2%     +32.9%       8378 ± 10%  vmstat.io.bo
    235.67 ±  3%     -26.2%     174.00 ±  5%  vmstat.procs.r
     10672           -20.9%       8447 ±  2%  vmstat.system.cs
    181822            +2.1%     185699        vmstat.system.in
     45728 ± 87%     -81.4%       8490 ±115%  numa-meminfo.node0.Active
     44135 ± 90%     -84.7%       6753 ±145%  numa-meminfo.node0.Active(anon)
    214827 ± 18%     -47.4%     112949 ± 23%  numa-meminfo.node1.Active
    214412 ± 18%     -47.4%     112749 ± 23%  numa-meminfo.node1.Active(anon)
    248902 ± 19%     -43.8%     139818 ± 28%  numa-meminfo.node1.Shmem
     11057 ± 90%     -84.9%       1673 ±145%  numa-vmstat.node0.nr_active_anon
     11057 ± 90%     -84.9%       1673 ±145%  numa-vmstat.node0.nr_zone_active_anon
     53560 ± 18%     -47.5%      28137 ± 23%  numa-vmstat.node1.nr_active_anon
     62229 ± 19%     -43.9%      34907 ± 28%  numa-vmstat.node1.nr_shmem
     44653 ± 54%     -68.4%      14127 ± 22%  numa-vmstat.node1.nr_written
     53560 ± 18%     -47.5%      28137 ± 23%  numa-vmstat.node1.nr_zone_active_anon
    365566           +17.6%     429985 ±  9%  slabinfo.buffer_head.active_objs
      9615           +17.0%      11250 ±  9%  slabinfo.buffer_head.active_slabs
    375022           +17.0%     438782 ±  9%  slabinfo.buffer_head.num_objs
      9615           +17.0%      11250 ±  9%  slabinfo.buffer_head.num_slabs
    832.17 ±  8%     +26.0%       1048 ± 10%  slabinfo.ext4_allocation_context.active_objs
    832.17 ±  8%     +26.0%       1048 ± 10%  slabinfo.ext4_allocation_context.num_objs
    260004 ±  2%     -53.1%     121893 ± 25%  meminfo.Active
    257996 ±  2%     -53.5%     119954 ± 25%  meminfo.Active(anon)
    158816           -20.4%     126416 ±  7%  meminfo.AnonHugePages
   1422103           +17.2%    1666680 ±  9%  meminfo.Dirty
   1829940           +13.8%    2082407 ±  7%  meminfo.Inactive
   1421940           +17.2%    1666440 ±  9%  meminfo.Inactive(file)
     80986 ±  3%     +15.1%      93190 ±  8%  meminfo.Mapped
    301698 ±  2%     -42.5%     173451 ± 19%  meminfo.Shmem
     64570 ±  2%     -53.5%      30001 ± 25%  proc-vmstat.nr_active_anon
    355378           +17.1%     416259 ±  9%  proc-vmstat.nr_dirty
    101865            +2.1%     103985        proc-vmstat.nr_inactive_anon
    355356           +17.1%     416206 ±  9%  proc-vmstat.nr_inactive_file
     60333            -1.8%      59275        proc-vmstat.nr_kernel_stack
     20124 ±  4%     +16.7%      23476 ±  7%  proc-vmstat.nr_mapped
     27011 ±  4%      -8.9%      24613 ±  4%  proc-vmstat.nr_page_table_pages
     75383 ±  2%     -42.5%      43365 ± 18%  proc-vmstat.nr_shmem
    141415 ±  6%     -49.3%      71729 ±  9%  proc-vmstat.nr_written
     64570 ±  2%     -53.5%      30001 ± 25%  proc-vmstat.nr_zone_active_anon
    101865            +2.1%     103985        proc-vmstat.nr_zone_inactive_anon
    355356           +17.1%     416206 ±  9%  proc-vmstat.nr_zone_inactive_file
    356750           +16.9%     417166 ±  9%  proc-vmstat.nr_zone_write_pending
     82578 ±  3%     -36.5%      52451 ± 19%  proc-vmstat.numa_hint_faults
     49387 ±  9%     -43.6%      27869 ± 33%  proc-vmstat.numa_hint_faults_local
     39256 ± 20%     -30.6%      27262 ± 23%  proc-vmstat.numa_pages_migrated
    232761 ±  6%     -27.1%     169589 ± 11%  proc-vmstat.numa_pte_updates
   1026316           -22.1%     799210 ±  4%  proc-vmstat.pgfault
     39256 ± 20%     -30.6%      27262 ± 23%  proc-vmstat.pgmigrate_success
   1371564 ±  2%     -20.8%    1086294 ±  2%  proc-vmstat.pgpgout
     53581 ±  2%     -33.5%      35634 ±  8%  proc-vmstat.pgreuse
     10524 ±  7%     -27.8%       7596 ±  5%  softirqs.CPU0.RCU
      8512 ±  9%     -28.7%       6072 ±  8%  softirqs.CPU10.RCU
      8964 ± 18%     -38.0%       5555 ± 12%  softirqs.CPU12.RCU
      6385 ± 26%     -27.6%       4622 ±  8%  softirqs.CPU18.SCHED
      9340 ± 16%     -42.5%       5372 ± 11%  softirqs.CPU20.RCU
      8995 ±  8%     -36.7%       5692 ±  7%  softirqs.CPU22.RCU
      8573 ±  9%     -39.4%       5195 ±  8%  softirqs.CPU26.RCU
      8932 ± 10%     -41.8%       5200 ±  9%  softirqs.CPU30.RCU
      8698 ± 10%     -40.0%       5222 ± 11%  softirqs.CPU32.RCU
      8598 ± 10%     -38.0%       5335 ± 12%  softirqs.CPU37.RCU
      8730 ± 13%     -38.4%       5376 ±  9%  softirqs.CPU39.RCU
      8861 ± 15%     -40.1%       5307 ± 10%  softirqs.CPU40.RCU
      8754 ± 12%     -32.5%       5908 ± 18%  softirqs.CPU57.RCU
      8620 ±  8%     -39.5%       5218 ±  9%  softirqs.CPU66.RCU
      9140 ± 20%     -41.4%       5353 ±  7%  softirqs.CPU7.RCU
      8521 ± 12%     -39.3%       5174 ± 13%  softirqs.CPU79.RCU
      8213 ± 12%     -39.8%       4945 ± 10%  softirqs.CPU85.RCU
      8471 ± 16%     -36.8%       5352 ±  6%  softirqs.CPU87.RCU
    747464 ±  6%     -34.9%     486676 ±  7%  softirqs.RCU
    490039           -16.0%     411771 ±  3%  softirqs.SCHED
     43647           -32.7%      29392 ±  8%  softirqs.TIMER
 3.105e+09           +48.0%  4.595e+09 ± 10%  perf-stat.i.branch-instructions
  21161802           +46.5%   30992355 ±  8%  perf-stat.i.branch-misses
  76855682           +39.9%  1.075e+08 ± 32%  perf-stat.i.cache-misses
 2.273e+08           +41.0%  3.206e+08 ± 30%  perf-stat.i.cache-references
     10701           -21.7%       8375 ±  2%  perf-stat.i.context-switches
     14.25           -35.5%       9.19 ± 12%  perf-stat.i.cpi
  2.32e+11            -4.0%  2.227e+11        perf-stat.i.cpu-cycles
 4.837e+09           +46.7%  7.094e+09 ± 10%  perf-stat.i.dTLB-loads
     53942 ±  6%     +25.8%      67839 ± 10%  perf-stat.i.dTLB-store-misses
 2.553e+09           +47.1%  3.757e+09 ± 10%  perf-stat.i.dTLB-stores
     96.08            -1.5       94.54        perf-stat.i.iTLB-load-miss-rate%
  17793060 ±  2%     +23.4%   21959165 ±  9%  perf-stat.i.iTLB-load-misses
 1.579e+10           +48.1%  2.339e+10 ± 10%  perf-stat.i.instructions
    998.65 ±  2%     +23.2%       1230 ±  5%  perf-stat.i.instructions-per-iTLB-miss
      0.09 ±  4%     +54.0%       0.14 ± 12%  perf-stat.i.ipc
      2.64            -3.9%       2.53        perf-stat.i.metric.GHz
    232.58 ±  4%     +41.5%     329.21 ± 18%  perf-stat.i.metric.K/sec
    121.77           +47.2%     179.19 ±  9%  perf-stat.i.metric.M/sec
      4377           +26.3%       5527 ±  5%  perf-stat.i.minor-faults
   7960108 ±  3%     +66.9%   13285764 ± 41%  perf-stat.i.node-load-misses
   2695393           +33.0%    3585635 ± 19%  perf-stat.i.node-loads
     66.20            -3.9       62.25 ±  2%  perf-stat.i.node-store-miss-rate%
   5733707           +11.2%    6373577        perf-stat.i.node-store-misses
   2794313           +29.4%    3615704 ±  5%  perf-stat.i.node-stores
      4380           +26.3%       5532 ±  5%  perf-stat.i.page-faults
     14.72           -34.4%       9.65 ± 12%  perf-stat.overall.cpi
      3024 ±  2%     -25.3%       2257 ± 25%  perf-stat.overall.cycles-between-cache-misses
      0.01 ±  9%      -0.0        0.01 ± 13%  perf-stat.overall.dTLB-load-miss-rate%
    887.77 ±  2%     +20.0%       1064        perf-stat.overall.instructions-per-iTLB-miss
      0.07           +54.6%       0.11 ± 11%  perf-stat.overall.ipc
     67.32            -3.5       63.85 ±  2%  perf-stat.overall.node-store-miss-rate%
 3.087e+09           +47.9%  4.565e+09 ± 10%  perf-stat.ps.branch-instructions
  20985417           +46.4%   30715739 ±  8%  perf-stat.ps.branch-misses
  76408104 ±  2%     +39.9%  1.069e+08 ± 32%  perf-stat.ps.cache-misses
 2.259e+08           +41.2%  3.189e+08 ± 30%  perf-stat.ps.cache-references
     10625           -21.7%       8317 ±  2%  perf-stat.ps.context-switches
 2.309e+11            -4.1%  2.215e+11        perf-stat.ps.cpu-cycles
 4.809e+09           +46.6%   7.05e+09 ± 10%  perf-stat.ps.dTLB-loads
     53845 ±  6%     +25.9%      67809 ± 10%  perf-stat.ps.dTLB-store-misses
 2.538e+09           +47.1%  3.733e+09 ± 10%  perf-stat.ps.dTLB-stores
  17689529 ±  2%     +23.4%   21821765 ±  9%  perf-stat.ps.iTLB-load-misses
  1.57e+10           +48.1%  2.324e+10 ± 10%  perf-stat.ps.instructions
      4321           +25.5%       5421 ±  5%  perf-stat.ps.minor-faults
   7920594 ±  3%     +66.8%   13213742 ± 41%  perf-stat.ps.node-load-misses
   2675733           +33.2%    3564890 ± 19%  perf-stat.ps.node-loads
   5723821           +10.8%    6341623        perf-stat.ps.node-store-misses
   2778550           +29.3%    3593821 ±  5%  perf-stat.ps.node-stores
      4324           +25.5%       5426 ±  5%  perf-stat.ps.page-faults
 3.382e+12           -12.6%  2.956e+12        perf-stat.total.instructions
      0.05 ± 68%    +305.6%       0.20 ± 26%  perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      0.10 ± 24%    +183.6%       0.27 ±108%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      0.11 ±  7%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.11 ± 19%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      0.10 ±  7%    +108.1%       0.20 ± 84%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      1.53 ± 27%     -52.2%       0.73 ± 38%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
      0.19 ± 12%    +160.6%       0.50 ± 97%  perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      0.01 ±153%   +4997.8%       0.39 ±163%  perf-sched.sch_delay.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.__fdget_pos
      4.77 ± 91%    +717.0%      38.97 ± 69%  perf-sched.sch_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
     12.93 ± 44%     -32.2%       8.76 ± 15%  perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
     38.66 ±136%   +3457.9%       1375 ± 95%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
     57.56 ± 34%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
     28.25 ± 46%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      7.94 ± 13%     +69.5%      13.47 ± 36%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
     31.00 ± 28%     -69.0%       9.60 ± 52%  perf-sched.sch_delay.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_del
      0.13 ±  6%     +60.4%       0.21 ± 39%  perf-sched.total_sch_delay.average.ms
    200.26 ±  6%     +18.2%     236.62 ±  8%  perf-sched.total_wait_and_delay.average.ms
    110701 ±  6%     -22.2%      86145 ±  3%  perf-sched.total_wait_and_delay.count.ms
    200.13 ±  6%     +18.1%     236.40 ±  8%  perf-sched.total_wait_time.average.ms
    199.49 ±  7%     +36.1%     271.57 ± 10%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
    171.08 ±  9%     +54.1%     263.72 ±  7%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
    153.91 ± 73%     +70.2%     261.99 ±  9%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
     78.75 ±143%    +269.7%     291.10 ± 10%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
    216.05 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
    196.87 ±  9%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
    207.27 ± 11%     +29.7%     268.74 ±  9%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
    213.62 ±  7%     +15.2%     246.02 ±  7%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
    108.77 ±100%    +150.9%     272.90 ± 12%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
    212.85 ± 10%     +34.7%     286.80 ± 10%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
     65.92 ±  9%    +391.0%     323.66 ± 23%  perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
    723.47           -28.0%     520.55 ± 24%  perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork
    233.00 ±  3%    +245.2%     804.33 ± 47%  perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      2519 ± 12%     +66.2%       4187 ± 26%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      1485 ± 17%   +1959.5%      30600 ± 14%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
    245.17 ± 71%    +430.3%       1300 ± 31%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
    128.50 ±143%    +258.4%     460.50 ± 15%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
     51136 ±  8%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      1615 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
     20831 ±  4%     -43.4%      11791 ± 17%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     81.67 ±101%   +1016.1%     911.50 ± 13%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
      2605 ± 18%     -29.7%       1831 ± 23%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
     37.17 ± 20%     -63.7%      13.50 ± 53%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
      3996 ±  3%     +43.0%       5716 ±  9%  perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1126 ±  2%     +48.1%       1668 ± 21%  perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
      3977 ±  3%     -26.0%       2945 ± 11%  perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4002 ±  3%     -24.7%       3013 ± 12%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      4036 ±  5%     -25.4%       3012 ± 11%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      3835 ±  4%     -70.3%       1139 ±141%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
      4044 ±  3%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      3977 ±  3%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      3993 ±  3%     -24.1%       3031 ± 13%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      4049 ±  4%     -25.9%       3001 ± 11%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      3989 ±  3%     -25.4%       2975 ± 10%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
      3925 ±  4%     -24.6%       2961 ± 12%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      3728 ±  5%     -38.6%       2290 ± 46%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
      3967 ±  4%     -26.3%       2923 ± 10%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
      3987 ±  4%     -25.8%       2956 ± 10%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      3965 ±  4%     -25.3%       2964 ± 10%  perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3986 ±  3%     -25.0%       2990 ± 11%  perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
    147.97 ± 20%    +102.0%     298.85 ± 17%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__alloc_pages.pagecache_get_page.grab_cache_page_write_begin
    199.39 ±  7%     +36.1%     271.30 ± 10%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
    316.30 ±206%     -95.6%      13.77 ± 17%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_orphan_add.__ext4_unlink
    170.98 ±  9%     +54.1%     263.51 ±  7%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
    206.10 ± 22%     +27.1%     261.86 ±  9%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
     24.03 ± 18%    +693.0%     190.60 ±112%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.block_invalidatepage.truncate_cleanup_page.truncate_inode_pages_range
    186.43 ± 24%     +56.1%     290.97 ± 10%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
     22.48 ± 30%     -39.0%      13.70 ± 29%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_write.vfs_unlink.do_unlinkat
    215.93 ±  7%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
    196.76 ±  9%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
    207.16 ± 11%     +29.6%     268.44 ±  9%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
    213.52 ±  7%     +15.1%     245.82 ±  7%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
    186.06 ± 19%     +46.6%     272.76 ± 12%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
    212.76 ± 10%     +34.7%     286.68 ± 10%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
     21.62 ± 21%   +1163.2%     273.08 ± 92%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.truncate_inode_pages_range.ext4_evict_inode.evict
     65.73 ± 10%    +391.6%     323.16 ± 23%  perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
     30.01 ± 60%    +756.1%     256.96 ± 20%  perf-sched.wait_time.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.__fdget_pos
     18.37 ± 27%    +909.3%     185.43 ± 49%  perf-sched.wait_time.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_del
    723.45           -28.0%     520.53 ± 24%  perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork
      3865 ±  4%     -24.0%       2937 ± 11%  perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      3977 ±  3%     -26.0%       2943 ± 11%  perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3754 ±  5%     -21.4%       2951 ± 11%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__alloc_pages.pagecache_get_page.grab_cache_page_write_begin
      3999 ±  3%     -25.3%       2986 ± 11%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      4008 ±  4%     -25.5%       2986 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      3923 ±  4%     -24.5%       2960 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
      3974 ±  3%     -26.0%       2939 ± 11%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
      3834 ±  4%     -23.6%       2931 ± 11%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
      4038 ±  3%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      3975 ±  3%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      3993 ±  3%     -25.0%       2993 ± 11%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      4039 ±  3%     -26.2%       2980 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      3799 ±  6%     -22.5%       2945 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
      3988 ±  3%     -25.5%       2973 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
      3924 ±  4%     -25.0%       2944 ± 12%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      3725 ±  5%     -23.7%       2844 ± 12%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
      3964 ±  4%     -26.3%       2921 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
      3957 ±  4%     -25.9%       2934 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      3982 ±  4%     -26.0%       2948 ± 10%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      2.82 ±197%   +6434.8%     184.16 ±198%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas
      3958 ±  4%     -25.5%       2950 ± 10%  perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3980 ±  3%     -25.1%       2980 ± 11%  perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      3603 ±  3%     -35.9%       2310 ± 45%  perf-sched.wait_time.max.ms.wait_transaction_locked.add_transaction_credits.start_this_handle.jbd2__journal_start
    431.67           -39.8%     260.00 ± 11%  interrupts.9:IO-APIC.9-fasteoi.acpi
    128222           -24.9%      96337 ±  8%  interrupts.CAL:Function_call_interrupts
    431875           -39.9%     259448 ± 11%  interrupts.CPU0.LOC:Local_timer_interrupts
      1603 ± 24%     -42.9%     915.67 ± 16%  interrupts.CPU0.RES:Rescheduling_interrupts
    431.67           -39.8%     260.00 ± 11%  interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
    431877           -40.0%     259291 ± 11%  interrupts.CPU1.LOC:Local_timer_interrupts
    988.50 ± 11%     -31.9%     673.33 ± 18%  interrupts.CPU1.RES:Rescheduling_interrupts
      1360 ±  5%     -25.5%       1013 ±  8%  interrupts.CPU10.CAL:Function_call_interrupts
    431881           -39.9%     259379 ± 11%  interrupts.CPU10.LOC:Local_timer_interrupts
      1382 ± 12%     -25.7%       1027 ± 11%  interrupts.CPU11.CAL:Function_call_interrupts
    431872           -39.9%     259376 ± 11%  interrupts.CPU11.LOC:Local_timer_interrupts
    431840           -39.9%     259335 ± 11%  interrupts.CPU12.LOC:Local_timer_interrupts
      1473 ± 15%     -30.8%       1020 ±  8%  interrupts.CPU13.CAL:Function_call_interrupts
    431756           -39.9%     259376 ± 11%  interrupts.CPU13.LOC:Local_timer_interrupts
      1220 ± 32%     -41.7%     711.83 ± 20%  interrupts.CPU13.RES:Rescheduling_interrupts
      1508 ± 11%     -27.0%       1101 ± 16%  interrupts.CPU14.CAL:Function_call_interrupts
    431818           -39.9%     259356 ± 11%  interrupts.CPU14.LOC:Local_timer_interrupts
    431770           -40.0%     259240 ± 11%  interrupts.CPU15.LOC:Local_timer_interrupts
      1114 ± 23%     -38.0%     690.50 ± 23%  interrupts.CPU15.RES:Rescheduling_interrupts
      1357 ±  6%     -25.7%       1009 ±  9%  interrupts.CPU16.CAL:Function_call_interrupts
    431775           -39.9%     259412 ± 11%  interrupts.CPU16.LOC:Local_timer_interrupts
    977.83 ± 10%     -23.7%     746.17 ± 24%  interrupts.CPU16.RES:Rescheduling_interrupts
    431836           -40.0%     259301 ± 11%  interrupts.CPU17.LOC:Local_timer_interrupts
      1565 ± 23%     -30.6%       1086 ± 14%  interrupts.CPU18.CAL:Function_call_interrupts
    431843           -39.9%     259337 ± 11%  interrupts.CPU18.LOC:Local_timer_interrupts
      1343 ±  7%     -23.3%       1030 ± 12%  interrupts.CPU19.CAL:Function_call_interrupts
    431744           -39.9%     259358 ± 11%  interrupts.CPU19.LOC:Local_timer_interrupts
    996.67 ± 11%     -25.7%     741.00 ± 16%  interrupts.CPU19.RES:Rescheduling_interrupts
    431763           -40.0%     259273 ± 11%  interrupts.CPU2.LOC:Local_timer_interrupts
      1363 ±  4%     -26.5%       1002 ±  7%  interrupts.CPU20.CAL:Function_call_interrupts
    431832           -39.9%     259387 ± 11%  interrupts.CPU20.LOC:Local_timer_interrupts
      1077 ± 24%     -36.3%     686.50 ± 20%  interrupts.CPU20.RES:Rescheduling_interrupts
      1387 ±  5%     -27.9%       1000 ±  7%  interrupts.CPU21.CAL:Function_call_interrupts
    431837           -39.9%     259348 ± 11%  interrupts.CPU21.LOC:Local_timer_interrupts
      1068 ± 13%     -34.8%     696.00 ± 16%  interrupts.CPU21.RES:Rescheduling_interrupts
      1505 ±  4%     -21.6%       1179 ± 11%  interrupts.CPU22.CAL:Function_call_interrupts
    432173           -40.0%     259359 ± 11%  interrupts.CPU22.LOC:Local_timer_interrupts
      1602 ± 17%     -43.0%     913.00 ± 16%  interrupts.CPU22.RES:Rescheduling_interrupts
      1899 ± 46%     -37.4%       1189 ± 10%  interrupts.CPU23.CAL:Function_call_interrupts
    431859           -39.9%     259338 ± 11%  interrupts.CPU23.LOC:Local_timer_interrupts
      1170 ± 10%     -43.4%     662.00 ± 19%  interrupts.CPU23.RES:Rescheduling_interrupts
      1587 ±  6%     -26.2%       1171 ± 10%  interrupts.CPU24.CAL:Function_call_interrupts
    431887           -39.9%     259354 ± 11%  interrupts.CPU24.LOC:Local_timer_interrupts
      1221 ± 18%     -44.8%     673.50 ± 20%  interrupts.CPU24.RES:Rescheduling_interrupts
      1605 ± 10%     -28.2%       1153 ± 10%  interrupts.CPU25.CAL:Function_call_interrupts
    431849           -39.9%     259350 ± 11%  interrupts.CPU25.LOC:Local_timer_interrupts
      1167 ± 12%     -43.1%     664.00 ± 14%  interrupts.CPU25.RES:Rescheduling_interrupts
    431842           -39.9%     259348 ± 11%  interrupts.CPU26.LOC:Local_timer_interrupts
      1108 ±  8%     -40.4%     660.83 ± 19%  interrupts.CPU26.RES:Rescheduling_interrupts
    431849           -40.0%     259296 ± 11%  interrupts.CPU27.LOC:Local_timer_interrupts
      1337 ± 41%     -49.9%     669.50 ± 24%  interrupts.CPU27.RES:Rescheduling_interrupts
      1489 ±  6%     -22.4%       1155 ± 12%  interrupts.CPU28.CAL:Function_call_interrupts
    431854           -40.0%     259292 ± 11%  interrupts.CPU28.LOC:Local_timer_interrupts
      1245 ±  7%     -48.1%     646.17 ± 21%  interrupts.CPU28.RES:Rescheduling_interrupts
    431842           -39.9%     259368 ± 11%  interrupts.CPU29.LOC:Local_timer_interrupts
      1126 ± 11%     -40.2%     673.83 ± 19%  interrupts.CPU29.RES:Rescheduling_interrupts
    431731           -39.9%     259367 ± 11%  interrupts.CPU3.LOC:Local_timer_interrupts
      1324 ± 29%     -42.3%     763.67 ± 19%  interrupts.CPU3.RES:Rescheduling_interrupts
      1542 ± 13%     -29.8%       1082 ± 10%  interrupts.CPU30.CAL:Function_call_interrupts
    431737           -39.9%     259318 ± 11%  interrupts.CPU30.LOC:Local_timer_interrupts
      1131 ±  8%     -36.3%     720.83 ± 27%  interrupts.CPU30.RES:Rescheduling_interrupts
      1475 ±  7%     -25.9%       1093 ±  8%  interrupts.CPU31.CAL:Function_call_interrupts
    431814           -39.9%     259336 ± 11%  interrupts.CPU31.LOC:Local_timer_interrupts
      1150 ± 10%     -44.9%     633.83 ± 20%  interrupts.CPU31.RES:Rescheduling_interrupts
      1490 ±  3%     -26.2%       1100 ± 12%  interrupts.CPU32.CAL:Function_call_interrupts
    431821           -39.9%     259334 ± 11%  interrupts.CPU32.LOC:Local_timer_interrupts
      1312 ± 22%     -47.6%     687.83 ± 26%  interrupts.CPU32.RES:Rescheduling_interrupts
      1566 ±  8%     -32.1%       1063 ± 11%  interrupts.CPU33.CAL:Function_call_interrupts
    431723           -39.9%     259333 ± 11%  interrupts.CPU33.LOC:Local_timer_interrupts
      1148 ±  5%     -44.0%     643.33 ± 18%  interrupts.CPU33.RES:Rescheduling_interrupts
      1457 ±  3%     -27.3%       1058 ± 11%  interrupts.CPU34.CAL:Function_call_interrupts
    431853           -39.9%     259378 ± 11%  interrupts.CPU34.LOC:Local_timer_interrupts
      1151 ±  7%     -45.0%     633.00 ± 19%  interrupts.CPU34.RES:Rescheduling_interrupts
      1523 ±  9%     -29.3%       1076 ±  9%  interrupts.CPU35.CAL:Function_call_interrupts
    431869           -39.9%     259449 ± 11%  interrupts.CPU35.LOC:Local_timer_interrupts
      1168 ±  8%     -45.5%     637.17 ± 19%  interrupts.CPU35.RES:Rescheduling_interrupts
      1433 ±  5%     -22.9%       1104 ± 11%  interrupts.CPU36.CAL:Function_call_interrupts
    431816           -39.9%     259307 ± 11%  interrupts.CPU36.LOC:Local_timer_interrupts
      1126 ±  7%     -40.6%     669.00 ± 17%  interrupts.CPU36.RES:Rescheduling_interrupts
      1437 ±  4%     -24.0%       1092 ±  9%  interrupts.CPU37.CAL:Function_call_interrupts
    431814           -40.0%     259223 ± 11%  interrupts.CPU37.LOC:Local_timer_interrupts
      1142 ±  9%     -40.9%     675.50 ± 21%  interrupts.CPU37.RES:Rescheduling_interrupts
      1425 ±  6%     -25.3%       1064 ± 10%  interrupts.CPU38.CAL:Function_call_interrupts
    431866           -39.9%     259339 ± 11%  interrupts.CPU38.LOC:Local_timer_interrupts
      1129 ±  8%     -42.6%     648.00 ± 18%  interrupts.CPU38.RES:Rescheduling_interrupts
      1454 ±  2%     -24.6%       1097 ± 10%  interrupts.CPU39.CAL:Function_call_interrupts
    431824           -39.9%     259327 ± 11%  interrupts.CPU39.LOC:Local_timer_interrupts
      1205 ±  9%     -42.1%     698.00 ± 17%  interrupts.CPU39.RES:Rescheduling_interrupts
      1386 ±  6%     -28.0%     998.83 ±  7%  interrupts.CPU4.CAL:Function_call_interrupts
    431867           -39.9%     259374 ± 11%  interrupts.CPU4.LOC:Local_timer_interrupts
    980.17 ± 10%     -27.3%     712.67 ± 22%  interrupts.CPU4.RES:Rescheduling_interrupts
      1428 ±  3%     -25.6%       1063 ±  7%  interrupts.CPU40.CAL:Function_call_interrupts
    431805           -39.9%     259456 ± 11%  interrupts.CPU40.LOC:Local_timer_interrupts
      1136 ±  9%     -40.7%     673.83 ± 17%  interrupts.CPU40.RES:Rescheduling_interrupts
      1414 ±  4%     -25.2%       1058 ±  8%  interrupts.CPU41.CAL:Function_call_interrupts
    431826           -40.0%     259293 ± 11%  interrupts.CPU41.LOC:Local_timer_interrupts
      1159 ± 12%     -44.5%     644.00 ± 20%  interrupts.CPU41.RES:Rescheduling_interrupts
      1430 ±  3%     -24.1%       1086 ±  9%  interrupts.CPU42.CAL:Function_call_interrupts
    431845           -40.0%     259276 ± 11%  interrupts.CPU42.LOC:Local_timer_interrupts
      1130 ±  8%     -40.2%     675.50 ± 19%  interrupts.CPU42.RES:Rescheduling_interrupts
      2631 ±  4%     -33.8%       1741 ± 11%  interrupts.CPU43.CAL:Function_call_interrupts
    431805           -39.9%     259337 ± 11%  interrupts.CPU43.LOC:Local_timer_interrupts
      2223 ±  5%     -44.2%       1240 ± 24%  interrupts.CPU43.RES:Rescheduling_interrupts
      1410 ±  4%     -26.8%       1032 ± 11%  interrupts.CPU44.CAL:Function_call_interrupts
    431828           -39.9%     259337 ± 11%  interrupts.CPU44.LOC:Local_timer_interrupts
      1358 ±  5%     -25.5%       1011 ±  9%  interrupts.CPU45.CAL:Function_call_interrupts
    431863           -40.0%     259256 ± 11%  interrupts.CPU45.LOC:Local_timer_interrupts
    978.50 ± 10%     -31.1%     674.67 ± 21%  interrupts.CPU45.RES:Rescheduling_interrupts
      1398 ±  7%     -27.3%       1017 ±  9%  interrupts.CPU46.CAL:Function_call_interrupts
    431875           -40.0%     259332 ± 11%  interrupts.CPU46.LOC:Local_timer_interrupts
      1312 ±  5%     -24.5%     990.50 ±  9%  interrupts.CPU47.CAL:Function_call_interrupts
    431979           -40.0%     259310 ± 11%  interrupts.CPU47.LOC:Local_timer_interrupts
      1360 ±  5%     -26.4%       1001 ±  7%  interrupts.CPU48.CAL:Function_call_interrupts
    431853           -40.0%     259302 ± 11%  interrupts.CPU48.LOC:Local_timer_interrupts
      1016 ± 12%     -32.8%     683.00 ± 18%  interrupts.CPU48.RES:Rescheduling_interrupts
      1333 ±  5%     -25.0%     999.67 ± 10%  interrupts.CPU49.CAL:Function_call_interrupts
    431862           -40.0%     259330 ± 11%  interrupts.CPU49.LOC:Local_timer_interrupts
      1699 ± 26%     -36.6%       1077 ± 13%  interrupts.CPU5.CAL:Function_call_interrupts
    431815           -39.9%     259381 ± 11%  interrupts.CPU5.LOC:Local_timer_interrupts
      1344 ±  6%     -27.0%     980.83 ±  6%  interrupts.CPU50.CAL:Function_call_interrupts
    431860           -40.0%     259272 ± 11%  interrupts.CPU50.LOC:Local_timer_interrupts
      1340 ±  4%     -23.9%       1020 ±  7%  interrupts.CPU51.CAL:Function_call_interrupts
    431865           -40.0%     259303 ± 11%  interrupts.CPU51.LOC:Local_timer_interrupts
      1336 ±  5%     -24.6%       1007 ±  8%  interrupts.CPU52.CAL:Function_call_interrupts
    431855           -40.0%     259321 ± 11%  interrupts.CPU52.LOC:Local_timer_interrupts
      1377 ±  5%     -23.5%       1053 ±  9%  interrupts.CPU53.CAL:Function_call_interrupts
    431866           -40.0%     259333 ± 11%  interrupts.CPU53.LOC:Local_timer_interrupts
      1332 ±  5%     -19.0%       1078 ± 13%  interrupts.CPU54.CAL:Function_call_interrupts
    431964           -40.0%     259367 ± 11%  interrupts.CPU54.LOC:Local_timer_interrupts
      1337 ±  5%     -23.3%       1025 ±  8%  interrupts.CPU55.CAL:Function_call_interrupts
    431840           -39.9%     259339 ± 11%  interrupts.CPU55.LOC:Local_timer_interrupts
      1368 ±  6%     -22.3%       1063 ± 12%  interrupts.CPU56.CAL:Function_call_interrupts
    431846           -39.9%     259338 ± 11%  interrupts.CPU56.LOC:Local_timer_interrupts
      1349 ±  5%     -22.8%       1041 ±  7%  interrupts.CPU57.CAL:Function_call_interrupts
    431936           -40.0%     259285 ± 11%  interrupts.CPU57.LOC:Local_timer_interrupts
      1359 ±  8%     -24.2%       1029 ± 10%  interrupts.CPU58.CAL:Function_call_interrupts
    431873           -39.9%     259371 ± 11%  interrupts.CPU58.LOC:Local_timer_interrupts
      1367 ±  4%     -26.4%       1006 ±  7%  interrupts.CPU59.CAL:Function_call_interrupts
    431796           -40.0%     259062 ± 11%  interrupts.CPU59.LOC:Local_timer_interrupts
    978.33 ± 12%     -29.9%     686.00 ± 19%  interrupts.CPU59.RES:Rescheduling_interrupts
      1365 ±  7%     -25.8%       1013 ±  7%  interrupts.CPU6.CAL:Function_call_interrupts
    431773           -39.9%     259370 ± 11%  interrupts.CPU6.LOC:Local_timer_interrupts
    431856           -39.9%     259475 ± 11%  interrupts.CPU60.LOC:Local_timer_interrupts
      1354 ±  4%     -21.1%       1068 ±  8%  interrupts.CPU61.CAL:Function_call_interrupts
    431874           -39.9%     259349 ± 11%  interrupts.CPU61.LOC:Local_timer_interrupts
      1378 ±  8%     -23.5%       1054 ± 11%  interrupts.CPU62.CAL:Function_call_interrupts
    431856           -39.9%     259409 ± 11%  interrupts.CPU62.LOC:Local_timer_interrupts
      1358 ±  7%     -23.9%       1034 ±  7%  interrupts.CPU63.CAL:Function_call_interrupts
    432006           -40.0%     259363 ± 11%  interrupts.CPU63.LOC:Local_timer_interrupts
      1322 ±  4%     -23.1%       1016 ± 10%  interrupts.CPU64.CAL:Function_call_interrupts
    431868           -39.9%     259390 ± 11%  interrupts.CPU64.LOC:Local_timer_interrupts
      1388 ± 12%     -26.8%       1016 ±  7%  interrupts.CPU65.CAL:Function_call_interrupts
    431870           -39.9%     259468 ± 11%  interrupts.CPU65.LOC:Local_timer_interrupts
      1409 ±  2%     -23.0%       1084 ± 10%  interrupts.CPU66.CAL:Function_call_interrupts
    431808           -39.9%     259395 ± 11%  interrupts.CPU66.LOC:Local_timer_interrupts
      1431 ±  6%     -27.6%       1035 ±  8%  interrupts.CPU67.CAL:Function_call_interrupts
    431834           -39.9%     259334 ± 11%  interrupts.CPU67.LOC:Local_timer_interrupts
      1212 ± 11%     -46.9%     644.17 ± 20%  interrupts.CPU67.RES:Rescheduling_interrupts
      1466 ±  6%     -26.8%       1073 ±  7%  interrupts.CPU68.CAL:Function_call_interrupts
    431862           -39.9%     259338 ± 11%  interrupts.CPU68.LOC:Local_timer_interrupts
      1161 ± 11%     -44.0%     650.17 ± 18%  interrupts.CPU68.RES:Rescheduling_interrupts
      1466 ±  4%     -26.3%       1081 ± 12%  interrupts.CPU69.CAL:Function_call_interrupts
    431845           -39.9%     259328 ± 11%  interrupts.CPU69.LOC:Local_timer_interrupts
      1447 ± 10%     -26.2%       1067 ±  9%  interrupts.CPU7.CAL:Function_call_interrupts
    431853           -40.0%     259295 ± 11%  interrupts.CPU7.LOC:Local_timer_interrupts
    999.67 ± 10%     -28.3%     716.67 ± 18%  interrupts.CPU7.RES:Rescheduling_interrupts
      1435 ±  3%     -25.7%       1066 ±  8%  interrupts.CPU70.CAL:Function_call_interrupts
    431854           -39.9%     259378 ± 11%  interrupts.CPU70.LOC:Local_timer_interrupts
      1099 ±  9%     -40.0%     659.50 ± 17%  interrupts.CPU70.RES:Rescheduling_interrupts
      1439 ±  5%     -26.8%       1054 ± 11%  interrupts.CPU71.CAL:Function_call_interrupts
    431844           -39.9%     259368 ± 11%  interrupts.CPU71.LOC:Local_timer_interrupts
      1287 ± 25%     -48.9%     658.17 ± 25%  interrupts.CPU71.RES:Rescheduling_interrupts
      1463 ±  7%     -26.2%       1079 ± 11%  interrupts.CPU72.CAL:Function_call_interrupts
    431901           -39.9%     259432 ± 11%  interrupts.CPU72.LOC:Local_timer_interrupts
      1501 ±  5%     -30.7%       1040 ±  9%  interrupts.CPU73.CAL:Function_call_interrupts
    431860           -39.9%     259391 ± 11%  interrupts.CPU73.LOC:Local_timer_interrupts
      1326 ± 30%     -51.3%     645.33 ± 21%  interrupts.CPU73.RES:Rescheduling_interrupts
      1417 ±  4%     -25.0%       1063 ±  9%  interrupts.CPU74.CAL:Function_call_interrupts
    431918           -40.0%     259366 ± 11%  interrupts.CPU74.LOC:Local_timer_interrupts
      1166 ±  2%     -45.5%     635.83 ± 19%  interrupts.CPU74.RES:Rescheduling_interrupts
      1435 ±  4%     -24.3%       1086 ±  8%  interrupts.CPU75.CAL:Function_call_interrupts
    431840           -39.9%     259375 ± 11%  interrupts.CPU75.LOC:Local_timer_interrupts
      1160 ± 10%     -42.3%     669.83 ± 16%  interrupts.CPU75.RES:Rescheduling_interrupts
      1439 ±  7%     -28.2%       1034 ± 14%  interrupts.CPU76.CAL:Function_call_interrupts
    431877           -39.9%     259429 ± 11%  interrupts.CPU76.LOC:Local_timer_interrupts
      1192 ± 17%     -44.4%     662.67 ± 24%  interrupts.CPU76.RES:Rescheduling_interrupts
      1390 ±  7%     -22.6%       1076 ±  8%  interrupts.CPU77.CAL:Function_call_interrupts
    431865           -39.9%     259384 ± 11%  interrupts.CPU77.LOC:Local_timer_interrupts
      1148 ± 14%     -41.6%     671.33 ± 15%  interrupts.CPU77.RES:Rescheduling_interrupts
      1433 ±  4%     -27.4%       1041 ±  9%  interrupts.CPU78.CAL:Function_call_interrupts
    431846           -39.9%     259379 ± 11%  interrupts.CPU78.LOC:Local_timer_interrupts
      1122 ±  7%     -42.9%     640.67 ± 19%  interrupts.CPU78.RES:Rescheduling_interrupts
      1466 ±  5%     -27.4%       1063 ±  9%  interrupts.CPU79.CAL:Function_call_interrupts
    431821           -39.9%     259374 ± 11%  interrupts.CPU79.LOC:Local_timer_interrupts
      1213 ± 11%     -47.7%     634.33 ± 20%  interrupts.CPU79.RES:Rescheduling_interrupts
      1884 ± 27%     -45.8%       1021 ± 10%  interrupts.CPU8.CAL:Function_call_interrupts
    431809           -39.9%     259341 ± 11%  interrupts.CPU8.LOC:Local_timer_interrupts
      1431 ±  7%     -24.3%       1083 ±  7%  interrupts.CPU80.CAL:Function_call_interrupts
    431854           -39.9%     259376 ± 11%  interrupts.CPU80.LOC:Local_timer_interrupts
      1148 ± 12%     -44.2%     641.00 ± 14%  interrupts.CPU80.RES:Rescheduling_interrupts
      1417 ±  5%     -25.6%       1054 ± 11%  interrupts.CPU81.CAL:Function_call_interrupts
    431830           -39.9%     259388 ± 11%  interrupts.CPU81.LOC:Local_timer_interrupts
      1098 ±  6%     -41.2%     645.67 ± 25%  interrupts.CPU81.RES:Rescheduling_interrupts
      1475 ± 10%     -28.4%       1056 ± 10%  interrupts.CPU82.CAL:Function_call_interrupts
    431878           -39.9%     259370 ± 11%  interrupts.CPU82.LOC:Local_timer_interrupts
      1272 ± 27%     -48.4%     656.33 ± 18%  interrupts.CPU82.RES:Rescheduling_interrupts
      1415 ±  4%     -23.4%       1084 ±  8%  interrupts.CPU83.CAL:Function_call_interrupts
    431859           -39.9%     259366 ± 11%  interrupts.CPU83.LOC:Local_timer_interrupts
      1122 ± 10%     -40.9%     663.50 ± 14%  interrupts.CPU83.RES:Rescheduling_interrupts
      1435 ±  5%     -26.1%       1060 ±  8%  interrupts.CPU84.CAL:Function_call_interrupts
    431839           -39.9%     259363 ± 11%  interrupts.CPU84.LOC:Local_timer_interrupts
      1227 ± 10%     -47.2%     647.50 ± 20%  interrupts.CPU84.RES:Rescheduling_interrupts
      1436 ±  4%     -25.3%       1073 ±  7%  interrupts.CPU85.CAL:Function_call_interrupts
    431832           -39.9%     259394 ± 11%  interrupts.CPU85.LOC:Local_timer_interrupts
      1135 ±  6%     -43.7%     639.50 ± 20%  interrupts.CPU85.RES:Rescheduling_interrupts
      1390 ±  5%     -24.9%       1044 ±  8%  interrupts.CPU86.CAL:Function_call_interrupts
    431862           -39.9%     259355 ± 11%  interrupts.CPU86.LOC:Local_timer_interrupts
      1117 ±  9%     -40.6%     663.50 ± 18%  interrupts.CPU86.RES:Rescheduling_interrupts
      1423 ±  5%     -20.9%       1126 ±  8%  interrupts.CPU87.CAL:Function_call_interrupts
    431895           -40.0%     259331 ± 11%  interrupts.CPU87.LOC:Local_timer_interrupts
      1142 ± 10%     -39.5%     691.00 ± 20%  interrupts.CPU87.RES:Rescheduling_interrupts
    431611           -39.9%     259371 ± 11%  interrupts.CPU9.LOC:Local_timer_interrupts
  38002501           -39.9%   22822684 ± 11%  interrupts.LOC:Local_timer_interrupts
     98629 ±  2%     -35.4%      63693 ± 13%  interrupts.RES:Rescheduling_interrupts
     58.38 ±  2%     -58.4        0.00        perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     63.54           -56.6        6.94 ± 35%  perf-profile.calltrace.cycles-pp.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     55.70 ±  2%     -55.7        0.00        perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
     55.35 ±  2%     -55.4        0.00        perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write
     27.78           -27.8        0.00        perf-profile.calltrace.cycles-pp.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     15.90 ±  3%     -15.9        0.00        perf-profile.calltrace.cycles-pp.__ext4_journal_stop.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     15.52 ±  4%     -15.5        0.00        perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter
     11.69 ±  6%     -11.7        0.00        perf-profile.calltrace.cycles-pp.generic_write_end.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      9.64 ±  4%      -9.6        0.00        perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin
      9.04            -9.0        0.00        perf-profile.calltrace.cycles-pp._raw_read_lock.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin
      8.57 ±  5%      -8.6        0.00        perf-profile.calltrace.cycles-pp.stop_this_handle.jbd2_journal_stop.__ext4_journal_stop.ext4_da_write_end.generic_perform_write
      8.31 ±  5%      -8.3        0.00        perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_write_end.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter
      6.98 ±  5%      -7.0        0.00        perf-profile.calltrace.cycles-pp.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.ext4_da_write_end.generic_perform_write
      5.56 ±  5%      -5.6        0.00        perf-profile.calltrace.cycles-pp.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.ext4_da_write_end
     92.55            -5.2       87.32 ±  6%  perf-profile.calltrace.cycles-pp.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
     97.14            -3.6       93.52 ±  2%  perf-profile.calltrace.cycles-pp.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     97.26            -2.5       94.72        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     97.57            -1.7       95.88        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.66            -1.6       96.03        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.76            -1.6       96.19        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.82            -1.6       96.25        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     98.05            -1.4       96.64        perf-profile.calltrace.cycles-pp.write
      0.94 ± 32%      +0.4        1.32 ±  7%  perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
      0.79 ±  9%      +0.5        1.27 ±  4%  perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.ext4_evict_inode.evict.__dentry_kill.dput
      0.90 ± 10%      +0.5        1.43 ±  4%  perf-profile.calltrace.cycles-pp.ext4_evict_inode.evict.__dentry_kill.dput.__fput
      0.90 ± 10%      +0.5        1.44 ±  4%  perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dput.__fput.task_work_run
      0.91 ± 10%      +0.5        1.45 ±  4%  perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_user_mode_prepare
      0.92 ± 10%      +0.5        1.46 ±  4%  perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      0.92 ± 10%      +0.5        1.46 ±  4%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      0.92 ± 10%      +0.5        1.46 ±  4%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.93 ± 11%      +0.5        1.47 ±  4%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__close
      0.93 ± 11%      +0.5        1.47 ±  4%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      0.92 ± 10%      +0.5        1.47 ±  3%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      0.92 ± 10%      +0.5        1.46 ±  4%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      0.93 ± 11%      +0.5        1.47 ±  4%  perf-profile.calltrace.cycles-pp.__close
      0.00            +0.7        0.68 ± 15%  perf-profile.calltrace.cycles-pp.truncate_cleanup_page.truncate_inode_pages_range.ext4_evict_inode.evict.__dentry_kill
      2.20 ±  7%      +0.8        2.96 ±  8%  perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      1.38 ±  7%      +0.8        2.18 ± 17%  perf-profile.calltrace.cycles-pp.jbd2_journal_dirty_metadata.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty
      1.53 ±  9%      +0.9        2.45 ± 18%  perf-profile.calltrace.cycles-pp.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode
      0.00            +0.9        0.94 ± 46%  perf-profile.calltrace.cycles-pp.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write
      0.00            +1.0        1.03 ± 53%  perf-profile.calltrace.cycles-pp.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.00            +1.1        1.06 ± 34%  perf-profile.calltrace.cycles-pp.__find_get_block.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write
      0.00            +1.1        1.11 ± 33%  perf-profile.calltrace.cycles-pp.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty
      1.61 ±  6%      +1.2        2.78 ± 20%  perf-profile.calltrace.cycles-pp.jbd2_journal_get_write_access.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode
      0.00            +1.2        1.23 ± 10%  perf-profile.calltrace.cycles-pp.mark_buffer_dirty.__block_commit_write.block_write_end.generic_write_end.generic_perform_write
      1.37 ±  7%      +1.3        2.67 ± 13%  perf-profile.calltrace.cycles-pp.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      1.14 ± 18%      +1.5        2.69 ± 47%  perf-profile.calltrace.cycles-pp.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      1.71 ±  6%      +1.6        3.32 ±  7%  perf-profile.calltrace.cycles-pp.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      2.22 ±  7%      +1.6        3.86 ± 25%  perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.27 ±100%      +1.7        2.00 ± 29%  perf-profile.calltrace.cycles-pp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode
      0.27 ±100%      +1.7        2.02 ± 29%  perf-profile.calltrace.cycles-pp.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      2.82 ±  6%      +2.6        5.44 ±  8%  perf-profile.calltrace.cycles-pp.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      0.00            +2.9        2.90 ±  9%  perf-profile.calltrace.cycles-pp.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      2.20 ±  5%      +3.2        5.37 ± 13%  perf-profile.calltrace.cycles-pp.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      3.34 ±  5%      +3.4        6.69 ± 13%  perf-profile.calltrace.cycles-pp.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      0.00            +4.0        3.96 ±  9%  perf-profile.calltrace.cycles-pp.__block_commit_write.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.00            +5.7        5.68 ± 37%  perf-profile.calltrace.cycles-pp.stop_this_handle.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end
      0.00            +7.5        7.54 ± 19%  perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
      0.00            +7.6        7.56 ± 18%  perf-profile.calltrace.cycles-pp._raw_read_lock.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
      0.00           +10.8       10.81 ± 31%  perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +11.1       11.12 ± 30%  perf-profile.calltrace.cycles-pp.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.00           +12.2       12.23 ± 13%  perf-profile.calltrace.cycles-pp.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
      1.70 ±  5%     +45.8       47.46 ± 16%  perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty
      0.00           +46.1       46.14 ± 17%  perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      0.00           +48.9       48.93 ± 15%  perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +61.3       61.29 ±  9%  perf-profile.calltrace.cycles-pp.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.00           +73.3       73.31 ± 12%  perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00           +77.7       77.70 ± 11%  perf-profile.calltrace.cycles-pp.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     63.56           -56.6        6.95 ± 35%  perf-profile.children.cycles-pp.ext4_da_write_begin
     27.79           -27.6        0.14 ± 13%  perf-profile.children.cycles-pp.ext4_da_write_end
     61.66 ±  2%     -10.8       50.81 ± 14%  perf-profile.children.cycles-pp.__ext4_journal_start_sb
     57.50 ±  2%      -9.6       47.93 ± 16%  perf-profile.children.cycles-pp.jbd2__journal_start
     57.18 ±  2%      -9.6       47.63 ± 16%  perf-profile.children.cycles-pp.start_this_handle
     17.61 ±  2%      -6.0       11.56 ± 29%  perf-profile.children.cycles-pp.__ext4_journal_stop
     17.04 ±  3%      -5.8       11.24 ± 30%  perf-profile.children.cycles-pp.jbd2_journal_stop
     92.60            -5.2       87.36 ±  6%  perf-profile.children.cycles-pp.generic_perform_write
     97.15            -3.6       93.53 ±  2%  perf-profile.children.cycles-pp.ext4_buffered_write_iter
      8.85 ±  5%      -2.9        5.90 ± 36%  perf-profile.children.cycles-pp.stop_this_handle
     97.29            -2.6       94.74        perf-profile.children.cycles-pp.new_sync_write
      9.97 ±  3%      -2.1        7.85 ± 18%  perf-profile.children.cycles-pp.add_transaction_credits
     97.61            -1.7       95.90        perf-profile.children.cycles-pp.vfs_write
     97.69            -1.6       96.05        perf-profile.children.cycles-pp.ksys_write
      9.39            -1.5        7.92 ± 18%  perf-profile.children.cycles-pp._raw_read_lock
     98.11            -1.4       96.76        perf-profile.children.cycles-pp.write
      4.12 ±  7%      -1.3        2.77 ± 13%  perf-profile.children.cycles-pp.ext4_journal_check_start
      1.10 ±  5%      -0.7        0.39 ± 24%  perf-profile.children.cycles-pp.up_write
     99.36            -0.3       99.01        perf-profile.children.cycles-pp.do_syscall_64
     99.43            -0.3       99.10        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.68 ±  2%      -0.2        0.44 ± 13%  perf-profile.children.cycles-pp.unlock_page
      0.34 ±  7%      -0.1        0.24 ± 18%  perf-profile.children.cycles-pp.queued_read_lock_slowpath
      0.55 ±  5%      -0.1        0.46 ±  4%  perf-profile.children.cycles-pp.down_write
      0.05 ±  7%      +0.0        0.08 ± 12%  perf-profile.children.cycles-pp.crypto_shash_update
      0.04 ± 44%      +0.0        0.07 ± 10%  perf-profile.children.cycles-pp.__fsnotify_parent
      0.14 ±  4%      +0.0        0.17 ±  6%  perf-profile.children.cycles-pp.task_tick_fair
      0.28            +0.0        0.32 ±  2%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.17 ±  2%      +0.0        0.20 ±  6%  perf-profile.children.cycles-pp.scheduler_tick
      0.08 ± 16%      +0.0        0.12 ±  3%  perf-profile.children.cycles-pp.free_buffer_head
      0.21 ±  2%      +0.0        0.25 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.06 ± 13%      +0.0        0.10 ±  5%  perf-profile.children.cycles-pp.__ext4_unlink
      0.08 ±  8%      +0.0        0.12 ± 11%  perf-profile.children.cycles-pp.__get_user_nocheck_1
      0.22 ±  2%      +0.0        0.26 ±  3%  perf-profile.children.cycles-pp.tick_sched_timer
      0.20 ±  2%      +0.0        0.24 ±  5%  perf-profile.children.cycles-pp.update_process_times
      0.10 ±  7%      +0.0        0.14 ±  9%  perf-profile.children.cycles-pp.ext4_es_lookup_extent
      0.07 ± 15%      +0.0        0.11 ±  3%  perf-profile.children.cycles-pp.__ext4_new_inode
      0.01 ±223%      +0.0        0.06 ±  9%  perf-profile.children.cycles-pp.rcu_all_qs
      0.08 ± 10%      +0.0        0.12 ± 13%  perf-profile.children.cycles-pp.__fget_light
      0.02 ±141%      +0.0        0.06 ±  7%  perf-profile.children.cycles-pp.ext4_nonda_switch
      0.11 ±  7%      +0.1        0.16 ± 14%  perf-profile.children.cycles-pp.iov_iter_fault_in_readable
      0.11 ±  6%      +0.1        0.16 ± 13%  perf-profile.children.cycles-pp.xas_load
      0.03 ±100%      +0.1        0.08 ± 16%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.down_read
      0.07 ±  5%      +0.1        0.13 ± 12%  perf-profile.children.cycles-pp.disk_rw
      0.10 ±  8%      +0.1        0.15 ±  3%  perf-profile.children.cycles-pp.ext4_unlink
      0.10 ± 10%      +0.1        0.16 ±  4%  perf-profile.children.cycles-pp.vfs_unlink
      0.05 ± 77%      +0.1        0.11 ± 23%  perf-profile.children.cycles-pp.osq_lock
      0.00            +0.1        0.06 ± 11%  perf-profile.children.cycles-pp.ext4_add_nondir
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.ext4_fc_track_inode
      0.09 ±  7%      +0.1        0.15 ± 12%  perf-profile.children.cycles-pp.__fdget_pos
      0.00            +0.1        0.06 ± 14%  perf-profile.children.cycles-pp.get_obj_cgroup_from_current
      0.03 ±100%      +0.1        0.09 ±  7%  perf-profile.children.cycles-pp.account_page_cleaned
      0.00            +0.1        0.06 ± 32%  perf-profile.children.cycles-pp.unaccount_page_cache_page
      0.11 ±  9%      +0.1        0.18 ±  2%  perf-profile.children.cycles-pp.ext4_create
      0.10 ±  5%      +0.1        0.17 ± 14%  perf-profile.children.cycles-pp.common_file_perm
      0.09 ±  9%      +0.1        0.17 ±  4%  perf-profile.children.cycles-pp.delete_from_page_cache_batch
      0.13 ±  8%      +0.1        0.22 ± 17%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.03 ± 70%      +0.1        0.12 ± 14%  perf-profile.children.cycles-pp.ext4_es_insert_delayed_block
      0.14 ± 12%      +0.1        0.23 ± 13%  perf-profile.children.cycles-pp.alloc_buffer_head
      0.06 ± 54%      +0.1        0.16 ±  5%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      0.15 ± 14%      +0.1        0.25 ± 13%  perf-profile.children.cycles-pp.alloc_page_buffers
      0.14 ±  5%      +0.1        0.25 ± 12%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.11 ±  4%      +0.1        0.22 ± 14%  perf-profile.children.cycles-pp.security_file_permission
      0.17 ±  5%      +0.1        0.28 ± 12%  perf-profile.children.cycles-pp.__entry_text_start
      0.18 ± 19%      +0.1        0.31 ±  9%  perf-profile.children.cycles-pp.do_unlinkat
      0.19 ± 17%      +0.1        0.32 ±  7%  perf-profile.children.cycles-pp.unlink
      0.06 ± 14%      +0.1        0.20 ± 61%  perf-profile.children.cycles-pp.__cancel_dirty_page
      0.14 ± 35%      +0.1        0.28 ± 13%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      0.06 ±  8%      +0.1        0.20 ± 80%  perf-profile.children.cycles-pp.current_time
      0.00            +0.2        0.16 ± 97%  perf-profile.children.cycles-pp.__dquot_alloc_space
      0.25 ± 22%      +0.2        0.42 ±  4%  perf-profile.children.cycles-pp.creat64
      0.27 ± 21%      +0.2        0.44 ±  5%  perf-profile.children.cycles-pp.path_openat
      0.27 ± 21%      +0.2        0.44 ±  5%  perf-profile.children.cycles-pp.do_filp_open
      0.28 ± 22%      +0.2        0.45 ±  5%  perf-profile.children.cycles-pp.do_sys_open
      0.28 ± 21%      +0.2        0.45 ±  5%  perf-profile.children.cycles-pp.do_sys_openat2
      0.22 ±  7%      +0.2        0.40 ±  4%  perf-profile.children.cycles-pp.ext4_inode_csum
      0.06 ±  6%      +0.2        0.24 ± 61%  perf-profile.children.cycles-pp.ext4_da_reserve_space
      0.20 ± 43%      +0.2        0.40 ± 19%  perf-profile.children.cycles-pp.__set_page_dirty
      0.21 ± 11%      +0.2        0.41 ± 30%  perf-profile.children.cycles-pp.try_to_free_buffers
      0.06 ±  9%      +0.2        0.26 ± 82%  perf-profile.children.cycles-pp.ext4_file_write_iter
      0.24 ±  5%      +0.2        0.46 ±  5%  perf-profile.children.cycles-pp.ext4_inode_csum_set
      0.44 ±  4%      +0.2        0.68 ±  8%  perf-profile.children.cycles-pp._raw_spin_lock
      0.42 ±  9%      +0.3        0.68 ± 15%  perf-profile.children.cycles-pp.truncate_cleanup_page
      0.07 ±  5%      +0.4        0.45 ±106%  perf-profile.children.cycles-pp.ksys_lseek
      0.29 ±  2%      +0.4        0.69 ± 31%  perf-profile.children.cycles-pp.jbd2_write_access_granted
      0.79 ±  9%      +0.5        1.27 ±  4%  perf-profile.children.cycles-pp.truncate_inode_pages_range
      0.26 ±  5%      +0.5        0.76 ± 58%  perf-profile.children.cycles-pp.llseek
      0.90 ± 10%      +0.5        1.43 ±  4%  perf-profile.children.cycles-pp.ext4_evict_inode
      0.90 ± 10%      +0.5        1.44 ±  4%  perf-profile.children.cycles-pp.evict
      0.91 ± 10%      +0.5        1.45 ±  4%  perf-profile.children.cycles-pp.__dentry_kill
      0.92 ± 10%      +0.5        1.46 ±  4%  perf-profile.children.cycles-pp.task_work_run
      0.92 ± 10%      +0.5        1.46 ±  4%  perf-profile.children.cycles-pp.__fput
      0.92 ± 10%      +0.5        1.46 ±  3%  perf-profile.children.cycles-pp.dput
      0.93 ± 11%      +0.5        1.48 ±  4%  perf-profile.children.cycles-pp.__close
      0.97 ± 10%      +0.6        1.53 ±  4%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      1.00 ±  9%      +0.6        1.58 ±  4%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.07 ± 10%      +0.7        0.72 ±119%  perf-profile.children.cycles-pp.ext4_generic_write_checks
      0.30 ±  5%      +0.7        0.95 ± 45%  perf-profile.children.cycles-pp.ext4_da_map_blocks
      0.04 ± 71%      +0.7        0.70 ±123%  perf-profile.children.cycles-pp.generic_write_checks
      0.30 ±  5%      +0.7        1.03 ± 53%  perf-profile.children.cycles-pp.ext4_da_get_block_prep
      0.40 ± 13%      +0.8        1.16 ± 33%  perf-profile.children.cycles-pp.__find_get_block
      2.22 ±  7%      +0.8        3.00 ±  8%  perf-profile.children.cycles-pp.pagecache_get_page
      0.42 ± 13%      +0.8        1.20 ± 32%  perf-profile.children.cycles-pp.__getblk_gfp
      1.48 ±  7%      +0.8        2.29 ± 17%  perf-profile.children.cycles-pp.jbd2_journal_dirty_metadata
      0.05 ±  8%      +0.8        0.86 ±130%  perf-profile.children.cycles-pp.balance_dirty_pages_ratelimited
      2.70 ± 19%      +0.8        3.52 ±  7%  perf-profile.children.cycles-pp.block_write_end
      1.64 ±  9%      +0.9        2.57 ± 17%  perf-profile.children.cycles-pp.__ext4_handle_dirty_metadata
      1.74 ±  6%      +1.2        2.92 ± 19%  perf-profile.children.cycles-pp.jbd2_journal_get_write_access
      1.92 ±  5%      +1.5        3.41 ±  6%  perf-profile.children.cycles-pp.__block_commit_write
      1.14 ± 18%      +1.6        2.69 ± 47%  perf-profile.children.cycles-pp.ext4_block_write_begin
      0.55 ± 13%      +1.6        2.11 ± 28%  perf-profile.children.cycles-pp.__ext4_get_inode_loc
      0.56 ± 12%      +1.6        2.12 ± 28%  perf-profile.children.cycles-pp.ext4_get_inode_loc
      1.85 ±  6%      +1.6        3.48 ±  7%  perf-profile.children.cycles-pp.__ext4_journal_get_write_access
      2.22 ±  7%      +1.6        3.87 ± 25%  perf-profile.children.cycles-pp.grab_cache_page_write_begin
      3.05 ±  6%      +2.6        5.70 ±  8%  perf-profile.children.cycles-pp.ext4_do_update_inode
      2.41 ±  5%      +3.2        5.61 ± 13%  perf-profile.children.cycles-pp.ext4_reserve_inode_write
      3.60 ±  5%      +3.4        7.00 ± 13%  perf-profile.children.cycles-pp.ext4_mark_iloc_dirty
      6.02 ±  4%      +6.7       12.74 ± 13%  perf-profile.children.cycles-pp.__ext4_mark_inode_dirty
      9.15 ±  4%     +54.3       63.42 ±  9%  perf-profile.children.cycles-pp.ext4_dirty_inode
     11.03 ±  4%     +64.9       75.93 ± 11%  perf-profile.children.cycles-pp.__mark_inode_dirty
     11.70 ±  6%     +66.0       77.72 ± 11%  perf-profile.children.cycles-pp.generic_write_end
     37.32 ±  2%      -5.8       31.49 ± 15%  perf-profile.self.cycles-pp.start_this_handle
      8.80 ±  5%      -2.9        5.87 ± 36%  perf-profile.self.cycles-pp.stop_this_handle
      8.06 ±  2%      -2.8        5.25 ± 24%  perf-profile.self.cycles-pp.jbd2_journal_stop
      9.91 ±  3%      -2.1        7.81 ± 18%  perf-profile.self.cycles-pp.add_transaction_credits
      9.33            -1.5        7.88 ± 18%  perf-profile.self.cycles-pp._raw_read_lock
      4.03 ±  7%      -1.3        2.72 ± 14%  perf-profile.self.cycles-pp.ext4_journal_check_start
      1.33 ±  5%      -1.0        0.31 ± 65%  perf-profile.self.cycles-pp.ext4_da_write_begin
      1.09 ±  5%      -0.7        0.38 ± 24%  perf-profile.self.cycles-pp.up_write
      0.68 ±  2%      -0.2        0.44 ± 12%  perf-profile.self.cycles-pp.unlock_page
      0.52 ±  6%      -0.1        0.40 ±  4%  perf-profile.self.cycles-pp.down_write
      0.08 ±  8%      +0.0        0.11 ± 12%  perf-profile.self.cycles-pp.xas_load
      0.04 ± 44%      +0.0        0.07 ± 10%  perf-profile.self.cycles-pp.__fsnotify_parent
      0.10 ± 19%      +0.0        0.14 ±  5%  perf-profile.self.cycles-pp.generic_perform_write
      0.07 ±  9%      +0.0        0.11 ± 12%  perf-profile.self.cycles-pp.__get_user_nocheck_1
      0.02 ±141%      +0.0        0.06 ±  8%  perf-profile.self.cycles-pp.__cond_resched
      0.10 ±  3%      +0.0        0.15 ± 17%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.06 ±  7%      +0.0        0.11 ± 13%  perf-profile.self.cycles-pp.disk_rw
      0.07 ±  8%      +0.0        0.12 ± 11%  perf-profile.self.cycles-pp.__fget_light
      0.07 ± 14%      +0.0        0.12 ± 19%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.03 ±100%      +0.1        0.08 ± 14%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.02 ± 99%      +0.1        0.08 ± 17%  perf-profile.self.cycles-pp.crypto_shash_update
      0.08 ±  4%      +0.1        0.14 ± 16%  perf-profile.self.cycles-pp.common_file_perm
      0.01 ±223%      +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.ext4_nonda_switch
      0.00            +0.1        0.06 ± 11%  perf-profile.self.cycles-pp.llseek
      0.08 ± 10%      +0.1        0.14 ± 12%  perf-profile.self.cycles-pp.__entry_text_start
      0.05 ± 77%      +0.1        0.11 ± 23%  perf-profile.self.cycles-pp.osq_lock
      0.08 ± 10%      +0.1        0.14 ± 11%  perf-profile.self.cycles-pp.write
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.ext4_es_lookup_extent
      0.04 ± 71%      +0.1        0.12 ± 31%  perf-profile.self.cycles-pp.ext4_inode_csum
      0.12 ± 10%      +0.1        0.20 ± 16%  perf-profile.self.cycles-pp.crc32c_pcl_intel_update
      0.06 ± 54%      +0.1        0.16 ±  7%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      0.14 ±  5%      +0.1        0.24 ± 13%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.36 ±  4%      +0.1        0.48 ±  8%  perf-profile.self.cycles-pp.generic_write_end
      0.20 ± 37%      +0.2        0.38 ± 17%  perf-profile.self.cycles-pp.copy_page_from_iter_atomic
      0.05 ±  8%      +0.2        0.26 ± 83%  perf-profile.self.cycles-pp.ext4_file_write_iter
      0.44 ±  4%      +0.2        0.67 ±  8%  perf-profile.self.cycles-pp._raw_spin_lock
      0.05            +0.3        0.36 ± 78%  perf-profile.self.cycles-pp.ext4_da_map_blocks
      0.29 ±  2%      +0.4        0.68 ± 32%  perf-profile.self.cycles-pp.jbd2_write_access_granted
      0.03 ±100%      +0.5        0.48 ±123%  perf-profile.self.cycles-pp.__ext4_journal_get_write_access
      1.04 ±  3%      +0.5        1.56 ±  4%  perf-profile.self.cycles-pp.pagecache_get_page
      0.82 ±  4%      +0.7        1.48 ±  7%  perf-profile.self.cycles-pp.__block_commit_write
      0.15 ± 14%      +0.7        0.81 ± 99%  perf-profile.self.cycles-pp.ext4_block_write_begin
      0.11 ± 10%      +0.7        0.79 ±105%  perf-profile.self.cycles-pp.vfs_write
      0.51            +0.7        1.23 ± 44%  perf-profile.self.cycles-pp.ext4_mark_iloc_dirty
      0.10 ±  9%      +0.7        0.84 ±114%  perf-profile.self.cycles-pp.__ext4_get_inode_loc
      0.37 ± 14%      +0.7        1.11 ± 33%  perf-profile.self.cycles-pp.__find_get_block
      0.00            +0.7        0.74 ±135%  perf-profile.self.cycles-pp.ext4_buffered_write_iter
      0.20 ±  3%      +0.8        0.98 ± 26%  perf-profile.self.cycles-pp.__mark_inode_dirty
      1.44 ±  8%      +0.8        2.21 ± 17%  perf-profile.self.cycles-pp.jbd2_journal_get_write_access
      1.48 ±  7%      +0.8        2.28 ± 17%  perf-profile.self.cycles-pp.jbd2_journal_dirty_metadata
      0.04 ± 45%      +0.8        0.85 ±131%  perf-profile.self.cycles-pp.balance_dirty_pages_ratelimited
      0.00            +0.8        0.81 ±133%  perf-profile.self.cycles-pp.file_update_time
      0.01 ±223%      +0.9        0.90 ±130%  perf-profile.self.cycles-pp.new_sync_write
      0.56 ±  5%      +1.2        1.71 ± 48%  perf-profile.self.cycles-pp.ext4_do_update_inode


                                                                                
                                  aim7.jobs-per-min                             
                                                                                
  160000 +------------------------------------------------------------------+   
         |O OOOO OOOO OOO  O OO OO  OO   O  O O OO OOO O O  OOO  O O        |   
  150000 |-+                          OO  OO   O                            |   
  140000 |-+                                                                |   
         |                                                                  |   
  130000 |-+                                                                |   
         |                                                                  |   
  120000 |-+             O        O                     O O    O  O         |   
         |                                                                  |   
  110000 |-+                                                                |   
  100000 |-+                                                                |   
         |                                                                  |   
   90000 |-+                                                                |   
         |+.++++.++++.++++.++++.+++.++++.++ +.++++.+++.++++.++++.++++.++ +.+|   
   80000 +------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  60000 +-------------------------------------------------------------------+   
        |O O        O     O        O                                        |   
  50000 |-+  OO OOO  OOO   O OOOO                                           |   
        |   O                       O                                       |   
        |                                                                   |   
  40000 |-+                       O                                         |   
        |                O            OOOO OOOO OOO OOO  O O OO O  O        |   
  30000 |-+                                                                 |   
        |                                              O       O            |   
  20000 |-+                                               O       O         |   
        |                                                                   |   
        |                                                                   |   
  10000 |-+                                                                 |   
        |      .+++.++++.++                                                 |   
      0 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  3000 +--------------------------------------------------------------------+   
       |                                                                    |   
  2500 |-+                       O                                          |   
       |                                                                    |   
       |    O       O         O   O O                                       |   
  2000 |O+O   O OO O O OOO OOO  O                                           |   
       |   O   O                                                            |   
  1500 |-+                                                                  |   
       |                                                                    |   
  1000 |-+                            O O OO  O           O       O         |   
       |                             O   O   O   OOO OOOO  OO OOO  O        |   
       |                                       O                            |   
   500 |-+                                                                  |   
       |+. ++.  + .+++.   .+ ++. +   + .++  .++ .++ .++++.  +.   .+  +.+    |   
     0 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                aim7.time.system_time                           
                                                                                
  19000 +-------------------------------------------------------------------+   
  18000 |+.                +.  +           ++ +.  +.          +         +   |   
        |  ++++.+++.++++.++  ++ +.+++.+++ +  +  ++  ++++.+++.+ ++.+++.++ +.+|   
  17000 |-+                              +                                  |   
  16000 |-+                                                                 |   
  15000 |-+                                                                 |   
  14000 |-+                                                                 |   
        |                                                                   |   
  13000 |-+                                                                 |   
  12000 |-+              O        O                    O  O    O  O         |   
  11000 |-+                                                                 |   
  10000 |-+                                                                 |   
        |  O  O        O      O       OOOO OOOO      O   O   O  O           |   
   9000 |O+ OO  OOO OOO   OO O OO  OO           OOO O O    O  O    O        |   
   8000 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                              aim7.time.elapsed_time                            
                                                                                
  220 +---------------------------------------------------------------------+   
      |  +++.+++.+++   ++  ++  ++.+++.++ +  +  ++  ++.+++.+++  +++.+++.+ +.+|   
  200 |-+                               +                                   |   
      |                                                                     |   
      |                                                                     |   
  180 |-+                                                                   |   
      |                                                                     |   
  160 |-+                                                                   |   
      |                O                               O  O    O O          |   
  140 |-+                       O                                           |   
      |                                                                     |   
      |                                                                     |   
  120 |O+OOO OOO OOO OO O OOO OO  OOO OOO OOO OOO OOO O O  OOO  O  O        |   
      |                                                                     |   
  100 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            aim7.time.elapsed_time.max                          
                                                                                
  220 +---------------------------------------------------------------------+   
      |  +++.+++.+++   ++  ++  ++.+++.++ +  +  ++  ++.+++.+++  +++.+++.+ +.+|   
  200 |-+                               +                                   |   
      |                                                                     |   
      |                                                                     |   
  180 |-+                                                                   |   
      |                                                                     |   
  160 |-+                                                                   |   
      |                O                               O  O    O O          |   
  140 |-+                       O                                           |   
      |                                                                     |   
      |                                                                     |   
  120 |O+OOO OOO OOO OO O OOO OO  OOO OOO OOO OOO OOO O O  OOO  O  O        |   
      |                                                                     |   
  100 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  5400 +--------------------------------------------------------------------+   
       |             +                                                      |   
  5200 |-+           :                                                      |   
  5000 |-+           ::                                                     |   
       |             ::                                                     |   
  4800 |-+          : :                                                     |   
       |            :  :+                                                   |   
  4600 |-+       +  +  +:                                                   |   
       |       + :+ :    :                                        +         |   
  4400 |-+++   ::  +     +           +                      +     :         |   
  4200 |-: :   :+        :  +   +    ::      + +   +    +   :+ + ::  +      |   
       | :  :  :          : ::  ::  : +     +: :+  :+   :+ :  + :: : ::    +|   
  4000 |++  + :           : :+ : ++.+  : +++  :: + : +++  ++    +  :+ : + + |   
       |     +:            :  ::       : :    :   :                +   + +  |   
  3800 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  260 +---------------------------------------------------------------------+   
      |                                                          +         +|   
  240 |-+   .+                     +   +    +              + +.++ +        :|   
  220 |-+ ++ :             ++. ++.+:   :+.  :+ ++. ++.+++.+: :     + +    : |   
      |+.+   :            +   +     : :   +:  +   +         :       + + + : |   
  200 |-+    :            :         +.+    +                +          + +  |   
      |      :            :                                                 |   
  180 |-+     :          :                                                  |   
      |       :          :                                                  |   
  160 |-+     :          :                                                  |   
  140 |-+     :          :                                                  |   
      |       :+.       :                                                   |   
  120 |-+     +  ++ .++++                                                   |   
      |            +                                                        |   
  100 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  0.35 +--------------------------------------------------------------------+   
       |                     :   :               :   :                      |   
   0.3 |++                   :   :               :   :                      |   
       |:                    :   :              ::  ::                      |   
       |::                   :   :              ::  ::                      |   
  0.25 |::                   ::  :              : : : :                     |   
       |::                  : : : :             : : : :                     |   
   0.2 |-:                  : : : :             : : : :                     |   
       |  :                 : : : :             : : : :                     |   
  0.15 |-++ +.+             : : : :            :  ::  :                     |   
       |   +  :            +: +.: :   +.++    +:  +:  + +      +            |   
       |       :           :+   + :.+ :   + .+ +   +   ::+ + .+ :.++++.+++. |   
   0.1 |-+     :      .++ :       +  +     +           +  + +   +          +|   
       |       +++.+++   ::                                                 |   
  0.05 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  85000 +-------------------------------------------------------------------+   
        |       +      +                                                    |   
  80000 |-+     ::+.+++ + +                                                 |   
  75000 |-+     :+       +:                                                 |   
        |      :          :                                                 |   
  70000 |-+    :          :                                                 |   
  65000 |-+    :           :                                                |   
        |      :           :                                                |   
  60000 |-+    :           :                                                |   
  55000 |-+   :            :                                           + +  |   
        |+    :            +.  +            + +.  +.  ++               :+ : |   
  50000 |-+   +              ++ +.+   +++ .+ :: ++  ++  :    +   .+ +.:   : |   
  45000 |-++++                     + +   +   +          : + + :++  +  +    :|   
        |                           +                    + +  +            +|   
  40000 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  5400 +--------------------------------------------------------------------+   
       |             +                                                      |   
  5200 |-+           :                                                      |   
  5000 |-+           ::                                                     |   
       |             ::                                                     |   
  4800 |-+          : :                                                     |   
       |            :  :+                                                   |   
  4600 |-++      +  +  +:                                                   |   
       |  ::   + :+ :    :                                        +         |   
  4400 |-: +   ::  +     +           +       +              +     :  +      |   
  4200 |-: :   :+        :  +   +    ::     :: +   +    +   :+ + ::  ::     |   
       |:   :  :          : ::  ::  : +     :: :+  :+   :+ :  + :: :: :    +|   
  4000 |++  + :           : :+ : ++.+  + +++  :: + : +++  ++    +  :+  :+ + |   
       |     +:            :  ::        +     :   :                +   + +  |   
  3800 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  260 +---------------------------------------------------------------------+   
      |                                                          +         +|   
  240 |-+   .+                     +   +    +              + +.++ +        :|   
  220 |-+ ++ :             ++. ++.+:   :+.  :+ ++. ++.+++.+: :     + +    : |   
      |+.+   :            +   +     : :   +:  +   +         :       + + + : |   
  200 |-+    :            :         +.+    +                +          + +  |   
      |      :            :                                                 |   
  180 |-+     :          :                                                  |   
      |       :          :                                                  |   
  160 |-+     :          :                                                  |   
  140 |-+     :          :                                                  |   
      |       :+.       :                                                   |   
  120 |-+     +  ++ .++++                                                   |   
      |            +                                                        |   
  100 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  5400 +--------------------------------------------------------------------+   
       |                                                                    |   
  5200 |-+           +                                                      |   
  5000 |-+           ::                                                     |   
       |             ::                                                     |   
  4800 |-+          :  :                                                    |   
  4600 |-+       +  :  ++                                                   |   
       |         :+ +   :                                                   |   
  4400 |-+ +   +:  +     :           +                      +     +         |   
  4200 |-++ :  :+        +           ::      +              :: + ::  +      |   
       | +  +  :          : +   +   : +     +: +.  +.   +. : : ::: : ::     |   
  4000 |++   +:           : :+ + ++.+  : +++  :: + : ++ : ++  + +  :: :   .+|   
  3800 |-+    +            +  +        : :    +   +    +           ++  +++  |   
       |                                +                                   |   
  3600 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  3200 +--------------------------------------------------------------------+   
  3000 |-+     ++   ++.  +                                                  |   
       |       :       + :                                                  |   
  2800 |-+     :        +:                                                  |   
  2600 |-+     :          :                                                 |   
       |       :          :                                                 |   
  2400 |-+    :           :                                                 |   
  2200 |-+    :           :                                                 |   
  2000 |-+    :           :                                                 |   
       |      +            :                                      +         |   
  1800 |-+    :            :            +                        : :   ++   |   
  1600 |-+ + :             + ++. + .+  + :  .++ .++ .+++   + .+  : ++ +  +. |   
       |+.+ ::              +   + +  ++  +++   +   +    +.+ +  ++    +     +|   
  1400 |-+  +                                                               |   
  1200 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                                                                
                                                                                
  5400 +--------------------------------------------------------------------+   
       |                                                                    |   
  5200 |-+           +                                                      |   
  5000 |-+           ::                                                     |   
       |             ::                                                     |   
  4800 |-+          :  :                                                    |   
  4600 |-+       +  :  ++                                                   |   
       |         :+ +   :                                                   |   
  4400 |-+ +   +:  +     :           +                      +     +         |   
  4200 |-++ :  :+        +           ::      +              :: + ::  +      |   
       | +  +  :          : +   +   : +     +: +.  +.   +. : : ::: : ::     |   
  4000 |++   +:           : :+ + ++.+  + +++  :: + : ++ : ++  + +  :: :   .+|   
  3800 |-+    +            +  +         +     +   +    +           ++  +++  |   
       |                                                                    |   
  3600 +--------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample

***************************************************************************************************
lkp-csl-2sp9: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/4BRD_12G/ext4/x86_64-rhel-8.3/3000/RAID1/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp9/disk_rw/aim7/0x5003006

commit: 
  6984aef598 ("ext4: factor out write end code of inline file")
  cc883236b7 ("ext4: drop unnecessary journal handle in delalloc write")

6984aef59814fb5c cc883236b79297f6266ca6f4e7f 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     84600           +83.1%     154886        aim7.jobs-per-min
    212.99           -45.3%     116.42        aim7.time.elapsed_time
    212.99           -45.3%     116.42        aim7.time.elapsed_time.max
   1708241           -60.8%     669169        aim7.time.involuntary_context_switches
    231226 ±  3%     -13.6%     199736 ±  2%  aim7.time.minor_page_faults
     17528           -47.9%       9131        aim7.time.system_time
    185350           -39.9%     111355 ±  3%  aim7.time.voluntary_context_switches
    251.74           -38.4%     155.14        uptime.boot
      6.34 ±  3%     +75.4%      11.12 ±  2%  iostat.cpu.idle
     93.23            -5.4%      88.15        iostat.cpu.system
      5.50 ±  3%      +4.3        9.75        mpstat.cpu.all.idle%
      0.00 ± 55%      +0.0        0.02 ±126%  mpstat.cpu.all.iowait%
      0.03 ±  2%      +0.0        0.05 ±  2%  mpstat.cpu.all.soft%
      0.43            +0.3        0.70        mpstat.cpu.all.usr%
      6.00           +75.0%      10.50 ±  4%  vmstat.cpu.id
    229.83 ±  2%     -26.4%     169.17 ±  4%  vmstat.procs.r
     10561           -20.2%       8427        vmstat.system.cs
    182145            +1.9%     185587        vmstat.system.in
      4.68 ± 32%      +4.0        8.64 ± 20%  turbostat.C1E%
      5.40 ±  6%     +83.7%       9.93        turbostat.CPU%c1
  39279392           -43.7%   22113174        turbostat.IRQ
     63.50            +4.2%      66.17 ±  2%  turbostat.PkgTmp
     58.18            +2.8%      59.79        turbostat.RAMWatt
    688648 ±  7%     +45.1%     999133 ±  2%  numa-meminfo.node0.Dirty
    975068 ±  6%     +35.0%    1316241 ±  2%  numa-meminfo.node0.Inactive
    690144 ±  7%     +44.9%    1000205 ±  2%  numa-meminfo.node0.Inactive(file)
    208761 ± 23%     -57.1%      89548 ±  6%  numa-meminfo.node1.Active
    208233 ± 23%     -57.1%      89347 ±  6%  numa-meminfo.node1.Active(anon)
    165882 ± 36%     -49.1%      84415 ±  8%  numa-meminfo.node1.AnonPages.max
    259403 ±  2%     -63.8%      93925 ±  5%  meminfo.Active
    257363 ±  2%     -64.3%      91990 ±  5%  meminfo.Active(anon)
    160116           -24.3%     121151        meminfo.AnonHugePages
   1412636           +27.1%    1795816        meminfo.Dirty
   1830917           +20.7%    2210679        meminfo.Inactive
   1414858           +26.9%    1795828        meminfo.Inactive(file)
   9978648 ±  2%     -12.1%    8771043 ±  4%  meminfo.Memused
    302476 ±  2%     -53.6%     140382 ±  5%  meminfo.Shmem
  10173670 ±  2%     -11.8%    8973049 ±  4%  meminfo.max_used_kB
     10073 ±  4%     -22.3%       7827 ±  3%  softirqs.CPU0.RCU
      8998 ± 17%     -35.7%       5782 ± 11%  softirqs.CPU12.RCU
      9450 ± 17%     -44.9%       5209 ± 11%  softirqs.CPU24.RCU
      8663 ± 20%     -36.8%       5475 ± 12%  softirqs.CPU47.RCU
      8860 ± 13%     -35.8%       5690 ± 11%  softirqs.CPU51.RCU
      2482 ±219%    -100.0%       0.17 ±223%  softirqs.CPU6.NET_RX
    717061 ±  3%     -34.7%     468252 ±  5%  softirqs.RCU
    486616           -17.9%     399348        softirqs.SCHED
     43043           -36.0%      27540        softirqs.TIMER
    172542 ±  7%     +45.0%     250211 ±  2%  numa-vmstat.node0.nr_dirty
    172943 ±  7%     +44.8%     250408 ±  2%  numa-vmstat.node0.nr_inactive_file
    110635 ±  6%     -42.7%      63414 ± 24%  numa-vmstat.node0.nr_written
    172945 ±  7%     +44.8%     250401 ±  2%  numa-vmstat.node0.nr_zone_inactive_file
    173612 ±  7%     +44.6%     251008 ±  2%  numa-vmstat.node0.nr_zone_write_pending
     51917 ± 23%     -57.1%      22296 ±  6%  numa-vmstat.node1.nr_active_anon
  18838796 ±  6%     -14.9%   16025868 ±  2%  numa-vmstat.node1.nr_dirtied
    100477 ± 11%     -61.2%      39030 ± 34%  numa-vmstat.node1.nr_written
     51917 ± 23%     -57.1%      22296 ±  6%  numa-vmstat.node1.nr_zone_active_anon
  20267109 ±  7%     -15.8%   17058208 ±  3%  numa-vmstat.node1.numa_hit
  20240518 ±  7%     -15.8%   17038798 ±  3%  numa-vmstat.node1.numa_local
    363813           +27.0%     462061        slabinfo.buffer_head.active_objs
      9559           +26.4%      12080        slabinfo.buffer_head.active_slabs
    372834           +26.4%     471141        slabinfo.buffer_head.num_objs
      9559           +26.4%      12080        slabinfo.buffer_head.num_slabs
      2096 ±  3%     -17.8%       1722 ±  6%  slabinfo.dquot.active_objs
      2096 ±  3%     -17.8%       1722 ±  6%  slabinfo.dquot.num_objs
    980.17 ± 11%     +19.1%       1167 ±  8%  slabinfo.ext4_allocation_context.active_objs
    980.17 ± 11%     +19.1%       1167 ±  8%  slabinfo.ext4_allocation_context.num_objs
    845.00 ± 12%     -48.6%     434.67 ± 29%  slabinfo.ext4_io_end.active_objs
    845.00 ± 12%     -48.6%     434.67 ± 29%  slabinfo.ext4_io_end.num_objs
      8742 ±  8%     -11.3%       7756 ± 10%  slabinfo.kmalloc-192.active_objs
      8973 ±  8%     -11.4%       7954 ± 10%  slabinfo.kmalloc-192.num_objs
      9575 ± 13%     -32.5%       6462 ± 11%  slabinfo.skbuff_ext_cache.active_objs
      9679 ± 12%     -32.3%       6550 ± 11%  slabinfo.skbuff_ext_cache.num_objs
     64498 ±  2%     -64.4%      22943 ±  5%  proc-vmstat.nr_active_anon
    352903           +27.6%     450182        proc-vmstat.nr_dirty
   3057769            +1.3%    3097721        proc-vmstat.nr_dirty_background_threshold
   6123015            +1.3%    6203018        proc-vmstat.nr_dirty_threshold
   1026661            +5.5%    1082635        proc-vmstat.nr_file_pages
    353358           +27.4%     450331        proc-vmstat.nr_inactive_file
     60303            -1.6%      59362        proc-vmstat.nr_kernel_stack
     75676 ±  2%     -54.1%      34771 ±  5%  proc-vmstat.nr_shmem
     49822            +2.6%      51123        proc-vmstat.nr_slab_reclaimable
    414594 ±  3%     -47.7%     216914 ± 19%  proc-vmstat.nr_written
     64498 ±  2%     -64.4%      22943 ±  5%  proc-vmstat.nr_zone_active_anon
    353358           +27.4%     450331        proc-vmstat.nr_zone_inactive_file
    354810           +27.3%     451734        proc-vmstat.nr_zone_write_pending
     83413 ±  5%     -46.4%      44711 ±  5%  proc-vmstat.numa_hint_faults
     53456 ±  6%     -58.8%      22024 ±  9%  proc-vmstat.numa_hint_faults_local
  79778462            -1.3%   78769977        proc-vmstat.numa_hit
  79747345            -1.3%   78716097        proc-vmstat.numa_local
     34732 ± 23%     -38.6%      21329 ±  8%  proc-vmstat.numa_pages_migrated
    225095 ±  4%     -34.5%     147444 ±  4%  proc-vmstat.numa_pte_updates
    117820 ±  2%     -76.5%      27642 ±  6%  proc-vmstat.pgactivate
  79756439            -1.3%   78754282        proc-vmstat.pgalloc_normal
   1029426           -26.0%     761627        proc-vmstat.pgfault
     34732 ± 23%     -38.6%      21329 ±  8%  proc-vmstat.pgmigrate_success
   1874948 ±  2%     -42.5%    1077371 ± 15%  proc-vmstat.pgpgout
     53026           -38.5%      32598        proc-vmstat.pgreuse
     14.30 ±  5%     -32.4%       9.67        perf-stat.i.MPKI
 3.119e+09           +59.6%  4.979e+09        perf-stat.i.branch-instructions
  21092251           +58.2%   33366020        perf-stat.i.branch-misses
     32.67            -0.8       31.91 ±  2%  perf-stat.i.cache-miss-rate%
  76817174 ±  2%     +11.0%   85267837        perf-stat.i.cache-misses
 2.274e+08           +12.5%  2.559e+08        perf-stat.i.cache-references
     10543           -20.8%       8355        perf-stat.i.context-switches
     14.15           -41.8%       8.24        perf-stat.i.cpi
 2.316e+11            -4.7%  2.207e+11        perf-stat.i.cpu-cycles
      3171           -12.8%       2766 ±  5%  perf-stat.i.cycles-between-cache-misses
  4.86e+09           +58.3%  7.695e+09        perf-stat.i.dTLB-loads
 2.567e+09           +58.9%  4.078e+09        perf-stat.i.dTLB-stores
     95.92            -1.9       94.07        perf-stat.i.iTLB-load-miss-rate%
  17707577           +37.7%   24385448 ±  2%  perf-stat.i.iTLB-load-misses
 1.587e+10           +59.8%  2.536e+10        perf-stat.i.instructions
      1004           +19.7%       1202 ±  2%  perf-stat.i.instructions-per-iTLB-miss
      0.09 ±  3%     +67.4%       0.15 ±  2%  perf-stat.i.ipc
      2.77 ± 17%    +109.3%       5.80 ± 23%  perf-stat.i.major-faults
      2.63            -4.7%       2.51        perf-stat.i.metric.GHz
    236.06 ±  3%     +17.5%     277.34 ±  2%  perf-stat.i.metric.K/sec
    122.43           +57.9%     193.26        perf-stat.i.metric.M/sec
      4411           +31.1%       5782        perf-stat.i.minor-faults
   8076958 ±  4%     +14.6%    9256531 ±  2%  perf-stat.i.node-load-misses
   2723819           +17.1%    3188737        perf-stat.i.node-loads
     67.00            -4.8       62.23        perf-stat.i.node-store-miss-rate%
   5761014           +10.6%    6371750        perf-stat.i.node-store-misses
   2828548           +36.3%    3855487        perf-stat.i.node-stores
      4413           +31.1%       5787        perf-stat.i.page-faults
     14.33           -29.5%      10.10        perf-stat.overall.MPKI
     14.61           -40.3%       8.72        perf-stat.overall.cpi
      3017 ±  2%     -14.2%       2588        perf-stat.overall.cycles-between-cache-misses
    896.10           +16.1%       1040 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.07           +67.6%       0.11        perf-stat.overall.ipc
     67.10            -4.8       62.35        perf-stat.overall.node-store-miss-rate%
 3.105e+09           +59.1%   4.94e+09        perf-stat.ps.branch-instructions
  20953296           +57.7%   33037336        perf-stat.ps.branch-misses
  76488805           +10.7%   84695011        perf-stat.ps.cache-misses
 2.264e+08           +12.2%  2.541e+08        perf-stat.ps.cache-references
     10499           -21.1%       8282        perf-stat.ps.context-switches
 2.307e+11            -5.0%  2.192e+11        perf-stat.ps.cpu-cycles
 4.839e+09           +57.8%  7.634e+09        perf-stat.ps.dTLB-loads
 2.556e+09           +58.3%  4.046e+09        perf-stat.ps.dTLB-stores
  17628213           +37.2%   24193118 ±  2%  perf-stat.ps.iTLB-load-misses
 1.579e+10           +59.3%  2.516e+10        perf-stat.ps.instructions
      2.71 ± 17%    +105.6%       5.56 ± 23%  perf-stat.ps.major-faults
      4354           +30.8%       5696        perf-stat.ps.minor-faults
   8048917 ±  4%     +14.2%    9195137 ±  2%  perf-stat.ps.node-load-misses
   2714561           +16.7%    3168786        perf-stat.ps.node-loads
   5750000           +10.3%    6342072        perf-stat.ps.node-store-misses
   2818690           +35.9%    3829644        perf-stat.ps.node-stores
      4356           +30.9%       5701        perf-stat.ps.page-faults
  3.38e+12           -12.9%  2.945e+12        perf-stat.total.instructions
      0.07 ± 41%    +174.4%       0.20 ± 17%  perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      0.25 ±111%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.11 ± 21%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      0.19 ± 76%     -68.9%       0.06 ± 32%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      1.89 ± 23%     -67.0%       0.62 ± 24%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
      0.19 ± 25%     +43.4%       0.28 ± 10%  perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      0.02 ±  5%     -13.7%       0.02 ±  6%  perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork
      7.72 ± 23%    +173.6%      21.13 ± 59%  perf-sched.sch_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      1347 ±125%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
     30.76 ±111%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      6.74 ± 15%     -70.0%       2.02 ±137%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
     26.46 ± 26%     -63.5%       9.65 ± 69%  perf-sched.sch_delay.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_del
    106958 ±  5%     -19.9%      85726        perf-sched.total_wait_and_delay.count.ms
     82.94 ± 18%     -51.3%      40.40 ± 13%  perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
    209.23 ±  7%     +12.9%     236.20 ±  4%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
    178.80 ± 11%     +31.7%     235.45 ±  3%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
    228.64 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
    201.57 ±  8%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
    210.64 ±  6%     +12.3%     236.64 ±  3%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
    232.48 ± 15%     -42.7%     133.15 ± 10%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      1399 ±  9%     -58.9%     575.84 ± 25%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
     79.98 ± 17%    +271.7%     297.27 ±  9%  perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
    721.05           -46.2%     387.87 ±  5%  perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork
    237.50 ±  3%    +388.1%       1159 ±  9%  perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      3996 ± 23%     -30.3%       2783 ±  7%  perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2429 ±  7%     +37.5%       3340 ±  7%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      1396 ± 10%   +2230.4%      32532 ±  2%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
    237.00 ± 70%    +340.6%       1044 ±  3%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
     48258 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      1524 ±  6%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      2820 ±  8%     +23.7%       3489 ± 13%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
     20416 ±  7%     -33.0%      13676 ±  5%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     99.50 ± 71%    +813.1%     908.50 ± 13%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
      2431 ± 10%     -31.9%       1656 ± 14%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
    104.17 ± 15%     +57.0%     163.50 ± 11%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
    268.67 ±  8%     -43.2%     152.50 ± 49%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      3947 ±  3%     +47.6%       5825 ±  2%  perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3850 ±  2%     -43.0%       2193 ±  5%  perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      1145           +85.4%       2124 ±  5%  perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
      4099 ±  4%     -35.8%       2632 ±  6%  perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4117 ±  4%     -34.8%       2686 ±  7%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      4080 ±  4%     -33.9%       2698 ±  7%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      4201 ±  6%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      4045 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      4093 ±  3%     -34.4%       2685 ±  6%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      4170 ±  4%     -35.3%       2697 ±  7%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      4090 ±  4%     -34.3%       2686 ±  7%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
      4037 ±  4%     -34.6%       2640 ±  7%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      4060 ±  4%     -35.0%       2637 ±  5%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
      4036 ±  5%     -44.4%       2245 ± 45%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      4041 ±  3%     -33.6%       2683 ±  7%  perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4135 ±  5%     -35.3%       2677 ±  7%  perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
     62.72 ± 10%     -51.2%      30.63 ± 12%  perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
    209.56 ± 18%     -28.5%     149.80 ± 16%  perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
     82.72 ± 18%     -51.5%      40.15 ± 13%  perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
    209.10 ±  7%     +12.9%     236.05 ±  4%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
    178.32 ± 11%     +31.9%     235.29 ±  3%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
     19.24 ± 10%    +294.2%      75.83 ± 39%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_getblk.ext4_bread
     15.43 ± 15%    +739.2%     129.49 ±126%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_read_inode_bitmap.__ext4_new_inode
     20.48 ± 17%    +182.4%      57.83 ± 46%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.block_invalidatepage.truncate_cleanup_page.truncate_inode_pages_range
    228.39 ±  4%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
    201.47 ±  8%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
    210.29 ±  6%     +12.5%     236.50 ±  3%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
    232.29 ± 15%     -42.7%     133.09 ± 10%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
     16.48 ± 16%     -43.5%       9.31 ± 48%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.simple_write_begin
      1397 ±  9%     -58.9%     575.21 ± 25%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
     18.82 ±  3%    +368.8%      88.22 ± 33%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.truncate_inode_pages_range.ext4_evict_inode.evict
    242.30 ± 15%     -31.2%     166.69 ± 21%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      0.00 ±172%  +2.1e+06%      97.60 ±191%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas
     79.78 ± 17%    +272.3%     297.00 ±  9%  perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
    146.53 ± 29%     -38.6%      89.93 ± 12%  perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
     46.06 ±107%   +1040.3%     525.23 ± 31%  perf-sched.wait_time.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.__fdget_pos
    721.03           -46.2%     387.85 ±  5%  perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork
      3928 ±  4%     -32.7%       2644 ±  6%  perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      4099 ±  4%     -35.8%       2632 ±  6%  perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3924 ±  5%     -33.3%       2617 ±  6%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__alloc_pages.pagecache_get_page.grab_cache_page_write_begin
      4112 ±  4%     -34.7%       2684 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
     34.38 ± 34%     -48.6%      17.68 ± 50%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_handle_dirty_dirblock.add_dirent_to_buf
      4080 ±  4%     -33.9%       2696 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      3985 ±  4%     -32.9%       2675 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
     56.80 ± 20%   +4099.0%       2385 ±  5%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_getblk.ext4_bread
      4013 ±  4%     -34.6%       2624 ±  6%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
      3952 ±  4%     -35.8%       2537 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
      4158 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      4042 ±  4%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      4076 ±  3%     -34.1%       2684 ±  6%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      4147 ±  5%     -35.0%       2694 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      3986 ±  6%     -33.4%       2654 ±  6%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
      4089 ±  4%     -34.4%       2684 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
      4037 ±  4%     -34.7%       2638 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      4058 ±  4%     -35.0%       2636 ±  5%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
     70.32 ± 15%   +3471.0%       2511 ±  6%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.truncate_inode_pages_range.ext4_evict_inode.evict
      4002 ±  3%     -33.9%       2644 ±  6%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      4030 ±  5%     -34.6%       2637 ±  7%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      0.00 ±172%  +6.8e+06%     319.00 ±206%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas
      4035 ±  3%     -33.6%       2680 ±  7%  perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4099 ±  5%     -34.8%       2672 ±  7%  perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      3698 ±  8%     -35.0%       2404 ±  4%  perf-sched.wait_time.max.ms.wait_transaction_locked.add_transaction_credits.start_this_handle.jbd2__journal_start
    429.33           -45.0%     236.00        interrupts.9:IO-APIC.9-fasteoi.acpi
    129821           -28.0%      93421 ±  2%  interrupts.CAL:Function_call_interrupts
      1911 ± 38%     -36.5%       1212 ± 27%  interrupts.CPU0.CAL:Function_call_interrupts
    428821           -45.0%     235782        interrupts.CPU0.LOC:Local_timer_interrupts
      1768 ± 25%     -46.7%     943.17 ±  6%  interrupts.CPU0.RES:Rescheduling_interrupts
    429.33           -45.0%     236.00        interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
      1646 ± 12%     -39.0%       1004 ±  3%  interrupts.CPU1.CAL:Function_call_interrupts
    428892           -45.0%     235763        interrupts.CPU1.LOC:Local_timer_interrupts
    429001           -45.0%     235753        interrupts.CPU10.LOC:Local_timer_interrupts
      1404 ±  4%     -25.9%       1040 ±  9%  interrupts.CPU11.CAL:Function_call_interrupts
    428877           -45.1%     235521        interrupts.CPU11.LOC:Local_timer_interrupts
      1404 ±  5%     -25.9%       1040 ±  7%  interrupts.CPU12.CAL:Function_call_interrupts
    428996           -45.1%     235647        interrupts.CPU12.LOC:Local_timer_interrupts
      1151 ± 26%     -38.5%     707.83 ±  7%  interrupts.CPU12.RES:Rescheduling_interrupts
      1400 ±  2%     -29.5%     986.67 ±  5%  interrupts.CPU13.CAL:Function_call_interrupts
    428889           -45.0%     235714        interrupts.CPU13.LOC:Local_timer_interrupts
    428967           -45.1%     235671        interrupts.CPU14.LOC:Local_timer_interrupts
      1237 ± 28%     -41.9%     718.67 ±  6%  interrupts.CPU14.RES:Rescheduling_interrupts
    428734           -45.0%     235667        interrupts.CPU15.LOC:Local_timer_interrupts
      1052 ± 10%     -30.9%     727.17 ±  3%  interrupts.CPU15.RES:Rescheduling_interrupts
      1399 ±  5%     -32.0%     951.17 ±  4%  interrupts.CPU16.CAL:Function_call_interrupts
    429020           -45.1%     235695        interrupts.CPU16.LOC:Local_timer_interrupts
      1226 ± 27%     -39.6%     740.50 ± 16%  interrupts.CPU16.RES:Rescheduling_interrupts
      1441 ±  6%     -32.6%     971.67 ±  6%  interrupts.CPU17.CAL:Function_call_interrupts
    428969           -45.1%     235641        interrupts.CPU17.LOC:Local_timer_interrupts
      1138 ± 14%     -38.7%     697.17 ±  3%  interrupts.CPU17.RES:Rescheduling_interrupts
    428835           -45.0%     235658        interrupts.CPU18.LOC:Local_timer_interrupts
      1021 ± 11%     -27.7%     737.83 ±  4%  interrupts.CPU18.RES:Rescheduling_interrupts
      1472 ± 18%     -34.0%     971.00 ±  2%  interrupts.CPU19.CAL:Function_call_interrupts
    428785           -45.0%     235697        interrupts.CPU19.LOC:Local_timer_interrupts
      1021 ±  9%     -31.8%     697.00 ±  3%  interrupts.CPU19.RES:Rescheduling_interrupts
      1804 ± 23%     -34.8%       1175 ± 22%  interrupts.CPU2.CAL:Function_call_interrupts
    428899           -45.0%     235882        interrupts.CPU2.LOC:Local_timer_interrupts
      1278 ± 26%     -41.5%     748.00 ±  5%  interrupts.CPU2.RES:Rescheduling_interrupts
      1405 ±  4%     -28.3%       1007 ±  8%  interrupts.CPU20.CAL:Function_call_interrupts
    428890           -45.1%     235512        interrupts.CPU20.LOC:Local_timer_interrupts
      1342 ±  5%     -27.5%     973.33 ±  5%  interrupts.CPU21.CAL:Function_call_interrupts
    428824           -45.1%     235502        interrupts.CPU21.LOC:Local_timer_interrupts
      1029 ±  9%     -31.8%     701.50 ±  3%  interrupts.CPU21.RES:Rescheduling_interrupts
      1501 ±  6%     -21.2%       1183 ±  8%  interrupts.CPU22.CAL:Function_call_interrupts
    429005           -45.1%     235704        interrupts.CPU22.LOC:Local_timer_interrupts
      1812 ± 38%     -59.0%     743.83 ±  8%  interrupts.CPU22.RES:Rescheduling_interrupts
      1512 ±  5%     -23.2%       1161 ± 10%  interrupts.CPU23.CAL:Function_call_interrupts
    429017           -45.1%     235694        interrupts.CPU23.LOC:Local_timer_interrupts
      1149 ± 10%     -51.8%     554.17 ±  9%  interrupts.CPU23.RES:Rescheduling_interrupts
      1548 ±  3%     -28.8%       1103 ±  4%  interrupts.CPU24.CAL:Function_call_interrupts
    429050           -45.1%     235675        interrupts.CPU24.LOC:Local_timer_interrupts
      1100 ± 11%     -52.7%     520.67 ±  6%  interrupts.CPU24.RES:Rescheduling_interrupts
      1459 ±  8%     -23.2%       1120 ±  7%  interrupts.CPU25.CAL:Function_call_interrupts
    428844           -45.0%     235681        interrupts.CPU25.LOC:Local_timer_interrupts
      1083 ± 10%     -51.0%     530.83 ±  7%  interrupts.CPU25.RES:Rescheduling_interrupts
      1548 ±  4%     -29.4%       1092 ±  6%  interrupts.CPU26.CAL:Function_call_interrupts
    428877           -45.1%     235661        interrupts.CPU26.LOC:Local_timer_interrupts
      1248 ± 20%     -58.4%     519.33 ±  7%  interrupts.CPU26.RES:Rescheduling_interrupts
    428925           -45.1%     235668        interrupts.CPU27.LOC:Local_timer_interrupts
      1077 ± 10%     -51.3%     525.17 ±  8%  interrupts.CPU27.RES:Rescheduling_interrupts
    428859           -45.0%     235659        interrupts.CPU28.LOC:Local_timer_interrupts
      1063 ± 10%     -49.6%     536.00 ± 15%  interrupts.CPU28.RES:Rescheduling_interrupts
      1507 ±  3%     -30.7%       1043 ±  6%  interrupts.CPU29.CAL:Function_call_interrupts
    428884           -45.1%     235664        interrupts.CPU29.LOC:Local_timer_interrupts
      1165 ± 18%     -56.9%     502.50 ±  6%  interrupts.CPU29.RES:Rescheduling_interrupts
    428891           -45.0%     235780        interrupts.CPU3.LOC:Local_timer_interrupts
      1092 ±  9%     -35.7%     702.50 ±  4%  interrupts.CPU3.RES:Rescheduling_interrupts
      1467 ±  3%     -29.6%       1033 ±  3%  interrupts.CPU30.CAL:Function_call_interrupts
    428873           -45.0%     235684        interrupts.CPU30.LOC:Local_timer_interrupts
      1404 ± 49%     -64.6%     497.50 ±  5%  interrupts.CPU30.RES:Rescheduling_interrupts
      1594 ± 17%     -32.7%       1072 ±  7%  interrupts.CPU31.CAL:Function_call_interrupts
    428892           -45.0%     235691        interrupts.CPU31.LOC:Local_timer_interrupts
      1227 ±  8%     -54.7%     556.00 ±  9%  interrupts.CPU31.RES:Rescheduling_interrupts
      1454 ±  4%     -25.7%       1080 ± 14%  interrupts.CPU32.CAL:Function_call_interrupts
    428870           -45.0%     235665        interrupts.CPU32.LOC:Local_timer_interrupts
      1130 ±  6%     -55.5%     503.00 ±  4%  interrupts.CPU32.RES:Rescheduling_interrupts
      1455 ±  2%     -30.5%       1011 ±  5%  interrupts.CPU33.CAL:Function_call_interrupts
    428852           -45.0%     235668        interrupts.CPU33.LOC:Local_timer_interrupts
      1140 ±  7%     -54.7%     516.17 ±  6%  interrupts.CPU33.RES:Rescheduling_interrupts
      1405 ±  3%     -27.0%       1025 ±  8%  interrupts.CPU34.CAL:Function_call_interrupts
    428881           -45.1%     235661        interrupts.CPU34.LOC:Local_timer_interrupts
      1072 ±  9%     -49.7%     539.17 ± 10%  interrupts.CPU34.RES:Rescheduling_interrupts
    428906           -45.1%     235657        interrupts.CPU35.LOC:Local_timer_interrupts
      1093 ± 12%     -53.1%     512.83 ±  6%  interrupts.CPU35.RES:Rescheduling_interrupts
      1437 ±  4%     -29.8%       1009 ±  7%  interrupts.CPU36.CAL:Function_call_interrupts
    428877           -45.0%     235672        interrupts.CPU36.LOC:Local_timer_interrupts
      1149 ± 13%     -56.3%     502.83 ±  6%  interrupts.CPU36.RES:Rescheduling_interrupts
      1422 ±  2%     -22.4%       1103 ±  9%  interrupts.CPU37.CAL:Function_call_interrupts
    428933           -45.1%     235668        interrupts.CPU37.LOC:Local_timer_interrupts
      1142 ± 20%     -54.0%     525.17 ±  7%  interrupts.CPU37.RES:Rescheduling_interrupts
      1411 ±  2%     -27.4%       1024 ±  7%  interrupts.CPU38.CAL:Function_call_interrupts
    428865           -45.0%     235666        interrupts.CPU38.LOC:Local_timer_interrupts
      1222 ± 32%     -56.9%     527.50 ± 11%  interrupts.CPU38.RES:Rescheduling_interrupts
      1421 ±  3%     -26.1%       1050 ± 10%  interrupts.CPU39.CAL:Function_call_interrupts
    428886           -45.0%     235695        interrupts.CPU39.LOC:Local_timer_interrupts
      1056 ±  9%     -50.8%     519.50 ±  7%  interrupts.CPU39.RES:Rescheduling_interrupts
      1903 ± 31%     -42.7%       1089 ± 22%  interrupts.CPU4.CAL:Function_call_interrupts
    428856           -45.0%     235746        interrupts.CPU4.LOC:Local_timer_interrupts
      1012 ± 12%     -27.9%     730.50 ±  5%  interrupts.CPU4.RES:Rescheduling_interrupts
      1456 ±  4%     -33.4%     970.83 ±  8%  interrupts.CPU40.CAL:Function_call_interrupts
    428883           -45.0%     235681        interrupts.CPU40.LOC:Local_timer_interrupts
      1124 ±  8%     -55.1%     504.67 ±  5%  interrupts.CPU40.RES:Rescheduling_interrupts
      1471 ±  6%     -34.9%     957.67 ±  9%  interrupts.CPU41.CAL:Function_call_interrupts
    428837           -45.0%     235672        interrupts.CPU41.LOC:Local_timer_interrupts
      1284 ± 31%     -60.7%     504.33 ±  5%  interrupts.CPU41.RES:Rescheduling_interrupts
      1449 ±  6%     -30.4%       1009 ±  7%  interrupts.CPU42.CAL:Function_call_interrupts
    428857           -45.1%     235646        interrupts.CPU42.LOC:Local_timer_interrupts
      1210 ± 18%     -57.1%     519.17 ±  8%  interrupts.CPU42.RES:Rescheduling_interrupts
      2680 ±  3%     -40.8%       1586 ±  5%  interrupts.CPU43.CAL:Function_call_interrupts
    428889           -45.0%     235698        interrupts.CPU43.LOC:Local_timer_interrupts
      2287 ±  8%     -50.4%       1135 ± 27%  interrupts.CPU43.RES:Rescheduling_interrupts
    428798           -45.0%     235789        interrupts.CPU44.LOC:Local_timer_interrupts
      1362 ±  2%     -28.7%     971.67 ±  3%  interrupts.CPU45.CAL:Function_call_interrupts
    428709           -45.0%     235597        interrupts.CPU45.LOC:Local_timer_interrupts
      1018 ±  9%     -29.1%     722.33 ±  7%  interrupts.CPU45.RES:Rescheduling_interrupts
      1412 ±  3%     -28.3%       1012 ±  5%  interrupts.CPU46.CAL:Function_call_interrupts
    428808           -45.0%     235712        interrupts.CPU46.LOC:Local_timer_interrupts
      1207 ± 35%     -39.9%     726.00 ±  6%  interrupts.CPU46.RES:Rescheduling_interrupts
      1363 ±  3%     -26.6%       1000 ±  6%  interrupts.CPU47.CAL:Function_call_interrupts
    428901           -45.1%     235662        interrupts.CPU47.LOC:Local_timer_interrupts
      1018 ± 12%     -26.1%     753.00 ±  7%  interrupts.CPU47.RES:Rescheduling_interrupts
      1915 ± 64%     -50.2%     954.67 ±  2%  interrupts.CPU48.CAL:Function_call_interrupts
    428879           -45.0%     235734        interrupts.CPU48.LOC:Local_timer_interrupts
      1267 ± 44%     -44.6%     702.00 ±  5%  interrupts.CPU48.RES:Rescheduling_interrupts
      1376 ±  3%     -29.8%     966.33 ±  4%  interrupts.CPU49.CAL:Function_call_interrupts
    428924           -45.0%     235756        interrupts.CPU49.LOC:Local_timer_interrupts
      1146 ± 15%     -34.4%     752.83 ± 10%  interrupts.CPU49.RES:Rescheduling_interrupts
      1573 ± 10%     -24.4%       1189 ± 17%  interrupts.CPU5.CAL:Function_call_interrupts
    428851           -45.0%     235749        interrupts.CPU5.LOC:Local_timer_interrupts
      1201 ± 32%     -37.5%     750.83 ±  7%  interrupts.CPU5.RES:Rescheduling_interrupts
      1353 ±  5%     -30.1%     946.17 ±  3%  interrupts.CPU50.CAL:Function_call_interrupts
    428829           -45.0%     235705        interrupts.CPU50.LOC:Local_timer_interrupts
      1019 ± 10%     -31.9%     693.83 ±  3%  interrupts.CPU50.RES:Rescheduling_interrupts
      1333 ±  5%     -28.8%     949.50 ±  4%  interrupts.CPU51.CAL:Function_call_interrupts
    428880           -45.0%     235719        interrupts.CPU51.LOC:Local_timer_interrupts
      1104 ± 18%     -35.5%     712.67 ±  3%  interrupts.CPU51.RES:Rescheduling_interrupts
      1386 ±  2%     -30.0%     971.00 ±  5%  interrupts.CPU52.CAL:Function_call_interrupts
    428827           -45.0%     235716        interrupts.CPU52.LOC:Local_timer_interrupts
      1196 ± 23%     -40.6%     710.00 ±  9%  interrupts.CPU52.RES:Rescheduling_interrupts
      1385 ±  3%     -29.8%     972.33 ±  4%  interrupts.CPU53.CAL:Function_call_interrupts
    428856           -45.0%     235676        interrupts.CPU53.LOC:Local_timer_interrupts
      1026 ±  7%     -30.5%     713.33 ±  6%  interrupts.CPU53.RES:Rescheduling_interrupts
      1446 ±  7%     -34.5%     947.83 ±  3%  interrupts.CPU54.CAL:Function_call_interrupts
    428871           -45.0%     235748        interrupts.CPU54.LOC:Local_timer_interrupts
      1307 ± 21%     -43.4%     739.83 ±  8%  interrupts.CPU54.RES:Rescheduling_interrupts
      1408 ±  7%     -29.7%     990.33 ±  9%  interrupts.CPU55.CAL:Function_call_interrupts
    428878           -45.0%     235715        interrupts.CPU55.LOC:Local_timer_interrupts
      1071 ± 13%     -26.5%     787.67 ± 18%  interrupts.CPU55.RES:Rescheduling_interrupts
      1350 ±  3%     -25.0%       1012 ± 11%  interrupts.CPU56.CAL:Function_call_interrupts
    428937           -45.1%     235690        interrupts.CPU56.LOC:Local_timer_interrupts
      1361 ±  3%     -26.7%     997.83 ±  4%  interrupts.CPU57.CAL:Function_call_interrupts
    428893           -45.0%     235776        interrupts.CPU57.LOC:Local_timer_interrupts
      2040 ±104%     -62.9%     757.33 ±  9%  interrupts.CPU57.RES:Rescheduling_interrupts
      1340 ±  2%     -25.6%     997.00 ±  7%  interrupts.CPU58.CAL:Function_call_interrupts
    428899           -45.1%     235667        interrupts.CPU58.LOC:Local_timer_interrupts
      1379 ±  5%     -28.7%     983.33 ±  4%  interrupts.CPU59.CAL:Function_call_interrupts
    428820           -45.0%     235736        interrupts.CPU59.LOC:Local_timer_interrupts
      1302 ± 28%     -43.6%     735.00 ±  5%  interrupts.CPU59.RES:Rescheduling_interrupts
      1850 ± 33%     -46.7%     985.50 ±  3%  interrupts.CPU6.CAL:Function_call_interrupts
    428869           -45.0%     235687        interrupts.CPU6.LOC:Local_timer_interrupts
      1361 ±  2%     -28.1%     978.33 ±  8%  interrupts.CPU60.CAL:Function_call_interrupts
    428897           -45.0%     235841        interrupts.CPU60.LOC:Local_timer_interrupts
      1166 ± 28%     -38.0%     722.50 ±  6%  interrupts.CPU60.RES:Rescheduling_interrupts
      1430 ± 11%     -30.8%     989.83 ±  6%  interrupts.CPU61.CAL:Function_call_interrupts
    428893           -45.0%     235716        interrupts.CPU61.LOC:Local_timer_interrupts
      1143 ± 13%     -38.2%     707.00 ±  6%  interrupts.CPU61.RES:Rescheduling_interrupts
      1360 ±  4%     -27.1%     991.67 ±  3%  interrupts.CPU62.CAL:Function_call_interrupts
    428924           -45.1%     235676        interrupts.CPU62.LOC:Local_timer_interrupts
      1371 ±  4%     -28.7%     977.67 ±  2%  interrupts.CPU63.CAL:Function_call_interrupts
    428991           -45.1%     235705        interrupts.CPU63.LOC:Local_timer_interrupts
      1112 ± 23%     -35.2%     721.33 ±  8%  interrupts.CPU63.RES:Rescheduling_interrupts
      1436 ± 12%     -30.5%     999.00 ±  5%  interrupts.CPU64.CAL:Function_call_interrupts
    428917           -45.0%     235749        interrupts.CPU64.LOC:Local_timer_interrupts
      1367 ±  6%     -29.4%     965.67 ±  4%  interrupts.CPU65.CAL:Function_call_interrupts
    428882           -45.1%     235635        interrupts.CPU65.LOC:Local_timer_interrupts
      1048 ± 11%     -32.1%     711.67 ±  8%  interrupts.CPU65.RES:Rescheduling_interrupts
      1359 ±  2%     -27.3%     988.83 ±  8%  interrupts.CPU66.CAL:Function_call_interrupts
    428872           -45.0%     235677        interrupts.CPU66.LOC:Local_timer_interrupts
      1006 ± 10%     -50.5%     498.33 ±  7%  interrupts.CPU66.RES:Rescheduling_interrupts
      1693 ± 34%     -39.8%       1019 ±  6%  interrupts.CPU67.CAL:Function_call_interrupts
    428875           -45.0%     235694        interrupts.CPU67.LOC:Local_timer_interrupts
      1103 ± 18%     -53.2%     515.83 ±  4%  interrupts.CPU67.RES:Rescheduling_interrupts
      1444 ±  5%     -29.7%       1015 ±  4%  interrupts.CPU68.CAL:Function_call_interrupts
    428909           -45.0%     235709        interrupts.CPU68.LOC:Local_timer_interrupts
      1100 ± 16%     -53.9%     507.67 ±  6%  interrupts.CPU68.RES:Rescheduling_interrupts
      1420 ±  3%     -28.3%       1019 ±  6%  interrupts.CPU69.CAL:Function_call_interrupts
    428902           -45.0%     235753        interrupts.CPU69.LOC:Local_timer_interrupts
      1084 ± 10%     -52.0%     520.50 ±  6%  interrupts.CPU69.RES:Rescheduling_interrupts
      1587 ± 21%     -33.5%       1055 ± 10%  interrupts.CPU7.CAL:Function_call_interrupts
    429046           -45.1%     235630        interrupts.CPU7.LOC:Local_timer_interrupts
      1200 ± 26%     -39.7%     724.17 ±  4%  interrupts.CPU7.RES:Rescheduling_interrupts
      1432 ±  3%     -28.3%       1027 ±  7%  interrupts.CPU70.CAL:Function_call_interrupts
    428901           -45.0%     235718        interrupts.CPU70.LOC:Local_timer_interrupts
      1078 ±  8%     -50.9%     529.17 ± 11%  interrupts.CPU70.RES:Rescheduling_interrupts
      1427 ±  3%     -26.7%       1046 ±  6%  interrupts.CPU71.CAL:Function_call_interrupts
    428899           -45.0%     235732        interrupts.CPU71.LOC:Local_timer_interrupts
      1153 ± 20%     -52.7%     545.67 ±  8%  interrupts.CPU71.RES:Rescheduling_interrupts
      1446 ±  3%     -30.4%       1006 ±  6%  interrupts.CPU72.CAL:Function_call_interrupts
    428900           -45.0%     235702        interrupts.CPU72.LOC:Local_timer_interrupts
      1090 ± 12%     -53.1%     511.50 ±  2%  interrupts.CPU72.RES:Rescheduling_interrupts
      1390           -27.8%       1003 ±  6%  interrupts.CPU73.CAL:Function_call_interrupts
    428906           -45.0%     235701        interrupts.CPU73.LOC:Local_timer_interrupts
      1034 ±  9%     -50.7%     510.17 ± 10%  interrupts.CPU73.RES:Rescheduling_interrupts
      1439 ±  2%     -30.9%     994.33 ±  4%  interrupts.CPU74.CAL:Function_call_interrupts
    428923           -45.1%     235689        interrupts.CPU74.LOC:Local_timer_interrupts
      1184 ± 22%     -57.6%     502.17 ±  5%  interrupts.CPU74.RES:Rescheduling_interrupts
      1555 ± 24%     -34.7%       1015 ±  4%  interrupts.CPU75.CAL:Function_call_interrupts
    428909           -45.1%     235665        interrupts.CPU75.LOC:Local_timer_interrupts
      1121 ±  8%     -49.1%     571.00 ± 28%  interrupts.CPU75.RES:Rescheduling_interrupts
      1654 ± 31%     -40.1%     991.50 ±  5%  interrupts.CPU76.CAL:Function_call_interrupts
    428896           -45.0%     235723        interrupts.CPU76.LOC:Local_timer_interrupts
      1125 ±  9%     -57.1%     482.67 ±  7%  interrupts.CPU76.RES:Rescheduling_interrupts
      1413 ±  2%     -23.9%       1075 ± 13%  interrupts.CPU77.CAL:Function_call_interrupts
    428897           -45.0%     235686        interrupts.CPU77.LOC:Local_timer_interrupts
      1084 ±  8%     -54.3%     495.00 ±  5%  interrupts.CPU77.RES:Rescheduling_interrupts
      1401           -28.5%       1001 ±  9%  interrupts.CPU78.CAL:Function_call_interrupts
    428921           -45.0%     235699        interrupts.CPU78.LOC:Local_timer_interrupts
      1156 ± 26%     -56.3%     505.33 ±  6%  interrupts.CPU78.RES:Rescheduling_interrupts
      1468 ±  6%     -32.0%     999.50 ±  6%  interrupts.CPU79.CAL:Function_call_interrupts
    428942           -45.1%     235680        interrupts.CPU79.LOC:Local_timer_interrupts
      1101 ± 17%     -54.5%     501.83 ±  4%  interrupts.CPU79.RES:Rescheduling_interrupts
    428832           -45.0%     235717        interrupts.CPU8.LOC:Local_timer_interrupts
      1420 ±  2%     -27.7%       1026 ±  5%  interrupts.CPU80.CAL:Function_call_interrupts
    428875           -45.0%     235728        interrupts.CPU80.LOC:Local_timer_interrupts
      1082 ± 12%     -52.5%     514.17 ±  5%  interrupts.CPU80.RES:Rescheduling_interrupts
      1426 ±  4%     -26.2%       1052 ± 10%  interrupts.CPU81.CAL:Function_call_interrupts
    428905           -45.1%     235649        interrupts.CPU81.LOC:Local_timer_interrupts
      1141 ± 13%     -55.5%     508.33 ±  8%  interrupts.CPU81.RES:Rescheduling_interrupts
      1439           -27.7%       1040 ±  5%  interrupts.CPU82.CAL:Function_call_interrupts
    428885           -45.0%     235699        interrupts.CPU82.LOC:Local_timer_interrupts
      1299 ± 13%     -58.3%     542.17 ± 14%  interrupts.CPU82.RES:Rescheduling_interrupts
      1414 ±  2%     -29.0%       1004 ±  7%  interrupts.CPU83.CAL:Function_call_interrupts
    428915           -45.0%     235698        interrupts.CPU83.LOC:Local_timer_interrupts
      1068 ±  8%     -52.2%     510.67 ±  8%  interrupts.CPU83.RES:Rescheduling_interrupts
      1402 ±  7%     -29.3%     990.67 ±  5%  interrupts.CPU84.CAL:Function_call_interrupts
    428911           -45.0%     235703        interrupts.CPU84.LOC:Local_timer_interrupts
      1124 ±  8%     -55.1%     505.33 ±  9%  interrupts.CPU84.RES:Rescheduling_interrupts
      1437 ±  3%     -28.6%       1026 ±  7%  interrupts.CPU85.CAL:Function_call_interrupts
    428953           -45.1%     235677        interrupts.CPU85.LOC:Local_timer_interrupts
      1086 ± 10%     -52.3%     518.33 ±  6%  interrupts.CPU85.RES:Rescheduling_interrupts
    428908           -45.0%     235686        interrupts.CPU86.LOC:Local_timer_interrupts
      1034 ± 10%     -42.2%     598.50 ± 36%  interrupts.CPU86.RES:Rescheduling_interrupts
      1407 ±  5%     -26.4%       1036 ±  4%  interrupts.CPU87.CAL:Function_call_interrupts
    428896           -45.0%     235693        interrupts.CPU87.LOC:Local_timer_interrupts
      1143 ±  7%     -53.9%     527.33 ±  4%  interrupts.CPU87.RES:Rescheduling_interrupts
    428924           -45.0%     235714        interrupts.CPU9.LOC:Local_timer_interrupts
  37742579           -45.0%   20741077        interrupts.LOC:Local_timer_interrupts
    102143 ±  2%     -44.0%      57170        interrupts.RES:Rescheduling_interrupts
     59.38           -59.4        0.00        perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     64.18           -58.9        5.32 ±  8%  perf-profile.calltrace.cycles-pp.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     56.66           -56.7        0.00        perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
     56.34           -56.3        0.00        perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write
     27.62 ±  2%     -27.6        0.00        perf-profile.calltrace.cycles-pp.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     16.52 ±  6%     -16.5        0.00        perf-profile.calltrace.cycles-pp.__ext4_journal_stop.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     16.30 ±  6%     -16.3        0.00        perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter
     10.96 ±  5%     -11.0        0.00        perf-profile.calltrace.cycles-pp.generic_write_end.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     10.07 ±  4%     -10.1        0.00        perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin
      9.14 ±  9%      -9.1        0.00        perf-profile.calltrace.cycles-pp.stop_this_handle.jbd2_journal_stop.__ext4_journal_stop.ext4_da_write_end.generic_perform_write
      9.00 ±  2%      -9.0        0.00        perf-profile.calltrace.cycles-pp._raw_read_lock.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin
      8.15 ±  6%      -8.2        0.00        perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_write_end.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter
      6.88 ±  6%      -6.9        0.00        perf-profile.calltrace.cycles-pp.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.ext4_da_write_end.generic_perform_write
      5.48 ±  5%      -5.5        0.00        perf-profile.calltrace.cycles-pp.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.ext4_da_write_end
     97.33            -2.2       95.10        perf-profile.calltrace.cycles-pp.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     97.44            -2.1       95.33        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     97.76            -1.8       95.95        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.85            -1.7       96.12        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.95            -1.6       96.31        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     98.00            -1.6       96.38        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     92.72            -1.5       91.26        perf-profile.calltrace.cycles-pp.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
     98.24            -1.4       96.81        perf-profile.calltrace.cycles-pp.write
      2.59            -0.1        2.48 ±  2%  perf-profile.calltrace.cycles-pp.generic_update_time.file_update_time.ext4_write_checks.ext4_buffered_write_iter.new_sync_write
      2.59            -0.1        2.48 ±  2%  perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_update_time.file_update_time.ext4_write_checks.ext4_buffered_write_iter
      0.53 ±  2%      +0.2        0.76 ± 17%  perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      0.73 ±  2%      +0.4        1.13 ± 14%  perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write
      0.53 ±  3%      +0.5        0.99 ± 23%  perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.43 ± 44%      +0.5        0.92 ± 25%  perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter
      0.00            +0.6        0.55 ±  9%  perf-profile.calltrace.cycles-pp.create_empty_buffers.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.73 ±  3%      +0.6        1.30 ±  5%  perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.ext4_evict_inode.evict.__dentry_kill.dput
      0.00            +0.6        0.63 ±  6%  perf-profile.calltrace.cycles-pp.truncate_cleanup_page.truncate_inode_pages_range.ext4_evict_inode.evict.__dentry_kill
      0.83 ±  3%      +0.6        1.48 ±  6%  perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dput.__fput.task_work_run
      0.82 ±  3%      +0.6        1.47 ±  5%  perf-profile.calltrace.cycles-pp.ext4_evict_inode.evict.__dentry_kill.dput.__fput
      0.84 ±  3%      +0.7        1.49 ±  6%  perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_user_mode_prepare
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      0.00            +0.7        0.66 ±  2%  perf-profile.calltrace.cycles-pp.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.85 ±  3%      +0.7        1.52 ±  6%  perf-profile.calltrace.cycles-pp.__close
      0.85 ±  3%      +0.7        1.51 ±  6%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__close
      0.85 ±  3%      +0.7        1.51 ±  6%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      0.00            +0.7        0.67 ±  2%  perf-profile.calltrace.cycles-pp.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.00            +0.8        0.80 ±  7%  perf-profile.calltrace.cycles-pp.jbd2_write_access_granted.jbd2_journal_get_write_access.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
      0.66 ±  3%      +0.8        1.46 ± 20%  perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
      0.93 ±  3%      +0.9        1.85 ± 11%  perf-profile.calltrace.cycles-pp.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      1.37 ± 10%      +1.0        2.38 ±  3%  perf-profile.calltrace.cycles-pp.jbd2_journal_dirty_metadata.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty
      1.36 ± 10%      +1.1        2.42 ±  3%  perf-profile.calltrace.cycles-pp.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      2.02            +1.1        3.17 ±  6%  perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      2.04            +1.2        3.22 ±  6%  perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      1.49 ± 12%      +1.2        2.68 ±  5%  perf-profile.calltrace.cycles-pp.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode
      0.00            +1.3        1.30 ±  2%  perf-profile.calltrace.cycles-pp.__find_get_block.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write
      0.00            +1.3        1.32 ±  4%  perf-profile.calltrace.cycles-pp.mark_buffer_dirty.__block_commit_write.block_write_end.generic_write_end.generic_perform_write
      0.00            +1.3        1.34 ±  2%  perf-profile.calltrace.cycles-pp.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty
      1.60 ±  8%      +1.5        3.09 ±  4%  perf-profile.calltrace.cycles-pp.jbd2_journal_get_write_access.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode
      0.00            +1.6        1.58 ±  2%  perf-profile.calltrace.cycles-pp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode
      1.68 ±  8%      +1.6        3.25 ±  3%  perf-profile.calltrace.cycles-pp.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      0.00            +1.6        1.59 ±  2%  perf-profile.calltrace.cycles-pp.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      2.81 ±  6%      +2.4        5.23 ±  4%  perf-profile.calltrace.cycles-pp.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      2.10 ±  6%      +2.8        4.87 ±  2%  perf-profile.calltrace.cycles-pp.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      3.34 ±  4%      +2.8        6.12 ±  3%  perf-profile.calltrace.cycles-pp.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      0.00            +3.1        3.08 ±  9%  perf-profile.calltrace.cycles-pp.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00            +4.0        3.97 ± 24%  perf-profile.calltrace.cycles-pp.__block_commit_write.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.00            +7.0        7.00 ±  5%  perf-profile.calltrace.cycles-pp.stop_this_handle.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end
      0.00            +8.5        8.52 ±  2%  perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
      0.00            +8.6        8.57 ±  3%  perf-profile.calltrace.cycles-pp._raw_read_lock.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
      0.00           +11.1       11.09 ±  2%  perf-profile.calltrace.cycles-pp.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +13.0       12.97 ±  4%  perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +13.3       13.30 ±  4%  perf-profile.calltrace.cycles-pp.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      1.64 ±  2%     +51.3       52.90 ±  2%  perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty
      0.00           +51.7       51.68 ±  2%  perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      0.00           +54.1       54.13 ±  2%  perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +65.3       65.26 ±  2%  perf-profile.calltrace.cycles-pp.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.00           +79.3       79.25        perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00           +83.9       83.87        perf-profile.calltrace.cycles-pp.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     64.18           -58.9        5.33 ±  8%  perf-profile.children.cycles-pp.ext4_da_write_begin
     27.62 ±  2%     -27.5        0.14 ± 30%  perf-profile.children.cycles-pp.ext4_da_write_end
     62.58            -6.6       55.98 ±  2%  perf-profile.children.cycles-pp.__ext4_journal_start_sb
     58.12            -5.0       53.09 ±  2%  perf-profile.children.cycles-pp.start_this_handle
     58.41            -5.0       53.45 ±  2%  perf-profile.children.cycles-pp.jbd2__journal_start
     18.14 ±  5%      -4.4       13.77 ±  4%  perf-profile.children.cycles-pp.__ext4_journal_stop
     17.80 ±  5%      -4.4       13.44 ±  4%  perf-profile.children.cycles-pp.jbd2_journal_stop
     97.33            -2.2       95.11        perf-profile.children.cycles-pp.ext4_buffered_write_iter
      9.42 ±  9%      -2.2        7.25 ±  5%  perf-profile.children.cycles-pp.stop_this_handle
     97.46            -2.1       95.36        perf-profile.children.cycles-pp.new_sync_write
     97.78            -1.8       95.99        perf-profile.children.cycles-pp.vfs_write
     97.87            -1.7       96.14        perf-profile.children.cycles-pp.ksys_write
      4.14 ± 10%      -1.6        2.50 ±  3%  perf-profile.children.cycles-pp.ext4_journal_check_start
     10.38 ±  4%      -1.6        8.83        perf-profile.children.cycles-pp.add_transaction_credits
     92.76            -1.4       91.32        perf-profile.children.cycles-pp.generic_perform_write
     98.31            -1.4       96.93        perf-profile.children.cycles-pp.write
      1.18 ± 12%      -0.7        0.45 ±  6%  perf-profile.children.cycles-pp.up_write
     99.36            -0.5       98.90        perf-profile.children.cycles-pp.do_syscall_64
     99.43            -0.4       98.99        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      9.33 ±  2%      -0.4        8.93 ±  3%  perf-profile.children.cycles-pp._raw_read_lock
      0.66 ±  2%      -0.2        0.46 ±  4%  perf-profile.children.cycles-pp.unlock_page
      0.57 ±  5%      -0.1        0.45 ±  6%  perf-profile.children.cycles-pp.down_write
      2.59            -0.1        2.48 ±  2%  perf-profile.children.cycles-pp.generic_update_time
      0.08 ±  5%      +0.0        0.10 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.07 ±  7%      +0.0        0.09 ± 12%  perf-profile.children.cycles-pp.try_charge_memcg
      0.07 ±  5%      +0.0        0.09 ±  4%  perf-profile.children.cycles-pp.find_lock_entries
      0.06 ±  8%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.current_time
      0.21 ±  2%      +0.0        0.24 ±  6%  perf-profile.children.cycles-pp.tick_sched_handle
      0.21 ±  2%      +0.0        0.24 ±  6%  perf-profile.children.cycles-pp.update_process_times
      0.23 ±  2%      +0.0        0.26 ±  6%  perf-profile.children.cycles-pp.tick_sched_timer
      0.05 ±  8%      +0.0        0.09 ±  8%  perf-profile.children.cycles-pp.generic_write_checks
      0.06 ±  9%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.xas_store
      0.45 ±  3%      +0.0        0.48 ±  4%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.29 ±  3%      +0.0        0.33 ±  5%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.11            +0.0        0.15 ±  3%  perf-profile.children.cycles-pp.__cond_resched
      0.04 ± 44%      +0.0        0.08 ±  4%  perf-profile.children.cycles-pp.__fsnotify_parent
      0.07 ±  5%      +0.0        0.11 ±  8%  perf-profile.children.cycles-pp.ext4_generic_write_checks
      0.05 ±  8%      +0.0        0.10 ±  8%  perf-profile.children.cycles-pp.crypto_shash_update
      0.04 ± 47%      +0.0        0.09 ± 12%  perf-profile.children.cycles-pp.balance_dirty_pages_ratelimited
      0.10 ±  9%      +0.0        0.15 ±  6%  perf-profile.children.cycles-pp.block_invalidatepage
      0.02 ±141%      +0.0        0.06        perf-profile.children.cycles-pp.rcu_all_qs
      0.06 ±  7%      +0.0        0.11 ±  5%  perf-profile.children.cycles-pp.__ext4_new_inode
      0.62 ±  3%      +0.0        0.66 ±  4%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.07 ±  7%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.ksys_lseek
      0.13 ±  5%      +0.0        0.18 ±  2%  perf-profile.children.cycles-pp.__might_sleep
      0.05 ±  8%      +0.0        0.10 ± 13%  perf-profile.children.cycles-pp.rmqueue
      0.07 ±  5%      +0.0        0.12 ±  7%  perf-profile.children.cycles-pp.free_buffer_head
      0.08 ±  4%      +0.0        0.13 ±  2%  perf-profile.children.cycles-pp.__get_user_nocheck_1
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.__mod_node_page_state
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.__dquot_alloc_space
      0.04 ± 44%      +0.1        0.10 ± 13%  perf-profile.children.cycles-pp.__ext4_unlink
      0.00            +0.1        0.05 ± 13%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.unaccount_page_cache_page
      0.00            +0.1        0.06 ± 13%  perf-profile.children.cycles-pp.drop_buffers
      0.14 ±  3%      +0.1        0.19 ±  6%  perf-profile.children.cycles-pp.kmem_cache_free
      0.01 ±223%      +0.1        0.06 ± 11%  perf-profile.children.cycles-pp.page_cache_free_page
      0.08            +0.1        0.14 ±  5%  perf-profile.children.cycles-pp.__fget_light
      0.50 ±  3%      +0.1        0.56 ±  4%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.ext4_add_nondir
      0.00            +0.1        0.06 ± 15%  perf-profile.children.cycles-pp.__es_insert_extent
      0.00            +0.1        0.06 ± 23%  perf-profile.children.cycles-pp.errseq_check
      0.00            +0.1        0.06 ± 16%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.ext4_fc_track_inode
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.xas_start
      0.05 ±  8%      +0.1        0.11 ±  8%  perf-profile.children.cycles-pp.ext4_file_write_iter
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.down_read
      0.08 ±  6%      +0.1        0.14        perf-profile.children.cycles-pp.disk_rw
      0.09 ±  7%      +0.1        0.15 ± 11%  perf-profile.children.cycles-pp.ext4_es_lookup_extent
      0.11 ±  4%      +0.1        0.18 ±  2%  perf-profile.children.cycles-pp.iov_iter_fault_in_readable
      0.01 ±223%      +0.1        0.08 ± 14%  perf-profile.children.cycles-pp.page_counter_try_charge
      0.10 ±  5%      +0.1        0.16 ±  4%  perf-profile.children.cycles-pp.__fdget_pos
      0.06 ±  9%      +0.1        0.12 ± 10%  perf-profile.children.cycles-pp.__cancel_dirty_page
      0.03 ± 70%      +0.1        0.10 ±  9%  perf-profile.children.cycles-pp.page_counter_cancel
      0.00            +0.1        0.07 ± 27%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.00            +0.1        0.07 ± 18%  perf-profile.children.cycles-pp.ext4_nonda_switch
      0.09 ±  5%      +0.1        0.16 ±  5%  perf-profile.children.cycles-pp.ext4_unlink
      0.10 ±  3%      +0.1        0.18 ±  3%  perf-profile.children.cycles-pp.xas_load
      0.06 ±  6%      +0.1        0.14 ±  3%  perf-profile.children.cycles-pp.ext4_da_reserve_space
      0.09            +0.1        0.17 ±  6%  perf-profile.children.cycles-pp.vfs_unlink
      0.10 ±  4%      +0.1        0.18 ±  4%  perf-profile.children.cycles-pp.ext4_create
      0.03 ± 70%      +0.1        0.11 ± 11%  perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
      0.04 ± 71%      +0.1        0.12 ±  9%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.10 ±  4%      +0.1        0.18 ±  3%  perf-profile.children.cycles-pp.delete_from_page_cache_batch
      0.00            +0.1        0.08 ± 17%  perf-profile.children.cycles-pp.get_obj_cgroup_from_current
      0.03 ± 70%      +0.1        0.12 ±  8%  perf-profile.children.cycles-pp.ext4_es_insert_delayed_block
      0.10 ±  4%      +0.1        0.19 ± 13%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.02 ±141%      +0.1        0.10 ± 13%  perf-profile.children.cycles-pp.uncharge_batch
      0.03 ±102%      +0.1        0.12 ± 18%  perf-profile.children.cycles-pp.osq_lock
      0.00            +0.1        0.09 ± 13%  perf-profile.children.cycles-pp.account_page_cleaned
      0.00            +0.1        0.10 ± 34%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.02 ±141%      +0.1        0.12 ± 29%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      0.09 ±  6%      +0.1        0.19 ±  4%  perf-profile.children.cycles-pp.common_file_perm
      0.13 ±  5%      +0.1        0.24 ± 10%  perf-profile.children.cycles-pp.__alloc_pages
      0.15 ±  4%      +0.1        0.26 ±  3%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.21 ±  3%      +0.1        0.32 ±  4%  perf-profile.children.cycles-pp.___might_sleep
      0.00            +0.1        0.12 ± 14%  perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
      0.01 ±223%      +0.1        0.13 ± 35%  perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
      0.09            +0.1        0.22 ± 22%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.23 ±  4%      +0.1        0.36 ± 22%  perf-profile.children.cycles-pp.mem_cgroup_charge
      0.14 ±  6%      +0.1        0.27 ± 11%  perf-profile.children.cycles-pp.__pagevec_lru_add
      0.11 ±  6%      +0.1        0.25 ±  3%  perf-profile.children.cycles-pp.security_file_permission
      0.02 ± 99%      +0.1        0.16 ± 11%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      0.17 ±  3%      +0.1        0.31 ±  2%  perf-profile.children.cycles-pp.__entry_text_start
      0.19 ±  3%      +0.1        0.34 ± 10%  perf-profile.children.cycles-pp.lru_cache_add
      0.12 ±  6%      +0.1        0.26 ± 12%  perf-profile.children.cycles-pp.alloc_buffer_head
      0.13 ± 10%      +0.1        0.27 ±  9%  perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.08 ±  8%      +0.2        0.23 ± 10%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.18 ±  4%      +0.2        0.34 ±  8%  perf-profile.children.cycles-pp.try_to_free_buffers
      0.13 ±  5%      +0.2        0.29 ± 11%  perf-profile.children.cycles-pp.alloc_page_buffers
      0.27 ±  3%      +0.2        0.44 ±  6%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.15 ±  9%      +0.2        0.32 ±  9%  perf-profile.children.cycles-pp.do_unlinkat
      0.15 ±  9%      +0.2        0.33 ±  9%  perf-profile.children.cycles-pp.unlink
      0.38 ±  7%      +0.2        0.57 ±  3%  perf-profile.children.cycles-pp.__brelse
      0.27            +0.2        0.46 ±  3%  perf-profile.children.cycles-pp.llseek
      0.17 ±  5%      +0.2        0.38 ± 10%  perf-profile.children.cycles-pp.__pagevec_release
      0.22 ±  7%      +0.2        0.43 ± 28%  perf-profile.children.cycles-pp.memset_erms
      0.10 ± 25%      +0.2        0.30 ± 15%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      0.18 ±  4%      +0.2        0.39 ± 10%  perf-profile.children.cycles-pp.release_pages
      0.15 ±  6%      +0.2        0.36 ± 25%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.34 ±  5%      +0.2        0.55 ±  9%  perf-profile.children.cycles-pp.create_empty_buffers
      0.22 ±  7%      +0.2        0.44 ±  7%  perf-profile.children.cycles-pp.ext4_inode_csum
      0.21 ±  7%      +0.2        0.44 ±  8%  perf-profile.children.cycles-pp.creat64
      0.12 ±  5%      +0.2        0.36 ± 21%  perf-profile.children.cycles-pp.__set_page_dirty
      0.53 ±  2%      +0.2        0.77 ± 16%  perf-profile.children.cycles-pp.__add_to_page_cache_locked
      0.47 ±  4%      +0.2        0.71 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock
      0.22 ±  7%      +0.2        0.46 ±  8%  perf-profile.children.cycles-pp.do_filp_open
      0.22 ±  7%      +0.2        0.46 ±  8%  perf-profile.children.cycles-pp.path_openat
      0.23 ±  6%      +0.2        0.48 ±  8%  perf-profile.children.cycles-pp.do_sys_open
      0.38 ±  4%      +0.2        0.63 ±  6%  perf-profile.children.cycles-pp.truncate_cleanup_page
      0.22 ±  6%      +0.3        0.48 ±  8%  perf-profile.children.cycles-pp.do_sys_openat2
      0.24 ±  6%      +0.3        0.50 ±  6%  perf-profile.children.cycles-pp.ext4_inode_csum_set
      1.00 ±  3%      +0.3        1.32 ±  4%  perf-profile.children.cycles-pp.mark_buffer_dirty
      0.29 ±  4%      +0.4        0.67 ±  2%  perf-profile.children.cycles-pp.ext4_da_get_block_prep
      0.28 ±  5%      +0.4        0.66 ±  2%  perf-profile.children.cycles-pp.ext4_da_map_blocks
      0.73 ±  2%      +0.4        1.13 ± 14%  perf-profile.children.cycles-pp.add_to_page_cache_lru
      0.52 ±  2%      +0.4        0.94 ± 25%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.54 ±  2%      +0.5        1.01 ± 23%  perf-profile.children.cycles-pp.copyin
      0.29 ±  2%      +0.5        0.84 ±  7%  perf-profile.children.cycles-pp.jbd2_write_access_granted
      0.73 ±  3%      +0.6        1.30 ±  6%  perf-profile.children.cycles-pp.truncate_inode_pages_range
      0.82 ±  3%      +0.6        1.47 ±  5%  perf-profile.children.cycles-pp.ext4_evict_inode
      0.83 ±  3%      +0.6        1.48 ±  5%  perf-profile.children.cycles-pp.evict
      0.84 ±  3%      +0.6        1.49 ±  6%  perf-profile.children.cycles-pp.__dentry_kill
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.children.cycles-pp.dput
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.children.cycles-pp.__fput
      0.84 ±  3%      +0.7        1.50 ±  6%  perf-profile.children.cycles-pp.task_work_run
      0.85 ±  3%      +0.7        1.52 ±  6%  perf-profile.children.cycles-pp.__close
      0.89 ±  3%      +0.7        1.58 ±  6%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.92 ±  3%      +0.7        1.65 ±  5%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.66 ±  3%      +0.8        1.47 ± 20%  perf-profile.children.cycles-pp.copy_page_from_iter_atomic
      0.93 ±  3%      +0.9        1.85 ± 11%  perf-profile.children.cycles-pp.ext4_block_write_begin
      1.46 ± 10%      +1.0        2.49 ±  3%  perf-profile.children.cycles-pp.jbd2_journal_dirty_metadata
      0.35 ±  4%      +1.0        1.39 ±  2%  perf-profile.children.cycles-pp.__find_get_block
      0.38 ±  3%      +1.1        1.44 ±  2%  perf-profile.children.cycles-pp.__getblk_gfp
      2.04            +1.2        3.21 ±  6%  perf-profile.children.cycles-pp.pagecache_get_page
      2.05            +1.2        3.22 ±  6%  perf-profile.children.cycles-pp.grab_cache_page_write_begin
      0.48 ±  4%      +1.2        1.66 ±  2%  perf-profile.children.cycles-pp.__ext4_get_inode_loc
      0.49 ±  3%      +1.2        1.67 ±  2%  perf-profile.children.cycles-pp.ext4_get_inode_loc
      1.60 ± 12%      +1.2        2.81 ±  5%  perf-profile.children.cycles-pp.__ext4_handle_dirty_metadata
      1.73 ±  8%      +1.5        3.24 ±  3%  perf-profile.children.cycles-pp.jbd2_journal_get_write_access
      2.17 ±  3%      +1.5        3.70 ± 15%  perf-profile.children.cycles-pp.block_write_end
      1.81 ±  8%      +1.6        3.41 ±  3%  perf-profile.children.cycles-pp.__ext4_journal_get_write_access
      1.81 ±  3%      +1.8        3.57 ± 14%  perf-profile.children.cycles-pp.__block_commit_write
      3.03 ±  5%      +2.4        5.46 ±  4%  perf-profile.children.cycles-pp.ext4_do_update_inode
      2.30 ±  6%      +2.8        5.09 ±  2%  perf-profile.children.cycles-pp.ext4_reserve_inode_write
      3.59 ±  4%      +2.8        6.38 ±  3%  perf-profile.children.cycles-pp.ext4_mark_iloc_dirty
      5.90 ±  5%      +5.6       11.54 ±  2%  perf-profile.children.cycles-pp.__ext4_mark_inode_dirty
      8.97 ±  5%     +58.3       67.29 ±  2%  perf-profile.children.cycles-pp.ext4_dirty_inode
     10.77 ±  5%     +71.0       81.81        perf-profile.children.cycles-pp.__mark_inode_dirty
     10.97 ±  5%     +72.9       83.90        perf-profile.children.cycles-pp.generic_write_end
     37.84 ±  2%      -3.0       34.89 ±  3%  perf-profile.self.cycles-pp.start_this_handle
      8.26 ±  2%      -2.2        6.09 ±  3%  perf-profile.self.cycles-pp.jbd2_journal_stop
      9.37 ±  9%      -2.2        7.20 ±  5%  perf-profile.self.cycles-pp.stop_this_handle
      4.06 ± 10%      -1.6        2.44 ±  3%  perf-profile.self.cycles-pp.ext4_journal_check_start
     10.32 ±  4%      -1.6        8.77        perf-profile.self.cycles-pp.add_transaction_credits
      1.36 ±  4%      -1.2        0.17 ±  8%  perf-profile.self.cycles-pp.ext4_da_write_begin
      1.17 ± 12%      -0.7        0.45 ±  5%  perf-profile.self.cycles-pp.up_write
      9.27 ±  2%      -0.4        8.87 ±  3%  perf-profile.self.cycles-pp._raw_read_lock
      0.65 ±  2%      -0.2        0.46 ±  4%  perf-profile.self.cycles-pp.unlock_page
      0.54 ±  6%      -0.2        0.38 ±  7%  perf-profile.self.cycles-pp.down_write
      0.08 ±  4%      +0.0        0.10 ±  6%  perf-profile.self.cycles-pp.kmem_cache_free
      0.06 ±  7%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.__add_to_page_cache_locked
      0.08 ±  5%      +0.0        0.10 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.06 ±  7%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.find_lock_entries
      0.07 ±  5%      +0.0        0.10 ±  5%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.08 ±  7%      +0.0        0.11 ±  5%  perf-profile.self.cycles-pp.block_invalidatepage
      0.06 ±  9%      +0.0        0.09 ±  4%  perf-profile.self.cycles-pp.truncate_cleanup_page
      0.04 ± 45%      +0.0        0.08 ±  8%  perf-profile.self.cycles-pp.balance_dirty_pages_ratelimited
      0.12 ±  5%      +0.0        0.16 ±  4%  perf-profile.self.cycles-pp.__might_sleep
      0.06 ±  9%      +0.0        0.10 ±  6%  perf-profile.self.cycles-pp.ext4_inode_csum
      0.03 ± 70%      +0.0        0.08 ±  4%  perf-profile.self.cycles-pp.__fsnotify_parent
      0.04 ± 44%      +0.0        0.09 ±  6%  perf-profile.self.cycles-pp.new_sync_write
      0.07 ±  8%      +0.0        0.12        perf-profile.self.cycles-pp.__get_user_nocheck_1
      0.08 ±  6%      +0.1        0.13 ±  9%  perf-profile.self.cycles-pp.__pagevec_lru_add
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.xas_start
      0.08 ±  4%      +0.1        0.13 ±  4%  perf-profile.self.cycles-pp.xas_load
      0.00            +0.1        0.05 ±  7%  perf-profile.self.cycles-pp.iov_iter_fault_in_readable
      0.06 ±  7%      +0.1        0.12 ±  6%  perf-profile.self.cycles-pp.release_pages
      0.06 ±  8%      +0.1        0.11 ± 13%  perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      0.00            +0.1        0.06 ± 13%  perf-profile.self.cycles-pp.drop_buffers
      0.07 ±  7%      +0.1        0.12 ±  3%  perf-profile.self.cycles-pp.disk_rw
      0.01 ±223%      +0.1        0.06 ± 11%  perf-profile.self.cycles-pp.page_cache_free_page
      0.08 ±  6%      +0.1        0.13 ±  2%  perf-profile.self.cycles-pp.__fget_light
      0.10 ±  4%      +0.1        0.16 ±  6%  perf-profile.self.cycles-pp.create_empty_buffers
      0.00            +0.1        0.06 ± 25%  perf-profile.self.cycles-pp.errseq_check
      0.05 ±  7%      +0.1        0.11 ±  5%  perf-profile.self.cycles-pp.ext4_file_write_iter
      0.00            +0.1        0.06 ±  9%  perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.00            +0.1        0.06 ±  6%  perf-profile.self.cycles-pp.file_update_time
      0.00            +0.1        0.06 ±  6%  perf-profile.self.cycles-pp.ext4_buffered_write_iter
      0.08 ±  5%      +0.1        0.15 ± 11%  perf-profile.self.cycles-pp.generic_perform_write
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.llseek
      0.00            +0.1        0.06 ± 11%  perf-profile.self.cycles-pp.__cond_resched
      0.03 ±100%      +0.1        0.09 ± 11%  perf-profile.self.cycles-pp.crypto_shash_update
      0.00            +0.1        0.07 ±  7%  perf-profile.self.cycles-pp.ext4_es_lookup_extent
      0.08 ±  5%      +0.1        0.15 ±  4%  perf-profile.self.cycles-pp.__entry_text_start
      0.00            +0.1        0.07 ± 21%  perf-profile.self.cycles-pp.ext4_nonda_switch
      0.00            +0.1        0.07 ± 15%  perf-profile.self.cycles-pp.page_counter_try_charge
      0.00            +0.1        0.07 ± 15%  perf-profile.self.cycles-pp.copyin
      0.03 ± 70%      +0.1        0.10 ±  9%  perf-profile.self.cycles-pp.page_counter_cancel
      0.00            +0.1        0.07 ± 27%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.08 ±  8%      +0.1        0.16 ±  3%  perf-profile.self.cycles-pp.write
      0.10 ±  4%      +0.1        0.17 ±  3%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.00            +0.1        0.08 ±  6%  perf-profile.self.cycles-pp.__ext4_journal_get_write_access
      0.06 ±  9%      +0.1        0.14 ±  9%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.09 ±  5%      +0.1        0.16 ±  4%  perf-profile.self.cycles-pp.__ext4_get_inode_loc
      0.00            +0.1        0.08 ± 17%  perf-profile.self.cycles-pp.get_obj_cgroup_from_current
      0.08 ±  6%      +0.1        0.16 ±  3%  perf-profile.self.cycles-pp.common_file_perm
      0.03 ±102%      +0.1        0.12 ± 16%  perf-profile.self.cycles-pp.osq_lock
      0.00            +0.1        0.09 ± 32%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.11 ±  6%      +0.1        0.20 ±  3%  perf-profile.self.cycles-pp.vfs_write
      0.00            +0.1        0.10 ± 35%  perf-profile.self.cycles-pp.percpu_counter_add_batch
      0.06 ± 11%      +0.1        0.16 ± 34%  perf-profile.self.cycles-pp.__mod_lruvec_page_state
      0.20 ±  4%      +0.1        0.31 ±  3%  perf-profile.self.cycles-pp.___might_sleep
      0.14 ±  5%      +0.1        0.26 ±  2%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.01 ±223%      +0.1        0.13 ± 35%  perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
      0.05            +0.1        0.17 ±  7%  perf-profile.self.cycles-pp.ext4_da_map_blocks
      0.13 ±  3%      +0.1        0.25 ± 12%  perf-profile.self.cycles-pp.ext4_block_write_begin
      0.02 ± 99%      +0.1        0.16 ± 11%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      0.12 ±  9%      +0.1        0.25 ±  9%  perf-profile.self.cycles-pp.crc32c_pcl_intel_update
      0.11 ± 42%      +0.2        0.28 ± 29%  perf-profile.self.cycles-pp.__ext4_handle_dirty_metadata
      0.33 ±  4%      +0.2        0.51 ± 12%  perf-profile.self.cycles-pp.generic_write_end
      0.38 ±  7%      +0.2        0.56 ±  3%  perf-profile.self.cycles-pp.__brelse
      0.22 ±  5%      +0.2        0.42 ± 28%  perf-profile.self.cycles-pp.memset_erms
      0.47 ±  5%      +0.2        0.70 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock
      0.12 ±  6%      +0.3        0.46 ± 13%  perf-profile.self.cycles-pp.copy_page_from_iter_atomic
      0.53 ±  7%      +0.3        0.86 ±  2%  perf-profile.self.cycles-pp.ext4_mark_iloc_dirty
      0.36 ± 12%      +0.4        0.74 ± 37%  perf-profile.self.cycles-pp.block_write_end
      0.52 ±  2%      +0.4        0.93 ± 25%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      1.03 ±  2%      +0.5        1.56 ±  2%  perf-profile.self.cycles-pp.pagecache_get_page
      0.28 ±  2%      +0.5        0.83 ±  7%  perf-profile.self.cycles-pp.jbd2_write_access_granted
      0.55 ±  4%      +0.6        1.12 ±  3%  perf-profile.self.cycles-pp.ext4_do_update_inode
      0.21 ±  7%      +0.6        0.78 ±  5%  perf-profile.self.cycles-pp.__mark_inode_dirty
      0.78 ±  4%      +0.8        1.54 ± 13%  perf-profile.self.cycles-pp.__block_commit_write
      1.44 ± 10%      +0.9        2.38 ±  4%  perf-profile.self.cycles-pp.jbd2_journal_get_write_access
      1.46 ± 10%      +1.0        2.47 ±  4%  perf-profile.self.cycles-pp.jbd2_journal_dirty_metadata
      0.33 ±  4%      +1.0        1.34 ±  2%  perf-profile.self.cycles-pp.__find_get_block



***************************************************************************************************
lkp-icl-2sp2: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/1BRD_48G/ext4/x86_64-rhel-8.3/3000/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp2/disk_rw/aim7/0xd000280

commit: 
  6984aef598 ("ext4: factor out write end code of inline file")
  cc883236b7 ("ext4: drop unnecessary journal handle in delalloc write")

6984aef59814fb5c cc883236b79297f6266ca6f4e7f 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    151790           +68.6%     255987 ±  2%  aim7.jobs-per-min
    118.77           -40.6%      70.53 ±  2%  aim7.time.elapsed_time
    118.77           -40.6%      70.53 ±  2%  aim7.time.elapsed_time.max
    868735 ±  2%     -55.3%     388069 ±  3%  aim7.time.involuntary_context_switches
    219053            -9.8%     197584        aim7.time.minor_page_faults
     13359           -44.2%       7459 ±  2%  aim7.time.system_time
     64.40            -9.5%      58.29        aim7.time.user_time
    134967 ±  2%     -39.6%      81532 ±  2%  aim7.time.voluntary_context_switches
    175.29           -26.1%     129.57 ±  3%  uptime.boot
 1.803e+09 ±  2%     -11.0%  1.605e+09        cpuidle..time
   3711800 ±  2%     -19.2%    2999096 ± 15%  cpuidle..usage
     12.91 ±  3%     +48.2%      19.13 ±  3%  iostat.cpu.idle
     86.54            -7.4%      80.12        iostat.cpu.system
     11.49 ±  3%      +5.5       16.94 ±  3%  mpstat.cpu.all.idle%
      0.03 ±  7%      +0.0        0.04 ±  4%  mpstat.cpu.all.soft%
      0.54 ±  4%      +0.2        0.75 ±  3%  mpstat.cpu.all.usr%
      7324 ± 43%     -50.4%       3630 ±  9%  softirqs.CPU11.RCU
    707884 ± 16%     -35.2%     458881 ±  3%  softirqs.RCU
    646318           -16.0%     542591        softirqs.SCHED
     39269 ±  4%     -23.2%      30160 ±  5%  softirqs.TIMER
   3699232 ±  2%     -25.3%    2764757 ± 28%  turbostat.C1
     11.73 ±  2%      +5.5       17.25 ±  2%  turbostat.C1%
  33948074           -42.6%   19487840 ± 16%  turbostat.IRQ
     72.67            -3.2%      70.33        turbostat.PkgTmp
     12.33 ±  3%     +48.6%      18.33 ±  2%  vmstat.cpu.id
      7957 ±  7%     +57.5%      12531        vmstat.io.bo
    225.00           -24.3%     170.33 ±  3%  vmstat.procs.r
     10778           -13.9%       9283        vmstat.system.cs
    187616 ±  3%     -19.9%     150277 ±  4%  meminfo.Active
    186694 ±  3%     -20.0%     149403 ±  4%  meminfo.Active(anon)
    129742           -27.2%      94422 ±  2%  meminfo.AnonHugePages
   1335222           +14.8%    1532476 ±  2%  meminfo.Dirty
   1334695           +14.8%    1531712 ±  2%  meminfo.Inactive(file)
    139750 ± 10%     -43.0%      79641 ±  3%  meminfo.Mapped
    284982 ±  2%     -27.0%     208020 ±  2%  meminfo.Shmem
      4338 ± 19%     -51.8%       2091 ±  4%  numa-meminfo.node0.Active
      3584 ± 23%     -59.5%       1450 ± 11%  numa-meminfo.node0.Active(anon)
    125913           -55.7%      55835 ± 55%  numa-meminfo.node0.AnonHugePages
    711344 ±  8%     +22.9%     874446 ±  7%  numa-meminfo.node0.Dirty
    372289           -29.3%     263302 ± 26%  numa-meminfo.node0.Inactive(anon)
    711408 ±  8%     +22.9%     874418 ±  7%  numa-meminfo.node0.Inactive(file)
     85598           -42.8%      48994 ±  2%  numa-meminfo.node0.Mapped
     64916           -70.1%      19387        numa-meminfo.node0.Shmem
    182640 ±  2%     -19.2%     147659 ±  4%  numa-meminfo.node1.Active
    182473 ±  2%     -19.2%     147426 ±  4%  numa-meminfo.node1.Active(anon)
      3830 ± 10%    +912.6%      38789 ± 76%  numa-meminfo.node1.AnonHugePages
     62782 ±  4%     +91.2%     120069 ± 57%  numa-meminfo.node1.AnonPages
     94909 ±  3%     +68.2%     159602 ± 43%  numa-meminfo.node1.AnonPages.max
     54555 ± 23%     -42.7%      31233 ±  4%  numa-meminfo.node1.Mapped
    943.67 ± 15%     +28.3%       1210 ± 10%  numa-meminfo.node1.PageTables
    219838 ±  3%     -14.1%     188859 ±  2%  numa-meminfo.node1.Shmem
    896.00 ± 23%     -59.6%     362.00 ± 11%  numa-vmstat.node0.nr_active_anon
    177806 ±  8%     +23.0%     218683 ±  7%  numa-vmstat.node0.nr_dirty
     93179           -29.3%      65837 ± 26%  numa-vmstat.node0.nr_inactive_anon
    177847 ±  8%     +23.0%     218682 ±  7%  numa-vmstat.node0.nr_inactive_file
     21446           -42.9%      12249 ±  2%  numa-vmstat.node0.nr_mapped
     16339           -70.3%       4846        numa-vmstat.node0.nr_shmem
    896.00 ± 23%     -59.6%     362.00 ± 11%  numa-vmstat.node0.nr_zone_active_anon
     93179           -29.3%      65837 ± 26%  numa-vmstat.node0.nr_zone_inactive_anon
    177850 ±  8%     +23.0%     218677 ±  7%  numa-vmstat.node0.nr_zone_inactive_file
    178506 ±  8%     +22.7%     219083 ±  7%  numa-vmstat.node0.nr_zone_write_pending
     45719 ±  2%     -19.4%      36859 ±  4%  numa-vmstat.node1.nr_active_anon
     15680 ±  3%     +91.4%      30007 ± 57%  numa-vmstat.node1.nr_anon_pages
     13550 ± 21%     -42.2%       7825 ±  4%  numa-vmstat.node1.nr_mapped
    235.00 ± 15%     +28.5%     302.00 ± 10%  numa-vmstat.node1.nr_page_table_pages
     54985 ±  3%     -14.2%      47179 ±  2%  numa-vmstat.node1.nr_shmem
     45719 ±  2%     -19.4%      36859 ±  4%  numa-vmstat.node1.nr_zone_active_anon
     46724 ±  3%     -19.7%      37511 ±  4%  proc-vmstat.nr_active_anon
     93421            -2.1%      91433        proc-vmstat.nr_anon_pages
    333755           +14.1%     380964 ±  2%  proc-vmstat.nr_dirty
   1001846            +2.8%    1029557        proc-vmstat.nr_file_pages
    118434 ±  3%     -10.3%     106261        proc-vmstat.nr_inactive_anon
    333610           +14.1%     380766 ±  2%  proc-vmstat.nr_inactive_file
     64339            -2.0%      63068        proc-vmstat.nr_kernel_stack
     35075 ±  8%     -43.5%      19832 ±  3%  proc-vmstat.nr_mapped
     71442 ±  2%     -27.1%      52074 ±  2%  proc-vmstat.nr_shmem
     92247            -1.7%      90635        proc-vmstat.nr_slab_unreclaimable
     46724 ±  3%     -19.7%      37511 ±  4%  proc-vmstat.nr_zone_active_anon
    118434 ±  3%     -10.3%     106261        proc-vmstat.nr_zone_inactive_anon
    333610           +14.1%     380766 ±  2%  proc-vmstat.nr_zone_inactive_file
    335279           +13.8%     381599 ±  2%  proc-vmstat.nr_zone_write_pending
     65733 ±  3%     -55.8%      29049 ±  2%  proc-vmstat.numa_hint_faults
     34127 ±  2%     -69.6%      10388 ±  4%  proc-vmstat.numa_hint_faults_local
     30107           -38.0%      18660 ±  2%  proc-vmstat.numa_pages_migrated
    211132 ±  2%     -82.4%      37200 ± 26%  proc-vmstat.numa_pte_updates
     57404 ±  3%     +10.9%      63635        proc-vmstat.pgactivate
    823452           -35.6%     530237        proc-vmstat.pgfault
     30107           -38.0%      18660 ±  2%  proc-vmstat.pgmigrate_success
     31193           -30.9%      21556 ±  3%  proc-vmstat.pgreuse
    354174           +14.6%     405892 ±  2%  slabinfo.buffer_head.active_objs
      9168           +14.4%      10488 ±  2%  slabinfo.buffer_head.active_slabs
    357584           +14.4%     409080 ±  2%  slabinfo.buffer_head.num_objs
      9168           +14.4%      10488 ±  2%  slabinfo.buffer_head.num_slabs
     21769 ± 15%     +24.7%      27137 ± 14%  slabinfo.ep_head.active_objs
     21769 ± 15%     +24.7%      27137 ± 14%  slabinfo.ep_head.num_objs
    778.00 ±  2%     +22.9%     956.33 ±  7%  slabinfo.ext4_allocation_context.active_objs
    778.00 ±  2%     +22.9%     956.33 ±  7%  slabinfo.ext4_allocation_context.num_objs
     12685 ±  4%     -13.6%      10962        slabinfo.ext4_extent_status.active_objs
     12685 ±  4%     -13.6%      10962        slabinfo.ext4_extent_status.num_objs
      7220 ±  3%     +16.2%       8390 ±  4%  slabinfo.ext4_inode_cache.active_objs
      7220 ±  3%     +16.5%       8411 ±  4%  slabinfo.ext4_inode_cache.num_objs
      3962 ±  3%     +19.5%       4736 ±  2%  slabinfo.jbd2_journal_head.active_objs
      3962 ±  3%     +19.5%       4736 ±  2%  slabinfo.jbd2_journal_head.num_objs
      1206 ±  8%     -12.7%       1053 ±  8%  slabinfo.mnt_cache.active_objs
      1206 ±  8%     -12.7%       1053 ±  8%  slabinfo.mnt_cache.num_objs
     11761 ±  4%      -7.1%      10928 ±  7%  slabinfo.pde_opener.active_objs
     11761 ±  4%      -7.1%      10928 ±  7%  slabinfo.pde_opener.num_objs
      6044 ±  6%     -10.0%       5442 ±  6%  slabinfo.shmem_inode_cache.active_objs
      6044 ±  6%     -10.0%       5442 ±  6%  slabinfo.shmem_inode_cache.num_objs
      1373 ±  4%     -10.4%       1231 ±  4%  slabinfo.task_group.active_objs
      1373 ±  4%     -10.4%       1231 ±  4%  slabinfo.task_group.num_objs
 5.438e+09           +46.5%  7.966e+09 ±  2%  perf-stat.i.branch-instructions
      0.71            -0.1        0.59 ±  7%  perf-stat.i.branch-miss-rate%
  35015003           +11.7%   39128509 ±  4%  perf-stat.i.branch-misses
     34.69 ±  3%      -3.2       31.51 ±  6%  perf-stat.i.cache-miss-rate%
  79939395 ±  9%     +43.1%  1.144e+08 ±  6%  perf-stat.i.cache-misses
  2.18e+08 ± 12%     +52.9%  3.334e+08 ± 14%  perf-stat.i.cache-references
     10874           -15.6%       9179        perf-stat.i.context-switches
      9.88           -36.6%       6.27 ±  2%  perf-stat.i.cpi
 2.895e+11            -6.9%  2.696e+11        perf-stat.i.cpu-cycles
      1135            -4.8%       1080        perf-stat.i.cpu-migrations
      0.01 ±  6%      -0.0        0.01 ±  5%  perf-stat.i.dTLB-load-miss-rate%
  8.49e+09           +44.9%   1.23e+10 ±  2%  perf-stat.i.dTLB-loads
      0.00            +0.0        0.00        perf-stat.i.dTLB-store-miss-rate%
     88757           +18.4%     105076 ±  4%  perf-stat.i.dTLB-store-misses
 4.494e+09           +44.8%  6.508e+09 ±  2%  perf-stat.i.dTLB-stores
 2.766e+10           +46.6%  4.055e+10 ±  2%  perf-stat.i.instructions
      0.13           +44.5%       0.19 ±  3%  perf-stat.i.ipc
     15.88 ± 17%     +95.3%      31.01 ± 39%  perf-stat.i.major-faults
      2.26            -6.7%       2.11        perf-stat.i.metric.GHz
    496.90           +31.8%     654.87        perf-stat.i.metric.K/sec
    145.34           +45.8%     211.87 ±  2%  perf-stat.i.metric.M/sec
      6367            +3.4%       6581        perf-stat.i.minor-faults
     65.34 ±  2%      +4.7       70.03        perf-stat.i.node-load-miss-rate%
   3494508 ± 11%     +32.7%    4635677 ± 12%  perf-stat.i.node-load-misses
   1969890 ±  3%     +11.2%    2189560 ±  7%  perf-stat.i.node-loads
   4449677 ±  3%     +15.3%    5129917 ±  3%  perf-stat.i.node-store-misses
  51880034           +31.5%   68199894        perf-stat.i.node-stores
      6383            +3.6%       6612        perf-stat.i.page-faults
      0.64            -0.2        0.49 ±  6%  perf-stat.overall.branch-miss-rate%
     10.49           -36.4%       6.67 ±  2%  perf-stat.overall.cpi
      3666 ±  8%     -35.6%       2361 ±  5%  perf-stat.overall.cycles-between-cache-misses
      0.01 ±  6%      -0.0        0.01 ±  6%  perf-stat.overall.dTLB-load-miss-rate%
      0.00            -0.0        0.00 ±  6%  perf-stat.overall.dTLB-store-miss-rate%
      0.10           +57.3%       0.15 ±  2%  perf-stat.overall.ipc
     63.85 ±  3%      +4.0       67.86        perf-stat.overall.node-load-miss-rate%
      7.93 ±  3%      -0.8        7.11 ±  3%  perf-stat.overall.node-store-miss-rate%
 5.441e+09           +46.6%  7.975e+09 ±  2%  perf-stat.ps.branch-instructions
  34846549           +11.8%   38953154 ±  4%  perf-stat.ps.branch-misses
  79850423 ±  9%     +44.0%   1.15e+08 ±  5%  perf-stat.ps.cache-misses
 2.186e+08 ± 12%     +53.1%  3.347e+08 ± 13%  perf-stat.ps.cache-references
     10703           -15.3%       9061        perf-stat.ps.context-switches
 2.903e+11            -6.8%  2.707e+11        perf-stat.ps.cpu-cycles
      1127            -4.7%       1074        perf-stat.ps.cpu-migrations
    944131 ±  6%     +16.3%    1097975 ±  5%  perf-stat.ps.dTLB-load-misses
   8.5e+09           +45.0%  1.233e+10 ±  2%  perf-stat.ps.dTLB-loads
     88955           +20.2%     106924 ±  4%  perf-stat.ps.dTLB-store-misses
 4.499e+09           +44.9%  6.521e+09 ±  2%  perf-stat.ps.dTLB-stores
 2.768e+10           +46.7%   4.06e+10 ±  2%  perf-stat.ps.instructions
     13.61 ± 17%     +98.5%      27.01 ± 38%  perf-stat.ps.major-faults
      6116            +1.1%       6185        perf-stat.ps.minor-faults
   3494431 ± 11%     +34.2%    4688298 ± 11%  perf-stat.ps.node-load-misses
   1964278 ±  3%     +12.5%    2209716 ±  6%  perf-stat.ps.node-loads
   4463884 ±  3%     +17.1%    5228830 ±  2%  perf-stat.ps.node-store-misses
  51830328           +31.9%   68369241        perf-stat.ps.node-stores
      6130            +1.3%       6212        perf-stat.ps.page-faults
 3.306e+12           -12.9%   2.88e+12        perf-stat.total.instructions
     51.37 ±  2%     -51.4        0.00        perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     51.23 ±  2%     -51.2        0.00        perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
     50.70 ±  2%     -50.7        0.00        perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin.generic_perform_write
     56.83 ±  2%     -50.2        6.67 ±  8%  perf-profile.calltrace.cycles-pp.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     33.21 ±  2%     -33.2        0.00        perf-profile.calltrace.cycles-pp.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     27.91 ±  4%     -27.9        0.00        perf-profile.calltrace.cycles-pp.__ext4_journal_stop.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     27.71 ±  4%     -27.7        0.00        perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter
     15.69 ±  6%     -15.7        0.00        perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_da_write_begin
     14.27 ±  8%     -14.3        0.00        perf-profile.calltrace.cycles-pp.stop_this_handle.jbd2_journal_stop.__ext4_journal_stop.ext4_da_write_end.generic_perform_write
      5.23 ±  8%      -5.2        0.00        perf-profile.calltrace.cycles-pp.generic_write_end.ext4_da_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
     96.49            -2.5       94.03        perf-profile.calltrace.cycles-pp.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     96.64            -2.3       94.33        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     91.14            -2.0       89.11        perf-profile.calltrace.cycles-pp.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
     97.01            -2.0       95.06        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.12            -1.8       95.31        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.24            -1.7       95.50        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     97.31            -1.7       95.58        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     97.59            -1.5       96.06        perf-profile.calltrace.cycles-pp.write
      1.81 ±  5%      -1.3        0.46 ± 70%  perf-profile.calltrace.cycles-pp.up_write.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
      0.53 ±  3%      +0.2        0.70 ±  3%  perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      0.58 ±  3%      +0.2        0.82 ±  8%  perf-profile.calltrace.cycles-pp.truncate_cleanup_page.truncate_inode_pages_range.ext4_evict_inode.evict.__dentry_kill
      0.93 ±  3%      +0.4        1.31 ±  7%  perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write
      1.08 ±  7%      +0.5        1.61 ±  6%  perf-profile.calltrace.cycles-pp.ext4_do_update_inode.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      1.14 ±  3%      +0.6        1.77 ± 10%  perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.ext4_evict_inode.evict.__dentry_kill.dput
      0.00            +0.6        0.64 ±  8%  perf-profile.calltrace.cycles-pp.down_write.ext4_buffered_write_iter.new_sync_write.vfs_write.ksys_write
      0.00            +0.7        0.67 ± 19%  perf-profile.calltrace.cycles-pp.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      1.23 ±  2%      +0.7        1.91 ±  9%  perf-profile.calltrace.cycles-pp.ext4_evict_inode.evict.__dentry_kill.dput.__fput
      1.24 ±  2%      +0.7        1.93 ±  9%  perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_user_mode_prepare
      1.23 ±  2%      +0.7        1.92 ±  9%  perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dput.__fput.task_work_run
      1.25 ±  2%      +0.7        1.94 ±  9%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      1.25 ±  3%      +0.7        1.94 ±  9%  perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      1.26 ±  2%      +0.7        1.95 ±  9%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.26 ±  2%      +0.7        1.95 ±  9%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__close
      1.26 ±  2%      +0.7        1.95 ±  9%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      1.26 ±  2%      +0.7        1.96 ±  9%  perf-profile.calltrace.cycles-pp.__close
      1.26 ±  2%      +0.7        1.95 ±  9%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      1.26 ±  2%      +0.7        1.95 ±  9%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__close
      1.53 ±  6%      +0.7        2.23 ±  7%  perf-profile.calltrace.cycles-pp.ext4_mark_iloc_dirty.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      0.00            +0.8        0.76 ± 12%  perf-profile.calltrace.cycles-pp.create_empty_buffers.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.00            +0.9        0.90 ± 13%  perf-profile.calltrace.cycles-pp.unlock_page.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00            +1.2        1.16 ± 14%  perf-profile.calltrace.cycles-pp.ext4_da_map_blocks.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write
      0.00            +1.2        1.19 ± 13%  perf-profile.calltrace.cycles-pp.ext4_da_get_block_prep.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.00            +1.2        1.23 ±  6%  perf-profile.calltrace.cycles-pp.__find_get_block.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write
      0.00            +1.3        1.34 ±  5%  perf-profile.calltrace.cycles-pp.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty
      0.00            +1.4        1.41 ±  6%  perf-profile.calltrace.cycles-pp.mark_buffer_dirty.__block_commit_write.block_write_end.generic_write_end.generic_perform_write
      0.83 ±  2%      +1.5        2.33 ± 10%  perf-profile.calltrace.cycles-pp.ext4_block_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00            +1.5        1.50 ±  3%  perf-profile.calltrace.cycles-pp.__ext4_get_inode_loc.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode
      0.00            +1.5        1.52 ±  3%  perf-profile.calltrace.cycles-pp.ext4_get_inode_loc.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      2.49 ±  4%      +1.6        4.07 ±  9%  perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.62 ±  5%      +1.6        2.24 ±  4%  perf-profile.calltrace.cycles-pp.ext4_reserve_inode_write.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      2.53 ±  4%      +1.6        4.15 ±  8%  perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00            +1.9        1.91 ± 78%  perf-profile.calltrace.cycles-pp._raw_read_lock.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
      0.00            +3.3        3.26 ±  6%  perf-profile.calltrace.cycles-pp.__block_commit_write.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.00            +3.6        3.59 ±  5%  perf-profile.calltrace.cycles-pp.block_write_end.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00            +4.6        4.62 ±  6%  perf-profile.calltrace.cycles-pp.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +12.8       12.82 ± 18%  perf-profile.calltrace.cycles-pp.stop_this_handle.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end
      0.18 ±141%     +13.2       13.41 ±  8%  perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode
      0.00           +24.0       23.99 ± 16%  perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +24.2       24.20 ± 16%  perf-profile.calltrace.cycles-pp.__ext4_journal_stop.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      1.56 ± 18%     +44.9       46.43 ± 10%  perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty
      0.00           +45.2       45.24 ± 10%  perf-profile.calltrace.cycles-pp.jbd2__journal_start.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end
      0.00           +45.4       45.44 ± 10%  perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write
      0.00           +50.1       50.10 ± 10%  perf-profile.calltrace.cycles-pp.ext4_dirty_inode.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter
      0.00           +75.6       75.61        perf-profile.calltrace.cycles-pp.__mark_inode_dirty.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.00           +80.6       80.57        perf-profile.calltrace.cycles-pp.generic_write_end.generic_perform_write.ext4_buffered_write_iter.new_sync_write.vfs_write
     56.87 ±  2%     -50.2        6.70 ±  8%  perf-profile.children.cycles-pp.ext4_da_write_begin
     33.22 ±  2%     -33.1        0.08        perf-profile.children.cycles-pp.ext4_da_write_end
     96.51            -2.4       94.07        perf-profile.children.cycles-pp.ext4_buffered_write_iter
     16.25 ±  6%      -2.4       13.84 ±  8%  perf-profile.children.cycles-pp.add_transaction_credits
     96.70            -2.3       94.40        perf-profile.children.cycles-pp.new_sync_write
     91.23            -2.0       89.21        perf-profile.children.cycles-pp.generic_perform_write
     97.08            -1.9       95.14        perf-profile.children.cycles-pp.vfs_write
     97.18            -1.8       95.37        perf-profile.children.cycles-pp.ksys_write
     97.68            -1.5       96.23        perf-profile.children.cycles-pp.write
      1.82 ±  5%      -1.2        0.63 ± 16%  perf-profile.children.cycles-pp.up_write
     99.28            -0.5       98.83        perf-profile.children.cycles-pp.do_syscall_64
     99.35            -0.4       98.91        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.24 ± 13%      -0.1        0.17 ±  5%  perf-profile.children.cycles-pp.queued_read_lock_slowpath
      0.08 ±  6%      +0.0        0.09        perf-profile.children.cycles-pp.try_charge_memcg
      0.05 ±  8%      +0.0        0.07 ± 12%  perf-profile.children.cycles-pp.__slab_free
      0.06 ±  8%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.drop_buffers
      0.06 ±  8%      +0.0        0.08        perf-profile.children.cycles-pp.__mod_lruvec_state
      0.08 ±  6%      +0.0        0.10        perf-profile.children.cycles-pp.rcu_all_qs
      0.06 ±  8%      +0.0        0.08 ± 11%  perf-profile.children.cycles-pp.page_counter_cancel
      0.06 ±  7%      +0.0        0.09 ± 15%  perf-profile.children.cycles-pp.page_cache_free_page
      0.06 ±  7%      +0.0        0.09        perf-profile.children.cycles-pp.__ext4_new_inode
      0.06 ±  8%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
      0.16 ±  5%      +0.0        0.19 ±  6%  perf-profile.children.cycles-pp.__mem_cgroup_charge
      0.08 ±  5%      +0.0        0.12 ± 10%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.05 ±  8%      +0.0        0.09 ±  5%  perf-profile.children.cycles-pp.rmqueue
      0.03 ± 70%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.jbd2_journal_grab_journal_head
      0.11 ±  7%      +0.0        0.14 ± 11%  perf-profile.children.cycles-pp.find_lock_entries
      0.06 ± 13%      +0.0        0.09 ± 10%  perf-profile.children.cycles-pp.page_counter_uncharge
      0.19 ±  6%      +0.0        0.23 ±  4%  perf-profile.children.cycles-pp.kmem_cache_free
      0.07 ±  6%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.xas_store
      0.07 ± 12%      +0.0        0.11 ±  8%  perf-profile.children.cycles-pp.crypto_shash_update
      0.02 ±141%      +0.0        0.06 ±  8%  perf-profile.children.cycles-pp.page_counter_try_charge
      0.02 ±141%      +0.0        0.06 ±  8%  perf-profile.children.cycles-pp.__ext4_find_entry
      0.02 ±141%      +0.0        0.06 ±  8%  perf-profile.children.cycles-pp.ext4_dx_find_entry
      0.05            +0.0        0.09        perf-profile.children.cycles-pp.__fsnotify_parent
      0.03 ± 70%      +0.0        0.07 ± 12%  perf-profile.children.cycles-pp.uncharge_batch
      0.03 ± 70%      +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.account_page_cleaned
      0.03 ± 70%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.jbd2_journal_try_to_free_buffers
      0.03 ± 70%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.ext4_fc_track_inode
      0.09 ±  5%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.ext4_unlink
      0.08 ±  6%      +0.0        0.12 ±  3%  perf-profile.children.cycles-pp.__cancel_dirty_page
      0.09 ±  5%      +0.0        0.14        perf-profile.children.cycles-pp.vfs_unlink
      0.06 ± 13%      +0.0        0.11 ± 15%  perf-profile.children.cycles-pp.asm_exc_page_fault
      0.05 ±  8%      +0.0        0.10 ± 12%  perf-profile.children.cycles-pp.ext4_file_write_iter
      0.05 ±  8%      +0.0        0.10 ± 12%  perf-profile.children.cycles-pp.handle_mm_fault
      0.05 ±  8%      +0.0        0.10 ± 12%  perf-profile.children.cycles-pp.__handle_mm_fault
      0.11 ±  7%      +0.1        0.16 ±  5%  perf-profile.children.cycles-pp.ext4_create
      0.02 ±141%      +0.1        0.07 ±  7%  perf-profile.children.cycles-pp.__ext4_unlink
      0.06 ±  8%      +0.1        0.11 ± 15%  perf-profile.children.cycles-pp.exc_page_fault
      0.06 ±  8%      +0.1        0.11 ± 15%  perf-profile.children.cycles-pp.do_user_addr_fault
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.free_unref_page_list
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.file_remove_privs
      0.17 ±  5%      +0.1        0.22 ±  2%  perf-profile.children.cycles-pp.__cond_resched
      0.10 ±  4%      +0.1        0.15 ±  6%  perf-profile.children.cycles-pp.free_buffer_head
      0.11 ± 11%      +0.1        0.17 ±  5%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.08 ± 10%      +0.1        0.13 ±  3%  perf-profile.children.cycles-pp.current_time
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.unaccount_page_cache_page
      0.02 ±141%      +0.1        0.07        perf-profile.children.cycles-pp.file_modified
      0.00            +0.1        0.06 ±  8%  perf-profile.children.cycles-pp.__mod_node_page_state
      0.11 ±  4%      +0.1        0.17 ±  9%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.18 ±  2%      +0.1        0.24 ± 12%  perf-profile.children.cycles-pp.block_invalidatepage
      0.18 ±  9%      +0.1        0.24 ±  7%  perf-profile.children.cycles-pp.__mod_lruvec_page_state
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.syscall_enter_from_user_mode
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.xa_get_order
      0.00            +0.1        0.06 ± 23%  perf-profile.children.cycles-pp.jbd2_journal_dirty_metadata
      0.08 ±  5%      +0.1        0.15 ±  3%  perf-profile.children.cycles-pp.__fget_light
      0.07 ±  6%      +0.1        0.14 ± 12%  perf-profile.children.cycles-pp.ksys_lseek
      0.00            +0.1        0.06 ± 19%  perf-profile.children.cycles-pp.page_vma_mapped_walk
      0.12 ±  6%      +0.1        0.18 ±  2%  perf-profile.children.cycles-pp.__get_user_nocheck_1
      0.00            +0.1        0.07 ± 18%  perf-profile.children.cycles-pp.__es_insert_extent
      0.00            +0.1        0.07 ±  7%  perf-profile.children.cycles-pp.rcu_read_unlock_strict
      0.19 ±  5%      +0.1        0.25 ±  7%  perf-profile.children.cycles-pp.mem_cgroup_charge
      0.00            +0.1        0.07        perf-profile.children.cycles-pp.aa_file_perm
      0.00            +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.get_obj_cgroup_from_current
      0.02 ±141%      +0.1        0.09 ± 19%  perf-profile.children.cycles-pp.migrate_misplaced_page
      0.02 ±141%      +0.1        0.09 ± 19%  perf-profile.children.cycles-pp.migrate_pages
      0.00            +0.1        0.07 ± 40%  perf-profile.children.cycles-pp.wait_for_stable_page
      0.17 ±  8%      +0.1        0.24 ±  5%  perf-profile.children.cycles-pp.__might_sleep
      0.07 ±  6%      +0.1        0.15 ± 35%  perf-profile.children.cycles-pp.generic_write_checks
      0.14 ±  5%      +0.1        0.21 ±  5%  perf-profile.children.cycles-pp.__alloc_pages
      0.05 ± 72%      +0.1        0.12 ± 13%  perf-profile.children.cycles-pp.PageHuge
      0.00            +0.1        0.07 ± 12%  perf-profile.children.cycles-pp._raw_write_lock
      0.07 ±  7%      +0.1        0.14 ± 15%  perf-profile.children.cycles-pp.balance_dirty_pages_ratelimited
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.map_id_up
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.xas_start
      0.02 ±141%      +0.1        0.09 ± 18%  perf-profile.children.cycles-pp.do_numa_page
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.write@plt
      0.10 ±  4%      +0.1        0.18        perf-profile.children.cycles-pp.common_file_perm
      0.12 ±  4%      +0.1        0.19 ±  2%  perf-profile.children.cycles-pp.xas_load
      0.19 ±  8%      +0.1        0.27 ±  3%  perf-profile.children.cycles-pp.iov_iter_fault_in_readable
      0.10 ±  8%      +0.1        0.18        perf-profile.children.cycles-pp.__fdget_pos
      0.00            +0.1        0.08 ± 20%  perf-profile.children.cycles-pp.obj_cgroup_charge
      0.00            +0.1        0.08 ± 56%  perf-profile.children.cycles-pp.generic_write_check_limits
      0.10 ±  4%      +0.1        0.18 ±  4%  perf-profile.children.cycles-pp.disk_rw
      0.07            +0.1        0.16 ±  6%  perf-profile.children.cycles-pp.__ext4_handle_dirty_metadata
      0.09 ±  9%      +0.1        0.18 ± 29%  perf-profile.children.cycles-pp.ext4_generic_write_checks
      0.14 ±  3%      +0.1        0.22 ±  7%  perf-profile.children.cycles-pp.delete_from_page_cache_batch
      0.00            +0.1        0.09 ± 19%  perf-profile.children.cycles-pp.rmap_walk_anon
      0.14 ±  3%      +0.1        0.23 ±  2%  perf-profile.children.cycles-pp.security_file_permission
      0.00            +0.1        0.09 ±  9%  perf-profile.children.cycles-pp.__dquot_alloc_space
      0.00            +0.1        0.09 ± 10%  perf-profile.children.cycles-pp.up_read
      0.09 ± 28%      +0.1        0.20 ±  7%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      0.17 ±  8%      +0.1        0.30        perf-profile.children.cycles-pp.crc32c_pcl_intel_update
      0.20 ±  7%      +0.1        0.33 ±  2%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.18 ±  9%      +0.1        0.32        perf-profile.children.cycles-pp.__entry_text_start
      0.27 ±  6%      +0.1        0.41 ±  4%  perf-profile.children.cycles-pp.try_to_free_buffers
      0.36 ±  6%      +0.1        0.50 ±  7%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.00            +0.1        0.14 ± 21%  perf-profile.children.cycles-pp.down_read
      0.06 ±  8%      +0.2        0.21 ±  9%  perf-profile.children.cycles-pp.ext4_da_reserve_space
      0.05 ±  8%      +0.2        0.21 ± 18%  perf-profile.children.cycles-pp.ext4_es_lookup_extent
      0.54 ±  2%      +0.2        0.72 ±  2%  perf-profile.children.cycles-pp.__add_to_page_cache_locked
      0.31 ± 11%      +0.2        0.48        perf-profile.children.cycles-pp.ext4_inode_csum
      0.78 ±  3%      +0.2        0.95 ± 13%  perf-profile.children.cycles-pp.unlock_page
      0.19 ± 11%      +0.2        0.37 ±  2%  perf-profile.children.cycles-pp.__set_page_dirty
      0.36 ±  7%      +0.2        0.54 ± 18%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.10 ±  8%      +0.2        0.29 ± 12%  perf-profile.children.cycles-pp.alloc_buffer_head
      0.33 ± 10%      +0.2        0.52        perf-profile.children.cycles-pp.ext4_inode_csum_set
      0.31 ±  3%      +0.2        0.51 ± 16%  perf-profile.children.cycles-pp.__pagevec_lru_add
      0.33 ± 11%      +0.2        0.53 ±  9%  perf-profile.children.cycles-pp.___might_sleep
      0.45 ±  9%      +0.2        0.65 ±  8%  perf-profile.children.cycles-pp.down_write
      0.03 ± 70%      +0.2        0.24 ± 17%  perf-profile.children.cycles-pp.ext4_es_insert_delayed_block
      0.38 ±  3%      +0.2        0.59 ± 15%  perf-profile.children.cycles-pp.lru_cache_add
      0.12 ±  4%      +0.2        0.33 ± 12%  perf-profile.children.cycles-pp.alloc_page_buffers
      0.21 ± 18%      +0.2        0.44        perf-profile.children.cycles-pp.unlink
      0.21 ± 20%      +0.2        0.44        perf-profile.children.cycles-pp.do_unlinkat
      0.31 ±  8%      +0.2        0.54 ±  3%  perf-profile.children.cycles-pp.llseek
      0.58 ±  3%      +0.2        0.82 ±  8%  perf-profile.children.cycles-pp.truncate_cleanup_page
      0.14 ±  5%      +0.2        0.39 ± 23%  perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
      0.29 ± 17%      +0.3        0.54 ±  5%  perf-profile.children.cycles-pp.creat64
      0.09 ± 28%      +0.3        0.35 ±  3%  perf-profile.children.cycles-pp.osq_lock
      0.31 ± 18%      +0.3        0.57 ±  5%  perf-profile.children.cycles-pp.path_openat
      0.32 ± 17%      +0.3        0.58 ±  6%  perf-profile.children.cycles-pp.do_sys_open
      0.32 ± 17%      +0.3        0.58 ±  6%  perf-profile.children.cycles-pp.do_sys_openat2
      0.31 ± 18%      +0.3        0.57 ±  6%  perf-profile.children.cycles-pp.do_filp_open
      0.28            +0.3        0.54 ± 14%  perf-profile.children.cycles-pp.__pagevec_release
      0.37 ±  2%      +0.3        0.63 ±  7%  perf-profile.children.cycles-pp._raw_spin_lock
      0.29            +0.3        0.56 ± 14%  perf-profile.children.cycles-pp.release_pages
      0.21 ±  2%      +0.3        0.52 ± 19%  perf-profile.children.cycles-pp.jbd2_write_access_granted
      0.24            +0.3        0.57 ± 20%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.22 ±  4%      +0.3        0.56 ± 21%  perf-profile.children.cycles-pp.jbd2_journal_get_write_access
      0.21 ± 26%      +0.4        0.56 ±  5%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      0.93 ±  3%      +0.4        1.31 ±  7%  perf-profile.children.cycles-pp.add_to_page_cache_lru
      0.31 ±  6%      +0.4        0.73 ± 18%  perf-profile.children.cycles-pp.__ext4_journal_get_write_access
      0.25 ±  6%      +0.5        0.77 ± 12%  perf-profile.children.cycles-pp.create_empty_buffers
      1.17 ±  6%      +0.6        1.73 ±  6%  perf-profile.children.cycles-pp.ext4_do_update_inode
      0.81 ± 11%      +0.6        1.42 ±  6%  perf-profile.children.cycles-pp.mark_buffer_dirty
      1.14 ±  3%      +0.6        1.77 ± 10%  perf-profile.children.cycles-pp.truncate_inode_pages_range
      1.23 ±  2%      +0.7        1.91 ±  9%  perf-profile.children.cycles-pp.ext4_evict_inode
      1.25 ±  2%      +0.7        1.94 ±  9%  perf-profile.children.cycles-pp.dput
      1.24 ±  2%      +0.7        1.93 ±  9%  perf-profile.children.cycles-pp.__dentry_kill
      1.23 ±  2%      +0.7        1.92 ±  9%  perf-profile.children.cycles-pp.evict
      1.25 ±  2%      +0.7        1.94 ±  9%  perf-profile.children.cycles-pp.__fput
      1.26 ±  2%      +0.7        1.96 ±  9%  perf-profile.children.cycles-pp.__close
      1.26 ±  2%      +0.7        1.95 ±  9%  perf-profile.children.cycles-pp.task_work_run
      1.30 ±  2%      +0.7        2.02 ±  9%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      1.64 ±  6%      +0.7        2.37 ±  7%  perf-profile.children.cycles-pp.ext4_mark_iloc_dirty
      1.35 ±  2%      +0.8        2.10 ±  8%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.28 ±  5%      +0.9        1.18 ± 14%  perf-profile.children.cycles-pp.ext4_da_map_blocks
      0.28 ±  5%      +0.9        1.19 ± 13%  perf-profile.children.cycles-pp.ext4_da_get_block_prep
      0.29            +1.1        1.35 ±  6%  perf-profile.children.cycles-pp.__find_get_block
      0.32            +1.1        1.46 ±  5%  perf-profile.children.cycles-pp.__getblk_gfp
      0.41 ±  4%      +1.2        1.60 ±  3%  perf-profile.children.cycles-pp.__ext4_get_inode_loc
      0.42 ±  4%      +1.2        1.62 ±  3%  perf-profile.children.cycles-pp.ext4_get_inode_loc
      2.00 ± 18%      +1.3        3.29 ±  6%  perf-profile.children.cycles-pp.__block_commit_write
      0.83 ±  2%      +1.5        2.33 ± 10%  perf-profile.children.cycles-pp.ext4_block_write_begin
      2.04 ± 18%      +1.6        3.60 ±  6%  perf-profile.children.cycles-pp.block_write_end
      2.52 ±  3%      +1.6        4.12 ±  9%  perf-profile.children.cycles-pp.pagecache_get_page
      0.75 ±  4%      +1.6        2.38 ±  3%  perf-profile.children.cycles-pp.ext4_reserve_inode_write
      2.54 ±  4%      +1.6        4.17 ±  8%  perf-profile.children.cycles-pp.grab_cache_page_write_begin
      2.42 ±  3%      +2.4        4.87 ±  6%  perf-profile.children.cycles-pp.__ext4_mark_inode_dirty
      4.05 ±  7%     +48.0       52.02 ± 10%  perf-profile.children.cycles-pp.ext4_dirty_inode
      5.28 ± 11%     +73.5       78.74        perf-profile.children.cycles-pp.__mark_inode_dirty
      5.25 ±  8%     +75.5       80.76        perf-profile.children.cycles-pp.generic_write_end
     16.17 ±  6%      -2.4       13.77 ±  8%  perf-profile.self.cycles-pp.add_transaction_credits
      1.52 ±  2%      -1.4        0.15 ±  9%  perf-profile.self.cycles-pp.ext4_da_write_begin
      1.81 ±  5%      -1.2        0.62 ± 16%  perf-profile.self.cycles-pp.up_write
      0.06            +0.0        0.07 ±  6%  perf-profile.self.cycles-pp.ext4_da_write_end
      0.08 ±  6%      +0.0        0.09 ±  5%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.05 ±  8%      +0.0        0.07 ± 12%  perf-profile.self.cycles-pp.__slab_free
      0.06 ±  8%      +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.drop_buffers
      0.06            +0.0        0.08 ± 11%  perf-profile.self.cycles-pp.truncate_cleanup_page
      0.05            +0.0        0.07 ±  6%  perf-profile.self.cycles-pp.do_syscall_64
      0.08 ±  6%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.__cond_resched
      0.06 ±  8%      +0.0        0.08 ± 11%  perf-profile.self.cycles-pp.page_counter_cancel
      0.06 ±  7%      +0.0        0.09 ± 15%  perf-profile.self.cycles-pp.page_cache_free_page
      0.08 ±  5%      +0.0        0.11 ± 14%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.03 ± 70%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.jbd2_journal_grab_journal_head
      0.06 ±  8%      +0.0        0.09 ± 10%  perf-profile.self.cycles-pp.crypto_shash_update
      0.03 ± 70%      +0.0        0.07        perf-profile.self.cycles-pp.rcu_all_qs
      0.06 ± 13%      +0.0        0.10 ±  8%  perf-profile.self.cycles-pp.ext4_buffered_write_iter
      0.02 ±141%      +0.0        0.06 ±  8%  perf-profile.self.cycles-pp.page_counter_try_charge
      0.14 ±  3%      +0.0        0.18 ± 12%  perf-profile.self.cycles-pp.block_invalidatepage
      0.06 ±  8%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.__entry_text_start
      0.08 ± 10%      +0.0        0.12 ±  7%  perf-profile.self.cycles-pp.__add_to_page_cache_locked
      0.09 ±  5%      +0.0        0.13 ± 12%  perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      0.05            +0.0        0.10 ± 17%  perf-profile.self.cycles-pp.ext4_file_write_iter
      0.06 ±  7%      +0.0        0.11        perf-profile.self.cycles-pp.common_file_perm
      0.06 ±  8%      +0.0        0.10 ± 25%  perf-profile.self.cycles-pp.__ext4_get_inode_loc
      0.03 ± 70%      +0.0        0.08        perf-profile.self.cycles-pp.llseek
      0.03 ± 70%      +0.0        0.08        perf-profile.self.cycles-pp.__fsnotify_parent
      0.14 ±  6%      +0.0        0.19 ±  2%  perf-profile.self.cycles-pp.generic_perform_write
      0.08 ±  5%      +0.1        0.13 ±  3%  perf-profile.self.cycles-pp.xas_load
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.xas_store
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.rmqueue
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.syscall_enter_from_user_mode
      0.02 ±141%      +0.1        0.07 ± 20%  perf-profile.self.cycles-pp.__ext4_journal_get_write_access
      0.00            +0.1        0.06 ±  8%  perf-profile.self.cycles-pp.aa_file_perm
      0.00            +0.1        0.06 ±  8%  perf-profile.self.cycles-pp.__mod_node_page_state
      0.14 ±  9%      +0.1        0.19 ±  2%  perf-profile.self.cycles-pp.__might_sleep
      0.11 ±  4%      +0.1        0.17 ± 11%  perf-profile.self.cycles-pp.release_pages
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.xas_start
      0.00            +0.1        0.06 ± 23%  perf-profile.self.cycles-pp.jbd2_journal_dirty_metadata
      0.08 ±  6%      +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.__fget_light
      0.04 ± 71%      +0.1        0.10 ±  8%  perf-profile.self.cycles-pp.file_update_time
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.generic_write_checks
      0.11 ±  4%      +0.1        0.17 ±  2%  perf-profile.self.cycles-pp.__get_user_nocheck_1
      0.00            +0.1        0.07 ±  7%  perf-profile.self.cycles-pp.get_obj_cgroup_from_current
      0.06            +0.1        0.13 ± 19%  perf-profile.self.cycles-pp.balance_dirty_pages_ratelimited
      0.00            +0.1        0.07        perf-profile.self.cycles-pp.map_id_up
      0.08 ±  5%      +0.1        0.16 ±  3%  perf-profile.self.cycles-pp.disk_rw
      0.00            +0.1        0.07 ± 12%  perf-profile.self.cycles-pp._raw_write_lock
      0.04 ± 73%      +0.1        0.12 ± 14%  perf-profile.self.cycles-pp.PageHuge
      0.08 ±  6%      +0.1        0.16 ± 24%  perf-profile.self.cycles-pp.new_sync_write
      0.12 ±  3%      +0.1        0.20 ± 12%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.11 ± 11%      +0.1        0.19 ±  4%  perf-profile.self.cycles-pp.write
      0.00            +0.1        0.09 ± 10%  perf-profile.self.cycles-pp.up_read
      0.00            +0.1        0.10 ± 31%  perf-profile.self.cycles-pp.ksys_write
      0.00            +0.1        0.10 ± 16%  perf-profile.self.cycles-pp.ext4_es_lookup_extent
      0.09 ± 28%      +0.1        0.20 ±  7%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      0.00            +0.1        0.12 ± 22%  perf-profile.self.cycles-pp.down_read
      0.15 ± 11%      +0.1        0.27        perf-profile.self.cycles-pp.crc32c_pcl_intel_update
      0.20 ±  6%      +0.1        0.33 ±  2%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.43 ±  4%      +0.1        0.57 ± 10%  perf-profile.self.cycles-pp.ext4_mark_iloc_dirty
      0.00            +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.block_write_end
      0.77 ±  3%      +0.2        0.94 ± 13%  perf-profile.self.cycles-pp.unlock_page
      0.40 ± 10%      +0.2        0.57 ±  9%  perf-profile.self.cycles-pp.down_write
      0.36 ±  6%      +0.2        0.54 ± 18%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      0.14 ±  3%      +0.2        0.32 ± 38%  perf-profile.self.cycles-pp.vfs_write
      0.41 ±  6%      +0.2        0.60 ± 12%  perf-profile.self.cycles-pp.ext4_do_update_inode
      0.30 ± 13%      +0.2        0.49 ±  9%  perf-profile.self.cycles-pp.___might_sleep
      0.06            +0.2        0.29 ± 14%  perf-profile.self.cycles-pp.create_empty_buffers
      0.07 ± 12%      +0.2        0.31 ± 13%  perf-profile.self.cycles-pp.ext4_da_map_blocks
      0.09 ± 28%      +0.2        0.34 ±  4%  perf-profile.self.cycles-pp.osq_lock
      0.36 ±  3%      +0.3        0.62 ±  6%  perf-profile.self.cycles-pp._raw_spin_lock
      0.20 ±  2%      +0.3        0.51 ± 18%  perf-profile.self.cycles-pp.jbd2_write_access_granted
      0.44 ± 12%      +0.4        0.81 ±  5%  perf-profile.self.cycles-pp.generic_write_end
      0.60 ± 13%      +0.4        0.97 ± 10%  perf-profile.self.cycles-pp.mark_buffer_dirty
      1.12 ± 23%      +0.6        1.73 ±  6%  perf-profile.self.cycles-pp.__block_commit_write
      1.19 ±  4%      +0.9        2.10 ± 13%  perf-profile.self.cycles-pp.pagecache_get_page
      0.25 ±  3%      +1.0        1.29 ±  6%  perf-profile.self.cycles-pp.__find_get_block
      0.23 ±  2%      +1.2        1.48 ± 11%  perf-profile.self.cycles-pp.__mark_inode_dirty
     69.67 ± 10%    +771.8%     607.33 ± 80%  interrupts.153:IR-PCI-MSI.25690116-edge.eth0-TxRx-4
    155.00 ± 45%     -54.0%      71.33 ± 56%  interrupts.163:IR-PCI-MSI.25690126-edge.eth0-TxRx-14
    240.67           -40.4%     143.33 ±  2%  interrupts.9:IR-IO-APIC.9-fasteoi.acpi
    132897           -12.9%     115807        interrupts.CAL:Function_call_interrupts
    239938           -47.4%     126219 ± 21%  interrupts.CPU0.LOC:Local_timer_interrupts
     12582           -22.1%       9805 ± 20%  interrupts.CPU0.NMI:Non-maskable_interrupts
     12582           -22.1%       9805 ± 20%  interrupts.CPU0.PMI:Performance_monitoring_interrupts
      1117 ± 11%     -31.4%     766.33 ± 19%  interrupts.CPU0.RES:Rescheduling_interrupts
    240.67           -40.4%     143.33 ±  2%  interrupts.CPU1.9:IR-IO-APIC.9-fasteoi.acpi
    239990           -46.0%     129647 ± 17%  interrupts.CPU1.LOC:Local_timer_interrupts
    891.67 ± 15%     -42.6%     512.00 ± 13%  interrupts.CPU1.RES:Rescheduling_interrupts
    240045           -46.8%     127594 ± 19%  interrupts.CPU10.LOC:Local_timer_interrupts
      1651 ± 53%     -61.0%     644.67 ± 42%  interrupts.CPU10.RES:Rescheduling_interrupts
      1003           -13.9%     864.00        interrupts.CPU100.CAL:Function_call_interrupts
    240046           -46.3%     128839 ± 18%  interrupts.CPU100.LOC:Local_timer_interrupts
    599.67 ± 18%     -45.4%     327.67 ± 24%  interrupts.CPU100.RES:Rescheduling_interrupts
    987.33           -12.2%     867.00        interrupts.CPU101.CAL:Function_call_interrupts
    240021           -46.4%     128542 ± 18%  interrupts.CPU101.LOC:Local_timer_interrupts
    624.33 ± 20%     -50.5%     309.00 ± 17%  interrupts.CPU101.RES:Rescheduling_interrupts
      1003           -12.1%     882.00        interrupts.CPU102.CAL:Function_call_interrupts
    240027           -46.4%     128723 ± 18%  interrupts.CPU102.LOC:Local_timer_interrupts
    642.33 ± 11%     -41.3%     377.00 ± 35%  interrupts.CPU102.RES:Rescheduling_interrupts
    983.67           -11.3%     872.33 ±  3%  interrupts.CPU103.CAL:Function_call_interrupts
    240067           -46.4%     128570 ± 18%  interrupts.CPU103.LOC:Local_timer_interrupts
    567.67 ± 10%     -44.9%     313.00        interrupts.CPU103.RES:Rescheduling_interrupts
    992.33           -11.1%     882.67 ±  3%  interrupts.CPU104.CAL:Function_call_interrupts
    240063           -46.4%     128768 ± 18%  interrupts.CPU104.LOC:Local_timer_interrupts
    647.67 ± 13%     -33.9%     428.00 ± 37%  interrupts.CPU104.RES:Rescheduling_interrupts
    996.67 ±  3%     -10.9%     888.33 ±  4%  interrupts.CPU105.CAL:Function_call_interrupts
    240027           -46.4%     128670 ± 18%  interrupts.CPU105.LOC:Local_timer_interrupts
      1021 ±  5%     -17.5%     843.00 ±  8%  interrupts.CPU106.CAL:Function_call_interrupts
    239978           -46.4%     128720 ± 18%  interrupts.CPU106.LOC:Local_timer_interrupts
    838.67 ± 42%     -67.7%     270.67 ±  8%  interrupts.CPU106.RES:Rescheduling_interrupts
    992.33 ±  2%     -10.6%     887.33 ±  3%  interrupts.CPU107.CAL:Function_call_interrupts
    240041           -46.5%     128475 ± 18%  interrupts.CPU107.LOC:Local_timer_interrupts
    574.33 ± 13%     -44.9%     316.67 ± 16%  interrupts.CPU107.RES:Rescheduling_interrupts
    981.67            -9.8%     885.33        interrupts.CPU108.CAL:Function_call_interrupts
    240049           -46.6%     128273 ± 19%  interrupts.CPU108.LOC:Local_timer_interrupts
    659.00 ±  8%     -49.6%     332.00 ± 21%  interrupts.CPU108.RES:Rescheduling_interrupts
    997.67           -13.8%     860.33 ±  2%  interrupts.CPU109.CAL:Function_call_interrupts
    240066           -46.4%     128761 ± 18%  interrupts.CPU109.LOC:Local_timer_interrupts
    585.00 ± 17%     -48.9%     298.67 ± 22%  interrupts.CPU109.RES:Rescheduling_interrupts
      1020 ±  4%     -12.7%     891.00 ±  4%  interrupts.CPU11.CAL:Function_call_interrupts
    239990           -47.6%     125674 ± 22%  interrupts.CPU11.LOC:Local_timer_interrupts
      1004           -13.7%     867.00        interrupts.CPU110.CAL:Function_call_interrupts
    240202           -46.3%     128904 ± 18%  interrupts.CPU110.LOC:Local_timer_interrupts
    643.33 ± 18%     -51.2%     314.00 ± 16%  interrupts.CPU110.RES:Rescheduling_interrupts
      1006           -12.7%     878.33        interrupts.CPU111.CAL:Function_call_interrupts
    240177           -46.3%     128994 ± 18%  interrupts.CPU111.LOC:Local_timer_interrupts
    625.33 ± 14%     -48.2%     323.67 ± 19%  interrupts.CPU111.RES:Rescheduling_interrupts
    969.33 ±  6%     -10.3%     869.67 ±  3%  interrupts.CPU112.CAL:Function_call_interrupts
    240091           -46.3%     128824 ± 18%  interrupts.CPU112.LOC:Local_timer_interrupts
    632.00 ± 20%     -49.0%     322.33 ± 15%  interrupts.CPU112.RES:Rescheduling_interrupts
      1011 ±  2%     -11.1%     898.33 ±  3%  interrupts.CPU113.CAL:Function_call_interrupts
    240073           -44.9%     132389 ± 20%  interrupts.CPU113.LOC:Local_timer_interrupts
    619.00 ± 13%     -47.9%     322.33 ± 21%  interrupts.CPU113.RES:Rescheduling_interrupts
      1009 ±  4%     -13.7%     871.67 ±  2%  interrupts.CPU114.CAL:Function_call_interrupts
    240110           -46.4%     128636 ± 18%  interrupts.CPU114.LOC:Local_timer_interrupts
    845.00 ± 45%     -61.7%     323.33 ± 16%  interrupts.CPU114.RES:Rescheduling_interrupts
    973.33 ±  3%     -11.3%     863.67        interrupts.CPU115.CAL:Function_call_interrupts
    240071           -46.4%     128755 ± 18%  interrupts.CPU115.LOC:Local_timer_interrupts
    644.33 ± 31%     -54.8%     291.33 ± 11%  interrupts.CPU115.RES:Rescheduling_interrupts
    986.00            -9.9%     888.00 ±  2%  interrupts.CPU116.CAL:Function_call_interrupts
    240079           -46.4%     128631 ± 18%  interrupts.CPU116.LOC:Local_timer_interrupts
    619.67 ± 19%     -48.1%     321.33 ± 12%  interrupts.CPU116.RES:Rescheduling_interrupts
      1017 ±  3%     -10.5%     910.33 ±  4%  interrupts.CPU117.CAL:Function_call_interrupts
    240115           -43.8%     135057 ± 20%  interrupts.CPU117.LOC:Local_timer_interrupts
    616.00 ± 11%     -47.2%     325.00 ± 20%  interrupts.CPU117.RES:Rescheduling_interrupts
    240100           -46.4%     128586 ± 18%  interrupts.CPU118.LOC:Local_timer_interrupts
    663.00 ±  5%     -56.3%     289.67 ± 14%  interrupts.CPU118.RES:Rescheduling_interrupts
      1015 ±  2%     -14.4%     869.00        interrupts.CPU119.CAL:Function_call_interrupts
    240094           -46.3%     128849 ± 18%  interrupts.CPU119.LOC:Local_timer_interrupts
    723.33 ± 22%     -61.8%     276.33 ±  9%  interrupts.CPU119.RES:Rescheduling_interrupts
      1021           -15.3%     864.67 ±  2%  interrupts.CPU12.CAL:Function_call_interrupts
    240034           -47.6%     125794 ± 22%  interrupts.CPU12.LOC:Local_timer_interrupts
    888.67 ± 19%     -40.3%     530.33 ± 17%  interrupts.CPU12.RES:Rescheduling_interrupts
    996.00           -14.3%     853.67        interrupts.CPU120.CAL:Function_call_interrupts
    240057           -46.4%     128595 ± 18%  interrupts.CPU120.LOC:Local_timer_interrupts
    577.00 ± 15%     -51.2%     281.67 ± 19%  interrupts.CPU120.RES:Rescheduling_interrupts
    978.67           -11.6%     865.00 ±  3%  interrupts.CPU121.CAL:Function_call_interrupts
    240050           -46.4%     128752 ± 18%  interrupts.CPU121.LOC:Local_timer_interrupts
    606.33 ± 16%     -54.1%     278.33 ± 11%  interrupts.CPU121.RES:Rescheduling_interrupts
    240104           -46.4%     128776 ± 18%  interrupts.CPU122.LOC:Local_timer_interrupts
    598.00 ± 19%     -46.0%     322.67 ± 16%  interrupts.CPU122.RES:Rescheduling_interrupts
    991.33           -13.0%     862.67        interrupts.CPU123.CAL:Function_call_interrupts
    240114           -46.3%     128909 ± 18%  interrupts.CPU123.LOC:Local_timer_interrupts
    605.67 ± 18%     -54.5%     275.33 ± 10%  interrupts.CPU123.RES:Rescheduling_interrupts
    240133           -45.8%     130064 ± 19%  interrupts.CPU124.LOC:Local_timer_interrupts
    625.67 ± 20%     -57.3%     267.00 ± 13%  interrupts.CPU124.RES:Rescheduling_interrupts
      1006           -11.5%     890.00        interrupts.CPU125.CAL:Function_call_interrupts
    240148           -46.4%     128815 ± 18%  interrupts.CPU125.LOC:Local_timer_interrupts
    592.33 ± 18%     -50.4%     294.00 ±  2%  interrupts.CPU125.RES:Rescheduling_interrupts
    240159           -46.4%     128732 ± 18%  interrupts.CPU126.LOC:Local_timer_interrupts
      1067           -15.1%     905.67 ±  3%  interrupts.CPU127.CAL:Function_call_interrupts
    240164           -46.1%     129508 ± 17%  interrupts.CPU127.LOC:Local_timer_interrupts
    672.67 ± 16%     -56.8%     290.67 ±  8%  interrupts.CPU127.RES:Rescheduling_interrupts
      1027 ±  3%     -15.8%     865.00        interrupts.CPU13.CAL:Function_call_interrupts
    239984           -46.9%     127380 ± 20%  interrupts.CPU13.LOC:Local_timer_interrupts
     12539           -32.5%       8462        interrupts.CPU13.NMI:Non-maskable_interrupts
     12539           -32.5%       8462        interrupts.CPU13.PMI:Performance_monitoring_interrupts
    958.00 ± 25%     -42.4%     552.00 ± 13%  interrupts.CPU13.RES:Rescheduling_interrupts
    155.00 ± 45%     -54.0%      71.33 ± 56%  interrupts.CPU14.163:IR-PCI-MSI.25690126-edge.eth0-TxRx-14
      1084 ±  9%     -19.0%     877.67 ±  3%  interrupts.CPU14.CAL:Function_call_interrupts
    239844           -47.1%     126810 ± 20%  interrupts.CPU14.LOC:Local_timer_interrupts
     12579           -32.8%       8451        interrupts.CPU14.NMI:Non-maskable_interrupts
     12579           -32.8%       8451        interrupts.CPU14.PMI:Performance_monitoring_interrupts
      2237 ± 47%     -75.5%     547.00 ±  7%  interrupts.CPU14.RES:Rescheduling_interrupts
      1013 ±  4%     -12.6%     885.67        interrupts.CPU15.CAL:Function_call_interrupts
    240154           -47.6%     125757 ± 21%  interrupts.CPU15.LOC:Local_timer_interrupts
    975.00 ± 19%     -48.4%     502.67 ±  8%  interrupts.CPU15.RES:Rescheduling_interrupts
    239531           -47.5%     125838 ± 22%  interrupts.CPU16.LOC:Local_timer_interrupts
      1033 ± 33%     -42.8%     590.67 ±  5%  interrupts.CPU16.RES:Rescheduling_interrupts
      1083 ±  8%     -14.7%     924.33 ±  9%  interrupts.CPU17.CAL:Function_call_interrupts
    239788           -47.2%     126653 ± 21%  interrupts.CPU17.LOC:Local_timer_interrupts
      1568 ± 68%     -63.2%     577.33 ±  2%  interrupts.CPU17.RES:Rescheduling_interrupts
    243526 ±  2%     -48.4%     125762 ± 22%  interrupts.CPU18.LOC:Local_timer_interrupts
      1020 ±  4%     -16.6%     850.67        interrupts.CPU19.CAL:Function_call_interrupts
    240014           -49.7%     120806 ± 28%  interrupts.CPU19.LOC:Local_timer_interrupts
      8368           +34.7%      11270 ± 17%  interrupts.CPU19.NMI:Non-maskable_interrupts
      8368           +34.7%      11270 ± 17%  interrupts.CPU19.PMI:Performance_monitoring_interrupts
    869.67 ± 27%     -36.0%     556.33 ±  5%  interrupts.CPU19.RES:Rescheduling_interrupts
    240076           -47.5%     125940 ± 21%  interrupts.CPU2.LOC:Local_timer_interrupts
    915.67 ±  2%     -39.1%     558.00 ± 18%  interrupts.CPU2.RES:Rescheduling_interrupts
    239883           -47.6%     125721 ± 22%  interrupts.CPU20.LOC:Local_timer_interrupts
      1095 ± 15%     -21.8%     857.00        interrupts.CPU21.CAL:Function_call_interrupts
    240006           -47.7%     125561 ± 22%  interrupts.CPU21.LOC:Local_timer_interrupts
    913.33 ± 15%     -43.5%     516.00 ± 17%  interrupts.CPU21.RES:Rescheduling_interrupts
    987.00 ±  3%     -12.1%     867.67        interrupts.CPU22.CAL:Function_call_interrupts
    239946           -47.4%     126149 ± 21%  interrupts.CPU22.LOC:Local_timer_interrupts
    831.00 ± 16%     -34.7%     542.67 ± 26%  interrupts.CPU22.RES:Rescheduling_interrupts
      1015 ±  5%     -12.5%     888.00 ±  5%  interrupts.CPU23.CAL:Function_call_interrupts
    239997           -47.7%     125485 ± 22%  interrupts.CPU23.LOC:Local_timer_interrupts
      1217 ± 57%     -51.8%     586.67 ±  3%  interrupts.CPU23.RES:Rescheduling_interrupts
    239993           -47.6%     125809 ± 22%  interrupts.CPU24.LOC:Local_timer_interrupts
    986.67           -11.4%     874.33 ±  6%  interrupts.CPU25.CAL:Function_call_interrupts
    239960           -47.6%     125845 ± 22%  interrupts.CPU25.LOC:Local_timer_interrupts
    785.33 ± 10%     -25.0%     589.00 ± 17%  interrupts.CPU25.RES:Rescheduling_interrupts
      1031 ±  7%     -18.4%     842.00 ±  2%  interrupts.CPU26.CAL:Function_call_interrupts
    240006           -47.7%     125546 ± 22%  interrupts.CPU26.LOC:Local_timer_interrupts
    766.33 ± 13%     -30.0%     536.33 ± 20%  interrupts.CPU26.RES:Rescheduling_interrupts
      1000 ±  7%     -11.9%     880.67 ±  6%  interrupts.CPU27.CAL:Function_call_interrupts
    240002           -47.6%     125857 ± 22%  interrupts.CPU27.LOC:Local_timer_interrupts
    736.67 ± 10%     -23.5%     563.33 ± 15%  interrupts.CPU27.RES:Rescheduling_interrupts
      1010           -13.0%     879.67 ±  2%  interrupts.CPU28.CAL:Function_call_interrupts
    240101           -47.5%     126025 ± 21%  interrupts.CPU28.LOC:Local_timer_interrupts
    792.00 ± 12%     -43.2%     450.00 ± 13%  interrupts.CPU28.RES:Rescheduling_interrupts
    240044           -47.6%     125718 ± 22%  interrupts.CPU29.LOC:Local_timer_interrupts
      1745 ± 51%     -48.0%     908.33 ±  4%  interrupts.CPU3.CAL:Function_call_interrupts
    246138 ±  2%     -48.6%     126403 ± 21%  interrupts.CPU3.LOC:Local_timer_interrupts
    799.00 ± 13%     -27.2%     581.67 ± 14%  interrupts.CPU3.RES:Rescheduling_interrupts
      1038 ±  4%     -16.1%     870.67 ±  2%  interrupts.CPU30.CAL:Function_call_interrupts
    240200           -47.6%     125886 ± 22%  interrupts.CPU30.LOC:Local_timer_interrupts
    827.00 ± 17%     -41.0%     488.00 ±  8%  interrupts.CPU30.RES:Rescheduling_interrupts
    997.33 ±  3%     -12.4%     873.33 ±  2%  interrupts.CPU31.CAL:Function_call_interrupts
    240099           -47.6%     125763 ± 22%  interrupts.CPU31.LOC:Local_timer_interrupts
    801.33 ± 18%     -36.1%     511.67 ±  7%  interrupts.CPU31.RES:Rescheduling_interrupts
      1137 ±  4%     -16.6%     948.00        interrupts.CPU32.CAL:Function_call_interrupts
    240090           -47.2%     126702 ± 21%  interrupts.CPU32.LOC:Local_timer_interrupts
    999.67 ±  6%     -54.7%     453.33 ±  6%  interrupts.CPU32.RES:Rescheduling_interrupts
      1147 ±  2%     -12.9%     999.00 ±  6%  interrupts.CPU33.CAL:Function_call_interrupts
    240058           -47.6%     125750 ± 22%  interrupts.CPU33.LOC:Local_timer_interrupts
    833.00 ± 19%     -42.5%     478.67 ± 34%  interrupts.CPU33.RES:Rescheduling_interrupts
      1111           -15.5%     938.33 ±  2%  interrupts.CPU34.CAL:Function_call_interrupts
    240067           -47.1%     126931 ± 20%  interrupts.CPU34.LOC:Local_timer_interrupts
      1049           -13.2%     911.33 ±  2%  interrupts.CPU35.CAL:Function_call_interrupts
    240020           -47.4%     126258 ± 21%  interrupts.CPU35.LOC:Local_timer_interrupts
    653.00 ± 16%     -53.0%     307.00 ±  7%  interrupts.CPU35.RES:Rescheduling_interrupts
      1039 ±  2%     -17.0%     863.00 ±  2%  interrupts.CPU36.CAL:Function_call_interrupts
    240081           -47.2%     126663 ± 21%  interrupts.CPU36.LOC:Local_timer_interrupts
    610.67 ± 16%     -47.5%     320.67 ± 24%  interrupts.CPU36.RES:Rescheduling_interrupts
      1089 ±  3%     -17.7%     896.33        interrupts.CPU37.CAL:Function_call_interrupts
    240045           -47.3%     126550 ± 21%  interrupts.CPU37.LOC:Local_timer_interrupts
     12576           -23.3%       9651 ± 20%  interrupts.CPU37.NMI:Non-maskable_interrupts
     12576           -23.3%       9651 ± 20%  interrupts.CPU37.PMI:Performance_monitoring_interrupts
    641.67 ± 10%     -55.5%     285.33 ± 11%  interrupts.CPU37.RES:Rescheduling_interrupts
      1023 ±  2%     -12.2%     898.67        interrupts.CPU38.CAL:Function_call_interrupts
    240070           -47.8%     125294 ± 22%  interrupts.CPU38.LOC:Local_timer_interrupts
    628.00 ± 11%     -48.0%     326.33 ± 25%  interrupts.CPU38.RES:Rescheduling_interrupts
      1015           -12.2%     891.67        interrupts.CPU39.CAL:Function_call_interrupts
    240076           -47.8%     125246 ± 22%  interrupts.CPU39.LOC:Local_timer_interrupts
    632.33 ± 14%     -48.9%     323.33 ± 12%  interrupts.CPU39.RES:Rescheduling_interrupts
     69.67 ± 10%    +771.8%     607.33 ± 80%  interrupts.CPU4.153:IR-PCI-MSI.25690116-edge.eth0-TxRx-4
      1061 ±  6%     -18.1%     868.67        interrupts.CPU4.CAL:Function_call_interrupts
    240010           -46.8%     127721 ± 19%  interrupts.CPU4.LOC:Local_timer_interrupts
      1020 ±  2%     -15.5%     862.00        interrupts.CPU40.CAL:Function_call_interrupts
    240083           -47.4%     126373 ± 21%  interrupts.CPU40.LOC:Local_timer_interrupts
     12480           -22.6%       9662 ± 19%  interrupts.CPU40.NMI:Non-maskable_interrupts
     12480           -22.6%       9662 ± 19%  interrupts.CPU40.PMI:Performance_monitoring_interrupts
    630.33 ± 14%     -55.0%     283.67 ± 10%  interrupts.CPU40.RES:Rescheduling_interrupts
      1029           -14.7%     878.33        interrupts.CPU41.CAL:Function_call_interrupts
    240077           -47.5%     126094 ± 21%  interrupts.CPU41.LOC:Local_timer_interrupts
    657.33 ± 14%     -54.2%     301.00 ± 12%  interrupts.CPU41.RES:Rescheduling_interrupts
      1014           -11.8%     895.00 ±  4%  interrupts.CPU42.CAL:Function_call_interrupts
    240023           -47.8%     125345 ± 22%  interrupts.CPU42.LOC:Local_timer_interrupts
    638.00 ± 14%     -49.6%     321.33 ± 14%  interrupts.CPU42.RES:Rescheduling_interrupts
    240039           -47.8%     125350 ± 22%  interrupts.CPU43.LOC:Local_timer_interrupts
    608.67 ± 13%     -37.6%     379.67 ± 27%  interrupts.CPU43.RES:Rescheduling_interrupts
      1019           -15.9%     857.33        interrupts.CPU44.CAL:Function_call_interrupts
    240068           -47.8%     125415 ± 22%  interrupts.CPU44.LOC:Local_timer_interrupts
    641.00 ± 12%     -49.3%     324.67 ± 22%  interrupts.CPU44.RES:Rescheduling_interrupts
      1014 ±  2%     -15.0%     862.33        interrupts.CPU45.CAL:Function_call_interrupts
    240035           -47.9%     125086 ± 23%  interrupts.CPU45.LOC:Local_timer_interrupts
    695.00 ± 16%     -53.1%     325.67 ± 22%  interrupts.CPU45.RES:Rescheduling_interrupts
      1068 ±  4%     -20.3%     852.00 ±  2%  interrupts.CPU46.CAL:Function_call_interrupts
    240143           -47.7%     125647 ± 22%  interrupts.CPU46.LOC:Local_timer_interrupts
    914.33 ± 35%     -65.8%     312.33 ± 15%  interrupts.CPU46.RES:Rescheduling_interrupts
      1034           -15.2%     877.33        interrupts.CPU47.CAL:Function_call_interrupts
    240127           -47.8%     125444 ± 22%  interrupts.CPU47.LOC:Local_timer_interrupts
    643.33 ± 14%     -50.0%     321.67 ± 17%  interrupts.CPU47.RES:Rescheduling_interrupts
      1000           -14.4%     856.33        interrupts.CPU48.CAL:Function_call_interrupts
    240104           -47.4%     126375 ± 21%  interrupts.CPU48.LOC:Local_timer_interrupts
    635.33 ± 11%     -49.2%     323.00 ± 21%  interrupts.CPU48.RES:Rescheduling_interrupts
    978.00           -12.2%     858.33 ±  3%  interrupts.CPU49.CAL:Function_call_interrupts
    240050           -47.8%     125329 ± 22%  interrupts.CPU49.LOC:Local_timer_interrupts
    619.33 ± 13%     -52.9%     291.67 ± 15%  interrupts.CPU49.RES:Rescheduling_interrupts
    240037           -46.7%     128059 ± 19%  interrupts.CPU5.LOC:Local_timer_interrupts
    961.67 ± 10%     -45.8%     521.33 ±  4%  interrupts.CPU5.RES:Rescheduling_interrupts
    993.00 ±  2%     -13.4%     859.67        interrupts.CPU50.CAL:Function_call_interrupts
    240071           -47.9%     125191 ± 22%  interrupts.CPU50.LOC:Local_timer_interrupts
    633.00 ± 13%     -54.3%     289.33 ± 12%  interrupts.CPU50.RES:Rescheduling_interrupts
    986.67           -18.7%     802.33 ± 13%  interrupts.CPU51.CAL:Function_call_interrupts
    240065           -47.8%     125304 ± 22%  interrupts.CPU51.LOC:Local_timer_interrupts
    654.00 ±  7%     -50.1%     326.67 ± 18%  interrupts.CPU51.RES:Rescheduling_interrupts
    240060           -47.9%     125162 ± 22%  interrupts.CPU52.LOC:Local_timer_interrupts
    629.33 ± 17%     -49.6%     317.00 ±  5%  interrupts.CPU52.RES:Rescheduling_interrupts
    975.33           -12.4%     854.00        interrupts.CPU53.CAL:Function_call_interrupts
    240047           -47.8%     125194 ± 22%  interrupts.CPU53.LOC:Local_timer_interrupts
    613.33 ± 12%     -50.5%     303.67 ± 13%  interrupts.CPU53.RES:Rescheduling_interrupts
      1020 ±  4%     -15.0%     867.33        interrupts.CPU54.CAL:Function_call_interrupts
    246849 ±  3%     -49.3%     125175 ± 22%  interrupts.CPU54.LOC:Local_timer_interrupts
    621.33 ± 14%     -51.5%     301.33 ± 13%  interrupts.CPU54.RES:Rescheduling_interrupts
    986.00 ±  2%     -14.0%     847.67 ±  3%  interrupts.CPU55.CAL:Function_call_interrupts
    240063           -47.5%     126036 ± 21%  interrupts.CPU55.LOC:Local_timer_interrupts
    627.67 ± 12%     -53.5%     292.00 ± 16%  interrupts.CPU55.RES:Rescheduling_interrupts
    993.67 ±  2%     -14.6%     848.67        interrupts.CPU56.CAL:Function_call_interrupts
    240063           -47.8%     125234 ± 22%  interrupts.CPU56.LOC:Local_timer_interrupts
    607.33 ± 15%     -54.0%     279.33 ± 10%  interrupts.CPU56.RES:Rescheduling_interrupts
    982.33 ±  3%     -13.2%     853.00        interrupts.CPU57.CAL:Function_call_interrupts
    240058           -47.9%     125167 ± 22%  interrupts.CPU57.LOC:Local_timer_interrupts
    703.33 ± 12%     -58.3%     293.33 ± 11%  interrupts.CPU57.RES:Rescheduling_interrupts
      1016 ±  2%     -15.7%     857.33 ±  3%  interrupts.CPU58.CAL:Function_call_interrupts
    240123           -47.9%     125196 ± 23%  interrupts.CPU58.LOC:Local_timer_interrupts
    722.67 ± 15%     -59.4%     293.67 ± 10%  interrupts.CPU58.RES:Rescheduling_interrupts
    964.33           -11.7%     851.33 ±  2%  interrupts.CPU59.CAL:Function_call_interrupts
    240099           -47.9%     125123 ± 22%  interrupts.CPU59.LOC:Local_timer_interrupts
    613.67 ±  9%     -51.0%     300.67 ± 12%  interrupts.CPU59.RES:Rescheduling_interrupts
    239807           -47.5%     125935 ± 21%  interrupts.CPU6.LOC:Local_timer_interrupts
      1732 ± 63%     -71.0%     502.67 ± 11%  interrupts.CPU6.RES:Rescheduling_interrupts
    988.67           -13.4%     856.33 ±  2%  interrupts.CPU60.CAL:Function_call_interrupts
    240111           -47.8%     125221 ± 22%  interrupts.CPU60.LOC:Local_timer_interrupts
    634.67 ± 12%     -52.0%     304.33 ± 16%  interrupts.CPU60.RES:Rescheduling_interrupts
    986.00 ±  2%     -11.5%     872.67        interrupts.CPU61.CAL:Function_call_interrupts
    240135           -47.9%     125035 ± 23%  interrupts.CPU61.LOC:Local_timer_interrupts
    674.33 ± 13%     -51.6%     326.33 ± 23%  interrupts.CPU61.RES:Rescheduling_interrupts
    977.67           -11.3%     867.67 ±  2%  interrupts.CPU62.CAL:Function_call_interrupts
    240159           -47.8%     125341 ± 22%  interrupts.CPU62.LOC:Local_timer_interrupts
    676.67 ± 11%     -53.6%     313.67 ± 20%  interrupts.CPU62.RES:Rescheduling_interrupts
      1006 ±  3%     -12.9%     876.33        interrupts.CPU63.CAL:Function_call_interrupts
    240185           -47.8%     125262 ± 22%  interrupts.CPU63.LOC:Local_timer_interrupts
    661.00 ± 11%     -46.3%     355.00 ± 22%  interrupts.CPU63.RES:Rescheduling_interrupts
    240024           -46.0%     129523 ± 17%  interrupts.CPU64.LOC:Local_timer_interrupts
    239968           -45.8%     130033 ± 16%  interrupts.CPU65.LOC:Local_timer_interrupts
      9764 ± 20%     +29.7%      12667        interrupts.CPU65.NMI:Non-maskable_interrupts
      9764 ± 20%     +29.7%      12667        interrupts.CPU65.PMI:Performance_monitoring_interrupts
    773.00 ± 11%     -22.3%     601.00 ±  9%  interrupts.CPU65.RES:Rescheduling_interrupts
    239986           -46.1%     129299 ± 17%  interrupts.CPU66.LOC:Local_timer_interrupts
      1007 ±  5%     -12.6%     880.33 ±  5%  interrupts.CPU67.CAL:Function_call_interrupts
    239950           -46.1%     129295 ± 17%  interrupts.CPU67.LOC:Local_timer_interrupts
    832.67 ±  6%     -35.6%     536.00 ± 14%  interrupts.CPU67.RES:Rescheduling_interrupts
      1021 ±  4%     -15.3%     865.33 ±  2%  interrupts.CPU68.CAL:Function_call_interrupts
    240004           -46.1%     129269 ± 17%  interrupts.CPU68.LOC:Local_timer_interrupts
      9764 ± 20%     +29.8%      12677        interrupts.CPU68.NMI:Non-maskable_interrupts
      9764 ± 20%     +29.8%      12677        interrupts.CPU68.PMI:Performance_monitoring_interrupts
      1075 ± 24%     -54.4%     490.00 ± 16%  interrupts.CPU68.RES:Rescheduling_interrupts
    239958           -45.9%     129793 ± 17%  interrupts.CPU69.LOC:Local_timer_interrupts
    239993           -46.8%     127626 ± 19%  interrupts.CPU7.LOC:Local_timer_interrupts
      2021 ± 42%     -64.6%     716.00 ± 42%  interrupts.CPU7.RES:Rescheduling_interrupts
      1071 ± 11%     -20.9%     846.67        interrupts.CPU70.CAL:Function_call_interrupts
    239964           -46.1%     129309 ± 17%  interrupts.CPU70.LOC:Local_timer_interrupts
      9779 ± 20%     +29.3%      12648        interrupts.CPU70.NMI:Non-maskable_interrupts
      9779 ± 20%     +29.3%      12648        interrupts.CPU70.PMI:Performance_monitoring_interrupts
      1520 ± 66%     -67.4%     495.00 ± 24%  interrupts.CPU70.RES:Rescheduling_interrupts
      1050 ±  7%     -15.1%     892.33 ±  5%  interrupts.CPU71.CAL:Function_call_interrupts
    240046           -46.1%     129443 ± 17%  interrupts.CPU71.LOC:Local_timer_interrupts
    239974           -46.2%     129217 ± 17%  interrupts.CPU72.LOC:Local_timer_interrupts
      8357           +51.3%      12641        interrupts.CPU72.NMI:Non-maskable_interrupts
      8357           +51.3%      12641        interrupts.CPU72.PMI:Performance_monitoring_interrupts
    972.00 ±  2%      -9.6%     878.67 ±  5%  interrupts.CPU73.CAL:Function_call_interrupts
    239980           -46.2%     129101 ± 17%  interrupts.CPU73.LOC:Local_timer_interrupts
      8352           +51.7%      12668        interrupts.CPU73.NMI:Non-maskable_interrupts
      8352           +51.7%      12668        interrupts.CPU73.PMI:Performance_monitoring_interrupts
    840.33 ±  6%     -29.7%     590.67 ±  7%  interrupts.CPU73.RES:Rescheduling_interrupts
    981.00 ±  3%      -6.7%     915.00 ±  3%  interrupts.CPU74.CAL:Function_call_interrupts
    239985           -46.1%     129294 ± 17%  interrupts.CPU74.LOC:Local_timer_interrupts
      8361           +51.1%      12635        interrupts.CPU74.NMI:Non-maskable_interrupts
      8361           +51.1%      12635        interrupts.CPU74.PMI:Performance_monitoring_interrupts
    240829           -46.3%     129241 ± 17%  interrupts.CPU75.LOC:Local_timer_interrupts
      8354           +51.3%      12639        interrupts.CPU75.NMI:Non-maskable_interrupts
      8354           +51.3%      12639        interrupts.CPU75.PMI:Performance_monitoring_interrupts
      1215 ± 24%     -29.0%     862.67        interrupts.CPU76.CAL:Function_call_interrupts
    239936           -46.1%     129378 ± 17%  interrupts.CPU76.LOC:Local_timer_interrupts
      8356           +51.9%      12689        interrupts.CPU76.NMI:Non-maskable_interrupts
      8356           +51.9%      12689        interrupts.CPU76.PMI:Performance_monitoring_interrupts
      1190 ± 53%     -53.9%     548.67 ± 26%  interrupts.CPU76.RES:Rescheduling_interrupts
    240024           -46.1%     129392 ± 17%  interrupts.CPU77.LOC:Local_timer_interrupts
      9761 ± 20%     +29.9%      12678        interrupts.CPU77.NMI:Non-maskable_interrupts
      9761 ± 20%     +29.9%      12678        interrupts.CPU77.PMI:Performance_monitoring_interrupts
    887.33 ±  7%     -29.0%     629.67 ± 20%  interrupts.CPU77.RES:Rescheduling_interrupts
    979.00 ±  2%     -12.7%     854.33        interrupts.CPU78.CAL:Function_call_interrupts
    240014           -46.2%     129202 ± 17%  interrupts.CPU78.LOC:Local_timer_interrupts
    898.33 ± 17%     -34.6%     587.33 ± 19%  interrupts.CPU78.RES:Rescheduling_interrupts
    240108           -46.1%     129498 ± 17%  interrupts.CPU79.LOC:Local_timer_interrupts
      1026 ±  4%     -16.1%     860.67        interrupts.CPU8.CAL:Function_call_interrupts
    239982           -47.6%     125787 ± 22%  interrupts.CPU8.LOC:Local_timer_interrupts
    956.67 ± 11%     -42.2%     552.67 ± 23%  interrupts.CPU8.RES:Rescheduling_interrupts
    239946           -46.1%     129308 ± 17%  interrupts.CPU80.LOC:Local_timer_interrupts
      9778 ± 20%     +29.7%      12680        interrupts.CPU80.NMI:Non-maskable_interrupts
      9778 ± 20%     +29.7%      12680        interrupts.CPU80.PMI:Performance_monitoring_interrupts
      1061 ± 11%     -18.8%     862.33        interrupts.CPU81.CAL:Function_call_interrupts
    240044           -46.1%     129361 ± 17%  interrupts.CPU81.LOC:Local_timer_interrupts
      1570 ± 59%     -70.9%     457.00 ± 13%  interrupts.CPU81.RES:Rescheduling_interrupts
    241709           -46.5%     129399 ± 17%  interrupts.CPU82.LOC:Local_timer_interrupts
    240054           -46.3%     129000 ± 18%  interrupts.CPU83.LOC:Local_timer_interrupts
    239873           -46.2%     129076 ± 18%  interrupts.CPU84.LOC:Local_timer_interrupts
    239952           -46.1%     129352 ± 17%  interrupts.CPU85.LOC:Local_timer_interrupts
      9742 ± 20%     +15.6%      11260 ± 17%  interrupts.CPU85.NMI:Non-maskable_interrupts
      9742 ± 20%     +15.6%      11260 ± 17%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
    838.00 ± 11%     -26.7%     614.67 ± 25%  interrupts.CPU85.RES:Rescheduling_interrupts
    963.33            -8.8%     878.67 ±  6%  interrupts.CPU86.CAL:Function_call_interrupts
    239964           -46.1%     129240 ± 17%  interrupts.CPU86.LOC:Local_timer_interrupts
    787.00 ± 15%     -34.7%     514.00 ± 11%  interrupts.CPU86.RES:Rescheduling_interrupts
    987.33 ±  5%     -10.1%     888.00 ±  3%  interrupts.CPU87.CAL:Function_call_interrupts
    240019           -46.1%     129379 ± 17%  interrupts.CPU87.LOC:Local_timer_interrupts
    917.33 ±  9%     -41.1%     540.33 ± 21%  interrupts.CPU87.RES:Rescheduling_interrupts
    984.00           -13.0%     856.00 ±  2%  interrupts.CPU88.CAL:Function_call_interrupts
    240005           -46.2%     129206 ± 17%  interrupts.CPU88.LOC:Local_timer_interrupts
    847.00 ±  8%     -42.6%     486.33 ±  7%  interrupts.CPU88.RES:Rescheduling_interrupts
      1119 ±  8%     -19.9%     896.67 ±  4%  interrupts.CPU89.CAL:Function_call_interrupts
    240000           -46.2%     129181 ± 17%  interrupts.CPU89.LOC:Local_timer_interrupts
      1235 ± 44%     -60.6%     487.33 ±  7%  interrupts.CPU89.RES:Rescheduling_interrupts
      1566 ± 47%     -45.4%     855.00        interrupts.CPU9.CAL:Function_call_interrupts
    240007           -47.5%     125898 ± 22%  interrupts.CPU9.LOC:Local_timer_interrupts
    802.33 ± 19%     -41.1%     472.33 ± 15%  interrupts.CPU9.RES:Rescheduling_interrupts
      1014 ±  3%     -15.2%     859.67 ±  3%  interrupts.CPU90.CAL:Function_call_interrupts
    239988           -46.1%     129330 ± 17%  interrupts.CPU90.LOC:Local_timer_interrupts
    890.33 ± 10%     -25.3%     665.33 ± 22%  interrupts.CPU90.RES:Rescheduling_interrupts
      1052 ±  9%     -15.4%     890.00 ±  4%  interrupts.CPU91.CAL:Function_call_interrupts
    241075           -46.4%     129286 ± 17%  interrupts.CPU91.LOC:Local_timer_interrupts
      1250 ± 46%     -49.0%     638.33 ± 29%  interrupts.CPU91.RES:Rescheduling_interrupts
    240154           -46.1%     129491 ± 17%  interrupts.CPU92.LOC:Local_timer_interrupts
    997.00 ±  3%     -12.2%     875.67        interrupts.CPU93.CAL:Function_call_interrupts
    240100           -46.1%     129501 ± 17%  interrupts.CPU93.LOC:Local_timer_interrupts
    903.00 ± 13%     -42.4%     520.33 ± 28%  interrupts.CPU93.RES:Rescheduling_interrupts
    240113           -46.1%     129354 ± 17%  interrupts.CPU94.LOC:Local_timer_interrupts
      1059 ±  5%     -13.5%     915.67 ±  3%  interrupts.CPU95.CAL:Function_call_interrupts
    240211           -46.2%     129305 ± 17%  interrupts.CPU95.LOC:Local_timer_interrupts
      1038 ± 33%     -38.2%     641.67 ± 11%  interrupts.CPU95.RES:Rescheduling_interrupts
    987.33           -11.0%     878.67        interrupts.CPU96.CAL:Function_call_interrupts
    240040           -46.6%     128285 ± 18%  interrupts.CPU96.LOC:Local_timer_interrupts
    617.33 ±  7%     -44.7%     341.67 ± 12%  interrupts.CPU96.RES:Rescheduling_interrupts
    976.00           -11.3%     865.33        interrupts.CPU97.CAL:Function_call_interrupts
    240035           -46.4%     128578 ± 18%  interrupts.CPU97.LOC:Local_timer_interrupts
    597.33 ± 14%     -48.8%     306.00 ± 10%  interrupts.CPU97.RES:Rescheduling_interrupts
      1018 ±  2%     -13.7%     879.33        interrupts.CPU98.CAL:Function_call_interrupts
    240047           -46.3%     128809 ± 18%  interrupts.CPU98.LOC:Local_timer_interrupts
    603.67 ± 11%     -49.9%     302.67 ± 18%  interrupts.CPU98.RES:Rescheduling_interrupts
      1032 ±  6%     -17.0%     857.00        interrupts.CPU99.CAL:Function_call_interrupts
    240007           -46.2%     129045 ± 18%  interrupts.CPU99.LOC:Local_timer_interrupts
      1148 ± 74%     -72.2%     319.00 ± 15%  interrupts.CPU99.RES:Rescheduling_interrupts
    641.67 ±  6%     -27.0%     468.67        interrupts.IWI:IRQ_work_interrupts
  30745024           -46.9%   16326093 ± 20%  interrupts.LOC:Local_timer_interrupts
    107610           -39.5%      65129 ±  4%  interrupts.RES:Rescheduling_interrupts
      0.24 ±124%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      0.12 ±116%     -97.0%       0.00 ±141%  perf-sched.sch_delay.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
      0.02 ±  9%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      6.95 ± 78%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.do_syslog.part.0.kmsg_read.vfs_read
      0.48 ± 10%     -95.1%       0.02 ±135%  perf-sched.sch_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      1.48 ± 76%     -99.9%       0.00 ±141%  perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown]
      0.13 ± 28%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      0.00 ± 56%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown]
      0.19 ±  4%     -97.4%       0.01 ± 28%  perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.93 ± 34%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      3.69 ±  3%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.ipmi_thread.kthread.ret_from_fork
      0.03 ± 51%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.jbd2_journal_commit_transaction.kjournald2.kthread.ret_from_fork
      0.01 ± 17%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.kjournald2.kthread.ret_from_fork
      0.92 ±137%     -99.6%       0.00 ± 12%  perf-sched.sch_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      0.12 ± 56%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__alloc_pages.pagecache_get_page.grab_cache_page_write_begin
      1.41 ± 66%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      0.00 ± 40%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.__ext4_new_inode.ext4_create
      0.10 ±118%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
      0.13 ± 38%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      1.02          -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__flush_work.lru_add_drain_all.khugepaged
      0.10 ± 40%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
      0.11 ± 71%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_getblk.ext4_bread
      2.85 ± 71%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__put_anon_vma.unlink_anon_vmas.free_pgtables
      0.07 ± 58%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.block_invalidatepage.truncate_cleanup_page.truncate_inode_pages_range
      2.98 ± 44%    -100.0%       0.00 ±141%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.13 ± 74%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
      2.28 ± 33%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.down_read.rmap_walk_anon.remove_migration_ptes
      0.07 ± 13%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
      0.04 ± 54%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.dput.do_unlinkat.do_syscall_64
      0.15 ±137%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.dput.fscrypt_file_open.ext4_file_open
      0.06 ±136%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.dput.path_openat.do_filp_open
      0.34 ± 65%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      0.18 ± 20%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      0.13 ± 21%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      0.41 ± 51%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      0.08 ± 40%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
      0.26 ± 67%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
      0.11 ± 36%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      0.32 ±138%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
      0.19 ±139%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.try_to_migrate.migrate_pages
      2.85 ±127%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
     11.17 ± 10%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.sched_exec.bprm_execve
      0.05 ± 83%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.truncate_inode_pages_range.ext4_evict_inode.evict
      0.20 ± 16%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      2.96 ±115%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      0.18 ±103%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_migrate
      0.74 ± 68%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages
      1.18 ± 68%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.__put_anon_vma.unlink_anon_vmas.free_pgtables
      0.87 ± 47%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.35 ± 63%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      0.58 ± 21%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.unlink_anon_vmas.free_pgtables.exit_mmap
      0.10 ± 30%     -98.0%       0.00 ±141%  perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
      0.02 ± 22%     -62.3%       0.01 ±  6%  perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select
      0.01 ± 91%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      1.78 ± 64%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.usleep_range.ipmi_thread.kthread
      0.16 ± 48%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.__fdget_pos
      0.67 ± 72%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_add
      1.26 ± 46%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_del
      0.27 ±125%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg.__sys_recvfrom
      0.03 ± 15%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
      2.78 ± 11%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
      0.90 ±133%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.wait_transaction_locked.add_transaction_credits.start_this_handle.jbd2__journal_start
      0.02 ± 10%    +448.6%       0.14 ± 46%  perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork
      2.12 ±135%    -100.0%       0.00        perf-sched.sch_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      0.23 ±124%     -98.1%       0.00 ±141%  perf-sched.sch_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
      0.04 ± 27%    -100.0%       0.00        perf-sched.sch_delay.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      6.95 ± 78%    -100.0%       0.00        perf-sched.sch_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read
     56.52 ± 76%     -99.4%       0.34 ±137%  perf-sched.sch_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
     13.44 ±  8%     -81.8%       2.44 ± 87%  perf-sched.sch_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      9.29 ± 75%    -100.0%       0.00 ±141%  perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown]
     10.92 ± 18%    -100.0%       0.00        perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      0.02 ± 19%    -100.0%       0.00        perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown]
     77.93 ± 64%    -100.0%       0.01 ±  8%  perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
     16.67 ± 37%    -100.0%       0.00        perf-sched.sch_delay.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      3.79          -100.0%       0.00        perf-sched.sch_delay.max.ms.ipmi_thread.kthread.ret_from_fork
      0.04 ± 62%    -100.0%       0.00        perf-sched.sch_delay.max.ms.jbd2_journal_commit_transaction.kjournald2.kthread.ret_from_fork
      0.01 ± 18%    -100.0%       0.00        perf-sched.sch_delay.max.ms.kjournald2.kthread.ret_from_fork
      3366 ±141%    -100.0%       0.01 ±  7%  perf-sched.sch_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      5.32 ± 41%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__alloc_pages.pagecache_get_page.grab_cache_page_write_begin
      1470 ± 72%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      0.02 ± 11%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.__ext4_new_inode.ext4_create
      2.83 ±128%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
     18.81 ± 63%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      1.02          -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__flush_work.lru_add_drain_all.khugepaged
      8.60          -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
      5.02 ± 73%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_getblk.ext4_bread
      8.80 ± 71%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__put_anon_vma.unlink_anon_vmas.free_pgtables
     25.14 ± 83%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.block_invalidatepage.truncate_cleanup_page.truncate_inode_pages_range
     19.87 ± 72%    -100.0%       0.00 ±141%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
     10.45 ± 41%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
     15.33 ± 37%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.down_read.rmap_walk_anon.remove_migration_ptes
      7.51 ± 24%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
      3.65 ± 57%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.dput.do_unlinkat.do_syscall_64
      2.90 ±140%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.dput.fscrypt_file_open.ext4_file_open
      7.96 ±140%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.dput.path_openat.do_filp_open
      1615 ± 64%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
    104.61 ± 66%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
     26.17 ± 35%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      1533 ± 67%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      6.52 ± 26%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
     19.24 ± 80%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
     11.48 ± 16%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      5.32 ±136%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
      2.35 ±138%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.try_to_migrate.migrate_pages
    690.56 ±137%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
     47.22 ± 18%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.sched_exec.bprm_execve
     10.00 ± 88%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.truncate_inode_pages_range.ext4_evict_inode.evict
     14.49 ± 38%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      1.91 ±137%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
    796.40 ±139%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      6.86 ± 76%    -100.0%       0.00        perf-sched.sch_delay.max.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_migrate
      7.65 ± 70%    -100.0%       0.00        perf-sched.sch_delay.max.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages
     14.12 ± 65%    -100.0%       0.00        perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.__put_anon_vma.unlink_anon_vmas.free_pgtables
      1695 ± 64%    -100.0%       0.00        perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    900.56 ±129%    -100.0%       0.00        perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
     26.32 ± 45%    -100.0%       0.00        perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.unlink_anon_vmas.free_pgtables.exit_mmap
      1.38 ± 32%     -99.9%       0.00 ±141%  perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
      0.04 ± 45%     -79.8%       0.01 ±  6%  perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select
      0.04 ± 36%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      3.81          -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.usleep_range.ipmi_thread.kthread
     40.23 ± 61%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.__fdget_pos
      4.60 ± 70%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_add
     67.63 ±103%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_del
      0.27 ±125%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg.__sys_recvfrom
      0.14 ± 39%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
     82.51 ± 59%     -90.8%       7.57 ± 70%  perf-sched.sch_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork
     18.45 ± 22%    -100.0%       0.00        perf-sched.sch_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
     66.81 ±114%    -100.0%       0.00        perf-sched.sch_delay.max.ms.wait_transaction_locked.add_transaction_credits.start_this_handle.jbd2__journal_start
      4.81 ±  5%     -31.9%       3.28        perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork
      0.40 ± 42%     -91.9%       0.03 ± 37%  perf-sched.total_sch_delay.average.ms
      5037 ± 70%     -99.8%       9.29 ± 31%  perf-sched.total_sch_delay.max.ms
    206.03           -99.7%       0.70 ± 71%  perf-sched.total_wait_and_delay.average.ms
    110407 ±  3%     -99.5%     521.67 ± 10%  perf-sched.total_wait_and_delay.count.ms
     10052           -99.9%      12.56 ± 13%  perf-sched.total_wait_and_delay.max.ms
    205.63           -99.7%       0.67 ± 76%  perf-sched.total_wait_time.average.ms
     10033           -99.9%       9.83 ± 48%  perf-sched.total_wait_time.max.ms
    902.58          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
    795.52 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
    150.01 ± 10%     -99.8%       0.36 ± 41%  perf-sched.wait_and_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
     42.99 ± 14%     -98.9%       0.46 ± 32%  perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
    266.43 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
    133.36 ± 19%    -100.0%       0.00 ±141%  perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3039 ± 12%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.jbd2_journal_commit_transaction.kjournald2.kthread.ret_from_fork
     70.92 ± 27%     -99.2%       0.53 ± 22%  perf-sched.wait_and_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
    243.86 ± 11%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
    367.46 ± 31%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
    258.01 ± 12%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
    265.27 ± 11%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
    262.92 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
    210.81 ±  2%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
    231.92 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
    234.58 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
    197.19 ±  2%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
    292.50 ± 16%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
    207.67 ± 10%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
    428.40 ± 21%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
    269.54 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      7.84 ±  5%     -99.5%       0.04 ± 54%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
    261.70 ± 25%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
    126.62 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    154.50 ±  6%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
    318.40 ±  6%     -99.7%       0.90 ± 73%  perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
    479.59          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
    628.90 ±  6%     -99.8%       1.41 ± 83%  perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
    529.05 ±  4%     -99.9%       0.64 ± 27%  perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork
     20.67 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.count.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
     11.33 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.count.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      1011 ±  6%     -97.7%      23.67 ± 26%  perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      1027 ±  6%     -97.8%      22.67 ± 50%  perf-sched.wait_and_delay.count.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
    310.33 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      4219 ± 12%    -100.0%       0.67 ±141%  perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.67 ± 17%    -100.0%       0.00        perf-sched.wait_and_delay.count.jbd2_journal_commit_transaction.kjournald2.kthread.ret_from_fork
      2393 ± 40%     -99.3%      17.00 ± 51%  perf-sched.wait_and_delay.count.pipe_read.new_sync_read.vfs_read.ksys_read
      1084 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
     29.67 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
    297.00 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
    223.33 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
    167.67 ± 12%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
     41730 ±  3%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      1786 ± 10%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      2816 ±  6%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
     27473 ±  3%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
    134.67 ± 12%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
    999.33 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
    415.00 ± 38%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
    345.67 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      1234 ±  4%     -83.2%     207.67 ±  4%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
    324.67 ±  8%    -100.0%       0.00        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      5216 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4789 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
     33.00 ±  7%     -91.9%       2.67 ± 93%  perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
     41.33 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.count.schedule_timeout.kcompactd.kthread.ret_from_fork
      2355          -100.0%       1.00 ± 81%  perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      3443 ±  4%     -94.0%     207.67 ±  4%  perf-sched.wait_and_delay.count.smpboot_thread_fn.kthread.ret_from_fork
      2351 ±  2%     -98.7%      31.67 ± 48%  perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
      1003          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      1000          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
     10000          -100.0%       1.69 ± 39%  perf-sched.wait_and_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      7020 ± 60%    -100.0%       2.64 ± 72%  perf-sched.wait_and_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      2563 ±  9%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      2639 ±  6%    -100.0%       0.00 ±141%  perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4975          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.jbd2_journal_commit_transaction.kjournald2.kthread.ret_from_fork
      7160 ± 57%    -100.0%       1.48 ±  6%  perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      2647 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
      2300 ±  2%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
      2563 ±  2%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
      2503 ±  6%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
      2576 ±  3%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
      2709 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      2666 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      2643 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      3086 ± 18%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      2560 ±  2%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
      2620 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
      2643 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
      2578 ±  6%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      1024 ±  3%     -99.5%       4.83 ± 81%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      2511 ±  3%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      2651 ±  5%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2669 ±  4%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
    499.96           -99.4%       2.80 ± 77%  perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
    505.02          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
     68.77 ±116%     -95.2%       3.32 ± 70%  perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      8992 ±  4%     -99.9%      12.56 ± 13%  perf-sched.wait_and_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork
      5086           -99.9%       5.83 ± 62%  perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork
    902.34          -100.0%       0.00        perf-sched.wait_time.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      1.86 ± 16%     -73.9%       0.49 ±141%  perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
    795.50 ±  4%    -100.0%       0.00        perf-sched.wait_time.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
    149.53 ± 10%     -99.8%       0.34 ± 53%  perf-sched.wait_time.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
     42.83 ± 14%     -99.2%       0.33 ±  3%  perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
     98.52 ±127%    -100.0%       0.00        perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown]
    266.30 ±  5%    -100.0%       0.00        perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
    144.10 ± 69%    -100.0%       0.00        perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown]
      5.96 ± 40%    -100.0%       0.00        perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown]
    133.17 ± 20%    -100.0%       0.00        perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
     44.95 ±120%    -100.0%       0.00        perf-sched.wait_time.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      3.88 ±  3%    -100.0%       0.00        perf-sched.wait_time.avg.ms.ipmi_thread.kthread.ret_from_fork
      3039 ± 12%    -100.0%       0.00        perf-sched.wait_time.avg.ms.jbd2_journal_commit_transaction.kjournald2.kthread.ret_from_fork
      0.23 ± 23%    -100.0%       0.00        perf-sched.wait_time.avg.ms.kjournald2.kthread.ret_from_fork
     69.99 ± 29%     -99.2%       0.53 ± 22%  perf-sched.wait_time.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
    127.82 ±129%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__alloc_pages.alloc_pages_vma.shmem_alloc_page
    253.61 ± 26%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__alloc_pages.pagecache_get_page.grab_cache_page_write_begin
      8.90 ± 38%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__do_fault.do_fault.__handle_mm_fault
     14.23 ± 26%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.__ext4_new_inode.ext4_create
    242.45 ± 11%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
    201.67 ±135%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_free_inode.ext4_evict_inode
    262.06 ±131%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_handle_dirty_dirblock.add_dirent_to_buf
    302.18 ± 95%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_handle_dirty_dirblock.ext4_delete_entry
     10.34 ± 25%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_orphan_add.__ext4_unlink
    224.37 ± 77%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.__ext4_new_inode.ext4_create
     12.84 ± 68%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.add_dirent_to_buf.ext4_dx_add_entry
    372.22 ± 69%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_delete_entry.__ext4_unlink
     13.51 ± 43%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_orphan_add.__ext4_unlink
    367.37 ± 31%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
    439.50 ±136%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.__ext4_new_inode.ext4_create
    123.74 ± 13%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
    165.27 ± 71%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_evict_inode.evict
    257.91 ± 12%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
    266.36 ± 22%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_getblk.ext4_bread
     77.25 ±114%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_read_inode_bitmap.__ext4_new_inode
    277.65 ± 66%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_read_inode_bitmap.ext4_free_inode
    339.27 ±131%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__kmalloc_node.memcg_alloc_page_obj_cgroups.kmem_cache_alloc
     12.21 ± 16%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__put_anon_vma.unlink_anon_vmas.free_pgtables
    183.13 ± 28%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.block_invalidatepage.truncate_cleanup_page.truncate_inode_pages_range
      5.61 ± 47%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
    265.14 ± 11%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
     10.53 ± 26%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_read.rmap_walk_anon.remove_migration_ptes
    262.85 ±  4%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
     10.13 ± 74%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_write.generic_file_write_iter.new_sync_write
    210.89 ± 83%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.down_write.vfs_unlink.do_unlinkat
     30.01 ± 51%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.dput.__fput.task_work_run
    143.03 ± 44%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.dput.do_unlinkat.do_syscall_64
    307.59 ± 38%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.dput.fscrypt_file_open.ext4_file_open
    155.05 ±  4%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.dput.path_openat.do_filp_open
    210.47 ±  2%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
    231.74 ±  5%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
    234.45 ±  4%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
    178.71 ± 38%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
    196.79 ±  2%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      2.52 ± 66%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.khugepaged.kthread.ret_from_fork
     14.36 ± 28%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.__alloc_file.alloc_empty_file
    212.33 ± 70%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.__d_alloc.d_alloc
    211.77 ± 20%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
    105.94 ±122%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.ext4_alloc_inode.alloc_inode
    266.06 ±131%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.getname_flags.do_sys_openat2
    292.24 ± 16%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
    296.48 ±133%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.security_file_alloc.__alloc_file
     15.99 ± 26%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.migrate_pages.migrate_misplaced_page.do_numa_page
    344.60 ± 72%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.mnt_want_write.path_openat.do_filp_open
      9.27 ± 66%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.mutex_lock.perf_poll.do_sys_poll
    207.56 ± 10%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
     14.98 ± 32%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.simple_write_begin
     13.78 ± 21%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.remove_vma.exit_mmap.mmput
    127.70 ± 30%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
    127.95 ± 64%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.try_to_migrate.migrate_pages
    425.55 ± 21%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
     13.82 ± 34%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
    211.48 ± 37%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.truncate_inode_pages_range.ext4_evict_inode.evict
    269.34 ±  7%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      7.84 ±  5%     -99.5%       0.04 ± 54%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
    258.74 ± 26%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
    213.96 ± 74%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas
    146.96 ± 39%    -100.0%       0.00        perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_migrate
     35.98 ± 95%    -100.0%       0.00        perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages
     12.67 ± 17%    -100.0%       0.00        perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.__put_anon_vma.unlink_anon_vmas.free_pgtables
    125.75 ±  7%    -100.0%       0.00        perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
    154.14 ±  5%    -100.0%       0.00        perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
     86.69 ± 45%    -100.0%       0.00        perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.unlink_anon_vmas.free_pgtables.exit_mmap
    318.30 ±  6%     -99.7%       0.90 ± 73%  perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
     15.12 ± 53%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select
    234.15 ± 61%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      1.91 ± 60%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.usleep_range.ipmi_thread.kthread
     60.64 ±  2%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.__fdget_pos
    337.57 ± 92%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_add
     75.43 ± 81%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_del
      0.76 ± 70%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg.__sys_recvfrom
    479.56          -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
      3.38 ± 76%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
      4.38           -81.1%       0.83 ±141%  perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      0.02 ± 13%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      0.10 ± 71%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.wait_for_completion.stop_two_cpus.migrate_swap
    628.85 ±  6%     -99.8%       1.37 ± 88%  perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
      0.94 ± 14%    -100.0%       0.00        perf-sched.wait_time.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
     91.71 ± 80%    -100.0%       0.00        perf-sched.wait_time.avg.ms.wait_transaction_locked.add_transaction_credits.start_this_handle.jbd2__journal_start
    529.02 ±  4%     -99.9%       0.51 ± 46%  perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork
      1001          -100.0%       0.00        perf-sched.wait_time.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      3.72 ± 16%     -73.9%       0.97 ±141%  perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
      1000          -100.0%       0.00        perf-sched.wait_time.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
     10000          -100.0%       1.52 ± 56%  perf-sched.wait_time.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      7020 ± 60%    -100.0%       0.61 ±  5%  perf-sched.wait_time.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
    841.98 ±135%    -100.0%       0.00        perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown]
      2560 ±  9%    -100.0%       0.00        perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      1337 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_call_function_single.[unknown]
     23.85 ± 31%    -100.0%       0.00        perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown]
      2639 ±  6%    -100.0%       0.00        perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
    713.05 ±138%    -100.0%       0.00        perf-sched.wait_time.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      3.98          -100.0%       0.00        perf-sched.wait_time.max.ms.ipmi_thread.kthread.ret_from_fork
      4975          -100.0%       0.00        perf-sched.wait_time.max.ms.jbd2_journal_commit_transaction.kjournald2.kthread.ret_from_fork
      0.27 ± 17%    -100.0%       0.00        perf-sched.wait_time.max.ms.kjournald2.kthread.ret_from_fork
      4287 ± 95%    -100.0%       1.47 ±  6%  perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      1312 ±138%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__alloc_pages.alloc_pages_vma.shmem_alloc_page
      2427 ±  2%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__alloc_pages.pagecache_get_page.grab_cache_page_write_begin
     27.92 ± 40%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__do_fault.do_fault.__handle_mm_fault
     16.00 ± 31%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.__ext4_new_inode.ext4_create
      2644 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_do_update_inode.ext4_mark_iloc_dirty
    761.73 ±139%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_free_inode.ext4_evict_inode
    755.84 ±135%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_handle_dirty_dirblock.add_dirent_to_buf
      1493 ± 70%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_handle_dirty_dirblock.ext4_delete_entry
     13.33 ± 27%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_handle_dirty_metadata.ext4_orphan_add.__ext4_unlink
      2079 ± 10%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.__ext4_new_inode.ext4_create
     17.53 ± 70%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.add_dirent_to_buf.ext4_dx_add_entry
      1601 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_delete_entry.__ext4_unlink
     15.67 ± 23%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_orphan_add.__ext4_unlink
      2300 ±  2%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_journal_get_write_access.ext4_reserve_inode_write.__ext4_mark_inode_dirty
    860.88 ±137%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.__ext4_new_inode.ext4_create
      2552 ±  6%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_dirty_inode.__mark_inode_dirty
      1455 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__ext4_mark_inode_dirty.ext4_evict_inode.evict
      2560 ±  2%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.__ext4_get_inode_loc.ext4_get_inode_loc
      2423 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_getblk.ext4_bread
    769.55 ±137%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_read_inode_bitmap.__ext4_new_inode
      1324 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__getblk_gfp.ext4_read_inode_bitmap.ext4_free_inode
    661.53 ±135%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__kmalloc_node.memcg_alloc_page_obj_cgroups.kmem_cache_alloc
     31.53 ± 57%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__put_anon_vma.unlink_anon_vmas.free_pgtables
      2569          -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.block_invalidatepage.truncate_cleanup_page.truncate_inode_pages_range
     19.34 ± 24%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      2503 ±  6%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_read.ext4_da_map_blocks.constprop
     26.65 ± 16%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_read.rmap_walk_anon.remove_migration_ptes
      2576 ±  3%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_write.ext4_buffered_write_iter.new_sync_write
     10.13 ± 74%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_write.generic_file_write_iter.new_sync_write
      1423 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.down_write.vfs_unlink.do_unlinkat
      1395 ± 68%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.dput.__fput.task_work_run
      2412 ±  6%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.dput.do_unlinkat.do_syscall_64
      2313 ±  8%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.dput.fscrypt_file_open.ext4_file_open
      2483 ±  4%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.dput.path_openat.do_filp_open
      2686 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter
      2666 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_da_write_begin
      2643 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dirty_inode
      4113 ±  3%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      2677 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.generic_perform_write.ext4_buffered_write_iter.new_sync_write
      2.54 ± 67%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.khugepaged.kthread.ret_from_fork
     30.70 ± 40%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.__alloc_file.alloc_empty_file
      1470 ± 70%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.__d_alloc.d_alloc
      2500 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.alloc_buffer_head.alloc_page_buffers
    774.86 ±133%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.ext4_alloc_inode.alloc_inode
    769.52 ±136%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.getname_flags.do_sys_openat2
      2560 ±  2%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.jbd2__journal_start.__ext4_journal_start_sb
    860.95 ±136%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc.security_file_alloc.__alloc_file
     15.99 ± 26%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.migrate_pages.migrate_misplaced_page.do_numa_page
      1499 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.mnt_want_write.path_openat.do_filp_open
     12.77 ± 33%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.mutex_lock.perf_poll.do_sys_poll
      2620 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.ext4_da_write_begin
     21.84 ± 24%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.pagecache_get_page.grab_cache_page_write_begin.simple_write_begin
     18.89 ±  7%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.remove_vma.exit_mmap.mmput
      2170 ±  7%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.remove_migration_ptes.migrate_pages
      1604 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.rmap_walk_anon.try_to_migrate.migrate_pages
      2643 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.migrate_task_to.task_numa_migrate
      6.79 ± 77%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.stop_one_cpu.sched_exec.bprm_execve
     26.31 ± 45%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      2586 ±  6%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.truncate_inode_pages_range.ext4_evict_inode.evict
      2578 ±  6%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.vfs_write.ksys_write.do_syscall_64
      1024 ±  3%     -99.5%       4.83 ± 81%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      2509 ±  3%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.stop_two_cpus.migrate_swap
      1314 ± 69%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.zap_pte_range.unmap_page_range.unmap_vmas
      2365 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.page_lock_anon_vma_read.rmap_walk_anon.try_to_migrate
    907.69 ±134%    -100.0%       0.00        perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.rmap_walk_anon.remove_migration_ptes.migrate_pages
     40.85 ± 24%    -100.0%       0.00        perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.__put_anon_vma.unlink_anon_vmas.free_pgtables
      2642 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2667 ±  3%    -100.0%       0.00        perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_openat2
      2246          -100.0%       0.00        perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.unlink_anon_vmas.free_pgtables.exit_mmap
    499.94           -99.4%       2.80 ± 77%  perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
     57.24 ± 38%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select
      1000          -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      4.01          -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.usleep_range.ipmi_thread.kthread
      2411 ±  6%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.__fdget_pos
      1407 ± 70%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_add
      2178 ±  8%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_preempt_disabled.__mutex_lock.isra.0.ext4_orphan_del
      0.76 ± 70%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg.__sys_recvfrom
    504.99          -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
      3.38 ± 76%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
     39.08 ± 98%     -95.8%       1.66 ±141%  perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      0.02 ± 23%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      2.67 ±131%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.wait_for_completion.stop_two_cpus.migrate_swap
      8992 ±  4%     -99.9%       7.46 ± 71%  perf-sched.wait_time.max.ms.smpboot_thread_fn.kthread.ret_from_fork
     12.73 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
      1982 ±  4%    -100.0%       0.00        perf-sched.wait_time.max.ms.wait_transaction_locked.add_transaction_credits.start_this_handle.jbd2__journal_start
      5086           -99.9%       4.83 ± 89%  perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.14.0-rc2-00021-gcc883236b792" of type "text/plain" (174023 bytes)

View attachment "job-script" of type "text/plain" (8185 bytes)

View attachment "job.yaml" of type "text/plain" (5543 bytes)

View attachment "reproduce" of type "text/plain" (1007 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ