lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Sun, 27 Jun 2021 16:22:49 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Christoph Hellwig <hch@....de>
Cc:     Jens Axboe <axboe@...nel.dk>,
        Colin Ian King <colin.king@...onical.com>,
        Ming Lei <ming.lei@...hat.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...ux.intel.com
Subject: [block]  990e78116d:  stress-ng.loop.ops_per_sec 101263.6%
 improvement



Greeting,

FYI, we noticed a 101263.6% improvement of stress-ng.loop.ops_per_sec due to commit:


commit: 990e78116d38059c9306cf0560c1c4ed1cf358d3 ("block: loop: fix deadlock between open and remove")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: stress-ng
on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
with following parameters:

	nr_threads: 10%
	disk: 1HDD
	testtime: 60s
	fs: ext4
	class: os
	test: loop
	cpufreq_governor: performance
	ucode: 0x5003006






Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml  # generate the yaml file for lkp run
        bin/lkp run                    generated-yaml-file

=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
  os/gcc-9/performance/1HDD/ext4/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp5/loop/stress-ng/60s/0x5003006

commit: 
  41fe8d088e ("bcache: avoid oversized read request in cache missing code path")
  990e78116d ("block: loop: fix deadlock between open and remove")

41fe8d088e96472f 990e78116d38059c9306cf0560c 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     10.50 ±  8%  +15879.4%       1677 ±  2%  stress-ng.loop.ops
      0.03 ± 15%    +1e+05%      27.88 ±  2%  stress-ng.loop.ops_per_sec
    421.64 ± 21%     -85.2%      62.34        stress-ng.time.elapsed_time
    421.64 ± 21%     -85.2%      62.34        stress-ng.time.elapsed_time.max
     29.25 ± 32%  +14917.7%       4392 ±  2%  stress-ng.time.involuntary_context_switches
      0.23 ± 16%  +10099.3%      23.71 ±  3%  stress-ng.time.system_time
      1292 ± 41%   +4115.3%      54482 ± 10%  stress-ng.time.voluntary_context_switches
 3.839e+10 ± 19%     -87.3%  4.862e+09 ± 31%  cpuidle.C1E.time
  67842972 ± 28%     -83.9%   10938644 ± 17%  cpuidle.C1E.usage
     98.10            -1.3%      96.86        iostat.cpu.idle
      1.86 ± 10%     +18.2%       2.20 ±  4%  iostat.cpu.system
    472.47 ± 19%     -76.0%     113.40        uptime.boot
     44128 ± 19%     -76.8%      10219        uptime.idle
      0.03 ± 11%      +0.8        0.78 ±  4%  mpstat.cpu.all.iowait%
      1.70 ± 10%      -0.5        1.25 ±  6%  mpstat.cpu.all.irq%
      0.03 ±  7%      +0.7        0.69 ±  3%  mpstat.cpu.all.sys%
      0.01 ±  8%      +0.1        0.09 ± 13%  mpstat.cpu.all.usr%
    584857 ± 17%     -62.2%     220863 ± 10%  numa-numastat.node0.local_node
    629771 ± 15%     -56.8%     271964 ± 10%  numa-numastat.node0.numa_hit
    408608 ± 37%     -53.4%     190442 ± 10%  numa-numastat.node1.local_node
    450459 ± 37%     -49.4%     227935 ± 12%  numa-numastat.node1.numa_hit
      2.25 ± 57%  +1.3e+05%       3013 ±  2%  vmstat.io.bi
      8528 ± 10%     -26.3%       6289 ±  8%  vmstat.io.bo
      1593 ±  3%    +318.1%       6662        vmstat.memory.buff
      0.00         +1e+102%       1.00        vmstat.procs.r
      1402 ±  2%    +722.0%      11530        vmstat.system.cs
      9194 ±  2%     +13.2%      10405 ±  4%  numa-vmstat.node0.nr_kernel_stack
    204.00 ± 51%     -98.6%       2.83 ±137%  numa-vmstat.node0.nr_mlock
      2139 ± 15%     -78.7%     455.33 ± 17%  numa-vmstat.node1.nr_active_anon
      3050 ± 31%    +267.0%      11194 ± 88%  numa-vmstat.node1.nr_anon_pages
      3674 ± 37%    +226.9%      12012 ± 88%  numa-vmstat.node1.nr_inactive_anon
      7211           +15.2%       8307 ±  6%  numa-vmstat.node1.nr_kernel_stack
    185.25 ± 54%     -99.0%       1.83 ±115%  numa-vmstat.node1.nr_mlock
      2139 ± 15%     -78.7%     455.33 ± 17%  numa-vmstat.node1.nr_zone_active_anon
      3674 ± 37%    +226.9%      12012 ± 88%  numa-vmstat.node1.nr_zone_inactive_anon
    184219 ±  2%     -59.7%      74250 ± 32%  numa-meminfo.node0.AnonHugePages
      9192 ±  2%     +13.0%      10390 ±  4%  numa-meminfo.node0.KernelStack
    818.00 ± 51%     -98.6%      11.17 ± 82%  numa-meminfo.node0.Mlocked
      9091 ± 19%     -55.0%       4094 ± 53%  numa-meminfo.node1.Active
      8562 ± 15%     -78.7%       1821 ± 17%  numa-meminfo.node1.Active(anon)
      1535 ± 84%   +1211.0%      20133 ±129%  numa-meminfo.node1.AnonHugePages
     12188 ± 31%    +266.8%      44712 ± 88%  numa-meminfo.node1.AnonPages
     15019 ± 37%    +222.3%      48406 ± 88%  numa-meminfo.node1.Inactive
     14670 ± 37%    +227.1%      47983 ± 88%  numa-meminfo.node1.Inactive(anon)
      7209           +15.1%       8299 ±  6%  numa-meminfo.node1.KernelStack
    741.75 ± 54%     -98.8%       9.00 ± 66%  numa-meminfo.node1.Mlocked
     12763 ±  9%     -13.8%      11005        meminfo.Active
     10830 ± 11%     -69.4%       3315 ±  2%  meminfo.Active(anon)
      1933 ±  2%    +297.7%       7689        meminfo.Active(file)
    185774           -49.2%      94341 ±  3%  meminfo.AnonHugePages
      1592 ±  3%    +312.3%       6567 ±  2%  meminfo.Buffers
    110028           +10.2%     121276        meminfo.KReclaimable
     16410 ±  2%     +13.8%      18682        meminfo.KernelStack
   3773538           +12.2%    4234609        meminfo.Memused
      1559 ± 50%     -98.7%      20.83 ± 69%  meminfo.Mlocked
      4595 ±  2%     +13.6%       5221        meminfo.PageTables
    110028           +10.2%     121276        meminfo.SReclaimable
     22698 ±  5%     -34.0%      14985        meminfo.Shmem
      2705 ± 11%     -69.4%     828.50 ±  2%  proc-vmstat.nr_active_anon
    483.00 ±  2%    +299.4%       1929 ±  2%  proc-vmstat.nr_active_file
     63107            +7.5%      67854        proc-vmstat.nr_anon_pages
     65904            +7.4%      70753        proc-vmstat.nr_inactive_anon
     16406 ±  2%     +13.9%      18694        proc-vmstat.nr_kernel_stack
      9187            +2.9%       9456        proc-vmstat.nr_mapped
    389.25 ± 50%     -98.8%       4.50 ± 80%  proc-vmstat.nr_mlock
      1148 ±  3%     +13.6%       1304        proc-vmstat.nr_page_table_pages
      5673 ±  5%     -34.0%       3746        proc-vmstat.nr_shmem
     27506           +10.2%      30316        proc-vmstat.nr_slab_reclaimable
     45236 ±  2%      +8.2%      48940 ±  2%  proc-vmstat.nr_slab_unreclaimable
    102.50 ± 22%     -41.5%      60.00        proc-vmstat.nr_written
      2705 ± 11%     -69.4%     828.50 ±  2%  proc-vmstat.nr_zone_active_anon
    483.00 ±  2%    +299.4%       1929 ±  2%  proc-vmstat.nr_zone_active_file
     65904            +7.4%      70753        proc-vmstat.nr_zone_inactive_anon
     64.25 ± 31%   +1223.0%     850.00 ± 19%  proc-vmstat.numa_hint_faults
   1114352 ± 16%     -52.2%     532291        proc-vmstat.numa_hit
   1027570 ± 18%     -56.8%     443690        proc-vmstat.numa_local
     86782            +2.1%      88601        proc-vmstat.numa_other
     17073 ± 52%     -88.7%       1934 ± 75%  proc-vmstat.numa_pte_updates
      3161 ± 10%    +619.3%      22741        proc-vmstat.pgactivate
   1172556 ± 16%     -43.2%     666390        proc-vmstat.pgalloc_normal
   1236265 ± 20%     -81.9%     223851        proc-vmstat.pgfault
   1158989 ± 16%     -54.6%     526117 ±  2%  proc-vmstat.pgfree
    886.00 ± 32%  +22052.9%     196274 ±  2%  proc-vmstat.pgpgin
   3526825 ± 10%     -88.6%     403253 ±  8%  proc-vmstat.pgpgout
     81389 ± 21%     -82.8%      13960 ±  2%  proc-vmstat.pgreuse
 1.673e+08 ±  4%    +149.2%   4.17e+08        perf-stat.i.branch-instructions
   2447828 ± 17%    +144.3%    5980343 ± 37%  perf-stat.i.branch-misses
    382962 ±  4%    +481.2%    2225660 ± 16%  perf-stat.i.cache-misses
   4720794 ± 29%    +323.9%   20013784 ± 55%  perf-stat.i.cache-references
      1367          +751.4%      11644 ±  2%  perf-stat.i.context-switches
 2.753e+09 ±  8%    +103.5%  5.601e+09 ±  9%  perf-stat.i.cpu-cycles
     98.31           +74.2%     171.23        perf-stat.i.cpu-migrations
      7687 ±  9%     -65.6%       2640 ±  8%  perf-stat.i.cycles-between-cache-misses
 2.237e+08          +129.2%  5.128e+08        perf-stat.i.dTLB-loads
      0.01 ± 55%      +0.0        0.02 ± 59%  perf-stat.i.dTLB-store-miss-rate%
     10902 ± 52%    +497.5%      65141 ± 60%  perf-stat.i.dTLB-store-misses
 1.193e+08          +118.9%  2.611e+08        perf-stat.i.dTLB-stores
     28.66 ±  3%     +11.2       39.84 ±  4%  perf-stat.i.iTLB-load-miss-rate%
    566718 ±  2%     +86.8%    1058849        perf-stat.i.iTLB-load-misses
 8.183e+08 ±  4%    +144.3%  1.999e+09        perf-stat.i.instructions
      1438 ±  3%     +33.0%       1913        perf-stat.i.instructions-per-iTLB-miss
      2.34 ± 20%    +385.3%      11.36        perf-stat.i.major-faults
      0.03 ±  8%    +103.4%       0.06 ±  9%  perf-stat.i.metric.GHz
     63.99 ± 21%    +266.7%     234.64 ± 49%  perf-stat.i.metric.K/sec
      5.32 ±  2%    +133.3%      12.40        perf-stat.i.metric.M/sec
      2828           +11.9%       3164        perf-stat.i.minor-faults
     91.33            -7.3       84.00        perf-stat.i.node-load-miss-rate%
     71303 ±  5%    +598.0%     497678 ±  5%  perf-stat.i.node-load-misses
      8437 ±  9%   +1022.0%      94668 ±  4%  perf-stat.i.node-loads
     30965 ± 10%    +945.7%     323793 ±  9%  perf-stat.i.node-store-misses
      5133 ± 52%   +1590.4%      86774 ± 15%  perf-stat.i.node-stores
      2831           +13.5%       3214        perf-stat.i.page-faults
      7198 ±  8%     -64.7%       2543 ±  6%  perf-stat.overall.cycles-between-cache-misses
      0.01 ± 53%      +0.0        0.02 ± 58%  perf-stat.overall.dTLB-store-miss-rate%
     28.67 ±  3%     +11.2       39.91 ±  4%  perf-stat.overall.iTLB-load-miss-rate%
      1443 ±  3%     +30.8%       1887        perf-stat.overall.instructions-per-iTLB-miss
     89.43            -5.4       83.98        perf-stat.overall.node-load-miss-rate%
 1.669e+08 ±  4%    +145.8%  4.102e+08        perf-stat.ps.branch-instructions
   2441733 ± 17%    +140.9%    5883223 ± 37%  perf-stat.ps.branch-misses
    382016 ±  5%    +473.2%    2189781 ± 16%  perf-stat.ps.cache-misses
   4709674 ± 29%    +318.1%   19691192 ± 55%  perf-stat.ps.cache-references
      1364          +739.9%      11458 ±  2%  perf-stat.ps.context-switches
     95763            -1.3%      94480        perf-stat.ps.cpu-clock
 2.746e+09 ±  8%    +100.7%  5.511e+09 ±  9%  perf-stat.ps.cpu-cycles
     98.06           +71.9%     168.55        perf-stat.ps.cpu-migrations
 2.232e+08          +126.0%  5.045e+08        perf-stat.ps.dTLB-loads
     10877 ± 52%    +489.1%      64076 ± 60%  perf-stat.ps.dTLB-store-misses
  1.19e+08          +115.9%  2.569e+08        perf-stat.ps.dTLB-stores
    565306 ±  2%     +84.3%    1041890        perf-stat.ps.iTLB-load-misses
 8.162e+08 ±  4%    +141.0%  1.967e+09        perf-stat.ps.instructions
      2.34 ± 20%    +377.0%      11.14        perf-stat.ps.major-faults
      2821           +10.3%       3112        perf-stat.ps.minor-faults
     71124 ±  5%    +588.5%     489696 ±  5%  perf-stat.ps.node-load-misses
      8415 ±  9%   +1006.9%      93154 ±  4%  perf-stat.ps.node-loads
     30885 ± 10%    +931.6%     318608 ±  9%  perf-stat.ps.node-store-misses
      5119 ± 52%   +1567.1%      85354 ± 15%  perf-stat.ps.node-stores
      2824           +11.9%       3161        perf-stat.ps.page-faults
     95763            -1.3%      94480        perf-stat.ps.task-clock
 3.424e+11 ± 18%     -63.8%  1.241e+11        perf-stat.total.instructions
      1528 ±  7%    +155.0%       3898 ±  7%  slabinfo.Acpi-Parse.active_objs
      1528 ±  7%    +155.0%       3898 ±  7%  slabinfo.Acpi-Parse.num_objs
    218.50 ± 16%    +609.7%       1550 ±  3%  slabinfo.bdev_cache.active_objs
    218.50 ± 16%    +609.7%       1550 ±  3%  slabinfo.bdev_cache.num_objs
      1413          +105.4%       2903 ±  6%  slabinfo.buffer_head.active_objs
      1414          +105.7%       2908 ±  6%  slabinfo.buffer_head.num_objs
      3065 ±  5%     +31.3%       4024 ±  6%  slabinfo.dmaengine-unmap-16.active_objs
      3065 ±  5%     +31.4%       4028 ±  6%  slabinfo.dmaengine-unmap-16.num_objs
    186.50 ± 32%   +1190.9%       2407 ±  4%  slabinfo.dquot.active_objs
    186.50 ± 32%   +1190.9%       2407 ±  4%  slabinfo.dquot.num_objs
      1541 ± 14%    +246.0%       5332 ± 17%  slabinfo.ext4_extent_status.active_objs
      1541 ± 14%    +246.0%       5332 ± 17%  slabinfo.ext4_extent_status.num_objs
    148.00 ± 98%     -99.1%       1.33 ± 70%  slabinfo.ext4_pending_reservation.active_objs
    148.00 ± 98%     -99.1%       1.33 ± 70%  slabinfo.ext4_pending_reservation.num_objs
      1178 ± 13%    +117.0%       2556 ±  4%  slabinfo.file_lock_cache.active_objs
      1178 ± 13%    +117.0%       2556 ±  4%  slabinfo.file_lock_cache.num_objs
      3349 ±  4%    +127.4%       7617 ±  7%  slabinfo.fsnotify_mark_connector.active_objs
      3349 ±  4%    +127.4%       7617 ±  7%  slabinfo.fsnotify_mark_connector.num_objs
     87142           +15.9%     101023 ±  2%  slabinfo.inode_cache.active_objs
      1618           +16.0%       1877 ±  2%  slabinfo.inode_cache.active_slabs
     87437           +16.0%     101412 ±  2%  slabinfo.inode_cache.num_objs
      1618           +16.0%       1877 ±  2%  slabinfo.inode_cache.num_slabs
     85667           +17.4%     100538        slabinfo.kernfs_node_cache.active_objs
      2676           +18.1%       3161 ±  2%  slabinfo.kernfs_node_cache.active_slabs
     85667           +18.1%     101166 ±  2%  slabinfo.kernfs_node_cache.num_objs
      2676           +18.1%       3161 ±  2%  slabinfo.kernfs_node_cache.num_slabs
     35512           +26.3%      44836 ±  2%  slabinfo.kmalloc-16.num_objs
      5607           +24.3%       6968 ±  2%  slabinfo.kmalloc-192.num_objs
      5688 ±  3%     +10.8%       6305        slabinfo.kmalloc-1k.active_objs
      5823 ±  3%     +26.7%       7380 ±  2%  slabinfo.kmalloc-1k.num_objs
      9169 ±  4%     +18.0%      10817 ±  2%  slabinfo.kmalloc-256.active_objs
      9201 ±  4%     +18.9%      10936 ±  2%  slabinfo.kmalloc-256.num_objs
      1963           +13.3%       2223        slabinfo.kmalloc-4k.num_objs
     55212           +18.9%      65659 ±  5%  slabinfo.kmalloc-8.active_objs
     56063           +18.0%      66164 ±  4%  slabinfo.kmalloc-8.num_objs
      7350 ±  3%     -17.8%       6039 ±  2%  slabinfo.kmalloc-96.active_objs
    449.00 ± 20%    +624.6%       3253 ±  4%  slabinfo.kmalloc-rcl-192.active_objs
    449.00 ± 20%    +624.6%       3253 ±  3%  slabinfo.kmalloc-rcl-192.num_objs
      5599           +18.6%       6643 ±  3%  slabinfo.kmalloc-rcl-512.active_objs
      5600           +18.9%       6659 ±  3%  slabinfo.kmalloc-rcl-512.num_objs
      7882 ±  2%     +15.9%       9136 ±  3%  slabinfo.kmalloc-rcl-64.active_objs
      7882 ±  2%     +15.9%       9136 ±  3%  slabinfo.kmalloc-rcl-64.num_objs
      2708 ±  4%     +12.2%       3039 ±  4%  slabinfo.kmalloc-rcl-96.active_objs
      2708 ±  4%     +12.2%       3039 ±  4%  slabinfo.kmalloc-rcl-96.num_objs
      1349 ± 11%    +352.6%       6108 ±  2%  slabinfo.mbcache.active_objs
      1349 ± 11%    +352.6%       6108 ±  2%  slabinfo.mbcache.num_objs
      1376 ± 14%     +30.6%       1797 ± 11%  slabinfo.pool_workqueue.active_objs
      1381 ± 13%     +30.2%       1797 ± 11%  slabinfo.pool_workqueue.num_objs
     15006           -10.6%      13408        slabinfo.proc_inode_cache.active_objs
     15032           -10.8%      13408        slabinfo.proc_inode_cache.num_objs
    102.75 ± 17%   +1101.5%       1234 ±  3%  slabinfo.request_queue.active_objs
    102.75 ± 17%   +1101.5%       1234 ±  3%  slabinfo.request_queue.num_objs
    336.00 ±  4%     +68.3%     565.50 ± 10%  slabinfo.skbuff_fclone_cache.active_objs
    336.00 ±  4%     +68.3%     565.50 ± 10%  slabinfo.skbuff_fclone_cache.num_objs
      1253 ±  2%     +10.2%       1381        slabinfo.task_struct.active_objs
      3612 ±  4%     +36.0%       4913 ±  5%  slabinfo.trace_event_file.active_objs
      3612 ±  4%     +36.0%       4913 ±  5%  slabinfo.trace_event_file.num_objs
     17657 ±  2%     -29.1%      12513 ±  2%  slabinfo.vmap_area.active_objs
     17774           -29.4%      12549 ±  2%  slabinfo.vmap_area.num_objs
      0.01          -100.0%       0.00        perf-sched.sch_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      0.01 ± 24%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.cleaner_kthread.kthread.ret_from_fork
      0.01 ±  4%     -91.5%       0.00 ±223%  perf-sched.sch_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      0.01 ±  7%     -68.1%       0.00 ± 37%  perf-sched.sch_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      0.01 ±  8%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      0.01 ± 12%     -50.3%       0.01 ± 32%  perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00 ±  9%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      0.01          -100.0%       0.00        perf-sched.sch_delay.avg.ms.kjournald2.kthread.ret_from_fork
      0.00          +116.7%       0.00 ± 21%  perf-sched.sch_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      0.01 ±  4%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
      0.01 ±  5%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
      0.01 ±  8%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      0.01 ± 11%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
      0.01 ±  4%     -90.2%       0.00 ±223%  perf-sched.sch_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
      0.01 ± 36%     -60.6%       0.00 ± 17%  perf-sched.sch_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      0.01 ± 39%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_timeout.transaction_kthread.kthread.ret_from_fork
      0.01 ± 20%    -100.0%       0.00        perf-sched.sch_delay.avg.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all
      0.01           -14.3%       0.01        perf-sched.sch_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
      0.00          -100.0%       0.00        perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
      0.01 ±  5%   +4162.5%       0.51 ± 29%  perf-sched.sch_delay.avg.ms.worker_thread.kthread.ret_from_fork
      0.02 ± 24%    -100.0%       0.00        perf-sched.sch_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      0.01 ± 24%    -100.0%       0.00        perf-sched.sch_delay.max.ms.cleaner_kthread.kthread.ret_from_fork
      0.01 ± 24%     -93.5%       0.00 ±223%  perf-sched.sch_delay.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      0.03 ±  3%     -76.7%       0.01 ± 25%  perf-sched.sch_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      0.01 ± 18%    -100.0%       0.00        perf-sched.sch_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      0.01 ±  5%     -48.8%       0.01 ±  9%  perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.01 ± 10%    -100.0%       0.00        perf-sched.sch_delay.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      0.01          -100.0%       0.00        perf-sched.sch_delay.max.ms.kjournald2.kthread.ret_from_fork
      0.05 ± 35%    +711.8%       0.38 ±178%  perf-sched.sch_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      0.01 ±  4%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
      0.02 ± 22%    -100.0%       0.00        perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      0.02 ± 31%    -100.0%       0.00        perf-sched.sch_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork
      0.01 ±  3%     -28.3%       0.01 ±  5%  perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_select
      0.02 ±  5%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      0.02 ± 34%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
      0.02 ± 11%     -92.2%       0.00 ±223%  perf-sched.sch_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
      1.27 ±168%     -99.3%       0.01 ± 21%  perf-sched.sch_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      0.01 ± 39%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_timeout.transaction_kthread.kthread.ret_from_fork
      0.01 ± 20%    -100.0%       0.00        perf-sched.sch_delay.max.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all
      0.01 ± 42%    -100.0%       0.00        perf-sched.sch_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
      2.53           +11.2%       2.81 ±  2%  perf-sched.sch_delay.max.ms.worker_thread.kthread.ret_from_fork
      0.00 ± 11%    +155.6%       0.01 ± 14%  perf-sched.total_sch_delay.average.ms
    217.81           -99.9%       0.12 ± 24%  perf-sched.total_wait_and_delay.average.ms
      6704 ±  2%     -93.0%     468.67 ± 18%  perf-sched.total_wait_and_delay.count.ms
      9992           -99.9%      10.39 ± 38%  perf-sched.total_wait_and_delay.max.ms
    217.80          -100.0%       0.11 ± 25%  perf-sched.total_wait_time.average.ms
      9992           -99.9%      10.38 ± 38%  perf-sched.total_wait_time.max.ms
    899.59          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
    818.24          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
    266.47 ±  3%    -100.0%       0.12 ±171%  perf-sched.wait_and_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      0.80 ±  5%     -98.6%       0.01 ±223%  perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      1317          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
     66.01 ±  3%     -99.9%       0.05 ± 20%  perf-sched.wait_and_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
     18.00           -99.9%       0.02 ±223%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      4.47 ±  2%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
    428.98          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      5.58          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
    229.82 ± 11%    -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
    478.80          -100.0%       0.00 ±223%  perf-sched.wait_and_delay.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
     22.09 ± 22%     -87.1%       2.85 ± 16%  perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
    707.29          -100.0%       0.01        perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
      0.00          -100.0%       0.00        perf-sched.wait_and_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
    418.96 ±  3%     -99.8%       0.96 ± 65%  perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork
     20.00          -100.0%       0.00        perf-sched.wait_and_delay.count.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
     11.00          -100.0%       0.00        perf-sched.wait_and_delay.count.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
    243.00           -97.3%       6.50 ± 43%  perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
    242.00           -99.7%       0.67 ±223%  perf-sched.wait_and_delay.count.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      4.00          -100.0%       0.00        perf-sched.wait_and_delay.count.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      2432 ±  4%     -90.0%     243.00 ± 32%  perf-sched.wait_and_delay.count.pipe_read.new_sync_read.vfs_read.ksys_read
      1056           -90.9%      96.17        perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
    162.00 ± 23%    -100.0%       0.00        perf-sched.wait_and_delay.count.rcu_gp_kthread.kthread.ret_from_fork
     21.00          -100.0%       0.00        perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
     42.00 ± 11%    -100.0%       0.00        perf-sched.wait_and_delay.count.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
     42.00 ± 11%    -100.0%       0.00        perf-sched.wait_and_delay.count.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
     40.00           -99.2%       0.33 ±223%  perf-sched.wait_and_delay.count.schedule_timeout.kcompactd.kthread.ret_from_fork
    439.00 ± 19%     -98.9%       4.83 ± 22%  perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      1249           -92.3%      96.50        perf-sched.wait_and_delay.count.smpboot_thread_fn.kthread.ret_from_fork
     71.00          -100.0%       0.00        perf-sched.wait_and_delay.count.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
    593.75 ±  3%     -99.0%       6.17 ± 35%  perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
    999.74          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      1000          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      2999 ± 66%    -100.0%       0.76 ±193%  perf-sched.wait_and_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
     16.48 ±  2%     -99.9%       0.02 ±223%  perf-sched.wait_and_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      5271          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
      1006           -99.8%       1.59 ±114%  perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      9992          -100.0%       2.38 ±223%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      5.01          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork
      1000          -100.0%       0.00        perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      8.68 ±  7%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
    238.33 ± 10%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
    505.01          -100.0%       0.00 ±223%  perf-sched.wait_and_delay.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
    427.25           -98.9%       4.65 ± 10%  perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      1006          -100.0%       0.06 ± 53%  perf-sched.wait_and_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork
      0.01 ± 42%    -100.0%       0.00        perf-sched.wait_and_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
      8986 ±  3%     -99.9%       4.94 ± 80%  perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork
    899.58          -100.0%       0.00        perf-sched.wait_time.avg.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
    818.23          -100.0%       0.00        perf-sched.wait_time.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
    266.46 ±  3%    -100.0%       0.12 ±174%  perf-sched.wait_time.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      0.79 ±  5%     -98.6%       0.01 ±223%  perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      1317          -100.0%       0.00        perf-sched.wait_time.avg.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
     37.61 ±  4%    -100.0%       0.00        perf-sched.wait_time.avg.ms.kjournald2.kthread.ret_from_fork
     66.00 ±  3%     -99.9%       0.04 ± 23%  perf-sched.wait_time.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      0.31 ± 23%    -100.0%       0.00        perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
     18.00           -99.9%       0.02 ±223%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      4.46 ±  2%    -100.0%       0.00        perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
    130.40 ± 91%     -98.6%       1.88 ± 29%  perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
    428.97          -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      5.58          -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
    229.81 ± 11%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
    478.79          -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
      0.01 ± 50%    -100.0%       0.00        perf-sched.wait_time.avg.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
     22.08 ± 22%     -87.1%       2.84 ± 16%  perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
    707.28          -100.0%       0.00        perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
    418.95 ±  3%     -99.9%       0.44 ±149%  perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork
    999.73          -100.0%       0.00        perf-sched.wait_time.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
      1000          -100.0%       0.00        perf-sched.wait_time.max.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
      2999 ± 66%    -100.0%       0.76 ±194%  perf-sched.wait_time.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
     16.48 ±  2%     -99.9%       0.02 ±223%  perf-sched.wait_time.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
      5271          -100.0%       0.00        perf-sched.wait_time.max.ms.io_schedule.bit_wait_io.__wait_on_bit.out_of_line_wait_on_bit
     40.68 ±  5%    -100.0%       0.00        perf-sched.wait_time.max.ms.kjournald2.kthread.ret_from_fork
      1006           -99.9%       1.38 ±130%  perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
      0.44 ± 32%    -100.0%       0.00        perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.jbd2_journal_commit_transaction.kjournald2.kthread
      9992          -100.0%       2.38 ±223%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      5.00          -100.0%       0.00        perf-sched.wait_time.max.ms.rcu_gp_kthread.kthread.ret_from_fork
    380.84 ± 20%     -97.9%       8.14 ± 48%  perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
      1000          -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
      8.67 ±  8%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.ext4_lazyinit_thread.part.0.kthread
    238.32 ± 10%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.io_schedule_timeout.wait_for_completion_io.submit_bio_wait
    505.00          -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.kcompactd.kthread.ret_from_fork
      0.01 ± 50%    -100.0%       0.00        perf-sched.wait_time.max.ms.schedule_timeout.khugepaged.kthread.ret_from_fork
    427.24           -98.9%       4.65 ± 10%  perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      1006          -100.0%       0.00        perf-sched.wait_time.max.ms.smpboot_thread_fn.kthread.ret_from_fork
      8986 ±  3%    -100.0%       3.07 ±164%  perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork
      6039 ±  6%    +421.2%      31478 ±  2%  softirqs.BLOCK
     29138 ± 16%     -36.1%      18612 ± 13%  softirqs.CPU0.RCU
     58040 ± 17%     -75.7%      14102 ±  9%  softirqs.CPU0.SCHED
     24110 ± 20%     -56.0%      10620 ±  4%  softirqs.CPU1.RCU
     56327 ± 20%     -80.6%      10933 ±  9%  softirqs.CPU1.SCHED
     20895 ± 15%     -54.6%       9495 ±  8%  softirqs.CPU10.RCU
     54081 ± 19%     -84.2%       8566 ± 10%  softirqs.CPU10.SCHED
     21199 ± 17%     -56.8%       9158 ±  5%  softirqs.CPU11.RCU
     54781 ± 20%     -84.9%       8272 ± 18%  softirqs.CPU11.SCHED
     18953 ± 22%     -47.6%       9923 ±  6%  softirqs.CPU12.RCU
     54238 ± 19%     -85.0%       8159 ± 22%  softirqs.CPU12.SCHED
     20880 ± 12%     -55.9%       9198 ±  9%  softirqs.CPU13.RCU
     54341 ± 19%     -83.5%       8983 ± 11%  softirqs.CPU13.SCHED
     21483 ± 15%     -58.4%       8944 ±  6%  softirqs.CPU14.RCU
     54459 ± 19%     -84.8%       8298 ± 10%  softirqs.CPU14.SCHED
     19535 ± 15%     -56.0%       8603 ±  6%  softirqs.CPU15.RCU
     54471 ± 20%     -83.4%       9043 ±  5%  softirqs.CPU15.SCHED
     21573 ± 12%     -57.7%       9122 ± 10%  softirqs.CPU16.RCU
     49880 ± 34%     -81.5%       9206 ± 20%  softirqs.CPU16.SCHED
     21552 ± 18%     -59.1%       8806 ±  5%  softirqs.CPU17.RCU
     54462 ± 19%     -83.5%       8971 ±  7%  softirqs.CPU17.SCHED
     21287 ± 16%     -55.6%       9453 ±  3%  softirqs.CPU18.RCU
     49917 ± 34%     -81.2%       9386 ±  3%  softirqs.CPU18.SCHED
     21142 ± 16%     -55.2%       9466 ±  5%  softirqs.CPU19.RCU
     54765 ± 19%     -84.2%       8664 ±  7%  softirqs.CPU19.SCHED
     20613 ± 21%     -52.9%       9711 ±  4%  softirqs.CPU2.RCU
     55530 ± 18%     -82.7%       9622 ±  4%  softirqs.CPU2.SCHED
     21120 ± 15%     -55.4%       9428 ±  6%  softirqs.CPU20.RCU
     54707 ± 19%     -82.9%       9329 ± 11%  softirqs.CPU20.SCHED
     21016 ± 15%     -57.3%       8973 ±  4%  softirqs.CPU21.RCU
     54613 ± 19%     -83.5%       8996 ±  8%  softirqs.CPU21.SCHED
     21917 ± 15%     -58.8%       9035 ±  5%  softirqs.CPU22.RCU
     49554 ± 34%     -81.7%       9053 ±  6%  softirqs.CPU22.SCHED
     21111 ± 16%     -57.6%       8952 ±  3%  softirqs.CPU23.RCU
     54435 ± 19%     -84.6%       8400 ±  9%  softirqs.CPU23.SCHED
     21207 ± 16%     -59.7%       8546 ±  4%  softirqs.CPU24.RCU
     54520 ± 20%     -83.1%       9205 ±  4%  softirqs.CPU24.SCHED
     20732 ± 16%     -58.9%       8516 ±  7%  softirqs.CPU25.RCU
     54161 ± 19%     -83.3%       9069 ± 14%  softirqs.CPU25.SCHED
     21187 ± 16%     -61.6%       8126 ±  4%  softirqs.CPU26.RCU
     54238 ± 20%     -83.2%       9133 ±  5%  softirqs.CPU26.SCHED
     19552 ± 13%     -57.5%       8316 ±  6%  softirqs.CPU27.RCU
     53962 ± 20%     -82.8%       9278 ±  3%  softirqs.CPU27.SCHED
     21012 ± 17%     -60.5%       8300 ±  6%  softirqs.CPU28.RCU
     53864 ± 20%     -83.1%       9092 ±  6%  softirqs.CPU28.SCHED
     21272 ± 16%     -59.6%       8588 ±  5%  softirqs.CPU29.RCU
     54389 ± 20%     -84.3%       8543 ± 10%  softirqs.CPU29.SCHED
     20936 ± 17%     -51.8%      10086 ±  7%  softirqs.CPU3.RCU
     55866 ± 21%     -83.8%       9038 ± 14%  softirqs.CPU3.SCHED
     20929 ± 17%     -60.4%       8278 ±  4%  softirqs.CPU30.RCU
     54210 ± 20%     -84.3%       8501 ± 14%  softirqs.CPU30.SCHED
     20543 ± 16%     -60.9%       8026 ±  3%  softirqs.CPU31.RCU
     53859 ± 20%     -83.9%       8648 ± 11%  softirqs.CPU31.SCHED
     21006 ± 16%     -58.0%       8832 ± 11%  softirqs.CPU32.RCU
     53990 ± 20%     -83.4%       8938 ± 10%  softirqs.CPU32.SCHED
     20981 ± 16%     -55.8%       9275 ± 18%  softirqs.CPU33.RCU
     54016 ± 20%     -83.6%       8884 ±  4%  softirqs.CPU33.SCHED
     21071 ± 16%     -57.8%       8883 ± 11%  softirqs.CPU34.RCU
     54261 ± 20%     -83.8%       8780 ±  9%  softirqs.CPU34.SCHED
     21132 ± 17%     -59.3%       8608 ± 13%  softirqs.CPU35.RCU
     53809 ± 20%     -83.1%       9082 ±  4%  softirqs.CPU35.SCHED
     20021 ± 20%     -56.1%       8795 ±  6%  softirqs.CPU36.RCU
     53860 ± 20%     -83.8%       8736 ± 13%  softirqs.CPU36.SCHED
     21108 ± 17%     -58.0%       8871 ±  7%  softirqs.CPU37.RCU
     54360 ± 19%     -82.7%       9393        softirqs.CPU37.SCHED
     20920 ± 17%     -57.5%       8885 ±  8%  softirqs.CPU38.RCU
     54059 ± 20%     -83.8%       8777 ± 14%  softirqs.CPU38.SCHED
     21112 ± 17%     -57.2%       9037 ± 12%  softirqs.CPU39.RCU
     53938 ± 20%     -82.1%       9631 ±  6%  softirqs.CPU39.SCHED
     21156 ± 16%     -56.9%       9120 ± 12%  softirqs.CPU4.RCU
     54765 ± 19%     -82.5%       9608        softirqs.CPU4.SCHED
     21442 ± 17%     -59.8%       8617 ± 12%  softirqs.CPU40.RCU
     53974 ± 20%     -83.5%       8910 ± 10%  softirqs.CPU40.SCHED
     21394 ± 17%     -56.8%       9241 ± 11%  softirqs.CPU41.RCU
     54078 ± 20%     -83.6%       8842 ± 10%  softirqs.CPU41.SCHED
     21069 ± 16%     -60.2%       8387 ±  3%  softirqs.CPU42.RCU
     54480 ± 19%     -84.6%       8393 ± 13%  softirqs.CPU42.SCHED
     19041 ± 25%     -53.4%       8881 ± 10%  softirqs.CPU43.RCU
     53962 ± 20%     -84.4%       8434 ± 13%  softirqs.CPU43.SCHED
     20011 ± 17%     -55.8%       8848 ±  6%  softirqs.CPU44.RCU
     54413 ± 20%     -83.8%       8789 ± 10%  softirqs.CPU44.SCHED
     20908 ± 17%     -52.1%      10024 ± 29%  softirqs.CPU45.RCU
     47378 ± 23%     -78.2%      10346 ± 21%  softirqs.CPU45.SCHED
     21126 ± 16%     -55.8%       9339 ±  9%  softirqs.CPU46.RCU
     54632 ± 20%     -83.8%       8852 ± 11%  softirqs.CPU46.SCHED
     21548 ± 17%     -56.9%       9290 ± 15%  softirqs.CPU47.RCU
     41071 ± 42%     -81.0%       7818 ± 18%  softirqs.CPU47.SCHED
     20981 ± 14%     -57.1%       9001 ±  7%  softirqs.CPU48.RCU
     47343 ± 39%     -82.2%       8443 ± 10%  softirqs.CPU48.SCHED
     21328 ± 19%     -58.5%       8842 ± 11%  softirqs.CPU49.RCU
     53739 ± 20%     -81.9%       9700 ± 11%  softirqs.CPU49.SCHED
     21400 ± 16%     -55.5%       9517 ±  5%  softirqs.CPU5.RCU
     47327 ± 44%     -83.6%       7756 ± 23%  softirqs.CPU5.SCHED
     21749 ± 16%     -54.7%       9859 ±  6%  softirqs.CPU50.RCU
     46551 ± 19%     -81.2%       8734 ± 14%  softirqs.CPU50.SCHED
     21785 ± 12%     -56.8%       9400 ±  6%  softirqs.CPU51.RCU
     55290 ± 19%     -83.7%       9003 ± 13%  softirqs.CPU51.SCHED
     21770 ± 16%     -57.0%       9358 ±  6%  softirqs.CPU52.RCU
     54921 ± 20%     -84.1%       8710 ±  6%  softirqs.CPU52.SCHED
     21839 ± 16%     -49.9%      10933 ± 17%  softirqs.CPU53.RCU
     54659 ± 19%     -80.6%      10602 ± 20%  softirqs.CPU53.SCHED
     21867 ± 16%     -56.1%       9607 ±  7%  softirqs.CPU54.RCU
     54908 ± 19%     -83.3%       9144 ±  6%  softirqs.CPU54.SCHED
     21365 ± 16%     -56.1%       9380 ±  7%  softirqs.CPU55.RCU
     53563 ± 19%     -82.7%       9245 ±  4%  softirqs.CPU55.SCHED
     21218 ± 15%     -57.8%       8949 ±  4%  softirqs.CPU56.RCU
     53328 ± 19%     -84.3%       8391 ±  7%  softirqs.CPU56.SCHED
     20965 ± 16%     -55.2%       9398 ±  6%  softirqs.CPU57.RCU
     54464 ± 17%     -84.4%       8484 ±  8%  softirqs.CPU57.SCHED
     21753 ± 17%     -57.3%       9279 ±  6%  softirqs.CPU58.RCU
     47270 ± 19%     -81.5%       8756 ± 11%  softirqs.CPU58.SCHED
     22030 ± 11%     -51.1%      10774 ± 19%  softirqs.CPU59.RCU
     54053 ± 19%     -81.2%      10186 ± 19%  softirqs.CPU59.SCHED
     21201 ± 15%     -56.1%       9303 ±  4%  softirqs.CPU6.RCU
     54704 ± 19%     -84.2%       8644 ± 15%  softirqs.CPU6.SCHED
     22059 ± 15%     -56.0%       9707 ±  6%  softirqs.CPU60.RCU
     54376 ± 19%     -84.5%       8438 ± 25%  softirqs.CPU60.SCHED
     21450 ± 16%     -54.7%       9710 ±  9%  softirqs.CPU61.RCU
     54013 ± 20%     -83.0%       9203 ±  4%  softirqs.CPU61.SCHED
     20747 ± 16%     -54.3%       9478 ±  6%  softirqs.CPU62.RCU
     53698 ± 19%     -83.9%       8630 ± 12%  softirqs.CPU62.SCHED
     20819 ± 15%     -53.1%       9760 ±  8%  softirqs.CPU63.RCU
     53931 ± 19%     -83.2%       9046 ±  5%  softirqs.CPU63.SCHED
     19480 ± 13%     -53.7%       9027 ± 13%  softirqs.CPU64.RCU
     54934 ± 20%     -83.5%       9064 ± 17%  softirqs.CPU64.SCHED
     22099 ± 14%     -55.4%       9854 ± 20%  softirqs.CPU65.RCU
     47328 ± 19%     -79.1%       9872 ± 20%  softirqs.CPU65.SCHED
     22764 ± 16%     -61.0%       8889 ±  4%  softirqs.CPU66.RCU
     47453 ± 21%     -86.6%       6364 ± 27%  softirqs.CPU66.SCHED
     21969 ± 15%     -59.5%       8888 ±  6%  softirqs.CPU67.RCU
     54661 ± 19%     -84.5%       8476 ±  9%  softirqs.CPU67.SCHED
     21956 ± 16%     -59.2%       8961 ±  7%  softirqs.CPU68.RCU
     54895 ± 19%     -85.1%       8161 ± 20%  softirqs.CPU68.SCHED
     21521 ± 16%     -59.1%       8804 ±  6%  softirqs.CPU69.RCU
     54451 ± 19%     -82.8%       9360 ±  9%  softirqs.CPU69.SCHED
     20982 ± 16%     -56.8%       9062 ±  5%  softirqs.CPU7.RCU
     54333 ± 18%     -83.9%       8769 ±  4%  softirqs.CPU7.SCHED
     21882 ± 14%     -59.8%       8802 ±  2%  softirqs.CPU70.RCU
     54718 ± 19%     -84.0%       8781 ±  7%  softirqs.CPU70.SCHED
     21467 ± 15%     -60.3%       8521 ±  6%  softirqs.CPU71.RCU
     54365 ± 19%     -83.2%       9118 ±  6%  softirqs.CPU71.SCHED
     21166 ± 17%     -60.3%       8402        softirqs.CPU72.RCU
     55023 ± 20%     -84.0%       8800 ±  7%  softirqs.CPU72.SCHED
     20447 ± 17%     -53.4%       9535 ± 32%  softirqs.CPU73.RCU
     54138 ± 20%     -83.7%       8807 ±  6%  softirqs.CPU73.SCHED
     20784 ± 17%     -60.0%       8306 ±  6%  softirqs.CPU74.RCU
     54493 ± 20%     -85.1%       8098 ± 14%  softirqs.CPU74.SCHED
     20782 ± 17%     -59.9%       8337 ±  4%  softirqs.CPU75.RCU
     55712 ± 21%     -83.9%       8972 ±  9%  softirqs.CPU75.SCHED
     54976 ± 20%     -83.8%       8888 ±  6%  softirqs.CPU76.SCHED
     20818 ± 21%     -57.3%       8887 ±  9%  softirqs.CPU77.RCU
     47325 ± 21%     -80.7%       9141 ±  9%  softirqs.CPU77.SCHED
     20800 ± 17%     -59.9%       8336 ±  7%  softirqs.CPU78.RCU
     54709 ± 20%     -82.8%       9393        softirqs.CPU78.SCHED
     20834 ± 16%     -59.0%       8546 ± 10%  softirqs.CPU79.RCU
     54506 ± 20%     -83.8%       8832 ± 24%  softirqs.CPU79.SCHED
     20966 ± 13%     -56.7%       9072 ±  6%  softirqs.CPU8.RCU
     53701 ± 19%     -83.8%       8678 ±  9%  softirqs.CPU8.SCHED
     21194 ± 16%     -59.1%       8671 ± 11%  softirqs.CPU80.RCU
     54632 ± 20%     -84.2%       8643 ± 10%  softirqs.CPU80.SCHED
     20947 ± 17%     -57.2%       8972 ± 14%  softirqs.CPU81.RCU
     54366 ± 19%     -83.1%       9161 ±  4%  softirqs.CPU81.SCHED
     21117 ± 17%     -60.3%       8380 ± 12%  softirqs.CPU82.RCU
     54637 ± 20%     -83.9%       8809 ±  6%  softirqs.CPU82.SCHED
     20965 ± 17%     -57.7%       8863 ± 12%  softirqs.CPU83.RCU
     54464 ± 20%     -83.4%       9027 ±  4%  softirqs.CPU83.SCHED
     21258 ± 17%     -57.7%       8995 ± 12%  softirqs.CPU84.RCU
     54927 ± 19%     -84.8%       8328 ± 14%  softirqs.CPU84.SCHED
     21166 ± 18%     -57.2%       9069 ± 11%  softirqs.CPU85.RCU
     54355 ± 20%     -83.6%       8920 ±  5%  softirqs.CPU85.SCHED
     21492 ± 19%     -59.1%       8783 ± 12%  softirqs.CPU86.RCU
     54756 ± 20%     -84.2%       8658 ± 14%  softirqs.CPU86.SCHED
     21255 ± 17%     -59.2%       8678 ±  8%  softirqs.CPU87.RCU
     54448 ± 20%     -85.0%       8165 ±  8%  softirqs.CPU87.SCHED
     21370 ± 17%     -58.4%       8890 ± 13%  softirqs.CPU88.RCU
     54777 ± 20%     -83.6%       8983 ± 13%  softirqs.CPU88.SCHED
     21197 ± 17%     -58.6%       8783 ± 11%  softirqs.CPU89.RCU
     54858 ± 20%     -83.8%       8891 ±  5%  softirqs.CPU89.SCHED
     19670 ± 22%     -54.1%       9019 ±  8%  softirqs.CPU9.RCU
     47246 ± 24%     -80.7%       9113 ±  4%  softirqs.CPU9.SCHED
     20784 ± 18%     -60.5%       8210 ±  6%  softirqs.CPU90.RCU
     54168 ± 20%     -82.5%       9495 ±  7%  softirqs.CPU90.SCHED
     21222 ± 18%     -59.2%       8648 ±  8%  softirqs.CPU91.RCU
     54583 ± 20%     -84.2%       8618 ± 11%  softirqs.CPU91.SCHED
     20734 ± 17%     -57.7%       8778 ± 10%  softirqs.CPU92.RCU
     54505 ± 20%     -84.4%       8507 ±  8%  softirqs.CPU92.SCHED
     20945 ± 17%     -57.4%       8922 ±  9%  softirqs.CPU93.RCU
     54481 ± 20%     -84.4%       8519 ± 12%  softirqs.CPU93.SCHED
     21227 ± 17%     -58.8%       8745 ± 10%  softirqs.CPU94.RCU
     55544 ± 21%     -84.2%       8750 ±  8%  softirqs.CPU94.SCHED
     21333 ± 17%     -60.0%       8543 ± 18%  softirqs.CPU95.RCU
     48288 ± 23%     -81.0%       9161 ±  7%  softirqs.CPU95.SCHED
   2034389 ± 16%     -56.9%     877030 ±  3%  softirqs.RCU
   5133667 ± 19%     -83.3%     859201        softirqs.SCHED
     31405 ± 13%     -26.5%      23077 ±  3%  softirqs.TIMER
     76043 ±  2%      -7.7%      70215        interrupts.CAL:Function_call_interrupts
    842953 ± 21%     -84.9%     127370        interrupts.CPU0.LOC:Local_timer_interrupts
    101.00 ± 14%    +169.6%     272.33 ± 43%  interrupts.CPU0.NMI:Non-maskable_interrupts
    101.00 ± 14%    +169.6%     272.33 ± 43%  interrupts.CPU0.PMI:Performance_monitoring_interrupts
    840340 ± 20%     -84.9%     127037        interrupts.CPU1.LOC:Local_timer_interrupts
    843395 ± 21%     -84.9%     127257        interrupts.CPU10.LOC:Local_timer_interrupts
     83.75 ± 11%    +140.2%     201.17 ± 34%  interrupts.CPU10.NMI:Non-maskable_interrupts
     83.75 ± 11%    +140.2%     201.17 ± 34%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
    842273 ± 20%     -84.9%     127166        interrupts.CPU11.LOC:Local_timer_interrupts
     87.00 ± 15%    +213.4%     272.67 ± 39%  interrupts.CPU11.NMI:Non-maskable_interrupts
     87.00 ± 15%    +213.4%     272.67 ± 39%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
    839908 ± 20%     -84.8%     127364        interrupts.CPU12.LOC:Local_timer_interrupts
    843850 ± 21%     -84.9%     127095        interrupts.CPU13.LOC:Local_timer_interrupts
    614.50           +13.1%     695.00 ±  5%  interrupts.CPU14.CAL:Function_call_interrupts
    844030 ± 21%     -84.9%     127130        interrupts.CPU14.LOC:Local_timer_interrupts
     91.00 ± 19%    +152.2%     229.50 ± 37%  interrupts.CPU14.NMI:Non-maskable_interrupts
     91.00 ± 19%    +152.2%     229.50 ± 37%  interrupts.CPU14.PMI:Performance_monitoring_interrupts
    844705 ± 21%     -84.9%     127478        interrupts.CPU15.LOC:Local_timer_interrupts
    843860 ± 21%     -84.9%     127257        interrupts.CPU16.LOC:Local_timer_interrupts
    613.75           +38.1%     847.33 ± 18%  interrupts.CPU17.CAL:Function_call_interrupts
    844885 ± 21%     -85.0%     126951        interrupts.CPU17.LOC:Local_timer_interrupts
    842280 ± 20%     -84.9%     127136        interrupts.CPU18.LOC:Local_timer_interrupts
     89.75 ± 16%    +225.9%     292.50 ± 37%  interrupts.CPU18.NMI:Non-maskable_interrupts
     89.75 ± 16%    +225.9%     292.50 ± 37%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
    641.50 ±  3%     +30.2%     835.50 ±  7%  interrupts.CPU19.CAL:Function_call_interrupts
    843812 ± 21%     -84.9%     127092        interrupts.CPU19.LOC:Local_timer_interrupts
     88.50 ± 15%    +262.5%     320.83 ±  5%  interrupts.CPU19.NMI:Non-maskable_interrupts
     88.50 ± 15%    +262.5%     320.83 ±  5%  interrupts.CPU19.PMI:Performance_monitoring_interrupts
    843241 ± 21%     -84.9%     127018        interrupts.CPU2.LOC:Local_timer_interrupts
     88.75 ± 21%    +171.7%     241.17 ± 25%  interrupts.CPU2.NMI:Non-maskable_interrupts
     88.75 ± 21%    +171.7%     241.17 ± 25%  interrupts.CPU2.PMI:Performance_monitoring_interrupts
    614.75           +26.8%     779.50 ± 15%  interrupts.CPU20.CAL:Function_call_interrupts
    844073 ± 21%     -84.9%     127115        interrupts.CPU20.LOC:Local_timer_interrupts
     93.50 ± 18%    +166.8%     249.50 ± 14%  interrupts.CPU20.NMI:Non-maskable_interrupts
     93.50 ± 18%    +166.8%     249.50 ± 14%  interrupts.CPU20.PMI:Performance_monitoring_interrupts
    621.25           +32.6%     824.00 ± 16%  interrupts.CPU21.CAL:Function_call_interrupts
    839248 ± 20%     -84.8%     127242        interrupts.CPU21.LOC:Local_timer_interrupts
     88.75 ± 18%    +105.8%     182.67 ± 23%  interrupts.CPU21.NMI:Non-maskable_interrupts
     88.75 ± 18%    +105.8%     182.67 ± 23%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
    843394 ± 21%     -84.9%     127086        interrupts.CPU22.LOC:Local_timer_interrupts
     91.00 ± 17%    +213.6%     285.33 ± 13%  interrupts.CPU22.NMI:Non-maskable_interrupts
     91.00 ± 17%    +213.6%     285.33 ± 13%  interrupts.CPU22.PMI:Performance_monitoring_interrupts
    843836 ± 21%     -84.9%     127554        interrupts.CPU23.LOC:Local_timer_interrupts
    843834 ± 21%     -84.9%     127259        interrupts.CPU24.LOC:Local_timer_interrupts
    845168 ± 21%     -85.0%     127044        interrupts.CPU25.LOC:Local_timer_interrupts
    844826 ± 21%     -84.9%     127277        interrupts.CPU26.LOC:Local_timer_interrupts
    844846 ± 21%     -85.0%     127110        interrupts.CPU27.LOC:Local_timer_interrupts
     86.25 ±  7%     +92.9%     166.33 ± 45%  interrupts.CPU27.NMI:Non-maskable_interrupts
     86.25 ±  7%     +92.9%     166.33 ± 45%  interrupts.CPU27.PMI:Performance_monitoring_interrupts
    844885 ± 21%     -85.0%     127049        interrupts.CPU28.LOC:Local_timer_interrupts
    842909 ± 21%     -84.9%     127225        interrupts.CPU29.LOC:Local_timer_interrupts
     86.25 ± 13%    +128.2%     196.83 ± 44%  interrupts.CPU29.NMI:Non-maskable_interrupts
     86.25 ± 13%    +128.2%     196.83 ± 44%  interrupts.CPU29.PMI:Performance_monitoring_interrupts
    843705 ± 21%     -84.9%     127175        interrupts.CPU3.LOC:Local_timer_interrupts
     91.25 ±  7%    +165.4%     242.17 ± 27%  interrupts.CPU3.NMI:Non-maskable_interrupts
     91.25 ±  7%    +165.4%     242.17 ± 27%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    843544 ± 21%     -84.9%     127110        interrupts.CPU30.LOC:Local_timer_interrupts
    844641 ± 21%     -84.9%     127253        interrupts.CPU31.LOC:Local_timer_interrupts
    843257 ± 21%     -84.9%     127176        interrupts.CPU32.LOC:Local_timer_interrupts
    844438 ± 21%     -84.9%     127240        interrupts.CPU33.LOC:Local_timer_interrupts
    844457 ± 21%     -84.9%     127190        interrupts.CPU34.LOC:Local_timer_interrupts
    844194 ± 21%     -84.9%     127145        interrupts.CPU35.LOC:Local_timer_interrupts
    611.75           +16.1%     710.17 ± 12%  interrupts.CPU36.CAL:Function_call_interrupts
    842877 ± 21%     -84.9%     127222        interrupts.CPU36.LOC:Local_timer_interrupts
    842203 ± 20%     -84.9%     127220        interrupts.CPU37.LOC:Local_timer_interrupts
    842075 ± 20%     -84.9%     127094        interrupts.CPU38.LOC:Local_timer_interrupts
    842850 ± 21%     -84.9%     127248        interrupts.CPU39.LOC:Local_timer_interrupts
    624.00 ±  2%     +31.7%     821.67 ± 20%  interrupts.CPU4.CAL:Function_call_interrupts
    840682 ± 20%     -84.9%     127053        interrupts.CPU4.LOC:Local_timer_interrupts
     68.50 ± 30%    +227.0%     224.00 ± 28%  interrupts.CPU4.NMI:Non-maskable_interrupts
     68.50 ± 30%    +227.0%     224.00 ± 28%  interrupts.CPU4.PMI:Performance_monitoring_interrupts
    838695 ± 20%     -84.8%     127225        interrupts.CPU40.LOC:Local_timer_interrupts
    839157 ± 20%     -84.9%     127052        interrupts.CPU41.LOC:Local_timer_interrupts
    820417 ± 19%     -84.5%     127094        interrupts.CPU42.LOC:Local_timer_interrupts
    812471 ± 19%     -84.3%     127199        interrupts.CPU43.LOC:Local_timer_interrupts
    808700 ± 18%     -84.3%     127000        interrupts.CPU44.LOC:Local_timer_interrupts
     84.00 ± 34%    +169.4%     226.33 ± 32%  interrupts.CPU44.NMI:Non-maskable_interrupts
     84.00 ± 34%    +169.4%     226.33 ± 32%  interrupts.CPU44.PMI:Performance_monitoring_interrupts
    842336 ± 20%     -84.9%     127128        interrupts.CPU45.LOC:Local_timer_interrupts
     76.50 ± 27%    +236.8%     257.67 ± 32%  interrupts.CPU45.NMI:Non-maskable_interrupts
     76.50 ± 27%    +236.8%     257.67 ± 32%  interrupts.CPU45.PMI:Performance_monitoring_interrupts
    800644 ± 18%     -84.1%     127154        interrupts.CPU46.LOC:Local_timer_interrupts
     69.25 ± 46%    +166.9%     184.83 ± 36%  interrupts.CPU46.NMI:Non-maskable_interrupts
     69.25 ± 46%    +166.9%     184.83 ± 36%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
    839952 ± 20%     -84.8%     127330        interrupts.CPU47.LOC:Local_timer_interrupts
    842954 ± 21%     -84.9%     126906        interrupts.CPU48.LOC:Local_timer_interrupts
     74.00 ± 36%    +281.3%     282.17 ± 40%  interrupts.CPU48.NMI:Non-maskable_interrupts
     74.00 ± 36%    +281.3%     282.17 ± 40%  interrupts.CPU48.PMI:Performance_monitoring_interrupts
    840194 ± 20%     -84.9%     127283        interrupts.CPU49.LOC:Local_timer_interrupts
     84.50 ± 39%    +175.7%     233.00 ± 23%  interrupts.CPU49.NMI:Non-maskable_interrupts
     84.50 ± 39%    +175.7%     233.00 ± 23%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
    844078 ± 21%     -84.9%     127304        interrupts.CPU5.LOC:Local_timer_interrupts
     83.00 ± 13%    +172.9%     226.50 ± 40%  interrupts.CPU5.NMI:Non-maskable_interrupts
     83.00 ± 13%    +172.9%     226.50 ± 40%  interrupts.CPU5.PMI:Performance_monitoring_interrupts
    843200 ± 21%     -84.9%     127032        interrupts.CPU50.LOC:Local_timer_interrupts
    112.50 ± 51%    +136.4%     266.00 ± 28%  interrupts.CPU50.NMI:Non-maskable_interrupts
    112.50 ± 51%    +136.4%     266.00 ± 28%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
    843472 ± 21%     -84.9%     127266        interrupts.CPU51.LOC:Local_timer_interrupts
    841010 ± 20%     -84.9%     127312        interrupts.CPU52.LOC:Local_timer_interrupts
     94.75 ± 45%    +145.9%     233.00 ± 31%  interrupts.CPU52.NMI:Non-maskable_interrupts
     94.75 ± 45%    +145.9%     233.00 ± 31%  interrupts.CPU52.PMI:Performance_monitoring_interrupts
    844061 ± 21%     -84.9%     127350        interrupts.CPU53.LOC:Local_timer_interrupts
     55.50 ± 50%    +289.8%     216.33 ± 38%  interrupts.CPU53.NMI:Non-maskable_interrupts
     55.50 ± 50%    +289.8%     216.33 ± 38%  interrupts.CPU53.PMI:Performance_monitoring_interrupts
    615.00           +17.6%     723.00 ±  9%  interrupts.CPU54.CAL:Function_call_interrupts
    843353 ± 21%     -84.9%     127413        interrupts.CPU54.LOC:Local_timer_interrupts
     75.25 ± 31%    +138.1%     179.17 ± 42%  interrupts.CPU54.NMI:Non-maskable_interrupts
     75.25 ± 31%    +138.1%     179.17 ± 42%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
    624.00 ±  2%     +17.1%     730.50 ±  8%  interrupts.CPU55.CAL:Function_call_interrupts
    842745 ± 21%     -84.9%     127363        interrupts.CPU55.LOC:Local_timer_interrupts
     68.00 ± 44%    +242.2%     232.67 ± 26%  interrupts.CPU55.NMI:Non-maskable_interrupts
     68.00 ± 44%    +242.2%     232.67 ± 26%  interrupts.CPU55.PMI:Performance_monitoring_interrupts
    844904 ± 21%     -84.9%     127212        interrupts.CPU56.LOC:Local_timer_interrupts
    844373 ± 21%     -84.9%     127362        interrupts.CPU57.LOC:Local_timer_interrupts
    843136 ± 21%     -84.9%     127392        interrupts.CPU58.LOC:Local_timer_interrupts
     90.50 ± 23%    +113.6%     193.33 ± 34%  interrupts.CPU58.NMI:Non-maskable_interrupts
     90.50 ± 23%    +113.6%     193.33 ± 34%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
    842321 ± 20%     -84.9%     127396        interrupts.CPU59.LOC:Local_timer_interrupts
     90.00 ± 18%    +144.8%     220.33 ± 40%  interrupts.CPU59.NMI:Non-maskable_interrupts
     90.00 ± 18%    +144.8%     220.33 ± 40%  interrupts.CPU59.PMI:Performance_monitoring_interrupts
    843664 ± 21%     -84.9%     127260        interrupts.CPU6.LOC:Local_timer_interrupts
     86.25 ± 14%    +131.5%     199.67 ± 42%  interrupts.CPU6.NMI:Non-maskable_interrupts
     86.25 ± 14%    +131.5%     199.67 ± 42%  interrupts.CPU6.PMI:Performance_monitoring_interrupts
    839857 ± 20%     -84.8%     127281        interrupts.CPU60.LOC:Local_timer_interrupts
    843804 ± 21%     -84.9%     127192        interrupts.CPU61.LOC:Local_timer_interrupts
     79.50 ± 37%    +117.4%     172.83 ± 36%  interrupts.CPU61.NMI:Non-maskable_interrupts
     79.50 ± 37%    +117.4%     172.83 ± 36%  interrupts.CPU61.PMI:Performance_monitoring_interrupts
    619.25           +23.2%     762.83 ± 11%  interrupts.CPU62.CAL:Function_call_interrupts
    844003 ± 21%     -84.9%     127191        interrupts.CPU62.LOC:Local_timer_interrupts
    844768 ± 21%     -84.9%     127409        interrupts.CPU63.LOC:Local_timer_interrupts
    100.25 ± 10%     +99.2%     199.67 ± 25%  interrupts.CPU63.NMI:Non-maskable_interrupts
    100.25 ± 10%     +99.2%     199.67 ± 25%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
    843942 ± 21%     -84.9%     127142        interrupts.CPU64.LOC:Local_timer_interrupts
    100.25 ± 23%    +159.9%     260.50 ± 27%  interrupts.CPU64.NMI:Non-maskable_interrupts
    100.25 ± 23%    +159.9%     260.50 ± 27%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
    844911 ± 21%     -85.0%     126957        interrupts.CPU65.LOC:Local_timer_interrupts
    842339 ± 20%     -84.9%     127332        interrupts.CPU66.LOC:Local_timer_interrupts
     84.75 ± 37%    +155.7%     216.67 ± 34%  interrupts.CPU66.NMI:Non-maskable_interrupts
     84.75 ± 37%    +155.7%     216.67 ± 34%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
    843842 ± 21%     -84.9%     127319        interrupts.CPU67.LOC:Local_timer_interrupts
     85.25 ± 40%    +161.0%     222.50 ± 27%  interrupts.CPU67.NMI:Non-maskable_interrupts
     85.25 ± 40%    +161.0%     222.50 ± 27%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
    844217 ± 21%     -84.9%     127191        interrupts.CPU68.LOC:Local_timer_interrupts
     86.25 ± 32%    +119.7%     189.50 ± 36%  interrupts.CPU68.NMI:Non-maskable_interrupts
     86.25 ± 32%    +119.7%     189.50 ± 36%  interrupts.CPU68.PMI:Performance_monitoring_interrupts
    839417 ± 20%     -84.8%     127551        interrupts.CPU69.LOC:Local_timer_interrupts
     80.75 ± 33%    +140.0%     193.83 ± 32%  interrupts.CPU69.NMI:Non-maskable_interrupts
     80.75 ± 33%    +140.0%     193.83 ± 32%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
    842748 ± 21%     -84.9%     127382        interrupts.CPU7.LOC:Local_timer_interrupts
    843475 ± 21%     -84.9%     127061        interrupts.CPU70.LOC:Local_timer_interrupts
     86.75 ± 36%    +197.8%     258.33 ± 16%  interrupts.CPU70.NMI:Non-maskable_interrupts
     86.75 ± 36%    +197.8%     258.33 ± 16%  interrupts.CPU70.PMI:Performance_monitoring_interrupts
    607.25 ±  2%     +11.8%     678.67 ±  5%  interrupts.CPU71.CAL:Function_call_interrupts
    843809 ± 21%     -85.0%     126993        interrupts.CPU71.LOC:Local_timer_interrupts
     92.75 ± 17%    +176.2%     256.17 ± 33%  interrupts.CPU71.NMI:Non-maskable_interrupts
     92.75 ± 17%    +176.2%     256.17 ± 33%  interrupts.CPU71.PMI:Performance_monitoring_interrupts
    843819 ± 21%     -84.9%     127186        interrupts.CPU72.LOC:Local_timer_interrupts
    845122 ± 21%     -84.9%     127296        interrupts.CPU73.LOC:Local_timer_interrupts
    844830 ± 21%     -85.0%     127117        interrupts.CPU74.LOC:Local_timer_interrupts
    844971 ± 21%     -85.0%     127141        interrupts.CPU75.LOC:Local_timer_interrupts
    844907 ± 21%     -85.0%     127095        interrupts.CPU76.LOC:Local_timer_interrupts
     74.00 ± 29%    +209.2%     228.83 ± 35%  interrupts.CPU76.NMI:Non-maskable_interrupts
     74.00 ± 29%    +209.2%     228.83 ± 35%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
    842923 ± 21%     -84.9%     127258        interrupts.CPU77.LOC:Local_timer_interrupts
     68.00 ± 43%    +163.0%     178.83 ± 37%  interrupts.CPU77.NMI:Non-maskable_interrupts
     68.00 ± 43%    +163.0%     178.83 ± 37%  interrupts.CPU77.PMI:Performance_monitoring_interrupts
    843553 ± 21%     -84.9%     127140        interrupts.CPU78.LOC:Local_timer_interrupts
    844808 ± 21%     -84.9%     127198        interrupts.CPU79.LOC:Local_timer_interrupts
    844984 ± 21%     -85.0%     127143        interrupts.CPU8.LOC:Local_timer_interrupts
     85.25 ± 10%    +112.9%     181.50 ± 35%  interrupts.CPU8.NMI:Non-maskable_interrupts
     85.25 ± 10%    +112.9%     181.50 ± 35%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
    843268 ± 21%     -84.9%     127179        interrupts.CPU80.LOC:Local_timer_interrupts
    844192 ± 21%     -84.9%     127351        interrupts.CPU81.LOC:Local_timer_interrupts
    844452 ± 21%     -84.9%     127190        interrupts.CPU82.LOC:Local_timer_interrupts
    844200 ± 21%     -84.9%     127268        interrupts.CPU83.LOC:Local_timer_interrupts
    842977 ± 21%     -84.9%     127353        interrupts.CPU84.LOC:Local_timer_interrupts
    842215 ± 20%     -84.9%     127210        interrupts.CPU85.LOC:Local_timer_interrupts
    842417 ± 20%     -84.9%     127221        interrupts.CPU86.LOC:Local_timer_interrupts
    842872 ± 21%     -84.9%     127134        interrupts.CPU87.LOC:Local_timer_interrupts
    606.75           +22.2%     741.17 ± 18%  interrupts.CPU88.CAL:Function_call_interrupts
    838462 ± 20%     -84.8%     127253        interrupts.CPU88.LOC:Local_timer_interrupts
    839301 ± 20%     -84.8%     127165        interrupts.CPU89.LOC:Local_timer_interrupts
    844556 ± 21%     -84.9%     127228        interrupts.CPU9.LOC:Local_timer_interrupts
     82.25 ± 36%    +117.8%     179.17 ± 37%  interrupts.CPU9.NMI:Non-maskable_interrupts
     82.25 ± 36%    +117.8%     179.17 ± 37%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
    820468 ± 19%     -84.5%     127151        interrupts.CPU90.LOC:Local_timer_interrupts
    612.50           +17.3%     718.17 ± 10%  interrupts.CPU91.CAL:Function_call_interrupts
    812463 ± 19%     -84.4%     127135        interrupts.CPU91.LOC:Local_timer_interrupts
    808629 ± 18%     -84.3%     127079        interrupts.CPU92.LOC:Local_timer_interrupts
     82.00 ± 32%     +98.4%     162.67 ± 30%  interrupts.CPU92.NMI:Non-maskable_interrupts
     82.00 ± 32%     +98.4%     162.67 ± 30%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
    842454 ± 21%     -84.9%     127038        interrupts.CPU93.LOC:Local_timer_interrupts
     95.25 ± 15%    +109.3%     199.33 ± 36%  interrupts.CPU93.NMI:Non-maskable_interrupts
     95.25 ± 15%    +109.3%     199.33 ± 36%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
    800628 ± 18%     -84.1%     127087        interrupts.CPU94.LOC:Local_timer_interrupts
    839969 ± 20%     -84.9%     127209        interrupts.CPU95.LOC:Local_timer_interrupts
  80675915 ± 20%     -84.9%   12211336        interrupts.LOC:Local_timer_interrupts
      7823 ± 19%    +137.8%      18606 ±  7%  interrupts.NMI:Non-maskable_interrupts
      7823 ± 19%    +137.8%      18606 ±  7%  interrupts.PMI:Performance_monitoring_interrupts
      1217 ± 35%     +53.7%       1871 ±  7%  interrupts.RES:Rescheduling_interrupts
    545.50 ± 35%     -48.4%     281.67 ± 56%  interrupts.TLB:TLB_shootdowns
     97.10           -37.7       59.38 ±  2%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     95.80           -37.1       58.68 ±  2%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     95.80           -37.1       58.68 ±  2%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     95.74           -37.1       58.65 ±  2%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     84.61           -30.7       53.95 ±  3%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     83.35           -30.0       53.30 ±  3%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     39.53 ± 13%     -23.9       15.61 ±  6%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     32.33 ± 13%     -19.7       12.63 ±  5%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
     23.41 ± 16%     -14.9        8.49 ±  5%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
     23.17 ± 16%     -14.8        8.37 ±  5%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      9.46 ± 26%      -6.5        2.97 ± 13%  perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
     10.41 ±  6%      -6.2        4.22 ±  5%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
     42.73 ±  9%      -5.5       37.20 ±  6%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      8.98 ± 14%      -5.4        3.61 ±  5%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      7.38 ± 30%      -5.3        2.05 ± 16%  perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      7.19 ± 10%      -4.3        2.88 ±  3%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      6.31 ±  9%      -3.7        2.64 ±  5%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      6.14 ± 11%      -3.6        2.56 ±  5%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      5.12 ± 11%      -3.4        1.69 ±  7%  perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
      4.36 ± 14%      -3.0        1.36 ± 10%  perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
      4.60 ±  7%      -2.3        2.32 ±  9%  perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      3.32 ±  8%      -2.0        1.33 ±  7%  perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      2.50 ± 19%      -1.9        0.62 ± 45%  perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
      3.61 ±  9%      -1.7        1.90 ±  8%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      2.10 ± 13%      -1.3        0.80 ±  9%  perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      1.61 ± 29%      -1.2        0.38 ± 72%  perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      1.92 ± 16%      -1.1        0.85 ± 12%  perf-profile.calltrace.cycles-pp.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      1.82 ± 17%      -1.0        0.84 ± 16%  perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.75 ± 17%      -0.9        0.81 ± 17%  perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      1.52 ±  7%      -0.9        0.63 ±  9%  perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt
      1.22 ± 15%      -0.8        0.40 ± 74%  perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.19 ± 24%      -0.7        0.51 ± 75%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      1.30 ± 21%      -0.7        0.63 ± 52%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      1.30 ± 21%      -0.7        0.63 ± 52%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
      1.30 ± 21%      -0.7        0.63 ± 52%  perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64_no_verify
      1.14 ± 25%      -0.6        0.50 ± 76%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
      0.00            +0.8        0.82 ± 16%  perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +0.8        0.82 ± 16%  perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +0.9        0.88 ± 30%  perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +0.9        0.88 ± 30%  perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
      0.00            +0.9        0.88 ±  7%  perf-profile.calltrace.cycles-pp.simple_recursive_removal.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue
      0.00            +0.9        0.89 ±  7%  perf-profile.calltrace.cycles-pp.debugfs_remove.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue.loop_remove
      0.00            +0.9        0.89 ±  7%  perf-profile.calltrace.cycles-pp.blk_mq_debugfs_unregister_hctx.blk_mq_exit_queue.blk_cleanup_queue.loop_remove.loop_control_ioctl
      0.00            +0.9        0.89 ±  7%  perf-profile.calltrace.cycles-pp.blk_mq_exit_queue.blk_cleanup_queue.loop_remove.loop_control_ioctl.__x64_sys_ioctl
      0.00            +0.9        0.90 ±  8%  perf-profile.calltrace.cycles-pp.blk_cleanup_queue.loop_remove.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64
      0.00            +1.0        1.03 ±  8%  perf-profile.calltrace.cycles-pp.loop_remove.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.0        1.04 ± 15%  perf-profile.calltrace.cycles-pp.__mutex_lock.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.3        1.35 ± 24%  perf-profile.calltrace.cycles-pp.delay_tsc.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
      0.00            +2.6        2.62 ±  8%  perf-profile.calltrace.cycles-pp.loop_control_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +4.1        4.14 ±  6%  perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.lo_release.__blkdev_put.blkdev_put
      0.00            +4.2        4.18 ± 13%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +4.2        4.22 ± 13%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +4.3        4.26 ±  7%  perf-profile.calltrace.cycles-pp.__mutex_lock.lo_release.__blkdev_put.blkdev_put.blkdev_close
      0.00            +4.3        4.26 ±  7%  perf-profile.calltrace.cycles-pp.lo_release.__blkdev_put.blkdev_put.blkdev_close.__fput
      0.00            +4.3        4.34 ±  7%  perf-profile.calltrace.cycles-pp.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      0.00            +4.3        4.34 ±  7%  perf-profile.calltrace.cycles-pp.blkdev_put.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare
      0.00            +4.3        4.34 ±  7%  perf-profile.calltrace.cycles-pp.__blkdev_put.blkdev_put.blkdev_close.__fput.task_work_run
      0.00            +4.4        4.40 ±  7%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      0.00            +4.5        4.51 ±  7%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +5.9        5.86 ±  9%  perf-profile.calltrace.cycles-pp.printk.set_capacity_and_notify.cold.loop_set_size.lo_ioctl.blkdev_ioctl
      0.00            +5.9        5.86 ±  9%  perf-profile.calltrace.cycles-pp.vprintk_emit.printk.set_capacity_and_notify.cold.loop_set_size.lo_ioctl
      0.00            +5.9        5.87 ±  9%  perf-profile.calltrace.cycles-pp.loop_set_size.lo_ioctl.blkdev_ioctl.block_ioctl.__x64_sys_ioctl
      0.00            +5.9        5.87 ±  9%  perf-profile.calltrace.cycles-pp.set_capacity_and_notify.cold.loop_set_size.lo_ioctl.blkdev_ioctl.block_ioctl
      0.00            +6.0        6.02 ±  9%  perf-profile.calltrace.cycles-pp.printk.set_capacity_and_notify.cold.loop_set_size.loop_configure.lo_ioctl
      0.00            +6.0        6.02 ±  9%  perf-profile.calltrace.cycles-pp.vprintk_emit.printk.set_capacity_and_notify.cold.loop_set_size.loop_configure
      0.00            +6.0        6.02 ±  9%  perf-profile.calltrace.cycles-pp.loop_set_size.loop_configure.lo_ioctl.blkdev_ioctl.block_ioctl
      0.00            +6.0        6.02 ±  9%  perf-profile.calltrace.cycles-pp.set_capacity_and_notify.cold.loop_set_size.loop_configure.lo_ioctl.blkdev_ioctl
      0.00            +6.0        6.04 ±  9%  perf-profile.calltrace.cycles-pp.loop_configure.lo_ioctl.blkdev_ioctl.block_ioctl.__x64_sys_ioctl
      0.32 ±100%      +6.8        7.11 ±  9%  perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
      0.34 ±100%      +8.2        8.54 ±  7%  perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock
      0.34 ±100%      +8.2        8.55 ±  7%  perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit
      0.36 ±100%      +8.8        9.13 ±  7%  perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.printk
      0.00            +9.6        9.56 ±  7%  perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.printk.set_capacity_and_notify.cold
      0.00           +10.3       10.35 ±  7%  perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.printk.set_capacity_and_notify.cold.loop_set_size
      0.00           +12.4       12.38 ±  5%  perf-profile.calltrace.cycles-pp.lo_ioctl.blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64
      0.00           +12.4       12.38 ±  5%  perf-profile.calltrace.cycles-pp.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00           +12.4       12.38 ±  5%  perf-profile.calltrace.cycles-pp.blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00           +13.1       13.12 ±  5%  perf-profile.calltrace.cycles-pp.memcpy_toio.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread
      0.00           +13.5       13.50 ±  5%  perf-profile.calltrace.cycles-pp.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread.ret_from_fork
      0.00           +14.1       14.12 ±  5%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      0.00           +14.2       14.21 ±  5%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      0.13 ±173%     +14.7       14.82 ±  5%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      0.13 ±173%     +14.7       14.84 ±  5%  perf-profile.calltrace.cycles-pp.ret_from_fork
      0.00           +15.0       15.00 ±  4%  perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.31 ±102%     +20.6       20.89 ±  5%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.32 ±102%     +20.6       20.90 ±  5%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     97.10           -37.7       59.37 ±  2%  perf-profile.children.cycles-pp.do_idle
     97.10           -37.7       59.38 ±  2%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     97.10           -37.7       59.38 ±  2%  perf-profile.children.cycles-pp.cpu_startup_entry
     95.80           -37.1       58.68 ±  2%  perf-profile.children.cycles-pp.start_secondary
     85.82           -31.2       54.60 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter
     85.76           -31.2       54.58 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter_state
     36.71 ± 12%     -21.8       14.91 ±  5%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
     32.82 ± 12%     -19.9       12.91 ±  5%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
     23.84 ± 15%     -15.1        8.70 ±  5%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
     23.60 ± 15%     -15.0        8.58 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
     10.74 ± 23%      -7.3        3.49 ± 13%  perf-profile.children.cycles-pp.ktime_get
      9.65 ± 25%      -6.6        3.02 ± 13%  perf-profile.children.cycles-pp.clockevents_program_event
     10.68 ±  5%      -6.3        4.38 ±  4%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      9.10 ± 14%      -5.5        3.65 ±  5%  perf-profile.children.cycles-pp.menu_select
      7.37 ±  9%      -4.4        2.98 ±  3%  perf-profile.children.cycles-pp.tick_sched_timer
      6.45 ±  8%      -3.7        2.73 ±  5%  perf-profile.children.cycles-pp.tick_sched_handle
      6.29 ± 10%      -3.6        2.66 ±  5%  perf-profile.children.cycles-pp.update_process_times
      5.18 ± 11%      -3.5        1.71 ±  7%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      4.42 ± 13%      -3.0        1.38 ± 10%  perf-profile.children.cycles-pp.tick_nohz_next_event
      4.74 ±  7%      -2.3        2.40 ±  9%  perf-profile.children.cycles-pp.irq_exit_rcu
      3.43 ±  7%      -2.0        1.38 ±  6%  perf-profile.children.cycles-pp.scheduler_tick
      2.52 ± 20%      -1.8        0.70 ± 19%  perf-profile.children.cycles-pp.timekeeping_max_deferment
      3.73 ±  8%      -1.7        2.05 ±  7%  perf-profile.children.cycles-pp.__softirqentry_text_start
      2.16 ± 12%      -1.3        0.82 ±  9%  perf-profile.children.cycles-pp.rebalance_domains
      2.11 ± 16%      -1.3        0.83 ±  2%  perf-profile.children.cycles-pp.native_irq_return_iret
      1.77 ± 13%      -1.2        0.60 ± 13%  perf-profile.children.cycles-pp.irqtime_account_irq
      2.03 ± 15%      -1.1        0.89 ± 12%  perf-profile.children.cycles-pp.lapic_next_deadline
      1.64 ± 28%      -1.1        0.53 ± 19%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      1.86 ± 16%      -1.0        0.85 ± 16%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      1.57 ±  6%      -0.9        0.66 ±  8%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      1.36 ± 22%      -0.9        0.45 ± 20%  perf-profile.children.cycles-pp.calc_global_load_tick
      1.39 ±  6%      -0.8        0.58 ± 13%  perf-profile.children.cycles-pp.sched_clock_cpu
      1.22 ±  8%      -0.7        0.50 ± 14%  perf-profile.children.cycles-pp.native_sched_clock
      1.25 ± 16%      -0.7        0.54 ± 26%  perf-profile.children.cycles-pp.irq_enter_rcu
      1.26 ± 20%      -0.7        0.56 ± 10%  perf-profile.children.cycles-pp.read_tsc
      1.18 ± 15%      -0.7        0.52 ± 26%  perf-profile.children.cycles-pp.tick_irq_enter
      1.30 ± 21%      -0.6        0.69 ± 33%  perf-profile.children.cycles-pp.start_kernel
      0.97 ± 31%      -0.6        0.38 ± 22%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.94 ± 14%      -0.5        0.46 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.83 ± 28%      -0.5        0.36 ± 20%  perf-profile.children.cycles-pp.update_rq_clock
      0.72 ± 13%      -0.4        0.28 ± 12%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.74 ± 15%      -0.4        0.30 ± 20%  perf-profile.children.cycles-pp.hrtimer_update_next_event
      0.70 ±  6%      -0.4        0.26 ± 21%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.87 ± 17%      -0.4        0.45 ± 22%  perf-profile.children.cycles-pp.asm_sysvec_irq_work
      0.87 ± 17%      -0.4        0.45 ± 22%  perf-profile.children.cycles-pp.sysvec_irq_work
      0.87 ± 17%      -0.4        0.45 ± 22%  perf-profile.children.cycles-pp.__sysvec_irq_work
      0.87 ± 17%      -0.4        0.45 ± 22%  perf-profile.children.cycles-pp.irq_work_run
      0.90 ± 18%      -0.4        0.49 ± 19%  perf-profile.children.cycles-pp.irq_work_run_list
      0.87 ± 17%      -0.4        0.46 ± 21%  perf-profile.children.cycles-pp.irq_work_single
      0.65 ±  8%      -0.4        0.27 ± 26%  perf-profile.children.cycles-pp.__remove_hrtimer
      0.60 ± 12%      -0.4        0.23 ± 13%  perf-profile.children.cycles-pp.__hrtimer_next_event_base
      0.65 ± 11%      -0.4        0.28 ± 10%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.68 ±  8%      -0.4        0.32 ±  9%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.50 ± 36%      -0.4        0.13 ± 30%  perf-profile.children.cycles-pp.do_user_addr_fault
      0.52 ± 35%      -0.4        0.15 ± 25%  perf-profile.children.cycles-pp.asm_exc_page_fault
      0.50 ± 36%      -0.4        0.14 ± 28%  perf-profile.children.cycles-pp.exc_page_fault
      0.66 ± 10%      -0.3        0.32 ±  9%  perf-profile.children.cycles-pp.update_blocked_averages
      0.46 ± 38%      -0.3        0.12 ± 29%  perf-profile.children.cycles-pp.handle_mm_fault
      0.60 ±  9%      -0.3        0.26 ± 12%  perf-profile.children.cycles-pp.hrtimer_next_event_without
      0.44 ± 39%      -0.3        0.11 ± 29%  perf-profile.children.cycles-pp.__handle_mm_fault
      1.11 ±  8%      -0.3        0.78 ±  5%  perf-profile.children.cycles-pp.load_balance
      0.48 ± 34%      -0.3        0.17 ± 23%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.43 ± 14%      -0.3        0.13 ± 16%  perf-profile.children.cycles-pp.call_cpuidle
      0.40 ± 20%      -0.3        0.10 ±  8%  perf-profile.children.cycles-pp.__x64_sys_execve
      0.40 ± 20%      -0.3        0.10 ±  8%  perf-profile.children.cycles-pp.do_execveat_common
      0.51 ± 31%      -0.3        0.21 ± 22%  perf-profile.children.cycles-pp.update_irq_load_avg
      0.40 ± 20%      -0.3        0.10 ±  8%  perf-profile.children.cycles-pp.execve
      0.46 ± 36%      -0.3        0.17 ± 24%  perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
      0.34 ± 45%      -0.3        0.05 ± 80%  perf-profile.children.cycles-pp.do_fault
      0.31 ± 48%      -0.3        0.03 ±108%  perf-profile.children.cycles-pp.filemap_map_pages
      0.48 ± 11%      -0.3        0.20 ± 26%  perf-profile.children.cycles-pp.timerqueue_del
      0.56 ± 18%      -0.3        0.29 ± 16%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.41 ±  6%      -0.3        0.15 ± 21%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.32 ± 19%      -0.2        0.08 ± 22%  perf-profile.children.cycles-pp.bprm_execve
      0.38 ±  6%      -0.2        0.14 ± 25%  perf-profile.children.cycles-pp.timerqueue_add
      0.29 ± 21%      -0.2        0.07 ± 30%  perf-profile.children.cycles-pp.mmput
      0.29 ± 22%      -0.2        0.07 ± 30%  perf-profile.children.cycles-pp.exit_mmap
      0.28 ± 21%      -0.2        0.06 ± 51%  perf-profile.children.cycles-pp.exec_binprm
      0.27 ± 20%      -0.2        0.05 ± 73%  perf-profile.children.cycles-pp.load_elf_binary
      0.34 ± 19%      -0.2        0.13 ± 11%  perf-profile.children.cycles-pp.trigger_load_balance
      0.33 ± 21%      -0.2        0.12 ± 13%  perf-profile.children.cycles-pp.hrtimer_get_next_event
      0.36 ± 13%      -0.2        0.15 ± 16%  perf-profile.children.cycles-pp.__hrtimer_get_next_event
      0.40 ± 22%      -0.2        0.20 ± 18%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.32 ± 28%      -0.2        0.14 ± 28%  perf-profile.children.cycles-pp.cpuidle_governor_latency_req
      0.19 ± 24%      -0.1        0.04 ± 73%  perf-profile.children.cycles-pp.tick_sched_do_timer
      0.21 ± 23%      -0.1        0.07 ± 55%  perf-profile.children.cycles-pp.perf_event_task_tick
      0.19 ± 25%      -0.1        0.05 ± 52%  perf-profile.children.cycles-pp.__x64_sys_exit_group
      0.19 ± 25%      -0.1        0.05 ± 52%  perf-profile.children.cycles-pp.do_group_exit
      0.26 ± 21%      -0.1        0.12 ± 18%  perf-profile.children.cycles-pp.rcu_eqs_enter
      0.16 ± 29%      -0.1        0.03 ±101%  perf-profile.children.cycles-pp.timekeeping_advance
      0.19 ± 25%      -0.1        0.06 ± 50%  perf-profile.children.cycles-pp.do_exit
      0.16 ± 13%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.menu_reflect
      0.74 ±  3%      -0.1        0.62 ±  7%  perf-profile.children.cycles-pp.update_sd_lb_stats
      0.22 ± 10%      -0.1        0.10 ± 28%  perf-profile.children.cycles-pp.rb_next
      0.24 ± 27%      -0.1        0.12 ± 11%  perf-profile.children.cycles-pp.cpumask_next_and
      0.24 ± 15%      -0.1        0.12 ± 21%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.76 ±  3%      -0.1        0.65 ±  6%  perf-profile.children.cycles-pp.find_busiest_group
      0.21 ± 32%      -0.1        0.10 ± 40%  perf-profile.children.cycles-pp.update_ts_time_stats
      0.17 ± 19%      -0.1        0.06 ± 47%  perf-profile.children.cycles-pp.tick_nohz_tick_stopped
      0.16 ± 21%      -0.1        0.06 ± 17%  perf-profile.children.cycles-pp.__libc_fork
      0.14 ± 27%      -0.1        0.05 ± 72%  perf-profile.children.cycles-pp.get_cpu_device
      0.12 ± 25%      -0.1        0.03 ±101%  perf-profile.children.cycles-pp.do_mmap
      0.13 ± 25%      -0.1        0.04 ±102%  perf-profile.children.cycles-pp.vm_mmap_pgoff
      0.12 ± 17%      -0.1        0.03 ±101%  perf-profile.children.cycles-pp.__do_sys_clone
      0.17 ± 28%      -0.1        0.08 ± 23%  perf-profile.children.cycles-pp.rb_erase
      0.18 ± 20%      -0.1        0.10 ± 22%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.17 ± 29%      -0.1        0.09 ± 17%  perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
      0.16 ±  9%      -0.1        0.08 ± 19%  perf-profile.children.cycles-pp.read_counters
      0.16 ±  9%      -0.1        0.08 ± 19%  perf-profile.children.cycles-pp.cmd_stat
      0.16 ±  9%      -0.1        0.08 ± 19%  perf-profile.children.cycles-pp.dispatch_events
      0.16 ±  9%      -0.1        0.08 ± 19%  perf-profile.children.cycles-pp.process_interval
      0.16 ±  9%      -0.1        0.08 ± 18%  perf-profile.children.cycles-pp.__libc_start_main
      0.16 ±  9%      -0.1        0.08 ± 18%  perf-profile.children.cycles-pp.main
      0.16 ±  9%      -0.1        0.08 ± 18%  perf-profile.children.cycles-pp.run_builtin
      0.10 ± 17%      -0.1        0.03 ±102%  perf-profile.children.cycles-pp.copy_process
      0.11 ± 27%      -0.1        0.04 ± 75%  perf-profile.children.cycles-pp.irqentry_exit
      0.11 ± 22%      -0.1        0.04 ± 73%  perf-profile.children.cycles-pp.update_rt_rq_load_avg
      0.12 ± 15%      -0.1        0.06 ± 48%  perf-profile.children.cycles-pp.tick_program_event
      0.11 ± 21%      -0.1        0.04 ± 78%  perf-profile.children.cycles-pp.rb_insert_color
      0.24 ± 12%      -0.1        0.18 ± 27%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.16 ± 32%      -0.1        0.09 ± 16%  perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
      0.08 ± 23%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.write
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.malloc
      0.02 ±100%      +0.1        0.08 ± 16%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.00            +0.1        0.06 ± 14%  perf-profile.children.cycles-pp.refill_obj_stock
      0.00            +0.1        0.06 ± 17%  perf-profile.children.cycles-pp.sd_event_run
      0.01 ±173%      +0.1        0.08 ± 19%  perf-profile.children.cycles-pp.obj_cgroup_charge
      0.01 ±173%      +0.1        0.08 ± 11%  perf-profile.children.cycles-pp.update_load_avg
      0.00            +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.d_add
      0.00            +0.1        0.07 ± 26%  perf-profile.children.cycles-pp.blk_complete_reqs
      0.00            +0.1        0.07 ± 13%  perf-profile.children.cycles-pp.simple_lookup
      0.00            +0.1        0.07 ± 23%  perf-profile.children.cycles-pp.__check_object_size
      0.01 ±173%      +0.1        0.08 ± 29%  perf-profile.children.cycles-pp.try_to_unlazy
      0.00            +0.1        0.07 ± 11%  perf-profile.children.cycles-pp.blk_mq_init_queue_data
      0.00            +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.apparmor_file_alloc_security
      0.00            +0.1        0.07 ± 16%  perf-profile.children.cycles-pp.ep_poll_callback
      0.00            +0.1        0.07 ± 21%  perf-profile.children.cycles-pp.cp_new_stat
      0.00            +0.1        0.07 ± 29%  perf-profile.children.cycles-pp.__legitimize_path
      0.00            +0.1        0.07 ± 12%  perf-profile.children.cycles-pp.recvmsg
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.pcpu_alloc
      0.00            +0.1        0.08 ± 25%  perf-profile.children.cycles-pp.path_init
      0.01 ±173%      +0.1        0.09 ± 16%  perf-profile.children.cycles-pp.__cond_resched
      0.00            +0.1        0.08 ± 18%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.00            +0.1        0.08 ± 26%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.00            +0.1        0.08 ± 21%  perf-profile.children.cycles-pp.del_gendisk
      0.00            +0.1        0.08 ± 21%  perf-profile.children.cycles-pp.____sys_recvmsg
      0.00            +0.1        0.08 ± 28%  perf-profile.children.cycles-pp.lookup_dcache
      0.02 ±173%      +0.1        0.10 ± 23%  perf-profile.children.cycles-pp.__slab_free
      0.00            +0.1        0.08 ± 27%  perf-profile.children.cycles-pp.d_lookup
      0.00            +0.1        0.08 ± 22%  perf-profile.children.cycles-pp.schedule_hrtimeout_range_clock
      0.00            +0.1        0.08 ± 62%  perf-profile.children.cycles-pp.allocate_slab
      0.00            +0.1        0.09 ± 28%  perf-profile.children.cycles-pp.ahci_single_level_irq_intr
      0.00            +0.1        0.09 ± 12%  perf-profile.children.cycles-pp.autoremove_wake_function
      0.00            +0.1        0.09 ± 26%  perf-profile.children.cycles-pp.handle_irq_event_percpu
      0.00            +0.1        0.09 ± 26%  perf-profile.children.cycles-pp.__handle_irq_event_percpu
      0.00            +0.1        0.09 ± 30%  perf-profile.children.cycles-pp.___sys_recvmsg
      0.00            +0.1        0.09 ± 27%  perf-profile.children.cycles-pp.handle_irq_event
      0.00            +0.1        0.09 ± 29%  perf-profile.children.cycles-pp.handle_edge_irq
      0.00            +0.1        0.10 ± 23%  perf-profile.children.cycles-pp.__x64_sys_close
      0.00            +0.1        0.10 ±  8%  perf-profile.children.cycles-pp.memset_erms
      0.00            +0.1        0.10 ± 23%  perf-profile.children.cycles-pp.call_rcu
      0.00            +0.1        0.10 ± 30%  perf-profile.children.cycles-pp.__common_interrupt
      0.00            +0.1        0.10 ± 57%  perf-profile.children.cycles-pp.___d_drop
      0.00            +0.1        0.10 ± 27%  perf-profile.children.cycles-pp.__sys_recvmsg
      0.00            +0.1        0.10 ± 21%  perf-profile.children.cycles-pp.ep_poll
      0.00            +0.1        0.10 ± 21%  perf-profile.children.cycles-pp.read_pages
      0.00            +0.1        0.10 ± 14%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.00            +0.1        0.10 ± 58%  perf-profile.children.cycles-pp.__d_drop
      0.00            +0.1        0.10 ± 22%  perf-profile.children.cycles-pp.do_epoll_wait
      0.02 ±173%      +0.1        0.12 ± 28%  perf-profile.children.cycles-pp.mutex_lock
      0.00            +0.1        0.11 ± 21%  perf-profile.children.cycles-pp.__x64_sys_epoll_wait
      0.00            +0.1        0.11 ± 12%  perf-profile.children.cycles-pp.blkdev_get_no_open
      0.00            +0.1        0.11 ± 12%  perf-profile.children.cycles-pp.blk_request_module
      0.00            +0.1        0.11 ± 12%  perf-profile.children.cycles-pp.loop_probe
      0.00            +0.1        0.11 ± 27%  perf-profile.children.cycles-pp.__d_alloc
      0.00            +0.1        0.11 ± 65%  perf-profile.children.cycles-pp.kernfs_iop_lookup
      0.00            +0.1        0.11 ± 53%  perf-profile.children.cycles-pp.___slab_alloc
      0.01 ±173%      +0.1        0.12 ± 32%  perf-profile.children.cycles-pp.___might_sleep
      0.00            +0.1        0.11 ± 14%  perf-profile.children.cycles-pp.__entry_text_start
      0.00            +0.1        0.11 ± 51%  perf-profile.children.cycles-pp.__slab_alloc
      0.00            +0.1        0.12 ± 27%  perf-profile.children.cycles-pp.asm_common_interrupt
      0.00            +0.1        0.12 ± 27%  perf-profile.children.cycles-pp.common_interrupt
      0.00            +0.1        0.12 ± 14%  perf-profile.children.cycles-pp.epoll_wait
      0.00            +0.1        0.12 ± 23%  perf-profile.children.cycles-pp.evict
      0.00            +0.1        0.12 ± 33%  perf-profile.children.cycles-pp.vfs_fstat
      0.00            +0.1        0.12 ± 15%  perf-profile.children.cycles-pp.security_file_alloc
      0.00            +0.1        0.13 ± 20%  perf-profile.children.cycles-pp.page_cache_ra_unbounded
      0.00            +0.1        0.13 ± 26%  perf-profile.children.cycles-pp.____sys_sendmsg
      0.00            +0.1        0.13 ± 46%  perf-profile.children.cycles-pp.alloc_inode
      0.00            +0.1        0.13 ± 15%  perf-profile.children.cycles-pp.strncpy_from_user
      0.00            +0.1        0.14 ± 14%  perf-profile.children.cycles-pp.new_inode_pseudo
      0.00            +0.1        0.14 ± 19%  perf-profile.children.cycles-pp.inode_permission
      0.00            +0.1        0.14 ± 26%  perf-profile.children.cycles-pp.___sys_sendmsg
      0.02 ±173%      +0.1        0.15 ±  9%  perf-profile.children.cycles-pp.step_into
      0.00            +0.1        0.14 ± 11%  perf-profile.children.cycles-pp.debugfs_get_inode
      0.00            +0.1        0.14 ± 22%  perf-profile.children.cycles-pp.sock_sendmsg
      0.00            +0.1        0.14 ± 28%  perf-profile.children.cycles-pp.__sys_sendmsg
      0.00            +0.1        0.14 ± 15%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.02 ±173%      +0.1        0.16 ± 18%  perf-profile.children.cycles-pp.d_alloc
      0.00            +0.1        0.14 ± 11%  perf-profile.children.cycles-pp.__wake_up_common
      0.00            +0.1        0.14 ± 10%  perf-profile.children.cycles-pp.new_inode
      0.04 ±103%      +0.1        0.18 ± 16%  perf-profile.children.cycles-pp.d_alloc_parallel
      0.00            +0.1        0.15 ±  9%  perf-profile.children.cycles-pp.__d_lookup
      0.14 ± 25%      +0.2        0.30 ± 13%  perf-profile.children.cycles-pp.new_sync_read
      0.24 ± 13%      +0.2        0.40 ±  6%  perf-profile.children.cycles-pp.vfs_read
      0.24 ± 13%      +0.2        0.41 ±  6%  perf-profile.children.cycles-pp.ksys_read
      0.02 ±100%      +0.2        0.20 ±  6%  perf-profile.children.cycles-pp.getname_flags
      0.02 ±173%      +0.2        0.20 ± 38%  perf-profile.children.cycles-pp.schedule_idle
      0.02 ±100%      +0.2        0.21 ± 19%  perf-profile.children.cycles-pp.try_to_wake_up
      0.00            +0.2        0.19 ± 18%  perf-profile.children.cycles-pp.filemap_get_pages
      0.00            +0.2        0.20 ± 13%  perf-profile.children.cycles-pp.transfer_xor
      0.00            +0.2        0.20 ± 14%  perf-profile.children.cycles-pp.blkdev_read_iter
      0.00            +0.2        0.20 ± 25%  perf-profile.children.cycles-pp.__do_sys_newfstat
      0.00            +0.2        0.20 ± 14%  perf-profile.children.cycles-pp.cpumask_next
      0.00            +0.2        0.20 ± 21%  perf-profile.children.cycles-pp.d_invalidate
      0.00            +0.2        0.22 ±  8%  perf-profile.children.cycles-pp.access
      0.04 ±100%      +0.2        0.28 ± 16%  perf-profile.children.cycles-pp.filename_lookup
      0.00            +0.2        0.24 ± 16%  perf-profile.children.cycles-pp.lookup_one_len
      0.02 ±173%      +0.2        0.26 ± 18%  perf-profile.children.cycles-pp.lookup_fast
      0.00            +0.3        0.25 ± 13%  perf-profile.children.cycles-pp.filemap_read
      0.00            +0.3        0.26 ± 16%  perf-profile.children.cycles-pp.start_creating
      0.00            +0.3        0.26 ± 11%  perf-profile.children.cycles-pp.do_faccessat
      0.06 ± 58%      +0.3        0.33 ± 13%  perf-profile.children.cycles-pp.kmem_cache_free
      0.00            +0.3        0.30 ± 14%  perf-profile.children.cycles-pp.loop_queue_work
      0.00            +0.3        0.30 ± 20%  perf-profile.children.cycles-pp.__dentry_kill
      0.01 ±173%      +0.3        0.31 ± 11%  perf-profile.children.cycles-pp.rcu_do_batch
      0.04 ±101%      +0.3        0.35 ± 20%  perf-profile.children.cycles-pp.__lookup_slow
      0.03 ±105%      +0.3        0.36 ± 12%  perf-profile.children.cycles-pp.newidle_balance
      0.20 ± 50%      +0.3        0.52 ± 14%  perf-profile.children.cycles-pp.rcu_core
      0.00            +0.3        0.33 ± 29%  perf-profile.children.cycles-pp.__fxstat64
      0.13 ± 32%      +0.3        0.47 ± 10%  perf-profile.children.cycles-pp.link_path_walk
      0.00            +0.3        0.35 ± 14%  perf-profile.children.cycles-pp.kthread_worker_fn
      0.00            +0.4        0.36 ± 13%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.00            +0.4        0.36 ± 13%  perf-profile.children.cycles-pp.debugfs_create_files
      0.00            +0.4        0.36 ± 13%  perf-profile.children.cycles-pp.__debugfs_create_file
      0.00            +0.4        0.38 ± 27%  perf-profile.children.cycles-pp.open64
      0.02 ±173%      +0.4        0.41 ± 19%  perf-profile.children.cycles-pp.__alloc_file
      0.00            +0.4        0.40 ±  6%  perf-profile.children.cycles-pp.mnt_get_count
      0.02 ±173%      +0.4        0.42 ± 19%  perf-profile.children.cycles-pp.alloc_empty_file
      0.10 ± 24%      +0.4        0.50 ± 12%  perf-profile.children.cycles-pp.schedule
      0.00            +0.4        0.40 ± 12%  perf-profile.children.cycles-pp.blk_mq_debugfs_register_hctx
      0.00            +0.4        0.41 ± 14%  perf-profile.children.cycles-pp.invalidate_bdev
      0.00            +0.4        0.41 ± 12%  perf-profile.children.cycles-pp.blk_mq_debugfs_register
      0.02 ±173%      +0.4        0.44 ± 12%  perf-profile.children.cycles-pp.dput
      0.00            +0.4        0.43 ±  7%  perf-profile.children.cycles-pp.mntput_no_expire
      0.00            +0.5        0.47 ± 19%  perf-profile.children.cycles-pp.__blkdev_get
      0.00            +0.5        0.47 ± 19%  perf-profile.children.cycles-pp.lo_open
      0.00            +0.5        0.47 ±  7%  perf-profile.children.cycles-pp.on_each_cpu_cond_mask
      0.00            +0.5        0.47 ±  7%  perf-profile.children.cycles-pp.smp_call_function_many_cond
      0.08 ± 72%      +0.5        0.55 ± 14%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.00            +0.5        0.49 ± 13%  perf-profile.children.cycles-pp.blk_register_queue
      0.00            +0.5        0.50 ± 21%  perf-profile.children.cycles-pp.osq_lock
      0.12 ± 40%      +0.5        0.62 ± 13%  perf-profile.children.cycles-pp.walk_component
      0.01 ±173%      +0.5        0.52 ± 17%  perf-profile.children.cycles-pp.smp_call_function_single
      0.00            +0.5        0.52 ± 16%  perf-profile.children.cycles-pp.sync_rcu_exp_select_node_cpus
      0.00            +0.5        0.54 ± 14%  perf-profile.children.cycles-pp.__device_add_disk
      0.15 ± 23%      +0.6        0.71 ± 15%  perf-profile.children.cycles-pp.__schedule
      0.00            +0.6        0.58 ± 15%  perf-profile.children.cycles-pp.blkdev_get_by_dev
      0.00            +0.6        0.58 ± 15%  perf-profile.children.cycles-pp.blkdev_open
      0.02 ±173%      +0.6        0.64 ± 10%  perf-profile.children.cycles-pp.io_serial_out
      0.02 ±173%      +0.6        0.64 ± 15%  perf-profile.children.cycles-pp.do_open
      0.02 ±173%      +0.6        0.64 ± 13%  perf-profile.children.cycles-pp.do_dentry_open
      0.03 ±100%      +0.6        0.66 ± 10%  perf-profile.children.cycles-pp.sys_imageblit
      0.03 ±100%      +0.6        0.67 ± 10%  perf-profile.children.cycles-pp.drm_fb_helper_sys_imageblit
      0.00            +0.6        0.64 ± 12%  perf-profile.children.cycles-pp.loop_add
      0.04 ±100%      +0.7        0.70 ± 16%  perf-profile.children.cycles-pp.path_lookupat
      0.00            +0.7        0.70 ± 16%  perf-profile.children.cycles-pp.unit_file_find_dropin_paths
      0.03 ±100%      +0.7        0.73 ±  8%  perf-profile.children.cycles-pp.bit_putcs
      0.03 ±100%      +0.7        0.74 ±  8%  perf-profile.children.cycles-pp.fbcon_putcs
      0.02 ±173%      +0.7        0.73 ±  8%  perf-profile.children.cycles-pp.fbcon_redraw
      0.02 ±173%      +0.7        0.74 ±  8%  perf-profile.children.cycles-pp.lf
      0.02 ±173%      +0.7        0.74 ±  8%  perf-profile.children.cycles-pp.con_scroll
      0.02 ±173%      +0.7        0.74 ±  8%  perf-profile.children.cycles-pp.fbcon_scroll
      0.03 ±100%      +0.8        0.79 ±  9%  perf-profile.children.cycles-pp.vt_console_print
      0.00            +0.8        0.83 ± 54%  perf-profile.children.cycles-pp.__close
      0.00            +0.9        0.89 ±  7%  perf-profile.children.cycles-pp.blk_mq_debugfs_unregister_hctx
      0.00            +0.9        0.89 ±  7%  perf-profile.children.cycles-pp.blk_mq_exit_queue
      0.00            +0.9        0.90 ±  8%  perf-profile.children.cycles-pp.blk_cleanup_queue
      0.00            +0.9        0.91 ±  7%  perf-profile.children.cycles-pp.debugfs_remove
      0.00            +0.9        0.91 ±  7%  perf-profile.children.cycles-pp.simple_recursive_removal
      0.00            +1.0        1.03 ±  8%  perf-profile.children.cycles-pp.loop_remove
      0.00            +1.1        1.14 ± 13%  perf-profile.children.cycles-pp.openat64
      0.14 ± 63%      +1.5        1.61 ± 16%  perf-profile.children.cycles-pp.delay_tsc
      0.22 ± 24%      +1.7        1.88 ±  8%  perf-profile.children.cycles-pp.path_openat
      0.22 ± 23%      +1.7        1.90 ±  8%  perf-profile.children.cycles-pp.do_filp_open
      0.25 ± 26%      +2.0        2.24 ±  8%  perf-profile.children.cycles-pp.do_sys_openat2
      0.25 ± 26%      +2.0        2.24 ±  8%  perf-profile.children.cycles-pp.do_sys_open
      0.00            +2.6        2.62 ±  8%  perf-profile.children.cycles-pp.loop_control_ioctl
      0.00            +4.4        4.40 ±  6%  perf-profile.children.cycles-pp.lo_release
      0.00            +4.5        4.49 ±  6%  perf-profile.children.cycles-pp.__blkdev_put
      0.00            +4.5        4.49 ±  6%  perf-profile.children.cycles-pp.blkdev_close
      0.00            +4.5        4.49 ±  6%  perf-profile.children.cycles-pp.blkdev_put
      0.00            +4.7        4.70 ±  6%  perf-profile.children.cycles-pp.__fput
      0.00            +4.8        4.79 ±  6%  perf-profile.children.cycles-pp.task_work_run
      0.01 ±173%      +4.8        4.84 ±  6%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.01 ±173%      +5.0        5.03 ±  4%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.00            +5.4        5.41 ±  2%  perf-profile.children.cycles-pp.mutex_spin_on_owner
      0.00            +6.0        5.95 ±  3%  perf-profile.children.cycles-pp.__mutex_lock
      0.00            +6.0        6.04 ±  9%  perf-profile.children.cycles-pp.loop_configure
      0.64 ± 22%      +7.1        7.69 ±  8%  perf-profile.children.cycles-pp.io_serial_in
      0.76 ± 15%      +8.1        8.89 ±  7%  perf-profile.children.cycles-pp.serial8250_console_putchar
      0.79 ± 16%      +8.5        9.31 ±  7%  perf-profile.children.cycles-pp.wait_for_xmitr
      0.80 ± 16%      +8.7        9.51 ±  7%  perf-profile.children.cycles-pp.uart_console_write
      0.82 ± 17%      +9.1        9.95 ±  7%  perf-profile.children.cycles-pp.serial8250_console_write
      0.87 ± 17%      +9.9       10.76 ±  7%  perf-profile.children.cycles-pp.console_unlock
      0.87 ± 17%     +11.5       12.34 ±  6%  perf-profile.children.cycles-pp.printk
      0.87 ± 17%     +11.5       12.34 ±  6%  perf-profile.children.cycles-pp.vprintk_emit
      0.00           +11.9       11.89 ±  6%  perf-profile.children.cycles-pp.loop_set_size
      0.00           +11.9       11.89 ±  6%  perf-profile.children.cycles-pp.set_capacity_and_notify.cold
      0.00           +12.4       12.38 ±  5%  perf-profile.children.cycles-pp.lo_ioctl
      0.00           +12.4       12.38 ±  5%  perf-profile.children.cycles-pp.blkdev_ioctl
      0.00           +12.4       12.38 ±  5%  perf-profile.children.cycles-pp.block_ioctl
      0.20 ± 23%     +13.3       13.48 ±  5%  perf-profile.children.cycles-pp.memcpy_toio
      0.20 ± 23%     +13.3       13.50 ±  5%  perf-profile.children.cycles-pp.drm_fb_helper_damage_work
      0.24 ± 15%     +13.9       14.12 ±  5%  perf-profile.children.cycles-pp.process_one_work
      0.24 ± 13%     +14.0       14.21 ±  5%  perf-profile.children.cycles-pp.worker_thread
      0.46 ±  5%     +14.4       14.85 ±  5%  perf-profile.children.cycles-pp.ret_from_fork
      0.43 ± 10%     +14.4       14.82 ±  5%  perf-profile.children.cycles-pp.kthread
      0.00           +15.0       15.00 ±  4%  perf-profile.children.cycles-pp.__x64_sys_ioctl
      1.63 ± 15%     +22.8       24.44 ±  4%  perf-profile.children.cycles-pp.do_syscall_64
      1.65 ± 15%     +22.8       24.49 ±  4%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      9.74 ± 24%      -6.7        3.05 ± 14%  perf-profile.self.cycles-pp.ktime_get
      4.76 ± 13%      -2.7        2.02 ±  9%  perf-profile.self.cycles-pp.cpuidle_enter_state
      2.50 ± 20%      -1.8        0.70 ± 18%  perf-profile.self.cycles-pp.timekeeping_max_deferment
      3.42 ± 34%      -1.7        1.70 ±  7%  perf-profile.self.cycles-pp.menu_select
      2.11 ± 16%      -1.3        0.82 ±  2%  perf-profile.self.cycles-pp.native_irq_return_iret
      1.72 ± 29%      -1.2        0.48 ± 21%  perf-profile.self.cycles-pp.update_process_times
      2.03 ± 15%      -1.1        0.89 ± 12%  perf-profile.self.cycles-pp.lapic_next_deadline
      1.41 ± 27%      -1.0        0.41 ± 22%  perf-profile.self.cycles-pp.ktime_get_update_offsets_now
      1.35 ± 22%      -0.9        0.45 ± 20%  perf-profile.self.cycles-pp.calc_global_load_tick
      1.17 ± 14%      -0.8        0.36 ± 18%  perf-profile.self.cycles-pp.irqtime_account_irq
      1.07 ± 17%      -0.8        0.32 ± 19%  perf-profile.self.cycles-pp.tick_nohz_next_event
      1.19 ±  8%      -0.7        0.48 ± 14%  perf-profile.self.cycles-pp.native_sched_clock
      1.22 ± 20%      -0.7        0.54 ±  9%  perf-profile.self.cycles-pp.read_tsc
      0.97 ± 31%      -0.6        0.37 ± 22%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.94 ± 14%      -0.5        0.44 ±  6%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.70 ±  6%      -0.4        0.26 ± 21%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.65 ± 11%      -0.4        0.28 ± 10%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.66 ± 10%      -0.3        0.32 ± 14%  perf-profile.self.cycles-pp.do_idle
      0.52 ± 13%      -0.3        0.18 ± 14%  perf-profile.self.cycles-pp.__hrtimer_next_event_base
      0.50 ± 32%      -0.3        0.21 ± 22%  perf-profile.self.cycles-pp.update_irq_load_avg
      0.42 ± 16%      -0.3        0.13 ± 16%  perf-profile.self.cycles-pp.call_cpuidle
      0.43 ± 30%      -0.3        0.16 ± 25%  perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
      0.42 ± 16%      -0.2        0.17 ± 14%  perf-profile.self.cycles-pp.__hrtimer_run_queues
      0.40 ± 23%      -0.2        0.16 ± 13%  perf-profile.self.cycles-pp.hrtimer_interrupt
      0.39 ± 29%      -0.2        0.16 ± 29%  perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.31 ± 20%      -0.2        0.12 ± 12%  perf-profile.self.cycles-pp.trigger_load_balance
      0.29 ± 17%      -0.2        0.11 ± 19%  perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
      0.26 ±  7%      -0.2        0.09 ± 29%  perf-profile.self.cycles-pp.timerqueue_add
      0.26 ± 11%      -0.1        0.12 ± 16%  perf-profile.self.cycles-pp.__hrtimer_get_next_event
      0.20 ± 25%      -0.1        0.07 ± 56%  perf-profile.self.cycles-pp.perf_event_task_tick
      0.26 ± 10%      -0.1        0.12 ± 30%  perf-profile.self.cycles-pp.scheduler_tick
      0.20 ± 14%      -0.1        0.08 ± 24%  perf-profile.self.cycles-pp.load_balance
      0.15 ± 12%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.tick_sched_timer
      0.22 ±  8%      -0.1        0.10 ± 28%  perf-profile.self.cycles-pp.rb_next
      0.22 ± 25%      -0.1        0.10 ± 27%  perf-profile.self.cycles-pp.rcu_eqs_exit
      0.23 ± 14%      -0.1        0.12 ± 23%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.16 ± 13%      -0.1        0.05 ± 76%  perf-profile.self.cycles-pp.__remove_hrtimer
      0.19 ± 35%      -0.1        0.08 ± 16%  perf-profile.self.cycles-pp.rebalance_domains
      0.14 ± 35%      -0.1        0.04 ± 75%  perf-profile.self.cycles-pp.clockevents_program_event
      0.14 ± 28%      -0.1        0.04 ± 76%  perf-profile.self.cycles-pp.get_cpu_device
      0.20 ± 13%      -0.1        0.10 ± 21%  perf-profile.self.cycles-pp.__softirqentry_text_start
      0.16 ± 15%      -0.1        0.07 ± 60%  perf-profile.self.cycles-pp.timerqueue_del
      0.14 ± 23%      -0.1        0.05 ± 46%  perf-profile.self.cycles-pp.tick_nohz_tick_stopped
      0.17 ± 29%      -0.1        0.09 ± 21%  perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter
      0.13 ± 22%      -0.1        0.05 ± 78%  perf-profile.self.cycles-pp.sched_clock_cpu
      0.51 ±  9%      -0.1        0.43 ±  8%  perf-profile.self.cycles-pp.update_sd_lb_stats
      0.13 ± 26%      -0.1        0.06 ± 47%  perf-profile.self.cycles-pp.get_next_timer_interrupt
      0.16 ± 23%      -0.1        0.08 ± 20%  perf-profile.self.cycles-pp.update_blocked_averages
      0.15 ± 36%      -0.1        0.08 ± 25%  perf-profile.self.cycles-pp.rb_erase
      0.15 ± 19%      -0.1        0.08 ± 50%  perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
      0.14 ± 21%      -0.1        0.07 ± 23%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.15 ± 32%      -0.1        0.08 ± 14%  perf-profile.self.cycles-pp.rcu_idle_exit
      0.14 ± 31%      -0.1        0.07 ± 18%  perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
      0.12 ± 15%      -0.1        0.05 ± 49%  perf-profile.self.cycles-pp.tick_program_event
      0.11 ± 22%      -0.1        0.04 ± 73%  perf-profile.self.cycles-pp.update_rt_rq_load_avg
      0.11 ± 17%      -0.1        0.04 ± 80%  perf-profile.self.cycles-pp.rb_insert_color
      0.15 ± 36%      -0.1        0.09 ± 19%  perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
      0.10 ± 15%      -0.0        0.04 ± 47%  perf-profile.self.cycles-pp.tick_nohz_get_sleep_length
      0.00            +0.1        0.06 ± 25%  perf-profile.self.cycles-pp.apparmor_file_alloc_security
      0.00            +0.1        0.07 ± 20%  perf-profile.self.cycles-pp.call_rcu
      0.00            +0.1        0.07 ± 20%  perf-profile.self.cycles-pp.___d_drop
      0.01 ±173%      +0.1        0.09 ± 28%  perf-profile.self.cycles-pp.mutex_lock
      0.00            +0.1        0.08 ± 29%  perf-profile.self.cycles-pp.cpumask_next
      0.02 ±173%      +0.1        0.10 ± 23%  perf-profile.self.cycles-pp.__slab_free
      0.00            +0.1        0.09 ±  7%  perf-profile.self.cycles-pp.memset_erms
      0.00            +0.1        0.10 ± 14%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.01 ±173%      +0.1        0.12 ± 33%  perf-profile.self.cycles-pp.___might_sleep
      0.00            +0.1        0.12 ± 12%  perf-profile.self.cycles-pp.__d_lookup
      0.01 ±173%      +0.2        0.17 ± 12%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.00            +0.2        0.16 ± 17%  perf-profile.self.cycles-pp.kmem_cache_free
      0.00            +0.2        0.19 ± 13%  perf-profile.self.cycles-pp.transfer_xor
      0.00            +0.2        0.23 ± 11%  perf-profile.self.cycles-pp.mnt_get_count
      0.00            +0.5        0.46 ±  8%  perf-profile.self.cycles-pp.smp_call_function_many_cond
      0.00            +0.5        0.49 ± 21%  perf-profile.self.cycles-pp.osq_lock
      0.00            +0.5        0.52 ± 17%  perf-profile.self.cycles-pp.smp_call_function_single
      0.02 ±173%      +0.6        0.64 ± 10%  perf-profile.self.cycles-pp.io_serial_out
      0.03 ±100%      +0.6        0.66 ± 10%  perf-profile.self.cycles-pp.sys_imageblit
      0.14 ± 63%      +1.5        1.61 ± 16%  perf-profile.self.cycles-pp.delay_tsc
      0.00            +1.6        1.57 ± 10%  perf-profile.self.cycles-pp.vprintk_emit
      0.00            +5.4        5.36        perf-profile.self.cycles-pp.mutex_spin_on_owner
      0.64 ± 22%      +7.1        7.69 ±  8%  perf-profile.self.cycles-pp.io_serial_in
      0.20 ± 23%     +13.2       13.41 ±  5%  perf-profile.self.cycles-pp.memcpy_toio


                                                                                
                           stress-ng.loop.ops_per_sec                           
                                                                                
  30 +----------------------------------------------------------------------+   
     |  O O       O O    O  O O                                             |   
  25 |..+.  .+.        O                                                    |   
     |    +.   +..+.+..+                                                    |   
     |                 :                                                    |   
  20 |-+               :                                                    |   
     |                  :                                                   |   
  15 |-+                :                                                   |   
     |                  :                                                   |   
  10 |-+                :                                                   |   
     |                  :                                                   |   
     |                  :                                                   |   
   5 |-+                 :                                                  |   
     |                   :                                                  |   
   0 +----------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.12.0-08445-g990e78116d38" of type "text/plain" (173524 bytes)

View attachment "job-script" of type "text/plain" (8126 bytes)

View attachment "job.yaml" of type "text/plain" (5662 bytes)

View attachment "reproduce" of type "text/plain" (532 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ