lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20201209142518.GA5628@xsang-OptiPlex-9020>
Date:   Wed, 9 Dec 2020 22:25:18 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Josef Bacik <josef@...icpanda.com>
Cc:     David Sterba <dsterba@...e.com>,
        Nikolay Borisov <nborisov@...e.com>,
        LKML <linux-kernel@...r.kernel.org>,
        Linux Memory Management List <linux-mm@...ck.org>,
        lkp@...ts.01.org, lkp@...el.com, ying.huang@...el.com,
        feng.tang@...el.com, zhengjun.xing@...el.com,
        linux-btrfs@...r.kernel.org
Subject: [btrfs]  5951248cb0:  fio.write_iops 97.3% improvement


Greeting,

FYI, we noticed a 97.3% improvement of fio.write_iops due to commit:


commit: 5951248cb0a0296d1bd3574dfd1a5793a6d4aed4 ("btrfs: improve preemptive background space flushing")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master


in testcase: fio-basic
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
with following parameters:

	disk: 2pmem
	fs: btrfs
	runtime: 200s
	nr_task: 50%
	time_based: tb
	rw: randwrite
	bs: 4k
	ioengine: mmap
	test_size: 100G
	cpufreq_governor: performance
	ucode: 0x5003003

test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url: https://github.com/axboe/fio





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
  4k/gcc-9/performance/2pmem/btrfs/mmap/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/200s/randwrite/lkp-csl-2sp6/100G/fio-basic/tb/0x5003003

commit: 
  f8558cfcad ("btrfs: introduce a FORCE_COMMIT_TRANS flush operation")
  5951248cb0 ("btrfs: improve preemptive background space flushing")

f8558cfcad82fc08 5951248cb0a0296d1bd3574dfd1 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      0.04 ± 10%      -0.0        0.01        fio.latency_1000ms%
      0.83 ± 14%      +1.1        1.94 ± 11%  fio.latency_100us%
      0.13            -0.0        0.08 ±  4%  fio.latency_10ms%
      0.01            +0.0        0.05 ± 13%  fio.latency_250ms%
     96.96            -5.6       91.34        fio.latency_250us%
      0.25 ±  4%      -0.1        0.13 ±  6%  fio.latency_2ms%
      0.19 ±  3%      -0.1        0.09 ±  2%  fio.latency_4ms%
      0.03 ±  3%      +0.0        0.06 ±  2%  fio.latency_500ms%
      0.48 ± 14%      +1.2        1.68 ±  6%  fio.latency_500us%
      0.01            +0.0        0.01        fio.latency_50ms%
      0.72 ± 10%      +3.5        4.23 ±  3%  fio.latency_50us%
      0.10 ±  5%      -0.1        0.02 ±  5%  fio.latency_750ms%
      0.13            +0.1        0.22 ± 10%  fio.latency_750us%
  61935632           +97.1%  1.221e+08        fio.time.file_system_inputs
  61935632           +97.1%  1.221e+08        fio.time.file_system_outputs
    622.50 ±  3%    +210.2%       1931 ± 10%  fio.time.involuntary_context_switches
   8023387           +93.7%   15541563        fio.time.major_page_faults
    132.50          +126.2%     299.75 ±  2%  fio.time.percent_of_cpu_this_job_got
    245.37          +130.8%     566.38 ±  2%  fio.time.system_time
     22.96           +70.2%      39.08        fio.time.user_time
  15426527           +93.7%   29882065        fio.time.voluntary_context_switches
   7741954           +97.1%   15260130        fio.workload
    150.91           +97.3%     297.72        fio.write_bw_MBps
    144384           +23.4%     178176        fio.write_clat_90%_us
    162816 ±  2%     +23.3%     200704        fio.write_clat_95%_us
    520192 ±  6%     -19.9%     416768 ±  3%  fio.write_clat_99%_us
   1240440           -49.3%     628551        fio.write_clat_mean_us
  26919160           -47.5%   14125975        fio.write_clat_stddev
     38633           +97.3%      76217        fio.write_iops
    282.04 ±  2%      +9.9%     309.89        pmeter.Average_Active_Power
     92.70            -6.0%      87.15        iostat.cpu.idle
      7.19 ±  2%     +76.0%      12.65        iostat.cpu.system
  5.15e+08           +78.8%  9.208e+08        cpuidle.C1.time
  17838787 ±  2%     +78.3%   31803543        cpuidle.C1.usage
  32656609 ± 24%     +42.8%   46648784 ± 11%  cpuidle.C1E.usage
  20422831 ± 13%     +65.3%   33767564 ±  2%  cpuidle.POLL.time
   7619291           +76.0%   13411443 ±  2%  cpuidle.POLL.usage
      0.00 ± 63%      +0.0        0.02 ± 53%  mpstat.cpu.all.iowait%
      1.00 ± 19%      -0.2        0.75        mpstat.cpu.all.irq%
      0.07 ± 13%      -0.0        0.06        mpstat.cpu.all.soft%
      6.17            +5.8       11.94        mpstat.cpu.all.sys%
      0.11            +0.1        0.19        mpstat.cpu.all.usr%
   5160023 ± 13%     +64.8%    8503359 ±  3%  numa-numastat.node0.local_node
     97048 ±122%    +711.7%     787740 ± 20%  numa-numastat.node0.numa_foreign
   5169381 ± 13%     +65.0%    8529785 ±  3%  numa-numastat.node0.numa_hit
   5231576 ± 10%     +72.2%    9006472        numa-numastat.node1.local_node
   5253538 ± 10%     +71.5%    9011390        numa-numastat.node1.numa_hit
     97048 ±122%    +711.7%     787740 ± 20%  numa-numastat.node1.numa_miss
    119014 ± 96%    +566.0%     792666 ± 21%  numa-numastat.node1.other_node
     92.00            -5.4%      87.00        vmstat.cpu.id
    149786           +97.5%     295794        vmstat.io.bi
    477213           +55.9%     744015        vmstat.io.bo
  23884975           +37.8%   32913304        vmstat.memory.cache
  19160880           -50.1%    9559403        vmstat.memory.free
      5.75 ±  7%    +104.3%      11.75 ±  3%  vmstat.procs.r
    343743           +82.4%     627055        vmstat.system.cs
    194851 ±  6%      +9.9%     214155        vmstat.system.in
   3122948           +53.0%    4777039 ±  4%  meminfo.Active
     10675 ±  4%    +149.1%      26590 ±  4%  meminfo.Active(anon)
   3112271           +52.6%    4750448 ±  4%  meminfo.Active(file)
  23485264           +38.5%   32522135        meminfo.Cached
    188617 ±  8%     -49.2%      95733 ±  3%  meminfo.CmaFree
    406051          +149.4%    1012676        meminfo.Dirty
  19574674           +37.7%   26957144        meminfo.Inactive
  18213931           +40.5%   25593485        meminfo.Inactive(file)
  18844028           +39.2%   26228714        meminfo.Mapped
  19230700           -50.0%    9620371        meminfo.MemFree
  29873287           +32.2%   39483616        meminfo.Memused
   1625359           +33.1%    2163121        meminfo.SUnreclaim
   1958658           +27.5%    2496974        meminfo.Slab
      3854 ± 18%    +136.4%       9113 ± 12%  meminfo.Writeback
    216841           +10.3%     239097        meminfo.max_used_kB
    807.50 ± 95%    +612.8%       5755 ± 38%  numa-meminfo.node0.Active(anon)
    280319 ± 11%     +73.7%     486972 ± 23%  numa-meminfo.node0.Dirty
  10999924 ± 18%     +43.4%   15774789        numa-meminfo.node0.FilePages
   8243398 ± 27%     +59.6%   13158530 ±  5%  numa-meminfo.node0.Inactive
   7829266 ± 27%     +65.9%   12988148 ±  5%  numa-meminfo.node0.Inactive(file)
   7886010 ± 29%     +61.7%   12754604 ±  5%  numa-meminfo.node0.Mapped
  10000327 ± 18%     -49.9%    5011494 ±  3%  numa-meminfo.node0.MemFree
  14375416 ± 12%     +34.7%   19364248        numa-meminfo.node0.MemUsed
      2264 ±  9%     +96.4%       4447 ±  8%  numa-meminfo.node0.Writeback
    738419 ± 44%    +238.5%    2499670 ± 21%  numa-meminfo.node1.Active
      9869 ± 10%    +111.1%      20835 ± 13%  numa-meminfo.node1.Active(anon)
    728549 ± 44%    +240.2%    2478835 ± 21%  numa-meminfo.node1.Active(file)
    125666 ± 24%    +318.1%     525454 ± 19%  numa-meminfo.node1.Dirty
  12491903 ± 18%     +34.1%   16750213        numa-meminfo.node1.FilePages
   9223226 ± 22%     -50.1%    4605923 ±  3%  numa-meminfo.node1.MemFree
  15505016 ± 13%     +29.8%   20122320        numa-meminfo.node1.MemUsed
    605005 ± 30%     +73.6%    1050454 ± 11%  numa-meminfo.node1.SUnreclaim
    804263 ± 22%     +52.4%    1225619 ±  8%  numa-meminfo.node1.Slab
      1773 ± 24%    +159.7%       4605 ± 11%  numa-meminfo.node1.Writeback
    201.50 ± 95%    +612.9%       1436 ± 38%  numa-vmstat.node0.nr_active_anon
     69549 ± 11%     +73.4%     120624 ± 23%  numa-vmstat.node0.nr_dirty
   2749128 ± 18%     +43.5%    3944801        numa-vmstat.node0.nr_file_pages
   2500789 ± 18%     -50.0%    1251535 ±  3%  numa-vmstat.node0.nr_free_pages
   1956889 ± 27%     +66.0%    3248001 ±  5%  numa-vmstat.node0.nr_inactive_file
   1975638 ± 29%     +61.3%    3187266 ±  5%  numa-vmstat.node0.nr_mapped
    595.00 ±  3%    +102.3%       1203 ±  6%  numa-vmstat.node0.nr_writeback
    201.50 ± 95%    +612.9%       1436 ± 38%  numa-vmstat.node0.nr_zone_active_anon
   1956895 ± 27%     +66.0%    3248352 ±  5%  numa-vmstat.node0.nr_zone_inactive_file
     70585 ± 11%     +73.9%     122776 ± 23%  numa-vmstat.node0.nr_zone_write_pending
      4607 ±135%   +4978.0%     233955 ± 36%  numa-vmstat.node0.numa_foreign
     20349 ±173%   +1017.9%     227473 ± 43%  numa-vmstat.node0.numa_miss
     34455 ± 90%    +920.0%     351453 ± 14%  numa-vmstat.node0.numa_other
      2461 ±  9%    +111.5%       5204 ± 13%  numa-vmstat.node1.nr_active_anon
    182101 ± 44%    +240.3%     619713 ± 21%  numa-vmstat.node1.nr_active_file
  17399703 ± 75%    +105.0%   35674614 ±  3%  numa-vmstat.node1.nr_dirtied
     31727 ± 25%    +314.3%     131454 ± 19%  numa-vmstat.node1.nr_dirty
   3122539 ± 18%     +34.1%    4188806        numa-vmstat.node1.nr_file_pages
     47127 ±  8%     -49.3%      23915 ±  3%  numa-vmstat.node1.nr_free_cma
   2306140 ± 22%     -50.1%    1150015 ±  3%  numa-vmstat.node1.nr_free_pages
    151210 ± 30%     +73.7%     262711 ± 11%  numa-vmstat.node1.nr_slab_unreclaimable
    444.75 ± 10%    +179.7%       1243 ± 10%  numa-vmstat.node1.nr_writeback
  17348059 ± 75%    +104.6%   35497865 ±  3%  numa-vmstat.node1.nr_written
      2461 ±  9%    +111.5%       5205 ± 13%  numa-vmstat.node1.nr_zone_active_anon
    182101 ± 44%    +240.3%     619737 ± 21%  numa-vmstat.node1.nr_zone_active_file
     32546 ± 24%    +310.6%     133627 ± 19%  numa-vmstat.node1.nr_zone_write_pending
     20357 ±173%   +1017.5%     227485 ± 43%  numa-vmstat.node1.numa_foreign
      4611 ±135%   +4973.4%     233970 ± 36%  numa-vmstat.node1.numa_miss
    172419 ±  5%     +69.3%     291882 ± 32%  numa-vmstat.node1.numa_other
      4590           +79.4%       8236        sched_debug.cfs_rq:/.exec_clock.avg
      1820 ±  9%    +152.3%       4594 ±  9%  sched_debug.cfs_rq:/.exec_clock.min
      2528 ±  7%     -23.8%       1928 ±  6%  sched_debug.cfs_rq:/.exec_clock.stddev
    210833 ± 25%     +31.7%     277615 ± 11%  sched_debug.cfs_rq:/.load.stddev
     74.64 ± 21%     +49.1%     111.30 ± 15%  sched_debug.cfs_rq:/.load_avg.avg
    113.75 ± 47%    +111.1%     240.08 ± 52%  sched_debug.cfs_rq:/.removed.runnable_avg.max
     16.09 ± 48%    +106.2%      33.18 ± 49%  sched_debug.cfs_rq:/.removed.runnable_avg.stddev
    113.75 ± 47%    +111.1%     240.08 ± 52%  sched_debug.cfs_rq:/.removed.util_avg.max
     16.09 ± 48%    +106.2%      33.18 ± 49%  sched_debug.cfs_rq:/.removed.util_avg.stddev
    168.66 ± 16%     +32.8%     223.94 ±  9%  sched_debug.cfs_rq:/.runnable_avg.avg
    -46558          -101.7%     776.50 ±1206%  sched_debug.cfs_rq:/.spread0.avg
     18005 ±102%    +308.8%      73615 ± 18%  sched_debug.cfs_rq:/.spread0.max
    -56696           -82.8%      -9749        sched_debug.cfs_rq:/.spread0.min
    168.48 ± 16%     +32.8%     223.68 ±  9%  sched_debug.cfs_rq:/.util_avg.avg
     19.88 ± 22%     +95.4%      38.84 ± 25%  sched_debug.cfs_rq:/.util_est_enqueued.avg
    390.17 ± 18%     +74.2%     679.75 ±  4%  sched_debug.cfs_rq:/.util_est_enqueued.max
     71.90 ± 12%     +67.0%     120.07 ±  5%  sched_debug.cfs_rq:/.util_est_enqueued.stddev
      0.00 ±  4%     +33.9%       0.00 ±  7%  sched_debug.cpu.next_balance.stddev
    267879           +69.7%     454547        sched_debug.cpu.nr_switches.avg
    431837 ±  3%     +37.1%     591845 ±  4%  sched_debug.cpu.nr_switches.max
    106965 ± 28%    +175.1%     294249 ± 10%  sched_debug.cpu.nr_switches.min
    268086           +69.9%     455543        sched_debug.cpu.sched_count.avg
    433242 ±  3%     +36.1%     589608 ±  5%  sched_debug.cpu.sched_count.max
    107106 ± 28%    +174.3%     293741 ± 10%  sched_debug.cpu.sched_count.min
    132862           +70.2%     226171        sched_debug.cpu.sched_goidle.avg
    213399 ±  3%     +36.9%     292214 ±  5%  sched_debug.cpu.sched_goidle.max
     52904 ± 28%    +176.2%     146120 ± 10%  sched_debug.cpu.sched_goidle.min
    135730           +69.5%     230055        sched_debug.cpu.ttwu_count.avg
     68558 ±  6%    +113.5%     146389 ±  4%  sched_debug.cpu.ttwu_count.min
     47501 ± 13%     -21.4%      37341 ±  4%  sched_debug.cpu.ttwu_count.stddev
      2234 ±  5%     -40.5%       1330 ± 12%  sched_debug.cpu.ttwu_local.max
    132.83 ±  4%     +13.4%     150.67 ±  3%  sched_debug.cpu.ttwu_local.min
    379.94 ±  2%     -33.5%     252.59 ±  8%  sched_debug.cpu.ttwu_local.stddev
      1204 ±  5%     +13.6%       1368 ±  5%  slabinfo.Acpi-Parse.active_objs
      1204 ±  5%     +13.6%       1368 ±  5%  slabinfo.Acpi-Parse.num_objs
   3265814           +25.4%    4095444        slabinfo.Acpi-State.active_objs
     64209           +26.5%      81242        slabinfo.Acpi-State.active_slabs
   3274728           +26.5%    4143377        slabinfo.Acpi-State.num_objs
     64209           +26.5%      81242        slabinfo.Acpi-State.num_slabs
     19124 ±  3%     +16.8%      22337 ±  3%  slabinfo.btrfs_delayed_tree_ref.active_objs
    542.25 ±  3%     +21.3%     658.00 ±  4%  slabinfo.btrfs_delayed_tree_ref.active_slabs
     21163 ±  3%     +21.3%      25678 ±  4%  slabinfo.btrfs_delayed_tree_ref.num_objs
    542.25 ±  3%     +21.3%     658.00 ±  4%  slabinfo.btrfs_delayed_tree_ref.num_slabs
    106715 ±  3%    +104.8%     218526 ±  2%  slabinfo.btrfs_extent_buffer.active_objs
      3281 ±  3%    +102.8%       6655 ±  2%  slabinfo.btrfs_extent_buffer.active_slabs
    111585 ±  3%    +102.8%     226294 ±  2%  slabinfo.btrfs_extent_buffer.num_objs
      3281 ±  3%    +102.8%       6655 ±  2%  slabinfo.btrfs_extent_buffer.num_slabs
    131.50 ±  3%     +77.0%     232.75        slabinfo.btrfs_free_space_bitmap.active_objs
    132.50 ±  4%     +77.9%     235.75        slabinfo.btrfs_free_space_bitmap.num_objs
    819.00 ±  4%    +101.7%       1651 ± 67%  slabinfo.btrfs_inode.active_objs
    819.00 ±  4%    +103.0%       1662 ± 67%  slabinfo.btrfs_inode.num_objs
     28441 ±  5%     +44.4%      41073 ±  7%  slabinfo.fsnotify_mark_connector.active_objs
     29332 ±  5%     +41.8%      41596 ±  7%  slabinfo.fsnotify_mark_connector.num_objs
     64385           -12.2%      56511        slabinfo.inode_cache.active_objs
      1194           -11.6%       1055        slabinfo.inode_cache.active_slabs
     64512           -11.6%      57014        slabinfo.inode_cache.num_objs
      1194           -11.6%       1055        slabinfo.inode_cache.num_slabs
     22865 ±  2%     +30.2%      29769 ±  4%  slabinfo.khugepaged_mm_slot.active_objs
    656.00           +30.9%     858.50 ±  4%  slabinfo.khugepaged_mm_slot.active_slabs
     23632           +30.9%      30926 ±  4%  slabinfo.khugepaged_mm_slot.num_objs
    656.00           +30.9%     858.50 ±  4%  slabinfo.khugepaged_mm_slot.num_slabs
     11155 ±  3%     +10.6%      12334 ±  2%  slabinfo.kmalloc-256.active_objs
     11184 ±  2%     +10.8%      12391 ±  2%  slabinfo.kmalloc-256.num_objs
   7752593           +35.5%   10502274        slabinfo.pid_namespace.active_objs
    138677           +38.7%     192306        slabinfo.pid_namespace.active_slabs
   7765998           +38.7%   10769169        slabinfo.pid_namespace.num_objs
    138677           +38.7%     192306        slabinfo.pid_namespace.num_slabs
     13373 ±  7%     -29.6%       9418 ±  5%  slabinfo.proc_inode_cache.active_objs
     13386 ±  7%     -28.2%       9612 ±  5%  slabinfo.proc_inode_cache.num_objs
     17107 ± 14%     -48.9%       8740 ± 22%  softirqs.CPU0.RCU
     35135 ± 13%     +16.2%      40830 ±  3%  softirqs.CPU0.SCHED
     10209 ± 11%     -39.3%       6193 ±  4%  softirqs.CPU1.RCU
     30977 ±  4%      -9.1%      28165 ±  2%  softirqs.CPU1.SCHED
      8821 ± 15%     -34.7%       5761 ±  5%  softirqs.CPU16.RCU
      8864 ±  8%     -33.3%       5911 ±  5%  softirqs.CPU18.RCU
      9498 ±  6%     -35.4%       6133 ± 11%  softirqs.CPU2.RCU
     12013 ± 32%     -50.9%       5899 ± 10%  softirqs.CPU30.RCU
      9726 ± 10%     -44.0%       5451 ±  4%  softirqs.CPU33.RCU
      9365 ± 16%     -40.9%       5534 ±  2%  softirqs.CPU34.RCU
      9185 ±  6%     -38.7%       5632 ±  7%  softirqs.CPU35.RCU
      8926 ± 10%     -39.1%       5433 ±  2%  softirqs.CPU37.RCU
      9125 ± 12%     -38.4%       5618 ±  5%  softirqs.CPU38.RCU
      9461 ±  6%     -38.2%       5849 ±  4%  softirqs.CPU4.RCU
      9604 ±  8%     -43.4%       5436 ±  3%  softirqs.CPU40.RCU
      8948 ± 10%     -39.7%       5397 ±  5%  softirqs.CPU44.RCU
     10047 ± 19%     -42.0%       5831 ±  9%  softirqs.CPU46.RCU
     11057 ± 21%     -51.5%       5358 ±  3%  softirqs.CPU48.RCU
      9306 ±  9%     -37.8%       5786 ±  6%  softirqs.CPU49.RCU
      9337 ±  9%     -41.7%       5447 ±  2%  softirqs.CPU50.RCU
      9218 ± 12%     -37.6%       5754 ±  9%  softirqs.CPU51.RCU
      9052 ± 10%     -34.1%       5965 ±  7%  softirqs.CPU53.RCU
      9127 ± 12%     -39.2%       5547        softirqs.CPU55.RCU
      9277 ± 12%     -36.3%       5906 ±  8%  softirqs.CPU56.RCU
      8847 ± 11%     -36.7%       5600 ±  3%  softirqs.CPU57.RCU
      9230 ± 10%     -39.5%       5586        softirqs.CPU59.RCU
      9016 ± 11%     -38.6%       5540        softirqs.CPU68.RCU
      8921 ± 13%     -37.2%       5602        softirqs.CPU69.RCU
      9079 ±  9%     -38.1%       5616 ±  3%  softirqs.CPU71.RCU
      8505 ± 16%     -23.1%       6543 ± 24%  softirqs.CPU73.RCU
      9437 ± 11%     -36.1%       6034 ±  5%  softirqs.CPU78.RCU
      9335 ±  6%     -40.2%       5584 ±  4%  softirqs.CPU82.RCU
      9145 ±  9%     -40.6%       5430 ±  4%  softirqs.CPU86.RCU
     10616 ± 33%     -50.3%       5279 ±  6%  softirqs.CPU90.RCU
      8718 ±  9%     -39.3%       5289        softirqs.CPU92.RCU
    870647 ±  6%     -34.7%     568670        softirqs.RCU
      0.00         +1e+107%     104755 ± 52%  proc-vmstat.compact_isolated
      2665 ±  4%    +148.9%       6633 ±  4%  proc-vmstat.nr_active_anon
    777993           +52.6%    1187566 ±  4%  proc-vmstat.nr_active_file
  24741121           +56.3%   38658143        proc-vmstat.nr_dirtied
    101623          +148.4%     252426        proc-vmstat.nr_dirty
   1005108            -1.5%     990469        proc-vmstat.nr_dirty_background_threshold
   2012674            -1.5%    1983362        proc-vmstat.nr_dirty_threshold
   5870996           +38.5%    8131966        proc-vmstat.nr_file_pages
     47150 ±  8%     -49.3%      23927 ±  3%  proc-vmstat.nr_free_cma
   4807824           -50.0%    2403194        proc-vmstat.nr_free_pages
   4553032           +40.6%    6400005        proc-vmstat.nr_inactive_file
   4718389           +38.9%    6554444        proc-vmstat.nr_mapped
    280365            +1.5%     284615        proc-vmstat.nr_shmem
    406280           +33.2%     541003        proc-vmstat.nr_slab_unreclaimable
      1033 ±  7%    +141.4%       2494 ± 10%  proc-vmstat.nr_writeback
  24661846           +55.6%   38376773        proc-vmstat.nr_written
      2665 ±  4%    +148.9%       6634 ±  4%  proc-vmstat.nr_zone_active_anon
    777993           +52.7%    1187627 ±  4%  proc-vmstat.nr_zone_active_file
   4553041           +40.6%    6400717        proc-vmstat.nr_zone_inactive_file
    103397          +148.4%     256813        proc-vmstat.nr_zone_write_pending
    270836 ± 98%    +441.8%    1467432 ± 13%  proc-vmstat.numa_foreign
      1093 ± 14%     +81.2%       1982 ± 34%  proc-vmstat.numa_hint_faults
  10460798 ±  2%     +68.0%   17574326        proc-vmstat.numa_hit
  10429314 ±  2%     +68.2%   17542822        proc-vmstat.numa_local
    270836 ± 98%    +441.8%    1467432 ± 13%  proc-vmstat.numa_miss
    302320 ± 88%    +395.8%    1498936 ± 13%  proc-vmstat.numa_other
      3461 ±128%    +268.9%      12769 ± 54%  proc-vmstat.numa_pages_migrated
   3901168 ±  4%    +182.0%   11000071 ±  4%  proc-vmstat.numa_pte_updates
    739753           +94.6%    1439866 ± 10%  proc-vmstat.pgactivate
  11427932 ±  2%     +74.5%   19937206        proc-vmstat.pgalloc_normal
      0.00       +1.7e+107%     168606 ± 30%  proc-vmstat.pgdeactivate
  16656994           +90.3%   31700878        proc-vmstat.pgfault
   2289610          +337.1%   10008816        proc-vmstat.pgfree
   7741954           +97.1%   15260130        proc-vmstat.pgmajfault
      3461 ±128%   +1700.9%      62338 ± 50%  proc-vmstat.pgmigrate_success
  30967816           +97.2%   61077576        proc-vmstat.pgpgin
  98649626           +55.6%  1.535e+08        proc-vmstat.pgpgout
      0.00       +1.7e+105%       1733 ± 93%  proc-vmstat.pgrotated
 3.253e+09           +63.3%  5.313e+09        perf-stat.i.branch-instructions
  25279311 ±  6%     +77.2%   44783829        perf-stat.i.branch-misses
     24.20 ±  5%      +3.2       27.40 ±  2%  perf-stat.i.cache-miss-rate%
  33184638 ±  2%     +99.2%   66117679        perf-stat.i.cache-misses
 1.422e+08 ±  4%     +73.5%  2.467e+08        perf-stat.i.cache-references
    349316           +82.3%     636640        perf-stat.i.context-switches
      1.36 ±  2%      +8.6%       1.47        perf-stat.i.cpi
 2.198e+10           +75.5%  3.858e+10        perf-stat.i.cpu-cycles
    191.47 ±  6%     +47.4%     282.20 ± 11%  perf-stat.i.cpu-migrations
    671.47 ±  2%     -10.9%     598.32        perf-stat.i.cycles-between-cache-misses
      0.09 ± 13%      +0.1        0.21 ±  7%  perf-stat.i.dTLB-load-miss-rate%
   3352517 ± 12%    +319.5%   14063479 ±  6%  perf-stat.i.dTLB-load-misses
 4.185e+09           +62.9%  6.817e+09        perf-stat.i.dTLB-loads
      0.02 ± 15%      +0.0        0.03 ±  7%  perf-stat.i.dTLB-store-miss-rate%
    313356 ±  8%    +146.3%     771724 ±  7%  perf-stat.i.dTLB-store-misses
 1.973e+09           +63.3%  3.221e+09        perf-stat.i.dTLB-stores
     35.51            -3.6       31.93        perf-stat.i.iTLB-load-miss-rate%
   4430183 ±  2%     +57.7%    6988422        perf-stat.i.iTLB-load-misses
   8338809 ±  2%     +81.4%   15130748        perf-stat.i.iTLB-loads
 1.643e+10           +61.9%   2.66e+10        perf-stat.i.instructions
      0.77            -9.1%       0.70        perf-stat.i.ipc
     39438           +93.8%      76426        perf-stat.i.major-faults
      0.23           +75.5%       0.40        perf-stat.i.metric.GHz
      0.84 ±  2%     +48.9%       1.25 ±  5%  perf-stat.i.metric.K/sec
     99.74           +63.4%     162.96        perf-stat.i.metric.M/sec
   6324005 ±  2%    +126.2%   14307944 ±  3%  perf-stat.i.node-load-misses
   3804327 ±  6%    +131.4%    8804939 ±  2%  perf-stat.i.node-loads
     50.87 ± 17%     +10.6       61.46 ±  5%  perf-stat.i.node-store-miss-rate%
   1584487 ± 21%    +149.3%    3950397 ± 10%  perf-stat.i.node-store-misses
   1467161 ± 12%     +62.0%    2377521 ±  4%  perf-stat.i.node-stores
     42304           +87.5%      79330        perf-stat.i.page-faults
     23.37 ±  4%      +3.4       26.81 ±  2%  perf-stat.overall.cache-miss-rate%
      1.34            +8.4%       1.45        perf-stat.overall.cpi
    662.96 ±  3%     -12.0%     583.60        perf-stat.overall.cycles-between-cache-misses
      0.08 ± 13%      +0.1        0.21 ±  7%  perf-stat.overall.dTLB-load-miss-rate%
      0.02 ±  9%      +0.0        0.02 ±  8%  perf-stat.overall.dTLB-store-miss-rate%
     34.70            -3.1       31.59        perf-stat.overall.iTLB-load-miss-rate%
      3711            +2.6%       3808        perf-stat.overall.instructions-per-iTLB-miss
      0.75            -7.7%       0.69        perf-stat.overall.ipc
     51.49 ± 16%     +10.8       62.26 ±  4%  perf-stat.overall.node-store-miss-rate%
    431754           -17.9%     354427        perf-stat.overall.path-length
 3.237e+09           +63.3%  5.287e+09        perf-stat.ps.branch-instructions
  25156217 ±  6%     +77.2%   44564448        perf-stat.ps.branch-misses
  33019406 ±  2%     +99.3%   65798351        perf-stat.ps.cache-misses
 1.415e+08 ±  4%     +73.5%  2.455e+08        perf-stat.ps.cache-references
    347559           +82.3%     633468        perf-stat.ps.context-switches
 2.188e+10           +75.5%  3.839e+10        perf-stat.ps.cpu-cycles
    190.65 ±  6%     +47.4%     281.09 ± 11%  perf-stat.ps.cpu-migrations
   3335401 ± 12%    +319.6%   13995476 ±  6%  perf-stat.ps.dTLB-load-misses
 4.164e+09           +62.9%  6.784e+09        perf-stat.ps.dTLB-loads
    311886 ±  8%    +146.2%     767983 ±  7%  perf-stat.ps.dTLB-store-misses
 1.963e+09           +63.3%  3.206e+09        perf-stat.ps.dTLB-stores
   4408052 ±  2%     +57.8%    6953971        perf-stat.ps.iTLB-load-misses
   8296796 ±  2%     +81.5%   15055667        perf-stat.ps.iTLB-loads
 1.635e+10           +61.9%  2.648e+10        perf-stat.ps.instructions
     39250           +93.8%      76053        perf-stat.ps.major-faults
      2852            +1.4%       2891        perf-stat.ps.minor-faults
   6292615 ±  2%    +126.3%   14238522 ±  3%  perf-stat.ps.node-load-misses
   3785005 ±  6%    +131.5%    8762718 ±  2%  perf-stat.ps.node-loads
   1576310 ± 21%    +149.4%    3931150 ± 10%  perf-stat.ps.node-store-misses
   1460081 ± 12%     +62.1%    2366257 ±  4%  perf-stat.ps.node-stores
     42102           +87.5%      78944        perf-stat.ps.page-faults
 3.343e+12           +61.8%  5.409e+12        perf-stat.total.instructions
    224.00 ±128%     -99.1%       2.00 ±173%  interrupts.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
   1987222          +108.6%    4145761        interrupts.CAL:Function_call_interrupts
     16513 ± 11%    +106.5%      34094 ±  4%  interrupts.CPU0.CAL:Function_call_interrupts
    924.00 ± 38%     +76.7%       1632 ± 14%  interrupts.CPU0.NMI:Non-maskable_interrupts
    924.00 ± 38%     +76.7%       1632 ± 14%  interrupts.CPU0.PMI:Performance_monitoring_interrupts
      1409 ± 12%    +135.4%       3319        interrupts.CPU0.RES:Rescheduling_interrupts
     68.25 ±131%   +6322.3%       4383 ±  9%  interrupts.CPU0.TLB:TLB_shootdowns
     27965 ± 25%     +76.5%      49346 ±  7%  interrupts.CPU1.CAL:Function_call_interrupts
      2080 ± 17%     +87.0%       3890 ±  5%  interrupts.CPU1.RES:Rescheduling_interrupts
     45.25 ± 88%  +10118.8%       4624 ± 15%  interrupts.CPU1.TLB:TLB_shootdowns
     20736 ±  9%    +109.7%      43486 ± 17%  interrupts.CPU10.CAL:Function_call_interrupts
    492.00 ± 49%    +331.8%       2124 ± 25%  interrupts.CPU10.NMI:Non-maskable_interrupts
    492.00 ± 49%    +331.8%       2124 ± 25%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
      1734 ±  8%    +114.4%       3718 ±  9%  interrupts.CPU10.RES:Rescheduling_interrupts
    194.25 ±156%   +2074.0%       4223 ± 31%  interrupts.CPU10.TLB:TLB_shootdowns
     20993 ± 36%    +118.6%      45892 ±  8%  interrupts.CPU11.CAL:Function_call_interrupts
    819.50 ± 43%    +185.9%       2343 ± 41%  interrupts.CPU11.NMI:Non-maskable_interrupts
    819.50 ± 43%    +185.9%       2343 ± 41%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
      1868 ± 12%     +92.1%       3589 ±  9%  interrupts.CPU11.RES:Rescheduling_interrupts
    116.50 ± 71%   +3474.2%       4164 ± 18%  interrupts.CPU11.TLB:TLB_shootdowns
     21332 ± 43%    +100.9%      42847 ± 14%  interrupts.CPU12.CAL:Function_call_interrupts
      1839 ± 12%     +98.6%       3653 ±  6%  interrupts.CPU12.RES:Rescheduling_interrupts
     30.75 ± 65%  +12143.9%       3765 ± 29%  interrupts.CPU12.TLB:TLB_shootdowns
     25817 ± 20%     +65.7%      42791 ± 12%  interrupts.CPU13.CAL:Function_call_interrupts
      1279 ± 18%     +43.3%       1833 ± 14%  interrupts.CPU13.NMI:Non-maskable_interrupts
      1279 ± 18%     +43.3%       1833 ± 14%  interrupts.CPU13.PMI:Performance_monitoring_interrupts
      1954 ± 11%     +91.3%       3737 ±  4%  interrupts.CPU13.RES:Rescheduling_interrupts
     35.25 ± 90%  +11224.8%       3992 ± 25%  interrupts.CPU13.TLB:TLB_shootdowns
    662.25 ± 23%    +155.3%       1690 ± 30%  interrupts.CPU14.NMI:Non-maskable_interrupts
    662.25 ± 23%    +155.3%       1690 ± 30%  interrupts.CPU14.PMI:Performance_monitoring_interrupts
      1949 ± 20%     +87.8%       3661 ±  8%  interrupts.CPU14.RES:Rescheduling_interrupts
     34.25 ± 85%  +12775.9%       4410 ± 18%  interrupts.CPU14.TLB:TLB_shootdowns
     22469 ± 19%    +103.5%      45726 ± 20%  interrupts.CPU15.CAL:Function_call_interrupts
    811.75 ± 19%    +127.7%       1848 ± 18%  interrupts.CPU15.NMI:Non-maskable_interrupts
    811.75 ± 19%    +127.7%       1848 ± 18%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
      1836 ± 18%    +109.5%       3847 ±  9%  interrupts.CPU15.RES:Rescheduling_interrupts
     42.75 ± 35%  +11053.2%       4768 ± 15%  interrupts.CPU15.TLB:TLB_shootdowns
     22181 ± 20%    +101.5%      44693 ±  6%  interrupts.CPU16.CAL:Function_call_interrupts
    815.75 ± 21%     +97.1%       1607 ± 19%  interrupts.CPU16.NMI:Non-maskable_interrupts
    815.75 ± 21%     +97.1%       1607 ± 19%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
      1899 ± 16%    +100.3%       3804 ±  4%  interrupts.CPU16.RES:Rescheduling_interrupts
    128.50 ± 82%   +3905.6%       5147 ± 17%  interrupts.CPU16.TLB:TLB_shootdowns
    223.25 ±128%     -99.1%       2.00 ±173%  interrupts.CPU17.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
     17533 ± 11%    +131.7%      40632 ± 16%  interrupts.CPU17.CAL:Function_call_interrupts
      1915 ± 21%     +96.1%       3755 ±  8%  interrupts.CPU17.RES:Rescheduling_interrupts
     84.75 ± 99%   +5106.8%       4412 ± 23%  interrupts.CPU17.TLB:TLB_shootdowns
     25187 ± 20%     +75.1%      44109 ± 14%  interrupts.CPU18.CAL:Function_call_interrupts
    641.50 ± 24%    +150.4%       1606 ± 32%  interrupts.CPU18.NMI:Non-maskable_interrupts
    641.50 ± 24%    +150.4%       1606 ± 32%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
      2260 ± 15%     +71.0%       3865 ±  5%  interrupts.CPU18.RES:Rescheduling_interrupts
     36.75 ± 42%  +13916.3%       5151 ± 13%  interrupts.CPU18.TLB:TLB_shootdowns
     25614 ± 31%     +50.6%      38565 ± 12%  interrupts.CPU19.CAL:Function_call_interrupts
      2176 ± 18%     +81.3%       3946 ±  5%  interrupts.CPU19.RES:Rescheduling_interrupts
     88.25 ± 94%   +5495.5%       4938 ± 16%  interrupts.CPU19.TLB:TLB_shootdowns
     23555 ±  5%     +90.6%      44902 ±  8%  interrupts.CPU2.CAL:Function_call_interrupts
      2044 ± 16%     +81.3%       3707 ± 12%  interrupts.CPU2.RES:Rescheduling_interrupts
    116.75 ± 60%   +3869.6%       4634 ± 31%  interrupts.CPU2.TLB:TLB_shootdowns
     20220 ± 30%    +136.2%      47767 ±  7%  interrupts.CPU20.CAL:Function_call_interrupts
      1904 ± 20%    +115.9%       4112 ±  5%  interrupts.CPU20.RES:Rescheduling_interrupts
     43.25 ± 61%  +11229.5%       4900 ± 21%  interrupts.CPU20.TLB:TLB_shootdowns
     20789 ± 33%    +100.1%      41597 ± 16%  interrupts.CPU21.CAL:Function_call_interrupts
      1922 ± 14%     +96.3%       3773 ±  2%  interrupts.CPU21.RES:Rescheduling_interrupts
     50.75 ± 42%  +10357.1%       5307 ± 22%  interrupts.CPU21.TLB:TLB_shootdowns
     18506 ± 30%    +156.7%      47511 ±  8%  interrupts.CPU22.CAL:Function_call_interrupts
      1900 ± 19%    +101.3%       3824 ±  7%  interrupts.CPU22.RES:Rescheduling_interrupts
     33.25 ± 43%  +12700.0%       4256 ± 19%  interrupts.CPU22.TLB:TLB_shootdowns
      1878 ± 14%     +90.9%       3585 ±  7%  interrupts.CPU23.RES:Rescheduling_interrupts
     41.25 ± 23%  +10939.4%       4553 ±  9%  interrupts.CPU23.TLB:TLB_shootdowns
     17462 ± 21%     +98.4%      34636 ± 14%  interrupts.CPU24.CAL:Function_call_interrupts
    395.75 ± 46%    +290.3%       1544 ± 31%  interrupts.CPU24.NMI:Non-maskable_interrupts
    395.75 ± 46%    +290.3%       1544 ± 31%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
      1947 ±  8%     +92.8%       3755 ± 10%  interrupts.CPU24.RES:Rescheduling_interrupts
    129.25 ± 94%   +3738.9%       4961 ±  5%  interrupts.CPU24.TLB:TLB_shootdowns
     15613 ± 25%    +167.4%      41756 ±  9%  interrupts.CPU25.CAL:Function_call_interrupts
    556.25 ± 68%    +206.1%       1702 ± 36%  interrupts.CPU25.NMI:Non-maskable_interrupts
    556.25 ± 68%    +206.1%       1702 ± 36%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
      1892 ± 19%    +107.5%       3926 ± 12%  interrupts.CPU25.RES:Rescheduling_interrupts
     81.75 ± 38%   +5778.6%       4805 ± 14%  interrupts.CPU25.TLB:TLB_shootdowns
     17234 ± 14%    +146.7%      42512 ± 18%  interrupts.CPU26.CAL:Function_call_interrupts
    453.50 ± 61%    +307.2%       1846 ± 47%  interrupts.CPU26.NMI:Non-maskable_interrupts
    453.50 ± 61%    +307.2%       1846 ± 47%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
      1889 ± 16%    +109.7%       3961 ± 11%  interrupts.CPU26.RES:Rescheduling_interrupts
     73.00 ± 68%   +6922.9%       5126 ± 17%  interrupts.CPU26.TLB:TLB_shootdowns
     15457 ± 15%    +189.2%      44703 ±  7%  interrupts.CPU27.CAL:Function_call_interrupts
      1931 ± 24%     +97.2%       3808 ±  5%  interrupts.CPU27.RES:Rescheduling_interrupts
     92.75 ± 96%   +5126.4%       4847 ± 16%  interrupts.CPU27.TLB:TLB_shootdowns
     14786 ± 39%    +235.5%      49604 ± 22%  interrupts.CPU28.CAL:Function_call_interrupts
    470.75 ± 63%    +276.8%       1773 ± 30%  interrupts.CPU28.NMI:Non-maskable_interrupts
    470.75 ± 63%    +276.8%       1773 ± 30%  interrupts.CPU28.PMI:Performance_monitoring_interrupts
      1757 ± 11%    +135.5%       4137 ±  9%  interrupts.CPU28.RES:Rescheduling_interrupts
     57.75 ± 59%   +7532.5%       4407 ± 15%  interrupts.CPU28.TLB:TLB_shootdowns
     17470 ± 37%    +157.2%      44941 ± 14%  interrupts.CPU29.CAL:Function_call_interrupts
    453.75 ± 58%    +295.7%       1795 ± 16%  interrupts.CPU29.NMI:Non-maskable_interrupts
    453.75 ± 58%    +295.7%       1795 ± 16%  interrupts.CPU29.PMI:Performance_monitoring_interrupts
      1987 ± 15%     +97.8%       3930 ±  8%  interrupts.CPU29.RES:Rescheduling_interrupts
    118.00 ± 79%   +4325.6%       5222 ±  9%  interrupts.CPU29.TLB:TLB_shootdowns
     23374 ± 19%     +87.8%      43886 ± 14%  interrupts.CPU3.CAL:Function_call_interrupts
      1805 ± 24%    +116.6%       3910 ±  6%  interrupts.CPU3.RES:Rescheduling_interrupts
     42.75 ± 32%  +10864.3%       4687 ± 21%  interrupts.CPU3.TLB:TLB_shootdowns
     13925 ± 45%    +235.1%      46666 ±  7%  interrupts.CPU30.CAL:Function_call_interrupts
    410.75 ± 86%    +314.8%       1703 ± 21%  interrupts.CPU30.NMI:Non-maskable_interrupts
    410.75 ± 86%    +314.8%       1703 ± 21%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
      1672 ± 17%    +149.8%       4177 ±  3%  interrupts.CPU30.RES:Rescheduling_interrupts
     70.75 ± 68%   +5966.4%       4292 ± 10%  interrupts.CPU30.TLB:TLB_shootdowns
     14957 ± 27%    +209.0%      46215 ± 13%  interrupts.CPU31.CAL:Function_call_interrupts
    806.25 ± 80%    +177.8%       2240 ± 39%  interrupts.CPU31.NMI:Non-maskable_interrupts
    806.25 ± 80%    +177.8%       2240 ± 39%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
      1739 ± 15%    +130.0%       4000 ±  3%  interrupts.CPU31.RES:Rescheduling_interrupts
     57.00 ± 58%   +8641.7%       4982 ± 13%  interrupts.CPU31.TLB:TLB_shootdowns
     15217 ± 41%    +203.2%      46136 ± 12%  interrupts.CPU32.CAL:Function_call_interrupts
    556.75 ± 55%    +211.5%       1734 ± 43%  interrupts.CPU32.NMI:Non-maskable_interrupts
    556.75 ± 55%    +211.5%       1734 ± 43%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
      1868 ±  5%    +109.3%       3910 ±  4%  interrupts.CPU32.RES:Rescheduling_interrupts
    130.75 ± 85%   +3154.3%       4255 ± 11%  interrupts.CPU32.TLB:TLB_shootdowns
     19565 ± 20%    +119.2%      42891 ±  7%  interrupts.CPU33.CAL:Function_call_interrupts
    565.75 ± 47%    +172.0%       1538 ± 17%  interrupts.CPU33.NMI:Non-maskable_interrupts
    565.75 ± 47%    +172.0%       1538 ± 17%  interrupts.CPU33.PMI:Performance_monitoring_interrupts
      1992 ± 14%     +96.2%       3909 ±  2%  interrupts.CPU33.RES:Rescheduling_interrupts
    117.50 ± 30%   +4287.4%       5155 ± 14%  interrupts.CPU33.TLB:TLB_shootdowns
     11542 ±  8%    +310.9%      47426 ±  7%  interrupts.CPU34.CAL:Function_call_interrupts
    486.50 ± 28%    +162.2%       1275 ± 37%  interrupts.CPU34.NMI:Non-maskable_interrupts
    486.50 ± 28%    +162.2%       1275 ± 37%  interrupts.CPU34.PMI:Performance_monitoring_interrupts
      1760 ± 14%    +143.1%       4279        interrupts.CPU34.RES:Rescheduling_interrupts
     95.00 ± 57%   +5146.6%       4984 ± 30%  interrupts.CPU34.TLB:TLB_shootdowns
     14939 ± 23%    +218.3%      47547 ± 12%  interrupts.CPU35.CAL:Function_call_interrupts
    419.00 ± 29%    +262.7%       1519 ± 30%  interrupts.CPU35.NMI:Non-maskable_interrupts
    419.00 ± 29%    +262.7%       1519 ± 30%  interrupts.CPU35.PMI:Performance_monitoring_interrupts
      1761 ± 16%    +141.9%       4260 ±  5%  interrupts.CPU35.RES:Rescheduling_interrupts
     61.50 ± 57%   +7572.8%       4718 ± 11%  interrupts.CPU35.TLB:TLB_shootdowns
     18686 ± 26%     +96.7%      36760 ±  5%  interrupts.CPU36.CAL:Function_call_interrupts
    524.75 ± 42%    +249.1%       1831 ± 41%  interrupts.CPU36.NMI:Non-maskable_interrupts
    524.75 ± 42%    +249.1%       1831 ± 41%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
      1944 ±  8%     +85.7%       3611 ±  7%  interrupts.CPU36.RES:Rescheduling_interrupts
     73.50 ± 46%   +6816.3%       5083 ± 17%  interrupts.CPU36.TLB:TLB_shootdowns
     14749 ± 42%    +194.3%      43408 ± 10%  interrupts.CPU37.CAL:Function_call_interrupts
      1895 ± 16%    +108.3%       3948 ±  3%  interrupts.CPU37.RES:Rescheduling_interrupts
     60.25 ± 49%   +8867.6%       5403 ±  8%  interrupts.CPU37.TLB:TLB_shootdowns
     17832 ± 23%    +104.4%      36457 ±  9%  interrupts.CPU38.CAL:Function_call_interrupts
    433.00 ± 42%    +419.5%       2249 ± 31%  interrupts.CPU38.NMI:Non-maskable_interrupts
    433.00 ± 42%    +419.5%       2249 ± 31%  interrupts.CPU38.PMI:Performance_monitoring_interrupts
      1833 ± 21%    +107.5%       3804 ±  3%  interrupts.CPU38.RES:Rescheduling_interrupts
    148.75 ± 95%   +3305.7%       5066 ± 25%  interrupts.CPU38.TLB:TLB_shootdowns
     15253 ± 17%    +185.2%      43502 ±  6%  interrupts.CPU39.CAL:Function_call_interrupts
    417.00 ± 74%    +449.2%       2290 ± 13%  interrupts.CPU39.NMI:Non-maskable_interrupts
    417.00 ± 74%    +449.2%       2290 ± 13%  interrupts.CPU39.PMI:Performance_monitoring_interrupts
      1912 ± 12%    +107.5%       3968 ±  3%  interrupts.CPU39.RES:Rescheduling_interrupts
    206.75 ±120%   +2627.7%       5639 ± 15%  interrupts.CPU39.TLB:TLB_shootdowns
      2160 ± 13%     +67.8%       3625 ±  8%  interrupts.CPU4.RES:Rescheduling_interrupts
     67.75 ±112%   +6100.0%       4200 ± 15%  interrupts.CPU4.TLB:TLB_shootdowns
     21074 ± 32%     +94.3%      40947 ±  5%  interrupts.CPU40.CAL:Function_call_interrupts
    743.50 ± 58%    +160.8%       1938 ± 18%  interrupts.CPU40.NMI:Non-maskable_interrupts
    743.50 ± 58%    +160.8%       1938 ± 18%  interrupts.CPU40.PMI:Performance_monitoring_interrupts
      1885 ± 10%    +111.3%       3982 ±  6%  interrupts.CPU40.RES:Rescheduling_interrupts
     68.50 ± 39%   +7953.3%       5516 ± 21%  interrupts.CPU40.TLB:TLB_shootdowns
     17695 ± 30%    +137.6%      42036 ±  8%  interrupts.CPU41.CAL:Function_call_interrupts
    623.00 ± 85%    +225.7%       2029 ± 21%  interrupts.CPU41.NMI:Non-maskable_interrupts
    623.00 ± 85%    +225.7%       2029 ± 21%  interrupts.CPU41.PMI:Performance_monitoring_interrupts
      1957 ±  6%     +98.8%       3890 ±  4%  interrupts.CPU41.RES:Rescheduling_interrupts
    117.00 ± 66%   +4194.4%       5024 ± 17%  interrupts.CPU41.TLB:TLB_shootdowns
     13894 ± 47%    +187.5%      39949 ± 20%  interrupts.CPU42.CAL:Function_call_interrupts
    475.25 ± 32%    +266.3%       1740 ± 17%  interrupts.CPU42.NMI:Non-maskable_interrupts
    475.25 ± 32%    +266.3%       1740 ± 17%  interrupts.CPU42.PMI:Performance_monitoring_interrupts
      1907 ± 12%    +104.1%       3892 ±  5%  interrupts.CPU42.RES:Rescheduling_interrupts
     71.50 ± 59%   +6459.1%       4689 ± 11%  interrupts.CPU42.TLB:TLB_shootdowns
     16821 ± 12%    +145.0%      41217 ± 18%  interrupts.CPU43.CAL:Function_call_interrupts
    480.25 ± 37%    +278.0%       1815 ± 20%  interrupts.CPU43.NMI:Non-maskable_interrupts
    480.25 ± 37%    +278.0%       1815 ± 20%  interrupts.CPU43.PMI:Performance_monitoring_interrupts
      2071 ±  8%     +80.1%       3730 ± 10%  interrupts.CPU43.RES:Rescheduling_interrupts
     57.75 ± 46%   +8599.1%       5023 ± 13%  interrupts.CPU43.TLB:TLB_shootdowns
     14135 ± 33%    +173.1%      38607 ±  7%  interrupts.CPU44.CAL:Function_call_interrupts
    423.50 ± 40%    +309.2%       1733 ± 19%  interrupts.CPU44.NMI:Non-maskable_interrupts
    423.50 ± 40%    +309.2%       1733 ± 19%  interrupts.CPU44.PMI:Performance_monitoring_interrupts
      1783 ± 24%    +112.7%       3794 ±  3%  interrupts.CPU44.RES:Rescheduling_interrupts
    216.25 ±117%   +1935.4%       4401 ± 10%  interrupts.CPU44.TLB:TLB_shootdowns
     17078 ± 23%    +166.5%      45507 ±  9%  interrupts.CPU45.CAL:Function_call_interrupts
    413.50 ± 48%    +371.8%       1951 ± 30%  interrupts.CPU45.NMI:Non-maskable_interrupts
    413.50 ± 48%    +371.8%       1951 ± 30%  interrupts.CPU45.PMI:Performance_monitoring_interrupts
      1888 ± 16%    +104.3%       3858 ±  4%  interrupts.CPU45.RES:Rescheduling_interrupts
    158.25 ± 73%   +2963.0%       4847 ± 17%  interrupts.CPU45.TLB:TLB_shootdowns
     17386 ± 31%    +163.4%      45796 ±  6%  interrupts.CPU46.CAL:Function_call_interrupts
    376.75 ± 18%    +481.5%       2190 ± 37%  interrupts.CPU46.NMI:Non-maskable_interrupts
    376.75 ± 18%    +481.5%       2190 ± 37%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
      1834 ± 13%    +114.7%       3938 ±  7%  interrupts.CPU46.RES:Rescheduling_interrupts
    208.75 ± 68%   +2419.4%       5259 ± 15%  interrupts.CPU46.TLB:TLB_shootdowns
     14566 ± 10%    +171.4%      39539 ±  7%  interrupts.CPU47.CAL:Function_call_interrupts
    377.75 ± 19%    +435.8%       2024 ± 13%  interrupts.CPU47.NMI:Non-maskable_interrupts
    377.75 ± 19%    +435.8%       2024 ± 13%  interrupts.CPU47.PMI:Performance_monitoring_interrupts
      1730 ± 12%    +115.8%       3733 ±  4%  interrupts.CPU47.RES:Rescheduling_interrupts
    155.75 ± 71%   +2718.1%       4389 ± 21%  interrupts.CPU47.TLB:TLB_shootdowns
     26352 ± 26%     +55.4%      40946 ± 13%  interrupts.CPU48.CAL:Function_call_interrupts
      2039 ± 16%     +81.9%       3708 ±  3%  interrupts.CPU48.RES:Rescheduling_interrupts
    118.75 ± 68%   +3324.2%       4066 ±  8%  interrupts.CPU48.TLB:TLB_shootdowns
      2122 ± 17%     +78.0%       3777 ±  9%  interrupts.CPU49.RES:Rescheduling_interrupts
     41.75 ± 56%  +11697.0%       4925 ± 21%  interrupts.CPU49.TLB:TLB_shootdowns
     21752 ± 16%    +100.3%      43572 ± 10%  interrupts.CPU5.CAL:Function_call_interrupts
      1864 ± 15%     +89.1%       3525 ±  4%  interrupts.CPU5.RES:Rescheduling_interrupts
     25.25 ± 18%  +13998.0%       3559 ± 14%  interrupts.CPU5.TLB:TLB_shootdowns
     31882 ± 14%     +33.3%      42490 ±  7%  interrupts.CPU50.CAL:Function_call_interrupts
      2308 ± 13%     +59.3%       3677 ±  4%  interrupts.CPU50.RES:Rescheduling_interrupts
     55.25 ± 38%   +7829.4%       4381 ± 22%  interrupts.CPU50.TLB:TLB_shootdowns
      2232 ±  8%     +71.9%       3835 ±  8%  interrupts.CPU51.RES:Rescheduling_interrupts
     92.00 ± 74%   +5222.3%       4896 ± 19%  interrupts.CPU51.TLB:TLB_shootdowns
     22536 ± 12%     +95.5%      44060 ± 29%  interrupts.CPU52.CAL:Function_call_interrupts
      2050 ± 10%     +78.7%       3663 ± 11%  interrupts.CPU52.RES:Rescheduling_interrupts
     47.25 ± 29%   +7831.2%       3747 ± 12%  interrupts.CPU52.TLB:TLB_shootdowns
     22210 ± 16%    +102.1%      44877 ± 17%  interrupts.CPU53.CAL:Function_call_interrupts
      1963 ± 18%     +95.3%       3835 ±  7%  interrupts.CPU53.RES:Rescheduling_interrupts
     99.50 ±108%   +4031.4%       4110 ± 15%  interrupts.CPU53.TLB:TLB_shootdowns
     23124 ± 36%     +67.2%      38669 ± 11%  interrupts.CPU54.CAL:Function_call_interrupts
      1952 ±  4%     +91.7%       3742 ±  7%  interrupts.CPU54.RES:Rescheduling_interrupts
     29.00 ± 49%  +15513.8%       4528 ± 15%  interrupts.CPU54.TLB:TLB_shootdowns
     25684 ± 52%     +91.5%      49182 ± 10%  interrupts.CPU55.CAL:Function_call_interrupts
      1756 ± 20%    +117.7%       3822 ±  4%  interrupts.CPU55.RES:Rescheduling_interrupts
     89.00 ± 98%   +5349.7%       4850 ± 10%  interrupts.CPU55.TLB:TLB_shootdowns
     29758 ± 29%     +43.5%      42696 ± 10%  interrupts.CPU56.CAL:Function_call_interrupts
    926.50 ± 25%    +120.2%       2040 ± 51%  interrupts.CPU56.NMI:Non-maskable_interrupts
    926.50 ± 25%    +120.2%       2040 ± 51%  interrupts.CPU56.PMI:Performance_monitoring_interrupts
      2183 ± 13%     +73.4%       3785 ±  5%  interrupts.CPU56.RES:Rescheduling_interrupts
     28.50 ± 91%  +17108.8%       4904 ±  9%  interrupts.CPU56.TLB:TLB_shootdowns
     24818 ± 33%     +64.8%      40905 ± 13%  interrupts.CPU57.CAL:Function_call_interrupts
      2110 ± 11%     +78.6%       3768 ±  4%  interrupts.CPU57.RES:Rescheduling_interrupts
     70.00 ± 51%   +6095.4%       4336 ± 13%  interrupts.CPU57.TLB:TLB_shootdowns
     20692 ± 25%     +83.9%      38045 ± 17%  interrupts.CPU58.CAL:Function_call_interrupts
    446.25 ± 25%    +271.0%       1655 ± 20%  interrupts.CPU58.NMI:Non-maskable_interrupts
    446.25 ± 25%    +271.0%       1655 ± 20%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
      1955 ± 16%     +95.8%       3827 ±  7%  interrupts.CPU58.RES:Rescheduling_interrupts
     70.25 ± 88%   +5523.1%       3950 ± 31%  interrupts.CPU58.TLB:TLB_shootdowns
     29763 ± 23%     +54.4%      45970 ± 15%  interrupts.CPU59.CAL:Function_call_interrupts
      2182 ± 10%     +78.7%       3898 ±  3%  interrupts.CPU59.RES:Rescheduling_interrupts
     39.00 ± 52%  +11603.2%       4564 ± 18%  interrupts.CPU59.TLB:TLB_shootdowns
     20768 ± 40%    +145.2%      50925 ±  5%  interrupts.CPU6.CAL:Function_call_interrupts
      1868 ± 26%    +104.9%       3828 ±  5%  interrupts.CPU6.RES:Rescheduling_interrupts
     42.00 ± 51%   +9866.7%       4186 ± 24%  interrupts.CPU6.TLB:TLB_shootdowns
     29146 ± 25%     +28.9%      37570 ± 10%  interrupts.CPU60.CAL:Function_call_interrupts
      2347 ± 18%     +60.8%       3775 ±  2%  interrupts.CPU60.RES:Rescheduling_interrupts
     71.75 ± 69%   +6985.0%       5083 ± 24%  interrupts.CPU60.TLB:TLB_shootdowns
     23329 ± 35%     +69.2%      39484 ± 12%  interrupts.CPU61.CAL:Function_call_interrupts
      1983 ± 11%     +78.4%       3538 ±  2%  interrupts.CPU61.RES:Rescheduling_interrupts
     81.75 ±105%   +5690.8%       4734 ± 19%  interrupts.CPU61.TLB:TLB_shootdowns
     27707 ± 11%     +54.4%      42785 ± 16%  interrupts.CPU62.CAL:Function_call_interrupts
    543.00 ± 18%    +124.8%       1220 ± 26%  interrupts.CPU62.NMI:Non-maskable_interrupts
    543.00 ± 18%    +124.8%       1220 ± 26%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
      2123 ± 19%     +81.8%       3860 ± 10%  interrupts.CPU62.RES:Rescheduling_interrupts
     40.75 ± 46%  +11881.6%       4882 ± 12%  interrupts.CPU62.TLB:TLB_shootdowns
     26074 ± 19%     +71.5%      44722 ± 15%  interrupts.CPU63.CAL:Function_call_interrupts
    652.50 ± 22%    +112.1%       1384 ± 14%  interrupts.CPU63.NMI:Non-maskable_interrupts
    652.50 ± 22%    +112.1%       1384 ± 14%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
      1955 ± 18%     +86.8%       3652 ±  2%  interrupts.CPU63.RES:Rescheduling_interrupts
    114.50 ± 82%   +3946.1%       4632 ± 10%  interrupts.CPU63.TLB:TLB_shootdowns
     29372 ± 13%     +36.3%      40033 ±  6%  interrupts.CPU64.CAL:Function_call_interrupts
      2138 ± 13%     +77.0%       3786 ±  4%  interrupts.CPU64.RES:Rescheduling_interrupts
     79.25 ± 67%   +5226.2%       4221 ±  8%  interrupts.CPU64.TLB:TLB_shootdowns
      2123 ± 15%     +86.9%       3968 ±  9%  interrupts.CPU65.RES:Rescheduling_interrupts
     97.00 ± 91%   +4507.7%       4469 ± 13%  interrupts.CPU65.TLB:TLB_shootdowns
    521.25 ± 24%    +182.6%       1473 ± 32%  interrupts.CPU66.NMI:Non-maskable_interrupts
    521.25 ± 24%    +182.6%       1473 ± 32%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
      2173 ± 11%     +79.9%       3908 ±  8%  interrupts.CPU66.RES:Rescheduling_interrupts
     42.75 ± 41%   +9745.6%       4209 ±  5%  interrupts.CPU66.TLB:TLB_shootdowns
     30354 ± 20%     +42.5%      43240 ± 16%  interrupts.CPU67.CAL:Function_call_interrupts
    763.25 ± 30%    +154.0%       1938 ± 46%  interrupts.CPU67.NMI:Non-maskable_interrupts
    763.25 ± 30%    +154.0%       1938 ± 46%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
      2112 ± 13%     +88.0%       3970 ±  8%  interrupts.CPU67.RES:Rescheduling_interrupts
     46.00 ± 63%  +11481.5%       5327 ± 13%  interrupts.CPU67.TLB:TLB_shootdowns
     30617 ±  9%     +41.8%      43424 ±  3%  interrupts.CPU68.CAL:Function_call_interrupts
    759.25 ± 31%    +101.4%       1529 ± 19%  interrupts.CPU68.NMI:Non-maskable_interrupts
    759.25 ± 31%    +101.4%       1529 ± 19%  interrupts.CPU68.PMI:Performance_monitoring_interrupts
      2214 ± 16%     +83.8%       4070 ±  4%  interrupts.CPU68.RES:Rescheduling_interrupts
     38.25 ± 56%  +13891.5%       5351 ± 27%  interrupts.CPU68.TLB:TLB_shootdowns
     25386 ±  6%     +74.9%      44395 ± 14%  interrupts.CPU69.CAL:Function_call_interrupts
    768.75 ± 28%    +106.5%       1587 ± 14%  interrupts.CPU69.NMI:Non-maskable_interrupts
    768.75 ± 28%    +106.5%       1587 ± 14%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
      2091 ± 13%     +80.8%       3781 ± 11%  interrupts.CPU69.RES:Rescheduling_interrupts
    132.25 ±105%   +3627.0%       4929 ± 18%  interrupts.CPU69.TLB:TLB_shootdowns
     23726 ± 43%     +75.2%      41579 ±  8%  interrupts.CPU7.CAL:Function_call_interrupts
      1808 ± 16%    +101.8%       3649 ±  2%  interrupts.CPU7.RES:Rescheduling_interrupts
     82.75 ±107%   +5626.3%       4738 ±  9%  interrupts.CPU7.TLB:TLB_shootdowns
     23548 ± 28%     +92.1%      45244 ± 18%  interrupts.CPU70.CAL:Function_call_interrupts
      2046 ± 17%     +86.3%       3813 ± 10%  interrupts.CPU70.RES:Rescheduling_interrupts
     56.75 ± 54%   +8444.5%       4849 ± 17%  interrupts.CPU70.TLB:TLB_shootdowns
     27262 ± 22%     +64.0%      44724 ±  5%  interrupts.CPU71.CAL:Function_call_interrupts
    792.75 ± 18%     +88.4%       1493 ± 30%  interrupts.CPU71.NMI:Non-maskable_interrupts
    792.75 ± 18%     +88.4%       1493 ± 30%  interrupts.CPU71.PMI:Performance_monitoring_interrupts
      2124 ± 15%     +74.7%       3710 ±  4%  interrupts.CPU71.RES:Rescheduling_interrupts
    111.50 ±105%   +3881.4%       4439 ± 12%  interrupts.CPU71.TLB:TLB_shootdowns
     13804 ± 22%    +199.7%      41372 ± 13%  interrupts.CPU72.CAL:Function_call_interrupts
    428.50 ± 49%    +347.2%       1916 ± 32%  interrupts.CPU72.NMI:Non-maskable_interrupts
    428.50 ± 49%    +347.2%       1916 ± 32%  interrupts.CPU72.PMI:Performance_monitoring_interrupts
      1888 ± 19%    +112.5%       4012 ±  3%  interrupts.CPU72.RES:Rescheduling_interrupts
     88.75 ± 36%   +5734.1%       5177 ± 15%  interrupts.CPU72.TLB:TLB_shootdowns
     19432 ± 14%    +131.6%      45001 ±  6%  interrupts.CPU73.CAL:Function_call_interrupts
      2071 ± 10%     +92.4%       3985 ±  6%  interrupts.CPU73.RES:Rescheduling_interrupts
     76.25 ± 46%   +5307.2%       4123 ± 15%  interrupts.CPU73.TLB:TLB_shootdowns
     15769 ± 33%    +191.9%      46034 ± 11%  interrupts.CPU74.CAL:Function_call_interrupts
    408.25 ± 43%    +447.9%       2237 ± 56%  interrupts.CPU74.NMI:Non-maskable_interrupts
    408.25 ± 43%    +447.9%       2237 ± 56%  interrupts.CPU74.PMI:Performance_monitoring_interrupts
      1923 ±  6%    +105.3%       3949 ±  6%  interrupts.CPU74.RES:Rescheduling_interrupts
    178.50 ± 60%   +2479.0%       4603 ± 14%  interrupts.CPU74.TLB:TLB_shootdowns
     11767 ±  5%    +327.2%      50270 ± 13%  interrupts.CPU75.CAL:Function_call_interrupts
    991.25 ± 58%    +139.3%       2371 ± 31%  interrupts.CPU75.NMI:Non-maskable_interrupts
    991.25 ± 58%    +139.3%       2371 ± 31%  interrupts.CPU75.PMI:Performance_monitoring_interrupts
      1790 ± 13%    +133.6%       4183 ±  4%  interrupts.CPU75.RES:Rescheduling_interrupts
    100.75 ± 38%   +3620.8%       3748 ± 19%  interrupts.CPU75.TLB:TLB_shootdowns
     17988 ± 13%    +160.3%      46818 ± 12%  interrupts.CPU76.CAL:Function_call_interrupts
    347.00 ± 47%    +538.2%       2214 ± 57%  interrupts.CPU76.NMI:Non-maskable_interrupts
    347.00 ± 47%    +538.2%       2214 ± 57%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
      2126 ± 12%     +91.2%       4065 ±  3%  interrupts.CPU76.RES:Rescheduling_interrupts
     78.25 ± 48%   +6085.3%       4840 ±  7%  interrupts.CPU76.TLB:TLB_shootdowns
     15530 ± 66%    +143.9%      37875 ± 19%  interrupts.CPU77.CAL:Function_call_interrupts
    433.00 ± 61%    +297.1%       1719 ± 13%  interrupts.CPU77.NMI:Non-maskable_interrupts
    433.00 ± 61%    +297.1%       1719 ± 13%  interrupts.CPU77.PMI:Performance_monitoring_interrupts
      1821 ± 11%    +106.0%       3752 ±  3%  interrupts.CPU77.RES:Rescheduling_interrupts
     91.50 ± 58%   +5185.2%       4836 ± 14%  interrupts.CPU77.TLB:TLB_shootdowns
     16747 ± 38%    +165.2%      44408 ± 16%  interrupts.CPU78.CAL:Function_call_interrupts
    424.75 ± 57%    +365.4%       1976 ± 29%  interrupts.CPU78.NMI:Non-maskable_interrupts
    424.75 ± 57%    +365.4%       1976 ± 29%  interrupts.CPU78.PMI:Performance_monitoring_interrupts
      1787 ± 31%    +119.1%       3914 ± 11%  interrupts.CPU78.RES:Rescheduling_interrupts
     79.50 ± 61%   +5574.8%       4511 ± 12%  interrupts.CPU78.TLB:TLB_shootdowns
     17039 ± 27%    +193.8%      50061 ± 14%  interrupts.CPU79.CAL:Function_call_interrupts
    460.50 ± 50%    +437.0%       2473 ± 38%  interrupts.CPU79.NMI:Non-maskable_interrupts
    460.50 ± 50%    +437.0%       2473 ± 38%  interrupts.CPU79.PMI:Performance_monitoring_interrupts
      1947 ± 13%    +110.7%       4103 ±  2%  interrupts.CPU79.RES:Rescheduling_interrupts
     78.25 ± 51%   +5255.0%       4190 ± 11%  interrupts.CPU79.TLB:TLB_shootdowns
     20557 ± 35%    +112.9%      43776 ± 18%  interrupts.CPU8.CAL:Function_call_interrupts
      1020 ± 41%     +89.2%       1931 ± 24%  interrupts.CPU8.NMI:Non-maskable_interrupts
      1020 ± 41%     +89.2%       1931 ± 24%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
      1808 ±  8%    +108.5%       3770 ±  7%  interrupts.CPU8.RES:Rescheduling_interrupts
     37.50 ± 46%  +10758.0%       4071 ± 18%  interrupts.CPU8.TLB:TLB_shootdowns
     13635 ± 29%    +228.8%      44834 ± 19%  interrupts.CPU80.CAL:Function_call_interrupts
    405.75 ± 68%    +378.7%       1942 ± 44%  interrupts.CPU80.NMI:Non-maskable_interrupts
    405.75 ± 68%    +378.7%       1942 ± 44%  interrupts.CPU80.PMI:Performance_monitoring_interrupts
      1962 ±  8%    +103.7%       3996 ± 15%  interrupts.CPU80.RES:Rescheduling_interrupts
    118.25 ± 67%   +2850.7%       3489 ±  7%  interrupts.CPU80.TLB:TLB_shootdowns
     16281 ± 38%    +151.9%      41019 ±  8%  interrupts.CPU81.CAL:Function_call_interrupts
    449.25 ± 27%    +332.6%       1943 ± 32%  interrupts.CPU81.NMI:Non-maskable_interrupts
    449.25 ± 27%    +332.6%       1943 ± 32%  interrupts.CPU81.PMI:Performance_monitoring_interrupts
      2042 ± 11%     +99.7%       4079 ±  6%  interrupts.CPU81.RES:Rescheduling_interrupts
    101.50 ± 65%   +4196.8%       4361 ± 15%  interrupts.CPU81.TLB:TLB_shootdowns
     17864 ± 19%    +173.4%      48840 ± 10%  interrupts.CPU82.CAL:Function_call_interrupts
    423.50 ± 33%    +333.5%       1835 ± 13%  interrupts.CPU82.NMI:Non-maskable_interrupts
    423.50 ± 33%    +333.5%       1835 ± 13%  interrupts.CPU82.PMI:Performance_monitoring_interrupts
      2120 ± 16%     +92.3%       4075 ±  4%  interrupts.CPU82.RES:Rescheduling_interrupts
    263.00 ± 56%   +1820.0%       5049 ±  4%  interrupts.CPU82.TLB:TLB_shootdowns
     16834 ± 38%    +178.5%      46889 ±  9%  interrupts.CPU83.CAL:Function_call_interrupts
    365.75 ± 21%    +388.0%       1785 ± 24%  interrupts.CPU83.NMI:Non-maskable_interrupts
    365.75 ± 21%    +388.0%       1785 ± 24%  interrupts.CPU83.PMI:Performance_monitoring_interrupts
      1961 ±  5%    +112.0%       4159 ±  7%  interrupts.CPU83.RES:Rescheduling_interrupts
     75.75 ± 60%   +6846.2%       5261 ± 14%  interrupts.CPU83.TLB:TLB_shootdowns
     14600 ± 34%    +195.6%      43162 ± 10%  interrupts.CPU84.CAL:Function_call_interrupts
    511.25 ± 34%    +288.6%       1986 ± 23%  interrupts.CPU84.NMI:Non-maskable_interrupts
    511.25 ± 34%    +288.6%       1986 ± 23%  interrupts.CPU84.PMI:Performance_monitoring_interrupts
      1865 ± 14%    +100.4%       3738 ±  7%  interrupts.CPU84.RES:Rescheduling_interrupts
    146.50 ± 86%   +2955.3%       4476 ± 22%  interrupts.CPU84.TLB:TLB_shootdowns
     15630 ± 22%    +212.2%      48792 ± 13%  interrupts.CPU85.CAL:Function_call_interrupts
    728.25 ± 82%    +183.7%       2065 ± 16%  interrupts.CPU85.NMI:Non-maskable_interrupts
    728.25 ± 82%    +183.7%       2065 ± 16%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
      1953 ±  9%    +104.7%       3999 ±  2%  interrupts.CPU85.RES:Rescheduling_interrupts
    109.50 ± 69%   +4290.9%       4808 ± 29%  interrupts.CPU85.TLB:TLB_shootdowns
     17376 ± 16%    +145.0%      42572 ± 17%  interrupts.CPU86.CAL:Function_call_interrupts
    655.25 ± 55%    +208.7%       2022 ± 17%  interrupts.CPU86.NMI:Non-maskable_interrupts
    655.25 ± 55%    +208.7%       2022 ± 17%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
      2003 ± 17%    +103.1%       4068 ± 12%  interrupts.CPU86.RES:Rescheduling_interrupts
     79.25 ± 56%   +6364.0%       5122 ± 17%  interrupts.CPU86.TLB:TLB_shootdowns
     14377 ± 15%    +226.8%      46991 ± 17%  interrupts.CPU87.CAL:Function_call_interrupts
    387.50 ± 36%    +372.5%       1830 ± 22%  interrupts.CPU87.NMI:Non-maskable_interrupts
    387.50 ± 36%    +372.5%       1830 ± 22%  interrupts.CPU87.PMI:Performance_monitoring_interrupts
      2033 ± 13%     +98.8%       4040        interrupts.CPU87.RES:Rescheduling_interrupts
    126.75 ± 59%   +2960.2%       3878 ±  7%  interrupts.CPU87.TLB:TLB_shootdowns
     17828 ± 16%    +160.9%      46509 ±  7%  interrupts.CPU88.CAL:Function_call_interrupts
      1955 ± 16%    +102.5%       3960 ±  4%  interrupts.CPU88.RES:Rescheduling_interrupts
     78.00 ± 50%   +5155.1%       4099 ±  8%  interrupts.CPU88.TLB:TLB_shootdowns
     20794 ± 31%    +105.5%      42722 ± 15%  interrupts.CPU89.CAL:Function_call_interrupts
      2087 ± 10%     +84.6%       3854 ±  5%  interrupts.CPU89.RES:Rescheduling_interrupts
    105.00 ± 62%   +4257.1%       4575 ± 13%  interrupts.CPU89.TLB:TLB_shootdowns
     23600 ± 40%     +85.9%      43880 ± 11%  interrupts.CPU9.CAL:Function_call_interrupts
      1008 ± 37%     +78.9%       1803 ± 20%  interrupts.CPU9.NMI:Non-maskable_interrupts
      1008 ± 37%     +78.9%       1803 ± 20%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
      1787 ± 23%     +94.2%       3470 ±  6%  interrupts.CPU9.RES:Rescheduling_interrupts
     45.00 ± 49%   +8741.1%       3978 ± 12%  interrupts.CPU9.TLB:TLB_shootdowns
     22774 ± 22%     +73.2%      39450 ± 21%  interrupts.CPU90.CAL:Function_call_interrupts
    515.75 ± 79%    +208.4%       1590 ± 26%  interrupts.CPU90.NMI:Non-maskable_interrupts
    515.75 ± 79%    +208.4%       1590 ± 26%  interrupts.CPU90.PMI:Performance_monitoring_interrupts
      2237 ± 17%     +68.3%       3765 ± 10%  interrupts.CPU90.RES:Rescheduling_interrupts
     90.25 ± 30%   +4629.6%       4268 ± 14%  interrupts.CPU90.TLB:TLB_shootdowns
     18875 ± 46%    +102.9%      38298 ± 18%  interrupts.CPU91.CAL:Function_call_interrupts
    491.50 ± 83%    +209.3%       1520 ± 13%  interrupts.CPU91.NMI:Non-maskable_interrupts
    491.50 ± 83%    +209.3%       1520 ± 13%  interrupts.CPU91.PMI:Performance_monitoring_interrupts
      2005 ±  9%     +86.5%       3741 ±  9%  interrupts.CPU91.RES:Rescheduling_interrupts
     80.75 ± 47%   +5055.1%       4162 ± 23%  interrupts.CPU91.TLB:TLB_shootdowns
     17398 ± 30%    +131.3%      40240 ± 13%  interrupts.CPU92.CAL:Function_call_interrupts
    383.50 ± 20%    +225.3%       1247 ± 24%  interrupts.CPU92.NMI:Non-maskable_interrupts
    383.50 ± 20%    +225.3%       1247 ± 24%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
      1874 ±  7%    +102.1%       3787 ±  3%  interrupts.CPU92.RES:Rescheduling_interrupts
     95.00 ± 59%   +5127.6%       4966 ± 18%  interrupts.CPU92.TLB:TLB_shootdowns
     16525 ± 25%    +201.5%      49821 ± 16%  interrupts.CPU93.CAL:Function_call_interrupts
    370.50 ± 24%    +277.9%       1400 ± 25%  interrupts.CPU93.NMI:Non-maskable_interrupts
    370.50 ± 24%    +277.9%       1400 ± 25%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
      1960 ±  9%    +115.3%       4220 ±  6%  interrupts.CPU93.RES:Rescheduling_interrupts
    153.50 ± 50%   +2646.1%       4215 ± 22%  interrupts.CPU93.TLB:TLB_shootdowns
     15670 ± 32%    +165.7%      41633 ± 13%  interrupts.CPU94.CAL:Function_call_interrupts
    294.25 ± 25%    +479.0%       1703 ± 31%  interrupts.CPU94.NMI:Non-maskable_interrupts
    294.25 ± 25%    +479.0%       1703 ± 31%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
      1878 ±  8%    +112.3%       3988 ±  8%  interrupts.CPU94.RES:Rescheduling_interrupts
     84.00 ± 48%   +5955.1%       5086 ± 13%  interrupts.CPU94.TLB:TLB_shootdowns
     16915 ± 19%    +115.5%      36451 ± 14%  interrupts.CPU95.CAL:Function_call_interrupts
    287.25 ± 14%    +441.6%       1555 ± 12%  interrupts.CPU95.NMI:Non-maskable_interrupts
    287.25 ± 14%    +441.6%       1555 ± 12%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
      1861 ± 14%     +87.9%       3497 ±  6%  interrupts.CPU95.RES:Rescheduling_interrupts
    130.00 ± 48%   +3455.6%       4622 ± 13%  interrupts.CPU95.TLB:TLB_shootdowns
     73263 ±  8%    +133.2%     170845 ±  6%  interrupts.NMI:Non-maskable_interrupts
     73263 ±  8%    +133.2%     170845 ±  6%  interrupts.PMI:Performance_monitoring_interrupts
    187967           +96.8%     369899        interrupts.RES:Rescheduling_interrupts
      8463 ± 27%   +5146.4%     444018 ±  3%  interrupts.TLB:TLB_shootdowns
     10.74 ±  9%      -6.8        3.97 ± 28%  perf-profile.calltrace.cycles-pp.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread
     47.92 ±  3%      -6.4       41.48 ±  8%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     47.33 ±  2%      -6.2       41.11 ±  8%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     47.34 ±  2%      -6.2       41.13 ±  8%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     47.34 ±  2%      -6.2       41.13 ±  8%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     42.15 ±  3%      -6.1       36.07 ±  5%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
     41.81 ±  3%      -6.1       35.75 ±  5%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
     10.77 ±  9%      -5.9        4.82 ± 23%  perf-profile.calltrace.cycles-pp.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread
     10.77 ±  9%      -5.9        4.82 ± 23%  perf-profile.calltrace.cycles-pp.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread.ret_from_fork
     30.69 ±  4%      -4.2       26.48 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
      7.28 ± 10%      -4.2        3.10 ± 29%  perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction
      7.28 ± 10%      -4.2        3.11 ± 29%  perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space
      7.28 ± 10%      -4.2        3.10 ± 29%  perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction
      7.29 ± 10%      -4.2        3.12 ± 29%  perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space
      7.29 ± 10%      -4.2        3.14 ± 29%  perf-profile.calltrace.cycles-pp.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work
     20.58 ±  5%      -3.8       16.82 ±  3%  perf-profile.calltrace.cycles-pp.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread
     18.63 ±  5%      -3.6       15.03 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
     22.71 ±  5%      -3.5       19.24 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread.kthread
      5.66 ± 13%      -2.9        2.74 ± 30%  perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents
      5.66 ± 13%      -2.9        2.74 ± 30%  perf-profile.calltrace.cycles-pp.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range
     15.89 ±  5%      -2.7       13.19 ±  2%  perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper
     15.88 ±  5%      -2.7       13.18 ±  2%  perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io
      5.14 ± 12%      -2.7        2.45 ± 29%  perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages
      5.08 ± 12%      -2.7        2.42 ± 29%  perf-profile.calltrace.cycles-pp.check_leaf.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages
     42.18 ±  3%      -2.6       39.54 ±  5%  perf-profile.calltrace.cycles-pp.ret_from_fork
     42.18 ±  3%      -2.6       39.54 ±  5%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      4.00 ±  6%      -2.6        1.38 ±  6%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      2.80 ±  6%      -2.3        0.46 ± 58%  perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work
      2.79 ±  6%      -2.3        0.46 ± 58%  perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space
      3.07 ±  5%      -1.9        1.19 ±  6%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      2.77 ± 10%      -1.7        1.04 ±  5%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      5.17 ±  9%      -1.4        3.74 ±  3%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot
      1.93 ±  4%      -1.2        0.75 ±  5%  perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.92 ±  4%      -1.2        0.75 ±  5%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      6.13 ±  6%      -1.2        4.96 ±  4%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.__btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot
      1.89 ±  4%      -1.1        0.74 ±  5%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      5.10 ±  5%      -1.1        3.98 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents.insert_reserved_file_extent
      5.07 ±  5%      -1.1        3.96 ±  2%  perf-profile.calltrace.cycles-pp.__btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents
      5.03 ±  5%      -1.1        3.92 ±  2%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent
      6.19 ±  4%      -1.1        5.10 ±  4%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.__btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent
      1.96 ±  5%      -1.0        0.96 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_duplicate_item.btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper
      4.78 ±  4%      -0.9        3.92 ±  5%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.__btrfs_tree_read_lock.btrfs_read_lock_root_node
      1.58 ±  6%      -0.8        0.74 ±  2%  perf-profile.calltrace.cycles-pp.setup_leaf_for_split.btrfs_duplicate_item.btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io
      2.29 ±  4%      -0.8        1.49 ± 10%  perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.run_delalloc_nocow.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage
      2.29 ±  4%      -0.8        1.49 ± 10%  perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.run_delalloc_nocow.btrfs_run_delalloc_range.writepage_delalloc
      5.51            -0.8        4.74 ± 10%  perf-profile.calltrace.cycles-pp.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages
      5.71            -0.8        4.95 ± 10%  perf-profile.calltrace.cycles-pp.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages.__filemap_fdatawrite_range
      5.03            -0.7        4.32 ± 10%  perf-profile.calltrace.cycles-pp.run_delalloc_nocow.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages
      5.03            -0.7        4.32 ± 10%  perf-profile.calltrace.cycles-pp.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages
      0.98 ± 11%      -0.7        0.29 ±100%  perf-profile.calltrace.cycles-pp.btrfs_get_32.check_leaf.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio
      3.04 ±  5%      -0.7        2.38 ±  4%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_lock_root_node
      4.85 ±  4%      -0.6        4.21 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents.insert_reserved_file_extent
      4.80 ±  4%      -0.6        4.17 ±  3%  perf-profile.calltrace.cycles-pp.__btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents
      1.47 ±  5%      -0.5        1.00 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.run_delalloc_nocow.btrfs_run_delalloc_range
      1.45 ±  5%      -0.5        0.99 ± 11%  perf-profile.calltrace.cycles-pp.__btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.run_delalloc_nocow
      1.75 ±  4%      -0.3        1.46 ±  8%  perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents.insert_reserved_file_extent
      1.75 ±  4%      -0.3        1.46 ±  8%  perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents
      2.95 ±  6%      -0.3        2.66 ±  6%  perf-profile.calltrace.cycles-pp.btrfs_readpage.filemap_fault.__do_fault.do_fault.__handle_mm_fault
      2.19 ±  6%      -0.3        1.91        perf-profile.calltrace.cycles-pp.__btrfs_tree_lock.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents.insert_reserved_file_extent
      2.16 ±  6%      -0.3        1.89        perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_search_slot.btrfs_lookup_file_extent
      2.16 ±  6%      -0.3        1.90        perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_search_slot.btrfs_lookup_file_extent.btrfs_drop_extents
      2.11 ±  6%      -0.3        1.86        perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_search_slot
      0.64 ±  8%      -0.2        0.41 ± 57%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      1.50 ±  6%      -0.2        1.29 ±  3%  perf-profile.calltrace.cycles-pp.btrfs_insert_empty_items.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
      1.42 ±  6%      -0.2        1.21 ±  4%  perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_insert_empty_items.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper
      1.25 ±  6%      -0.2        1.04        perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_write_slowpath.__btrfs_tree_lock.btrfs_lock_root_node
      0.60 ±  5%      -0.2        0.39 ± 57%  perf-profile.calltrace.cycles-pp.btrfs_lock_and_flush_ordered_range.btrfs_readpage.filemap_fault.__do_fault.do_fault
      1.09 ±  3%      -0.1        0.97 ±  7%  perf-profile.calltrace.cycles-pp.btrfs_map_bio.btrfs_submit_data_bio.submit_one_bio.btrfs_readpage.filemap_fault
      0.93 ±  4%      -0.1        0.82 ±  2%  perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_read_slowpath.__btrfs_tree_read_lock.btrfs_read_lock_root_node
      0.90 ±  5%      -0.1        0.80 ±  7%  perf-profile.calltrace.cycles-pp.submit_bio_noacct.submit_bio.btrfs_map_bio.btrfs_submit_data_bio.submit_one_bio
      0.90 ±  5%      -0.1        0.81 ±  7%  perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btrfs_submit_data_bio.submit_one_bio.btrfs_readpage
      0.83 ±  5%      -0.1        0.74 ±  7%  perf-profile.calltrace.cycles-pp.pmem_submit_bio.submit_bio_noacct.submit_bio.btrfs_map_bio.btrfs_submit_data_bio
      0.00            +0.7        0.72 ± 10%  perf-profile.calltrace.cycles-pp.__lookup_extent_mapping.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list
      0.00            +0.8        0.84 ± 14%  perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread
      0.00            +0.8        0.84 ± 14%  perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space.process_one_work
      0.95 ± 21%      +0.9        1.87 ± 14%  perf-profile.calltrace.cycles-pp.check_leaf.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.submit_extent_page
      0.97 ± 21%      +0.9        1.90 ± 14%  perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.submit_extent_page.write_one_eb
      1.07 ± 20%      +1.1        2.13 ± 13%  perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages
      1.07 ± 20%      +1.1        2.13 ± 13%  perf-profile.calltrace.cycles-pp.btrfs_submit_metadata_bio.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages
      0.00            +1.1        1.09 ± 13%  perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs_for_head.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.btrfs_preempt_reclaim_metadata_space
      0.00            +1.7        1.68 ± 11%  perf-profile.calltrace.cycles-pp.flush_space.btrfs_preempt_reclaim_metadata_space.process_one_work.worker_thread.kthread
      0.00            +1.7        1.68 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.flush_space.btrfs_preempt_reclaim_metadata_space.process_one_work.worker_thread
      0.00            +1.7        1.68 ± 11%  perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.btrfs_preempt_reclaim_metadata_space.process_one_work
      0.00            +1.7        1.68 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_preempt_reclaim_metadata_space.process_one_work.worker_thread.kthread.ret_from_fork
      0.00            +1.9        1.88 ± 16%  perf-profile.calltrace.cycles-pp.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list.shrink_lruvec
      0.00            +1.9        1.89 ± 16%  perf-profile.calltrace.cycles-pp.btrfs_releasepage.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
      0.00            +2.2        2.16 ± 13%  perf-profile.calltrace.cycles-pp.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages.__writeback_single_inode
      0.00            +2.3        2.29 ± 13%  perf-profile.calltrace.cycles-pp.write_one_eb.btree_write_cache_pages.do_writepages.__writeback_single_inode.writeback_sb_inodes
      0.00            +2.4        2.38 ± 13%  perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb
      0.00            +2.4        2.43 ± 12%  perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback
      0.00            +2.4        2.43 ± 12%  perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork
      0.00            +2.4        2.43 ± 12%  perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread
      0.00            +2.4        2.43 ± 12%  perf-profile.calltrace.cycles-pp.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work.worker_thread
      0.00            +2.4        2.43 ± 12%  perf-profile.calltrace.cycles-pp.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work
      0.00            +2.4        2.43 ± 12%  perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn
      0.00            +2.9        2.87 ± 10%  perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
      0.00            +3.4        3.38 ± 10%  perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat.kswapd
      0.00            +3.4        3.38 ± 10%  perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.balance_pgdat.kswapd.kthread
      0.00            +3.4        3.40 ± 10%  perf-profile.calltrace.cycles-pp.shrink_node.balance_pgdat.kswapd.kthread.ret_from_fork
      0.00            +3.4        3.40 ± 10%  perf-profile.calltrace.cycles-pp.kswapd.kthread.ret_from_fork
      0.00            +3.4        3.40 ± 10%  perf-profile.calltrace.cycles-pp.balance_pgdat.kswapd.kthread.ret_from_fork
      0.00            +7.5        7.50 ± 38%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
      0.00            +7.5        7.52 ± 38%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
      3.77 ±  6%      +7.8       11.60 ± 25%  perf-profile.calltrace.cycles-pp.filemap_fault.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault
      3.77 ±  6%      +7.8       11.60 ± 25%  perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      0.00            +8.2        8.17 ± 36%  perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault
      0.00            +8.2        8.17 ± 36%  perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page
      0.00            +8.2        8.18 ± 36%  perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__do_fault
      0.00            +8.3        8.25 ± 35%  perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.pagecache_get_page.filemap_fault.__do_fault.do_fault
      8.03 ±  8%      +8.5       16.54 ± 18%  perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
      8.22 ±  7%      +8.6       16.80 ± 19%  perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
      8.15 ±  7%      +8.6       16.73 ± 19%  perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      8.21 ±  7%      +8.6       16.80 ± 18%  perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      8.09 ±  8%      +8.6       16.68 ± 19%  perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      0.00            +8.6        8.59 ± 34%  perf-profile.calltrace.cycles-pp.pagecache_get_page.filemap_fault.__do_fault.do_fault.__handle_mm_fault
      8.26 ±  8%      +8.6       16.89 ± 19%  perf-profile.calltrace.cycles-pp.asm_exc_page_fault
      0.00            +8.9        8.93 ± 36%  perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages
      0.00            +8.9        8.93 ± 36%  perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
      0.00            +9.0        8.96 ± 36%  perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
     10.74 ±  9%      -6.8        3.97 ± 28%  perf-profile.children.cycles-pp.btrfs_commit_transaction
     47.91 ±  3%      -6.4       41.47 ±  8%  perf-profile.children.cycles-pp.do_idle
     47.92 ±  3%      -6.4       41.48 ±  8%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     47.92 ±  3%      -6.4       41.48 ±  8%  perf-profile.children.cycles-pp.cpu_startup_entry
     47.34 ±  2%      -6.2       41.13 ±  8%  perf-profile.children.cycles-pp.start_secondary
     42.15 ±  3%      -6.1       36.08 ±  5%  perf-profile.children.cycles-pp.worker_thread
     41.81 ±  3%      -6.1       35.75 ±  5%  perf-profile.children.cycles-pp.process_one_work
     10.77 ±  9%      -5.9        4.82 ± 23%  perf-profile.children.cycles-pp.btrfs_async_reclaim_metadata_space
     13.25 ±  5%      -4.9        8.32 ± 16%  perf-profile.children.cycles-pp.__filemap_fdatawrite_range
     10.77 ±  9%      -4.3        6.51 ± 20%  perf-profile.children.cycles-pp.flush_space
     30.69 ±  4%      -4.2       26.48 ±  3%  perf-profile.children.cycles-pp.btrfs_work_helper
     21.97 ±  4%      -4.2       17.79 ±  3%  perf-profile.children.cycles-pp.btrfs_search_slot
      7.29 ± 10%      -4.2        3.12 ± 29%  perf-profile.children.cycles-pp.btrfs_write_marked_extents
      7.29 ± 10%      -4.2        3.14 ± 29%  perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction
     20.58 ±  5%      -3.8       16.82 ±  3%  perf-profile.children.cycles-pp.insert_reserved_file_extent
     18.63 ±  5%      -3.6       15.04 ±  3%  perf-profile.children.cycles-pp.btrfs_drop_extents
     18.19 ±  4%      -3.5       14.69 ±  3%  perf-profile.children.cycles-pp.btrfs_lookup_file_extent
     22.71 ±  5%      -3.5       19.24 ±  3%  perf-profile.children.cycles-pp.btrfs_finish_ordered_io
     15.03 ±  4%      -3.2       11.84 ±  3%  perf-profile.children.cycles-pp.rwsem_optimistic_spin
     42.18 ±  3%      -2.6       39.54 ±  5%  perf-profile.children.cycles-pp.kthread
     42.18 ±  3%      -2.6       39.59 ±  5%  perf-profile.children.cycles-pp.ret_from_fork
     13.28 ±  5%      -2.5       10.75 ± 10%  perf-profile.children.cycles-pp.do_writepages
      3.92 ±  4%      -2.3        1.66 ±  6%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      8.68 ±  5%      -1.9        6.75 ±  2%  perf-profile.children.cycles-pp.__btrfs_tree_lock
      3.35 ±  5%      -1.9        1.43 ±  6%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      8.54 ±  5%      -1.9        6.64 ±  2%  perf-profile.children.cycles-pp.rwsem_down_write_slowpath
      8.70 ±  4%      -1.9        6.80 ±  4%  perf-profile.children.cycles-pp.osq_lock
      8.46 ±  8%      -1.8        6.62 ± 11%  perf-profile.children.cycles-pp.submit_one_bio
      7.28 ± 10%      -1.8        5.48 ± 14%  perf-profile.children.cycles-pp.btree_write_cache_pages
      2.82 ± 10%      -1.8        1.06 ±  5%  perf-profile.children.cycles-pp.menu_select
      6.72 ± 11%      -1.7        5.03 ± 14%  perf-profile.children.cycles-pp.btrfs_submit_metadata_bio
      6.10 ± 10%      -1.6        4.48 ± 13%  perf-profile.children.cycles-pp.btree_csum_one_bio
      6.06 ± 10%      -1.6        4.46 ± 13%  perf-profile.children.cycles-pp.check_leaf
      2.86 ±  5%      -1.5        1.32 ±  5%  perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
      7.12 ±  4%      -1.5        5.67 ±  4%  perf-profile.children.cycles-pp.__btrfs_tree_read_lock
      5.68 ±  5%      -1.4        4.23 ±  3%  perf-profile.children.cycles-pp.btrfs_lock_root_node
      6.95 ±  4%      -1.4        5.51 ±  4%  perf-profile.children.cycles-pp.rwsem_down_read_slowpath
      6.95 ±  4%      -1.2        5.71 ±  4%  perf-profile.children.cycles-pp.btrfs_read_lock_root_node
      2.13 ±  4%      -1.2        0.94 ±  5%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      2.08 ±  4%      -1.2        0.92 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
      5.61 ±  5%      -1.1        4.53        perf-profile.children.cycles-pp.rwsem_spin_on_owner
      3.89 ± 10%      -1.0        2.87 ± 12%  perf-profile.children.cycles-pp.check_extent_data_item
      1.96 ±  5%      -1.0        0.96 ±  3%  perf-profile.children.cycles-pp.btrfs_duplicate_item
      1.58 ±  6%      -0.8        0.74 ±  2%  perf-profile.children.cycles-pp.setup_leaf_for_split
      5.53            -0.7        4.79 ± 10%  perf-profile.children.cycles-pp.writepage_delalloc
      5.74            -0.7        5.00 ± 10%  perf-profile.children.cycles-pp.__extent_writepage
      5.05            -0.7        4.36 ± 10%  perf-profile.children.cycles-pp.run_delalloc_nocow
      5.05            -0.7        4.36 ±  9%  perf-profile.children.cycles-pp.btrfs_run_delalloc_range
      1.19 ±  9%      -0.7        0.52        perf-profile.children.cycles-pp.__hrtimer_run_queues
      2.29 ± 10%      -0.6        1.66 ± 11%  perf-profile.children.cycles-pp.btrfs_get_64
      3.40 ±  4%      -0.6        2.79 ±  2%  perf-profile.children.cycles-pp.try_to_wake_up
      1.02 ±  6%      -0.5        0.48 ± 12%  perf-profile.children.cycles-pp.ktime_get
      0.82 ±  7%      -0.5        0.30 ±  6%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      1.92 ±  8%      -0.5        1.44 ± 12%  perf-profile.children.cycles-pp.btrfs_get_32
      1.64 ±  6%      -0.5        1.17 ±  3%  perf-profile.children.cycles-pp.rwsem_wake
      0.81 ±  9%      -0.4        0.37 ±  5%  perf-profile.children.cycles-pp.tick_sched_timer
      2.21 ±  5%      -0.4        1.77 ±  7%  perf-profile.children.cycles-pp.__btrfs_cow_block
      1.52 ±  6%      -0.4        1.07 ±  4%  perf-profile.children.cycles-pp.wake_up_q
      2.21 ±  5%      -0.4        1.77 ±  7%  perf-profile.children.cycles-pp.btrfs_cow_block
      0.68 ± 10%      -0.4        0.24 ±  6%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.61 ± 12%      -0.4        0.24 ± 28%  perf-profile.children.cycles-pp.btrfs_finish_extent_commit
      0.59 ± 11%      -0.4        0.22 ± 28%  perf-profile.children.cycles-pp.unpin_extent_range
      0.66 ±  9%      -0.4        0.30 ±  4%  perf-profile.children.cycles-pp.tick_sched_handle
      1.41 ±  7%      -0.4        1.05 ±  9%  perf-profile.children.cycles-pp.check_setget_bounds
      0.54 ± 12%      -0.3        0.19 ± 30%  perf-profile.children.cycles-pp.__btrfs_add_free_space
      0.63 ±  8%      -0.3        0.29 ±  5%  perf-profile.children.cycles-pp.update_process_times
      0.52 ± 11%      -0.3        0.18 ± 29%  perf-profile.children.cycles-pp.steal_from_bitmap
      0.60 ±  9%      -0.3        0.27 ±  6%  perf-profile.children.cycles-pp.irq_exit_rcu
      1.50 ±  8%      -0.3        1.19 ±  4%  perf-profile.children.cycles-pp.stack_trace_save_tsk
      2.18 ±  8%      -0.3        1.87 ±  4%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.48 ± 11%      -0.3        0.18 ± 20%  perf-profile.children.cycles-pp._find_next_bit
      0.85 ±  7%      -0.3        0.56 ±  2%  perf-profile.children.cycles-pp.copy_extent_buffer_full
      2.10 ±  8%      -0.3        1.81 ±  4%  perf-profile.children.cycles-pp.enqueue_task_fair
      1.35 ±  8%      -0.3        1.06 ±  4%  perf-profile.children.cycles-pp.arch_stack_walk
      0.86 ±  7%      -0.3        0.57 ±  3%  perf-profile.children.cycles-pp.copy_page
      2.95 ±  6%      -0.3        2.67 ±  6%  perf-profile.children.cycles-pp.btrfs_readpage
      1.74 ±  8%      -0.3        1.46 ±  4%  perf-profile.children.cycles-pp.__account_scheduler_latency
      0.57 ±  6%      -0.3        0.29 ±  8%  perf-profile.children.cycles-pp.clockevents_program_event
      0.50 ±  8%      -0.3        0.23 ±  8%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.49 ±  8%      -0.3        0.22 ±  7%  perf-profile.children.cycles-pp.do_softirq_own_stack
      0.39 ± 11%      -0.3        0.13 ± 21%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.34 ± 15%      -0.2        0.10 ±  8%  perf-profile.children.cycles-pp.timekeeping_max_deferment
      1.47 ±  7%      -0.2        1.24 ±  5%  perf-profile.children.cycles-pp.__schedule
      0.99 ± 10%      -0.2        0.78 ±  4%  perf-profile.children.cycles-pp.unwind_next_frame
      0.30 ± 13%      -0.2        0.09 ± 30%  perf-profile.children.cycles-pp.tick_irq_enter
      0.77 ±  5%      -0.2        0.58 ±  9%  perf-profile.children.cycles-pp.read_extent_buffer
      1.32 ±  3%      -0.2        1.13 ±  8%  perf-profile.children.cycles-pp.setup_items_for_insert
      0.74 ±  4%      -0.2        0.55 ±  3%  perf-profile.children.cycles-pp.unlock_up
      0.77 ±  8%      -0.2        0.59 ±  4%  perf-profile.children.cycles-pp.push_leaf_right
      0.92 ±  7%      -0.2        0.74 ±  4%  perf-profile.children.cycles-pp.split_leaf
      0.34 ±  6%      -0.2        0.17 ±  5%  perf-profile.children.cycles-pp.scheduler_tick
      0.74 ± 10%      -0.2        0.57 ± 14%  perf-profile.children.cycles-pp.btrfs_get_8
      0.79 ±  4%      -0.2        0.62 ±  3%  perf-profile.children.cycles-pp.btrfs_release_path
      0.25 ±  5%      -0.1        0.11 ±  7%  perf-profile.children.cycles-pp.rebalance_domains
      1.45 ±  4%      -0.1        1.30 ±  4%  perf-profile.children.cycles-pp.__wake_up_common
      0.65 ±  2%      -0.1        0.50 ±  9%  perf-profile.children.cycles-pp.btrfs_set_token_32
      0.86 ±  5%      -0.1        0.72 ±  6%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.74 ±  6%      -0.1        0.60 ±  4%  perf-profile.children.cycles-pp.autoremove_wake_function
      0.85 ±  6%      -0.1        0.72 ±  6%  perf-profile.children.cycles-pp.schedule
      0.62 ±  8%      -0.1        0.49 ±  5%  perf-profile.children.cycles-pp.poll_idle
      0.24            -0.1        0.12 ±  4%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.33 ±  3%      -0.1        0.21 ±  5%  perf-profile.children.cycles-pp.update_rq_clock
      0.19 ± 16%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.16 ±  5%      -0.1        0.05 ± 61%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      0.37 ±  9%      -0.1        0.27 ±  6%  perf-profile.children.cycles-pp.orc_find
      0.25 ±  5%      -0.1        0.14 ±  3%  perf-profile.children.cycles-pp.sched_clock
      0.95 ±  4%      -0.1        0.84 ±  9%  perf-profile.children.cycles-pp.btrfs_try_granting_tickets
      0.18 ± 22%      -0.1        0.08 ± 14%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.24 ±  4%      -0.1        0.14 ±  5%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.23 ±  7%      -0.1        0.13 ±  3%  perf-profile.children.cycles-pp.native_sched_clock
      0.49 ± 10%      -0.1        0.39 ±  3%  perf-profile.children.cycles-pp.add_delayed_ref_head
      0.16 ±  4%      -0.1        0.07 ±  7%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.60 ±  5%      -0.1        0.51 ±  6%  perf-profile.children.cycles-pp.btrfs_lock_and_flush_ordered_range
      0.62 ±  2%      -0.1        0.53 ±  5%  perf-profile.children.cycles-pp.btrfs_get_token_32
      0.20 ±  6%      -0.1        0.11 ±  6%  perf-profile.children.cycles-pp.read_tsc
      0.30 ± 12%      -0.1        0.21 ±  6%  perf-profile.children.cycles-pp.find_get_entry
      0.33 ±  9%      -0.1        0.24 ±  7%  perf-profile.children.cycles-pp.__orc_find
      0.15 ±  3%      -0.1        0.07 ±  6%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.14 ±  9%      -0.1        0.06        perf-profile.children.cycles-pp.load_balance
      0.16 ± 10%      -0.1        0.08 ± 10%  perf-profile.children.cycles-pp.irq_work_run_list
      0.11 ± 10%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.23 ±  5%      -0.1        0.15 ± 11%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.15 ±  8%      -0.1        0.08 ±  6%  perf-profile.children.cycles-pp.serial8250_console_write
      0.10 ± 21%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.update_blocked_averages
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.asm_sysvec_irq_work
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.sysvec_irq_work
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.__sysvec_irq_work
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.irq_work_run
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.irq_work_single
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.printk
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.console_unlock
      0.15 ±  9%      -0.1        0.08 ±  8%  perf-profile.children.cycles-pp.vprintk_emit
      0.52 ±  4%      -0.1        0.44 ±  8%  perf-profile.children.cycles-pp.btrfs_comp_cpu_keys
      0.10 ± 12%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.15 ± 10%      -0.1        0.08 ±  6%  perf-profile.children.cycles-pp.uart_console_write
      0.11 ±  4%      -0.1        0.04 ± 57%  perf-profile.children.cycles-pp.find_busiest_group
      0.14 ±  8%      -0.1        0.08 ±  6%  perf-profile.children.cycles-pp.wait_for_xmitr
      0.14 ± 10%      -0.1        0.07 ±  5%  perf-profile.children.cycles-pp.serial8250_console_putchar
      0.12 ±  6%      -0.1        0.06 ± 11%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.11 ± 16%      -0.1        0.05        perf-profile.children.cycles-pp.run_rebalance_domains
      0.11 ±  7%      -0.1        0.06 ±  9%  perf-profile.children.cycles-pp.calc_global_load_tick
      0.35 ±  8%      -0.1        0.30 ±  7%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.11 ± 14%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.io_serial_in
      0.29 ±  3%      -0.0        0.25 ±  7%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      0.23 ±  3%      -0.0        0.18 ±  9%  perf-profile.children.cycles-pp.set_next_entity
      0.09 ± 17%      -0.0        0.04 ± 58%  perf-profile.children.cycles-pp.check_prev_ino
      0.18 ±  6%      -0.0        0.14 ±  5%  perf-profile.children.cycles-pp.unwind_get_return_address
      0.17 ±  5%      -0.0        0.13 ±  6%  perf-profile.children.cycles-pp.__kernel_text_address
      0.28 ±  5%      -0.0        0.24 ±  6%  perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty
      0.08 ± 10%      -0.0        0.04 ± 58%  perf-profile.children.cycles-pp.xas_set_mark
      0.15 ±  7%      -0.0        0.11 ±  4%  perf-profile.children.cycles-pp.kernel_text_address
      0.11 ± 20%      -0.0        0.08 ± 11%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.14 ±  5%      -0.0        0.12 ±  9%  perf-profile.children.cycles-pp.release_extent_buffer
      0.08 ± 10%      -0.0        0.06 ±  7%  perf-profile.children.cycles-pp.rwsem_mark_wake
      0.07 ± 14%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.memset_erms
      0.10 ±  4%      -0.0        0.08 ±  5%  perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched
      0.12 ±  8%      -0.0        0.10 ±  4%  perf-profile.children.cycles-pp.down_write
      0.23            +0.0        0.26 ±  9%  perf-profile.children.cycles-pp.memmove_extent_buffer
      0.09 ±  7%      +0.0        0.12 ± 21%  perf-profile.children.cycles-pp.btrfs_free_path
      0.17 ±  6%      +0.0        0.20 ±  2%  perf-profile.children.cycles-pp.lookup_inline_extent_backref
      0.04 ± 59%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.rmqueue
      0.04 ± 57%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.__mod_lruvec_state
      0.06 ± 16%      +0.0        0.09 ±  4%  perf-profile.children.cycles-pp.free_extent_map
      0.11 ± 12%      +0.0        0.14 ±  7%  perf-profile.children.cycles-pp.btrfs_buffer_uptodate
      0.07 ± 11%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.17 ± 10%      +0.0        0.21 ± 12%  perf-profile.children.cycles-pp.up_read
      0.16 ±  7%      +0.0        0.20 ±  7%  perf-profile.children.cycles-pp.rb_next
      0.12 ±  6%      +0.0        0.17 ±  9%  perf-profile.children.cycles-pp.__add_to_page_cache_locked
      0.00            +0.1        0.05 ±  9%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.__pagevec_lru_add_fn
      0.01 ±173%      +0.1        0.07 ± 12%  perf-profile.children.cycles-pp.__list_add_valid
      0.06 ± 17%      +0.1        0.12 ± 30%  perf-profile.children.cycles-pp.start_transaction
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.lock_extent_buffer_for_io
      0.04 ± 58%      +0.1        0.10 ± 19%  perf-profile.children.cycles-pp.get_partial_node
      0.06 ±  9%      +0.1        0.11 ±  4%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.38 ±  5%      +0.1        0.44 ±  4%  perf-profile.children.cycles-pp.kmem_cache_free
      0.14 ±  3%      +0.1        0.20 ±  4%  perf-profile.children.cycles-pp.btrfs_remove_ordered_extent
      0.02 ±173%      +0.1        0.08 ± 31%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      0.02 ±173%      +0.1        0.08 ± 31%  perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
      0.35 ±  9%      +0.1        0.42 ±  3%  perf-profile.children.cycles-pp.unpin_extent_cache
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.remove_extent_mapping
      0.22 ± 10%      +0.1        0.29 ± 12%  perf-profile.children.cycles-pp.block_group_cache_tree_search
      0.00            +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.unlock_page
      0.00            +0.1        0.07 ± 17%  perf-profile.children.cycles-pp.put_cpu_partial
      0.17 ±  3%      +0.1        0.25 ±  5%  perf-profile.children.cycles-pp.rb_erase
      0.03 ±100%      +0.1        0.12 ± 11%  perf-profile.children.cycles-pp.pagevec_lru_move_fn
      0.00            +0.1        0.09 ± 12%  perf-profile.children.cycles-pp.try_to_unmap_one
      0.01 ±173%      +0.1        0.11 ± 19%  perf-profile.children.cycles-pp.lru_cache_add
      0.01 ±173%      +0.1        0.11 ±  9%  perf-profile.children.cycles-pp.page_mapping
      0.16 ±  8%      +0.1        0.27 ±  3%  perf-profile.children.cycles-pp.add_to_page_cache_lru
      0.00            +0.1        0.11 ± 17%  perf-profile.children.cycles-pp.try_to_unmap
      0.00            +0.1        0.12 ± 10%  perf-profile.children.cycles-pp.__isolate_lru_page
      0.51 ±  6%      +0.1        0.63 ±  8%  perf-profile.children.cycles-pp.down_read
      0.00            +0.1        0.13 ±  8%  perf-profile.children.cycles-pp.split_state
      0.11 ±  7%      +0.1        0.25 ±  7%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.30 ±  6%      +0.2        0.47 ±  7%  perf-profile.children.cycles-pp.clear_state_bit
      0.23 ±  8%      +0.2        0.40 ± 18%  perf-profile.children.cycles-pp.btrfs_update_block_group
      0.15 ±  3%      +0.2        0.34 ± 19%  perf-profile.children.cycles-pp.btrfs_add_ordered_extent
      0.15 ±  3%      +0.2        0.34 ± 19%  perf-profile.children.cycles-pp.__btrfs_add_ordered_extent
      0.04 ± 58%      +0.2        0.24 ± 36%  perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.00            +0.2        0.20 ± 16%  perf-profile.children.cycles-pp.xas_create
      0.00            +0.2        0.23 ± 14%  perf-profile.children.cycles-pp.xas_store
      0.00            +0.2        0.23 ±  3%  perf-profile.children.cycles-pp.move_pages_to_lru
      0.00            +0.2        0.24 ± 15%  perf-profile.children.cycles-pp.__delete_from_page_cache
      0.00            +0.3        0.28 ±  6%  perf-profile.children.cycles-pp.isolate_lru_pages
      0.00            +0.3        0.29 ± 16%  perf-profile.children.cycles-pp.__remove_mapping
      0.36 ± 10%      +0.3        0.66 ± 20%  perf-profile.children.cycles-pp.alloc_reserved_file_extent
      0.00            +0.3        0.30 ± 81%  perf-profile.children.cycles-pp.__get_free_pages
      0.23 ±  3%      +0.3        0.54 ± 61%  perf-profile.children.cycles-pp.clear_extent_bit
      1.60 ±  5%      +0.5        2.14 ±  6%  perf-profile.children.cycles-pp.__etree_search
      0.23 ±  9%      +0.6        0.85 ± 92%  perf-profile.children.cycles-pp.alloc_extent_state
      0.58 ±  4%      +0.6        1.22 ± 31%  perf-profile.children.cycles-pp.__clear_extent_bit
      0.03 ±100%      +0.7        0.70 ± 12%  perf-profile.children.cycles-pp.test_range_bit
      1.43 ±  5%      +0.7        2.17 ±  7%  perf-profile.children.cycles-pp.__lookup_extent_mapping
      4.39 ±  6%      +0.8        5.15 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock
      0.07 ±  6%      +0.9        0.93 ±  6%  perf-profile.children.cycles-pp.page_vma_mapped_walk
      0.08 ±  8%      +0.9        0.94 ± 74%  perf-profile.children.cycles-pp.allocate_slab
      0.61 ±  4%      +0.9        1.52 ± 50%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.24 ±  3%      +0.9        1.18 ± 62%  perf-profile.children.cycles-pp.___slab_alloc
      0.26 ±  4%      +1.0        1.21 ± 61%  perf-profile.children.cycles-pp.__slab_alloc
      0.00            +1.0        1.00 ±  7%  perf-profile.children.cycles-pp.page_referenced_one
      1.51 ± 14%      +1.1        2.56 ± 10%  perf-profile.children.cycles-pp.write_one_eb
      1.27 ± 19%      +1.2        2.42 ± 10%  perf-profile.children.cycles-pp.submit_extent_page
      0.00            +1.3        1.29 ±  8%  perf-profile.children.cycles-pp.page_referenced
      0.10            +1.3        1.44 ±  8%  perf-profile.children.cycles-pp.rmap_walk_file
      0.00            +1.7        1.68 ± 11%  perf-profile.children.cycles-pp.btrfs_preempt_reclaim_metadata_space
      0.00            +2.1        2.12 ± 18%  perf-profile.children.cycles-pp.try_release_extent_mapping
      0.00            +2.1        2.13 ± 18%  perf-profile.children.cycles-pp.btrfs_releasepage
      0.01 ±173%      +2.4        2.43 ± 12%  perf-profile.children.cycles-pp.wb_workfn
      0.01 ±173%      +2.4        2.43 ± 12%  perf-profile.children.cycles-pp.wb_writeback
      0.01 ±173%      +2.4        2.43 ± 12%  perf-profile.children.cycles-pp.__writeback_inodes_wb
      0.01 ±173%      +2.4        2.43 ± 12%  perf-profile.children.cycles-pp.writeback_sb_inodes
      0.01 ±173%      +2.4        2.43 ± 12%  perf-profile.children.cycles-pp.__writeback_single_inode
      0.00            +3.4        3.40 ± 10%  perf-profile.children.cycles-pp.kswapd
      0.00            +3.4        3.40 ± 10%  perf-profile.children.cycles-pp.balance_pgdat
      0.00            +4.2        4.20 ± 14%  perf-profile.children.cycles-pp.shrink_page_list
      3.77 ±  6%      +7.8       11.60 ± 25%  perf-profile.children.cycles-pp.__do_fault
      3.77 ±  6%      +7.8       11.60 ± 25%  perf-profile.children.cycles-pp.filemap_fault
      0.58 ±  7%      +8.3        8.90 ± 33%  perf-profile.children.cycles-pp.pagecache_get_page
      8.04 ±  8%      +8.5       16.55 ± 18%  perf-profile.children.cycles-pp.do_fault
      0.38 ±  4%      +8.5        8.89 ± 37%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      8.23 ±  8%      +8.6       16.85 ± 19%  perf-profile.children.cycles-pp.exc_page_fault
      8.23 ±  8%      +8.6       16.85 ± 19%  perf-profile.children.cycles-pp.do_user_addr_fault
      8.16 ±  7%      +8.6       16.80 ± 19%  perf-profile.children.cycles-pp.handle_mm_fault
      8.11 ±  8%      +8.6       16.75 ± 19%  perf-profile.children.cycles-pp.__handle_mm_fault
      8.28 ±  8%      +8.7       16.95 ± 19%  perf-profile.children.cycles-pp.asm_exc_page_fault
      3.58 ±  8%      +9.2       12.78 ± 26%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.00           +10.0        9.99 ± 35%  perf-profile.children.cycles-pp.try_to_free_pages
      0.00           +10.0        9.99 ± 35%  perf-profile.children.cycles-pp.do_try_to_free_pages
      0.00           +10.0        9.99 ± 35%  perf-profile.children.cycles-pp.__alloc_pages_slowpath
      0.10 ± 11%     +10.0       10.11 ± 34%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
      0.00           +13.3       13.34 ± 28%  perf-profile.children.cycles-pp.shrink_inactive_list
      0.00           +13.3       13.34 ± 28%  perf-profile.children.cycles-pp.shrink_lruvec
      0.00           +13.4       13.39 ± 28%  perf-profile.children.cycles-pp.shrink_node
      8.60 ±  4%      -1.8        6.78 ±  4%  perf-profile.self.cycles-pp.osq_lock
      1.90 ± 13%      -1.2        0.71 ±  8%  perf-profile.self.cycles-pp.menu_select
      5.54 ±  5%      -1.0        4.49        perf-profile.self.cycles-pp.rwsem_spin_on_owner
      1.26 ±  9%      -0.8        0.44 ±  3%  perf-profile.self.cycles-pp.cpuidle_enter_state
      1.80 ± 11%      -0.5        1.31 ± 12%  perf-profile.self.cycles-pp.btrfs_get_64
      0.84 ±  6%      -0.5        0.38 ± 14%  perf-profile.self.cycles-pp.ktime_get
      1.51 ±  9%      -0.4        1.14 ± 12%  perf-profile.self.cycles-pp.btrfs_get_32
      1.26 ±  7%      -0.3        0.94 ± 10%  perf-profile.self.cycles-pp.check_setget_bounds
      0.48 ± 11%      -0.3        0.18 ± 20%  perf-profile.self.cycles-pp._find_next_bit
      0.85 ±  7%      -0.3        0.56 ±  3%  perf-profile.self.cycles-pp.copy_page
      0.34 ± 17%      -0.2        0.10 ±  8%  perf-profile.self.cycles-pp.timekeeping_max_deferment
      0.62 ±  8%      -0.2        0.42 ±  3%  perf-profile.self.cycles-pp.rwsem_optimistic_spin
      0.76 ±  5%      -0.2        0.56 ± 11%  perf-profile.self.cycles-pp.read_extent_buffer
      0.20 ± 18%      -0.1        0.07 ± 11%  perf-profile.self.cycles-pp.tick_nohz_next_event
      0.59 ±  7%      -0.1        0.46 ±  6%  perf-profile.self.cycles-pp.poll_idle
      0.24            -0.1        0.12 ±  3%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.53 ±  9%      -0.1        0.42 ± 11%  perf-profile.self.cycles-pp.check_extent_data_item
      0.50 ± 11%      -0.1        0.39 ± 13%  perf-profile.self.cycles-pp.btrfs_get_8
      0.48 ±  4%      -0.1        0.38 ± 11%  perf-profile.self.cycles-pp.btrfs_set_token_32
      0.49 ± 10%      -0.1        0.39 ±  3%  perf-profile.self.cycles-pp.unwind_next_frame
      0.13 ±  5%      -0.1        0.03 ±102%  perf-profile.self.cycles-pp.ktime_get_update_offsets_now
      0.33 ±  9%      -0.1        0.24 ±  6%  perf-profile.self.cycles-pp.__orc_find
      0.22 ±  8%      -0.1        0.13 ±  3%  perf-profile.self.cycles-pp.native_sched_clock
      0.15 ±  3%      -0.1        0.07 ±  6%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.20 ±  8%      -0.1        0.11 ±  6%  perf-profile.self.cycles-pp.read_tsc
      0.40 ±  8%      -0.1        0.32 ±  2%  perf-profile.self.cycles-pp.add_delayed_ref_head
      0.11 ± 12%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp.update_process_times
      0.22 ± 10%      -0.1        0.14 ± 14%  perf-profile.self.cycles-pp.do_idle
      0.21 ±  4%      -0.1        0.13 ± 13%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.10 ± 12%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.20 ±  4%      -0.1        0.14 ±  5%  perf-profile.self.cycles-pp.update_rq_clock
      0.46 ±  2%      -0.1        0.40 ±  6%  perf-profile.self.cycles-pp.btrfs_get_token_32
      0.49 ±  4%      -0.1        0.43 ±  7%  perf-profile.self.cycles-pp.btrfs_comp_cpu_keys
      0.11 ±  9%      -0.1        0.06 ±  9%  perf-profile.self.cycles-pp.calc_global_load_tick
      0.31 ±  9%      -0.0        0.26 ±  5%  perf-profile.self.cycles-pp.__schedule
      0.11 ± 14%      -0.0        0.06 ±  7%  perf-profile.self.cycles-pp.io_serial_in
      0.09 ± 17%      -0.0        0.04 ± 58%  perf-profile.self.cycles-pp.check_prev_ino
      0.18 ±  7%      -0.0        0.13 ± 12%  perf-profile.self.cycles-pp.set_next_entity
      0.07 ±  7%      -0.0        0.03 ±100%  perf-profile.self.cycles-pp.btrfs_del_items
      0.08 ± 10%      -0.0        0.04 ± 58%  perf-profile.self.cycles-pp.xas_set_mark
      0.15 ± 12%      -0.0        0.12 ±  7%  perf-profile.self.cycles-pp.__switch_to
      0.11 ± 20%      -0.0        0.08 ± 11%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.15 ±  5%      -0.0        0.12 ± 12%  perf-profile.self.cycles-pp.setup_items_for_insert
      0.14 ±  8%      -0.0        0.11 ±  3%  perf-profile.self.cycles-pp.stack_trace_save_tsk
      0.11 ± 11%      -0.0        0.09 ±  4%  perf-profile.self.cycles-pp.filemap_fault
      0.06 ± 16%      +0.0        0.09        perf-profile.self.cycles-pp.free_extent_map
      0.17 ± 10%      +0.0        0.21 ± 12%  perf-profile.self.cycles-pp.up_read
      0.15 ±  9%      +0.0        0.20 ±  7%  perf-profile.self.cycles-pp.rb_next
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.test_range_bit
      0.01 ±173%      +0.1        0.07 ± 13%  perf-profile.self.cycles-pp.__list_add_valid
      0.00            +0.1        0.05 ±  9%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.00            +0.1        0.06 ± 11%  perf-profile.self.cycles-pp.btrfs_buffer_uptodate
      0.00            +0.1        0.06 ±  6%  perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      0.00            +0.1        0.07 ± 12%  perf-profile.self.cycles-pp.unlock_page
      0.00            +0.1        0.08 ± 12%  perf-profile.self.cycles-pp.isolate_lru_pages
      0.16 ±  5%      +0.1        0.24 ±  5%  perf-profile.self.cycles-pp.rb_erase
      0.00            +0.1        0.10 ±  9%  perf-profile.self.cycles-pp.page_referenced_one
      0.36 ±  4%      +0.1        0.46 ±  8%  perf-profile.self.cycles-pp.down_read
      0.00            +0.1        0.10 ± 10%  perf-profile.self.cycles-pp.split_state
      0.00            +0.1        0.10 ±  8%  perf-profile.self.cycles-pp.page_mapping
      0.04 ± 58%      +0.1        0.15 ± 23%  perf-profile.self.cycles-pp.queued_write_lock_slowpath
      0.00            +0.1        0.12 ± 10%  perf-profile.self.cycles-pp.__isolate_lru_page
      0.11 ±  7%      +0.1        0.24 ±  8%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.00            +0.1        0.14 ±  5%  perf-profile.self.cycles-pp.move_pages_to_lru
      0.00            +0.2        0.18 ± 10%  perf-profile.self.cycles-pp.shrink_page_list
      0.00            +0.2        0.20 ± 16%  perf-profile.self.cycles-pp.xas_create
      1.58 ±  6%      +0.5        2.10 ±  6%  perf-profile.self.cycles-pp.__etree_search
      0.00            +0.7        0.73 ±  5%  perf-profile.self.cycles-pp.page_vma_mapped_walk
      1.42 ±  5%      +0.7        2.15 ±  7%  perf-profile.self.cycles-pp.__lookup_extent_mapping
      3.54 ±  8%      +9.2       12.75 ± 26%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath


                                                                                
                                fio.latency_500us_                              
                                                                                
    3 +---------------------------------------------------------------------+   
      |   O           O                                                     |   
  2.5 |O+  O  O O  O         O                     O  O                     |   
      |  O  O            O     O         O  O     O O                       |   
      |        O        O  O      O OO       O         OO  O O              |   
    2 |-+        O        O     O  O   OO O   O          O  O   O  O        |   
      |             O         O                O O                O         |   
  1.5 |-+                                                     O  O   O      |   
      |                                                                     |   
    1 |-+                                                                   |   
      |                                                                     |   
      |                                   +.                                |   
  0.5 |+.+  +.++++.  ++.+  +.++++.  ++.+  : ++++.  ++.+     +++.++++.++++.++|   
      |   ++       ++    ++       ++    ++       ++    +++.+                |   
    0 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                               fio.time.system_time                             
                                                                                
  600 +---------------------------------------------------------------------+   
      |                                                          OOO        |   
  550 |-+                                                            O      |   
  500 |-+                                                                   |   
      |                                                                     |   
  450 |-+ O                                                                 |   
  400 |O+O OO OOOO                O O              O  O    O O  O           |   
      |            OOOO OOOO OOOO  O O O OO  OOO OO O  OOO  O O             |   
  350 |-+                               O   O                               |   
  300 |-+                                                                   |   
      |                                                                     |   
  250 |-+                                 +.+               +++.++++.++++.++|   
  200 |+.   +.  +     +.       +     +.   :  :+     +.      :               |   
      |  +++  ++ +.+++  ++++.++ +.+++  +++   + +.+++  ++++.+                |   
  150 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                       fio.time.percent_of_cpu_this_job_got                     
                                                                                
  350 +---------------------------------------------------------------------+   
      |                                                                     |   
      |                                                           O         |   
  300 |-+                                                        O O O      |   
      |                                                                     |   
      |                                                                     |   
  250 |-+                                                                   |   
      |   O   O O                                                           |   
  200 |O+O OO  O O O OO O  O O    O OO O      O   OOO OOOO OOOO O           |   
      |             O    OO   OOO  O    OOO OO O O                          |   
      |                                                                     |   
  150 |-+                                                                   |   
      |                                   +.+               +++.++++.++++.++|   
      |                                   :  :              :               |   
  100 +---------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Oliver Sang


View attachment "config-5.10.0-rc6-00185-g5951248cb0a0" of type "text/plain" (170131 bytes)

View attachment "job-script" of type "text/plain" (8451 bytes)

View attachment "job.yaml" of type "text/plain" (5935 bytes)

View attachment "reproduce" of type "text/plain" (909 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ