lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <20201124031558.GA7136@xsang-OptiPlex-9020>
Date:   Tue, 24 Nov 2020 11:15:58 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Waiman Long <longman@...hat.com>
Cc:     Peter Zijlstra <peterz@...radead.org>,
        Ingo Molnar <mingo@...hat.com>, Will Deacon <will@...nel.org>,
        linux-kernel@...r.kernel.org, Davidlohr Bueso <dave@...olabs.net>,
        Phil Auld <pauld@...hat.com>, Waiman Long <longman@...hat.com>,
        0day robot <lkp@...el.com>, lkp@...ts.01.org,
        ying.huang@...el.com, feng.tang@...el.com, zhengjun.xing@...el.com
Subject: [locking/rwsem]  c9847a7f94:  aim7.jobs-per-min -91.8% regression


Greeting,

FYI, we noticed a -91.8% regression of aim7.jobs-per-min due to commit:


commit: c9847a7f94679e742710574a2a7fee1c30c5ecf0 ("[PATCH v2 4/5] locking/rwsem: Wake up all waiting readers if RWSEM_WAKE_READ_OWNED")
url: https://github.com/0day-ci/linux/commits/Waiman-Long/locking-rwsem-Rework-reader-optimistic-spinning/20201121-122118
base: https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git 932f8c64d38bb08f69c8c26a2216ba0c36c6daa8

in testcase: aim7
on test machine: 96 threads Intel(R) Xeon(R) Platinum 8260L CPU @ 2.40GHz with 128G memory
with following parameters:

	disk: 4BRD_12G
	md: RAID0
	fs: f2fs
	test: sync_disk_rw
	load: 100
	cpufreq_governor: performance
	ucode: 0x4003003

test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/

In addition to that, the commit also has significant impact on the following tests:

+------------------+-------------------------------------------------------------------+
| testcase: change | unixbench: unixbench.score -1.9% regression                       |
| test machine     | 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory |
| test parameters  | cpufreq_governor=performance                                      |
|                  | nr_task=30%                                                       |
|                  | runtime=300s                                                      |
|                  | test=shell8                                                       |
|                  | ucode=0xde                                                        |
+------------------+-------------------------------------------------------------------+
| testcase: change | fio-basic: boot-time.dhcp 1.5% regression                         |
| test machine     | 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory       |
| test parameters  | bs=4k                                                             |
|                  | cpufreq_governor=performance                                      |
|                  | disk=1SSD                                                         |
|                  | fs=xfs                                                            |
|                  | ioengine=sync                                                     |
|                  | nr_task=32                                                        |
|                  | runtime=300s                                                      |
|                  | rw=randwrite                                                      |
|                  | test_size=256g                                                    |
|                  | ucode=0x4003003                                                   |
+------------------+-------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/4BRD_12G/f2fs/x86_64-rhel-8.3/100/RAID0/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp2/sync_disk_rw/aim7/0x4003003

commit: 
  62d5313500 ("locking/rwsem: Enable reader optimistic lock stealing")
  c9847a7f94 ("locking/rwsem: Wake up all waiting readers if RWSEM_WAKE_READ_OWNED")

62d5313500ac58b6 c9847a7f94679e742710574a2a7 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      8183           -91.8%     670.67 ±  2%  aim7.jobs-per-min
     73.37         +1120.4%     895.35 ±  2%  aim7.time.elapsed_time
     73.37         +1120.4%     895.35 ±  2%  aim7.time.elapsed_time.max
  87129598            -6.7%   81275468        aim7.time.file_system_outputs
   1448254           +90.4%    2757646        aim7.time.involuntary_context_switches
      9577          +175.6%      26393 ±  6%  aim7.time.minor_page_faults
    595.56          +746.0%       5038 ±  2%  aim7.time.system_time
  24062906           +16.1%   27942139        aim7.time.voluntary_context_switches
     91.22            +2.4%      93.44        iostat.cpu.idle
      8.60           -24.0%       6.54        iostat.cpu.system
    110.50          +744.5%     933.15 ±  2%  uptime.boot
      9659          +765.7%      83622 ±  2%  uptime.idle
      0.80 ±  2%      -0.1        0.67 ±  2%  mpstat.cpu.all.irq%
      0.07 ±  5%      -0.0        0.05 ±  2%  mpstat.cpu.all.soft%
      7.93            -2.1        5.83        mpstat.cpu.all.sys%
      0.17 ±  4%      -0.2        0.02 ±  2%  mpstat.cpu.all.usr%
 1.286e+08 ± 55%   +2555.5%  3.415e+09 ±106%  cpuidle.C1.time
   3750293 ± 73%    +947.8%   39295011 ± 90%  cpuidle.C1.usage
  72870517 ± 49%  +27824.2%  2.035e+10 ±128%  cpuidle.C6.time
    115860 ± 26%  +18644.3%   21717212 ±122%  cpuidle.C6.usage
    132759 ± 12%   +1186.3%    1707686 ±144%  cpuidle.POLL.usage
     91.00            +2.2%      93.00        vmstat.cpu.id
    564823           -92.0%      45042 ±  2%  vmstat.io.bo
      7.25 ± 11%     -31.0%       5.00        vmstat.procs.r
    747964           -89.6%      77847 ±  2%  vmstat.system.cs
    200863            -4.3%     192165        vmstat.system.in
     19990 ±  2%     +23.8%      24746 ±  3%  meminfo.Active
     17246 ±  3%     +25.3%      21611 ±  3%  meminfo.Active(anon)
     59295 ±  7%    +208.0%     182605        meminfo.AnonHugePages
     59070 ±  4%     -29.0%      41922 ±  2%  meminfo.Dirty
     95815           +14.6%     109848        meminfo.Inactive(file)
     27037 ±  2%     +17.4%      31737 ±  2%  meminfo.Shmem
    527416           -92.2%      41368 ±  2%  meminfo.max_used_kB
     26522 ± 64%    +381.1%     127588 ± 30%  numa-meminfo.node0.AnonHugePages
     30316 ±  4%     -30.3%      21143 ±  2%  numa-meminfo.node0.Dirty
     48795           +12.9%      55113 ±  2%  numa-meminfo.node0.Inactive(file)
     10871           -20.9%       8604 ± 11%  numa-meminfo.node0.KernelStack
      6158 ±  4%     -51.1%       3010 ± 49%  numa-meminfo.node0.PageTables
      1865 ± 29%    +428.6%       9858 ± 22%  numa-meminfo.node0.Shmem
     29502 ±  3%     -29.2%      20881        numa-meminfo.node1.Dirty
     47049           +16.3%      54722        numa-meminfo.node1.Inactive(file)
      7877 ±  4%     -33.1%       5268 ±  2%  numa-vmstat.node0.nr_dirty
     12224           +12.7%      13780 ±  2%  numa-vmstat.node0.nr_inactive_file
     10876 ±  2%     -20.9%       8605 ± 11%  numa-vmstat.node0.nr_kernel_stack
      1542 ±  4%     -51.2%     752.25 ± 49%  numa-vmstat.node0.nr_page_table_pages
    466.00 ± 29%    +428.9%       2464 ± 22%  numa-vmstat.node0.nr_shmem
    120.25 ± 10%     -88.4%      14.00 ± 23%  numa-vmstat.node0.nr_writeback
     12225           +12.7%      13780 ±  2%  numa-vmstat.node0.nr_zone_inactive_file
      6324           -14.7%       5396 ±  2%  numa-vmstat.node0.nr_zone_write_pending
   3076324 ±  2%     +24.3%    3823329 ±  3%  numa-vmstat.node0.numa_hit
   3057907 ±  2%     +21.3%    3710333 ±  4%  numa-vmstat.node0.numa_local
   2323931            +9.4%    2541694 ±  3%  numa-vmstat.node1.nr_dirtied
      7621 ±  2%     -31.7%       5208        numa-vmstat.node1.nr_dirty
     11735           +16.6%      13686        numa-vmstat.node1.nr_inactive_file
      4524 ±  3%     -19.9%       3623 ± 17%  numa-vmstat.node1.nr_mapped
    119.50 ±  9%     -89.1%      13.00 ±  5%  numa-vmstat.node1.nr_writeback
   2310921            +9.4%    2527480 ±  3%  numa-vmstat.node1.nr_written
     11735           +16.6%      13686        numa-vmstat.node1.nr_zone_inactive_file
      6241 ±  2%     -14.4%       5341        numa-vmstat.node1.nr_zone_write_pending
   3089061 ±  2%     +14.8%    3545531 ±  5%  numa-vmstat.node1.numa_hit
   2927335 ±  3%     +18.8%    3477808 ±  5%  numa-vmstat.node1.numa_local
    161726 ± 10%     -58.1%      67723 ± 94%  numa-vmstat.node1.numa_other
      3783           +25.9%       4764 ±  2%  slabinfo.dmaengine-unmap-16.active_objs
      3783           +25.9%       4764 ±  2%  slabinfo.dmaengine-unmap-16.num_objs
      1036 ±  5%     +12.6%       1167 ±  4%  slabinfo.ext4_extent_status.active_objs
      1036 ±  5%     +12.6%       1167 ±  4%  slabinfo.ext4_extent_status.num_objs
      4130           +16.8%       4823        slabinfo.ext4_fc_dentry_update.active_objs
      4130           +16.8%       4823        slabinfo.ext4_fc_dentry_update.num_objs
      5187           +16.9%       6062        slabinfo.ext4_io_end.active_objs
      5187           +16.9%       6062        slabinfo.ext4_io_end.num_objs
     10436           +19.0%      12417        slabinfo.ext4_pending_reservation.active_objs
     10436           +19.0%      12417        slabinfo.ext4_pending_reservation.num_objs
     19809           +13.9%      22567        slabinfo.f2fs_free_nid.active_objs
     19809           +13.9%      22567        slabinfo.f2fs_free_nid.num_objs
      2297           +16.4%       2674        slabinfo.f2fs_inode_cache.active_objs
      2297           +16.4%       2674        slabinfo.f2fs_inode_cache.num_objs
      3158           +16.8%       3688        slabinfo.f2fs_xattr_entry-9:0.active_objs
      3158           +16.8%       3688        slabinfo.f2fs_xattr_entry-9:0.num_objs
     31314 ±  4%     +22.9%      38490 ±  2%  slabinfo.filp.active_objs
    983.75 ±  4%     +22.6%       1206 ±  2%  slabinfo.filp.active_slabs
     31497 ±  4%     +22.6%      38610 ±  2%  slabinfo.filp.num_objs
    983.75 ±  4%     +22.6%       1206 ±  2%  slabinfo.filp.num_slabs
      1457 ±  5%      +9.2%       1590 ±  3%  slabinfo.khugepaged_mm_slot.active_objs
      1457 ±  5%      +9.2%       1590 ±  3%  slabinfo.khugepaged_mm_slot.num_objs
    696.00 ±  3%    +109.2%       1456 ± 33%  slabinfo.kmalloc-rcl-128.active_objs
      1115 ±  5%     +18.5%       1322 ±  8%  slabinfo.task_group.active_objs
      1115 ±  5%     +18.5%       1322 ±  8%  slabinfo.task_group.num_objs
      9806           +76.0%      17259        slabinfo.vmap_area.active_objs
    152.75           +93.6%     295.75        slabinfo.vmap_area.active_slabs
      9815           +93.2%      18963        slabinfo.vmap_area.num_objs
    152.75           +93.6%     295.75        slabinfo.vmap_area.num_slabs
      4303 ±  2%     +25.5%       5402 ±  3%  proc-vmstat.nr_active_anon
    686.00           +14.2%     783.25 ± 18%  proc-vmstat.nr_active_file
     58813            -2.0%      57631        proc-vmstat.nr_anon_pages
  10873317            -6.6%   10159153        proc-vmstat.nr_dirtied
     15057 ±  3%     -30.4%      10481 ±  2%  proc-vmstat.nr_dirty
    287777            +1.7%     292579        proc-vmstat.nr_file_pages
     61236            -1.9%      60070        proc-vmstat.nr_inactive_anon
     23951           +14.7%      27464        proc-vmstat.nr_inactive_file
     18130            -8.1%      16669        proc-vmstat.nr_kernel_stack
      7648            -3.7%       7364        proc-vmstat.nr_mapped
      2014 ±  2%     -10.7%       1799 ±  2%  proc-vmstat.nr_page_table_pages
      6751           +17.5%       7933 ±  2%  proc-vmstat.nr_shmem
     32387            +4.9%      33958        proc-vmstat.nr_slab_reclaimable
     48453            +1.6%      49217        proc-vmstat.nr_slab_unreclaimable
    167.75 ±  7%     -89.4%      17.75 ± 16%  proc-vmstat.nr_writeback
  10819249            -6.5%   10112523        proc-vmstat.nr_written
      4303 ±  2%     +25.5%       5402 ±  3%  proc-vmstat.nr_zone_active_anon
    686.00           +14.2%     783.25 ± 18%  proc-vmstat.nr_zone_active_file
     61236            -1.9%      60070        proc-vmstat.nr_zone_inactive_anon
     23951           +14.7%      27464        proc-vmstat.nr_zone_inactive_file
     12619 ±  2%     -14.8%      10750 ±  2%  proc-vmstat.nr_zone_write_pending
      5462 ± 48%    +320.9%      22990 ± 22%  proc-vmstat.numa_hint_faults
      2501 ± 75%    +456.7%      13926 ± 16%  proc-vmstat.numa_hint_faults_local
  11076268            +8.6%   12026224        proc-vmstat.numa_hit
  11045187            +8.6%   11995001        proc-vmstat.numa_local
  11143370            +8.9%   12140200        proc-vmstat.pgalloc_normal
    255571 ±  2%    +903.4%    2564404 ±  2%  proc-vmstat.pgfault
   1738243           +98.5%    3450189        proc-vmstat.pgfree
  43286180            -6.5%   40452677        proc-vmstat.pgpgout
     16566          +940.1%     172308 ±  2%  proc-vmstat.pgreuse
      2604          +849.8%      24740 ±  4%  sched_debug.cfs_rq:/.exec_clock.avg
      4411 ±  2%    +569.2%      29523 ±  2%  sched_debug.cfs_rq:/.exec_clock.max
      2452          +629.8%      17895 ±  5%  sched_debug.cfs_rq:/.exec_clock.min
    276.44 ±  6%    +522.5%       1720 ±  7%  sched_debug.cfs_rq:/.exec_clock.stddev
     35.17 ± 25%     -62.6%      13.14 ±  6%  sched_debug.cfs_rq:/.load_avg.avg
    829.50 ± 24%     -70.5%     244.99 ± 10%  sched_debug.cfs_rq:/.load_avg.max
    128.41 ± 25%     -66.5%      43.06 ±  7%  sched_debug.cfs_rq:/.load_avg.stddev
     38331 ±  2%    +313.4%     158467 ±  3%  sched_debug.cfs_rq:/.min_vruntime.avg
     54684 ±  5%    +237.1%     184348 ±  2%  sched_debug.cfs_rq:/.min_vruntime.max
     31946 ±  2%    +275.9%     120088 ±  4%  sched_debug.cfs_rq:/.min_vruntime.min
      3408 ±  9%    +201.0%      10260 ±  3%  sched_debug.cfs_rq:/.min_vruntime.stddev
      0.15 ± 11%     -43.1%       0.09 ±  5%  sched_debug.cfs_rq:/.nr_running.avg
      0.36 ±  4%     -23.4%       0.28 ±  2%  sched_debug.cfs_rq:/.nr_running.stddev
      0.03 ± 48%   +2800.1%       0.83 ±  5%  sched_debug.cfs_rq:/.nr_spread_over.avg
      1.25 ± 34%    +179.2%       3.49 ± 35%  sched_debug.cfs_rq:/.nr_spread_over.max
      0.17 ± 26%    +229.1%       0.57 ± 20%  sched_debug.cfs_rq:/.nr_spread_over.stddev
    238.12 ±  2%     -66.5%      79.88 ±  2%  sched_debug.cfs_rq:/.runnable_avg.avg
    944.38 ±  7%     -25.8%     700.31 ±  3%  sched_debug.cfs_rq:/.runnable_avg.max
    215.30 ±  8%     -26.5%     158.18 ±  6%  sched_debug.cfs_rq:/.runnable_avg.stddev
    508.65 ±723%   +6944.4%      35831 ± 11%  sched_debug.cfs_rq:/.spread0.avg
     16857 ± 18%    +266.1%      61714 ±  8%  sched_debug.cfs_rq:/.spread0.max
      3407 ±  9%    +201.1%      10261 ±  3%  sched_debug.cfs_rq:/.spread0.stddev
    236.63 ±  2%     -66.4%      79.55 ±  2%  sched_debug.cfs_rq:/.util_avg.avg
    944.38 ±  7%     -25.9%     700.12 ±  3%  sched_debug.cfs_rq:/.util_avg.max
    214.62 ±  7%     -26.4%     158.07 ±  6%  sched_debug.cfs_rq:/.util_avg.stddev
     24.12 ± 16%     -71.7%       6.83 ± 11%  sched_debug.cfs_rq:/.util_est_enqueued.avg
     79.73 ± 13%     -51.1%      39.02 ± 14%  sched_debug.cfs_rq:/.util_est_enqueued.stddev
    480279           -15.3%     406677 ±  2%  sched_debug.cpu.avg_idle.avg
    195746 ±  4%     +67.0%     326826 ±  3%  sched_debug.cpu.avg_idle.stddev
     65779          +593.8%     456360 ±  4%  sched_debug.cpu.clock.avg
     65785          +593.7%     456364 ±  4%  sched_debug.cpu.clock.max
     65773          +593.8%     456355 ±  4%  sched_debug.cpu.clock.min
      3.51 ± 12%     -23.9%       2.67 ±  2%  sched_debug.cpu.clock.stddev
     65382          +593.1%     453170 ±  4%  sched_debug.cpu.clock_task.avg
     65543          +591.9%     453506 ±  4%  sched_debug.cpu.clock_task.max
     60300          +642.6%     447801 ±  4%  sched_debug.cpu.clock_task.min
    598.98 ±  3%     +12.6%     674.28 ±  4%  sched_debug.cpu.clock_task.stddev
      3474          +277.9%      13129 ±  4%  sched_debug.cpu.curr->pid.max
    859.33 ±  6%     +88.6%       1620 ±  2%  sched_debug.cpu.curr->pid.stddev
    714713 ± 11%     -26.3%     526858        sched_debug.cpu.max_idle_balance_cost.max
     24781 ± 39%     -85.9%       3496 ± 27%  sched_debug.cpu.max_idle_balance_cost.stddev
      0.12 ±  7%     -34.1%       0.08 ±  2%  sched_debug.cpu.nr_running.avg
      0.34 ±  5%     -18.9%       0.27        sched_debug.cpu.nr_running.stddev
    232828           +44.6%     336611 ±  3%  sched_debug.cpu.nr_switches.avg
    271544 ±  5%     +43.2%     388935 ±  9%  sched_debug.cpu.nr_switches.max
    214594           +40.2%     300793 ±  2%  sched_debug.cpu.nr_switches.min
      0.47 ±  2%     +94.4%       0.92        sched_debug.cpu.nr_uninterruptible.avg
     36.50 ± 27%   +1017.2%     407.77 ±  3%  sched_debug.cpu.nr_uninterruptible.max
    -18.50          +321.3%     -77.94        sched_debug.cpu.nr_uninterruptible.min
      8.88 ± 11%    +590.1%      61.27 ±  3%  sched_debug.cpu.nr_uninterruptible.stddev
    231916           +44.5%     335202 ±  3%  sched_debug.cpu.sched_count.avg
    265672 ±  4%     +45.7%     386970 ± 10%  sched_debug.cpu.sched_count.max
    214641           +36.0%     291906 ±  3%  sched_debug.cpu.sched_count.min
    101196           +42.6%     144272 ±  3%  sched_debug.cpu.sched_goidle.avg
    106057           +46.5%     155382 ±  3%  sched_debug.cpu.sched_goidle.max
     97637           +28.7%     125626 ±  3%  sched_debug.cpu.sched_goidle.min
      1506 ± 12%    +188.0%       4339 ±  6%  sched_debug.cpu.sched_goidle.stddev
    117938           +43.0%     168603 ±  3%  sched_debug.cpu.ttwu_count.avg
    153830 ±  7%     +47.5%     226894 ± 21%  sched_debug.cpu.ttwu_count.max
     96129 ±  3%     +51.9%     146054 ±  2%  sched_debug.cpu.ttwu_count.min
     14465           +74.2%      25205 ±  3%  sched_debug.cpu.ttwu_local.avg
     27168 ± 16%     +60.3%      43545 ± 32%  sched_debug.cpu.ttwu_local.max
      7181 ±  6%    +184.5%      20433 ±  3%  sched_debug.cpu.ttwu_local.min
     65775          +593.8%     456355 ±  4%  sched_debug.cpu_clk
     65278          +598.3%     455859 ±  4%  sched_debug.ktime
     66120          +590.7%     456712 ±  4%  sched_debug.sched_clk
     11.50           -71.9%       3.23 ±  3%  perf-stat.i.MPKI
 2.791e+09           -40.1%  1.671e+09        perf-stat.i.branch-instructions
      1.46            -1.1        0.40 ±  5%  perf-stat.i.branch-miss-rate%
  32652551 ±  2%     -80.3%    6434530 ±  5%  perf-stat.i.branch-misses
     26.05            -5.9       20.19 ±  2%  perf-stat.i.cache-miss-rate%
  44628231           -89.3%    4769722 ±  2%  perf-stat.i.cache-misses
 1.567e+08           -85.0%   23447881 ±  3%  perf-stat.i.cache-references
    772578           -89.9%      77784 ±  2%  perf-stat.i.context-switches
      2.36           +24.8%       2.94        perf-stat.i.cpi
  3.12e+10           -31.6%  2.135e+10        perf-stat.i.cpu-cycles
      4527 ±  2%     -79.6%     924.77        perf-stat.i.cpu-migrations
      1510 ±  4%    +221.3%       4853        perf-stat.i.cycles-between-cache-misses
      0.10 ±  3%      -0.1        0.01 ± 17%  perf-stat.i.dTLB-load-miss-rate%
   3488578 ±  3%     -94.5%     191633 ± 15%  perf-stat.i.dTLB-load-misses
 3.232e+09           -45.2%   1.77e+09        perf-stat.i.dTLB-loads
      0.01 ± 10%      -0.0        0.00 ± 21%  perf-stat.i.dTLB-store-miss-rate%
    130165 ± 11%     -87.1%      16745 ± 21%  perf-stat.i.dTLB-store-misses
 1.357e+09           -75.3%  3.355e+08        perf-stat.i.dTLB-stores
     38.11            +7.2       45.30        perf-stat.i.iTLB-load-miss-rate%
   6970161           -68.0%    2229042        perf-stat.i.iTLB-load-misses
  12096922           -77.7%    2703576        perf-stat.i.iTLB-loads
 1.278e+10           -43.3%   7.25e+09        perf-stat.i.instructions
      1952           +67.8%       3276        perf-stat.i.instructions-per-iTLB-miss
      0.45           -24.3%       0.34        perf-stat.i.ipc
      1.47 ±  3%     -91.0%       0.13 ±  2%  perf-stat.i.major-faults
      0.32           -31.6%       0.22        perf-stat.i.metric.GHz
      0.29 ±  9%    +386.4%       1.42 ±  2%  perf-stat.i.metric.K/sec
     78.95           -49.8%      39.63        perf-stat.i.metric.M/sec
      3180           -12.1%       2795        perf-stat.i.minor-faults
  19311689           -91.0%    1733499 ±  2%  perf-stat.i.node-load-misses
   1888231 ±  2%     -90.0%     189573 ±  3%  perf-stat.i.node-loads
     88.88            +1.1       90.01        perf-stat.i.node-store-miss-rate%
   6646273           -91.1%     593107 ±  2%  perf-stat.i.node-store-misses
    711946           -90.8%      65302 ±  3%  perf-stat.i.node-stores
      3181           -12.1%       2795        perf-stat.i.page-faults
     12.26           -73.6%       3.23 ±  3%  perf-stat.overall.MPKI
      1.17            -0.8        0.39 ±  5%  perf-stat.overall.branch-miss-rate%
     28.48            -8.1       20.36 ±  3%  perf-stat.overall.cache-miss-rate%
      2.44           +20.6%       2.95        perf-stat.overall.cpi
    699.29          +540.4%       4478        perf-stat.overall.cycles-between-cache-misses
      0.11 ±  3%      -0.1        0.01 ± 15%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ± 11%      -0.0        0.00 ± 21%  perf-stat.overall.dTLB-store-miss-rate%
     36.56            +8.6       45.19        perf-stat.overall.iTLB-load-miss-rate%
      1833           +77.4%       3252        perf-stat.overall.instructions-per-iTLB-miss
      0.41           -17.1%       0.34        perf-stat.overall.ipc
     91.09            -0.9       90.14        perf-stat.overall.node-load-miss-rate%
 2.752e+09           -39.4%  1.669e+09        perf-stat.ps.branch-instructions
  32218020 ±  2%     -80.0%    6429298 ±  5%  perf-stat.ps.branch-misses
  43997213           -89.2%    4764687 ±  2%  perf-stat.ps.cache-misses
 1.545e+08           -84.8%   23423214 ±  3%  perf-stat.ps.cache-references
    761608           -89.8%      77694 ±  2%  perf-stat.ps.context-switches
     94708            +1.2%      95891        perf-stat.ps.cpu-clock
 3.076e+10           -30.7%  2.133e+10        perf-stat.ps.cpu-cycles
      4463 ±  2%     -79.3%     923.71        perf-stat.ps.cpu-migrations
   3438964 ±  3%     -94.4%     191430 ± 15%  perf-stat.ps.dTLB-load-misses
 3.187e+09           -44.5%  1.768e+09        perf-stat.ps.dTLB-loads
    128359 ± 11%     -87.0%      16732 ± 21%  perf-stat.ps.dTLB-store-misses
 1.338e+09           -75.0%  3.351e+08        perf-stat.ps.dTLB-stores
   6872737           -67.6%    2226542        perf-stat.ps.iTLB-load-misses
  11926601           -77.4%    2700513        perf-stat.ps.iTLB-loads
  1.26e+10           -42.5%  7.242e+09        perf-stat.ps.instructions
      1.45 ±  3%     -90.9%       0.13 ±  2%  perf-stat.ps.major-faults
      3138           -11.0%       2792        perf-stat.ps.minor-faults
  19037965           -90.9%    1731590 ±  2%  perf-stat.ps.node-load-misses
   1861551 ±  2%     -89.8%     189374 ±  3%  perf-stat.ps.node-loads
   6552105           -91.0%     592467 ±  2%  perf-stat.ps.node-store-misses
    701901           -90.7%      65238 ±  3%  perf-stat.ps.node-stores
      3140           -11.1%       2792        perf-stat.ps.page-faults
     94708            +1.2%      95891        perf-stat.ps.task-clock
 9.429e+11          +588.7%  6.493e+12 ±  2%  perf-stat.total.instructions
     18999 ± 13%     +57.9%      30005 ±  8%  softirqs.CPU0.RCU
     13831 ±  2%    +726.1%     114266 ±  3%  softirqs.CPU0.SCHED
     16966 ± 12%     +67.2%      28360 ±  6%  softirqs.CPU1.RCU
     11764 ±  3%    +810.4%     107101 ±  3%  softirqs.CPU1.SCHED
     16148 ± 10%     +74.0%      28092 ±  6%  softirqs.CPU10.RCU
     10989          +868.2%     106397 ±  2%  softirqs.CPU10.SCHED
     16629 ± 12%     +68.1%      27956 ±  5%  softirqs.CPU11.RCU
     10731          +885.4%     105746 ±  3%  softirqs.CPU11.SCHED
     16389 ± 10%     +70.5%      27936 ±  6%  softirqs.CPU12.RCU
     10518 ±  6%    +901.4%     105330 ±  2%  softirqs.CPU12.SCHED
     16638 ± 10%     +66.4%      27680 ±  5%  softirqs.CPU13.RCU
     11381 ±  4%    +829.2%     105752 ±  3%  softirqs.CPU13.SCHED
     16492 ±  9%     +66.8%      27503 ±  5%  softirqs.CPU14.RCU
     10741 ±  3%    +880.2%     105290        softirqs.CPU14.SCHED
     16124 ± 11%     +72.3%      27779 ±  5%  softirqs.CPU15.RCU
     11062 ±  3%    +857.4%     105910 ±  3%  softirqs.CPU15.SCHED
     17351 ± 11%     +69.1%      29335 ±  4%  softirqs.CPU16.RCU
     10926 ±  3%    +867.1%     105672 ±  2%  softirqs.CPU16.SCHED
     17274 ± 12%     +69.8%      29339 ±  6%  softirqs.CPU17.RCU
     10769 ±  6%    +879.9%     105528 ±  2%  softirqs.CPU17.SCHED
     17227 ± 11%     +66.8%      28733 ±  5%  softirqs.CPU18.RCU
     10603 ±  4%    +885.1%     104448 ±  3%  softirqs.CPU18.SCHED
     17647 ± 13%     +57.9%      27873 ±  9%  softirqs.CPU19.RCU
     10793 ±  5%    +898.8%     107796 ±  2%  softirqs.CPU19.SCHED
     16485 ± 11%     +66.2%      27399 ±  6%  softirqs.CPU2.RCU
     11446          +827.2%     106124 ±  3%  softirqs.CPU2.SCHED
     17251 ± 12%     +68.7%      29107 ±  4%  softirqs.CPU20.RCU
     10851 ±  3%    +879.2%     106250 ±  2%  softirqs.CPU20.SCHED
     17240 ± 11%     +69.1%      29156 ±  5%  softirqs.CPU21.RCU
     10901 ±  4%    +866.8%     105391 ±  3%  softirqs.CPU21.SCHED
     17395 ± 10%     +68.7%      29341 ±  5%  softirqs.CPU22.RCU
     10518 ±  4%    +911.4%     106385 ±  2%  softirqs.CPU22.SCHED
     17329 ± 11%     +63.4%      28319 ±  4%  softirqs.CPU23.RCU
     11048 ±  3%    +863.7%     106466 ±  2%  softirqs.CPU23.SCHED
     16739 ± 10%     +78.2%      29836 ±  2%  softirqs.CPU24.RCU
     11455 ±  2%    +833.8%     106975 ±  2%  softirqs.CPU24.SCHED
     16813 ± 10%     +70.1%      28597 ±  5%  softirqs.CPU25.RCU
     10649 ±  5%    +879.6%     104327 ±  4%  softirqs.CPU25.SCHED
     16623 ± 10%     +72.8%      28733 ±  4%  softirqs.CPU26.RCU
     11315 ±  3%    +839.2%     106277 ±  2%  softirqs.CPU26.SCHED
     16949 ± 12%     +69.3%      28702 ±  5%  softirqs.CPU27.RCU
     11293 ±  5%    +839.8%     106131 ±  2%  softirqs.CPU27.SCHED
     16695 ± 10%     +77.6%      29654 ±  7%  softirqs.CPU28.RCU
     11089 ±  4%    +859.8%     106432 ±  3%  softirqs.CPU28.SCHED
     16909 ± 10%     +71.5%      29007 ±  4%  softirqs.CPU29.RCU
     10658 ±  8%    +900.1%     106591 ±  3%  softirqs.CPU29.SCHED
     16636 ± 11%     +68.3%      27993 ±  6%  softirqs.CPU3.RCU
     10732 ±  2%    +895.8%     106874 ±  3%  softirqs.CPU3.SCHED
     16336 ± 15%     +74.8%      28554 ±  5%  softirqs.CPU30.RCU
     11252 ±  2%    +844.4%     106258 ±  2%  softirqs.CPU30.SCHED
     16605 ± 11%     +71.3%      28450 ±  6%  softirqs.CPU31.RCU
     10247 ±  7%    +929.3%     105474 ±  2%  softirqs.CPU31.SCHED
     16370 ± 12%     +74.2%      28514 ±  6%  softirqs.CPU32.RCU
     11236          +824.5%     103880 ±  3%  softirqs.CPU32.SCHED
     16600 ± 12%     +70.8%      28345 ±  4%  softirqs.CPU33.RCU
     10916 ±  4%    +867.7%     105632 ±  2%  softirqs.CPU33.SCHED
     16306 ± 11%     +74.9%      28517 ±  4%  softirqs.CPU34.RCU
     10756          +873.2%     104675 ±  2%  softirqs.CPU34.SCHED
     16582 ± 11%     +73.7%      28807 ±  5%  softirqs.CPU35.RCU
     10909 ±  3%    +856.8%     104377        softirqs.CPU35.SCHED
     16432 ± 11%     +75.1%      28769 ±  4%  softirqs.CPU36.RCU
     11042          +853.3%     105264 ±  3%  softirqs.CPU36.SCHED
     16174 ± 10%     +74.0%      28150 ±  5%  softirqs.CPU37.RCU
     10713 ±  6%    +881.7%     105179 ±  3%  softirqs.CPU37.SCHED
     16838 ± 14%     +65.8%      27916 ±  4%  softirqs.CPU38.RCU
     10650 ±  4%    +877.6%     104119 ±  4%  softirqs.CPU38.SCHED
     16743 ± 13%     +68.4%      28200 ±  4%  softirqs.CPU39.RCU
     10472 ±  4%    +907.0%     105456 ±  3%  softirqs.CPU39.SCHED
     16425 ± 11%     +70.3%      27981 ±  5%  softirqs.CPU4.RCU
     11167 ±  4%    +855.0%     106644 ±  2%  softirqs.CPU4.SCHED
     16614 ± 11%     +75.8%      29205 ±  9%  softirqs.CPU40.RCU
     10426 ± 11%    +917.5%     106090 ±  2%  softirqs.CPU40.SCHED
     16536 ± 11%     +72.2%      28472 ±  4%  softirqs.CPU41.RCU
     10699 ±  6%    +879.9%     104842 ±  2%  softirqs.CPU41.SCHED
     16677 ± 11%     +71.0%      28516 ±  4%  softirqs.CPU42.RCU
     11008 ±  3%    +862.6%     105966 ±  2%  softirqs.CPU42.SCHED
     16425 ± 11%     +71.9%      28226 ±  4%  softirqs.CPU43.RCU
     10999 ±  7%    +855.7%     105115 ±  3%  softirqs.CPU43.SCHED
     16376 ± 10%     +72.2%      28198 ±  5%  softirqs.CPU44.RCU
     10963 ±  4%    +868.0%     106127 ±  2%  softirqs.CPU44.SCHED
     16395 ± 12%     +72.3%      28244 ±  4%  softirqs.CPU45.RCU
     11001 ±  4%    +867.9%     106479 ±  2%  softirqs.CPU45.SCHED
     16714 ± 12%     +70.5%      28497 ±  5%  softirqs.CPU46.RCU
     10764 ±  6%    +887.7%     106321 ±  2%  softirqs.CPU46.SCHED
     16736 ± 10%     +70.5%      28543 ±  5%  softirqs.CPU47.RCU
     10325 ±  6%    +922.8%     105602 ±  3%  softirqs.CPU47.SCHED
     15954 ± 12%     +71.1%      27303 ±  6%  softirqs.CPU48.RCU
     11170 ±  5%    +840.8%     105093 ±  6%  softirqs.CPU48.SCHED
     16687 ± 12%     +68.6%      28141 ±  5%  softirqs.CPU49.RCU
     10685 ±  7%    +886.4%     105398 ±  3%  softirqs.CPU49.SCHED
     16470 ± 11%     +71.0%      28160 ±  6%  softirqs.CPU5.RCU
     11290 ±  2%    +841.9%     106341 ±  3%  softirqs.CPU5.SCHED
     16729 ± 11%     +67.2%      27978 ±  4%  softirqs.CPU50.RCU
     10816 ±  3%    +884.2%     106453        softirqs.CPU50.SCHED
     16795 ± 11%     +67.7%      28164 ±  5%  softirqs.CPU51.RCU
     10392 ±  8%    +926.2%     106647 ±  3%  softirqs.CPU51.SCHED
     16750 ± 11%     +69.1%      28328 ±  4%  softirqs.CPU52.RCU
     11200          +841.9%     105493 ±  2%  softirqs.CPU52.SCHED
     16558 ± 11%     +70.2%      28177 ±  5%  softirqs.CPU53.RCU
     10992          +861.6%     105701 ±  2%  softirqs.CPU53.SCHED
     16690 ± 12%     +69.2%      28239 ±  5%  softirqs.CPU54.RCU
     10530 ±  3%    +904.1%     105736 ±  3%  softirqs.CPU54.SCHED
     16401 ± 11%     +69.2%      27745 ±  5%  softirqs.CPU55.RCU
     10735 ±  5%    +886.7%     105928 ±  5%  softirqs.CPU55.SCHED
     16864 ± 12%     +65.7%      27946 ±  5%  softirqs.CPU56.RCU
     10743 ±  5%    +881.5%     105447 ±  3%  softirqs.CPU56.SCHED
     16641 ± 12%     +66.8%      27764 ±  4%  softirqs.CPU57.RCU
     11072 ±  4%    +846.0%     104747        softirqs.CPU57.SCHED
     16750 ± 13%     +67.2%      28004 ±  5%  softirqs.CPU58.RCU
     11138          +859.2%     106841 ±  3%  softirqs.CPU58.SCHED
     16607 ± 11%     +71.2%      28427 ±  5%  softirqs.CPU59.RCU
     10470 ±  7%    +903.2%     105034 ±  4%  softirqs.CPU59.SCHED
     16705 ± 11%     +67.9%      28053 ±  4%  softirqs.CPU6.RCU
     10945 ±  3%    +873.4%     106545 ±  3%  softirqs.CPU6.SCHED
     16628 ± 12%     +68.8%      28061 ±  5%  softirqs.CPU60.RCU
     10796 ±  6%    +865.5%     104239 ±  4%  softirqs.CPU60.SCHED
     16317 ± 12%     +69.0%      27571 ±  4%  softirqs.CPU61.RCU
     10590 ±  4%    +870.2%     102747 ±  4%  softirqs.CPU61.SCHED
     16490 ± 11%     +67.2%      27573 ±  5%  softirqs.CPU62.RCU
     10796 ±  3%    +863.7%     104046 ±  2%  softirqs.CPU62.SCHED
     16779 ± 12%     +67.4%      28094 ±  4%  softirqs.CPU63.RCU
     10155 ±  6%    +934.3%     105042 ±  2%  softirqs.CPU63.SCHED
     17689 ± 11%     +69.1%      29911 ±  5%  softirqs.CPU64.RCU
     10839 ±  2%    +869.2%     105057 ±  2%  softirqs.CPU64.SCHED
     17856 ± 13%     +66.3%      29699 ±  3%  softirqs.CPU65.RCU
     11017 ±  3%    +871.5%     107027 ±  3%  softirqs.CPU65.SCHED
     17448 ± 12%     +68.0%      29312 ±  6%  softirqs.CPU66.RCU
     11019 ±  4%    +835.9%     103135 ±  4%  softirqs.CPU66.SCHED
     17590 ± 11%     +64.9%      29003 ±  4%  softirqs.CPU67.RCU
     10926 ±  3%    +852.9%     104113        softirqs.CPU67.SCHED
     17726 ± 11%     +67.4%      29668 ±  4%  softirqs.CPU68.RCU
     10924 ±  6%    +879.3%     106977 ±  2%  softirqs.CPU68.SCHED
     17706 ± 11%     +68.0%      29749 ±  2%  softirqs.CPU69.RCU
     10670 ±  3%    +883.7%     104970 ±  4%  softirqs.CPU69.SCHED
     16399 ± 10%     +65.1%      27075 ±  5%  softirqs.CPU7.RCU
     10865 ±  3%    +862.7%     104594 ±  2%  softirqs.CPU7.SCHED
     19786 ± 18%     +49.3%      29547 ±  4%  softirqs.CPU70.RCU
     11268 ±  2%    +845.4%     106529        softirqs.CPU70.SCHED
     17910 ± 14%     +61.3%      28887 ±  4%  softirqs.CPU71.RCU
     10911 ± 13%    +887.3%     107726 ±  5%  softirqs.CPU71.SCHED
     16810 ± 11%     +72.8%      29052 ±  5%  softirqs.CPU72.RCU
     10526 ±  6%    +891.9%     104417 ±  4%  softirqs.CPU72.SCHED
     17107 ±  9%     +70.1%      29094 ±  5%  softirqs.CPU73.RCU
     10228 ± 11%    +931.6%     105515 ±  4%  softirqs.CPU73.SCHED
     16867 ± 11%     +72.2%      29054 ±  5%  softirqs.CPU74.RCU
     10500 ±  4%    +899.3%     104938 ±  3%  softirqs.CPU74.SCHED
     17004 ± 12%     +71.2%      29118 ±  5%  softirqs.CPU75.RCU
     10890 ±  3%    +884.5%     107217 ±  3%  softirqs.CPU75.SCHED
     17071 ± 11%     +70.6%      29124 ±  5%  softirqs.CPU76.RCU
     10506 ± 10%    +914.6%     106603 ±  2%  softirqs.CPU76.SCHED
     16750 ± 11%     +73.8%      29105 ±  4%  softirqs.CPU77.RCU
     11767 ±  8%    +809.8%     107060 ±  2%  softirqs.CPU77.SCHED
     17084 ±  9%     +71.6%      29322 ±  4%  softirqs.CPU78.RCU
     11190 ±  2%    +847.6%     106038 ±  2%  softirqs.CPU78.SCHED
     16991 ± 10%     +70.5%      28977 ±  5%  softirqs.CPU79.RCU
     11043 ±  2%    +842.0%     104023 ±  4%  softirqs.CPU79.SCHED
     16433 ± 12%     +68.0%      27616 ±  6%  softirqs.CPU8.RCU
     11061 ±  2%    +850.1%     105092 ±  3%  softirqs.CPU8.SCHED
     16768 ±  8%     +68.7%      28281 ±  7%  softirqs.CPU80.RCU
     11218 ± 13%    +839.4%     105389 ±  4%  softirqs.CPU80.SCHED
     16210 ± 12%     +71.8%      27856 ±  4%  softirqs.CPU81.RCU
     11673 ±  8%    +795.0%     104478 ±  2%  softirqs.CPU81.SCHED
     16165 ± 12%     +72.2%      27839 ±  4%  softirqs.CPU82.RCU
     11321 ±  2%    +815.5%     103642 ±  3%  softirqs.CPU82.SCHED
     16735 ± 14%     +69.5%      28371 ±  4%  softirqs.CPU83.RCU
     11498 ±  8%    +811.1%     104758        softirqs.CPU83.SCHED
    295.25 ±149%   +7682.5%      22977 ±107%  softirqs.CPU84.NET_RX
     16622 ±  9%     +74.2%      28953 ±  5%  softirqs.CPU84.RCU
     10929          +878.5%     106938 ±  2%  softirqs.CPU84.SCHED
    465.00 ±158%   +6432.6%      30376 ± 93%  softirqs.CPU85.NET_RX
     16210 ± 11%     +75.7%      28481 ±  3%  softirqs.CPU85.RCU
     10620 ±  2%    +887.8%     104915 ±  4%  softirqs.CPU85.SCHED
     16164 ± 10%     +73.2%      27992 ±  4%  softirqs.CPU86.RCU
     10768 ±  4%    +857.1%     103066 ±  2%  softirqs.CPU86.SCHED
     16600 ± 14%     +72.0%      28558 ±  6%  softirqs.CPU87.RCU
     11171 ±  6%    +856.9%     106895 ±  3%  softirqs.CPU87.SCHED
     16697 ±  9%     +68.2%      28089 ±  5%  softirqs.CPU88.RCU
     10092 ±  6%    +931.6%     104110 ±  2%  softirqs.CPU88.SCHED
     16127 ± 12%     +74.2%      28100 ±  5%  softirqs.CPU89.RCU
     11243          +836.0%     105234        softirqs.CPU89.SCHED
     16381 ± 11%     +70.3%      27889 ±  5%  softirqs.CPU9.RCU
     11070 ±  4%    +849.4%     105096 ±  2%  softirqs.CPU9.SCHED
     16516 ± 11%     +72.4%      28475 ±  5%  softirqs.CPU90.RCU
     10508 ±  8%    +913.0%     106449 ±  2%  softirqs.CPU90.SCHED
     16181 ± 12%     +75.8%      28447 ±  4%  softirqs.CPU91.RCU
     10861 ±  4%    +864.6%     104766 ±  2%  softirqs.CPU91.SCHED
     16187 ± 10%     +73.0%      27999 ±  4%  softirqs.CPU92.RCU
     11031 ±  2%    +864.9%     106446 ±  2%  softirqs.CPU92.SCHED
     16126 ± 11%     +75.5%      28303 ±  4%  softirqs.CPU93.RCU
     11021 ±  4%    +860.4%     105857 ±  3%  softirqs.CPU93.SCHED
     16441 ±  9%     +72.7%      28400 ±  5%  softirqs.CPU94.RCU
     11138 ±  2%    +849.8%     105792 ±  2%  softirqs.CPU94.SCHED
     16412 ± 10%     +74.1%      28567 ±  4%  softirqs.CPU95.RCU
     10707 ±  4%    +891.4%     106157 ±  3%  softirqs.CPU95.SCHED
      8088 ± 51%   +1114.4%      98220 ± 24%  softirqs.NET_RX
   1610477 ± 11%     +69.8%    2734242 ±  4%  softirqs.RCU
   1049197          +867.0%   10145511 ±  2%  softirqs.SCHED
     20966 ±  7%    +634.8%     154061        softirqs.TIMER
     56.08           -19.9       36.20        perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     55.51           -19.8       35.76        perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     55.50           -19.7       35.76        perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     55.48           -19.7       35.75        perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     47.51           -19.6       27.95        perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     49.60           -17.0       32.59        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     49.77           -16.7       33.06        perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      6.48            -6.5        0.00        perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     26.34            -6.2       20.15 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      5.05 ±  2%      -5.1        0.00        perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
     15.46            -2.1       13.36 ±  8%  perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.41 ± 57%      +0.5        0.91 ±  7%  perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
      1.15 ±  4%      +0.6        1.78 ± 12%  perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.14 ±173%      +0.6        0.78 ±  9%  perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
      0.65 ±  3%      +0.6        1.29 ±  2%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
      0.00            +0.7        0.72 ±  3%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      0.00            +0.7        0.73 ±  4%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      0.00            +0.8        0.83 ±  8%  perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
      0.00            +0.9        0.95 ± 18%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page
      0.00            +1.0        0.97        perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
      1.26 ±  6%      +1.2        2.42 ±  3%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      1.29 ±  5%      +1.2        2.46 ±  3%  perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.29 ±  6%      +1.2        2.46 ±  3%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      8.04            +1.6        9.69 ± 12%  perf-profile.calltrace.cycles-pp.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      2.04 ±  3%      +1.7        3.78 ±  3%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      7.79            +1.9        9.66 ± 12%  perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      2.21 ±  3%      +2.2        4.39 ±  6%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      7.08            +2.4        9.48 ± 12%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages
      0.69            +2.6        3.29 ± 10%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +2.9        2.92 ± 10%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
      6.20            +3.0        9.23 ± 13%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.set_node_addr.__write_node_page
      0.00            +3.2        3.25 ± 10%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
      0.00            +3.6        3.55 ±  6%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_dentry_mark.f2fs_fsync_node_pages
      1.64 ±  2%      +4.0        5.67 ±  8%  perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      0.00            +4.4        4.36 ± 11%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file
      1.28            +4.4        5.64 ±  9%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.00            +5.3        5.27 ±  9%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
      0.91 ±  3%      +5.4        6.34 ±  3%  perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      0.65 ±  3%      +5.7        6.31 ±  3%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
      0.00            +5.9        5.93 ±  3%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
      7.65 ±  2%      +6.9       14.58 ±  6%  perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      7.61 ±  2%      +7.0       14.57 ±  6%  perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
      7.59 ±  2%      +7.0       14.57 ±  6%  perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
      7.59 ±  2%      +7.0       14.57 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.f2fs_do_sync_file
      7.47 ±  2%      +7.1       14.55 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range
      4.51 ±  3%      +9.8       14.27 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.__filemap_fdatawrite_range
      4.33 ±  3%      +9.9       14.25 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
      0.00           +11.8       11.79 ±  8%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page
      1.10 ±  3%     +12.9       13.99 ±  6%  perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
      0.83 ±  4%     +13.1       13.96 ±  6%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
      0.00           +13.6       13.59 ±  7%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
      0.00           +18.4       18.43 ±  5%  perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_is_checkpointed_node.f2fs_do_sync_file
      1.54           +19.7       21.27 ±  5%  perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
      1.09 ±  2%     +20.1       21.22 ±  5%  perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
     41.69           +20.7       62.36        perf-profile.calltrace.cycles-pp.write
      0.00           +20.7       20.70 ±  6%  perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
     41.45           +20.9       62.31        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     41.40           +20.9       62.30        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     41.39           +20.9       62.30        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     41.37           +20.9       62.30        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     41.26           +21.0       62.29        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     41.23           +21.0       62.28        perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     39.59           +22.4       62.03        perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
     56.08           -19.9       36.20        perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     56.08           -19.9       36.20        perf-profile.children.cycles-pp.cpu_startup_entry
     56.06           -19.9       36.20        perf-profile.children.cycles-pp.do_idle
     55.51           -19.8       35.76        perf-profile.children.cycles-pp.start_secondary
     47.58           -19.3       28.30        perf-profile.children.cycles-pp.intel_idle
     50.28           -16.8       33.45        perf-profile.children.cycles-pp.cpuidle_enter_state
     50.28           -16.8       33.47        perf-profile.children.cycles-pp.cpuidle_enter
      8.94            -8.4        0.54 ± 13%  perf-profile.children.cycles-pp.__submit_merged_write_cond
     26.34            -6.2       20.15 ±  5%  perf-profile.children.cycles-pp.f2fs_fsync_node_pages
      4.92 ±  4%      -4.6        0.32 ± 15%  perf-profile.children.cycles-pp.do_write_page
      4.00            -3.8        0.17 ± 20%  perf-profile.children.cycles-pp.rwsem_wake
      4.47            -3.7        0.75 ± 12%  perf-profile.children.cycles-pp.try_to_wake_up
      4.36            -3.6        0.71 ± 11%  perf-profile.children.cycles-pp.ttwu_do_activate
      4.33            -3.6        0.71 ± 11%  perf-profile.children.cycles-pp.enqueue_task_fair
      4.07            -3.4        0.67 ± 10%  perf-profile.children.cycles-pp.enqueue_entity
      3.73            -3.1        0.62 ± 13%  perf-profile.children.cycles-pp.wake_up_q
      3.10 ±  7%      -3.0        0.12 ± 18%  perf-profile.children.cycles-pp.f2fs_submit_page_write
      3.03            -2.7        0.29 ± 15%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      3.19            -2.7        0.53 ± 12%  perf-profile.children.cycles-pp.__account_scheduler_latency
      2.66 ±  8%      -2.5        0.17 ± 16%  perf-profile.children.cycles-pp.f2fs_do_write_node_page
      2.85            -2.4        0.40 ±  7%  perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
      2.60 ±  5%      -2.4        0.18 ± 15%  perf-profile.children.cycles-pp.f2fs_outplace_write_data
      2.81            -2.4        0.45 ± 13%  perf-profile.children.cycles-pp.submit_bio
      2.81            -2.4        0.45 ± 13%  perf-profile.children.cycles-pp.submit_bio_noacct
      2.67            -2.3        0.36 ±  6%  perf-profile.children.cycles-pp.sched_ttwu_pending
      2.23            -2.2        0.07 ± 15%  perf-profile.children.cycles-pp.pagevec_lookup_range_tag
      2.22            -2.2        0.07 ± 15%  perf-profile.children.cycles-pp.find_get_pages_range_tag
     15.46            -2.1       13.36 ±  8%  perf-profile.children.cycles-pp.__write_node_page
      2.37            -2.0        0.38 ± 12%  perf-profile.children.cycles-pp.stack_trace_save_tsk
      2.19            -2.0        0.24 ± 12%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      2.17            -1.8        0.35 ± 12%  perf-profile.children.cycles-pp.arch_stack_walk
      2.17            -1.8        0.36 ±  6%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      2.45            -1.8        0.69 ±  8%  perf-profile.children.cycles-pp.__schedule
      2.03 ±  2%      -1.7        0.30 ± 11%  perf-profile.children.cycles-pp.__submit_merged_bio
      1.99            -1.7        0.28 ± 14%  perf-profile.children.cycles-pp.brd_submit_bio
      1.68            -1.5        0.18 ± 18%  perf-profile.children.cycles-pp.f2fs_allocate_data_block
      1.60 ±  2%      -1.3        0.30 ± 10%  perf-profile.children.cycles-pp.ret_from_fork
      1.59 ±  2%      -1.3        0.29 ± 12%  perf-profile.children.cycles-pp.kthread
      1.51 ±  2%      -1.3        0.25 ± 12%  perf-profile.children.cycles-pp.unwind_next_frame
      1.41 ±  2%      -1.2        0.22 ± 23%  perf-profile.children.cycles-pp.__generic_file_write_iter
      1.30            -1.1        0.19 ± 16%  perf-profile.children.cycles-pp.brd_do_bvec
      1.30 ±  2%      -1.1        0.22 ± 25%  perf-profile.children.cycles-pp.generic_perform_write
      1.55            -1.0        0.54 ±  5%  perf-profile.children.cycles-pp.schedule
      1.04 ±  2%      -0.9        0.13 ± 14%  perf-profile.children.cycles-pp.issue_flush_thread
      1.09 ±  2%      -0.8        0.24 ± 14%  perf-profile.children.cycles-pp._raw_spin_lock
      0.93 ±  4%      -0.8        0.15 ± 17%  perf-profile.children.cycles-pp.schedule_idle
      0.80 ±  9%      -0.7        0.08 ± 26%  perf-profile.children.cycles-pp.f2fs_space_for_roll_forward
      0.87            -0.7        0.19 ±  9%  perf-profile.children.cycles-pp.f2fs_issue_flush
      0.76 ± 10%      -0.7        0.08 ± 26%  perf-profile.children.cycles-pp.__percpu_counter_sum
      0.74 ±  4%      -0.6        0.09 ± 11%  perf-profile.children.cycles-pp.down_read
      0.76 ±  3%      -0.6        0.11 ±  9%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.70 ±  3%      -0.6        0.10 ±  8%  perf-profile.children.cycles-pp.dequeue_entity
      0.71 ±  2%      -0.6        0.12 ± 22%  perf-profile.children.cycles-pp.f2fs_write_begin
      0.68            -0.6        0.09 ± 11%  perf-profile.children.cycles-pp.brd_insert_page
      0.60            -0.6        0.05 ± 58%  perf-profile.children.cycles-pp.complete
      0.61            -0.5        0.08 ± 13%  perf-profile.children.cycles-pp.f2fs_write_end_io
      0.57            -0.5        0.05 ± 58%  perf-profile.children.cycles-pp.swake_up_locked
      0.66 ±  2%      -0.5        0.15 ± 13%  perf-profile.children.cycles-pp.rwsem_mark_wake
      0.62 ±  4%      -0.5        0.13 ± 11%  perf-profile.children.cycles-pp.md_submit_bio
      0.63            -0.5        0.14 ±  8%  perf-profile.children.cycles-pp.update_load_avg
      0.58            -0.5        0.09 ± 11%  perf-profile.children.cycles-pp.select_task_rq_fair
      0.56 ±  5%      -0.5        0.09 ± 10%  perf-profile.children.cycles-pp.orc_find
      0.59            -0.5        0.13 ± 14%  perf-profile.children.cycles-pp.__submit_flush_wait
      0.56            -0.4        0.12 ± 15%  perf-profile.children.cycles-pp.submit_bio_wait
      0.50 ±  6%      -0.4        0.08 ± 15%  perf-profile.children.cycles-pp.__orc_find
      0.44 ±  3%      -0.4        0.03 ±100%  perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
      0.54 ±  4%      -0.4        0.14 ± 11%  perf-profile.children.cycles-pp.worker_thread
      0.45 ±  3%      -0.4        0.07 ± 17%  perf-profile.children.cycles-pp.__get_node_page
      0.47 ±  3%      -0.4        0.10 ± 12%  perf-profile.children.cycles-pp.md_handle_request
      0.43 ±  2%      -0.4        0.07 ± 21%  perf-profile.children.cycles-pp.update_curr
      0.43 ±  3%      -0.4        0.07 ± 12%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.38            -0.3        0.03 ±100%  perf-profile.children.cycles-pp.__test_set_page_writeback
      0.38 ±  4%      -0.3        0.04 ± 59%  perf-profile.children.cycles-pp.unwind_get_return_address
      0.42 ±  3%      -0.3        0.08 ± 13%  perf-profile.children.cycles-pp.raid0_make_request
      0.39            -0.3        0.06 ± 34%  perf-profile.children.cycles-pp.f2fs_write_end
      0.36 ±  4%      -0.3        0.04 ± 58%  perf-profile.children.cycles-pp.f2fs_is_valid_blkaddr
      0.42 ±  5%      -0.3        0.10 ± 19%  perf-profile.children.cycles-pp.process_one_work
      0.35            -0.3        0.03 ±102%  perf-profile.children.cycles-pp.f2fs_submit_merged_ipu_write
      0.34 ±  6%      -0.3        0.03 ±100%  perf-profile.children.cycles-pp.pagecache_get_page
      0.34 ±  5%      -0.3        0.04 ± 58%  perf-profile.children.cycles-pp.__kernel_text_address
      0.32 ±  2%      -0.3        0.03 ±100%  perf-profile.children.cycles-pp.update_cfs_rq_h_load
      0.34 ±  3%      -0.3        0.04 ± 58%  perf-profile.children.cycles-pp.__lookup_nat_cache
      0.32 ±  2%      -0.3        0.03 ±100%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.31 ±  6%      -0.3        0.03 ±100%  perf-profile.children.cycles-pp.kernel_text_address
      0.30 ±  5%      -0.3        0.03 ±100%  perf-profile.children.cycles-pp.tick_nohz_idle_exit
      0.31 ±  5%      -0.3        0.04 ± 58%  perf-profile.children.cycles-pp.set_next_entity
      0.31 ±  2%      -0.3        0.06 ± 14%  perf-profile.children.cycles-pp.wait_for_completion
      0.30 ±  2%      -0.3        0.04 ± 59%  perf-profile.children.cycles-pp.__radix_tree_lookup
      0.32 ±  2%      -0.2        0.07 ± 15%  perf-profile.children.cycles-pp.md_flush_request
      0.29 ±  2%      -0.2        0.05 ± 62%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
      0.31 ±  4%      -0.2        0.07 ± 21%  perf-profile.children.cycles-pp.submit_flushes
      0.27 ±  4%      -0.2        0.03 ±102%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.30 ±  2%      -0.2        0.07 ± 12%  perf-profile.children.cycles-pp.queue_work_on
      0.28 ±  2%      -0.2        0.06 ± 14%  perf-profile.children.cycles-pp.schedule_timeout
      0.26 ±  5%      -0.2        0.04 ± 58%  perf-profile.children.cycles-pp.update_ts_time_stats
      0.26 ±  3%      -0.2        0.04 ± 58%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.58 ±  4%      -0.2        0.38 ±  7%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.27 ±  5%      -0.2        0.07 ± 13%  perf-profile.children.cycles-pp.__queue_work
      0.24 ±  4%      -0.2        0.07 ± 11%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.30 ±  3%      -0.2        0.14 ±  6%  perf-profile.children.cycles-pp.update_rq_clock
      0.18 ±  2%      -0.2        0.03 ±100%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.24 ±  6%      -0.1        0.11 ± 11%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      1.89            -0.1        1.77 ±  3%  perf-profile.children.cycles-pp.rwsem_spin_on_owner
      0.09            -0.1        0.04 ± 57%  perf-profile.children.cycles-pp._find_next_bit
      0.21 ±  4%      -0.0        0.17 ±  5%  perf-profile.children.cycles-pp.sched_clock
      0.20 ±  6%      -0.0        0.16 ±  6%  perf-profile.children.cycles-pp.native_sched_clock
      0.10 ±  7%      -0.0        0.07        perf-profile.children.cycles-pp.hrtimer_next_event_without
      0.20 ±  7%      -0.0        0.17 ±  4%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.11 ±  4%      -0.0        0.09 ± 15%  perf-profile.children.cycles-pp.get_next_timer_interrupt
      0.06 ± 11%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.07 ± 13%      +0.0        0.11 ± 13%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.00            +0.1        0.07 ± 17%  perf-profile.children.cycles-pp.idle_cpu
      0.06 ±  7%      +0.1        0.12 ±  6%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.04 ± 57%      +0.1        0.12 ± 10%  perf-profile.children.cycles-pp.update_blocked_averages
      0.09 ± 13%      +0.1        0.17 ±  6%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.04 ± 58%      +0.1        0.12 ± 21%  perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
      0.04 ± 58%      +0.1        0.12 ± 18%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.05 ±  8%      +0.1        0.14 ±  5%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.00            +0.1        0.09 ±  4%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.09 ±  4%      +0.1        0.20 ±  7%  perf-profile.children.cycles-pp.calc_global_load_tick
      0.09 ±  4%      +0.1        0.21 ±  6%  perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
      0.09 ±  4%      +0.1        0.22 ±  4%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.35 ±  7%      +0.1        0.48 ±  6%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.36 ±  6%      +0.1        0.49 ±  6%  perf-profile.children.cycles-pp.do_softirq_own_stack
      0.14 ±  3%      +0.1        0.27 ±  9%  perf-profile.children.cycles-pp.rebalance_domains
      0.10 ± 19%      +0.1        0.24 ±  8%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      0.16 ±  9%      +0.2        0.31 ±  8%  perf-profile.children.cycles-pp.tick_nohz_irq_exit
      0.16 ± 13%      +0.2        0.33 ±  9%  perf-profile.children.cycles-pp.tick_irq_enter
      0.42 ±  7%      +0.2        0.58 ±  7%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.20 ±  8%      +0.2        0.42 ±  8%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.07 ± 11%      +0.2        0.30 ±  9%  perf-profile.children.cycles-pp.newidle_balance
      0.23 ±  2%      +0.2        0.45 ±  5%  perf-profile.children.cycles-pp.scheduler_tick
      0.08 ± 10%      +0.2        0.33 ±  6%  perf-profile.children.cycles-pp.update_sd_lb_stats
      0.09 ± 12%      +0.2        0.34 ±  6%  perf-profile.children.cycles-pp.find_busiest_group
      0.11 ±  7%      +0.3        0.39 ±  5%  perf-profile.children.cycles-pp.load_balance
      0.16 ± 18%      +0.3        0.48 ±  5%  perf-profile.children.cycles-pp.timekeeping_max_deferment
      0.50 ± 13%      +0.3        0.84 ±  8%  perf-profile.children.cycles-pp.clockevents_program_event
      0.44 ±  5%      +0.4        0.84 ±  4%  perf-profile.children.cycles-pp.tick_sched_handle
      0.52 ±  8%      +0.4        0.92 ±  7%  perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
      0.43 ±  6%      +0.4        0.83 ±  4%  perf-profile.children.cycles-pp.update_process_times
      0.39 ± 11%      +0.4        0.83 ±  8%  perf-profile.children.cycles-pp.tick_nohz_next_event
      0.88 ±  9%      +0.5        1.40 ±  6%  perf-profile.children.cycles-pp.ktime_get
      0.57 ±  4%      +0.5        1.09 ±  2%  perf-profile.children.cycles-pp.tick_sched_timer
      1.16 ±  4%      +0.6        1.81 ± 12%  perf-profile.children.cycles-pp.menu_select
      0.77 ±  4%      +0.7        1.46 ±  2%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.00            +0.8        0.78 ± 75%  perf-profile.children.cycles-pp.f2fs_remove_inode_page
      0.00            +0.8        0.78 ± 75%  perf-profile.children.cycles-pp.truncate_node
      1.46 ±  6%      +1.2        2.67 ±  3%  perf-profile.children.cycles-pp.hrtimer_interrupt
      1.48 ±  5%      +1.2        2.70 ±  3%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      1.96 ±  4%      +1.3        3.25 ±  2%  perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
      8.06            +1.7        9.75 ± 12%  perf-profile.children.cycles-pp.set_node_addr
      2.29 ±  3%      +1.8        4.06 ±  3%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      2.50 ±  3%      +2.1        4.58 ±  3%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      1.64 ±  2%      +4.0        5.67 ±  8%  perf-profile.children.cycles-pp.f2fs_need_inode_block_update
      0.91 ±  3%      +5.4        6.34 ±  3%  perf-profile.children.cycles-pp.f2fs_need_dentry_mark
      7.65 ±  2%      +6.9       14.58 ±  6%  perf-profile.children.cycles-pp.file_write_and_wait_range
      7.61 ±  2%      +7.0       14.57 ±  6%  perf-profile.children.cycles-pp.__filemap_fdatawrite_range
      7.59 ±  2%      +7.0       14.57 ±  6%  perf-profile.children.cycles-pp.do_writepages
      7.59 ±  2%      +7.0       14.57 ±  6%  perf-profile.children.cycles-pp.f2fs_write_data_pages
      7.47 ±  2%      +7.1       14.55 ±  6%  perf-profile.children.cycles-pp.f2fs_write_cache_pages
      4.52 ±  3%      +9.8       14.27 ±  6%  perf-profile.children.cycles-pp.f2fs_write_single_data_page
      4.33 ±  3%      +9.9       14.25 ±  6%  perf-profile.children.cycles-pp.f2fs_do_write_data_page
      1.80           +16.2       18.03 ±  7%  perf-profile.children.cycles-pp.f2fs_get_node_info
      1.54           +19.7       21.27 ±  5%  perf-profile.children.cycles-pp.f2fs_is_checkpointed_node
     41.70           +20.7       62.36        perf-profile.children.cycles-pp.write
     41.57           +20.9       62.48        perf-profile.children.cycles-pp.do_syscall_64
     41.39           +20.9       62.30        perf-profile.children.cycles-pp.ksys_write
     41.37           +20.9       62.30        perf-profile.children.cycles-pp.vfs_write
     41.26           +21.0       62.29        perf-profile.children.cycles-pp.new_sync_write
     41.23           +21.0       62.28        perf-profile.children.cycles-pp.f2fs_file_write_iter
     41.77           +21.6       63.35        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     39.59           +22.4       62.03        perf-profile.children.cycles-pp.f2fs_do_sync_file
     13.89           +35.4       49.30 ±  2%  perf-profile.children.cycles-pp.osq_lock
     10.27           +41.0       51.25        perf-profile.children.cycles-pp.rwsem_down_read_slowpath
     16.38           +43.4       59.78        perf-profile.children.cycles-pp.rwsem_optimistic_spin
     47.58           -19.3       28.30        perf-profile.self.cycles-pp.intel_idle
      3.02            -2.7        0.29 ± 15%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      1.86            -1.8        0.04 ± 58%  perf-profile.self.cycles-pp.find_get_pages_range_tag
      1.14            -0.9        0.26 ±  9%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      1.83            -0.8        0.99 ±  6%  perf-profile.self.cycles-pp.rwsem_spin_on_owner
      1.04 ±  2%      -0.8        0.22 ±  5%  perf-profile.self.cycles-pp._raw_spin_lock
      0.69 ±  4%      -0.6        0.08 ± 13%  perf-profile.self.cycles-pp.down_read
      0.71            -0.6        0.12 ± 13%  perf-profile.self.cycles-pp.unwind_next_frame
      0.59 ±  3%      -0.5        0.10 ± 17%  perf-profile.self.cycles-pp.rwsem_down_read_slowpath
      0.50 ±  6%      -0.4        0.08 ± 15%  perf-profile.self.cycles-pp.__orc_find
      0.42 ±  6%      -0.4        0.06 ± 13%  perf-profile.self.cycles-pp.brd_do_bvec
      0.42 ±  3%      -0.4        0.06 ±  6%  perf-profile.self.cycles-pp.try_to_wake_up
      0.36 ±  4%      -0.3        0.03 ±100%  perf-profile.self.cycles-pp.f2fs_is_valid_blkaddr
      0.40 ±  3%      -0.3        0.07 ± 10%  perf-profile.self.cycles-pp.__schedule
      0.40 ±  7%      -0.3        0.08 ± 10%  perf-profile.self.cycles-pp.__account_scheduler_latency
      0.35 ± 15%      -0.3        0.05 ± 62%  perf-profile.self.cycles-pp.__percpu_counter_sum
      0.32 ±  2%      -0.3        0.03 ±100%  perf-profile.self.cycles-pp.update_cfs_rq_h_load
      0.32 ±  2%      -0.3        0.03 ±100%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.29 ±  2%      -0.3        0.04 ± 60%  perf-profile.self.cycles-pp.__radix_tree_lookup
      0.26 ±  3%      -0.2        0.04 ± 58%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.23 ±  3%      -0.2        0.04 ± 58%  perf-profile.self.cycles-pp.update_load_avg
      0.23 ±  6%      -0.2        0.04 ± 57%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.24 ±  3%      -0.2        0.07 ± 11%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.23 ±  2%      -0.1        0.10 ± 14%  perf-profile.self.cycles-pp.do_idle
      0.18 ±  5%      -0.1        0.07 ±  7%  perf-profile.self.cycles-pp.update_rq_clock
      0.20 ±  2%      -0.1        0.09 ± 15%  perf-profile.self.cycles-pp.rwsem_mark_wake
      0.20            -0.1        0.10 ± 10%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.08 ±  5%      -0.1        0.03 ±100%  perf-profile.self.cycles-pp._find_next_bit
      0.19 ±  5%      -0.0        0.15 ±  7%  perf-profile.self.cycles-pp.native_sched_clock
      0.06 ± 17%      +0.0        0.11 ± 13%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.03 ±100%      +0.1        0.09 ±  4%  perf-profile.self.cycles-pp.tick_sched_timer
      0.00            +0.1        0.06 ± 17%  perf-profile.self.cycles-pp.update_blocked_averages
      0.00            +0.1        0.06 ±  6%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.00            +0.1        0.07 ± 17%  perf-profile.self.cycles-pp.idle_cpu
      0.00            +0.1        0.08 ±  6%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.09 ± 13%      +0.1        0.17 ±  6%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.00            +0.1        0.09 ±  4%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.01 ±173%      +0.1        0.11 ± 19%  perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
      0.09 ±  4%      +0.1        0.20 ±  7%  perf-profile.self.cycles-pp.calc_global_load_tick
      0.08 ± 26%      +0.1        0.21 ± 13%  perf-profile.self.cycles-pp.update_process_times
      0.09 ± 17%      +0.1        0.21 ±  6%  perf-profile.self.cycles-pp.ktime_get_update_offsets_now
      0.09 ±  4%      +0.1        0.22 ±  4%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.09 ± 20%      +0.2        0.24 ± 20%  perf-profile.self.cycles-pp.tick_nohz_next_event
      0.06 ± 13%      +0.2        0.24 ±  9%  perf-profile.self.cycles-pp.update_sd_lb_stats
      0.16 ± 18%      +0.3        0.48 ±  5%  perf-profile.self.cycles-pp.timekeeping_max_deferment
      0.76 ± 10%      +0.5        1.26 ±  7%  perf-profile.self.cycles-pp.ktime_get
      0.26 ±  4%      +0.6        0.84 ± 22%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.67 ±  2%      +8.8        9.43 ±  2%  perf-profile.self.cycles-pp.rwsem_optimistic_spin
     13.81           +35.3       49.11        perf-profile.self.cycles-pp.osq_lock
    250.00 ± 98%  +12777.4%      32193 ±167%  interrupts.75:PCI-MSI.70260737-edge.eth3-TxRx-0
    774.25 ±162%   +1610.6%      13244 ±136%  interrupts.77:PCI-MSI.70260739-edge.eth3-TxRx-2
    552.00 ±158%   +8041.8%      44942 ±105%  interrupts.79:PCI-MSI.70260741-edge.eth3-TxRx-4
    844.50 ±163%   +6985.2%      59834 ± 92%  interrupts.80:PCI-MSI.70260742-edge.eth3-TxRx-5
     96.50 ± 90%   +4080.3%       4034 ±150%  interrupts.81:PCI-MSI.70260743-edge.eth3-TxRx-6
    150.50         +1092.7%       1795 ±  2%  interrupts.9:IO-APIC.9-fasteoi.acpi
    609956            -6.3%     571265        interrupts.CAL:Function_call_interrupts
      6904 ±  4%     -17.1%       5724 ±  6%  interrupts.CPU0.CAL:Function_call_interrupts
    149876         +1092.6%    1787470 ±  3%  interrupts.CPU0.LOC:Local_timer_interrupts
      1581 ± 25%     -63.5%     577.25 ± 23%  interrupts.CPU0.NMI:Non-maskable_interrupts
      1581 ± 25%     -63.5%     577.25 ± 23%  interrupts.CPU0.PMI:Performance_monitoring_interrupts
    537.75 ±  3%     +78.5%     959.75 ±  7%  interrupts.CPU0.RES:Rescheduling_interrupts
    150.50         +1092.7%       1795 ±  2%  interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
      7196 ±  4%     -22.6%       5570 ±  4%  interrupts.CPU1.CAL:Function_call_interrupts
    150226         +1090.1%    1787842 ±  3%  interrupts.CPU1.LOC:Local_timer_interrupts
      1527 ± 25%     -64.8%     538.00 ± 30%  interrupts.CPU1.NMI:Non-maskable_interrupts
      1527 ± 25%     -64.8%     538.00 ± 30%  interrupts.CPU1.PMI:Performance_monitoring_interrupts
    529.75 ±  3%     +88.7%     999.75 ±  2%  interrupts.CPU1.RES:Rescheduling_interrupts
      6843           -11.7%       6039 ±  4%  interrupts.CPU10.CAL:Function_call_interrupts
    150193         +1090.3%    1787827 ±  3%  interrupts.CPU10.LOC:Local_timer_interrupts
      1773           -50.0%     886.50 ± 42%  interrupts.CPU10.NMI:Non-maskable_interrupts
      1773           -50.0%     886.50 ± 42%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
    517.75 ±  6%     +87.9%     972.75 ± 11%  interrupts.CPU10.RES:Rescheduling_interrupts
    150160         +1090.6%    1787832 ±  3%  interrupts.CPU11.LOC:Local_timer_interrupts
      1774           -59.7%     716.00 ± 27%  interrupts.CPU11.NMI:Non-maskable_interrupts
      1774           -59.7%     716.00 ± 27%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
    515.00 ±  4%     +84.8%     951.50 ±  5%  interrupts.CPU11.RES:Rescheduling_interrupts
      6965           -17.1%       5773 ±  3%  interrupts.CPU12.CAL:Function_call_interrupts
    150211         +1090.1%    1787741 ±  3%  interrupts.CPU12.LOC:Local_timer_interrupts
      1769           -53.4%     824.75 ± 26%  interrupts.CPU12.NMI:Non-maskable_interrupts
      1769           -53.4%     824.75 ± 26%  interrupts.CPU12.PMI:Performance_monitoring_interrupts
    509.00 ±  4%     +99.6%       1015 ±  4%  interrupts.CPU12.RES:Rescheduling_interrupts
      6966           -15.8%       5866 ±  5%  interrupts.CPU13.CAL:Function_call_interrupts
    149890         +1092.7%    1787701 ±  3%  interrupts.CPU13.LOC:Local_timer_interrupts
      1755           -46.8%     933.25 ± 28%  interrupts.CPU13.NMI:Non-maskable_interrupts
      1755           -46.8%     933.25 ± 28%  interrupts.CPU13.PMI:Performance_monitoring_interrupts
    507.75 ±  5%     +99.3%       1011 ±  8%  interrupts.CPU13.RES:Rescheduling_interrupts
      6884 ±  2%     -18.1%       5639 ±  4%  interrupts.CPU14.CAL:Function_call_interrupts
    150173         +1090.5%    1787862 ±  3%  interrupts.CPU14.LOC:Local_timer_interrupts
    510.25 ±  6%     +83.0%     934.00 ±  5%  interrupts.CPU14.RES:Rescheduling_interrupts
      7174 ±  4%     -17.0%       5957 ±  8%  interrupts.CPU15.CAL:Function_call_interrupts
    150282         +1089.6%    1787694 ±  3%  interrupts.CPU15.LOC:Local_timer_interrupts
      1751           -48.6%     899.50 ± 24%  interrupts.CPU15.NMI:Non-maskable_interrupts
      1751           -48.6%     899.50 ± 24%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
    500.75 ±  4%    +100.0%       1001 ±  5%  interrupts.CPU15.RES:Rescheduling_interrupts
      7088 ±  2%     -15.8%       5970 ±  6%  interrupts.CPU16.CAL:Function_call_interrupts
    150253         +1089.8%    1787673 ±  3%  interrupts.CPU16.LOC:Local_timer_interrupts
      1531 ± 24%     -55.3%     684.00 ± 40%  interrupts.CPU16.NMI:Non-maskable_interrupts
      1531 ± 24%     -55.3%     684.00 ± 40%  interrupts.CPU16.PMI:Performance_monitoring_interrupts
    520.75 ±  3%     +72.5%     898.50 ±  4%  interrupts.CPU16.RES:Rescheduling_interrupts
      6974 ±  2%     -15.5%       5896 ±  3%  interrupts.CPU17.CAL:Function_call_interrupts
    150233         +1090.0%    1787724 ±  3%  interrupts.CPU17.LOC:Local_timer_interrupts
      1782           -60.1%     710.25 ± 31%  interrupts.CPU17.NMI:Non-maskable_interrupts
      1782           -60.1%     710.25 ± 31%  interrupts.CPU17.PMI:Performance_monitoring_interrupts
    523.75           +66.5%     872.25 ±  2%  interrupts.CPU17.RES:Rescheduling_interrupts
      6812           -14.4%       5828 ±  4%  interrupts.CPU18.CAL:Function_call_interrupts
    150333         +1089.2%    1787828 ±  3%  interrupts.CPU18.LOC:Local_timer_interrupts
      1549 ± 23%     -47.7%     811.00 ± 20%  interrupts.CPU18.NMI:Non-maskable_interrupts
      1549 ± 23%     -47.7%     811.00 ± 20%  interrupts.CPU18.PMI:Performance_monitoring_interrupts
    518.75 ±  5%     +93.6%       1004 ±  5%  interrupts.CPU18.RES:Rescheduling_interrupts
      6896 ±  2%     -13.8%       5941        interrupts.CPU19.CAL:Function_call_interrupts
    150247         +1090.0%    1787866 ±  3%  interrupts.CPU19.LOC:Local_timer_interrupts
      1534 ± 24%     -43.1%     874.00 ± 20%  interrupts.CPU19.NMI:Non-maskable_interrupts
      1534 ± 24%     -43.1%     874.00 ± 20%  interrupts.CPU19.PMI:Performance_monitoring_interrupts
    515.25 ±  6%    +103.8%       1050 ±  4%  interrupts.CPU19.RES:Rescheduling_interrupts
    150079         +1091.0%    1787408 ±  2%  interrupts.CPU2.LOC:Local_timer_interrupts
      1516 ± 23%     -58.1%     635.25 ± 22%  interrupts.CPU2.NMI:Non-maskable_interrupts
      1516 ± 23%     -58.1%     635.25 ± 22%  interrupts.CPU2.PMI:Performance_monitoring_interrupts
    513.00 ±  4%     +88.9%     969.00 ±  7%  interrupts.CPU2.RES:Rescheduling_interrupts
      6783           -15.1%       5757 ±  5%  interrupts.CPU20.CAL:Function_call_interrupts
    150187         +1090.4%    1787794 ±  3%  interrupts.CPU20.LOC:Local_timer_interrupts
    525.75 ±  6%     +75.5%     922.50 ±  5%  interrupts.CPU20.RES:Rescheduling_interrupts
      6991 ±  3%     -17.8%       5748 ±  4%  interrupts.CPU21.CAL:Function_call_interrupts
    150327         +1089.3%    1787825 ±  3%  interrupts.CPU21.LOC:Local_timer_interrupts
      1766           -68.9%     549.50 ± 34%  interrupts.CPU21.NMI:Non-maskable_interrupts
      1766           -68.9%     549.50 ± 34%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
    540.50 ±  8%     +73.1%     935.50 ±  5%  interrupts.CPU21.RES:Rescheduling_interrupts
      6879 ±  3%     -14.4%       5891 ±  3%  interrupts.CPU22.CAL:Function_call_interrupts
    150278         +1089.6%    1787778 ±  3%  interrupts.CPU22.LOC:Local_timer_interrupts
      1774           -51.4%     861.50 ± 25%  interrupts.CPU22.NMI:Non-maskable_interrupts
      1774           -51.4%     861.50 ± 25%  interrupts.CPU22.PMI:Performance_monitoring_interrupts
    553.25 ± 12%     +59.7%     883.50 ±  7%  interrupts.CPU22.RES:Rescheduling_interrupts
      6914 ±  2%     -12.3%       6062 ±  6%  interrupts.CPU23.CAL:Function_call_interrupts
    150270         +1089.7%    1787808 ±  3%  interrupts.CPU23.LOC:Local_timer_interrupts
      1546 ± 25%     -53.2%     723.00 ± 34%  interrupts.CPU23.NMI:Non-maskable_interrupts
      1546 ± 25%     -53.2%     723.00 ± 34%  interrupts.CPU23.PMI:Performance_monitoring_interrupts
    516.75 ±  6%     +79.2%     926.25 ±  6%  interrupts.CPU23.RES:Rescheduling_interrupts
      5887 ±  4%     +15.2%       6783 ±  7%  interrupts.CPU24.CAL:Function_call_interrupts
    149885         +1093.6%    1789046 ±  2%  interrupts.CPU24.LOC:Local_timer_interrupts
      1799 ±  2%     -61.7%     689.25 ±  9%  interrupts.CPU24.NMI:Non-maskable_interrupts
      1799 ±  2%     -61.7%     689.25 ±  9%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
    569.50 ± 10%     +88.9%       1076 ±  5%  interrupts.CPU24.RES:Rescheduling_interrupts
    149890         +1093.6%    1789026 ±  2%  interrupts.CPU25.LOC:Local_timer_interrupts
      1768           -47.1%     934.75 ± 12%  interrupts.CPU25.NMI:Non-maskable_interrupts
      1768           -47.1%     934.75 ± 12%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
    540.75           +92.3%       1039 ±  8%  interrupts.CPU25.RES:Rescheduling_interrupts
    150160         +1091.4%    1789061 ±  2%  interrupts.CPU26.LOC:Local_timer_interrupts
    537.25 ±  2%     +88.1%       1010 ±  6%  interrupts.CPU26.RES:Rescheduling_interrupts
    150017         +1092.6%    1789042 ±  2%  interrupts.CPU27.LOC:Local_timer_interrupts
      1759           -58.1%     737.25 ±  6%  interrupts.CPU27.NMI:Non-maskable_interrupts
      1759           -58.1%     737.25 ±  6%  interrupts.CPU27.PMI:Performance_monitoring_interrupts
    528.75 ±  5%     +75.1%     925.75 ±  3%  interrupts.CPU27.RES:Rescheduling_interrupts
    149980         +1092.8%    1789024 ±  2%  interrupts.CPU28.LOC:Local_timer_interrupts
    503.25           +88.9%     950.50 ±  2%  interrupts.CPU28.RES:Rescheduling_interrupts
    150157         +1091.3%    1788798 ±  2%  interrupts.CPU29.LOC:Local_timer_interrupts
      1782 ±  2%     -47.6%     934.00 ±  8%  interrupts.CPU29.NMI:Non-maskable_interrupts
      1782 ±  2%     -47.6%     934.00 ±  8%  interrupts.CPU29.PMI:Performance_monitoring_interrupts
    525.00 ±  6%     +77.4%     931.50 ±  6%  interrupts.CPU29.RES:Rescheduling_interrupts
      7140 ±  4%     -18.8%       5798 ±  4%  interrupts.CPU3.CAL:Function_call_interrupts
    149871         +1092.9%    1787743 ±  3%  interrupts.CPU3.LOC:Local_timer_interrupts
      1755           -50.9%     861.75 ± 17%  interrupts.CPU3.NMI:Non-maskable_interrupts
      1755           -50.9%     861.75 ± 17%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
    529.75 ±  4%     +80.9%     958.50 ±  5%  interrupts.CPU3.RES:Rescheduling_interrupts
    149977         +1092.9%    1789016 ±  2%  interrupts.CPU30.LOC:Local_timer_interrupts
      1791           -61.1%     696.25 ± 22%  interrupts.CPU30.NMI:Non-maskable_interrupts
      1791           -61.1%     696.25 ± 22%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
    521.75 ±  5%     +77.8%     927.50 ±  3%  interrupts.CPU30.RES:Rescheduling_interrupts
    150029         +1092.4%    1788968 ±  2%  interrupts.CPU31.LOC:Local_timer_interrupts
      1767           -62.0%     671.75 ± 37%  interrupts.CPU31.NMI:Non-maskable_interrupts
      1767           -62.0%     671.75 ± 37%  interrupts.CPU31.PMI:Performance_monitoring_interrupts
    521.00 ±  2%     +84.7%     962.50 ±  7%  interrupts.CPU31.RES:Rescheduling_interrupts
    150028         +1092.5%    1789067 ±  2%  interrupts.CPU32.LOC:Local_timer_interrupts
    532.50 ±  2%     +96.5%       1046 ±  4%  interrupts.CPU32.RES:Rescheduling_interrupts
    149637         +1095.6%    1789077 ±  2%  interrupts.CPU33.LOC:Local_timer_interrupts
      1763 ±  2%     -64.4%     628.25 ± 37%  interrupts.CPU33.NMI:Non-maskable_interrupts
      1763 ±  2%     -64.4%     628.25 ± 37%  interrupts.CPU33.PMI:Performance_monitoring_interrupts
    499.25 ±  5%     +92.8%     962.75 ± 10%  interrupts.CPU33.RES:Rescheduling_interrupts
    150148         +1091.6%    1789238 ±  2%  interrupts.CPU34.LOC:Local_timer_interrupts
      1323 ± 33%     -54.5%     602.75 ± 46%  interrupts.CPU34.NMI:Non-maskable_interrupts
      1323 ± 33%     -54.5%     602.75 ± 46%  interrupts.CPU34.PMI:Performance_monitoring_interrupts
    498.00 ±  5%     +92.6%     959.00 ±  3%  interrupts.CPU34.RES:Rescheduling_interrupts
    150084         +1091.9%    1788867 ±  2%  interrupts.CPU35.LOC:Local_timer_interrupts
      1544 ± 25%     -57.8%     651.25 ± 43%  interrupts.CPU35.NMI:Non-maskable_interrupts
      1544 ± 25%     -57.8%     651.25 ± 43%  interrupts.CPU35.PMI:Performance_monitoring_interrupts
    511.25 ±  3%     +89.8%     970.25 ±  5%  interrupts.CPU35.RES:Rescheduling_interrupts
    150106         +1091.5%    1788521 ±  2%  interrupts.CPU36.LOC:Local_timer_interrupts
    533.00 ±  3%     +76.4%     940.25 ±  5%  interrupts.CPU36.RES:Rescheduling_interrupts
    150139         +1091.8%    1789312 ±  2%  interrupts.CPU37.LOC:Local_timer_interrupts
    513.25 ±  4%     +91.3%     982.00 ±  5%  interrupts.CPU37.RES:Rescheduling_interrupts
    150102         +1091.9%    1789006 ±  2%  interrupts.CPU38.LOC:Local_timer_interrupts
      1299 ± 32%     -43.1%     739.00 ± 21%  interrupts.CPU38.NMI:Non-maskable_interrupts
      1299 ± 32%     -43.1%     739.00 ± 21%  interrupts.CPU38.PMI:Performance_monitoring_interrupts
    518.75 ±  4%    +107.7%       1077 ±  6%  interrupts.CPU38.RES:Rescheduling_interrupts
    150053         +1092.2%    1788960 ±  2%  interrupts.CPU39.LOC:Local_timer_interrupts
      1525 ± 25%     -53.5%     709.00 ± 26%  interrupts.CPU39.NMI:Non-maskable_interrupts
      1525 ± 25%     -53.5%     709.00 ± 26%  interrupts.CPU39.PMI:Performance_monitoring_interrupts
    526.50 ±  2%     +94.3%       1022 ±  8%  interrupts.CPU39.RES:Rescheduling_interrupts
      7103 ±  2%     -16.3%       5942 ±  3%  interrupts.CPU4.CAL:Function_call_interrupts
    150217         +1090.1%    1787766 ±  3%  interrupts.CPU4.LOC:Local_timer_interrupts
      1536 ± 25%     -49.7%     772.25 ± 20%  interrupts.CPU4.NMI:Non-maskable_interrupts
      1536 ± 25%     -49.7%     772.25 ± 20%  interrupts.CPU4.PMI:Performance_monitoring_interrupts
    495.75 ±  3%     +88.8%     936.00 ±  4%  interrupts.CPU4.RES:Rescheduling_interrupts
    150146         +1091.5%    1788930 ±  2%  interrupts.CPU40.LOC:Local_timer_interrupts
    501.50           +89.0%     947.75 ±  3%  interrupts.CPU40.RES:Rescheduling_interrupts
    150099         +1091.8%    1788854 ±  2%  interrupts.CPU41.LOC:Local_timer_interrupts
    518.00 ±  5%     +87.3%     970.00 ±  4%  interrupts.CPU41.RES:Rescheduling_interrupts
    150159         +1091.3%    1788781 ±  2%  interrupts.CPU42.LOC:Local_timer_interrupts
    536.00 ±  2%     +69.8%     910.25 ±  9%  interrupts.CPU42.RES:Rescheduling_interrupts
      4.75 ±101%   +2936.8%     144.25 ±137%  interrupts.CPU42.TLB:TLB_shootdowns
    149916         +1093.3%    1788909 ±  2%  interrupts.CPU43.LOC:Local_timer_interrupts
    531.25 ±  2%     +80.3%     958.00 ±  2%  interrupts.CPU43.RES:Rescheduling_interrupts
    150126         +1091.7%    1789018 ±  2%  interrupts.CPU44.LOC:Local_timer_interrupts
      1525 ± 24%     -52.2%     729.75 ± 24%  interrupts.CPU44.NMI:Non-maskable_interrupts
      1525 ± 24%     -52.2%     729.75 ± 24%  interrupts.CPU44.PMI:Performance_monitoring_interrupts
    505.00 ±  3%     +81.0%     914.25 ±  4%  interrupts.CPU44.RES:Rescheduling_interrupts
    150108         +1091.8%    1788995 ±  2%  interrupts.CPU45.LOC:Local_timer_interrupts
      1756           -58.0%     738.00 ± 15%  interrupts.CPU45.NMI:Non-maskable_interrupts
      1756           -58.0%     738.00 ± 15%  interrupts.CPU45.PMI:Performance_monitoring_interrupts
    524.50 ±  5%     +74.5%     915.00 ±  2%  interrupts.CPU45.RES:Rescheduling_interrupts
    149970         +1092.9%    1788950 ±  2%  interrupts.CPU46.LOC:Local_timer_interrupts
      1790           -57.7%     757.25 ±  8%  interrupts.CPU46.NMI:Non-maskable_interrupts
      1790           -57.7%     757.25 ±  8%  interrupts.CPU46.PMI:Performance_monitoring_interrupts
    516.00 ±  6%     +84.0%     949.25 ± 11%  interrupts.CPU46.RES:Rescheduling_interrupts
    149906         +1093.4%    1788999 ±  2%  interrupts.CPU47.LOC:Local_timer_interrupts
      1756           -48.8%     898.75 ± 23%  interrupts.CPU47.NMI:Non-maskable_interrupts
      1756           -48.8%     898.75 ± 23%  interrupts.CPU47.PMI:Performance_monitoring_interrupts
    495.75 ±  5%     +83.2%     908.25 ± 12%  interrupts.CPU47.RES:Rescheduling_interrupts
    150137         +1090.7%    1787631 ±  3%  interrupts.CPU48.LOC:Local_timer_interrupts
      1538 ± 25%     -54.2%     704.50 ± 37%  interrupts.CPU48.NMI:Non-maskable_interrupts
      1538 ± 25%     -54.2%     704.50 ± 37%  interrupts.CPU48.PMI:Performance_monitoring_interrupts
    565.25 ±  7%     +86.8%       1056 ±  6%  interrupts.CPU48.RES:Rescheduling_interrupts
      6840 ±  2%     -15.8%       5757 ±  5%  interrupts.CPU49.CAL:Function_call_interrupts
    150165         +1090.5%    1787741 ±  3%  interrupts.CPU49.LOC:Local_timer_interrupts
      1516 ± 24%     -52.5%     720.00 ± 29%  interrupts.CPU49.NMI:Non-maskable_interrupts
      1516 ± 24%     -52.5%     720.00 ± 29%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
    558.75 ±  5%     +86.2%       1040 ±  9%  interrupts.CPU49.RES:Rescheduling_interrupts
    150264         +1089.8%    1787810 ±  3%  interrupts.CPU5.LOC:Local_timer_interrupts
      1751 ±  3%     -62.5%     656.25 ± 30%  interrupts.CPU5.NMI:Non-maskable_interrupts
      1751 ±  3%     -62.5%     656.25 ± 30%  interrupts.CPU5.PMI:Performance_monitoring_interrupts
    505.50 ±  5%     +79.2%     906.00 ±  3%  interrupts.CPU5.RES:Rescheduling_interrupts
      6841 ±  3%     -18.2%       5593 ±  5%  interrupts.CPU50.CAL:Function_call_interrupts
    150244         +1089.9%    1787787 ±  3%  interrupts.CPU50.LOC:Local_timer_interrupts
      1312 ± 34%     -54.4%     599.00 ±  4%  interrupts.CPU50.NMI:Non-maskable_interrupts
      1312 ± 34%     -54.4%     599.00 ±  4%  interrupts.CPU50.PMI:Performance_monitoring_interrupts
    522.50 ±  2%     +77.7%     928.50 ±  4%  interrupts.CPU50.RES:Rescheduling_interrupts
      6771 ±  2%     -16.3%       5669 ±  2%  interrupts.CPU51.CAL:Function_call_interrupts
    150197         +1090.3%    1787760 ±  3%  interrupts.CPU51.LOC:Local_timer_interrupts
    519.75 ±  4%     +74.6%     907.25 ±  3%  interrupts.CPU51.RES:Rescheduling_interrupts
      6920           -18.7%       5624 ±  4%  interrupts.CPU52.CAL:Function_call_interrupts
    150223         +1090.1%    1787770 ±  3%  interrupts.CPU52.LOC:Local_timer_interrupts
    535.50 ±  6%     +59.2%     852.75 ±  4%  interrupts.CPU52.RES:Rescheduling_interrupts
      6938           -16.3%       5804 ±  6%  interrupts.CPU53.CAL:Function_call_interrupts
    150134         +1090.8%    1787795 ±  3%  interrupts.CPU53.LOC:Local_timer_interrupts
    525.75 ±  7%     +75.5%     922.50 ± 10%  interrupts.CPU53.RES:Rescheduling_interrupts
      7038 ±  2%     -17.9%       5779 ±  5%  interrupts.CPU54.CAL:Function_call_interrupts
    150213         +1090.2%    1787848 ±  3%  interrupts.CPU54.LOC:Local_timer_interrupts
      1519 ± 24%     -45.1%     834.75 ± 28%  interrupts.CPU54.NMI:Non-maskable_interrupts
      1519 ± 24%     -45.1%     834.75 ± 28%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
    520.75 ±  5%     +57.3%     819.00 ±  8%  interrupts.CPU54.RES:Rescheduling_interrupts
      6722 ±  2%     -13.0%       5848 ±  6%  interrupts.CPU55.CAL:Function_call_interrupts
    150261         +1089.8%    1787822 ±  3%  interrupts.CPU55.LOC:Local_timer_interrupts
      1523 ± 24%     -53.9%     702.75 ± 35%  interrupts.CPU55.NMI:Non-maskable_interrupts
      1523 ± 24%     -53.9%     702.75 ± 35%  interrupts.CPU55.PMI:Performance_monitoring_interrupts
    541.25 ±  7%     +74.5%     944.25 ± 14%  interrupts.CPU55.RES:Rescheduling_interrupts
    150127         +1090.8%    1787690 ±  3%  interrupts.CPU56.LOC:Local_timer_interrupts
    516.75 ±  4%     +80.0%     930.00 ±  7%  interrupts.CPU56.RES:Rescheduling_interrupts
      6916 ±  2%     -17.1%       5737 ±  6%  interrupts.CPU57.CAL:Function_call_interrupts
    150223         +1090.1%    1787837 ±  3%  interrupts.CPU57.LOC:Local_timer_interrupts
      1528 ± 24%     -45.3%     835.75 ± 29%  interrupts.CPU57.NMI:Non-maskable_interrupts
      1528 ± 24%     -45.3%     835.75 ± 29%  interrupts.CPU57.PMI:Performance_monitoring_interrupts
    573.75 ±  7%     +69.5%     972.50 ±  9%  interrupts.CPU57.RES:Rescheduling_interrupts
      6876 ±  2%     -14.8%       5855 ±  4%  interrupts.CPU58.CAL:Function_call_interrupts
    150314         +1089.4%    1787848 ±  3%  interrupts.CPU58.LOC:Local_timer_interrupts
      1534 ± 24%     -52.6%     727.50 ± 35%  interrupts.CPU58.NMI:Non-maskable_interrupts
      1534 ± 24%     -52.6%     727.50 ± 35%  interrupts.CPU58.PMI:Performance_monitoring_interrupts
    505.00 ±  8%     +68.2%     849.25 ±  4%  interrupts.CPU58.RES:Rescheduling_interrupts
      7000           -15.1%       5941 ±  5%  interrupts.CPU59.CAL:Function_call_interrupts
    150209         +1090.3%    1787892 ±  3%  interrupts.CPU59.LOC:Local_timer_interrupts
      1314 ± 32%     -40.8%     778.00 ± 14%  interrupts.CPU59.NMI:Non-maskable_interrupts
      1314 ± 32%     -40.8%     778.00 ± 14%  interrupts.CPU59.PMI:Performance_monitoring_interrupts
    555.50 ± 12%     +66.2%     923.00 ±  7%  interrupts.CPU59.RES:Rescheduling_interrupts
      6913 ±  3%     -17.0%       5740 ±  4%  interrupts.CPU6.CAL:Function_call_interrupts
    150232         +1090.0%    1787761 ±  3%  interrupts.CPU6.LOC:Local_timer_interrupts
    530.75 ±  6%     +84.4%     978.50 ±  5%  interrupts.CPU6.RES:Rescheduling_interrupts
      6918           -14.8%       5895 ±  6%  interrupts.CPU60.CAL:Function_call_interrupts
    150296         +1089.5%    1787820 ±  3%  interrupts.CPU60.LOC:Local_timer_interrupts
    543.50 ±  5%     +64.0%     891.25 ±  7%  interrupts.CPU60.RES:Rescheduling_interrupts
      6832           -15.7%       5756 ±  4%  interrupts.CPU61.CAL:Function_call_interrupts
    150275         +1089.7%    1787780 ±  3%  interrupts.CPU61.LOC:Local_timer_interrupts
      1736           -50.9%     852.25 ± 16%  interrupts.CPU61.NMI:Non-maskable_interrupts
      1736           -50.9%     852.25 ± 16%  interrupts.CPU61.PMI:Performance_monitoring_interrupts
    561.50 ±  3%     +69.0%     948.75 ± 10%  interrupts.CPU61.RES:Rescheduling_interrupts
    150147         +1090.7%    1787853 ±  3%  interrupts.CPU62.LOC:Local_timer_interrupts
      1523 ± 24%     -59.8%     613.00 ± 32%  interrupts.CPU62.NMI:Non-maskable_interrupts
      1523 ± 24%     -59.8%     613.00 ± 32%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
    513.50 ±  3%     +87.0%     960.25 ± 11%  interrupts.CPU62.RES:Rescheduling_interrupts
      6929 ±  2%     -17.0%       5750 ±  4%  interrupts.CPU63.CAL:Function_call_interrupts
    150307         +1089.5%    1787834 ±  3%  interrupts.CPU63.LOC:Local_timer_interrupts
      1749 ±  2%     -49.4%     884.25 ± 16%  interrupts.CPU63.NMI:Non-maskable_interrupts
      1749 ±  2%     -49.4%     884.25 ± 16%  interrupts.CPU63.PMI:Performance_monitoring_interrupts
    531.50 ±  7%     +65.6%     880.25        interrupts.CPU63.RES:Rescheduling_interrupts
      6986 ±  2%     -17.1%       5788 ±  3%  interrupts.CPU64.CAL:Function_call_interrupts
    150298         +1089.4%    1787593 ±  3%  interrupts.CPU64.LOC:Local_timer_interrupts
      1521 ± 26%     -52.4%     724.75 ± 18%  interrupts.CPU64.NMI:Non-maskable_interrupts
      1521 ± 26%     -52.4%     724.75 ± 18%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
    527.25 ±  3%     +60.2%     844.50 ±  2%  interrupts.CPU64.RES:Rescheduling_interrupts
      7083           -16.8%       5894 ±  5%  interrupts.CPU65.CAL:Function_call_interrupts
    150225         +1090.2%    1787921 ±  3%  interrupts.CPU65.LOC:Local_timer_interrupts
    536.75 ±  4%     +59.3%     855.00 ±  5%  interrupts.CPU65.RES:Rescheduling_interrupts
      6910           -14.1%       5938 ±  4%  interrupts.CPU66.CAL:Function_call_interrupts
    150340         +1089.2%    1787898 ±  3%  interrupts.CPU66.LOC:Local_timer_interrupts
    585.75 ±  2%     +71.5%       1004 ±  9%  interrupts.CPU66.RES:Rescheduling_interrupts
      6851           -15.0%       5823 ±  5%  interrupts.CPU67.CAL:Function_call_interrupts
    150302         +1089.4%    1787748 ±  3%  interrupts.CPU67.LOC:Local_timer_interrupts
      1552 ± 25%     -50.5%     768.00 ± 23%  interrupts.CPU67.NMI:Non-maskable_interrupts
      1552 ± 25%     -50.5%     768.00 ± 23%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
    555.25 ±  3%     +62.0%     899.50 ±  6%  interrupts.CPU67.RES:Rescheduling_interrupts
      6901 ±  2%     -19.6%       5550 ±  4%  interrupts.CPU68.CAL:Function_call_interrupts
    150258         +1089.9%    1787888 ±  3%  interrupts.CPU68.LOC:Local_timer_interrupts
    556.75 ± 10%     +58.7%     883.75 ±  8%  interrupts.CPU68.RES:Rescheduling_interrupts
      6944           -18.0%       5692 ±  9%  interrupts.CPU69.CAL:Function_call_interrupts
    150265         +1089.8%    1787886 ±  3%  interrupts.CPU69.LOC:Local_timer_interrupts
      1540 ± 25%     -54.8%     696.25 ± 30%  interrupts.CPU69.NMI:Non-maskable_interrupts
      1540 ± 25%     -54.8%     696.25 ± 30%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
    553.25 ±  9%     +67.8%     928.25 ±  8%  interrupts.CPU69.RES:Rescheduling_interrupts
      6819           -13.5%       5900 ±  5%  interrupts.CPU7.CAL:Function_call_interrupts
    150231         +1090.0%    1787821 ±  3%  interrupts.CPU7.LOC:Local_timer_interrupts
    518.50 ±  2%    +105.4%       1065 ± 10%  interrupts.CPU7.RES:Rescheduling_interrupts
      6876 ±  2%     -16.4%       5751 ±  5%  interrupts.CPU70.CAL:Function_call_interrupts
    150342         +1089.2%    1787842 ±  3%  interrupts.CPU70.LOC:Local_timer_interrupts
    532.25 ±  6%     +59.7%     849.75 ±  2%  interrupts.CPU70.RES:Rescheduling_interrupts
      6849           -13.8%       5904 ±  4%  interrupts.CPU71.CAL:Function_call_interrupts
    150219         +1090.2%    1787845 ±  3%  interrupts.CPU71.LOC:Local_timer_interrupts
    517.00 ±  7%     +70.7%     882.75 ±  9%  interrupts.CPU71.RES:Rescheduling_interrupts
    149871         +1093.7%    1789000 ±  2%  interrupts.CPU72.LOC:Local_timer_interrupts
      1570 ± 24%     -56.9%     676.50 ± 17%  interrupts.CPU72.NMI:Non-maskable_interrupts
      1570 ± 24%     -56.9%     676.50 ± 17%  interrupts.CPU72.PMI:Performance_monitoring_interrupts
    553.75 ±  3%     +85.5%       1027 ±  7%  interrupts.CPU72.RES:Rescheduling_interrupts
      5738 ±  4%     +18.8%       6818 ± 11%  interrupts.CPU73.CAL:Function_call_interrupts
    150071         +1092.1%    1788977 ±  2%  interrupts.CPU73.LOC:Local_timer_interrupts
    557.25 ±  7%     +92.7%       1073 ± 10%  interrupts.CPU73.RES:Rescheduling_interrupts
    150122         +1091.7%    1789048 ±  2%  interrupts.CPU74.LOC:Local_timer_interrupts
      1544 ± 24%     -41.7%     900.75 ± 24%  interrupts.CPU74.NMI:Non-maskable_interrupts
      1544 ± 24%     -41.7%     900.75 ± 24%  interrupts.CPU74.PMI:Performance_monitoring_interrupts
    524.50 ±  6%     +87.6%     984.00 ± 11%  interrupts.CPU74.RES:Rescheduling_interrupts
    150079         +1092.1%    1789068 ±  2%  interrupts.CPU75.LOC:Local_timer_interrupts
    523.50 ±  2%     +78.7%     935.25 ±  6%  interrupts.CPU75.RES:Rescheduling_interrupts
    150127         +1091.6%    1788984 ±  2%  interrupts.CPU76.LOC:Local_timer_interrupts
      1523 ± 24%     -52.4%     725.50 ±  8%  interrupts.CPU76.NMI:Non-maskable_interrupts
      1523 ± 24%     -52.4%     725.50 ±  8%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
    525.00           +76.5%     926.75 ±  9%  interrupts.CPU76.RES:Rescheduling_interrupts
    150165         +1091.4%    1789008 ±  2%  interrupts.CPU77.LOC:Local_timer_interrupts
      1556 ± 25%     -46.9%     826.50 ± 25%  interrupts.CPU77.NMI:Non-maskable_interrupts
      1556 ± 25%     -46.9%     826.50 ± 25%  interrupts.CPU77.PMI:Performance_monitoring_interrupts
    535.75 ±  3%     +78.3%     955.50 ± 10%  interrupts.CPU77.RES:Rescheduling_interrupts
    149783         +1094.4%    1789010 ±  2%  interrupts.CPU78.LOC:Local_timer_interrupts
      1788           -59.3%     727.50 ±  8%  interrupts.CPU78.NMI:Non-maskable_interrupts
      1788           -59.3%     727.50 ±  8%  interrupts.CPU78.PMI:Performance_monitoring_interrupts
    539.00 ±  7%     +67.3%     901.50 ±  8%  interrupts.CPU78.RES:Rescheduling_interrupts
    150147         +1091.4%    1788924 ±  2%  interrupts.CPU79.LOC:Local_timer_interrupts
      1562 ± 25%     -43.0%     889.75 ± 31%  interrupts.CPU79.NMI:Non-maskable_interrupts
      1562 ± 25%     -43.0%     889.75 ± 31%  interrupts.CPU79.PMI:Performance_monitoring_interrupts
    542.75 ±  9%     +65.5%     898.50 ±  2%  interrupts.CPU79.RES:Rescheduling_interrupts
      6824 ±  2%     -15.1%       5793 ±  4%  interrupts.CPU8.CAL:Function_call_interrupts
    150210         +1090.0%    1787456 ±  3%  interrupts.CPU8.LOC:Local_timer_interrupts
      1741           -56.3%     760.50 ± 19%  interrupts.CPU8.NMI:Non-maskable_interrupts
      1741           -56.3%     760.50 ± 19%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
    506.00 ±  4%     +93.4%     978.75 ±  5%  interrupts.CPU8.RES:Rescheduling_interrupts
    250.00 ± 98%  +12777.4%      32193 ±167%  interrupts.CPU80.75:PCI-MSI.70260737-edge.eth3-TxRx-0
    150009         +1092.6%    1789046 ±  2%  interrupts.CPU80.LOC:Local_timer_interrupts
      1761           -56.8%     760.50 ± 27%  interrupts.CPU80.NMI:Non-maskable_interrupts
      1761           -56.8%     760.50 ± 27%  interrupts.CPU80.PMI:Performance_monitoring_interrupts
    523.25 ±  5%     +81.6%     950.25 ±  5%  interrupts.CPU80.RES:Rescheduling_interrupts
    149572         +1096.1%    1789038 ±  2%  interrupts.CPU81.LOC:Local_timer_interrupts
      1546 ± 24%     -49.7%     777.00 ± 21%  interrupts.CPU81.NMI:Non-maskable_interrupts
      1546 ± 24%     -49.7%     777.00 ± 21%  interrupts.CPU81.PMI:Performance_monitoring_interrupts
    546.75 ± 10%     +64.0%     896.50 ±  6%  interrupts.CPU81.RES:Rescheduling_interrupts
    774.25 ±162%   +1610.6%      13244 ±136%  interrupts.CPU82.77:PCI-MSI.70260739-edge.eth3-TxRx-2
    150143         +1091.7%    1789225 ±  2%  interrupts.CPU82.LOC:Local_timer_interrupts
      1771           -50.5%     876.50 ± 27%  interrupts.CPU82.NMI:Non-maskable_interrupts
      1771           -50.5%     876.50 ± 27%  interrupts.CPU82.PMI:Performance_monitoring_interrupts
    542.50 ±  7%     +70.5%     924.75 ±  7%  interrupts.CPU82.RES:Rescheduling_interrupts
    150013         +1092.5%    1788903 ±  2%  interrupts.CPU83.LOC:Local_timer_interrupts
      1767           -54.8%     798.50 ± 19%  interrupts.CPU83.NMI:Non-maskable_interrupts
      1767           -54.8%     798.50 ± 19%  interrupts.CPU83.PMI:Performance_monitoring_interrupts
    526.75 ±  3%     +68.0%     885.00 ±  8%  interrupts.CPU83.RES:Rescheduling_interrupts
    552.00 ±158%   +8041.8%      44942 ±105%  interrupts.CPU84.79:PCI-MSI.70260741-edge.eth3-TxRx-4
    150082         +1091.7%    1788512 ±  2%  interrupts.CPU84.LOC:Local_timer_interrupts
      1803           -49.1%     917.25 ± 21%  interrupts.CPU84.NMI:Non-maskable_interrupts
      1803           -49.1%     917.25 ± 21%  interrupts.CPU84.PMI:Performance_monitoring_interrupts
    545.75           +71.5%     936.00 ±  4%  interrupts.CPU84.RES:Rescheduling_interrupts
    844.50 ±163%   +6985.2%      59834 ± 92%  interrupts.CPU85.80:PCI-MSI.70260742-edge.eth3-TxRx-5
    150154         +1091.7%    1789379 ±  2%  interrupts.CPU85.LOC:Local_timer_interrupts
      1765 ±  2%     -53.6%     818.75 ± 26%  interrupts.CPU85.NMI:Non-maskable_interrupts
      1765 ±  2%     -53.6%     818.75 ± 26%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
    545.50 ±  3%     +77.2%     966.75 ±  8%  interrupts.CPU85.RES:Rescheduling_interrupts
     96.50 ± 90%   +4080.3%       4034 ±150%  interrupts.CPU86.81:PCI-MSI.70260743-edge.eth3-TxRx-6
    150129         +1091.7%    1789096 ±  2%  interrupts.CPU86.LOC:Local_timer_interrupts
      1751 ±  2%     -52.7%     828.00 ± 17%  interrupts.CPU86.NMI:Non-maskable_interrupts
      1751 ±  2%     -52.7%     828.00 ± 17%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
    560.00 ±  3%     +65.1%     924.50 ±  4%  interrupts.CPU86.RES:Rescheduling_interrupts
    150050         +1092.3%    1789021 ±  2%  interrupts.CPU87.LOC:Local_timer_interrupts
    559.50 ±  6%     +60.3%     896.75 ±  8%  interrupts.CPU87.RES:Rescheduling_interrupts
    150187         +1091.2%    1788981 ±  2%  interrupts.CPU88.LOC:Local_timer_interrupts
      1771 ±  2%     -48.8%     907.00 ± 17%  interrupts.CPU88.NMI:Non-maskable_interrupts
      1771 ±  2%     -48.8%     907.00 ± 17%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
    561.00 ±  3%     +67.9%     942.00 ±  5%  interrupts.CPU88.RES:Rescheduling_interrupts
    150116         +1091.7%    1788958 ±  2%  interrupts.CPU89.LOC:Local_timer_interrupts
      1793           -43.4%       1015 ± 17%  interrupts.CPU89.NMI:Non-maskable_interrupts
      1793           -43.4%       1015 ± 17%  interrupts.CPU89.PMI:Performance_monitoring_interrupts
    521.50 ±  4%     +72.1%     897.50 ±  6%  interrupts.CPU89.RES:Rescheduling_interrupts
    150194         +1090.4%    1787840 ±  3%  interrupts.CPU9.LOC:Local_timer_interrupts
      1522 ± 23%     -47.5%     799.25 ± 17%  interrupts.CPU9.NMI:Non-maskable_interrupts
      1522 ± 23%     -47.5%     799.25 ± 17%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
    498.00 ±  3%    +101.5%       1003 ±  2%  interrupts.CPU9.RES:Rescheduling_interrupts
    150149         +1091.5%    1788993 ±  2%  interrupts.CPU90.LOC:Local_timer_interrupts
      1780           -56.4%     775.75 ± 23%  interrupts.CPU90.NMI:Non-maskable_interrupts
      1780           -56.4%     775.75 ± 23%  interrupts.CPU90.PMI:Performance_monitoring_interrupts
    512.75 ±  3%     +68.9%     866.25 ±  3%  interrupts.CPU90.RES:Rescheduling_interrupts
    149986         +1092.7%    1788910 ±  2%  interrupts.CPU91.LOC:Local_timer_interrupts
    518.25 ±  4%     +69.9%     880.25 ±  6%  interrupts.CPU91.RES:Rescheduling_interrupts
      6.00 ± 61%   +2137.5%     134.25 ±125%  interrupts.CPU91.TLB:TLB_shootdowns
    150056         +1092.2%    1789012 ±  2%  interrupts.CPU92.LOC:Local_timer_interrupts
      1765           -55.4%     788.00 ± 14%  interrupts.CPU92.NMI:Non-maskable_interrupts
      1765           -55.4%     788.00 ± 14%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
    526.50 ±  5%     +65.5%     871.50 ±  9%  interrupts.CPU92.RES:Rescheduling_interrupts
    150123         +1091.7%    1789025 ±  2%  interrupts.CPU93.LOC:Local_timer_interrupts
      1543 ± 24%     -55.3%     689.75 ± 26%  interrupts.CPU93.NMI:Non-maskable_interrupts
      1543 ± 24%     -55.3%     689.75 ± 26%  interrupts.CPU93.PMI:Performance_monitoring_interrupts
    511.25 ±  3%     +70.4%     871.00 ±  4%  interrupts.CPU93.RES:Rescheduling_interrupts
    150075         +1092.1%    1789036 ±  2%  interrupts.CPU94.LOC:Local_timer_interrupts
      1568 ± 25%     -50.4%     777.25 ± 16%  interrupts.CPU94.NMI:Non-maskable_interrupts
      1568 ± 25%     -50.4%     777.25 ± 16%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
    526.25 ±  5%     +66.7%     877.25 ±  4%  interrupts.CPU94.RES:Rescheduling_interrupts
    150146         +1091.5%    1789044 ±  2%  interrupts.CPU95.LOC:Local_timer_interrupts
      1784           -50.6%     880.50 ± 27%  interrupts.CPU95.NMI:Non-maskable_interrupts
      1784           -50.6%     880.50 ± 27%  interrupts.CPU95.PMI:Performance_monitoring_interrupts
    539.25 ±  7%     +53.6%     828.25 ±  4%  interrupts.CPU95.RES:Rescheduling_interrupts
  14412372         +1091.2%  1.717e+08 ±  2%  interrupts.LOC:Local_timer_interrupts
      0.00       +1.9e+104%     192.00        interrupts.MCP:Machine_check_polls
    154111 ±  4%     -51.0%      75504 ±  4%  interrupts.NMI:Non-maskable_interrupts
    154111 ±  4%     -51.0%      75504 ±  4%  interrupts.PMI:Performance_monitoring_interrupts
     50770           +78.2%      90484 ±  2%  interrupts.RES:Rescheduling_interrupts
    721.25 ±  3%    +396.3%       3579 ± 37%  interrupts.TLB:TLB_shootdowns


                                                                                
                                 aim7.jobs-per-min                              
                                                                                
  9000 +--------------------------------------------------------------------+   
       |.+..+.+.+..+.+.+.+..+.+    +.+.+..+.   .+..+.+.+                    |   
  8000 |-+                    :    :        +.+                             |   
  7000 |-O  O O O  O O O O  O : O  : O O  O O O O  O O O  O O O  O O        |   
       |                      :   :                                         |   
  6000 |-+                     :  :                                         |   
  5000 |-+                     :  :                                         |   
       |                       :  :                                         |   
  4000 |-+                     : :                                          |   
  3000 |-+                     : :                                          |   
       |                       : :                                          |   
  2000 |-+                      ::                                          |   
  1000 |-+                      :                                           |   
       |                        :                                    O O  O |   
     0 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                              aim7.time.elapsed_time                            
                                                                                
  1000 +--------------------------------------------------------------------+   
   900 |-+                                                             O    |   
       |                                                             O    O |   
   800 |-+                                                                  |   
   700 |-+                                                                  |   
       |                                                                    |   
   600 |-+                                                                  |   
   500 |-+                                                                  |   
   400 |-+                                                                  |   
       |                                                                    |   
   300 |-+                                                                  |   
   200 |-+                                                                  |   
       |                                                                    |   
   100 |.+..+.+.+..+.+.+.+..+.+.O .+.+.+..+.+.+.+..+.+.+  O O O  O O        |   
     0 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            aim7.time.elapsed_time.max                          
                                                                                
  1000 +--------------------------------------------------------------------+   
   900 |-+                                                             O    |   
       |                                                             O    O |   
   800 |-+                                                                  |   
   700 |-+                                                                  |   
       |                                                                    |   
   600 |-+                                                                  |   
   500 |-+                                                                  |   
   400 |-+                                                                  |   
       |                                                                    |   
   300 |-+                                                                  |   
   200 |-+                                                                  |   
       |                                                                    |   
   100 |.+..+.+.+..+.+.+.+..+.+.O .+.+.+..+.+.+.+..+.+.+  O O O  O O        |   
     0 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                        aim7.time.involuntary_context_switches                  
                                                                                
    3e+06 +-----------------------------------------------------------------+   
          |                                                          O  O O |   
  2.5e+06 |-O O  O O O O O  O O O O O  O O O O O  O O O O O  O O O O        |   
          |                                                                 |   
          |                                                                 |   
    2e+06 |-+                                                               |   
          |                                                                 |   
  1.5e+06 |-+                                +.+..+.+.+.+                   |   
          |                                 :                               |   
    1e+06 |-+                               :                               |   
          |.+.+..+.+.+.+.+..+.+.+   +..+.+.+                                |   
          |                      :  :                                       |   
   500000 |-+                    : :                                        |   
          |                       ::                                        |   
        0 +-----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            aim7.time.file_system_outputs                       
                                                                                
  9e+07 +-------------------------------------------------------------------+   
        | O  O O O O  O O O O  : O : O  O O O  O O O O  O O O O  O O O O  O |   
  8e+07 |-+                    :   :                                        |   
  7e+07 |-+                    :   :                                        |   
        |                       : :                                         |   
  6e+07 |-+                     : :                                         |   
  5e+07 |-+                     : :                                         |   
        |                       : :                                         |   
  4e+07 |-+                     : :                                         |   
  3e+07 |-+                     : :                                         |   
        |                       : :                                         |   
  2e+07 |-+                      :                                          |   
  1e+07 |-+                      :                                          |   
        |                        :                                          |   
      0 +-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample

***************************************************************************************************
lkp-cfl-e1: 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/30%/debian-10.4-x86_64-20200603.cgz/300s/lkp-cfl-e1/shell8/unixbench/0xde

commit: 
  62d5313500 ("locking/rwsem: Enable reader optimistic lock stealing")
  c9847a7f94 ("locking/rwsem: Wake up all waiting readers if RWSEM_WAKE_READ_OWNED")

62d5313500ac58b6 c9847a7f94679e742710574a2a7 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     22370            -1.9%      21939        unixbench.score
   1325065            -2.8%    1287341        unixbench.time.involuntary_context_switches
     10030            -0.8%       9950        unixbench.time.maximum_resident_set_size
 1.074e+08            -1.9%  1.054e+08        unixbench.time.minor_page_faults
      1367            -2.2%       1337        unixbench.time.percent_of_cpu_this_job_got
    372.90            -2.6%     363.18        unixbench.time.system_time
    490.82            -1.9%     481.37        unixbench.time.user_time
   3156052           +11.8%    3528615        unixbench.time.voluntary_context_switches
    845598            -1.9%     829330        unixbench.workload
     11.84            +2.0       13.83 ±  4%  mpstat.cpu.all.idle%
     14864 ± 57%     -63.7%       5388 ± 26%  softirqs.NET_RX
     48363           -16.4%      40455 ± 10%  meminfo.AnonHugePages
    217888           -11.7%     192288 ±  4%  meminfo.DirectMap4k
      2185           +12.1%       2449        slabinfo.kmalloc-1k.num_objs
     11354 ±  3%     -16.1%       9521 ±  4%  slabinfo.vmap_area.active_objs
     11526 ±  3%     -14.7%       9835 ±  4%  slabinfo.vmap_area.num_objs
     13.50 ±  3%     +14.8%      15.50 ±  3%  vmstat.cpu.id
     51.00            -2.5%      49.75        vmstat.cpu.sy
     34.00            -2.9%      33.00        vmstat.cpu.us
     23.50 ±  2%      -9.6%      21.25 ±  5%  vmstat.procs.r
    102380           +10.6%     113264        vmstat.system.cs
  33970733 ±  2%     +50.1%   50992679 ±  8%  cpuidle.C1.time
    886295           +46.4%    1297530 ±  6%  cpuidle.C1.usage
     62811 ± 99%    +202.9%     190270 ± 12%  cpuidle.C10.time
     45921 ±  3%     +35.2%      62068 ± 13%  cpuidle.C3.usage
    115402          +124.5%     259071 ±  8%  cpuidle.POLL.time
     10953 ±  3%    +197.5%      32585 ±  7%  cpuidle.POLL.usage
    477.50 ±  3%      +9.5%     522.75        proc-vmstat.nr_active_anon
      5785            +0.9%       5838        proc-vmstat.nr_kernel_stack
    477.50 ±  3%      +9.5%     522.75        proc-vmstat.nr_zone_active_anon
  71809737            -1.1%   71020069        proc-vmstat.numa_hit
  71809737            -1.1%   71020069        proc-vmstat.numa_local
    119599            -3.0%     115977        proc-vmstat.pgactivate
  76761873            -1.9%   75313926        proc-vmstat.pgalloc_normal
 1.077e+08            -1.9%  1.056e+08        proc-vmstat.pgfault
  76755211            -1.9%   75305695        proc-vmstat.pgfree
   5472622            -2.1%    5357159        proc-vmstat.pgreuse
      3627            -4.2%       3475        proc-vmstat.thp_fault_alloc
   1503946            -1.9%    1474994        proc-vmstat.unevictable_pgs_culled
      4767 ± 96%     -89.1%     519.50 ±139%  interrupts.132:IR-PCI-MSI.2097153-edge.eth1-TxRx-0
     22159 ±  2%      -4.0%      21268 ±  3%  interrupts.CAL:Function_call_interrupts
    558.50 ±  2%     +14.4%     639.00 ± 11%  interrupts.CPU0.TLB:TLB_shootdowns
      4767 ± 96%     -89.1%     519.50 ±139%  interrupts.CPU1.132:IR-PCI-MSI.2097153-edge.eth1-TxRx-0
      1363 ±  5%      -9.3%       1237 ±  6%  interrupts.CPU1.CAL:Function_call_interrupts
    559.00           +17.1%     654.50 ±  2%  interrupts.CPU1.TLB:TLB_shootdowns
    535.00 ±  2%     +24.1%     663.75 ±  4%  interrupts.CPU10.TLB:TLB_shootdowns
    576.50           +14.1%     658.00 ±  4%  interrupts.CPU11.TLB:TLB_shootdowns
      1421 ±  5%      -7.1%       1320 ±  4%  interrupts.CPU12.CAL:Function_call_interrupts
    579.00           +20.5%     697.75 ±  3%  interrupts.CPU12.TLB:TLB_shootdowns
    569.50           +21.2%     690.50 ±  6%  interrupts.CPU13.TLB:TLB_shootdowns
    505.00           +32.2%     667.50 ±  6%  interrupts.CPU14.TLB:TLB_shootdowns
      1422 ±  3%      -8.4%       1302 ±  3%  interrupts.CPU15.CAL:Function_call_interrupts
    509.50 ±  6%     +36.2%     694.00 ±  8%  interrupts.CPU15.TLB:TLB_shootdowns
    557.50 ±  2%     +18.9%     662.75 ±  6%  interrupts.CPU2.TLB:TLB_shootdowns
    570.00 ±  2%     +18.9%     678.00 ±  8%  interrupts.CPU3.TLB:TLB_shootdowns
    556.50           +21.4%     675.75 ±  2%  interrupts.CPU4.TLB:TLB_shootdowns
    506.00           +34.7%     681.75 ±  6%  interrupts.CPU5.TLB:TLB_shootdowns
      1363 ±  3%      -6.5%       1274 ±  5%  interrupts.CPU6.CAL:Function_call_interrupts
    534.00 ±  3%     +23.5%     659.50 ±  4%  interrupts.CPU6.TLB:TLB_shootdowns
    559.50           +21.3%     678.50 ±  7%  interrupts.CPU7.TLB:TLB_shootdowns
    563.50 ±  2%     +20.6%     679.75 ±  7%  interrupts.CPU8.TLB:TLB_shootdowns
    514.50 ±  4%     +27.8%     657.75 ±  2%  interrupts.CPU9.TLB:TLB_shootdowns
      8753           +22.7%      10738 ±  4%  interrupts.TLB:TLB_shootdowns
    242.90 ±  8%     +20.9%     293.59 ±  5%  sched_debug.cfs_rq:/.exec_clock.stddev
     12708 ±  2%     +19.8%      15225 ±  8%  sched_debug.cfs_rq:/.min_vruntime.stddev
      1472           +26.0%       1854 ± 12%  sched_debug.cfs_rq:/.runnable_avg.max
    292.07 ±  5%     +28.7%     375.92 ± 13%  sched_debug.cfs_rq:/.runnable_avg.stddev
     12708 ±  2%     +19.8%      15226 ±  8%  sched_debug.cfs_rq:/.spread0.stddev
      1418           +27.0%       1801 ± 12%  sched_debug.cfs_rq:/.util_avg.max
    281.89 ±  7%     +30.6%     368.13 ± 14%  sched_debug.cfs_rq:/.util_avg.stddev
    212080 ± 10%     -15.4%     179338 ± 12%  sched_debug.cpu.avg_idle.avg
     41096 ± 15%     -24.6%      30990 ± 17%  sched_debug.cpu.avg_idle.min
    208687 ±  3%     -15.1%     177102 ± 10%  sched_debug.cpu.avg_idle.stddev
      7605 ± 19%     +92.1%      14611 ±  7%  sched_debug.cpu.curr->pid.max
      2601 ± 37%     +93.0%       5020 ± 20%  sched_debug.cpu.curr->pid.stddev
    203329           +10.7%     225114        sched_debug.cpu.nr_switches.avg
    -82.00          +129.7%    -188.38        sched_debug.cpu.nr_uninterruptible.min
     42.97           +69.8%      72.96 ± 16%  sched_debug.cpu.nr_uninterruptible.stddev
    197540           +11.1%     219447        sched_debug.cpu.sched_count.avg
    200544           +11.3%     223137        sched_debug.cpu.sched_count.max
    187758           +11.0%     208437        sched_debug.cpu.sched_count.min
      3057           +23.1%       3763 ± 10%  sched_debug.cpu.sched_count.stddev
     43758           +28.3%      56141 ±  3%  sched_debug.cpu.sched_goidle.avg
     45063           +27.4%      57397 ±  3%  sched_debug.cpu.sched_goidle.max
     41416           +28.8%      53349 ±  2%  sched_debug.cpu.sched_goidle.min
    860.48           +23.8%       1064 ± 10%  sched_debug.cpu.sched_goidle.stddev
     86423           +13.0%      97665        sched_debug.cpu.ttwu_count.avg
     87940           +13.8%     100103        sched_debug.cpu.ttwu_count.max
     81643           +12.4%      91752 ±  2%  sched_debug.cpu.ttwu_count.min
    611.62 ±  2%     +26.0%     770.48 ± 11%  sched_debug.cpu.ttwu_local.stddev
 1.024e+10            -1.5%  1.008e+10        perf-stat.i.branch-instructions
      4.55            +0.1        4.69        perf-stat.i.cache-miss-rate%
 1.019e+08            -0.9%  1.009e+08        perf-stat.i.cache-misses
 2.485e+09            -1.7%  2.442e+09        perf-stat.i.cache-references
    105828           +10.8%     117262        perf-stat.i.context-switches
 5.631e+10            -1.8%  5.529e+10        perf-stat.i.cpu-cycles
     15839           +15.4%      18271 ±  2%  perf-stat.i.cpu-migrations
 1.276e+10            -1.8%  1.253e+10        perf-stat.i.dTLB-loads
   3739007            -2.7%    3638057        perf-stat.i.dTLB-store-misses
 7.373e+09            -1.9%  7.236e+09        perf-stat.i.dTLB-stores
  10623717            -1.7%   10438031        perf-stat.i.iTLB-load-misses
 4.991e+10            -1.5%  4.914e+10        perf-stat.i.instructions
      3.52            -1.8%       3.46        perf-stat.i.metric.GHz
      0.33 ±  6%     -58.4%       0.14 ± 28%  perf-stat.i.metric.K/sec
      2056            -1.7%       2021        perf-stat.i.metric.M/sec
   1655018            -2.2%    1619167        perf-stat.i.minor-faults
      0.00 ±  2%      +0.0        0.00 ± 15%  perf-stat.i.node-load-miss-rate%
   5452609            -1.0%    5399939        perf-stat.i.node-loads
  33146294            -1.4%   32686027        perf-stat.i.node-stores
   1655623            -2.2%    1619758        perf-stat.i.page-faults
 1.007e+10            -1.5%  9.918e+09        perf-stat.ps.branch-instructions
 1.002e+08            -0.9%   99277053        perf-stat.ps.cache-misses
 2.444e+09            -1.7%  2.403e+09        perf-stat.ps.cache-references
    104069           +10.9%     115371        perf-stat.ps.context-switches
 5.538e+10            -1.8%   5.44e+10        perf-stat.ps.cpu-cycles
     15575           +15.4%      17977 ±  2%  perf-stat.ps.cpu-migrations
 1.254e+10            -1.7%  1.233e+10        perf-stat.ps.dTLB-loads
   3676839            -2.7%    3579226        perf-stat.ps.dTLB-store-misses
 7.251e+09            -1.8%  7.119e+09        perf-stat.ps.dTLB-stores
  10447266            -1.7%   10269385        perf-stat.ps.iTLB-load-misses
 4.909e+10            -1.5%  4.835e+10        perf-stat.ps.instructions
   1627477            -2.1%    1592966        perf-stat.ps.minor-faults
   5362125            -0.9%    5312864        perf-stat.ps.node-loads
  32594979            -1.3%   32157625        perf-stat.ps.node-stores
   1628072            -2.1%    1593547        perf-stat.ps.page-faults
 3.148e+12            -1.5%  3.102e+12        perf-stat.total.instructions
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.write
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write.do_syscall_64
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write
     15.17 ±100%     -15.2        0.00        perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write
     24.48 ±100%     -14.2       10.29 ±173%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
     24.48 ±100%     -14.2       10.29 ±173%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
     24.48 ±100%     -14.2       10.29 ±173%  perf-profile.calltrace.cycles-pp.drm_fb_helper_dirty_work.process_one_work.worker_thread.kthread.ret_from_fork
     24.48 ±100%     -13.9       10.59 ±173%  perf-profile.calltrace.cycles-pp.ret_from_fork
     24.48 ±100%     -13.9       10.59 ±173%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
     23.80 ± 99%     -13.8       10.00 ±173%  perf-profile.calltrace.cycles-pp.memcpy_erms.drm_fb_helper_dirty_work.process_one_work.worker_thread.kthread
     13.79 ±100%     -13.8        0.00        perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold
     13.11 ±100%     -13.1        0.00        perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit
      8.96 ±100%      -9.0        0.00        perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock
      8.96 ±100%      -9.0        0.00        perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
      8.96 ±100%      -9.0        0.00        perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.perf_output_begin.perf_event_mmap_output.perf_iterate_sb.perf_event_mmap.mmap_region
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.vma_interval_tree_remove.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.__tsearch
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.__dentry_kill.shrink_dentry_list.shrink_dcache_parent.d_invalidate.proc_invalidate_siblings_dcache
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.evict.__dentry_kill.shrink_dentry_list.shrink_dcache_parent.d_invalidate
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.asm_exc_page_fault
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.perf_event_mmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.perf_iterate_sb.perf_event_mmap.mmap_region.do_mmap.vm_mmap_pgoff
      4.54 ±100%      -4.5        0.00        perf-profile.calltrace.cycles-pp.perf_event_mmap_output.perf_iterate_sb.perf_event_mmap.mmap_region.do_mmap
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.calltrace.cycles-pp.alloc_pages_vma.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.calltrace.cycles-pp.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
      4.14 ±100%      -4.1        0.00        perf-profile.calltrace.cycles-pp.io_serial_out.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.__do_sys_waitid.do_syscall_64.entry_SYSCALL_64_after_hwframe.waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.shrink_dentry_list.shrink_dcache_parent.d_invalidate.proc_invalidate_siblings_dcache.release_task
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.kernel_waitid.__do_sys_waitid.do_syscall_64.entry_SYSCALL_64_after_hwframe.waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.do_wait.kernel_waitid.__do_sys_waitid.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.d_invalidate.proc_invalidate_siblings_dcache.release_task.wait_task_zombie.do_wait
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.release_task.wait_task_zombie.do_wait.kernel_waitid.__do_sys_waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.proc_invalidate_siblings_dcache.release_task.wait_task_zombie.do_wait.kernel_waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.shrink_dcache_parent.d_invalidate.proc_invalidate_siblings_dcache.release_task.wait_task_zombie
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.calltrace.cycles-pp.wait_task_zombie.do_wait.kernel_waitid.__do_sys_waitid.do_syscall_64
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.calltrace.cycles-pp.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.calltrace.cycles-pp.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.calltrace.cycles-pp.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.calltrace.cycles-pp.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.calltrace.cycles-pp.setlocale
      0.34 ±100%     +10.4       10.71 ± 57%  perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.34 ±100%     +10.4       10.71 ± 57%  perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.34 ±100%     +10.4       10.71 ± 57%  perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.write
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.ksys_write
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.vfs_write
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.new_sync_write
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.devkmsg_write.cold
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.devkmsg_emit
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.vprintk_emit
     15.17 ±100%     -15.2        0.00        perf-profile.children.cycles-pp.console_unlock
     24.48 ±100%     -14.2       10.29 ±173%  perf-profile.children.cycles-pp.worker_thread
     24.48 ±100%     -14.2       10.29 ±173%  perf-profile.children.cycles-pp.process_one_work
     24.48 ±100%     -14.2       10.29 ±173%  perf-profile.children.cycles-pp.drm_fb_helper_dirty_work
     24.48 ±100%     -13.9       10.59 ±173%  perf-profile.children.cycles-pp.ret_from_fork
     24.48 ±100%     -13.9       10.59 ±173%  perf-profile.children.cycles-pp.kthread
     24.14 ±100%     -13.8       10.29 ±173%  perf-profile.children.cycles-pp.memcpy_erms
     13.79 ±100%     -13.8        0.00        perf-profile.children.cycles-pp.serial8250_console_write
     13.11 ±100%     -13.1        0.00        perf-profile.children.cycles-pp.uart_console_write
      9.65 ±100%      -9.7        0.00        perf-profile.children.cycles-pp.wait_for_xmitr
      9.65 ±100%      -9.7        0.00        perf-profile.children.cycles-pp.io_serial_in
      8.96 ±100%      -9.0        0.00        perf-profile.children.cycles-pp.serial8250_console_putchar
      4.89 ± 85%      -4.9        0.00        perf-profile.children.cycles-pp.vma_interval_tree_remove
      4.54 ±100%      -4.5        0.00        perf-profile.children.cycles-pp.perf_output_begin
      4.54 ±100%      -4.5        0.00        perf-profile.children.cycles-pp.__tsearch
      4.54 ±100%      -4.5        0.00        perf-profile.children.cycles-pp.__dentry_kill
      4.54 ±100%      -4.5        0.00        perf-profile.children.cycles-pp.evict
      4.54 ±100%      -4.5        0.00        perf-profile.children.cycles-pp.perf_event_mmap
      4.54 ±100%      -4.5        0.00        perf-profile.children.cycles-pp.perf_iterate_sb
      4.54 ±100%      -4.5        0.00        perf-profile.children.cycles-pp.perf_event_mmap_output
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.__handle_mm_fault
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.alloc_pages_vma
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.asm_exc_page_fault
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.do_user_addr_fault
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.do_anonymous_page
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.exc_page_fault
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.children.cycles-pp.handle_mm_fault
      4.14 ±100%      -4.1        0.00        perf-profile.children.cycles-pp.io_serial_out
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.__do_sys_waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.shrink_dentry_list
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.kernel_waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.do_wait
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.d_invalidate
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.release_task
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.proc_invalidate_siblings_dcache
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.shrink_dcache_parent
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.waitid
      4.54 ±100%      -2.8        1.78 ±173%  perf-profile.children.cycles-pp.wait_task_zombie
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.children.cycles-pp.__x64_sys_mprotect
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.children.cycles-pp.do_mprotect_pkey
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.children.cycles-pp.__vma_adjust
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.children.cycles-pp.mprotect_fixup
      4.54 ±100%      -2.5        2.08 ±173%  perf-profile.children.cycles-pp.setlocale
      0.34 ±100%     +10.4       10.71 ± 57%  perf-profile.children.cycles-pp.__x64_sys_exit_group
      0.69 ±100%     +20.4       21.12 ± 82%  perf-profile.children.cycles-pp.do_group_exit
      0.69 ±100%     +20.4       21.12 ± 82%  perf-profile.children.cycles-pp.do_exit
     24.14 ±100%     -14.1       10.00 ±173%  perf-profile.self.cycles-pp.memcpy_erms
      9.65 ±100%      -9.7        0.00        perf-profile.self.cycles-pp.io_serial_in
      4.89 ± 85%      -4.9        0.00        perf-profile.self.cycles-pp.vma_interval_tree_remove
      4.54 ±100%      -4.5        0.00        perf-profile.self.cycles-pp.perf_output_begin
      4.54 ±100%      -4.5        0.00        perf-profile.self.cycles-pp.__tsearch
      4.54 ±100%      -4.5        0.00        perf-profile.self.cycles-pp.setlocale
      4.54 ±100%      -4.5        0.00        perf-profile.self.cycles-pp.evict
      4.54 ±100%      -4.2        0.29 ±173%  perf-profile.self.cycles-pp.__alloc_pages_nodemask
      4.14 ±100%      -4.1        0.00        perf-profile.self.cycles-pp.io_serial_out



***************************************************************************************************
lkp-csl-2ap1: 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory
=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode:
  4k/gcc-9/performance/1SSD/xfs/sync/x86_64-rhel-8.3/32/debian-10.4-x86_64-20200603.cgz/300s/randwrite/lkp-csl-2ap1/256g/fio-basic/0x4003003

commit: 
  62d5313500 ("locking/rwsem: Enable reader optimistic lock stealing")
  c9847a7f94 ("locking/rwsem: Wake up all waiting readers if RWSEM_WAKE_READ_OWNED")

62d5313500ac58b6 c9847a7f94679e742710574a2a7 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
          0:2           11%           0:4     perf-profile.children.cycles-pp.error_entry
          0:2            8%           0:4     perf-profile.self.cycles-pp.error_entry
         %stddev     %change         %stddev
             \          |                \  
      0.03 ±  4%      +0.0        0.04 ±  5%  fio.latency_100us%
    310.22            +2.2%     316.95 ±  2%  fio.time.system_time
     80.27            -3.3%      77.63        fio.time.user_time
  14149913 ±  7%     -13.0%   12317496 ±  7%  meminfo.DirectMap2M
     20012 ±  5%      -8.9%      18226 ±  2%  meminfo.Writeback
     10114 ±  3%      -7.4%       9369 ±  5%  sched_debug.cpu.ttwu_count.stddev
     23907 ±  5%     -16.1%      20049 ±  6%  sched_debug.cpu.ttwu_local.max
     34.12            +1.5%      34.63        boot-time.boot
     29.29            +1.5%      29.72        boot-time.dhcp
      5692            +1.6%       5785        boot-time.idle
      1273            -2.3%       1244 ±  2%  perf-stat.i.cycles-between-cache-misses
      1253            -1.5%       1234        perf-stat.overall.cycles-between-cache-misses
      1255            -1.3%       1239        perf-stat.overall.instructions-per-iTLB-miss
   2249599 ±  8%    +196.0%    6658444 ± 27%  numa-numastat.node1.numa_foreign
  14201697 ±  4%     -32.4%    9595709 ± 11%  numa-numastat.node2.local_node
   3615071 ± 18%     -33.0%    2422719 ± 27%  numa-numastat.node2.numa_foreign
  14232753 ±  4%     -32.4%    9619099 ± 11%  numa-numastat.node2.numa_hit
   3648742 ± 14%    +111.0%    7698381 ± 17%  numa-numastat.node2.numa_miss
   3679798 ± 14%    +109.8%    7721778 ± 17%  numa-numastat.node2.other_node
    565431 ± 97%     -98.3%       9626 ± 27%  numa-meminfo.node0.Mapped
    562998 ± 98%     -99.0%       5571 ± 71%  numa-meminfo.node0.Shmem
      5781 ±  6%      -7.4%       5353 ±  7%  numa-meminfo.node0.Writeback
      6824 ±  8%    +770.6%      59416 ± 99%  numa-meminfo.node2.AnonPages
      6921 ±  8%   +8832.4%     618210 ± 85%  numa-meminfo.node2.Inactive(anon)
      6229 ±  3%     +17.1%       7294 ±  6%  numa-meminfo.node2.KernelStack
    221.00 ± 26%   +1132.2%       2723 ± 67%  numa-meminfo.node2.PageTables
   7779536 ±  3%      -7.2%    7221783 ±  5%  numa-meminfo.node3.Dirty
    916.00 ±  8%     -16.1%     768.25 ± 12%  proc-vmstat.kswapd_high_wmark_hit_quickly
    302394            -0.9%     299680        proc-vmstat.nr_slab_unreclaimable
  16262663 ±  3%     +25.8%   20453611 ±  9%  proc-vmstat.numa_foreign
  53313089            -7.9%   49075650 ±  3%  proc-vmstat.numa_hit
  53219629            -8.0%   48981929 ±  3%  proc-vmstat.numa_local
  16262663 ±  3%     +25.8%   20453611 ±  9%  proc-vmstat.numa_miss
  16356124 ±  3%     +25.6%   20547332 ±  9%  proc-vmstat.numa_other
      2589 ±  3%      -8.4%       2371 ±  8%  proc-vmstat.pageoutrun
      3178           -10.7%       2837 ±  4%  proc-vmstat.pgactivate
    464640           -16.5%     387918 ±  4%  proc-vmstat.pgalloc_dma32
  28308854            -2.0%   27733269        proc-vmstat.pgfree
    140746 ± 98%     -99.0%       1392 ± 71%  numa-vmstat.node0.nr_shmem
    611995 ±  8%    +329.7%    2629633 ± 30%  numa-vmstat.node1.numa_foreign
      1706 ±  8%    +770.5%      14854 ± 99%  numa-vmstat.node2.nr_anon_pages
      1731 ±  8%   +8828.6%     154553 ± 85%  numa-vmstat.node2.nr_inactive_anon
      6236 ±  3%     +16.9%       7290 ±  6%  numa-vmstat.node2.nr_kernel_stack
     53.50 ± 27%   +1166.4%     677.50 ± 68%  numa-vmstat.node2.nr_page_table_pages
      1276 ± 12%     -18.7%       1037 ± 18%  numa-vmstat.node2.nr_writeback
      1733 ±  8%   +8818.5%     154557 ± 85%  numa-vmstat.node2.nr_zone_inactive_anon
   8117299 ±  7%     -30.7%    5628762 ± 11%  numa-vmstat.node2.numa_hit
   8000798 ±  7%     -31.0%    5519712 ± 11%  numa-vmstat.node2.numa_local
   1945012 ±  3%      -7.2%    1804575 ±  5%  numa-vmstat.node3.nr_dirty
   1945821 ±  3%      -7.2%    1805557 ±  5%  numa-vmstat.node3.nr_zone_write_pending
     21294 ±  6%     -10.7%      19009 ± 10%  softirqs.CPU121.RCU
      8982 ± 60%     -59.2%       3668 ±151%  softirqs.CPU13.NET_RX
     21708            -9.8%      19575 ±  5%  softirqs.CPU160.RCU
     21280 ±  4%      -9.3%      19291 ±  5%  softirqs.CPU168.RCU
     21250 ±  2%     -11.5%      18811 ±  4%  softirqs.CPU169.RCU
     20674 ±  5%      -7.8%      19066 ±  3%  softirqs.CPU170.RCU
     19940 ±  5%      -7.3%      18493 ±  4%  softirqs.CPU172.RCU
     20439 ±  6%      -7.2%      18962 ±  6%  softirqs.CPU173.RCU
     20464 ±  5%      -7.9%      18847 ±  4%  softirqs.CPU174.RCU
     20260 ±  6%      -7.7%      18706 ±  5%  softirqs.CPU175.RCU
     22472 ±  4%     -10.4%      20138 ±  5%  softirqs.CPU176.RCU
     22274 ±  5%      -8.8%      20307 ±  6%  softirqs.CPU177.RCU
     22391 ±  4%      -9.7%      20210 ±  5%  softirqs.CPU178.RCU
     22638 ±  2%     -11.4%      20060 ±  5%  softirqs.CPU179.RCU
     21904 ±  6%      -9.2%      19882 ±  5%  softirqs.CPU180.RCU
     21495 ±  6%      -8.3%      19705 ±  5%  softirqs.CPU181.RCU
     21991 ±  5%      -7.5%      20334 ±  5%  softirqs.CPU183.RCU
     21678 ±  5%      -6.5%      20277 ±  4%  softirqs.CPU185.RCU
     22661 ±  8%     -11.1%      20139 ±  5%  softirqs.CPU187.RCU
     24764           -16.2%      20750 ±  7%  softirqs.CPU24.RCU
     22860 ±  7%      -9.9%      20606 ±  3%  softirqs.CPU64.RCU
      8947 ± 12%    +137.3%      21230 ± 40%  softirqs.CPU7.SCHED
     23032 ±  3%      -9.8%      20770 ±  5%  softirqs.CPU72.RCU
     22208 ±  3%     -10.8%      19814 ±  6%  softirqs.CPU73.RCU
     22009 ±  4%     -11.9%      19390 ±  8%  softirqs.CPU83.RCU
     21939 ±  5%      -7.0%      20400 ±  3%  softirqs.CPU90.RCU
     21959 ±  5%      -7.2%      20371 ±  4%  softirqs.CPU91.RCU
     22777           -11.0%      20263 ±  3%  softirqs.CPU92.RCU
     21811 ±  5%      -6.3%      20446 ±  5%  softirqs.CPU94.RCU
     48.90 ±  2%      -2.7       46.17 ±  2%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     47.31 ±  2%      -2.6       44.69        perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
     54.66 ±  4%      -2.4       52.27 ±  2%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      2.45 ±  8%      -0.3        2.10 ±  6%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
      1.67 ±  5%      -0.2        1.50 ±  2%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      1.71 ±  5%      -0.2        1.55 ±  3%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      0.91 ±  8%      -0.1        0.82 ±  4%  perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
     49.23 ±  2%      -2.6       46.58 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter_state
     49.25 ±  2%      -2.6       46.61 ±  2%  perf-profile.children.cycles-pp.cpuidle_enter
     54.66 ±  4%      -2.4       52.27 ±  2%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     54.66 ±  4%      -2.4       52.27 ±  2%  perf-profile.children.cycles-pp.cpu_startup_entry
     54.66 ±  4%      -2.4       52.27 ±  2%  perf-profile.children.cycles-pp.do_idle
      1.73 ±  6%      -0.1        1.58 ±  2%  perf-profile.children.cycles-pp.update_process_times
      1.76 ±  6%      -0.1        1.63 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.56 ±  5%      -0.1        0.47 ± 13%  perf-profile.children.cycles-pp.lapic_next_deadline
      0.96 ±  8%      -0.1        0.87 ±  4%  perf-profile.children.cycles-pp.scheduler_tick
      0.11 ± 18%      -0.1        0.03 ±105%  perf-profile.children.cycles-pp.put_cpu_partial
      0.20 ± 19%      -0.1        0.13 ± 14%  perf-profile.children.cycles-pp.xfs_btree_lshift
      0.43 ±  8%      -0.0        0.38 ±  4%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.24 ±  4%      -0.0        0.20 ± 11%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.07 ± 20%      -0.0        0.04 ± 58%  perf-profile.children.cycles-pp.timekeeping_advance
      0.06            -0.0        0.03 ±100%  perf-profile.children.cycles-pp.native_apic_mem_write
      0.08 ±  6%      -0.0        0.04 ± 59%  perf-profile.children.cycles-pp.delay_tsc
      0.07            -0.0        0.04 ± 58%  perf-profile.children.cycles-pp.rcu_read_unlock_strict
      0.17 ±  5%      -0.0        0.14 ± 10%  perf-profile.children.cycles-pp._xfs_trans_bjoin
      0.28 ±  5%      -0.0        0.25 ±  7%  perf-profile.children.cycles-pp.calc_global_load_tick
      0.11 ±  4%      -0.0        0.09 ±  7%  perf-profile.children.cycles-pp.xfs_errortag_test
      0.05            +0.0        0.06        perf-profile.children.cycles-pp.menu_reflect
      0.08 ±  5%      +0.0        0.11 ±  9%  perf-profile.children.cycles-pp.xfs_end_bio
      0.06 ± 16%      +0.0        0.09        perf-profile.children.cycles-pp.xfs_iext_insert
      0.16            +0.0        0.19 ±  7%  perf-profile.children.cycles-pp.xfs_trans_log_buf
      0.07 ±  7%      +0.0        0.10 ± 11%  perf-profile.children.cycles-pp.run_local_timers
      0.06 ±  9%      +0.0        0.09 ± 13%  perf-profile.children.cycles-pp.up_read
      0.09            +0.0        0.12 ± 23%  perf-profile.children.cycles-pp.node_dirty_ok
      0.29 ±  6%      +0.0        0.33 ±  2%  perf-profile.children.cycles-pp.xfs_inode_item_format
      0.00            +0.1        0.06 ± 15%  perf-profile.children.cycles-pp.irqentry_exit
      0.23            +0.1        0.29 ±  6%  perf-profile.children.cycles-pp.xfs_btree_insrec
      0.25 ±  4%      +0.1        0.31 ±  6%  perf-profile.children.cycles-pp.xfs_btree_insert
      0.57 ±  6%      +0.1        0.68 ±  5%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.44 ±  5%      +0.1        0.57 ±  9%  perf-profile.children.cycles-pp.get_page_from_freelist
      0.52 ±  4%      +0.1        0.64 ±  8%  perf-profile.children.cycles-pp.__alloc_pages_nodemask
      0.55 ±  5%      -0.1        0.47 ± 13%  perf-profile.self.cycles-pp.lapic_next_deadline
      0.34 ±  4%      -0.1        0.27 ± 15%  perf-profile.self.cycles-pp.update_process_times
      0.71            -0.1        0.66 ±  4%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.18 ± 13%      -0.0        0.15 ± 10%  perf-profile.self.cycles-pp.blk_attempt_plug_merge
      0.22 ±  6%      -0.0        0.18 ±  8%  perf-profile.self.cycles-pp.rcu_sched_clock_irq
      0.19 ± 15%      -0.0        0.16 ±  8%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.16 ±  9%      -0.0        0.13 ±  6%  perf-profile.self.cycles-pp.tick_sched_timer
      0.08 ±  6%      -0.0        0.04 ± 59%  perf-profile.self.cycles-pp.delay_tsc
      0.09 ± 11%      -0.0        0.07 ± 13%  perf-profile.self.cycles-pp._xfs_trans_bjoin
      0.13 ±  7%      -0.0        0.11 ±  6%  perf-profile.self.cycles-pp.rebalance_domains
      0.10 ±  5%      -0.0        0.08 ±  6%  perf-profile.self.cycles-pp.xfs_errortag_test
      0.13            -0.0        0.11 ±  7%  perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.10            -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.xfs_btree_rec_offset
      0.11 ±  4%      -0.0        0.10 ±  7%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.05            +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.blk_attempt_bio_merge
      0.05            +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.xfs_iext_insert
      0.12            +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.xfs_trans_dirty_buf
      0.06 ±  9%      +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.up_read
      0.05            +0.0        0.08 ± 14%  perf-profile.self.cycles-pp.run_local_timers
      0.20 ±  2%      +0.1        0.26 ± 15%  perf-profile.self.cycles-pp.clear_page_dirty_for_io
     17886 ± 60%     -61.2%       6932 ±151%  interrupts.34:PCI-MSI.524292-edge.eth0-TxRx-3
    178.50 ±  7%     -54.3%      81.50 ± 88%  interrupts.CPU101.TLB:TLB_shootdowns
    179.00 ±  7%     -54.1%      82.25 ± 87%  interrupts.CPU103.TLB:TLB_shootdowns
    186.00           -52.3%      88.75 ± 82%  interrupts.CPU104.TLB:TLB_shootdowns
    188.50           -55.2%      84.50 ± 88%  interrupts.CPU105.TLB:TLB_shootdowns
    556.00           -39.6%     336.00 ± 59%  interrupts.CPU106.RES:Rescheduling_interrupts
    222.50 ± 14%     -59.8%      89.50 ± 80%  interrupts.CPU106.TLB:TLB_shootdowns
    179.00 ±  6%     -50.4%      88.75 ± 82%  interrupts.CPU107.TLB:TLB_shootdowns
    680.50 ± 16%     -37.5%     425.25 ± 21%  interrupts.CPU108.NMI:Non-maskable_interrupts
    680.50 ± 16%     -37.5%     425.25 ± 21%  interrupts.CPU108.PMI:Performance_monitoring_interrupts
    107.00 ± 57%     -59.1%      43.75 ±145%  interrupts.CPU11.TLB:TLB_shootdowns
    191.50           -55.1%      86.00 ± 87%  interrupts.CPU110.TLB:TLB_shootdowns
    701.50 ± 62%     -70.1%     209.50 ± 35%  interrupts.CPU111.NMI:Non-maskable_interrupts
    701.50 ± 62%     -70.1%     209.50 ± 35%  interrupts.CPU111.PMI:Performance_monitoring_interrupts
    187.00           -54.4%      85.25 ± 88%  interrupts.CPU111.TLB:TLB_shootdowns
    181.00 ±  4%     -51.1%      88.50 ± 81%  interrupts.CPU112.TLB:TLB_shootdowns
    184.50 ±  2%     -54.9%      83.25 ± 89%  interrupts.CPU114.TLB:TLB_shootdowns
    174.00 ±  9%     -52.6%      82.50 ± 87%  interrupts.CPU116.TLB:TLB_shootdowns
    681.00 ± 37%     -69.6%     207.00 ± 48%  interrupts.CPU117.NMI:Non-maskable_interrupts
    681.00 ± 37%     -69.6%     207.00 ± 48%  interrupts.CPU117.PMI:Performance_monitoring_interrupts
    194.50 ±  9%     -54.8%      88.00 ± 82%  interrupts.CPU117.TLB:TLB_shootdowns
    189.00           -50.4%      93.75 ± 69%  interrupts.CPU118.TLB:TLB_shootdowns
     59.50 ± 88%    +200.0%     178.50 ± 32%  interrupts.CPU121.TLB:TLB_shootdowns
    246.00           -42.9%     140.50 ± 61%  interrupts.CPU124.NMI:Non-maskable_interrupts
    246.00           -42.9%     140.50 ± 61%  interrupts.CPU124.PMI:Performance_monitoring_interrupts
     17886 ± 60%     -61.2%       6932 ±151%  interrupts.CPU13.34:PCI-MSI.524292-edge.eth0-TxRx-3
     96.00 ± 67%     -65.6%      33.00 ±167%  interrupts.CPU13.TLB:TLB_shootdowns
    109.50 ± 15%     -30.1%      76.50 ± 38%  interrupts.CPU136.NMI:Non-maskable_interrupts
    109.50 ± 15%     -30.1%      76.50 ± 38%  interrupts.CPU136.PMI:Performance_monitoring_interrupts
    102.50 ±  7%     -30.5%      71.25 ± 22%  interrupts.CPU137.NMI:Non-maskable_interrupts
    102.50 ±  7%     -30.5%      71.25 ± 22%  interrupts.CPU137.PMI:Performance_monitoring_interrupts
    101.00 ±  6%    +131.2%     233.50 ± 52%  interrupts.CPU143.NMI:Non-maskable_interrupts
    101.00 ±  6%    +131.2%     233.50 ± 52%  interrupts.CPU143.PMI:Performance_monitoring_interrupts
    497.00 ± 47%     -63.4%     181.75 ± 45%  interrupts.CPU144.NMI:Non-maskable_interrupts
    497.00 ± 47%     -63.4%     181.75 ± 45%  interrupts.CPU144.PMI:Performance_monitoring_interrupts
    336.00 ± 18%     -42.8%     192.25 ± 25%  interrupts.CPU145.NMI:Non-maskable_interrupts
    336.00 ± 18%     -42.8%     192.25 ± 25%  interrupts.CPU145.PMI:Performance_monitoring_interrupts
    321.50 ± 22%     -55.5%     143.00 ± 29%  interrupts.CPU147.NMI:Non-maskable_interrupts
    321.50 ± 22%     -55.5%     143.00 ± 29%  interrupts.CPU147.PMI:Performance_monitoring_interrupts
    103.00 ±  6%     +72.1%     177.25 ± 37%  interrupts.CPU149.NMI:Non-maskable_interrupts
    103.00 ±  6%     +72.1%     177.25 ± 37%  interrupts.CPU149.PMI:Performance_monitoring_interrupts
     82.50 ±  3%     +84.8%     152.50 ± 40%  interrupts.CPU149.TLB:TLB_shootdowns
    733.50 ± 32%     -56.9%     316.50 ± 46%  interrupts.CPU15.NMI:Non-maskable_interrupts
    733.50 ± 32%     -56.9%     316.50 ± 46%  interrupts.CPU15.PMI:Performance_monitoring_interrupts
      3.00 ± 33%   +1933.3%      61.00 ± 68%  interrupts.CPU152.RES:Rescheduling_interrupts
    151.50 ± 26%     -40.9%      89.50 ± 26%  interrupts.CPU153.NMI:Non-maskable_interrupts
    151.50 ± 26%     -40.9%      89.50 ± 26%  interrupts.CPU153.PMI:Performance_monitoring_interrupts
    111.50 ±  2%     +67.9%     187.25 ± 27%  interrupts.CPU158.NMI:Non-maskable_interrupts
    111.50 ±  2%     +67.9%     187.25 ± 27%  interrupts.CPU158.PMI:Performance_monitoring_interrupts
     87.50 ± 22%     +92.0%     168.00 ± 31%  interrupts.CPU159.TLB:TLB_shootdowns
    175.50           -59.5%      71.00 ± 57%  interrupts.CPU16.RES:Rescheduling_interrupts
    244.00 ±  7%     -55.0%     109.75 ±  9%  interrupts.CPU160.NMI:Non-maskable_interrupts
    244.00 ±  7%     -55.0%     109.75 ±  9%  interrupts.CPU160.PMI:Performance_monitoring_interrupts
    311.00 ± 24%     -71.1%      90.00 ± 23%  interrupts.CPU163.NMI:Non-maskable_interrupts
    311.00 ± 24%     -71.1%      90.00 ± 23%  interrupts.CPU163.PMI:Performance_monitoring_interrupts
    317.00 ± 23%     -57.3%     135.50 ± 58%  interrupts.CPU164.NMI:Non-maskable_interrupts
    317.00 ± 23%     -57.3%     135.50 ± 58%  interrupts.CPU164.PMI:Performance_monitoring_interrupts
    101.00 ± 80%     -51.5%      49.00 ±145%  interrupts.CPU17.TLB:TLB_shootdowns
    100.50 ± 44%    +233.1%     334.75 ± 29%  interrupts.CPU170.NMI:Non-maskable_interrupts
    100.50 ± 44%    +233.1%     334.75 ± 29%  interrupts.CPU170.PMI:Performance_monitoring_interrupts
     68.00 ± 33%    +126.8%     154.25 ± 30%  interrupts.CPU172.NMI:Non-maskable_interrupts
     68.00 ± 33%    +126.8%     154.25 ± 30%  interrupts.CPU172.PMI:Performance_monitoring_interrupts
    130.00 ± 40%     -65.0%      45.50 ±142%  interrupts.CPU18.TLB:TLB_shootdowns
     79.50 ± 44%    +255.3%     282.50 ± 27%  interrupts.CPU184.NMI:Non-maskable_interrupts
     79.50 ± 44%    +255.3%     282.50 ± 27%  interrupts.CPU184.PMI:Performance_monitoring_interrupts
    714.50 ± 21%     -67.9%     229.50 ± 32%  interrupts.CPU21.NMI:Non-maskable_interrupts
    714.50 ± 21%     -67.9%     229.50 ± 32%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
    159.50 ± 20%     -59.1%      65.25 ± 81%  interrupts.CPU22.TLB:TLB_shootdowns
    118.00 ± 14%     -53.8%      54.50 ± 56%  interrupts.CPU23.RES:Rescheduling_interrupts
    312.00 ± 19%    +109.9%     654.75 ± 28%  interrupts.CPU24.NMI:Non-maskable_interrupts
    312.00 ± 19%    +109.9%     654.75 ± 28%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
     16.50 ± 81%    +943.9%     172.25 ± 51%  interrupts.CPU24.TLB:TLB_shootdowns
    254.50          +143.4%     619.50 ± 45%  interrupts.CPU25.NMI:Non-maskable_interrupts
    254.50          +143.4%     619.50 ± 45%  interrupts.CPU25.PMI:Performance_monitoring_interrupts
    742.00 ± 19%     -41.4%     435.00 ± 56%  interrupts.CPU3.NMI:Non-maskable_interrupts
    742.00 ± 19%     -41.4%     435.00 ± 56%  interrupts.CPU3.PMI:Performance_monitoring_interrupts
     21.00 ± 57%    +409.5%     107.00 ± 61%  interrupts.CPU37.TLB:TLB_shootdowns
    540.00 ± 21%     -46.0%     291.75 ± 43%  interrupts.CPU48.NMI:Non-maskable_interrupts
    540.00 ± 21%     -46.0%     291.75 ± 43%  interrupts.CPU48.PMI:Performance_monitoring_interrupts
    111.00 ± 54%     -65.1%      38.75 ±136%  interrupts.CPU5.TLB:TLB_shootdowns
    103.50 ±  8%    +137.9%     246.25 ± 50%  interrupts.CPU53.NMI:Non-maskable_interrupts
    103.50 ±  8%    +137.9%     246.25 ± 50%  interrupts.CPU53.PMI:Performance_monitoring_interrupts
    123.50 ±  9%     -16.4%     103.25 ±  8%  interrupts.CPU57.NMI:Non-maskable_interrupts
    123.50 ±  9%     -16.4%     103.25 ±  8%  interrupts.CPU57.PMI:Performance_monitoring_interrupts
    105.50 ± 46%     -92.7%       7.75 ± 68%  interrupts.CPU6.TLB:TLB_shootdowns
     82.00 ± 35%    +247.6%     285.00 ± 44%  interrupts.CPU62.NMI:Non-maskable_interrupts
     82.00 ± 35%    +247.6%     285.00 ± 44%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
     29.50 ± 69%    +341.5%     130.25 ± 43%  interrupts.CPU63.TLB:TLB_shootdowns
    379.50 ±  3%     -71.5%     108.25 ±  6%  interrupts.CPU64.NMI:Non-maskable_interrupts
    379.50 ±  3%     -71.5%     108.25 ±  6%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
    342.00 ± 18%     -69.9%     103.00 ±  9%  interrupts.CPU67.NMI:Non-maskable_interrupts
    342.00 ± 18%     -69.9%     103.00 ±  9%  interrupts.CPU67.PMI:Performance_monitoring_interrupts
    105.50 ± 47%     -68.2%      33.50 ± 85%  interrupts.CPU7.TLB:TLB_shootdowns
      7.50 ±  6%    +960.0%      79.50 ±144%  interrupts.CPU72.RES:Rescheduling_interrupts
    148.00 ± 27%    +137.5%     351.50 ± 16%  interrupts.CPU74.NMI:Non-maskable_interrupts
    148.00 ± 27%    +137.5%     351.50 ± 16%  interrupts.CPU74.PMI:Performance_monitoring_interrupts
    407.50 ±  4%     +77.5%     723.50 ± 35%  interrupts.CPU8.NMI:Non-maskable_interrupts
    407.50 ±  4%     +77.5%     723.50 ± 35%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
    151.50 ±  9%     -69.8%      45.75 ±139%  interrupts.CPU8.TLB:TLB_shootdowns
    101.50 ± 12%    +192.4%     296.75 ± 39%  interrupts.CPU88.NMI:Non-maskable_interrupts
    101.50 ± 12%    +192.4%     296.75 ± 39%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
      1.00 ±100%   +3975.0%      40.75 ±150%  interrupts.CPU94.RES:Rescheduling_interrupts
    167.00 ± 16%     -56.7%      72.25 ± 77%  interrupts.CPU96.TLB:TLB_shootdowns
    474.50 ± 62%     -81.1%      89.75 ± 76%  interrupts.CPU97.TLB:TLB_shootdowns
    191.00           -52.7%      90.25 ± 75%  interrupts.CPU98.TLB:TLB_shootdowns





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Oliver Sang


View attachment "config-5.10.0-rc3-00005-gc9847a7f9467" of type "text/plain" (170093 bytes)

View attachment "job-script" of type "text/plain" (8373 bytes)

View attachment "job.yaml" of type "text/plain" (5700 bytes)

View attachment "reproduce" of type "text/plain" (1009 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ