lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20200824004522.GR18179@shao2-debian>
Date:   Mon, 24 Aug 2020 08:45:22 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Goldwyn Rodrigues <rgoldwyn@...e.com>
Cc:     David Sterba <dsterba@...e.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        linux-btrfs@...r.kernel.org
Subject: [btrfs] c0aaf9b7a1: reaim.jobs_per_min 21.8% improvement

Greeting,

FYI, we noticed a 21.8% improvement of reaim.jobs_per_min due to commit:


commit: c0aaf9b7a114f6b75e0da97be7d99c102347a751 ("btrfs: switch to iomap_dio_rw() for dio")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master


in testcase: reaim
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
with following parameters:

	runtime: 300s
	nr_task: 100
	disk: 1HDD
	fs: btrfs
	test: disk
	cpufreq_governor: performance
	ucode: 0x5002f01

test-description: REAIM is an updated and improved version of AIM 7 benchmark.
test-url: https://sourceforge.net/projects/re-aim-7/





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
  gcc-9/performance/1HDD/btrfs/x86_64-rhel-8.3/100/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2sp7/disk/reaim/0x5002f01

commit: 
  b77407c36a ("btrfs: check the right error variable in btrfs_del_dir_entries_in_log")
  c0aaf9b7a1 ("btrfs: switch to iomap_dio_rw() for dio")

b77407c36ac2bcab c0aaf9b7a114f6b75e0da97be7d 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
          0:4           -0%           0:4     perf-profile.children.cycles-pp.error_entry
         %stddev     %change         %stddev
             \          |                \  
      7094           +21.8%       8639        reaim.jobs_per_min
     70.94           +21.8%      86.40        reaim.jobs_per_min_child
      7172           +22.4%       8776        reaim.max_jobs_per_min
     84.59           -17.9%      69.46        reaim.parent_time
      0.97 ±  2%     -15.1%       0.83 ±  4%  reaim.std_dev_time
    347.16            +3.2%     358.33        reaim.time.elapsed_time
    347.16            +3.2%     358.33        reaim.time.elapsed_time.max
    273108           -85.4%      39900        reaim.time.file_system_inputs
   7558500           +31.6%    9945474        reaim.time.file_system_outputs
     55771           -41.3%      32745        reaim.time.involuntary_context_switches
      9988 ±  7%     +20.9%      12076 ±  4%  reaim.time.major_page_faults
   6909321           +25.2%    8647763        reaim.time.minor_page_faults
     94.00 ±  2%     +21.5%     114.25        reaim.time.percent_of_cpu_this_job_got
    310.54           +25.2%     388.82        reaim.time.system_time
     18.01           +24.1%      22.34        reaim.time.user_time
   1917831           +27.0%    2436493        reaim.time.voluntary_context_switches
     40000           +25.0%      50000        reaim.workload
     90.28            +2.0%      92.08        iostat.cpu.idle
      6.68           -28.6%       4.77        iostat.cpu.iowait
      6.71            -1.9        4.79        mpstat.cpu.all.iowait%
      1.05 ±  4%      +0.2        1.28        mpstat.cpu.all.sys%
   1036195 ±  8%     +22.4%    1268422        cpuidle.C1.usage
   1032367           +18.3%    1221111        cpuidle.POLL.time
    200734           +18.5%     237965        cpuidle.POLL.usage
    480652           +30.7%     628363        meminfo.Active
    473220           +31.1%     620546        meminfo.Active(file)
    603667           -13.0%     525322        meminfo.Inactive
    295951           -26.5%     217384        meminfo.Inactive(file)
   3110715 ±  2%     +20.6%    3750872 ±  3%  numa-numastat.node0.local_node
   3110883 ±  2%     +20.8%    3758779 ±  3%  numa-numastat.node0.numa_hit
   2962537 ±  2%     +20.8%    3579954 ±  3%  numa-numastat.node1.local_node
   2993644 ±  2%     +20.4%    3603413 ±  3%  numa-numastat.node1.numa_hit
     90.00            +2.2%      92.00        vmstat.cpu.id
    389.75           -85.9%      55.00 ±  2%  vmstat.io.bi
     17120           +28.0%      21905        vmstat.io.bo
      6.25 ±  6%     -32.0%       4.25 ± 10%  vmstat.procs.b
     18996           +17.7%      22352        vmstat.system.cs
    241644 ±  4%     +32.9%     321105        numa-meminfo.node0.Active
    238912 ±  4%     +33.6%     319122        numa-meminfo.node0.Active(file)
    148253           -25.2%     110871        numa-meminfo.node0.Inactive(file)
     14202 ± 14%     +10.2%      15655 ± 15%  numa-meminfo.node0.Mapped
    238944 ±  3%     +28.7%     307560 ±  2%  numa-meminfo.node1.Active
    234246 ±  3%     +28.8%     301726 ±  2%  numa-meminfo.node1.Active(file)
    147828 ±  2%     -28.0%     106478 ±  2%  numa-meminfo.node1.Inactive(file)
      1127 ±  6%     -17.5%     930.50 ± 12%  slabinfo.file_lock_cache.active_objs
      1127 ±  6%     -17.5%     930.50 ± 12%  slabinfo.file_lock_cache.num_objs
      4527 ±  2%     -12.1%       3981        slabinfo.khugepaged_mm_slot.active_objs
      4527 ±  2%     -12.1%       3981        slabinfo.khugepaged_mm_slot.num_objs
      4151 ±  4%      +9.1%       4528 ±  6%  slabinfo.kmalloc-rcl-64.active_objs
      4151 ±  4%      +9.1%       4528 ±  6%  slabinfo.kmalloc-rcl-64.num_objs
     10364 ±  4%     +14.7%      11891        slabinfo.mnt_cache.active_objs
     10513 ±  4%     +14.6%      12043        slabinfo.mnt_cache.num_objs
     39580           +13.5%      44928        slabinfo.numa_policy.active_objs
     39581           +13.6%      44956        slabinfo.numa_policy.num_objs
     59736 ±  4%     +33.5%      79730        numa-vmstat.node0.nr_active_file
    274074 ±  2%     +31.1%     359370        numa-vmstat.node0.nr_dirtied
     37068           -25.0%      27792        numa-vmstat.node0.nr_inactive_file
      3615 ± 13%     +11.1%       4016 ± 14%  numa-vmstat.node0.nr_mapped
    264153 ±  2%     +31.6%     347645        numa-vmstat.node0.nr_written
     59736 ±  4%     +33.5%      79730        numa-vmstat.node0.nr_zone_active_file
     37068           -25.0%      27792        numa-vmstat.node0.nr_zone_inactive_file
   2274776 ±  4%     +13.8%    2589250 ±  5%  numa-vmstat.node0.numa_hit
   2267684 ±  4%     +13.6%    2576306 ±  5%  numa-vmstat.node0.numa_local
     58561 ±  3%     +28.7%      75388 ±  2%  numa-vmstat.node1.nr_active_file
    266806 ±  2%     +27.8%     341023 ±  2%  numa-vmstat.node1.nr_dirtied
     36954 ±  2%     -27.8%      26684 ±  2%  numa-vmstat.node1.nr_inactive_file
    257168 ±  2%     +28.3%     329869 ±  2%  numa-vmstat.node1.nr_written
     58561 ±  3%     +28.7%      75388 ±  2%  numa-vmstat.node1.nr_zone_active_file
     36954 ±  2%     -27.8%      26684 ±  2%  numa-vmstat.node1.nr_zone_inactive_file
   2143119 ±  4%     +14.9%    2462421 ±  5%  numa-vmstat.node1.numa_hit
   1964454 ±  5%     +16.6%    2289732 ±  5%  numa-vmstat.node1.numa_local
      1818 ±  2%     +30.1%       2365 ±  8%  sched_debug.cfs_rq:/.exec_clock.avg
      3900 ±  3%     +25.0%       4876 ± 19%  sched_debug.cfs_rq:/.exec_clock.max
      1601 ±  2%     +34.0%       2145 ±  8%  sched_debug.cfs_rq:/.exec_clock.min
     37702 ±  2%     +25.6%      47358 ±  6%  sched_debug.cfs_rq:/.min_vruntime.avg
     67540 ±  4%     +27.1%      85847 ± 20%  sched_debug.cfs_rq:/.min_vruntime.max
     30634 ±  2%     +28.0%      39200 ±  8%  sched_debug.cfs_rq:/.min_vruntime.min
    175825            +8.5%     190710 ±  7%  sched_debug.cpu.clock_task.avg
    176095            +8.5%     190999 ±  7%  sched_debug.cpu.clock_task.max
    171199            +8.8%     186193 ±  7%  sched_debug.cpu.clock_task.min
     40946           +11.8%      45762 ±  5%  sched_debug.cpu.curr->pid.max
     31434           +28.3%      40335 ±  8%  sched_debug.cpu.nr_switches.avg
     26452           +32.0%      34919 ± 10%  sched_debug.cpu.nr_switches.min
     25.64 ±  5%     +15.3%      29.55 ±  4%  sched_debug.cpu.nr_uninterruptible.stddev
     30829           +30.2%      40137 ±  9%  sched_debug.cpu.sched_count.avg
     26400           +32.8%      35070 ± 10%  sched_debug.cpu.sched_count.min
     14302           +31.1%      18751 ±  9%  sched_debug.cpu.sched_goidle.avg
     12263           +33.9%      16422 ± 10%  sched_debug.cpu.sched_goidle.min
     14904           +29.9%      19358 ±  9%  sched_debug.cpu.ttwu_count.avg
    140323 ±  3%     +19.4%     167520 ±  8%  sched_debug.cpu.ttwu_count.max
     10272           +33.5%      13709 ±  9%  sched_debug.cpu.ttwu_count.min
     13018 ±  3%     +18.3%      15397 ±  8%  sched_debug.cpu.ttwu_count.stddev
      1856            +5.2%       1952        proc-vmstat.nr_active_anon
    118333           +31.1%     155165        proc-vmstat.nr_active_file
   1072935           +29.9%    1393379        proc-vmstat.nr_dirtied
    438329            +3.9%     455632        proc-vmstat.nr_file_pages
     74015           -26.5%      54379        proc-vmstat.nr_inactive_file
      4114            +2.4%       4211        proc-vmstat.nr_shmem
     24572            +1.3%      24884        proc-vmstat.nr_slab_reclaimable
   1032910           +30.3%    1346312        proc-vmstat.nr_written
      1856            +5.2%       1952        proc-vmstat.nr_zone_active_anon
    118333           +31.1%     155165        proc-vmstat.nr_zone_active_file
     74015           -26.5%      54379        proc-vmstat.nr_zone_inactive_file
    124.75 ±150%    +457.7%     695.75 ± 52%  proc-vmstat.numa_hint_faults_local
   6138345           +20.5%    7395540        proc-vmstat.numa_hit
   6107048           +20.6%    7364151        proc-vmstat.numa_local
      8493 ±128%    +253.3%      30007 ± 21%  proc-vmstat.numa_pte_updates
    300243           +21.0%     363301        proc-vmstat.pgactivate
   6402116           +20.5%    7711498        proc-vmstat.pgalloc_normal
      1605 ±  4%    +819.1%      14753        proc-vmstat.pgdeactivate
   7936083           +22.4%    9710261        proc-vmstat.pgfault
   6109790           +21.4%    7417746        proc-vmstat.pgfree
    136554           -85.3%      20014 ±  2%  proc-vmstat.pgpgin
   5991172           +32.2%    7919163        proc-vmstat.pgpgout
     27009           +53.8%      41550        proc-vmstat.pgrotated
 3.752e+08            +8.0%  4.051e+08        perf-stat.i.branch-instructions
     12.57 ± 22%      +2.6       15.18        perf-stat.i.cache-miss-rate%
     19120           +17.7%      22513        perf-stat.i.context-switches
      3.46 ± 10%      -8.3%       3.18        perf-stat.i.cpi
    874.81           +16.6%       1019        perf-stat.i.cpu-migrations
      1563 ±  4%     -11.2%       1388        perf-stat.i.cycles-between-cache-misses
      0.15 ± 98%      -0.1        0.06 ±  5%  perf-stat.i.dTLB-load-miss-rate%
  4.86e+08            +8.7%  5.283e+08        perf-stat.i.dTLB-loads
 2.309e+08            +8.3%  2.499e+08        perf-stat.i.dTLB-stores
   2060121 ±  5%      +7.3%    2210286        perf-stat.i.iTLB-load-misses
   2285707 ±  8%      +8.5%    2481094        perf-stat.i.iTLB-loads
 1.805e+09            +7.9%  1.947e+09        perf-stat.i.instructions
      0.30 ±  9%      +7.6%       0.32        perf-stat.i.ipc
     29.24 ±  6%     +17.2%      34.26 ±  4%  perf-stat.i.major-faults
      1.80 ± 23%     +16.4%       2.09        perf-stat.i.metric.K/sec
     11.77            +7.6%      12.67        perf-stat.i.metric.M/sec
     22247           +18.5%      26372        perf-stat.i.minor-faults
    988442 ±  2%     +18.4%    1170674        perf-stat.i.node-load-misses
    135403 ±  2%     +15.4%     156253        perf-stat.i.node-loads
    436818           +16.7%     509819        perf-stat.i.node-store-misses
     22277           +18.5%      26406        perf-stat.i.page-faults
     12.55 ± 22%      +2.6       15.13        perf-stat.overall.cache-miss-rate%
      3.34 ± 10%      -7.8%       3.08        perf-stat.overall.cpi
      1540 ±  4%     -11.2%       1368        perf-stat.overall.cycles-between-cache-misses
      0.30 ±  9%      +7.3%       0.32        perf-stat.overall.ipc
  15664991           -10.9%   13953650        perf-stat.overall.path-length
 3.742e+08            +8.0%   4.04e+08        perf-stat.ps.branch-instructions
     19064           +17.8%      22449        perf-stat.ps.context-switches
    872.35           +16.6%       1016        perf-stat.ps.cpu-migrations
 4.847e+08            +8.7%  5.269e+08        perf-stat.ps.dTLB-loads
 2.302e+08            +8.2%  2.492e+08        perf-stat.ps.dTLB-stores
   2054162 ±  5%      +7.3%    2204115        perf-stat.ps.iTLB-load-misses
   2279069 ±  8%      +8.6%    2474127        perf-stat.ps.iTLB-loads
   1.8e+09            +7.9%  1.942e+09        perf-stat.ps.instructions
     29.16 ±  6%     +17.2%      34.17 ±  4%  perf-stat.ps.major-faults
     22185           +18.5%      26297        perf-stat.ps.minor-faults
    985630 ±  2%     +18.4%    1167364        perf-stat.ps.node-load-misses
    135052 ±  2%     +15.4%     155851        perf-stat.ps.node-loads
    435571           +16.7%     508344        perf-stat.ps.node-store-misses
     22214           +18.5%      26331        perf-stat.ps.page-faults
 6.266e+11           +11.3%  6.977e+11        perf-stat.total.instructions
     66743 ±  3%     +11.5%      74447 ±  5%  softirqs.CPU0.RCU
     60512 ±  6%     +18.8%      71904        softirqs.CPU1.RCU
     62897 ±  3%     +14.9%      72271 ±  2%  softirqs.CPU10.RCU
     63486 ±  3%     +15.3%      73208        softirqs.CPU11.RCU
     61807 ±  3%     +16.5%      72031 ±  2%  softirqs.CPU12.RCU
     61473 ±  3%     +16.8%      71829 ±  2%  softirqs.CPU13.RCU
     61630 ±  3%     +15.7%      71332 ±  2%  softirqs.CPU14.RCU
     61684 ±  3%     +16.5%      71887 ±  2%  softirqs.CPU15.RCU
     62943 ±  3%     +15.3%      72585 ±  3%  softirqs.CPU16.RCU
     62648 ±  3%     +16.1%      72738 ±  3%  softirqs.CPU17.RCU
     61323 ±  4%     +18.7%      72784 ±  3%  softirqs.CPU18.RCU
     61791 ±  3%     +16.9%      72224 ±  3%  softirqs.CPU19.RCU
     61558 ±  3%     +17.0%      71999 ±  2%  softirqs.CPU2.RCU
     61468 ±  2%     +18.9%      73064 ±  3%  softirqs.CPU20.RCU
     61452 ±  3%     +16.8%      71766 ±  3%  softirqs.CPU21.RCU
     62175 ±  2%     +16.8%      72622 ±  3%  softirqs.CPU22.RCU
     62054 ±  3%     +17.5%      72935 ±  3%  softirqs.CPU23.RCU
     61786 ±  2%     +15.2%      71152 ±  4%  softirqs.CPU24.RCU
     60824 ±  3%     +16.0%      70536 ±  3%  softirqs.CPU25.RCU
     60420 ±  4%     +17.0%      70679 ±  3%  softirqs.CPU26.RCU
     61915 ±  2%     +11.5%      69063 ±  6%  softirqs.CPU27.RCU
     61416 ±  3%     +15.6%      70996 ±  4%  softirqs.CPU28.RCU
     61479 ±  2%     +15.4%      70930 ±  4%  softirqs.CPU29.RCU
     61352 ±  4%     +14.1%      69980 ±  3%  softirqs.CPU3.RCU
     57387 ±  5%     +18.2%      67854 ±  7%  softirqs.CPU30.RCU
     61387 ±  2%     +14.8%      70474 ±  4%  softirqs.CPU31.RCU
     63293           +12.9%      71430 ±  4%  softirqs.CPU32.RCU
     62636           +14.2%      71549 ±  5%  softirqs.CPU33.RCU
     63336           +14.2%      72315 ±  4%  softirqs.CPU34.RCU
     64099           +13.0%      72448 ±  4%  softirqs.CPU35.RCU
     62806           +15.0%      72228 ±  4%  softirqs.CPU36.RCU
     62325           +16.0%      72291 ±  4%  softirqs.CPU37.RCU
     62717           +14.5%      71795 ±  4%  softirqs.CPU38.RCU
     62811           +13.8%      71460 ±  4%  softirqs.CPU39.RCU
     62648 ±  3%     +15.7%      72477 ±  2%  softirqs.CPU4.RCU
     63580           +13.5%      72166 ±  4%  softirqs.CPU40.RCU
     63717           +13.5%      72305 ±  4%  softirqs.CPU41.RCU
     62130 ±  3%     +15.7%      71905 ±  4%  softirqs.CPU42.RCU
     63289           +13.3%      71688 ±  4%  softirqs.CPU43.RCU
     63106           +12.7%      71093 ±  4%  softirqs.CPU44.RCU
     62789           +13.3%      71126 ±  4%  softirqs.CPU45.RCU
     63699           +13.0%      71963 ±  4%  softirqs.CPU46.RCU
     64208           +12.6%      72308 ±  4%  softirqs.CPU47.RCU
     63433 ±  4%     +20.3%      76284 ±  2%  softirqs.CPU48.RCU
     61628 ±  8%     +19.9%      73878 ±  2%  softirqs.CPU49.RCU
     62673 ±  3%     +16.7%      73129 ±  2%  softirqs.CPU5.RCU
     63764 ±  3%     +16.1%      74056 ±  2%  softirqs.CPU50.RCU
     63770 ±  2%     +14.8%      73205 ±  2%  softirqs.CPU52.RCU
     63831 ±  2%     +15.6%      73791 ±  2%  softirqs.CPU53.RCU
     63993 ±  2%     +15.4%      73862 ±  2%  softirqs.CPU54.RCU
     63738 ±  2%     +15.7%      73734 ±  3%  softirqs.CPU55.RCU
     63612 ±  2%     +15.9%      73712 ±  2%  softirqs.CPU56.RCU
     63509 ±  2%     +15.9%      73591 ±  2%  softirqs.CPU57.RCU
     63744           +16.2%      74072 ±  2%  softirqs.CPU58.RCU
     64149 ±  2%     +15.8%      74301 ±  2%  softirqs.CPU59.RCU
     63136 ±  3%     +15.7%      73063 ±  2%  softirqs.CPU6.RCU
     63627 ±  2%     +16.7%      74231 ±  2%  softirqs.CPU60.RCU
     63210 ±  3%     +16.9%      73864 ±  2%  softirqs.CPU61.RCU
     63609 ±  2%     +16.1%      73828 ±  2%  softirqs.CPU62.RCU
     63650 ±  2%     +16.0%      73845 ±  2%  softirqs.CPU63.RCU
     63444 ±  3%     +18.6%      75263 ±  3%  softirqs.CPU64.RCU
     64207 ±  3%     +17.7%      75566 ±  3%  softirqs.CPU65.RCU
     62292 ±  4%     +20.5%      75057 ±  2%  softirqs.CPU66.RCU
     63104 ±  4%     +19.5%      75379 ±  3%  softirqs.CPU67.RCU
     62967 ±  3%     +18.1%      74365 ±  3%  softirqs.CPU68.RCU
     62617 ±  4%     +19.7%      74968 ±  3%  softirqs.CPU69.RCU
     61477 ±  3%     +16.1%      71392        softirqs.CPU7.RCU
     62935 ±  3%     +18.9%      74841 ±  3%  softirqs.CPU70.RCU
     62906 ±  3%     +19.1%      74906 ±  3%  softirqs.CPU71.RCU
     62731 ±  2%     +17.4%      73673 ±  4%  softirqs.CPU72.RCU
     61407 ±  3%     +20.2%      73823 ±  3%  softirqs.CPU73.RCU
     60648 ±  4%     +21.5%      73662 ±  3%  softirqs.CPU74.RCU
     61843 ±  2%     +15.3%      71305 ±  7%  softirqs.CPU75.RCU
     61914 ±  2%     +18.8%      73547 ±  3%  softirqs.CPU76.RCU
     62077 ±  2%     +18.5%      73564 ±  3%  softirqs.CPU77.RCU
     58920 ±  2%     +17.8%      69389 ±  9%  softirqs.CPU78.RCU
     61911 ±  2%     +18.8%      73577 ±  3%  softirqs.CPU79.RCU
     61939 ±  2%     +15.4%      71471        softirqs.CPU8.RCU
     62838           +14.2%      71773 ±  4%  softirqs.CPU80.RCU
     62577           +14.7%      71762 ±  4%  softirqs.CPU81.RCU
     63586           +14.6%      72869 ±  4%  softirqs.CPU82.RCU
     63769           +14.7%      73161 ±  4%  softirqs.CPU83.RCU
     62637 ±  2%     +15.8%      72507 ±  4%  softirqs.CPU84.RCU
     62404 ±  3%     +15.8%      72277 ±  4%  softirqs.CPU85.RCU
     61966           +15.7%      71692 ±  3%  softirqs.CPU86.RCU
     62041           +17.0%      72589 ±  3%  softirqs.CPU87.RCU
     63539           +15.4%      73300 ±  3%  softirqs.CPU88.RCU
     63630 ±  2%     +14.1%      72604 ±  3%  softirqs.CPU89.RCU
     61880 ±  2%     +16.7%      72207 ±  2%  softirqs.CPU9.RCU
     61669 ±  3%     +16.8%      72003 ±  4%  softirqs.CPU90.RCU
     62616           +14.8%      71866 ±  4%  softirqs.CPU91.RCU
     63034           +13.6%      71618 ±  3%  softirqs.CPU92.RCU
     63040           +14.4%      72130 ±  4%  softirqs.CPU93.RCU
     63186           +15.3%      72859 ±  4%  softirqs.CPU94.RCU
     63563           +15.1%      73175 ±  4%  softirqs.CPU95.RCU
   6007614 ±  2%     +16.0%    6969218 ±  3%  softirqs.RCU
     63.11 ±  4%      -3.9       59.22 ±  2%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     63.15 ±  4%      -3.9       59.26 ±  2%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
     63.14 ±  4%      -3.9       59.26 ±  2%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
     15.99 ±  3%      -1.6       14.39 ±  3%  perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     13.09 ±  2%      -1.5       11.54 ±  3%  perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      8.13 ±  3%      -1.1        7.01 ±  4%  perf-profile.calltrace.cycles-pp.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      8.09 ±  2%      -1.1        7.00 ±  4%  perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      7.93 ±  3%      -1.0        6.90 ±  4%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      4.40 ±  4%      -0.6        3.84 ±  3%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt
      3.14 ±  5%      -0.4        2.73 ±  4%  perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack
      2.60 ±  5%      -0.4        2.22 ±  4%  perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
      2.57 ±  5%      -0.4        2.21 ±  4%  perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      0.91 ± 21%      -0.3        0.61 ±  4%  perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      0.83 ±  5%      -0.2        0.62 ±  9%  perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu
      1.27 ±  6%      -0.1        1.18 ±  4%  perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      0.59 ±  6%      +0.2        0.76 ±  3%  perf-profile.calltrace.cycles-pp.start_transaction.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread
      0.56 ±  6%      +0.2        0.73 ±  3%  perf-profile.calltrace.cycles-pp.wait_current_trans.start_transaction.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
      0.91 ± 14%      +0.2        1.14 ±  7%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent
      0.87 ± 14%      +0.2        1.10 ±  8%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot
      0.86 ± 14%      +0.2        1.09 ±  7%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node
      0.66 ± 25%      +0.2        0.90 ±  9%  perf-profile.calltrace.cycles-pp.finish_wait.wait_current_trans.start_transaction.btrfs_sync_file.btrfs_file_write_iter
      0.66 ± 24%      +0.2        0.90 ±  9%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.wait_current_trans.start_transaction
      0.66 ± 24%      +0.2        0.90 ±  9%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.wait_current_trans.start_transaction.btrfs_sync_file
      0.96 ± 18%      +0.3        1.22 ±  9%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.wait_current_trans.start_transaction
      0.96 ± 18%      +0.3        1.22 ±  9%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.wait_current_trans.start_transaction.btrfs_sync_file
      0.97 ± 18%      +0.3        1.27 ±  7%  perf-profile.calltrace.cycles-pp.prepare_to_wait_event.wait_current_trans.start_transaction.btrfs_sync_file.btrfs_file_write_iter
      0.77 ± 28%      +0.3        1.12 ±  9%  perf-profile.calltrace.cycles-pp.btrfs_commit_transaction.iterate_supers.ksys_sync.__x64_sys_sync.do_syscall_64
      0.90 ± 15%      +0.4        1.25 ±  4%  perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.37 ± 12%      +0.4        1.75 ±  9%  perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent
      0.17 ±173%      +0.5        0.65 ± 20%  perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.btrfs_commit_transaction.iterate_supers.ksys_sync
      0.17 ±173%      +0.5        0.65 ± 20%  perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.btrfs_commit_transaction.iterate_supers.ksys_sync.__x64_sys_sync
      1.62 ± 19%      +0.5        2.13 ±  6%  perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents
      1.69 ± 21%      +0.5        2.22 ±  6%  perf-profile.calltrace.cycles-pp.wait_current_trans.start_transaction.btrfs_sync_file.btrfs_file_write_iter.new_sync_write
      1.72 ± 21%      +0.5        2.25 ±  7%  perf-profile.calltrace.cycles-pp.start_transaction.btrfs_sync_file.btrfs_file_write_iter.new_sync_write.vfs_write
      1.90 ± 14%      +0.5        2.44 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io
      1.90 ± 14%      +0.5        2.44 ± 11%  perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper
      2.25 ± 13%      +0.6        2.80 ± 11%  perf-profile.calltrace.cycles-pp.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
      2.30 ± 13%      +0.6        2.89 ± 11%  perf-profile.calltrace.cycles-pp.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread
      3.14 ± 12%      +0.8        3.91 ±  9%  perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
      3.04 ± 12%      +0.8        3.82 ±  9%  perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread.kthread
      4.03 ±  9%      +0.9        4.92 ±  7%  perf-profile.calltrace.cycles-pp.ret_from_fork
      4.02 ±  9%      +0.9        4.92 ±  7%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      3.79 ± 10%      +0.9        4.73 ±  8%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      3.62 ± 10%      +0.9        4.57 ±  8%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
     63.15 ±  4%      -3.9       59.26 ±  2%  perf-profile.children.cycles-pp.start_secondary
     15.17 ±  2%      -1.5       13.65 ±  3%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
     13.50 ±  2%      -1.5       12.02 ±  3%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
     11.91 ±  3%      -1.3       10.57 ±  4%  perf-profile.children.cycles-pp.asm_call_on_stack
      8.41 ±  2%      -1.1        7.34 ±  4%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      8.25 ±  2%      -1.0        7.25 ±  4%  perf-profile.children.cycles-pp.hrtimer_interrupt
      4.63 ±  4%      -0.5        4.09 ±  3%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      3.32 ±  4%      -0.4        2.92 ±  4%  perf-profile.children.cycles-pp.tick_sched_timer
      2.76 ±  4%      -0.4        2.39 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      2.74 ±  4%      -0.4        2.38 ±  4%  perf-profile.children.cycles-pp.update_process_times
      0.94 ± 21%      -0.3        0.64 ±  4%  perf-profile.children.cycles-pp.irq_enter_rcu
      0.73 ± 26%      -0.2        0.48 ±  5%  perf-profile.children.cycles-pp.tick_irq_enter
      0.69 ± 12%      -0.2        0.47 ±  3%  perf-profile.children.cycles-pp.ktime_get_update_offsets_now
      0.85 ±  6%      -0.2        0.64 ±  7%  perf-profile.children.cycles-pp.rebalance_domains
      1.29            -0.2        1.08 ±  8%  perf-profile.children.cycles-pp.load_balance
      1.04 ±  2%      -0.1        0.91 ±  9%  perf-profile.children.cycles-pp.find_busiest_group
      1.02 ±  2%      -0.1        0.88 ±  9%  perf-profile.children.cycles-pp.update_sd_lb_stats
      0.10 ± 23%      -0.1        0.03 ±102%  perf-profile.children.cycles-pp.prepare_uptodate_page
      0.20 ± 11%      -0.0        0.16 ± 12%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.12 ± 17%      -0.0        0.08 ± 15%  perf-profile.children.cycles-pp.prepare_pages
      0.16 ± 11%      -0.0        0.12 ± 20%  perf-profile.children.cycles-pp.btrfs_submit_bio_hook
      0.15 ± 20%      -0.0        0.11 ±  7%  perf-profile.children.cycles-pp.io_schedule
      0.07 ± 16%      +0.0        0.09 ±  8%  perf-profile.children.cycles-pp.generic_file_buffered_read
      0.09 ±  7%      +0.0        0.12 ± 12%  perf-profile.children.cycles-pp.new_sync_read
      0.11 ±  6%      +0.0        0.14 ± 10%  perf-profile.children.cycles-pp.blk_mq_sched_insert_requests
      0.18 ±  8%      +0.0        0.22 ± 13%  perf-profile.children.cycles-pp.__open64_nocancel
      0.11 ± 11%      +0.0        0.15 ± 15%  perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata
      0.04 ± 58%      +0.0        0.09 ± 17%  perf-profile.children.cycles-pp.btrfs_root_node
      0.03 ±100%      +0.0        0.07 ± 14%  perf-profile.children.cycles-pp.copy_extent_buffer_full
      0.11 ± 21%      +0.0        0.16 ± 13%  perf-profile.children.cycles-pp.btrfs_orphan_add
      0.11 ± 21%      +0.0        0.16 ± 13%  perf-profile.children.cycles-pp.btrfs_insert_orphan_item
      0.24 ±  8%      +0.0        0.29 ±  6%  perf-profile.children.cycles-pp.__intel_pmu_enable_all
      0.18 ± 23%      +0.0        0.23 ± 15%  perf-profile.children.cycles-pp.lockref_put_or_lock
      0.01 ±173%      +0.1        0.06 ± 20%  perf-profile.children.cycles-pp.read_extent_buffer
      0.09 ± 12%      +0.1        0.14 ± 18%  perf-profile.children.cycles-pp.submit_extent_page
      0.18 ± 22%      +0.1        0.24 ±  7%  perf-profile.children.cycles-pp.__btrfs_cow_block
      0.30 ± 17%      +0.1        0.36 ±  4%  perf-profile.children.cycles-pp.vma_interval_tree_insert
      0.01 ±173%      +0.1        0.07 ± 20%  perf-profile.children.cycles-pp.mutex_lock
      0.00            +0.1        0.06 ± 20%  perf-profile.children.cycles-pp.touch_atime
      0.17 ±  4%      +0.1        0.24 ± 15%  perf-profile.children.cycles-pp.insert_with_overflow
      0.33 ±  9%      +0.1        0.41 ±  9%  perf-profile.children.cycles-pp.wait_task_zombie
      0.14 ± 22%      +0.1        0.22 ± 10%  perf-profile.children.cycles-pp.btree_csum_one_bio
      0.14 ± 22%      +0.1        0.22 ± 10%  perf-profile.children.cycles-pp.check_leaf
      0.08 ± 72%      +0.1        0.16 ±  8%  perf-profile.children.cycles-pp.btrfs_del_orphan_item
      0.32 ±  7%      +0.1        0.40 ±  9%  perf-profile.children.cycles-pp.release_task
      0.28 ± 18%      +0.1        0.36 ±  7%  perf-profile.children.cycles-pp.setlocale
      0.16 ± 13%      +0.1        0.24 ± 12%  perf-profile.children.cycles-pp.btree_submit_bio_hook
      0.27 ±  2%      +0.1        0.35 ± 11%  perf-profile.children.cycles-pp.rcu_do_batch
      0.18 ±  8%      +0.1        0.27 ± 16%  perf-profile.children.cycles-pp.btrfs_insert_dir_item
      0.60 ±  8%      +0.1        0.70 ± 10%  perf-profile.children.cycles-pp.dput
      0.18 ±  8%      +0.1        0.28 ± 14%  perf-profile.children.cycles-pp.btrfs_add_link
      0.94 ±  7%      +0.1        1.05 ±  7%  perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.11 ±  7%      +0.1        0.22 ± 34%  perf-profile.children.cycles-pp.write_one_eb
      0.64 ±  5%      +0.1        0.77 ±  2%  perf-profile.children.cycles-pp.kmem_cache_free
      0.42 ± 17%      +0.1        0.55 ± 12%  perf-profile.children.cycles-pp.btrfs_unlink
      0.43 ± 18%      +0.1        0.57 ± 11%  perf-profile.children.cycles-pp.vfs_unlink
      0.65 ±  7%      +0.1        0.79 ±  8%  perf-profile.children.cycles-pp.autoremove_wake_function
      0.68 ±  6%      +0.1        0.83 ±  8%  perf-profile.children.cycles-pp.__do_sys_wait4
      0.68 ±  6%      +0.2        0.83 ±  8%  perf-profile.children.cycles-pp.kernel_wait4
      0.68 ±  6%      +0.2        0.83 ±  7%  perf-profile.children.cycles-pp.do_wait
      0.43 ± 20%      +0.2        0.61 ± 15%  perf-profile.children.cycles-pp.btrfs_create
      0.24 ± 14%      +0.2        0.42 ± 10%  perf-profile.children.cycles-pp.__writeback_single_inode
      0.24 ± 13%      +0.2        0.42 ±  9%  perf-profile.children.cycles-pp.writeback_sb_inodes
      0.56 ± 16%      +0.2        0.74 ±  7%  perf-profile.children.cycles-pp.queued_read_lock_slowpath
      0.49 ± 21%      +0.2        0.67 ± 10%  perf-profile.children.cycles-pp.btrfs_evict_inode
      0.25 ± 11%      +0.2        0.43 ±  8%  perf-profile.children.cycles-pp.wb_writeback
      0.26 ± 12%      +0.2        0.44 ± 10%  perf-profile.children.cycles-pp.wb_workfn
      0.49 ± 21%      +0.2        0.68 ±  9%  perf-profile.children.cycles-pp.evict
      0.25 ± 13%      +0.2        0.46 ± 13%  perf-profile.children.cycles-pp.btree_write_cache_pages
      0.38 ± 47%      +0.2        0.60 ± 18%  perf-profile.children.cycles-pp.btrfs_run_delayed_refs_for_head
      0.95 ±  9%      +0.2        1.18 ±  6%  perf-profile.children.cycles-pp.btrfs_release_path
      1.48 ± 10%      +0.3        1.74 ±  5%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.42 ± 42%      +0.3        0.69 ± 16%  perf-profile.children.cycles-pp.btrfs_run_delayed_refs
      0.42 ± 44%      +0.3        0.69 ± 16%  perf-profile.children.cycles-pp.__btrfs_run_delayed_refs
      0.90 ± 15%      +0.4        1.25 ±  4%  perf-profile.children.cycles-pp.do_unlinkat
      0.77 ± 28%      +0.4        1.15 ±  6%  perf-profile.children.cycles-pp.btrfs_commit_transaction
      2.30 ± 13%      +0.6        2.89 ± 11%  perf-profile.children.cycles-pp.insert_reserved_file_extent
      2.86 ± 16%      +0.7        3.52 ±  6%  perf-profile.children.cycles-pp.btrfs_lookup_file_extent
      3.20 ± 16%      +0.7        3.90 ±  6%  perf-profile.children.cycles-pp.__btrfs_drop_extents
      3.14 ± 12%      +0.8        3.91 ±  9%  perf-profile.children.cycles-pp.btrfs_work_helper
      3.05 ± 15%      +0.8        3.82 ±  2%  perf-profile.children.cycles-pp.finish_wait
      3.04 ± 12%      +0.8        3.82 ±  9%  perf-profile.children.cycles-pp.btrfs_finish_ordered_io
      2.27 ± 16%      +0.8        3.06 ± 19%  perf-profile.children.cycles-pp.__mutex_lock
      2.72 ± 13%      +0.8        3.56 ±  4%  perf-profile.children.cycles-pp.wait_current_trans
      2.80 ± 12%      +0.9        3.66 ±  3%  perf-profile.children.cycles-pp.start_transaction
      4.07 ±  9%      +0.9        4.96 ±  7%  perf-profile.children.cycles-pp.ret_from_fork
      4.02 ±  9%      +0.9        4.92 ±  7%  perf-profile.children.cycles-pp.kthread
      4.18 ± 14%      +0.9        5.11 ±  2%  perf-profile.children.cycles-pp.btrfs_tree_read_lock
      3.79 ±  9%      +0.9        4.73 ±  8%  perf-profile.children.cycles-pp.worker_thread
      3.62 ± 10%      +0.9        4.57 ±  8%  perf-profile.children.cycles-pp.process_one_work
      4.22 ± 14%      +1.0        5.18 ±  2%  perf-profile.children.cycles-pp.btrfs_read_lock_root_node
      5.39 ± 15%      +1.4        6.79 ±  2%  perf-profile.children.cycles-pp.prepare_to_wait_event
      7.25 ± 16%      +1.7        8.91        perf-profile.children.cycles-pp.btrfs_search_slot
      9.89 ± 14%      +2.4       12.28        perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.58 ± 15%      -0.2        0.37 ±  8%  perf-profile.self.cycles-pp.ktime_get_update_offsets_now
      0.77 ±  4%      -0.1        0.64 ± 11%  perf-profile.self.cycles-pp.update_sd_lb_stats
      0.39 ± 25%      -0.1        0.28        perf-profile.self.cycles-pp.do_idle
      0.38 ±  3%      -0.1        0.31 ± 10%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.15 ± 23%      -0.1        0.09 ± 20%  perf-profile.self.cycles-pp.load_balance
      0.12 ±  8%      -0.0        0.08 ± 21%  perf-profile.self.cycles-pp.rebalance_domains
      0.08 ± 24%      +0.0        0.12 ± 17%  perf-profile.self.cycles-pp.queued_read_lock_slowpath
      0.04 ± 58%      +0.0        0.09 ± 17%  perf-profile.self.cycles-pp.btrfs_root_node
      0.24 ±  8%      +0.0        0.29 ±  6%  perf-profile.self.cycles-pp.__intel_pmu_enable_all
      0.01 ±173%      +0.1        0.07 ± 20%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.00            +0.1        0.06 ± 17%  perf-profile.self.cycles-pp.mutex_lock
      0.20 ± 14%      +0.1        0.29 ±  5%  perf-profile.self.cycles-pp.update_blocked_averages
      0.20 ± 16%      +0.1        0.29 ±  3%  perf-profile.self.cycles-pp.kmem_cache_free
      0.00       +1.3e+105%       1316 ±170%  interrupts.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
    287046           +21.0%     347209        interrupts.CAL:Function_call_interrupts
    112.50 ± 14%     +42.9%     160.75 ±  9%  interrupts.CPU0.TLB:TLB_shootdowns
      0.00       +1.3e+105%       1316 ±170%  interrupts.CPU1.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
      3054 ±  9%     +24.4%       3798 ±  9%  interrupts.CPU1.CAL:Function_call_interrupts
      3114 ±  6%     +15.6%       3601 ±  4%  interrupts.CPU10.CAL:Function_call_interrupts
    266.75 ±  6%     +15.7%     308.75 ±  7%  interrupts.CPU10.RES:Rescheduling_interrupts
    111.25 ± 17%     +44.9%     161.25 ±  6%  interrupts.CPU10.TLB:TLB_shootdowns
      3032 ±  6%     +20.1%       3642 ±  2%  interrupts.CPU11.CAL:Function_call_interrupts
    114.75 ± 21%     +55.8%     178.75 ± 11%  interrupts.CPU11.TLB:TLB_shootdowns
      2904 ±  2%     +22.3%       3551 ±  7%  interrupts.CPU12.CAL:Function_call_interrupts
    254.25 ±  5%     +17.6%     299.00 ±  9%  interrupts.CPU12.RES:Rescheduling_interrupts
    105.75 ± 15%     +37.4%     145.25 ± 10%  interrupts.CPU12.TLB:TLB_shootdowns
      3035 ±  3%     +14.6%       3477 ±  4%  interrupts.CPU13.CAL:Function_call_interrupts
    117.75 ± 16%     +34.2%     158.00 ±  5%  interrupts.CPU13.TLB:TLB_shootdowns
      3027 ±  4%     +18.7%       3593 ±  4%  interrupts.CPU14.CAL:Function_call_interrupts
    114.25 ± 20%     +40.9%     161.00 ±  6%  interrupts.CPU14.TLB:TLB_shootdowns
      2970 ±  4%     +19.0%       3534 ±  4%  interrupts.CPU15.CAL:Function_call_interrupts
      2911 ±  2%     +23.2%       3586 ±  2%  interrupts.CPU16.CAL:Function_call_interrupts
    251.50 ±  2%     +16.5%     293.00 ±  2%  interrupts.CPU16.RES:Rescheduling_interrupts
    107.00 ±  6%     +43.5%     153.50 ±  7%  interrupts.CPU16.TLB:TLB_shootdowns
      2979 ±  7%     +20.3%       3584 ±  5%  interrupts.CPU17.CAL:Function_call_interrupts
    116.50 ± 18%     +38.0%     160.75 ±  8%  interrupts.CPU17.TLB:TLB_shootdowns
      2982 ±  3%     +16.4%       3471 ±  4%  interrupts.CPU18.CAL:Function_call_interrupts
    114.00 ±  6%     +38.4%     157.75 ±  7%  interrupts.CPU18.TLB:TLB_shootdowns
      3086 ±  5%     +15.9%       3576 ±  7%  interrupts.CPU19.CAL:Function_call_interrupts
    112.00 ± 16%     +29.2%     144.75 ± 14%  interrupts.CPU19.TLB:TLB_shootdowns
    108.00 ± 13%     +51.2%     163.25 ± 10%  interrupts.CPU2.TLB:TLB_shootdowns
      3071 ±  6%     +14.2%       3507 ±  5%  interrupts.CPU20.CAL:Function_call_interrupts
      3245 ±  6%     +23.5%       4008 ±  3%  interrupts.CPU21.CAL:Function_call_interrupts
    558.50 ± 47%     +65.4%     923.75 ±  5%  interrupts.CPU21.RES:Rescheduling_interrupts
    179.25 ± 24%     +58.9%     284.75 ±  2%  interrupts.CPU21.TLB:TLB_shootdowns
      3172 ±  4%     +20.8%       3830        interrupts.CPU22.CAL:Function_call_interrupts
      3189 ±  7%     +15.9%       3696 ±  3%  interrupts.CPU23.CAL:Function_call_interrupts
    161.00 ± 30%     +46.7%     236.25 ±  6%  interrupts.CPU23.NMI:Non-maskable_interrupts
    161.00 ± 30%     +46.7%     236.25 ±  6%  interrupts.CPU23.PMI:Performance_monitoring_interrupts
      3068 ±  5%     +21.2%       3717 ±  3%  interrupts.CPU24.CAL:Function_call_interrupts
    107.25 ±  8%     +47.1%     157.75 ±  7%  interrupts.CPU24.TLB:TLB_shootdowns
      3064 ±  3%     +19.9%       3673 ±  5%  interrupts.CPU25.CAL:Function_call_interrupts
    271.75 ±  7%     +19.7%     325.25 ± 11%  interrupts.CPU25.RES:Rescheduling_interrupts
    111.75 ± 16%     +47.7%     165.00 ±  5%  interrupts.CPU25.TLB:TLB_shootdowns
      3087 ±  6%     +23.4%       3811 ±  7%  interrupts.CPU26.CAL:Function_call_interrupts
    261.25 ±  4%     +18.0%     308.25 ±  6%  interrupts.CPU26.RES:Rescheduling_interrupts
    119.50 ± 22%     +43.3%     171.25 ±  6%  interrupts.CPU26.TLB:TLB_shootdowns
      2976 ±  4%     +27.5%       3794 ±  8%  interrupts.CPU27.CAL:Function_call_interrupts
    263.25 ± 11%     +21.7%     320.25 ±  9%  interrupts.CPU27.RES:Rescheduling_interrupts
    113.75 ± 18%     +53.0%     174.00 ±  4%  interrupts.CPU27.TLB:TLB_shootdowns
      2994 ±  2%     +23.2%       3689 ±  6%  interrupts.CPU28.CAL:Function_call_interrupts
    119.25 ±  8%     +36.1%     162.25 ±  2%  interrupts.CPU28.TLB:TLB_shootdowns
      3013           +18.3%       3566 ±  3%  interrupts.CPU29.CAL:Function_call_interrupts
    259.25 ±  4%     +24.4%     322.50 ±  7%  interrupts.CPU29.RES:Rescheduling_interrupts
    119.75 ± 20%     +29.0%     154.50 ±  3%  interrupts.CPU29.TLB:TLB_shootdowns
      3000 ±  5%     +23.4%       3703 ±  6%  interrupts.CPU3.CAL:Function_call_interrupts
    106.75 ± 17%     +40.3%     149.75 ±  5%  interrupts.CPU3.TLB:TLB_shootdowns
      3096 ±  6%     +16.9%       3621 ±  4%  interrupts.CPU30.CAL:Function_call_interrupts
    117.00 ± 17%     +47.2%     172.25 ±  5%  interrupts.CPU30.TLB:TLB_shootdowns
      2933 ±  4%     +21.7%       3571 ±  2%  interrupts.CPU31.CAL:Function_call_interrupts
    252.75 ± 10%     +24.9%     315.75 ±  7%  interrupts.CPU31.RES:Rescheduling_interrupts
      2944 ±  5%     +24.7%       3673 ±  2%  interrupts.CPU32.CAL:Function_call_interrupts
    256.75 ±  5%     +21.7%     312.50 ±  3%  interrupts.CPU32.RES:Rescheduling_interrupts
    113.50 ± 19%     +43.4%     162.75 ± 13%  interrupts.CPU32.TLB:TLB_shootdowns
      2986 ±  4%     +18.5%       3539        interrupts.CPU33.CAL:Function_call_interrupts
    103.25 ± 17%     +59.3%     164.50 ±  5%  interrupts.CPU33.TLB:TLB_shootdowns
      3078 ±  7%     +14.0%       3509 ±  2%  interrupts.CPU34.CAL:Function_call_interrupts
    111.25 ± 15%     +45.8%     162.25 ±  6%  interrupts.CPU34.TLB:TLB_shootdowns
      3073 ±  7%     +19.2%       3663 ±  4%  interrupts.CPU35.CAL:Function_call_interrupts
    119.00 ± 11%     +38.9%     165.25 ±  7%  interrupts.CPU35.TLB:TLB_shootdowns
      2923 ±  3%     +23.0%       3595        interrupts.CPU36.CAL:Function_call_interrupts
    260.00 ±  6%     +19.5%     310.75 ±  7%  interrupts.CPU36.RES:Rescheduling_interrupts
    121.00 ± 19%     +37.4%     166.25 ±  5%  interrupts.CPU36.TLB:TLB_shootdowns
      2977 ±  8%     +23.8%       3684        interrupts.CPU37.CAL:Function_call_interrupts
    114.75 ± 18%     +41.2%     162.00 ±  4%  interrupts.CPU37.TLB:TLB_shootdowns
      2924           +27.8%       3736 ±  2%  interrupts.CPU38.CAL:Function_call_interrupts
    265.50 ±  9%     +20.3%     319.50 ±  8%  interrupts.CPU38.RES:Rescheduling_interrupts
    117.50 ± 16%     +54.0%     181.00 ±  4%  interrupts.CPU38.TLB:TLB_shootdowns
      3009 ±  6%     +23.6%       3720 ±  4%  interrupts.CPU39.CAL:Function_call_interrupts
    262.75 ± 11%     +21.8%     320.00 ± 10%  interrupts.CPU39.RES:Rescheduling_interrupts
    108.00 ± 18%     +54.6%     167.00 ±  7%  interrupts.CPU39.TLB:TLB_shootdowns
      2981 ±  5%     +19.8%       3572 ± 11%  interrupts.CPU4.CAL:Function_call_interrupts
    103.25 ± 22%     +56.7%     161.75 ±  3%  interrupts.CPU4.TLB:TLB_shootdowns
      2966 ±  6%     +22.6%       3637 ±  3%  interrupts.CPU40.CAL:Function_call_interrupts
    118.00 ± 17%     +52.5%     180.00 ±  7%  interrupts.CPU40.TLB:TLB_shootdowns
      2971 ±  3%     +25.8%       3736 ±  4%  interrupts.CPU41.CAL:Function_call_interrupts
    129.00 ± 11%     +26.4%     163.00 ±  7%  interrupts.CPU41.TLB:TLB_shootdowns
      3008 ±  5%     +19.1%       3582 ±  5%  interrupts.CPU42.CAL:Function_call_interrupts
    129.00 ± 12%     +27.1%     164.00 ±  8%  interrupts.CPU42.TLB:TLB_shootdowns
      3006 ±  3%     +19.5%       3591 ±  2%  interrupts.CPU43.CAL:Function_call_interrupts
    246.00 ±  6%     +26.2%     310.50 ±  6%  interrupts.CPU43.RES:Rescheduling_interrupts
    116.25 ± 15%     +40.6%     163.50 ±  7%  interrupts.CPU43.TLB:TLB_shootdowns
      2939 ±  4%     +23.7%       3635 ±  4%  interrupts.CPU44.CAL:Function_call_interrupts
    125.25 ±  5%     +33.7%     167.50 ±  8%  interrupts.CPU44.TLB:TLB_shootdowns
      3046 ±  6%     +21.1%       3688 ±  3%  interrupts.CPU45.CAL:Function_call_interrupts
    120.75 ± 20%     +43.5%     173.25 ± 13%  interrupts.CPU45.TLB:TLB_shootdowns
      3032 ±  7%     +20.1%       3641 ±  5%  interrupts.CPU46.CAL:Function_call_interrupts
    130.25 ± 15%     +35.3%     176.25 ±  8%  interrupts.CPU46.TLB:TLB_shootdowns
      2875 ±  4%     +31.1%       3769 ±  2%  interrupts.CPU47.CAL:Function_call_interrupts
    114.75 ± 20%     +51.9%     174.25 ± 10%  interrupts.CPU47.TLB:TLB_shootdowns
      3037 ±  4%     +19.4%       3628 ±  2%  interrupts.CPU48.CAL:Function_call_interrupts
    133.75 ± 11%     +32.7%     177.50 ±  6%  interrupts.CPU48.TLB:TLB_shootdowns
      2953 ±  6%     +22.9%       3631        interrupts.CPU49.CAL:Function_call_interrupts
    279.50 ±  7%     +13.6%     317.50 ±  5%  interrupts.CPU49.RES:Rescheduling_interrupts
    124.00 ± 20%     +34.3%     166.50 ±  6%  interrupts.CPU49.TLB:TLB_shootdowns
      3123 ±  8%     +17.9%       3684 ± 10%  interrupts.CPU5.CAL:Function_call_interrupts
    119.50 ± 19%     +34.5%     160.75 ±  4%  interrupts.CPU5.TLB:TLB_shootdowns
    133.75 ± 15%     +29.5%     173.25 ±  6%  interrupts.CPU50.TLB:TLB_shootdowns
      3010 ±  2%     +17.1%       3524 ±  3%  interrupts.CPU51.CAL:Function_call_interrupts
    122.75 ± 16%     +42.6%     175.00 ±  3%  interrupts.CPU51.TLB:TLB_shootdowns
      2985 ±  5%     +16.7%       3485        interrupts.CPU52.CAL:Function_call_interrupts
    269.00 ±  3%     +10.9%     298.25 ±  3%  interrupts.CPU52.RES:Rescheduling_interrupts
    116.75 ± 13%     +43.7%     167.75 ±  7%  interrupts.CPU52.TLB:TLB_shootdowns
      2955 ±  6%     +21.4%       3589 ±  3%  interrupts.CPU53.CAL:Function_call_interrupts
    271.75 ±  9%     +17.7%     319.75 ±  6%  interrupts.CPU53.RES:Rescheduling_interrupts
    117.75 ± 15%     +48.4%     174.75 ± 12%  interrupts.CPU53.TLB:TLB_shootdowns
      2818 ±  7%     +23.7%       3486 ±  3%  interrupts.CPU54.CAL:Function_call_interrupts
      2950           +17.2%       3459 ±  2%  interrupts.CPU55.CAL:Function_call_interrupts
    119.25 ±  9%     +35.6%     161.75 ±  2%  interrupts.CPU55.TLB:TLB_shootdowns
      2881 ±  3%     +20.4%       3469 ±  2%  interrupts.CPU56.CAL:Function_call_interrupts
    127.25 ± 12%     +29.5%     164.75 ±  7%  interrupts.CPU56.TLB:TLB_shootdowns
      2962 ±  7%     +17.7%       3485 ±  3%  interrupts.CPU57.CAL:Function_call_interrupts
    140.00 ± 28%     +59.6%     223.50 ±  3%  interrupts.CPU57.NMI:Non-maskable_interrupts
    140.00 ± 28%     +59.6%     223.50 ±  3%  interrupts.CPU57.PMI:Performance_monitoring_interrupts
    263.00 ±  6%     +17.0%     307.75 ±  5%  interrupts.CPU57.RES:Rescheduling_interrupts
    128.75 ± 18%     +50.7%     194.00 ± 27%  interrupts.CPU57.TLB:TLB_shootdowns
      2894 ±  2%     +20.5%       3488 ±  4%  interrupts.CPU58.CAL:Function_call_interrupts
    120.50 ± 18%     +35.9%     163.75 ±  4%  interrupts.CPU58.TLB:TLB_shootdowns
      2944 ±  4%     +15.4%       3398        interrupts.CPU59.CAL:Function_call_interrupts
    126.75 ± 20%     +29.4%     164.00 ±  7%  interrupts.CPU59.TLB:TLB_shootdowns
      3014 ±  6%     +22.5%       3693 ±  8%  interrupts.CPU6.CAL:Function_call_interrupts
    260.75 ±  4%     +19.1%     310.50 ±  4%  interrupts.CPU6.RES:Rescheduling_interrupts
      2902 ±  3%     +18.3%       3434 ±  5%  interrupts.CPU60.CAL:Function_call_interrupts
    263.25 ±  7%     +16.4%     306.50 ±  4%  interrupts.CPU60.RES:Rescheduling_interrupts
    132.00 ± 17%     +27.1%     167.75 ±  5%  interrupts.CPU60.TLB:TLB_shootdowns
    119.75 ± 20%     +42.2%     170.25        interrupts.CPU61.TLB:TLB_shootdowns
      2866 ±  2%     +21.7%       3487 ±  4%  interrupts.CPU62.CAL:Function_call_interrupts
    247.00 ±  6%     +22.2%     301.75 ±  6%  interrupts.CPU62.RES:Rescheduling_interrupts
      2719 ±  4%     +23.9%       3368 ±  2%  interrupts.CPU63.CAL:Function_call_interrupts
    259.50 ±  2%     +11.6%     289.50 ±  5%  interrupts.CPU63.RES:Rescheduling_interrupts
    112.00 ± 10%     +50.2%     168.25 ± 14%  interrupts.CPU63.TLB:TLB_shootdowns
      2972 ±  5%     +20.1%       3569 ±  2%  interrupts.CPU64.CAL:Function_call_interrupts
    123.00 ± 12%     +45.7%     179.25 ±  2%  interrupts.CPU64.TLB:TLB_shootdowns
      3031 ±  3%     +17.4%       3558 ±  5%  interrupts.CPU65.CAL:Function_call_interrupts
    115.25 ± 11%     +40.6%     162.00 ±  3%  interrupts.CPU65.TLB:TLB_shootdowns
      2990 ±  7%     +21.0%       3617 ±  4%  interrupts.CPU66.CAL:Function_call_interrupts
    261.00 ±  5%     +15.4%     301.25 ±  8%  interrupts.CPU66.RES:Rescheduling_interrupts
    114.50 ± 19%     +50.0%     171.75 ±  5%  interrupts.CPU66.TLB:TLB_shootdowns
      2860 ±  3%     +21.8%       3484 ±  4%  interrupts.CPU67.CAL:Function_call_interrupts
    251.25 ±  9%     +25.1%     314.25 ±  5%  interrupts.CPU67.RES:Rescheduling_interrupts
    115.00 ± 13%     +37.4%     158.00 ±  6%  interrupts.CPU67.TLB:TLB_shootdowns
      2963 ±  5%     +15.7%       3429        interrupts.CPU68.CAL:Function_call_interrupts
    114.00 ± 16%     +41.4%     161.25 ±  9%  interrupts.CPU68.TLB:TLB_shootdowns
      3071 ±  8%     +24.7%       3831        interrupts.CPU69.CAL:Function_call_interrupts
    106.00 ± 26%     +55.9%     165.25 ±  7%  interrupts.CPU69.TLB:TLB_shootdowns
      2872 ±  7%     +23.9%       3558 ±  2%  interrupts.CPU7.CAL:Function_call_interrupts
    252.75 ±  5%     +22.5%     309.50 ±  9%  interrupts.CPU7.RES:Rescheduling_interrupts
      2927 ±  6%     +21.2%       3549        interrupts.CPU70.CAL:Function_call_interrupts
    246.00 ±  3%     +15.1%     283.25 ±  6%  interrupts.CPU70.RES:Rescheduling_interrupts
     96.00 ± 16%     +68.2%     161.50 ±  8%  interrupts.CPU70.TLB:TLB_shootdowns
      2925 ±  4%     +20.0%       3509 ±  6%  interrupts.CPU71.CAL:Function_call_interrupts
    252.75 ±  5%     +17.0%     295.75 ±  7%  interrupts.CPU71.RES:Rescheduling_interrupts
    115.50 ±  8%     +40.7%     162.50 ± 12%  interrupts.CPU71.TLB:TLB_shootdowns
      2965 ±  6%     +24.6%       3694 ±  4%  interrupts.CPU72.CAL:Function_call_interrupts
      2876 ±  3%     +26.7%       3645 ±  2%  interrupts.CPU73.CAL:Function_call_interrupts
    248.25 ±  9%     +19.1%     295.75 ±  3%  interrupts.CPU73.RES:Rescheduling_interrupts
    123.75 ± 10%     +48.9%     184.25 ± 18%  interrupts.CPU73.TLB:TLB_shootdowns
      2914 ±  3%     +20.8%       3520        interrupts.CPU74.CAL:Function_call_interrupts
    246.75 ±  8%     +19.6%     295.00 ±  5%  interrupts.CPU74.RES:Rescheduling_interrupts
    121.00 ± 18%     +51.7%     183.50 ±  7%  interrupts.CPU74.TLB:TLB_shootdowns
      3052 ±  5%     +19.2%       3637 ±  4%  interrupts.CPU75.CAL:Function_call_interrupts
    120.50 ± 30%     +41.1%     170.00 ± 11%  interrupts.CPU75.TLB:TLB_shootdowns
      2829 ±  4%     +31.8%       3730 ±  5%  interrupts.CPU76.CAL:Function_call_interrupts
    121.75 ± 21%     +41.9%     172.75 ±  2%  interrupts.CPU76.TLB:TLB_shootdowns
      2934 ±  5%     +26.5%       3710        interrupts.CPU77.CAL:Function_call_interrupts
    253.75 ±  9%     +17.2%     297.50 ±  4%  interrupts.CPU77.RES:Rescheduling_interrupts
    126.25 ± 12%     +36.8%     172.75 ±  8%  interrupts.CPU77.TLB:TLB_shootdowns
      2975 ±  5%     +20.9%       3596 ±  4%  interrupts.CPU78.CAL:Function_call_interrupts
    115.75 ± 13%     +39.5%     161.50 ±  4%  interrupts.CPU78.TLB:TLB_shootdowns
      3081 ±  8%     +20.7%       3718 ±  6%  interrupts.CPU79.CAL:Function_call_interrupts
    115.75 ± 14%     +48.8%     172.25 ±  5%  interrupts.CPU79.TLB:TLB_shootdowns
      2881 ±  8%     +28.9%       3715 ±  7%  interrupts.CPU8.CAL:Function_call_interrupts
    250.00 ±  8%     +30.3%     325.75 ± 14%  interrupts.CPU8.RES:Rescheduling_interrupts
    108.00 ± 14%     +39.1%     150.25 ±  6%  interrupts.CPU8.TLB:TLB_shootdowns
    251.00 ± 13%     +20.2%     301.75 ±  6%  interrupts.CPU80.RES:Rescheduling_interrupts
    118.75 ± 18%     +42.5%     169.25 ±  4%  interrupts.CPU80.TLB:TLB_shootdowns
      2952 ±  6%     +20.4%       3553 ±  3%  interrupts.CPU81.CAL:Function_call_interrupts
    246.50 ± 10%     +21.1%     298.50 ±  6%  interrupts.CPU81.RES:Rescheduling_interrupts
    114.50 ±  9%     +49.3%     171.00 ± 13%  interrupts.CPU81.TLB:TLB_shootdowns
      2873 ±  6%     +24.1%       3566 ±  3%  interrupts.CPU82.CAL:Function_call_interrupts
    241.50 ± 11%     +28.1%     309.25 ±  8%  interrupts.CPU82.RES:Rescheduling_interrupts
      2915 ±  7%     +21.8%       3549        interrupts.CPU83.CAL:Function_call_interrupts
    121.25 ± 20%     +42.5%     172.75 ±  8%  interrupts.CPU83.TLB:TLB_shootdowns
      3012 ±  8%     +19.6%       3604 ±  7%  interrupts.CPU84.CAL:Function_call_interrupts
    258.75 ±  4%     +26.9%     328.25 ± 11%  interrupts.CPU84.RES:Rescheduling_interrupts
    110.75 ± 19%     +47.9%     163.75 ±  8%  interrupts.CPU84.TLB:TLB_shootdowns
      2980 ±  7%     +23.0%       3664 ±  7%  interrupts.CPU85.CAL:Function_call_interrupts
    119.75 ±  8%     +39.7%     167.25 ±  7%  interrupts.CPU85.TLB:TLB_shootdowns
      2854 ±  5%     +23.2%       3516        interrupts.CPU86.CAL:Function_call_interrupts
    124.00 ±  8%     +32.5%     164.25 ±  9%  interrupts.CPU86.TLB:TLB_shootdowns
      2941 ±  2%     +25.4%       3688 ±  4%  interrupts.CPU87.CAL:Function_call_interrupts
    123.50 ± 16%     +30.8%     161.50 ±  2%  interrupts.CPU87.TLB:TLB_shootdowns
      3051 ±  4%     +14.9%       3505 ±  2%  interrupts.CPU88.CAL:Function_call_interrupts
    109.75 ± 23%     +53.3%     168.25 ±  8%  interrupts.CPU88.TLB:TLB_shootdowns
      3017 ±  5%     +23.2%       3717 ±  5%  interrupts.CPU89.CAL:Function_call_interrupts
    121.25 ±  8%     +37.1%     166.25 ±  3%  interrupts.CPU89.TLB:TLB_shootdowns
      2948 ±  8%     +27.5%       3758 ±  9%  interrupts.CPU9.CAL:Function_call_interrupts
    103.25 ± 12%     +85.0%     191.00 ± 20%  interrupts.CPU9.TLB:TLB_shootdowns
      2878 ±  8%     +24.5%       3583 ±  3%  interrupts.CPU90.CAL:Function_call_interrupts
    247.50 ±  7%     +28.5%     318.00 ±  7%  interrupts.CPU90.RES:Rescheduling_interrupts
    123.00 ± 22%     +38.2%     170.00 ±  7%  interrupts.CPU90.TLB:TLB_shootdowns
      3004 ±  6%     +20.7%       3627 ±  3%  interrupts.CPU91.CAL:Function_call_interrupts
    122.75 ± 10%     +27.1%     156.00 ±  9%  interrupts.CPU91.TLB:TLB_shootdowns
      2976           +26.0%       3751 ±  7%  interrupts.CPU92.CAL:Function_call_interrupts
    228.50 ±  8%     -38.2%     141.25 ± 39%  interrupts.CPU92.NMI:Non-maskable_interrupts
    228.50 ±  8%     -38.2%     141.25 ± 39%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
    116.00 ± 15%     +39.2%     161.50 ±  3%  interrupts.CPU92.TLB:TLB_shootdowns
      2836 ±  3%     +24.0%       3517        interrupts.CPU93.CAL:Function_call_interrupts
    263.75 ±  6%     +20.3%     317.25 ±  5%  interrupts.CPU93.RES:Rescheduling_interrupts
    107.25 ± 14%     +49.0%     159.75 ±  2%  interrupts.CPU93.TLB:TLB_shootdowns
      2906 ±  4%     +22.7%       3566 ±  4%  interrupts.CPU94.CAL:Function_call_interrupts
    115.50 ± 15%     +49.6%     172.75 ±  5%  interrupts.CPU94.TLB:TLB_shootdowns
      2966 ±  6%     +25.3%       3717 ±  6%  interrupts.CPU95.CAL:Function_call_interrupts
    258.00 ±  6%     +16.3%     300.00 ±  4%  interrupts.CPU95.RES:Rescheduling_interrupts
     26248 ±  4%     +14.3%      30012        interrupts.RES:Rescheduling_interrupts
     11581 ± 13%     +39.9%      16206        interrupts.TLB:TLB_shootdowns


                                                                                
                       reaim.time.involuntary_context_switches                  
                                                                                
  60000 +-------------------------------------------------------------------+   
        |                                                                   |   
  55000 |+.++++.++++. +++.++++.++++.++++.+++.++++.++++.++++.++++.++++.++++.+|   
        |            +                                                      |   
  50000 |-+                                                                 |   
        |                                                                   |   
  45000 |-+                                                                 |   
        |                                                                   |   
  40000 |-+                                                                 |   
        |                                                                   |   
  35000 |-+                                                                 |   
        |  O O  OOOO OOOO OOOO OOOO OOOO OOO OO                             |   
  30000 |-+                                                                 |   
        |O  O O                                                             |   
  25000 +-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            reaim.time.file_system_inputs                       
                                                                                
  300000 +------------------------------------------------------------------+   
         |++.++++.++++.++++.++++.++++.++++.+++++.++++.++++.++++.++++.++++.++|   
  250000 |-+                                                                |   
         |                                                                  |   
         |                                                                  |   
  200000 |-+                                                                |   
         |                                                                  |   
  150000 |-+                                                                |   
         |                                                                  |   
  100000 |-+                                                                |   
         |                                                                  |   
         |                                                                  |   
   50000 |OO OOOO OOOO OOOO OOOO OOOO OOOO OOOO                             |   
         |                                                                  |   
       0 +------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                reaim.parent_time                               
                                                                                
  88 +----------------------------------------------------------------------+   
  86 |-+                   +  :+  :   + : + ::     + : + : :               +|   
     |+.   .+  .++         :+:  +: :  :::  : :     :::  :: +         +.   + |   
  84 |-++++  ++   ++.+++.++  +   + :.+ +   +  +++.+ +   +   +.++++.++  +++  |   
  82 |-+                           +                                        |   
     |                                                                      |   
  80 |-+                                                                    |   
  78 |-+                                                                    |   
  76 |-+                                                                    |   
     |O  O                                                                  |   
  74 |-+    O                                                               |   
  72 |-+O                                                                   |   
     |    O        O OO  O        O                                         |   
  70 |-+     OO OOO    O  OO OOO O O OOO OOOO                               |   
  68 +----------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                reaim.jobs_per_min                              
                                                                                
  8800 +--------------------------------------------------------------------+   
  8600 |-+       O       O O      O O OOO OOOO                              |   
       |       OO  OOOO O O  OOO O O                                        |   
  8400 |-+O O                                                               |   
  8200 |-+                                                                  |   
       |   O O                                                              |   
  8000 |O+                                                                  |   
  7800 |-+                                                                  |   
  7600 |-+                                                                  |   
       |                                                                    |   
  7400 |-+                                                                  |   
  7200 |-+           +              +.+        ++ +           ++.+ +        |   
       |+.++++.+++.++ +.++++. +   + :  :+   + :  + + +   + +.+    + +.++++. |   
  7000 |-+                   + :.+ :   + + + ::     + :.+ ::               +|   
  6800 +--------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                            reaim.jobs_per_min_child                            
                                                                                
  88 +----------------------------------------------------------------------+   
  86 |-+        O      O  O      O O OOO OOOO                               |   
     |       OO  OOO OO  O O OOO  O                                         |   
  84 |-+O O                                                                 |   
  82 |-+                                                                    |   
     |   O  O                                                               |   
  80 |O+                                                                    |   
  78 |-+                                                                    |   
  76 |-+                                                                    |   
     |                                                                      |   
  74 |-+                                                                    |   
  72 |-+           +.              +.+        ++ .+          .+++ .+        |   
     |+.+++.+++.+++  +++.++ .+  .+ :  :+   + :  +  :+   +  ++    +  ++.+++. |   
  70 |-+                   +  :+  :   + + + ::     + + + + :               +|   
  68 +----------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.9.0-rc1-00044-gc0aaf9b7a114f6" of type "text/plain" (159062 bytes)

View attachment "job-script" of type "text/plain" (7996 bytes)

View attachment "job.yaml" of type "text/plain" (5560 bytes)

View attachment "reproduce" of type "text/plain" (1001 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ