lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite for Android: free password hash cracker in your pocket
[<prev] [next>] [day] [month] [year] [list]
Date:   Sun, 4 Jul 2021 22:53:00 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Waiman Long <longman@...hat.com>
Cc:     Linus Torvalds <torvalds@...ux-foundation.org>,
        Shakeel Butt <shakeelb@...gle.com>,
        Alex Shi <alex.shi@...ux.alibaba.com>,
        Chris Down <chris@...isdown.name>,
        Christoph Lameter <cl@...ux.com>,
        David Rientjes <rientjes@...gle.com>,
        Johannes Weiner <hannes@...xchg.org>,
        Joonsoo Kim <iamjoonsoo.kim@....com>,
        Masayoshi Mizuma <msys.mizuma@...il.com>,
        Matthew Wilcox <willy@...radead.org>,
        Michal Hocko <mhocko@...nel.org>,
        Muchun Song <songmuchun@...edance.com>,
        Pekka Enberg <penberg@...nel.org>,
        Roman Gushchin <guro@...com>, Tejun Heo <tj@...nel.org>,
        Vladimir Davydov <vdavydov.dev@...il.com>,
        Vlastimil Babka <vbabka@...e.cz>,
        Wei Yang <richard.weiyang@...il.com>,
        Xing Zhengjun <zhengjun.xing@...ux.intel.com>,
        Yafang Shao <laoar.shao@...il.com>,
        Andrew Morton <akpm@...ux-foundation.org>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com
Subject: [mm/memcg]  5387c90490:  hackbench.throughput 41.3% improvement



Greeting,

FYI, we noticed a 41.3% improvement of hackbench.throughput due to commit:


commit: 5387c90490f7f42df3209154ca955a453ee01b41 ("mm/memcg: improve refill_obj_stock() performance")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: hackbench
on test machine: 104 threads 2 sockets Skylake with 192G memory
with following parameters:

	nr_threads: 100%
	iterations: 4
	mode: threads
	ipc: socket
	cpufreq_governor: performance
	ucode: 0x2006a0a

test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler.
test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sched/cfs-scheduler/hackbench.c

In addition to that, the commit also has significant impact on the following tests:

+------------------+----------------------------------------------------------------------+
| testcase: change | hackbench: hackbench.throughput 51.9% improvement                    |
| test machine     | 96 threads 2 sockets Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory |
| test parameters  | cpufreq_governor=performance                                         |
|                  | ipc=socket                                                           |
|                  | iterations=8                                                         |
|                  | mode=process                                                         |
|                  | nr_threads=1600%                                                     |
|                  | ucode=0x4003006                                                      |
+------------------+----------------------------------------------------------------------+




Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml  # generate the yaml file for lkp run
        bin/lkp run                    generated-yaml-file

=========================================================================================
compiler/cpufreq_governor/ipc/iterations/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode:
  gcc-9/performance/socket/4/x86_64-rhel-8.3/threads/100%/debian-10.4-x86_64-20200603.cgz/lkp-skl-fpga01/hackbench/0x2006a0a

commit: 
  68ac5b3c8d ("mm/memcg: cache vmstat data in percpu memcg_stock_pcp")
  5387c90490 ("mm/memcg: improve refill_obj_stock() performance")

68ac5b3c8db2fda0 5387c90490f7f42df3209154ca9 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     82459           +41.3%     116521 ±  2%  hackbench.throughput
    601.44           -29.1%     426.40 ±  2%  hackbench.time.elapsed_time
    601.44           -29.1%     426.40 ±  2%  hackbench.time.elapsed_time.max
 2.344e+09 ±  3%     -85.5%  3.396e+08 ± 21%  hackbench.time.involuntary_context_switches
     53613           -32.8%      36018 ±  2%  hackbench.time.system_time
 3.493e+09 ±  2%     -77.9%  7.702e+08 ± 14%  hackbench.time.voluntary_context_switches
   1374661 ± 22%     -58.4%     572519 ± 13%  numa-numastat.node0.local_node
   1403760 ± 21%     -55.5%     623973 ± 15%  numa-numastat.node0.numa_hit
    651.41           -26.7%     477.78 ±  2%  uptime.boot
      5074 ±  3%      +9.5%       5557 ±  3%  uptime.idle
  65187074 ± 25%    +336.1%  2.843e+08 ±  6%  cpuidle.C1.time
   5686636 ± 13%    +402.4%   28566892 ±  5%  cpuidle.C1.usage
   5451564 ± 23%    +189.6%   15789364 ±  5%  cpuidle.POLL.time
   1684249 ± 24%    +103.1%    3421281 ± 11%  cpuidle.POLL.usage
      3.45 ±  4%      +6.9       10.38 ± 36%  mpstat.cpu.all.idle%
      1.19 ±  4%      -0.1        1.04 ±  3%  mpstat.cpu.all.irq%
      0.02            +0.0        0.04 ±  5%  mpstat.cpu.all.soft%
     12.20            +2.7       14.92 ±  5%  mpstat.cpu.all.usr%
   3295209           +80.7%    5954774 ± 20%  vmstat.memory.cache
      2143           -22.4%       1663        vmstat.procs.r
   9678625 ±  2%     -72.3%    2678610 ± 17%  vmstat.system.cs
    955036 ±  3%     -41.1%     562152 ±  7%  vmstat.system.in
    568807 ±  3%     +10.5%     628623 ±  5%  numa-vmstat.node0.nr_file_pages
     16548 ± 30%    +239.6%      56197 ± 46%  numa-vmstat.node0.nr_mapped
    523.67 ± 35%     +55.0%     811.67 ± 17%  numa-vmstat.node0.nr_page_table_pages
     36972 ± 26%     +53.5%      56757 ±  5%  numa-vmstat.node0.nr_slab_unreclaimable
    193900 ±  8%    +319.4%     813228 ± 37%  numa-vmstat.node1.nr_shmem
   5677672 ± 13%    +403.0%   28559515 ±  5%  turbostat.C1
      0.10 ± 26%      +0.5        0.64 ±  7%  turbostat.C1%
      0.68 ±  2%     +97.8%       1.34 ±  3%  turbostat.CPU%c1
 5.956e+08 ±  3%     -56.6%  2.585e+08 ±  5%  turbostat.IRQ
    118.32           +12.9%     133.57        turbostat.RAMWatt
   3177467           +81.9%    5780159 ± 20%  meminfo.Cached
   1203614          +222.4%    3880986 ± 31%  meminfo.Committed_AS
   4677171           +64.7%    7701539 ± 17%  meminfo.Memused
    297339           +24.9%     371485        meminfo.SUnreclaim
    806445          +323.2%    3412731 ± 35%  meminfo.Shmem
    420575           +19.0%     500317        meminfo.Slab
   5215936           +51.2%    7884576 ± 14%  meminfo.max_used_kB
   2275408 ±  3%     +10.5%    2514228 ±  5%  numa-meminfo.node0.FilePages
     64515 ± 31%    +247.9%     224420 ± 46%  numa-meminfo.node0.Mapped
   3161940 ±  5%     +18.3%    3741976 ±  3%  numa-meminfo.node0.MemUsed
      2096 ± 35%     +55.0%       3249 ± 17%  numa-meminfo.node0.PageTables
    148152 ± 26%     +53.3%     227063 ±  5%  numa-meminfo.node0.SUnreclaim
    224798 ± 18%     +37.9%     309991 ±  5%  numa-meminfo.node0.Slab
    774062 ±  8%    +320.0%    3251142 ± 37%  numa-meminfo.node1.Shmem
   4772460            -1.6%    4696954        proc-vmstat.nr_dirty_background_threshold
   9556589            -1.6%    9405393        proc-vmstat.nr_dirty_threshold
    794697           +81.8%    1444609 ± 20%  proc-vmstat.nr_file_pages
  48011598            -1.6%   47256315        proc-vmstat.nr_free_pages
    201937          +322.3%     852751 ± 35%  proc-vmstat.nr_shmem
     30809            +4.5%      32203        proc-vmstat.nr_slab_reclaimable
     74338           +24.9%      92861        proc-vmstat.nr_slab_unreclaimable
   3223037 ±  2%     -20.0%    2579246 ± 17%  proc-vmstat.numa_hit
   3128922 ±  2%     -20.6%    2485141 ± 18%  proc-vmstat.numa_local
   6652818 ±  3%     -50.8%    3274182 ± 18%  proc-vmstat.pgalloc_normal
   6372725 ±  3%     -68.5%    2009197 ± 11%  proc-vmstat.pgfree
     78108           -13.4%      67635 ±  4%  proc-vmstat.pgreuse
     64709 ±  4%      -8.6%      59163 ±  5%  slabinfo.anon_vma_chain.active_objs
      1012 ±  4%      -8.5%     926.50 ±  5%  slabinfo.anon_vma_chain.active_slabs
     64825 ±  4%      -8.5%      59329 ±  5%  slabinfo.anon_vma_chain.num_objs
      1012 ±  4%      -8.5%     926.50 ±  5%  slabinfo.anon_vma_chain.num_slabs
    766.50           +17.5%     900.50        slabinfo.kmalloc-256.active_slabs
     24539           +17.5%      28832        slabinfo.kmalloc-256.num_objs
    766.50           +17.5%     900.50        slabinfo.kmalloc-256.num_slabs
     39056 ±  3%    +181.6%     109997 ±  3%  slabinfo.kmalloc-512.active_objs
      1397 ±  3%    +217.3%       4434 ±  4%  slabinfo.kmalloc-512.active_slabs
     44743 ±  3%    +217.2%     141914 ±  4%  slabinfo.kmalloc-512.num_objs
      1397 ±  3%    +217.3%       4434 ±  4%  slabinfo.kmalloc-512.num_slabs
     31672           +31.2%      41555 ± 11%  slabinfo.radix_tree_node.active_objs
    565.17           +31.2%     741.67 ± 11%  slabinfo.radix_tree_node.active_slabs
     31677           +31.2%      41555 ± 11%  slabinfo.radix_tree_node.num_objs
    565.17           +31.2%     741.67 ± 11%  slabinfo.radix_tree_node.num_slabs
     30624 ±  3%    +229.8%     101008 ±  3%  slabinfo.skbuff_head_cache.active_objs
      1117 ±  4%    +267.9%       4111 ±  4%  slabinfo.skbuff_head_cache.active_slabs
     35782 ±  4%    +267.8%     131591 ±  4%  slabinfo.skbuff_head_cache.num_objs
      1117 ±  4%    +267.9%       4111 ±  4%  slabinfo.skbuff_head_cache.num_slabs
     12.17 ± 59%     -76.6%       2.85 ±105%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_recvmsg.sock_recvmsg
    107.59 ± 26%     -86.3%      14.72 ± 87%  perf-sched.sch_delay.avg.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     12.08 ± 10%     -80.9%       2.30 ±127%  perf-sched.sch_delay.avg.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     11216 ± 19%     -53.8%       5178 ± 79%  perf-sched.sch_delay.max.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     12780 ± 13%     -58.6%       5291 ± 82%  perf-sched.sch_delay.max.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     13649 ± 12%     -49.4%       6904 ± 79%  perf-sched.total_wait_time.max.ms
     95.29 ± 22%     -66.6%      31.87 ± 85%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
    509.93 ± 20%     -88.0%      61.07 ± 83%  perf-sched.wait_and_delay.avg.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     43.59 ± 11%     -80.4%       8.55 ±127%  perf-sched.wait_and_delay.avg.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     23259 ± 15%     -55.3%      10391 ± 79%  perf-sched.wait_and_delay.max.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     25565 ± 13%     -57.7%      10809 ± 83%  perf-sched.wait_and_delay.max.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
    177.56 ± 57%     -70.7%      52.07 ± 81%  perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
     35.59 ± 19%     -74.3%       9.13 ± 94%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
     36.21 ± 47%     -82.1%       6.50 ± 99%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_recvmsg.sock_recvmsg
     95.29 ± 22%     -66.6%      31.87 ± 85%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
    402.34 ± 20%     -88.5%      46.35 ± 82%  perf-sched.wait_time.avg.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     31.51 ± 12%     -80.2%       6.24 ±126%  perf-sched.wait_time.avg.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     13649 ± 12%     -55.2%       6120 ± 83%  perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12457 ± 15%     -53.4%       5811 ± 84%  perf-sched.wait_time.max.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     13018 ± 14%     -57.3%       5565 ± 83%  perf-sched.wait_time.max.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     11.68            -4.0%      11.22 ±  3%  perf-stat.i.MPKI
  1.91e+10 ±  2%     -13.0%  1.662e+10 ±  4%  perf-stat.i.branch-instructions
 3.114e+08           -13.3%    2.7e+08 ±  4%  perf-stat.i.branch-misses
      6.20            +9.1       15.31 ±  4%  perf-stat.i.cache-miss-rate%
  63695030 ±  4%    +112.1%  1.351e+08 ±  4%  perf-stat.i.cache-misses
 1.062e+09 ±  3%     -13.9%  9.139e+08 ±  8%  perf-stat.i.cache-references
   9804802 ±  2%     -72.2%    2721599 ± 18%  perf-stat.i.context-switches
      3.20 ±  2%     +12.1%       3.59 ±  4%  perf-stat.i.cpi
    682632 ±  6%     -64.6%     241483 ± 19%  perf-stat.i.cpu-migrations
      5079 ±  4%     -57.8%       2145 ±  4%  perf-stat.i.cycles-between-cache-misses
      0.08 ±  2%      +0.1        0.15 ±  4%  perf-stat.i.dTLB-load-miss-rate%
  19602583           +76.8%   34648829 ±  3%  perf-stat.i.dTLB-load-misses
 2.642e+10 ±  2%     -10.9%  2.353e+10 ±  4%  perf-stat.i.dTLB-loads
      0.01 ±  8%      +0.0        0.04 ± 10%  perf-stat.i.dTLB-store-miss-rate%
    886982 ±  8%    +468.7%    5044093 ±  9%  perf-stat.i.dTLB-store-misses
 1.612e+10            -8.9%  1.468e+10 ±  4%  perf-stat.i.dTLB-stores
     71.40           +12.4       83.83        perf-stat.i.iTLB-load-miss-rate%
  11045291 ±  6%     -52.6%    5234559 ± 10%  perf-stat.i.iTLB-loads
  9.29e+10 ±  2%     -11.1%   8.26e+10 ±  4%  perf-stat.i.instructions
      3720           -11.7%       3283 ±  2%  perf-stat.i.instructions-per-iTLB-miss
      0.32 ±  2%      -9.9%       0.29 ±  4%  perf-stat.i.ipc
    532.69 ±  5%     +33.9%     713.49 ±  5%  perf-stat.i.metric.K/sec
    602.85 ±  2%     -11.1%     535.87 ±  4%  perf-stat.i.metric.M/sec
      2939 ±  3%     +60.2%       4710 ±  8%  perf-stat.i.minor-faults
     87.86           -38.2       49.64 ±  6%  perf-stat.i.node-load-miss-rate%
   2480788 ±  7%    +578.9%   16841829 ±  4%  perf-stat.i.node-loads
     91.60           -43.7       47.94 ±  6%  perf-stat.i.node-store-miss-rate%
  10368046 ±  6%     +17.6%   12189032 ±  6%  perf-stat.i.node-store-misses
    965185 ±  7%   +1354.2%   14035704 ±  4%  perf-stat.i.node-stores
      2941 ±  3%     +60.2%       4712 ±  8%  perf-stat.i.page-faults
      6.05            +8.9       14.91 ±  5%  perf-stat.overall.cache-miss-rate%
      3.11 ±  2%     +11.6%       3.47 ±  5%  perf-stat.overall.cpi
      4511 ±  3%     -53.1%       2113 ±  4%  perf-stat.overall.cycles-between-cache-misses
      0.07 ±  2%      +0.1        0.15 ±  4%  perf-stat.overall.dTLB-load-miss-rate%
      0.01 ±  9%      +0.0        0.03 ± 10%  perf-stat.overall.dTLB-store-miss-rate%
     70.35           +13.2       83.55        perf-stat.overall.iTLB-load-miss-rate%
      3571 ±  2%     -12.3%       3131 ±  2%  perf-stat.overall.instructions-per-iTLB-miss
      0.32 ±  2%     -10.2%       0.29 ±  4%  perf-stat.overall.ipc
     89.09           -38.4       50.67 ±  8%  perf-stat.overall.node-load-miss-rate%
     90.82           -44.9       45.92 ±  5%  perf-stat.overall.node-store-miss-rate%
 1.896e+10 ±  2%     -12.8%  1.654e+10 ±  4%  perf-stat.ps.branch-instructions
 3.094e+08           -13.1%  2.688e+08 ±  4%  perf-stat.ps.branch-misses
  63654107 ±  3%    +111.9%  1.349e+08 ±  4%  perf-stat.ps.cache-misses
 1.053e+09 ±  3%     -13.8%  9.081e+08 ±  7%  perf-stat.ps.cache-references
   9699719 ±  2%     -72.4%    2679869 ± 18%  perf-stat.ps.context-switches
    670636 ±  6%     -65.0%     234729 ± 18%  perf-stat.ps.cpu-migrations
  19593701           +76.7%   34623370 ±  3%  perf-stat.ps.dTLB-load-misses
 2.624e+10 ±  2%     -10.7%  2.342e+10 ±  4%  perf-stat.ps.dTLB-loads
    901124 ±  9%    +459.7%    5043349 ±  9%  perf-stat.ps.dTLB-store-misses
 1.601e+10            -8.7%  1.462e+10 ±  4%  perf-stat.ps.dTLB-stores
  10905261 ±  6%     -52.5%    5180101 ± 10%  perf-stat.ps.iTLB-loads
 9.225e+10 ±  2%     -10.9%  8.219e+10 ±  4%  perf-stat.ps.instructions
      1.12 ± 44%     +99.7%       2.24 ± 25%  perf-stat.ps.major-faults
      2910 ±  3%     +56.2%       4547 ±  8%  perf-stat.ps.minor-faults
   2537682 ±  7%    +568.1%   16953030 ±  4%  perf-stat.ps.node-loads
  10280989 ±  6%     +16.7%   11999128 ±  6%  perf-stat.ps.node-store-misses
   1033899 ±  7%   +1266.0%   14122866 ±  4%  perf-stat.ps.node-stores
      2912 ±  3%     +56.2%       4550 ±  8%  perf-stat.ps.page-faults
 5.555e+13 ±  2%     -36.9%  3.505e+13 ±  2%  perf-stat.total.instructions
     82383           -38.1%      51010 ±  2%  softirqs.CPU0.RCU
     11946 ±  8%     +51.9%      18143 ±  6%  softirqs.CPU0.SCHED
     83901           -39.4%      50854 ±  2%  softirqs.CPU1.RCU
     10530 ±  9%     +62.6%      17122 ±  5%  softirqs.CPU1.SCHED
     82690           -40.3%      49378 ±  2%  softirqs.CPU10.RCU
      8595 ±  5%     +68.9%      14520 ±  4%  softirqs.CPU10.SCHED
     81004           -39.4%      49126 ±  3%  softirqs.CPU100.RCU
     10023 ± 14%     +60.5%      16092 ±  5%  softirqs.CPU100.SCHED
     80721           -39.7%      48692 ±  3%  softirqs.CPU101.RCU
      9652 ± 12%     +67.1%      16127 ±  3%  softirqs.CPU101.SCHED
     81743           -39.5%      49494 ±  4%  softirqs.CPU102.RCU
      9461 ± 12%     +68.5%      15946 ±  4%  softirqs.CPU102.SCHED
     81567           -39.9%      49048 ±  4%  softirqs.CPU103.RCU
     10377 ± 13%     +57.1%      16306 ±  3%  softirqs.CPU103.SCHED
     83547           -39.9%      50187 ±  3%  softirqs.CPU11.RCU
      8718 ±  7%     +67.4%      14598 ±  4%  softirqs.CPU11.SCHED
     83780           -39.7%      50514 ±  3%  softirqs.CPU12.RCU
      8551 ±  7%     +69.7%      14515 ±  5%  softirqs.CPU12.SCHED
     82874 ±  2%     -37.9%      51480 ±  3%  softirqs.CPU13.RCU
      8707 ±  7%     +74.3%      15179 ±  5%  softirqs.CPU13.SCHED
     79623 ±  9%     -37.1%      50081 ±  4%  softirqs.CPU14.RCU
      8757 ±  8%     +62.8%      14260 ±  5%  softirqs.CPU14.SCHED
     91367           -40.7%      54191 ±  5%  softirqs.CPU15.RCU
      8433 ±  6%     +69.1%      14260 ±  5%  softirqs.CPU15.SCHED
     91569           -41.1%      53944 ±  3%  softirqs.CPU16.RCU
      8422 ±  5%     +75.1%      14746 ±  5%  softirqs.CPU16.SCHED
     90429 ±  5%     -40.0%      54232 ±  2%  softirqs.CPU17.RCU
      8511 ±  7%     +69.8%      14452 ±  3%  softirqs.CPU17.SCHED
     92542           -41.6%      54049 ±  3%  softirqs.CPU18.RCU
      8609 ±  9%     +64.8%      14191 ±  5%  softirqs.CPU18.SCHED
     93207           -42.0%      54033 ±  3%  softirqs.CPU19.RCU
      8866 ±  6%     +59.6%      14153 ±  4%  softirqs.CPU19.SCHED
     83467           -39.0%      50951 ±  3%  softirqs.CPU2.RCU
      9144 ±  7%     +63.6%      14964 ±  5%  softirqs.CPU2.SCHED
     90907           -41.1%      53543 ±  3%  softirqs.CPU20.RCU
      8915 ± 10%     +63.0%      14530 ±  4%  softirqs.CPU20.SCHED
     91022           -40.9%      53798 ±  3%  softirqs.CPU21.RCU
      8302 ±  4%     +73.1%      14372 ±  4%  softirqs.CPU21.SCHED
     90088 ±  4%     -40.4%      53699 ±  3%  softirqs.CPU22.RCU
      8682 ±  5%     +64.6%      14291 ±  4%  softirqs.CPU22.SCHED
     91532           -40.7%      54267 ±  3%  softirqs.CPU23.RCU
      8545 ±  6%     +72.0%      14696 ±  5%  softirqs.CPU23.SCHED
     92532           -41.1%      54495 ±  3%  softirqs.CPU24.RCU
      8682 ±  7%     +68.9%      14661 ±  4%  softirqs.CPU24.SCHED
     90745 ±  6%     -40.1%      54374 ±  3%  softirqs.CPU25.RCU
      8656 ±  6%     +67.3%      14479 ±  5%  softirqs.CPU25.SCHED
     80912           -41.1%      47680 ±  3%  softirqs.CPU26.RCU
      9647 ± 12%     +63.0%      15726 ±  8%  softirqs.CPU26.SCHED
     81056           -40.1%      48515 ±  2%  softirqs.CPU27.RCU
     10080 ± 12%     +70.4%      17182 ±  8%  softirqs.CPU27.SCHED
     80849           -40.3%      48288 ±  4%  softirqs.CPU28.RCU
      9318 ± 16%     +73.8%      16195 ±  4%  softirqs.CPU28.SCHED
     81348           -40.3%      48602 ±  3%  softirqs.CPU29.RCU
      9837 ±  9%     +61.9%      15923 ±  3%  softirqs.CPU29.SCHED
     82656 ±  2%     -38.1%      51137 ±  4%  softirqs.CPU3.RCU
      8719 ±  5%     +70.4%      14859 ±  4%  softirqs.CPU3.SCHED
     83915           -38.2%      51833 ±  5%  softirqs.CPU30.RCU
      9430 ±  9%     +70.3%      16062 ±  5%  softirqs.CPU30.SCHED
     84800 ±  2%     -40.3%      50624 ±  3%  softirqs.CPU31.RCU
      9622 ± 12%     +67.9%      16158 ±  6%  softirqs.CPU31.SCHED
     81832 ±  8%     -38.0%      50745 ±  3%  softirqs.CPU32.RCU
      9722 ± 10%     +66.6%      16202 ±  5%  softirqs.CPU32.SCHED
     83675           -39.7%      50422 ±  3%  softirqs.CPU33.RCU
      9401 ± 11%     +72.2%      16187 ±  5%  softirqs.CPU33.SCHED
     84672           -40.0%      50793 ±  3%  softirqs.CPU34.RCU
      9561 ± 17%     +65.6%      15831 ±  5%  softirqs.CPU34.SCHED
     84570           -40.1%      50664 ±  3%  softirqs.CPU35.RCU
      9508 ± 12%     +68.9%      16065 ±  3%  softirqs.CPU35.SCHED
     84118           -39.4%      50963 ±  3%  softirqs.CPU36.RCU
      9782 ± 16%     +62.9%      15935 ±  6%  softirqs.CPU36.SCHED
     85110           -40.0%      51085 ±  3%  softirqs.CPU37.RCU
      9587 ± 15%     +65.5%      15866 ±  5%  softirqs.CPU37.SCHED
     85245 ±  2%     -40.1%      51046 ±  3%  softirqs.CPU38.RCU
      9434 ± 13%     +69.1%      15955 ±  4%  softirqs.CPU38.SCHED
     84202           -39.8%      50729 ±  3%  softirqs.CPU39.RCU
      9671 ± 11%     +63.8%      15841 ±  5%  softirqs.CPU39.SCHED
     83756 ±  3%     -40.1%      50200 ±  3%  softirqs.CPU4.RCU
      8758 ±  6%     +67.9%      14703 ±  5%  softirqs.CPU4.SCHED
     84595           -40.2%      50626 ±  3%  softirqs.CPU40.RCU
      9627 ± 15%     +62.6%      15651 ±  7%  softirqs.CPU40.SCHED
     83591           -39.5%      50583 ±  3%  softirqs.CPU41.RCU
      8874 ±  8%     +80.0%      15972 ±  6%  softirqs.CPU41.SCHED
     84667 ±  2%     -39.9%      50851 ±  3%  softirqs.CPU42.RCU
      9534 ± 17%     +66.2%      15850 ±  5%  softirqs.CPU42.SCHED
     85428 ±  2%     -40.2%      51057 ±  3%  softirqs.CPU43.RCU
      9135 ±  9%     +75.2%      16002 ±  4%  softirqs.CPU43.SCHED
     84516 ±  2%     -40.1%      50629 ±  3%  softirqs.CPU44.RCU
      9459 ± 13%     +68.8%      15971 ±  4%  softirqs.CPU44.SCHED
     85668           -40.8%      50691 ±  3%  softirqs.CPU45.RCU
      9758 ± 19%     +62.6%      15862 ±  6%  softirqs.CPU45.SCHED
     84519           -40.4%      50333 ±  3%  softirqs.CPU46.RCU
      9430 ± 11%     +69.3%      15970 ±  4%  softirqs.CPU46.SCHED
     84197           -40.3%      50268 ±  3%  softirqs.CPU47.RCU
      9879 ± 18%     +61.5%      15951 ±  5%  softirqs.CPU47.SCHED
     84157           -40.3%      50225 ±  3%  softirqs.CPU48.RCU
      9486 ± 15%     +70.4%      16166 ±  4%  softirqs.CPU48.SCHED
     84677           -40.9%      50082 ±  4%  softirqs.CPU49.RCU
      9683 ± 12%     +63.1%      15789 ±  5%  softirqs.CPU49.SCHED
     83127           -39.5%      50295 ±  3%  softirqs.CPU5.RCU
      8662 ±  6%     +68.8%      14625 ±  6%  softirqs.CPU5.SCHED
     84627           -40.4%      50461 ±  3%  softirqs.CPU50.RCU
      9172 ± 11%     +72.1%      15788 ±  3%  softirqs.CPU50.SCHED
     85517           -41.2%      50256 ±  3%  softirqs.CPU51.RCU
     10235 ± 18%     +57.5%      16117 ±  5%  softirqs.CPU51.SCHED
     89582 ±  2%     -41.6%      52277 ±  4%  softirqs.CPU52.RCU
      8268 ±  5%     +69.3%      13998 ±  5%  softirqs.CPU52.SCHED
     91542 ±  2%     -42.7%      52468 ±  3%  softirqs.CPU53.RCU
      8564 ±  4%     +67.9%      14382 ±  5%  softirqs.CPU53.SCHED
     91896 ±  2%     -42.8%      52597 ±  4%  softirqs.CPU54.RCU
      7566 ±  4%     +77.8%      13452 ±  8%  softirqs.CPU54.SCHED
     91657 ±  3%     -41.9%      53221 ±  4%  softirqs.CPU55.RCU
      8339 ±  5%     +72.7%      14402 ±  4%  softirqs.CPU55.SCHED
     92388 ±  2%     -42.2%      53390 ±  2%  softirqs.CPU56.RCU
      8593 ±  5%     +67.9%      14426 ±  4%  softirqs.CPU56.SCHED
     91852           -41.7%      53505 ±  2%  softirqs.CPU57.RCU
      8502 ±  5%     +71.3%      14568 ±  4%  softirqs.CPU57.SCHED
     93510 ±  2%     -42.8%      53479 ±  2%  softirqs.CPU58.RCU
      8769 ±  7%     +66.6%      14611 ±  4%  softirqs.CPU58.SCHED
     87046 ± 10%     -39.3%      52836 ±  3%  softirqs.CPU59.RCU
      8785 ±  9%     +63.6%      14375 ±  5%  softirqs.CPU59.SCHED
     84834 ±  2%     -40.3%      50626 ±  3%  softirqs.CPU6.RCU
      8858 ±  6%     +65.3%      14639 ±  5%  softirqs.CPU6.SCHED
     83069           -39.6%      50157 ±  3%  softirqs.CPU60.RCU
      8628 ±  7%     +69.9%      14661 ±  5%  softirqs.CPU60.SCHED
     83152           -40.1%      49776 ±  3%  softirqs.CPU61.RCU
      8854 ± 10%     +63.8%      14501 ±  6%  softirqs.CPU61.SCHED
     82984           -40.1%      49686 ±  2%  softirqs.CPU62.RCU
      8622 ±  5%     +71.5%      14785 ±  5%  softirqs.CPU62.SCHED
     84589           -40.4%      50403 ±  2%  softirqs.CPU63.RCU
      8722 ±  7%     +67.0%      14565 ±  4%  softirqs.CPU63.SCHED
     84360           -40.3%      50355 ±  3%  softirqs.CPU64.RCU
      8807 ±  6%     +61.3%      14203 ±  4%  softirqs.CPU64.SCHED
     82988           -39.5%      50218 ±  3%  softirqs.CPU65.RCU
      8580 ±  5%     +69.1%      14506 ±  5%  softirqs.CPU65.SCHED
     80761 ±  7%     -37.3%      50666 ±  3%  softirqs.CPU66.RCU
      8602 ±  5%     +71.9%      14789 ±  4%  softirqs.CPU66.SCHED
     82949           -39.5%      50221 ±  3%  softirqs.CPU67.RCU
      8626 ±  6%     +71.1%      14762 ±  5%  softirqs.CPU67.SCHED
     83358           -39.0%      50882 ±  3%  softirqs.CPU68.RCU
      8559 ±  6%     +72.7%      14784 ±  3%  softirqs.CPU68.SCHED
     80823 ±  9%     -37.2%      50754 ±  3%  softirqs.CPU69.RCU
      8981 ± 12%     +63.6%      14693 ±  4%  softirqs.CPU69.SCHED
     81901 ±  7%     -38.3%      50504 ±  4%  softirqs.CPU7.RCU
      9028 ±  6%     +59.1%      14360 ±  6%  softirqs.CPU7.SCHED
     84749 ±  2%     -39.9%      50898 ±  3%  softirqs.CPU70.RCU
      8761 ±  7%     +67.9%      14707 ±  4%  softirqs.CPU70.SCHED
     84493 ±  2%     -39.7%      50972 ±  3%  softirqs.CPU71.RCU
      8746 ±  6%     +66.0%      14519 ±  6%  softirqs.CPU71.SCHED
     83345           -39.6%      50312 ±  3%  softirqs.CPU72.RCU
      8936 ± 12%     +63.5%      14610 ±  5%  softirqs.CPU72.SCHED
     83229           -39.0%      50755 ±  3%  softirqs.CPU73.RCU
      8482 ±  5%     +77.3%      15042 ±  5%  softirqs.CPU73.SCHED
     79942 ±  9%     -37.1%      50285 ±  3%  softirqs.CPU74.RCU
      8981 ±  7%     +64.1%      14740 ±  5%  softirqs.CPU74.SCHED
     83686 ±  2%     -41.2%      49243 ±  3%  softirqs.CPU75.RCU
      8671 ±  5%     +71.8%      14901 ±  5%  softirqs.CPU75.SCHED
     84048 ±  2%     -41.8%      48892 ±  4%  softirqs.CPU76.RCU
      9352 ±  8%     +57.0%      14684 ±  3%  softirqs.CPU76.SCHED
     80865 ±  7%     -39.9%      48572 ±  3%  softirqs.CPU77.RCU
      8789 ±  4%     +69.0%      14853 ±  4%  softirqs.CPU77.SCHED
     87858           -41.6%      51306 ±  3%  softirqs.CPU78.RCU
      9232 ±  9%     +69.4%      15642 ±  8%  softirqs.CPU78.SCHED
     88237           -40.7%      52303 ±  3%  softirqs.CPU79.RCU
     10236 ± 12%     +61.0%      16483 ±  9%  softirqs.CPU79.SCHED
     82490 ±  2%     -39.1%      50211 ±  3%  softirqs.CPU8.RCU
      8488 ±  5%     +69.0%      14344 ±  6%  softirqs.CPU8.SCHED
     88590           -41.2%      52132 ±  4%  softirqs.CPU80.RCU
     10327 ± 10%     +53.8%      15886 ±  5%  softirqs.CPU80.SCHED
     87957           -40.4%      52465 ±  3%  softirqs.CPU81.RCU
      9534 ± 13%     +73.0%      16494 ±  7%  softirqs.CPU81.SCHED
     87951           -40.6%      52263 ±  3%  softirqs.CPU82.RCU
      9557 ± 10%     +71.7%      16409 ±  7%  softirqs.CPU82.SCHED
     87989 ±  2%     -40.7%      52154 ±  3%  softirqs.CPU83.RCU
     10051 ± 23%     +59.6%      16040 ±  5%  softirqs.CPU83.SCHED
     87013 ±  4%     -40.0%      52210 ±  3%  softirqs.CPU84.RCU
     10147 ± 13%     +55.9%      15817 ±  6%  softirqs.CPU84.SCHED
     87829           -40.7%      52106 ±  3%  softirqs.CPU85.RCU
      9448 ± 11%     +69.9%      16054 ±  4%  softirqs.CPU85.SCHED
     88170           -40.3%      52637 ±  3%  softirqs.CPU86.RCU
      9309 ± 11%     +73.6%      16158 ±  5%  softirqs.CPU86.SCHED
     88373           -40.9%      52219 ±  3%  softirqs.CPU87.RCU
      9834 ± 12%     +63.0%      16033 ±  3%  softirqs.CPU87.SCHED
     87687           -40.3%      52361 ±  3%  softirqs.CPU88.RCU
      9885 ± 14%     +60.9%      15907 ±  7%  softirqs.CPU88.SCHED
     88035           -40.9%      52034 ±  3%  softirqs.CPU89.RCU
      9647 ± 13%     +65.9%      16003 ±  5%  softirqs.CPU89.SCHED
     82978 ±  2%     -40.2%      49601 ±  3%  softirqs.CPU9.RCU
      8802 ±  7%     +62.1%      14265 ±  5%  softirqs.CPU9.SCHED
     82405           -40.1%      49331 ±  2%  softirqs.CPU90.RCU
      9559 ± 14%     +67.0%      15961 ±  5%  softirqs.CPU90.SCHED
     81438           -39.6%      49209 ±  3%  softirqs.CPU91.RCU
      9803 ± 11%     +64.1%      16091 ±  7%  softirqs.CPU91.SCHED
     81721           -40.1%      48978 ±  3%  softirqs.CPU92.RCU
      9665 ± 13%     +63.8%      15828 ±  6%  softirqs.CPU92.SCHED
     81370           -39.7%      49067 ±  3%  softirqs.CPU93.RCU
      9448 ± 10%     +67.2%      15794 ±  6%  softirqs.CPU93.SCHED
     81624           -39.9%      49065 ±  3%  softirqs.CPU94.RCU
      9737 ± 16%     +64.4%      16010 ±  6%  softirqs.CPU94.SCHED
     81770           -39.6%      49413 ±  3%  softirqs.CPU95.RCU
      9066 ± 10%     +83.2%      16607 ±  9%  softirqs.CPU95.SCHED
     81782           -39.9%      49184 ±  3%  softirqs.CPU96.RCU
      9772 ± 14%     +61.6%      15792 ±  4%  softirqs.CPU96.SCHED
     82155           -40.0%      49329 ±  3%  softirqs.CPU97.RCU
      9878 ± 18%     +59.8%      15789 ±  6%  softirqs.CPU97.SCHED
     81298           -39.6%      49144 ±  3%  softirqs.CPU98.RCU
      9705 ± 14%     +63.7%      15889 ±  5%  softirqs.CPU98.SCHED
     81242           -39.4%      49224 ±  3%  softirqs.CPU99.RCU
      9817 ± 14%     +64.9%      16184 ±  5%  softirqs.CPU99.SCHED
   8852871           -40.1%    5301088 ±  3%  softirqs.RCU
    958083 ±  4%     +66.6%    1596070 ±  3%  softirqs.SCHED
     92537           -30.2%      64615 ±  2%  softirqs.TIMER
      1205           -29.0%     856.00 ±  2%  interrupts.9:IO-APIC.9-fasteoi.acpi
  89891349 ± 18%     -60.7%   35361947 ± 25%  interrupts.CAL:Function_call_interrupts
   1623974 ± 57%     -71.7%     459021 ± 84%  interrupts.CPU0.CAL:Function_call_interrupts
   1205651           -29.1%     855249 ±  2%  interrupts.CPU0.LOC:Local_timer_interrupts
   3196764 ±  7%     -66.4%    1072530 ±  6%  interrupts.CPU0.RES:Rescheduling_interrupts
      1205           -29.0%     856.00 ±  2%  interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
   1205641           -29.1%     855146 ±  2%  interrupts.CPU1.LOC:Local_timer_interrupts
   3425943 ±  6%     -69.8%    1033843 ± 10%  interrupts.CPU1.RES:Rescheduling_interrupts
    707756 ± 71%     -59.9%     283504 ± 29%  interrupts.CPU10.CAL:Function_call_interrupts
   1205637           -29.1%     855186 ±  2%  interrupts.CPU10.LOC:Local_timer_interrupts
   3586704 ±  2%     -70.0%    1076909 ±  6%  interrupts.CPU10.RES:Rescheduling_interrupts
   1205570           -29.1%     855284 ±  2%  interrupts.CPU100.LOC:Local_timer_interrupts
   3642188 ± 10%     -68.5%    1146714 ± 16%  interrupts.CPU100.RES:Rescheduling_interrupts
   1220194 ± 53%     -66.3%     411230 ± 58%  interrupts.CPU101.CAL:Function_call_interrupts
   1205569           -29.1%     855310 ±  2%  interrupts.CPU101.LOC:Local_timer_interrupts
   3686422 ±  9%     -69.4%    1127680 ±  8%  interrupts.CPU101.RES:Rescheduling_interrupts
   1205539           -29.1%     855303 ±  2%  interrupts.CPU102.LOC:Local_timer_interrupts
   3466868 ±  9%     -66.0%    1178496 ±  9%  interrupts.CPU102.RES:Rescheduling_interrupts
    753033 ± 38%     -51.9%     362540 ± 39%  interrupts.CPU103.CAL:Function_call_interrupts
   1205534           -29.1%     855323 ±  2%  interrupts.CPU103.LOC:Local_timer_interrupts
   3450153 ±  8%     -68.4%    1088970 ±  6%  interrupts.CPU103.RES:Rescheduling_interrupts
    724554 ± 60%     -62.5%     271669 ± 33%  interrupts.CPU11.CAL:Function_call_interrupts
   1205604           -29.1%     855122 ±  2%  interrupts.CPU11.LOC:Local_timer_interrupts
   3400360 ±  6%     -68.8%    1061657 ± 15%  interrupts.CPU11.RES:Rescheduling_interrupts
    641236 ± 59%     -61.2%     248758 ± 32%  interrupts.CPU12.CAL:Function_call_interrupts
   1205609           -29.1%     855116 ±  2%  interrupts.CPU12.LOC:Local_timer_interrupts
   3561488 ±  5%     -70.5%    1050780 ±  8%  interrupts.CPU12.RES:Rescheduling_interrupts
    734040 ± 70%     -63.5%     268243 ± 31%  interrupts.CPU13.CAL:Function_call_interrupts
   1205642           -29.1%     855148 ±  2%  interrupts.CPU13.LOC:Local_timer_interrupts
   3308551 ±  8%     -66.5%    1109093 ±  8%  interrupts.CPU13.RES:Rescheduling_interrupts
    785202 ± 64%     -67.1%     258319 ± 29%  interrupts.CPU14.CAL:Function_call_interrupts
   1205608           -29.1%     855174 ±  2%  interrupts.CPU14.LOC:Local_timer_interrupts
   3615978 ±  7%     -70.6%    1063276 ±  8%  interrupts.CPU14.RES:Rescheduling_interrupts
    757597 ± 64%     -67.7%     244389 ± 16%  interrupts.CPU15.CAL:Function_call_interrupts
   1205614           -29.1%     855152 ±  2%  interrupts.CPU15.LOC:Local_timer_interrupts
   3343478 ±  4%     -66.8%    1110832 ± 11%  interrupts.CPU15.RES:Rescheduling_interrupts
    505614 ± 44%     -54.3%     230896 ± 17%  interrupts.CPU16.CAL:Function_call_interrupts
   1205612           -29.1%     855161 ±  2%  interrupts.CPU16.LOC:Local_timer_interrupts
   3677516 ±  9%     -74.0%     957228 ±  4%  interrupts.CPU16.RES:Rescheduling_interrupts
    756708 ± 52%     -70.5%     223318 ± 17%  interrupts.CPU17.CAL:Function_call_interrupts
   1205608           -29.1%     855129 ±  2%  interrupts.CPU17.LOC:Local_timer_interrupts
   3411368 ±  3%     -70.5%    1005739 ±  9%  interrupts.CPU17.RES:Rescheduling_interrupts
    650745 ± 48%     -64.0%     234382 ± 15%  interrupts.CPU18.CAL:Function_call_interrupts
   1205588           -29.1%     855144 ±  2%  interrupts.CPU18.LOC:Local_timer_interrupts
   3489665 ±  6%     -67.4%    1137268 ± 20%  interrupts.CPU18.RES:Rescheduling_interrupts
   1205594           -29.1%     855172 ±  2%  interrupts.CPU19.LOC:Local_timer_interrupts
   3184389 ±  4%     -67.2%    1044787 ± 12%  interrupts.CPU19.RES:Rescheduling_interrupts
   1205645           -29.1%     855163 ±  2%  interrupts.CPU2.LOC:Local_timer_interrupts
   3344801 ±  5%     -67.3%    1094443 ±  6%  interrupts.CPU2.RES:Rescheduling_interrupts
    718386 ± 67%     -63.5%     262499 ± 19%  interrupts.CPU20.CAL:Function_call_interrupts
   1205599           -29.1%     855188 ±  2%  interrupts.CPU20.LOC:Local_timer_interrupts
   3403935 ±  6%     -67.7%    1100497 ±  8%  interrupts.CPU20.RES:Rescheduling_interrupts
   1205604           -29.1%     855136 ±  2%  interrupts.CPU21.LOC:Local_timer_interrupts
   3497519 ±  8%     -69.7%    1060157 ± 11%  interrupts.CPU21.RES:Rescheduling_interrupts
    775676 ± 52%     -55.6%     344109 ± 51%  interrupts.CPU22.CAL:Function_call_interrupts
   1205655           -29.1%     855162 ±  2%  interrupts.CPU22.LOC:Local_timer_interrupts
   3455529 ±  6%     -67.9%    1108198 ± 10%  interrupts.CPU22.RES:Rescheduling_interrupts
    705272 ± 56%     -62.7%     262796 ± 21%  interrupts.CPU23.CAL:Function_call_interrupts
   1205628           -29.1%     855179 ±  2%  interrupts.CPU23.LOC:Local_timer_interrupts
   3677020 ±  9%     -71.0%    1066870 ±  6%  interrupts.CPU23.RES:Rescheduling_interrupts
   1205621           -29.1%     855116 ±  2%  interrupts.CPU24.LOC:Local_timer_interrupts
   3311684 ±  6%     -69.2%    1020747 ±  3%  interrupts.CPU24.RES:Rescheduling_interrupts
    656460 ± 67%     -65.4%     227021 ± 16%  interrupts.CPU25.CAL:Function_call_interrupts
   1205631           -29.1%     855144 ±  2%  interrupts.CPU25.LOC:Local_timer_interrupts
   3232461 ±  7%     -68.0%    1034332 ± 13%  interrupts.CPU25.RES:Rescheduling_interrupts
   1205541           -29.1%     855326 ±  2%  interrupts.CPU26.LOC:Local_timer_interrupts
   2889950 ± 15%     -61.4%    1115390 ±  6%  interrupts.CPU26.RES:Rescheduling_interrupts
   1026174 ± 48%     -69.4%     314389 ± 32%  interrupts.CPU27.CAL:Function_call_interrupts
   1205558           -29.1%     855282 ±  2%  interrupts.CPU27.LOC:Local_timer_interrupts
   3593896 ±  7%     -69.9%    1081988 ±  7%  interrupts.CPU27.RES:Rescheduling_interrupts
    984752 ± 53%     -64.3%     351367 ± 48%  interrupts.CPU28.CAL:Function_call_interrupts
   1205555           -29.1%     855306 ±  2%  interrupts.CPU28.LOC:Local_timer_interrupts
   3424262 ± 10%     -67.1%    1127593 ±  9%  interrupts.CPU28.RES:Rescheduling_interrupts
   1205576           -29.1%     855297 ±  2%  interrupts.CPU29.LOC:Local_timer_interrupts
   3512273 ±  8%     -68.6%    1104147 ± 12%  interrupts.CPU29.RES:Rescheduling_interrupts
    669897 ± 54%     -58.9%     275239 ± 27%  interrupts.CPU3.CAL:Function_call_interrupts
   1205627           -29.1%     855178 ±  2%  interrupts.CPU3.LOC:Local_timer_interrupts
   3595156 ±  5%     -69.9%    1082314 ±  8%  interrupts.CPU3.RES:Rescheduling_interrupts
   1004398 ± 38%     -58.3%     418341 ± 60%  interrupts.CPU30.CAL:Function_call_interrupts
   1205681           -29.1%     855320 ±  2%  interrupts.CPU30.LOC:Local_timer_interrupts
   3499045 ±  2%     -68.5%    1101860 ±  9%  interrupts.CPU30.RES:Rescheduling_interrupts
   1112178 ± 39%     -67.4%     362178 ± 36%  interrupts.CPU31.CAL:Function_call_interrupts
   1205626           -29.1%     855320 ±  2%  interrupts.CPU31.LOC:Local_timer_interrupts
   3329087 ±  4%     -65.4%    1153373 ±  7%  interrupts.CPU31.RES:Rescheduling_interrupts
   1205545           -29.0%     855336 ±  2%  interrupts.CPU32.LOC:Local_timer_interrupts
   3613423 ±  7%     -67.6%    1169236 ± 11%  interrupts.CPU32.RES:Rescheduling_interrupts
   1205644           -29.1%     855326 ±  2%  interrupts.CPU33.LOC:Local_timer_interrupts
   3581469 ±  8%     -68.2%    1140463 ± 10%  interrupts.CPU33.RES:Rescheduling_interrupts
   1205560           -29.1%     855270 ±  2%  interrupts.CPU34.LOC:Local_timer_interrupts
   3470665 ±  4%     -65.9%    1182794 ± 12%  interrupts.CPU34.RES:Rescheduling_interrupts
   1205608           -29.1%     855330 ±  2%  interrupts.CPU35.LOC:Local_timer_interrupts
   3591355 ±  6%     -67.4%    1169240 ± 13%  interrupts.CPU35.RES:Rescheduling_interrupts
   1205561           -29.1%     855312 ±  2%  interrupts.CPU36.LOC:Local_timer_interrupts
   3565397 ±  7%     -68.0%    1141008 ±  8%  interrupts.CPU36.RES:Rescheduling_interrupts
   1205566           -29.1%     855277 ±  2%  interrupts.CPU37.LOC:Local_timer_interrupts
   3496519 ±  4%     -69.1%    1079423 ±  7%  interrupts.CPU37.RES:Rescheduling_interrupts
   1205562           -29.1%     855258 ±  2%  interrupts.CPU38.LOC:Local_timer_interrupts
   3564781 ±  7%     -69.5%    1088902 ± 12%  interrupts.CPU38.RES:Rescheduling_interrupts
   1205555           -29.0%     855356 ±  2%  interrupts.CPU39.LOC:Local_timer_interrupts
   3286445 ±  9%     -64.2%    1177572 ± 13%  interrupts.CPU39.RES:Rescheduling_interrupts
    487100 ± 43%     -47.5%     255865 ± 23%  interrupts.CPU4.CAL:Function_call_interrupts
   1205646           -29.1%     855198 ±  2%  interrupts.CPU4.LOC:Local_timer_interrupts
   3273624 ±  5%     -66.2%    1106857 ± 15%  interrupts.CPU4.RES:Rescheduling_interrupts
   1205633           -29.1%     855273 ±  2%  interrupts.CPU40.LOC:Local_timer_interrupts
   3479005           -64.1%    1248042 ± 12%  interrupts.CPU40.RES:Rescheduling_interrupts
   1205609           -29.1%     855264 ±  2%  interrupts.CPU41.LOC:Local_timer_interrupts
   3647883 ± 10%     -68.3%    1157486 ±  7%  interrupts.CPU41.RES:Rescheduling_interrupts
   1205645           -29.1%     855251 ±  2%  interrupts.CPU42.LOC:Local_timer_interrupts
   3676170 ±  7%     -69.2%    1133012 ± 10%  interrupts.CPU42.RES:Rescheduling_interrupts
   1205540           -29.1%     855299 ±  2%  interrupts.CPU43.LOC:Local_timer_interrupts
   3629110 ±  8%     -69.7%    1100768 ±  5%  interrupts.CPU43.RES:Rescheduling_interrupts
   1205622           -29.1%     855335 ±  2%  interrupts.CPU44.LOC:Local_timer_interrupts
   3463203 ±  5%     -64.9%    1215805 ± 13%  interrupts.CPU44.RES:Rescheduling_interrupts
   1079682 ± 54%     -71.2%     310597 ± 37%  interrupts.CPU45.CAL:Function_call_interrupts
   1205568           -29.1%     855297 ±  2%  interrupts.CPU45.LOC:Local_timer_interrupts
   3679792 ± 19%     -69.9%    1108076 ±  9%  interrupts.CPU45.RES:Rescheduling_interrupts
   1205556           -29.1%     855281 ±  2%  interrupts.CPU46.LOC:Local_timer_interrupts
   3498927 ±  6%     -67.1%    1151118 ± 10%  interrupts.CPU46.RES:Rescheduling_interrupts
   1205560           -29.1%     855311 ±  2%  interrupts.CPU47.LOC:Local_timer_interrupts
   3719213 ±  6%     -68.3%    1178088 ± 14%  interrupts.CPU47.RES:Rescheduling_interrupts
   1205608           -29.1%     855310 ±  2%  interrupts.CPU48.LOC:Local_timer_interrupts
   3651264 ±  8%     -69.0%    1132056 ± 14%  interrupts.CPU48.RES:Rescheduling_interrupts
   1235025 ± 51%     -66.8%     409515 ± 54%  interrupts.CPU49.CAL:Function_call_interrupts
   1205544           -29.0%     855344 ±  2%  interrupts.CPU49.LOC:Local_timer_interrupts
   3487785 ±  6%     -68.7%    1091874 ±  6%  interrupts.CPU49.RES:Rescheduling_interrupts
    649411 ± 60%     -56.1%     284866 ± 37%  interrupts.CPU5.CAL:Function_call_interrupts
   1205621           -29.1%     855152 ±  2%  interrupts.CPU5.LOC:Local_timer_interrupts
   3481679 ±  5%     -68.2%    1107732 ± 17%  interrupts.CPU5.RES:Rescheduling_interrupts
   1205609           -29.1%     855312 ±  2%  interrupts.CPU50.LOC:Local_timer_interrupts
   3656124 ±  5%     -67.7%    1180412 ± 10%  interrupts.CPU50.RES:Rescheduling_interrupts
   1205628           -29.1%     855379 ±  2%  interrupts.CPU51.LOC:Local_timer_interrupts
   3642072 ±  9%     -70.0%    1093120 ±  8%  interrupts.CPU51.RES:Rescheduling_interrupts
   1535288 ± 61%     -73.9%     400663 ± 64%  interrupts.CPU52.CAL:Function_call_interrupts
   1205570           -29.1%     855149 ±  2%  interrupts.CPU52.LOC:Local_timer_interrupts
   3181327 ±  8%     -66.1%    1079937 ±  4%  interrupts.CPU52.RES:Rescheduling_interrupts
   1205565           -29.1%     855109 ±  2%  interrupts.CPU53.LOC:Local_timer_interrupts
   3287450 ±  9%     -68.9%    1022387 ±  7%  interrupts.CPU53.RES:Rescheduling_interrupts
   1205586           -29.1%     855161 ±  2%  interrupts.CPU54.LOC:Local_timer_interrupts
   3447162 ±  8%     -68.2%    1095360 ±  9%  interrupts.CPU54.RES:Rescheduling_interrupts
    673858 ± 62%     -57.6%     285884 ± 29%  interrupts.CPU55.CAL:Function_call_interrupts
   1205592           -29.1%     855167 ±  2%  interrupts.CPU55.LOC:Local_timer_interrupts
   3681265 ±  4%     -69.9%    1107408 ±  9%  interrupts.CPU55.RES:Rescheduling_interrupts
   1205653           -29.1%     855132 ±  2%  interrupts.CPU56.LOC:Local_timer_interrupts
   3492355 ±  5%     -69.2%    1074433 ± 17%  interrupts.CPU56.RES:Rescheduling_interrupts
    609594 ± 74%     -57.4%     259486 ± 30%  interrupts.CPU57.CAL:Function_call_interrupts
   1205600           -29.1%     855174 ±  2%  interrupts.CPU57.LOC:Local_timer_interrupts
   3250090 ±  8%     -68.5%    1023666 ± 13%  interrupts.CPU57.RES:Rescheduling_interrupts
   1205585           -29.1%     855155 ±  2%  interrupts.CPU58.LOC:Local_timer_interrupts
   3292319 ±  6%     -67.8%    1059167 ± 12%  interrupts.CPU58.RES:Rescheduling_interrupts
    589279 ± 38%     -54.7%     266987 ± 21%  interrupts.CPU59.CAL:Function_call_interrupts
   1205592           -29.1%     855127 ±  2%  interrupts.CPU59.LOC:Local_timer_interrupts
   2995999 ± 12%     -64.6%    1060886 ± 11%  interrupts.CPU59.RES:Rescheduling_interrupts
    604415 ± 67%     -60.6%     237906 ± 18%  interrupts.CPU6.CAL:Function_call_interrupts
   1205626           -29.1%     855145 ±  2%  interrupts.CPU6.LOC:Local_timer_interrupts
   3320534 ±  7%     -68.0%    1062145 ± 11%  interrupts.CPU6.RES:Rescheduling_interrupts
    681116 ± 56%     -57.6%     288687 ± 31%  interrupts.CPU60.CAL:Function_call_interrupts
   1205605           -29.1%     855108 ±  2%  interrupts.CPU60.LOC:Local_timer_interrupts
   3447925 ± 11%     -68.3%    1092859 ± 16%  interrupts.CPU60.RES:Rescheduling_interrupts
   1205600           -29.1%     855136 ±  2%  interrupts.CPU61.LOC:Local_timer_interrupts
   3688455 ± 10%     -68.8%    1149466 ± 12%  interrupts.CPU61.RES:Rescheduling_interrupts
   1205607           -29.1%     855183 ±  2%  interrupts.CPU62.LOC:Local_timer_interrupts
   3384029 ±  7%     -68.4%    1070519 ±  8%  interrupts.CPU62.RES:Rescheduling_interrupts
    549499 ± 52%     -56.7%     237951 ± 27%  interrupts.CPU63.CAL:Function_call_interrupts
   1205597           -29.1%     855069 ±  2%  interrupts.CPU63.LOC:Local_timer_interrupts
   3329589 ±  6%     -69.4%    1017592 ± 10%  interrupts.CPU63.RES:Rescheduling_interrupts
    612129 ± 48%     -59.2%     249650 ± 31%  interrupts.CPU64.CAL:Function_call_interrupts
   1205619           -29.1%     855146 ±  2%  interrupts.CPU64.LOC:Local_timer_interrupts
      7832           -23.7%       5977 ± 27%  interrupts.CPU64.NMI:Non-maskable_interrupts
      7832           -23.7%       5977 ± 27%  interrupts.CPU64.PMI:Performance_monitoring_interrupts
   3357501 ± 11%     -69.3%    1029447 ±  8%  interrupts.CPU64.RES:Rescheduling_interrupts
    659883 ± 70%     -61.9%     251209 ± 26%  interrupts.CPU65.CAL:Function_call_interrupts
   1205621           -29.1%     855152 ±  2%  interrupts.CPU65.LOC:Local_timer_interrupts
   3421441 ± 12%     -68.0%    1093274 ± 11%  interrupts.CPU65.RES:Rescheduling_interrupts
    569279 ± 75%     -52.3%     271317 ± 26%  interrupts.CPU66.CAL:Function_call_interrupts
   1205711           -29.1%     855164 ±  2%  interrupts.CPU66.LOC:Local_timer_interrupts
   3597977 ± 10%     -70.5%    1059957 ±  8%  interrupts.CPU66.RES:Rescheduling_interrupts
    772167 ± 57%     -69.0%     239751 ± 14%  interrupts.CPU67.CAL:Function_call_interrupts
   1205625           -29.1%     855124 ±  2%  interrupts.CPU67.LOC:Local_timer_interrupts
   3415111 ±  5%     -67.5%    1110632 ±  8%  interrupts.CPU67.RES:Rescheduling_interrupts
    454837 ± 40%     -50.0%     227206 ± 15%  interrupts.CPU68.CAL:Function_call_interrupts
   1205569           -29.1%     855170 ±  2%  interrupts.CPU68.LOC:Local_timer_interrupts
      7836           -38.8%       4795 ± 35%  interrupts.CPU68.NMI:Non-maskable_interrupts
      7836           -38.8%       4795 ± 35%  interrupts.CPU68.PMI:Performance_monitoring_interrupts
   3416078 ±  8%     -72.0%     956119 ±  5%  interrupts.CPU68.RES:Rescheduling_interrupts
    627063 ± 46%     -60.8%     246039 ± 27%  interrupts.CPU69.CAL:Function_call_interrupts
   1205639           -29.1%     855170 ±  2%  interrupts.CPU69.LOC:Local_timer_interrupts
   3327270 ±  6%     -69.3%    1020049 ± 11%  interrupts.CPU69.RES:Rescheduling_interrupts
    593490 ± 42%     -52.4%     282559 ± 29%  interrupts.CPU7.CAL:Function_call_interrupts
   1205657           -29.1%     855174 ±  2%  interrupts.CPU7.LOC:Local_timer_interrupts
   3303249 ±  5%     -67.7%    1067112 ± 10%  interrupts.CPU7.RES:Rescheduling_interrupts
    652681 ± 58%     -65.0%     228460 ± 15%  interrupts.CPU70.CAL:Function_call_interrupts
   1205689           -29.1%     855186 ±  2%  interrupts.CPU70.LOC:Local_timer_interrupts
      7831           -38.9%       4784 ± 35%  interrupts.CPU70.NMI:Non-maskable_interrupts
      7831           -38.9%       4784 ± 35%  interrupts.CPU70.PMI:Performance_monitoring_interrupts
   3225378 ±  9%     -67.3%    1055573 ±  9%  interrupts.CPU70.RES:Rescheduling_interrupts
   1205544           -29.1%     855158 ±  2%  interrupts.CPU71.LOC:Local_timer_interrupts
   3349906 ±  4%     -69.4%    1026051 ± 13%  interrupts.CPU71.RES:Rescheduling_interrupts
    667025 ± 62%     -58.9%     274338 ± 23%  interrupts.CPU72.CAL:Function_call_interrupts
   1205643           -29.1%     855196 ±  2%  interrupts.CPU72.LOC:Local_timer_interrupts
   3452935 ± 10%     -68.3%    1096091 ±  8%  interrupts.CPU72.RES:Rescheduling_interrupts
   1205653           -29.1%     855183 ±  2%  interrupts.CPU73.LOC:Local_timer_interrupts
   3347362 ± 14%     -66.9%    1107626 ± 12%  interrupts.CPU73.RES:Rescheduling_interrupts
   1205609           -29.1%     855130 ±  2%  interrupts.CPU74.LOC:Local_timer_interrupts
   3510382 ±  9%     -67.8%    1128850 ± 12%  interrupts.CPU74.RES:Rescheduling_interrupts
   1205610           -29.1%     855095 ±  2%  interrupts.CPU75.LOC:Local_timer_interrupts
   3684382 ±  5%     -69.9%    1108322 ±  8%  interrupts.CPU75.RES:Rescheduling_interrupts
   1205626           -29.1%     855135 ±  2%  interrupts.CPU76.LOC:Local_timer_interrupts
   3424662 ±  8%     -70.0%    1026323 ±  5%  interrupts.CPU76.RES:Rescheduling_interrupts
    679078 ± 73%     -65.9%     231660 ± 18%  interrupts.CPU77.CAL:Function_call_interrupts
   1205618           -29.1%     855181 ±  2%  interrupts.CPU77.LOC:Local_timer_interrupts
   3145940 ±  8%     -66.5%    1055195 ± 12%  interrupts.CPU77.RES:Rescheduling_interrupts
   1205573           -29.1%     855322 ±  2%  interrupts.CPU78.LOC:Local_timer_interrupts
   2959807 ± 11%     -62.0%    1126121 ±  8%  interrupts.CPU78.RES:Rescheduling_interrupts
   1036604 ± 45%     -68.8%     323128 ± 30%  interrupts.CPU79.CAL:Function_call_interrupts
   1205615           -29.1%     855298 ±  2%  interrupts.CPU79.LOC:Local_timer_interrupts
   3462919 ±  7%     -69.0%    1071952 ±  7%  interrupts.CPU79.RES:Rescheduling_interrupts
   1205598           -29.1%     855153 ±  2%  interrupts.CPU8.LOC:Local_timer_interrupts
   3589350 ±  7%     -69.3%    1101811 ± 16%  interrupts.CPU8.RES:Rescheduling_interrupts
   1205586           -29.1%     855353 ±  2%  interrupts.CPU80.LOC:Local_timer_interrupts
   3502569 ±  9%     -68.1%    1118950 ±  9%  interrupts.CPU80.RES:Rescheduling_interrupts
   1205553           -29.1%     855317 ±  2%  interrupts.CPU81.LOC:Local_timer_interrupts
   3453668 ±  2%     -67.5%    1124145 ± 11%  interrupts.CPU81.RES:Rescheduling_interrupts
   1205574           -29.0%     855366 ±  2%  interrupts.CPU82.LOC:Local_timer_interrupts
   3443920 ±  9%     -68.3%    1092950 ±  5%  interrupts.CPU82.RES:Rescheduling_interrupts
   1205620           -29.1%     855340 ±  2%  interrupts.CPU83.LOC:Local_timer_interrupts
   3332776 ±  5%     -65.4%    1152593 ±  6%  interrupts.CPU83.RES:Rescheduling_interrupts
   1205595           -29.0%     855383 ±  2%  interrupts.CPU84.LOC:Local_timer_interrupts
   3298021 ± 11%     -63.9%    1191118 ± 13%  interrupts.CPU84.RES:Rescheduling_interrupts
   1205568           -29.1%     855327 ±  2%  interrupts.CPU85.LOC:Local_timer_interrupts
   3403587 ±  7%     -65.2%    1185507 ±  9%  interrupts.CPU85.RES:Rescheduling_interrupts
   1205556           -29.0%     855358 ±  2%  interrupts.CPU86.LOC:Local_timer_interrupts
   3413766 ±  6%     -65.8%    1168950 ± 11%  interrupts.CPU86.RES:Rescheduling_interrupts
   1205588           -29.1%     855254 ±  2%  interrupts.CPU87.LOC:Local_timer_interrupts
   3819022 ±  3%     -69.0%    1182764 ± 11%  interrupts.CPU87.RES:Rescheduling_interrupts
   1205634           -29.0%     855403 ±  2%  interrupts.CPU88.LOC:Local_timer_interrupts
   3554878 ±  4%     -68.0%    1135894 ±  9%  interrupts.CPU88.RES:Rescheduling_interrupts
   1205618           -29.1%     855273 ±  2%  interrupts.CPU89.LOC:Local_timer_interrupts
   3506043 ±  4%     -69.3%    1075922 ±  3%  interrupts.CPU89.RES:Rescheduling_interrupts
    637361 ± 38%     -54.9%     287418 ± 24%  interrupts.CPU9.CAL:Function_call_interrupts
   1205624           -29.1%     855173 ±  2%  interrupts.CPU9.LOC:Local_timer_interrupts
   3575063 ±  4%     -66.4%    1200524 ± 15%  interrupts.CPU9.RES:Rescheduling_interrupts
   1205711           -29.1%     855277 ±  2%  interrupts.CPU90.LOC:Local_timer_interrupts
   3540800 ±  7%     -68.4%    1118482 ±  9%  interrupts.CPU90.RES:Rescheduling_interrupts
   1205569           -29.1%     855324 ±  2%  interrupts.CPU91.LOC:Local_timer_interrupts
   3631748 ±  6%     -67.7%    1172587 ± 14%  interrupts.CPU91.RES:Rescheduling_interrupts
   1205564           -29.1%     855323 ±  2%  interrupts.CPU92.LOC:Local_timer_interrupts
   3573401 ±  6%     -66.0%    1216552 ± 13%  interrupts.CPU92.RES:Rescheduling_interrupts
   1205583           -29.1%     855337 ±  2%  interrupts.CPU93.LOC:Local_timer_interrupts
   3802054 ±  9%     -69.1%    1173720 ± 10%  interrupts.CPU93.RES:Rescheduling_interrupts
   1205561           -29.1%     855271 ±  2%  interrupts.CPU94.LOC:Local_timer_interrupts
   3658583 ± 16%     -68.8%    1140697 ±  7%  interrupts.CPU94.RES:Rescheduling_interrupts
   1205530           -29.1%     855297 ±  2%  interrupts.CPU95.LOC:Local_timer_interrupts
   3497532 ±  8%     -68.3%    1109998 ±  7%  interrupts.CPU95.RES:Rescheduling_interrupts
   1205578           -29.1%     855338 ±  2%  interrupts.CPU96.LOC:Local_timer_interrupts
   3462753 ± 11%     -66.0%    1177706 ± 11%  interrupts.CPU96.RES:Rescheduling_interrupts
   1098954 ± 63%     -69.3%     337065 ± 44%  interrupts.CPU97.CAL:Function_call_interrupts
   1205573           -29.1%     855301 ±  2%  interrupts.CPU97.LOC:Local_timer_interrupts
   3430508 ±  7%     -67.5%    1114780 ±  8%  interrupts.CPU97.RES:Rescheduling_interrupts
   1205586           -29.1%     855315 ±  2%  interrupts.CPU98.LOC:Local_timer_interrupts
   3582330 ±  6%     -68.1%    1142146 ±  9%  interrupts.CPU98.RES:Rescheduling_interrupts
   1082601 ± 43%     -65.9%     369132 ± 51%  interrupts.CPU99.CAL:Function_call_interrupts
   1205570           -29.0%     855354 ±  2%  interrupts.CPU99.LOC:Local_timer_interrupts
   3408496 ±  9%     -65.4%    1179828 ± 15%  interrupts.CPU99.RES:Rescheduling_interrupts
    506.50 ±  2%    +358.4%       2321 ± 35%  interrupts.IWI:IRQ_work_interrupts
 1.254e+08           -29.1%   88944386 ±  2%  interrupts.LOC:Local_timer_interrupts
 3.601e+08           -68.1%   1.15e+08 ±  5%  interrupts.RES:Rescheduling_interrupts
     23.71 ±  6%     -12.3       11.38 ± 15%  perf-profile.calltrace.cycles-pp.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     23.78 ±  6%     -12.3       11.46 ± 15%  perf-profile.calltrace.cycles-pp.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
     24.29 ±  6%     -10.1       14.15 ± 18%  perf-profile.calltrace.cycles-pp.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
     44.65            -8.8       35.82 ± 44%  perf-profile.calltrace.cycles-pp.__libc_read
     12.80 ±  6%      -8.8        4.03 ± 15%  perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg
     41.47            -8.1       33.38 ± 44%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_read
     41.23            -8.0       33.26 ± 44%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read
      7.15 ±  5%      -7.1        0.00        perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb
     10.39 ±  5%      -5.7        4.71 ± 16%  perf-profile.calltrace.cycles-pp.kfree.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     12.04 ±  4%      -4.3        7.71 ± 15%  perf-profile.calltrace.cycles-pp.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
     10.12 ±  7%      -3.8        6.31 ± 16%  perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb
     10.20 ±  7%      -3.8        6.41 ± 16%  perf-profile.calltrace.cycles-pp.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg
      7.54 ±  7%      -3.5        4.06 ± 15%  perf-profile.calltrace.cycles-pp.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      4.26 ±  6%      -1.8        2.49 ± 17%  perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      4.50 ±  2%      -1.8        2.72 ± 45%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read
      3.31 ±  7%      -1.3        1.98 ± 21%  perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common
      1.24 ±  3%      -0.9        0.32 ±102%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.unix_stream_read_generic
      2.40 ±  7%      -0.9        1.49 ± 27%  perf-profile.calltrace.cycles-pp.select_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function
     41.59            -0.7       40.88        perf-profile.calltrace.cycles-pp.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write
     42.10            -0.6       41.50        perf-profile.calltrace.cycles-pp.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write.ksys_write
      1.01 ±  3%      -0.5        0.47 ± 45%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read
      0.46 ± 44%      +0.2        0.65 ±  6%  perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.63 ±  4%      +0.2        0.84 ±  8%  perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.44 ± 44%      +0.3        0.73 ± 10%  perf-profile.calltrace.cycles-pp.__fget_files.__fget_light.__fdget_pos.ksys_write.do_syscall_64
      0.62 ±  2%      +0.3        0.94 ±  9%  perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor
      0.64 ±  2%      +0.3        0.97 ±  9%  perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic
      0.80 ±  2%      +0.4        1.16 ± 10%  perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic
      0.55 ±  5%      +0.4        0.92 ± 11%  perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor
      0.60 ±  7%      +0.5        1.08 ± 29%  perf-profile.calltrace.cycles-pp._raw_spin_lock.__schedule.schedule.schedule_timeout.unix_stream_read_generic
      0.46 ± 45%      +0.5        0.95 ± 15%  perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
      0.08 ±223%      +0.5        0.58 ±  5%  perf-profile.calltrace.cycles-pp.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read
      1.03 ±  2%      +0.5        1.53 ± 12%  perf-profile.calltrace.cycles-pp.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.97 ±  2%      +0.5        1.47 ± 13%  perf-profile.calltrace.cycles-pp.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic
      1.01 ±  2%      +0.5        1.52 ± 12%  perf-profile.calltrace.cycles-pp.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
      0.76 ±  4%      +0.5        1.30 ± 14%  perf-profile.calltrace.cycles-pp.sock_wfree.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb
      1.58            +0.7        2.25 ±  9%  perf-profile.calltrace.cycles-pp.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      1.54            +0.7        2.23 ±  9%  perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      1.50            +0.7        2.19 ±  9%  perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg
      0.18 ±141%      +0.7        0.88 ± 11%  perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
      0.00            +0.7        0.70 ± 12%  perf-profile.calltrace.cycles-pp.__slab_free.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.00            +0.8        0.77 ± 12%  perf-profile.calltrace.cycles-pp.__slab_free.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.00            +1.0        0.96 ± 31%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__schedule.schedule.schedule_timeout
      1.10 ±  9%      +1.0        2.14 ± 29%  perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      0.64 ± 16%      +1.3        1.93 ± 30%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common
      0.00            +1.3        1.33 ± 20%  perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.unix_stream_read_generic
      0.11 ±223%      +1.7        1.80 ± 21%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_prepare
      0.00            +1.7        1.69 ± 19%  perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg
      0.12 ±223%      +1.7        1.87 ± 22%  perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      0.00            +1.8        1.82 ± 19%  perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.00            +1.9        1.90 ± 34%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg
      0.26 ±100%      +1.9        2.21 ± 19%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb
      0.00            +2.0        2.00 ± 20%  perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb
      0.00            +2.1        2.06 ± 32%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg
      0.00            +2.1        2.14 ± 19%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
      0.00            +2.7        2.66 ± 19%  perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kfree.consume_skb
      4.48 ± 12%      +2.9        7.40 ± 20%  perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      4.38 ± 13%      +3.0        7.36 ± 20%  perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
      0.67 ± 10%      +3.3        3.94 ± 20%  perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.__kmalloc_node_track_caller.kmalloc_reserve
      0.91 ± 10%      +3.3        4.22 ± 19%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
      0.98 ±  9%      +3.3        4.32 ± 19%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags
      0.00            +3.4        3.38 ± 19%  perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kfree.consume_skb.unix_stream_read_generic
      0.00            +3.7        3.66 ± 19%  perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kfree.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
      3.65 ± 16%      +3.8        7.41 ± 16%  perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.unix_stream_read_generic
      2.40 ± 22%      +4.0        6.39 ± 20%  perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
      0.20 ±223%      +4.4        4.61 ± 16%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.schedule_timeout
      0.22 ±223%      +4.6        4.82 ± 16%  perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.schedule_timeout.unix_stream_read_generic
      1.75 ± 32%      +4.6        6.38 ± 16%  perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout
      0.94 ± 56%      +4.7        5.68 ± 20%  perf-profile.calltrace.cycles-pp.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
      0.84 ± 58%      +4.8        5.61 ± 15%  perf-profile.calltrace.cycles-pp.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      0.22 ±223%      +4.8        5.03 ± 20%  perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity
      0.22 ±223%      +4.9        5.14 ± 20%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair
      0.21 ±223%      +4.9        5.13 ± 15%  perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template
      0.21 ±223%      +5.0        5.16 ± 15%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up
      0.21 ±223%      +5.0        5.17 ± 15%  perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function
      0.91 ± 59%      +5.0        5.95 ± 16%  perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
      0.24 ±223%      +5.1        5.33 ± 20%  perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate
      0.23 ±223%      +5.1        5.32 ± 16%  perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity
      0.26 ±223%      +5.2        5.43 ± 15%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common
      0.23 ±223%      +5.2        5.45 ± 16%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair
      0.26 ±223%      +5.4        5.61 ± 16%  perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair.__schedule
      0.30 ±223%      +5.9        6.18 ± 18%  perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch
      0.30 ±223%      +5.9        6.23 ± 18%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule
      0.30 ±223%      +5.9        6.24 ± 18%  perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule.schedule
      0.00            +6.0        5.96 ± 20%  perf-profile.calltrace.cycles-pp.unwind_next_frame.__unwind_start.perf_callchain_kernel.get_perf_callchain.perf_callchain
     13.17 ± 10%      +6.5       19.67 ± 16%  perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg
     12.98 ± 10%      +6.6       19.54 ± 16%  perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg
      0.00            +6.6        6.57 ± 21%  perf-profile.calltrace.cycles-pp.unwind_next_frame.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample
     12.81 ± 10%      +6.6       19.44 ± 16%  perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable
      0.00            +7.0        6.95 ± 18%  perf-profile.calltrace.cycles-pp.__unwind_start.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample
      8.23 ± 14%      +7.2       15.44 ± 17%  perf-profile.calltrace.cycles-pp.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      8.02 ± 14%      +7.3       15.34 ± 17%  perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      7.82 ± 14%      +7.4       15.25 ± 17%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg
     13.78 ± 10%      +8.3       22.12 ± 15%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
     14.12 ± 10%      +8.6       22.67 ± 14%  perf-profile.calltrace.cycles-pp.sock_def_readable.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
      0.44 ±223%      +9.8       10.26 ± 18%  perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime
      0.44 ±223%      +9.9       10.32 ± 18%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr
      0.77 ±223%     +16.9       17.66 ± 19%  perf-profile.calltrace.cycles-pp.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward
      0.84 ±223%     +18.4       19.29 ± 18%  perf-profile.calltrace.cycles-pp.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow
      0.85 ±223%     +18.6       19.40 ± 18%  perf-profile.calltrace.cycles-pp.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow
      0.92 ±223%     +20.2       21.07 ± 18%  perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event
     23.72 ±  6%     -12.3       11.40 ± 15%  perf-profile.children.cycles-pp.__alloc_skb
     23.78 ±  6%     -12.3       11.46 ± 15%  perf-profile.children.cycles-pp.alloc_skb_with_frags
     24.29 ±  6%     -10.1       14.16 ± 18%  perf-profile.children.cycles-pp.sock_alloc_send_pskb
     10.46 ±  5%      -9.9        0.55 ±  8%  perf-profile.children.cycles-pp.get_obj_cgroup_from_current
     44.80            -8.8       35.98 ± 44%  perf-profile.children.cycles-pp.__libc_read
     12.84 ±  6%      -8.8        4.07 ± 15%  perf-profile.children.cycles-pp.kmem_cache_alloc_node
     10.40 ±  5%      -5.7        4.72 ± 16%  perf-profile.children.cycles-pp.kfree
     12.04 ±  4%      -4.3        7.71 ± 15%  perf-profile.children.cycles-pp.consume_skb
     10.17 ±  7%      -3.8        6.36 ± 16%  perf-profile.children.cycles-pp.__kmalloc_node_track_caller
     10.21 ±  7%      -3.8        6.42 ± 16%  perf-profile.children.cycles-pp.kmalloc_reserve
      3.80 ±  7%      -3.7        0.13 ± 11%  perf-profile.children.cycles-pp.refill_obj_stock
      7.56 ±  7%      -3.5        4.08 ± 15%  perf-profile.children.cycles-pp.kmem_cache_free
      3.32 ± 10%      -2.3        1.03 ± 11%  perf-profile.children.cycles-pp.mod_objcg_state
      4.28 ±  6%      -1.7        2.53 ± 17%  perf-profile.children.cycles-pp.select_task_rq_fair
     11.30 ±  3%      -1.7        9.58 ±  3%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      2.54 ±  6%      -1.4        1.12 ± 19%  perf-profile.children.cycles-pp.pick_next_task_fair
      3.33 ±  7%      -1.3        2.01 ± 21%  perf-profile.children.cycles-pp.select_idle_sibling
      2.54 ±  4%      -1.2        1.36 ± 17%  perf-profile.children.cycles-pp.update_load_avg
      2.42 ±  7%      -0.9        1.53 ± 26%  perf-profile.children.cycles-pp.select_idle_cpu
      1.13 ± 10%      -0.8        0.30 ± 22%  perf-profile.children.cycles-pp.get_mem_cgroup_from_objcg
     41.62            -0.7       40.92        perf-profile.children.cycles-pp.unix_stream_sendmsg
      1.27 ±  8%      -0.7        0.58 ± 13%  perf-profile.children.cycles-pp.switch_fpu_return
      1.24 ±  5%      -0.7        0.56 ± 21%  perf-profile.children.cycles-pp.reweight_entity
     42.10            -0.6       41.52        perf-profile.children.cycles-pp.sock_sendmsg
      1.52 ±  8%      -0.6        0.97 ± 21%  perf-profile.children.cycles-pp.available_idle_cpu
      0.82 ±  4%      -0.4        0.38 ± 20%  perf-profile.children.cycles-pp.set_next_entity
      0.84 ±  3%      -0.4        0.44 ± 16%  perf-profile.children.cycles-pp.update_rq_clock
      0.78 ±  9%      -0.4        0.38 ± 18%  perf-profile.children.cycles-pp.__switch_to_asm
      0.62 ± 10%      -0.4        0.24 ± 23%  perf-profile.children.cycles-pp.pick_next_entity
      0.66 ±  4%      -0.4        0.29 ± 22%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.72 ±  4%      -0.4        0.36 ± 18%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.63 ±  3%      -0.4        0.28 ± 23%  perf-profile.children.cycles-pp.check_preempt_curr
      0.55 ±  3%      -0.3        0.21 ± 19%  perf-profile.children.cycles-pp.__enqueue_entity
      0.60 ±  9%      -0.3        0.28 ± 13%  perf-profile.children.cycles-pp.__switch_to
      0.50 ± 11%      -0.3        0.19 ± 20%  perf-profile.children.cycles-pp.put_prev_entity
      0.65 ±  4%      -0.3        0.35 ± 16%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.47 ±  6%      -0.3        0.21 ± 23%  perf-profile.children.cycles-pp.check_preempt_wakeup
      0.40 ± 10%      -0.2        0.18 ± 21%  perf-profile.children.cycles-pp.copy_fpregs_to_fpstate
      0.35 ±  9%      -0.2        0.13 ± 18%  perf-profile.children.cycles-pp.___perf_sw_event
      0.26 ± 13%      -0.2        0.10 ± 23%  perf-profile.children.cycles-pp.clear_buddies
      0.27 ±  7%      -0.1        0.13 ± 10%  perf-profile.children.cycles-pp.update_cfs_rq_h_load
      0.26 ±  9%      -0.1        0.13 ± 19%  perf-profile.children.cycles-pp.__calc_delta
      0.30 ±  3%      -0.1        0.16 ± 19%  perf-profile.children.cycles-pp.update_min_vruntime
      0.41 ±  3%      -0.1        0.28 ± 45%  perf-profile.children.cycles-pp.__pthread_disable_asynccancel
      0.27 ±  4%      -0.1        0.14 ± 22%  perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi
      0.20 ±  3%      -0.1        0.08 ± 16%  perf-profile.children.cycles-pp.rb_erase
      0.17 ±  8%      -0.1        0.08 ± 18%  perf-profile.children.cycles-pp.__wrgsbase_inactive
      0.18 ± 11%      -0.1        0.10 ± 11%  perf-profile.children.cycles-pp.cpus_share_cache
      0.12 ±  6%      -0.1        0.04 ± 71%  perf-profile.children.cycles-pp.clockevents_program_event
      0.23 ±  4%      -0.1        0.14 ±  7%  perf-profile.children.cycles-pp.preempt_schedule_common
      0.24 ±  6%      -0.1        0.16 ± 23%  perf-profile.children.cycles-pp._find_next_bit
      0.15 ±  9%      -0.1        0.07 ± 35%  perf-profile.children.cycles-pp.set_next_buddy
      0.14 ± 10%      -0.1        0.06 ± 23%  perf-profile.children.cycles-pp.resched_curr
      0.10 ± 11%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.__cgroup_account_cputime
      0.13 ±  7%      -0.1        0.06 ± 20%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.25 ±  4%      -0.1        0.18 ± 10%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.14 ±  5%      -0.1        0.07 ± 20%  perf-profile.children.cycles-pp.rb_insert_color
      0.14 ± 14%      -0.1        0.07 ± 20%  perf-profile.children.cycles-pp.migrate_task_rq_fair
      0.41            -0.1        0.35 ±  3%  perf-profile.children.cycles-pp.__cond_resched
      0.08 ±  4%      -0.1        0.03 ±100%  perf-profile.children.cycles-pp.rb_next
      0.11 ±  4%      -0.0        0.07 ± 18%  perf-profile.children.cycles-pp.__list_add_valid
      0.10 ±  6%      -0.0        0.06 ± 17%  perf-profile.children.cycles-pp.cpumask_next
      0.10 ± 10%      -0.0        0.07 ±  9%  perf-profile.children.cycles-pp.native_irq_return_iret
      0.08 ± 16%      -0.0        0.05 ±  8%  perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
      0.09 ±  4%      -0.0        0.07 ±  5%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
      0.05            +0.0        0.07 ±  9%  perf-profile.children.cycles-pp.kmalloc_slab
      0.18 ±  3%      +0.0        0.21 ±  5%  perf-profile.children.cycles-pp.__might_fault
      0.10 ±  3%      +0.0        0.13 ±  7%  perf-profile.children.cycles-pp.apparmor_socket_getpeersec_dgram
      0.14 ±  3%      +0.0        0.18 ±  8%  perf-profile.children.cycles-pp.apparmor_file_permission
      0.02 ±142%      +0.0        0.06 ± 14%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.15 ±  4%      +0.0        0.20 ±  6%  perf-profile.children.cycles-pp.security_socket_getpeersec_dgram
      0.15 ±  6%      +0.1        0.20        perf-profile.children.cycles-pp.rcu_read_unlock_strict
      0.10 ±  3%      +0.1        0.16 ± 12%  perf-profile.children.cycles-pp.aa_file_perm
      0.00            +0.1        0.06 ± 18%  perf-profile.children.cycles-pp.perf_trace_run_bpf_submit
      0.00            +0.1        0.06 ± 16%  perf-profile.children.cycles-pp.rcu_is_watching
      0.00            +0.1        0.06 ± 16%  perf-profile.children.cycles-pp.perf_swevent_get_recursion_context
      0.36 ±  4%      +0.1        0.42 ±  4%  perf-profile.children.cycles-pp.fsnotify
      0.01 ±223%      +0.1        0.07 ± 23%  perf-profile.children.cycles-pp.tracing_gen_ctx_irq_test
      0.08 ± 20%      +0.1        0.14 ± 19%  perf-profile.children.cycles-pp.perf_trace_buf_update
      0.00            +0.1        0.07 ± 27%  perf-profile.children.cycles-pp.__module_text_address
      0.00            +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.ftrace_ops_trampoline
      0.25 ±  5%      +0.1        0.33 ± 10%  perf-profile.children.cycles-pp.__virt_addr_valid
      0.00            +0.1        0.08 ± 13%  perf-profile.children.cycles-pp.is_ftrace_trampoline
      0.08 ± 21%      +0.1        0.16 ± 11%  perf-profile.children.cycles-pp.perf_trace_buf_alloc
      0.06 ± 14%      +0.1        0.15 ± 18%  perf-profile.children.cycles-pp.refill_stock
      0.57 ±  4%      +0.1        0.66 ±  5%  perf-profile.children.cycles-pp.common_file_perm
      0.28 ± 11%      +0.1        0.37 ± 15%  perf-profile.children.cycles-pp.native_sched_clock
      0.00            +0.1        0.09 ± 23%  perf-profile.children.cycles-pp.is_module_text_address
      0.02 ±142%      +0.1        0.12 ± 22%  perf-profile.children.cycles-pp.drain_stock
      0.40 ±  5%      +0.1        0.51 ±  6%  perf-profile.children.cycles-pp.security_socket_sendmsg
      0.41 ±  3%      +0.1        0.52 ±  4%  perf-profile.children.cycles-pp.security_socket_recvmsg
      0.29            +0.1        0.40 ± 11%  perf-profile.children.cycles-pp.fput_many
      0.48 ±  3%      +0.1        0.59 ±  5%  perf-profile.children.cycles-pp.sock_recvmsg
      0.00            +0.1        0.12 ± 16%  perf-profile.children.cycles-pp.get_stack_info_noinstr
      0.31 ± 10%      +0.1        0.43 ± 15%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.25 ±  9%      +0.1        0.37 ± 11%  perf-profile.children.cycles-pp.__build_skb_around
      0.02 ±141%      +0.1        0.16 ± 18%  perf-profile.children.cycles-pp.try_charge
      0.00            +0.2        0.15 ± 16%  perf-profile.children.cycles-pp.local_clock
      0.01 ±223%      +0.2        0.16 ± 15%  perf-profile.children.cycles-pp.__is_insn_slot_addr
      0.32 ±  9%      +0.2        0.48 ± 10%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.00            +0.2        0.16 ± 14%  perf-profile.children.cycles-pp.get_callchain_entry
      0.50 ±  4%      +0.2        0.67 ±  5%  perf-profile.children.cycles-pp.aa_sk_perm
      0.11 ± 24%      +0.2        0.28 ± 30%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.00            +0.2        0.17 ± 14%  perf-profile.children.cycles-pp.perf_tp_event_match
      0.01 ±223%      +0.2        0.19 ± 11%  perf-profile.children.cycles-pp.bpf_ksym_find
      0.18 ± 10%      +0.2        0.36 ± 15%  perf-profile.children.cycles-pp.skb_release_data
      0.25 ±  5%      +0.2        0.44 ± 14%  perf-profile.children.cycles-pp.skb_unlink
      0.00            +0.2        0.19 ± 15%  perf-profile.children.cycles-pp.get_stack_info
      0.34 ±  7%      +0.2        0.54 ±  5%  perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
      0.01 ±223%      +0.2        0.21 ± 63%  perf-profile.children.cycles-pp.generic_file_write_iter
      0.01 ±223%      +0.2        0.21 ± 63%  perf-profile.children.cycles-pp.__generic_file_write_iter
      0.01 ±223%      +0.2        0.21 ± 63%  perf-profile.children.cycles-pp.generic_perform_write
      0.91 ±  4%      +0.2        1.11 ±  6%  perf-profile.children.cycles-pp.security_file_permission
      0.00            +0.2        0.21 ± 57%  perf-profile.children.cycles-pp.perf_output_copy
      0.16 ± 16%      +0.2        0.37 ± 24%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.43 ±  7%      +0.2        0.64 ± 11%  perf-profile.children.cycles-pp.skb_set_owner_w
      0.33 ± 13%      +0.2        0.55 ± 10%  perf-profile.children.cycles-pp.finish_task_switch
      0.01 ±223%      +0.2        0.25 ± 17%  perf-profile.children.cycles-pp.perf_instruction_pointer
      0.46 ±  3%      +0.3        0.71 ±  2%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.01 ±223%      +0.3        0.27 ± 12%  perf-profile.children.cycles-pp.is_bpf_text_address
      0.46 ±  3%      +0.3        0.72 ±  2%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      1.04 ±  2%      +0.3        1.31 ±  8%  perf-profile.children.cycles-pp.__fget_light
      0.51 ±  4%      +0.3        0.79 ±  2%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      0.78 ±  4%      +0.3        1.06 ± 10%  perf-profile.children.cycles-pp.__fget_files
      1.06 ±  2%      +0.3        1.34 ±  8%  perf-profile.children.cycles-pp.__fdget_pos
      0.57 ±  3%      +0.3        0.86 ±  2%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.24 ±  2%      +0.3        0.54 ± 18%  perf-profile.children.cycles-pp.unix_write_space
      0.01 ±223%      +0.3        0.31 ± 12%  perf-profile.children.cycles-pp.perf_misc_flags
      0.11 ± 12%      +0.3        0.42 ±  6%  perf-profile.children.cycles-pp.task_tick_fair
      0.23 ±  7%      +0.3        0.55 ±  4%  perf-profile.children.cycles-pp.tick_sched_timer
      0.21 ±  7%      +0.3        0.53 ±  4%  perf-profile.children.cycles-pp.update_process_times
      0.21 ±  6%      +0.3        0.54 ±  4%  perf-profile.children.cycles-pp.tick_sched_handle
      0.65            +0.3        0.97 ±  9%  perf-profile.children.cycles-pp.simple_copy_to_iter
      0.14 ±  8%      +0.3        0.47 ±  4%  perf-profile.children.cycles-pp.scheduler_tick
      0.27 ±  5%      +0.3        0.60 ±  4%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.00            +0.3        0.34 ± 58%  perf-profile.children.cycles-pp.perf_output_sample
      0.02 ±223%      +0.4        0.37 ± 11%  perf-profile.children.cycles-pp.__task_pid_nr_ns
      0.80 ±  2%      +0.4        1.16 ±  9%  perf-profile.children.cycles-pp._copy_to_iter
      0.02 ±223%      +0.4        0.38 ± 15%  perf-profile.children.cycles-pp.perf_output_begin_forward
      0.19 ± 96%      +0.4        0.56 ± 27%  perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.55 ±  5%      +0.4        0.92 ± 11%  perf-profile.children.cycles-pp.copyout
      0.20 ± 95%      +0.4        0.57 ± 27%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.14 ± 94%      +0.4        0.53 ± 28%  perf-profile.children.cycles-pp.sched_ttwu_pending
      1.05            +0.4        1.44 ±  8%  perf-profile.children.cycles-pp.__check_object_size
      0.22 ± 95%      +0.4        0.62 ± 27%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.01 ±223%      +0.4        0.40 ± 26%  perf-profile.children.cycles-pp.unfreeze_partials
      0.02 ±144%      +0.4        0.43 ± 26%  perf-profile.children.cycles-pp.put_cpu_partial
      0.02 ±223%      +0.4        0.44 ± 15%  perf-profile.children.cycles-pp.ftrace_graph_ret_addr
      0.02 ±223%      +0.4        0.45 ± 12%  perf-profile.children.cycles-pp.perf_event_pid_type
      0.02 ±223%      +0.5        0.51 ± 15%  perf-profile.children.cycles-pp.__get_user_nocheck_8
      1.03            +0.5        1.53 ± 12%  perf-profile.children.cycles-pp.skb_release_all
      0.86 ±  3%      +0.5        1.35 ± 11%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      1.00 ±  2%      +0.5        1.50 ± 13%  perf-profile.children.cycles-pp.unix_destruct_scm
      1.02 ±  2%      +0.5        1.52 ± 12%  perf-profile.children.cycles-pp.skb_release_head_state
      0.76 ±  4%      +0.5        1.30 ± 14%  perf-profile.children.cycles-pp.sock_wfree
      0.22 ± 40%      +0.6        0.78 ± 18%  perf-profile.children.cycles-pp.set_task_cpu
      0.04 ±223%      +0.6        0.66 ± 17%  perf-profile.children.cycles-pp.perf_trace_sched_migrate_task
      1.58            +0.7        2.26 ±  9%  perf-profile.children.cycles-pp.unix_stream_read_actor
      1.55            +0.7        2.23 ±  9%  perf-profile.children.cycles-pp.skb_copy_datagram_iter
      1.51            +0.7        2.20 ±  9%  perf-profile.children.cycles-pp.__skb_datagram_iter
      0.03 ±223%      +0.7        0.73 ± 14%  perf-profile.children.cycles-pp.kvm_is_in_guest
      0.06 ± 54%      +0.8        0.83 ± 22%  perf-profile.children.cycles-pp.get_partial_node
      0.04 ±223%      +0.9        0.98 ± 14%  perf-profile.children.cycles-pp.__perf_event_header__init_id
      0.04 ±223%      +1.0        1.01 ± 15%  perf-profile.children.cycles-pp.perf_callchain_user
      0.24 ± 24%      +1.0        1.22 ± 20%  perf-profile.children.cycles-pp.___slab_alloc
      0.25 ± 24%      +1.0        1.25 ± 20%  perf-profile.children.cycles-pp.__slab_alloc
      0.46 ± 11%      +1.0        1.47 ± 12%  perf-profile.children.cycles-pp.__slab_free
      0.00            +1.2        1.21 ± 53%  perf-profile.children.cycles-pp.intel_idle
      0.06 ±223%      +1.3        1.32 ± 16%  perf-profile.children.cycles-pp.kernel_text_address
      0.00            +1.3        1.28 ± 53%  perf-profile.children.cycles-pp.cpuidle_enter
      0.00            +1.3        1.28 ± 53%  perf-profile.children.cycles-pp.cpuidle_enter_state
      0.06 ±223%      +1.4        1.45 ± 18%  perf-profile.children.cycles-pp.stack_access_ok
      0.01 ±223%      +1.6        1.60 ± 54%  perf-profile.children.cycles-pp.start_secondary
      0.01 ±223%      +1.6        1.61 ± 54%  perf-profile.children.cycles-pp.do_idle
      0.01 ±223%      +1.6        1.61 ± 54%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
      0.01 ±223%      +1.6        1.61 ± 54%  perf-profile.children.cycles-pp.cpu_startup_entry
      0.08 ±223%      +1.6        1.70 ± 16%  perf-profile.children.cycles-pp.__kernel_text_address
      0.10 ±223%      +2.1        2.17 ± 17%  perf-profile.children.cycles-pp.unwind_get_return_address
      0.34 ±  9%      +2.2        2.49 ± 20%  perf-profile.children.cycles-pp.propagate_protected_usage
      0.10 ±223%      +2.2        2.30 ± 15%  perf-profile.children.cycles-pp.orc_find
      3.20 ±  4%      +3.0        6.16 ±  9%  perf-profile.children.cycles-pp._raw_spin_lock
      0.76 ±  7%      +3.3        4.03 ± 19%  perf-profile.children.cycles-pp.page_counter_cancel
      4.58 ± 12%      +3.4        7.95 ± 17%  perf-profile.children.cycles-pp.ttwu_do_activate
      1.91 ±  6%      +3.4        5.33 ± 21%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      4.48 ± 12%      +3.4        7.90 ± 17%  perf-profile.children.cycles-pp.enqueue_task_fair
      1.86 ±  8%      +3.6        5.49 ± 19%  perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
      0.16 ±223%      +3.7        3.82 ± 16%  perf-profile.children.cycles-pp.__orc_find
      3.66 ± 16%      +3.9        7.55 ± 16%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.94 ±  7%      +4.2        5.19 ± 19%  perf-profile.children.cycles-pp.page_counter_uncharge
      2.51 ± 21%      +4.4        6.86 ± 17%  perf-profile.children.cycles-pp.enqueue_entity
      1.78 ± 31%      +4.7        6.51 ± 15%  perf-profile.children.cycles-pp.dequeue_entity
      0.84 ± 58%      +4.9        5.72 ± 14%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      1.36 ±  9%      +5.0        6.37 ± 19%  perf-profile.children.cycles-pp.obj_cgroup_charge_pages
      1.06 ±  9%      +5.0        6.08 ± 20%  perf-profile.children.cycles-pp.page_counter_try_charge
      1.48 ±  8%      +5.0        6.53 ± 19%  perf-profile.children.cycles-pp.obj_cgroup_charge
      1.13 ± 16%      +6.5        7.64 ±  8%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      0.42 ±173%      +6.6        7.06 ± 16%  perf-profile.children.cycles-pp.perf_trace_sched_switch
     13.18 ± 10%      +6.8       19.97 ± 16%  perf-profile.children.cycles-pp.__wake_up_common
     13.00 ± 10%      +6.8       19.84 ± 16%  perf-profile.children.cycles-pp.autoremove_wake_function
     12.83 ± 10%      +6.9       19.75 ± 16%  perf-profile.children.cycles-pp.try_to_wake_up
      0.33 ±223%      +7.2        7.56 ± 17%  perf-profile.children.cycles-pp.__unwind_start
      8.25 ± 14%      +7.5       15.73 ± 16%  perf-profile.children.cycles-pp.schedule_timeout
     10.33 ± 15%      +8.4       18.70 ± 17%  perf-profile.children.cycles-pp.schedule
     14.13 ± 10%      +8.5       22.68 ± 14%  perf-profile.children.cycles-pp.sock_def_readable
     10.39 ± 15%      +8.6       18.98 ± 16%  perf-profile.children.cycles-pp.__schedule
     13.80 ± 10%      +8.6       22.42 ± 14%  perf-profile.children.cycles-pp.__wake_up_common_lock
      2.88 ± 38%     +10.0       12.88 ± 16%  perf-profile.children.cycles-pp.update_curr
      0.65 ±165%     +11.1       11.71 ± 16%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      0.62 ±223%     +13.8       14.40 ± 16%  perf-profile.children.cycles-pp.unwind_next_frame
      0.82 ±223%     +18.1       18.92 ± 16%  perf-profile.children.cycles-pp.perf_callchain_kernel
      0.89 ±223%     +19.5       20.42 ± 16%  perf-profile.children.cycles-pp.get_perf_callchain
      0.90 ±223%     +19.6       20.54 ± 16%  perf-profile.children.cycles-pp.perf_callchain
      0.97 ±223%     +21.4       22.35 ± 16%  perf-profile.children.cycles-pp.perf_prepare_sample
      1.00 ±223%     +22.4       23.36 ± 15%  perf-profile.children.cycles-pp.perf_event_output_forward
      1.01 ±223%     +22.5       23.48 ± 15%  perf-profile.children.cycles-pp.__perf_event_overflow
      1.01 ±223%     +22.5       23.54 ± 15%  perf-profile.children.cycles-pp.perf_swevent_overflow
      1.31 ±176%     +23.0       24.27 ± 15%  perf-profile.children.cycles-pp.perf_tp_event
     10.27 ±  5%      -9.8        0.44 ±  8%  perf-profile.self.cycles-pp.get_obj_cgroup_from_current
      6.50 ±  5%      -5.9        0.64 ±  6%  perf-profile.self.cycles-pp.kfree
      5.18 ±  8%      -4.4        0.76 ±  5%  perf-profile.self.cycles-pp.__kmalloc_node_track_caller
      4.63 ±  7%      -4.1        0.53 ±  6%  perf-profile.self.cycles-pp.kmem_cache_alloc_node
      4.44 ±  7%      -3.5        0.92 ± 10%  perf-profile.self.cycles-pp.kmem_cache_free
      3.14 ± 10%      -2.5        0.64 ±  8%  perf-profile.self.cycles-pp.mod_objcg_state
      7.51 ±  4%      -1.8        5.75 ± 11%  perf-profile.self.cycles-pp.syscall_exit_to_user_mode
      1.12 ± 10%      -0.8        0.29 ± 22%  perf-profile.self.cycles-pp.get_mem_cgroup_from_objcg
      1.26 ±  9%      -0.7        0.58 ± 14%  perf-profile.self.cycles-pp.switch_fpu_return
      1.19 ±  2%      -0.6        0.54 ± 25%  perf-profile.self.cycles-pp.update_curr
      1.40 ±  4%      -0.6        0.77 ± 15%  perf-profile.self.cycles-pp.__schedule
      1.50 ±  8%      -0.5        0.96 ± 21%  perf-profile.self.cycles-pp.available_idle_cpu
      1.07 ±  5%      -0.4        0.63 ± 19%  perf-profile.self.cycles-pp.update_load_avg
      0.78 ±  9%      -0.4        0.38 ± 17%  perf-profile.self.cycles-pp.__switch_to_asm
      0.71 ±  4%      -0.3        0.36 ± 18%  perf-profile.self.cycles-pp.__update_load_avg_se
      0.55 ±  3%      -0.3        0.21 ± 20%  perf-profile.self.cycles-pp.__enqueue_entity
      0.82 ±  7%      -0.3        0.49 ± 27%  perf-profile.self.cycles-pp.select_idle_cpu
      0.62 ±  4%      -0.3        0.32 ± 16%  perf-profile.self.cycles-pp.update_rq_clock
      0.62 ±  5%      -0.3        0.33 ± 16%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.52 ±  9%      -0.3        0.24 ± 13%  perf-profile.self.cycles-pp.__switch_to
      0.47 ±  7%      -0.3        0.20 ± 13%  perf-profile.self.cycles-pp.reweight_entity
      0.53 ±  5%      -0.3        0.27 ± 18%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.56 ±  3%      -0.2        0.31 ± 12%  perf-profile.self.cycles-pp.select_task_rq_fair
      0.42 ±  3%      -0.2        0.18 ± 22%  perf-profile.self.cycles-pp.pick_next_task_fair
      0.40 ± 11%      -0.2        0.18 ± 19%  perf-profile.self.cycles-pp.copy_fpregs_to_fpstate
      0.45 ±  5%      -0.2        0.26 ± 16%  perf-profile.self.cycles-pp.dequeue_task_fair
      0.30 ±  9%      -0.2        0.11 ± 19%  perf-profile.self.cycles-pp.___perf_sw_event
      0.42 ±  5%      -0.2        0.22 ± 18%  perf-profile.self.cycles-pp.enqueue_entity
      0.42 ±  2%      -0.2        0.23 ± 15%  perf-profile.self.cycles-pp.prepare_to_wait
      0.39 ±  6%      -0.2        0.21 ± 15%  perf-profile.self.cycles-pp.select_idle_sibling
      0.46 ±  3%      -0.2        0.30 ± 15%  perf-profile.self.cycles-pp.try_to_wake_up
      0.28 ±  8%      -0.2        0.12 ± 22%  perf-profile.self.cycles-pp.pick_next_entity
      0.23 ± 12%      -0.1        0.09 ± 23%  perf-profile.self.cycles-pp.clear_buddies
      0.40 ±  8%      -0.1        0.26 ±  6%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.26 ±  9%      -0.1        0.12 ± 20%  perf-profile.self.cycles-pp.__calc_delta
      0.30 ±  2%      -0.1        0.16 ± 18%  perf-profile.self.cycles-pp.update_min_vruntime
      0.27 ±  8%      -0.1        0.13 ± 10%  perf-profile.self.cycles-pp.update_cfs_rq_h_load
      0.39 ±  3%      -0.1        0.26 ± 45%  perf-profile.self.cycles-pp.__pthread_disable_asynccancel
      0.24 ±  5%      -0.1        0.11 ± 18%  perf-profile.self.cycles-pp.dequeue_entity
      0.22 ±  6%      -0.1        0.10 ± 13%  perf-profile.self.cycles-pp.schedule_timeout
      0.26 ±  6%      -0.1        0.15 ± 11%  perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
      0.19 ±  4%      -0.1        0.08 ± 16%  perf-profile.self.cycles-pp.rb_erase
      0.21 ±  7%      -0.1        0.10 ± 22%  perf-profile.self.cycles-pp.check_preempt_wakeup
      0.15 ±  6%      -0.1        0.05 ± 50%  perf-profile.self.cycles-pp.check_preempt_curr
      0.17 ±  4%      -0.1        0.08 ± 22%  perf-profile.self.cycles-pp.set_next_entity
      0.17 ±  8%      -0.1        0.08 ± 18%  perf-profile.self.cycles-pp.__wrgsbase_inactive
      0.42 ±  4%      -0.1        0.33 ±  5%  perf-profile.self.cycles-pp.vfs_read
      0.18 ± 11%      -0.1        0.10 ± 11%  perf-profile.self.cycles-pp.cpus_share_cache
      0.17 ±  8%      -0.1        0.08 ± 20%  perf-profile.self.cycles-pp.schedule
      0.38 ±  5%      -0.1        0.29 ± 12%  perf-profile.self.cycles-pp.cpuacct_charge
      0.14 ±  8%      -0.1        0.06 ± 33%  perf-profile.self.cycles-pp.set_next_buddy
      0.14 ±  9%      -0.1        0.06 ± 21%  perf-profile.self.cycles-pp.resched_curr
      0.19 ±  6%      -0.1        0.12 ± 16%  perf-profile.self.cycles-pp.finish_task_switch
      0.14 ±  5%      -0.1        0.07 ± 23%  perf-profile.self.cycles-pp.rb_insert_color
      0.22 ±  6%      -0.1        0.15 ± 22%  perf-profile.self.cycles-pp._find_next_bit
      0.20 ±  6%      -0.1        0.13 ± 30%  perf-profile.self.cycles-pp.cpumask_next_wrap
      0.31 ±  6%      -0.1        0.25 ±  4%  perf-profile.self.cycles-pp.new_sync_read
      0.22 ±  5%      -0.1        0.16 ±  8%  perf-profile.self.cycles-pp.__list_del_entry_valid
      0.18 ± 10%      -0.1        0.12 ±  7%  perf-profile.self.cycles-pp.__wake_up_common
      0.21 ±  6%      -0.0        0.16 ±  4%  perf-profile.self.cycles-pp.unix_destruct_scm
      0.10 ±  4%      -0.0        0.06 ± 16%  perf-profile.self.cycles-pp.__list_add_valid
      0.18 ±  4%      -0.0        0.15 ±  6%  perf-profile.self.cycles-pp.do_syscall_64
      0.18 ±  7%      -0.0        0.15 ±  5%  perf-profile.self.cycles-pp._copy_to_iter
      0.10 ± 11%      -0.0        0.07 ±  9%  perf-profile.self.cycles-pp.native_irq_return_iret
      0.13 ±  3%      +0.0        0.15 ±  5%  perf-profile.self.cycles-pp._copy_from_iter
      0.05            +0.0        0.07 ± 10%  perf-profile.self.cycles-pp.kmalloc_slab
      0.08 ±  5%      +0.0        0.10 ±  7%  perf-profile.self.cycles-pp.__cond_resched
      0.09 ± 10%      +0.0        0.12 ±  3%  perf-profile.self.cycles-pp.rcu_read_unlock_strict
      0.08 ±  4%      +0.0        0.11 ± 10%  perf-profile.self.cycles-pp.apparmor_socket_getpeersec_dgram
      0.11 ±  3%      +0.0        0.15 ± 10%  perf-profile.self.cycles-pp.obj_cgroup_charge
      0.02 ±141%      +0.0        0.06 ±  8%  perf-profile.self.cycles-pp.security_socket_recvmsg
      0.09 ±  7%      +0.0        0.13 ± 12%  perf-profile.self.cycles-pp.security_file_permission
      0.04 ± 47%      +0.0        0.09 ±  9%  perf-profile.self.cycles-pp.perf_trace_buf_alloc
      0.09            +0.0        0.14 ± 11%  perf-profile.self.cycles-pp.aa_file_perm
      0.00            +0.1        0.06 ± 20%  perf-profile.self.cycles-pp.get_stack_info_noinstr
      0.00            +0.1        0.06 ± 13%  perf-profile.self.cycles-pp.perf_trace_run_bpf_submit
      0.01 ±223%      +0.1        0.06 ± 19%  perf-profile.self.cycles-pp.perf_trace_buf_update
      0.00            +0.1        0.06 ± 19%  perf-profile.self.cycles-pp.sched_clock_cpu
      0.00            +0.1        0.06 ± 18%  perf-profile.self.cycles-pp.rcu_is_watching
      0.00            +0.1        0.06 ± 18%  perf-profile.self.cycles-pp.perf_swevent_get_recursion_context
      0.00            +0.1        0.06 ±  9%  perf-profile.self.cycles-pp.perf_swevent_overflow
      0.00            +0.1        0.06 ± 23%  perf-profile.self.cycles-pp.is_bpf_text_address
      0.34 ±  5%      +0.1        0.40 ±  4%  perf-profile.self.cycles-pp.fsnotify
      0.27 ±  7%      +0.1        0.34 ±  7%  perf-profile.self.cycles-pp.aa_sk_perm
      0.00            +0.1        0.06 ± 21%  perf-profile.self.cycles-pp.perf_instruction_pointer
      0.01 ±223%      +0.1        0.07 ± 18%  perf-profile.self.cycles-pp.tracing_gen_ctx_irq_test
      0.00            +0.1        0.06 ± 14%  perf-profile.self.cycles-pp.ftrace_ops_trampoline
      0.24 ±  5%      +0.1        0.31 ± 10%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.00            +0.1        0.08 ±  9%  perf-profile.self.cycles-pp.perf_misc_flags
      0.00            +0.1        0.08 ± 13%  perf-profile.self.cycles-pp.get_stack_info
      0.00            +0.1        0.08 ± 16%  perf-profile.self.cycles-pp.perf_event_pid_type
      0.00            +0.1        0.08 ± 14%  perf-profile.self.cycles-pp.__perf_event_overflow
      0.27 ± 10%      +0.1        0.36 ± 15%  perf-profile.self.cycles-pp.native_sched_clock
      0.30 ±  3%      +0.1        0.39 ±  8%  perf-profile.self.cycles-pp.sock_write_iter
      0.28 ±  2%      +0.1        0.38 ±  7%  perf-profile.self.cycles-pp.vfs_write
      0.28            +0.1        0.39 ± 11%  perf-profile.self.cycles-pp.fput_many
      0.00            +0.1        0.10 ± 16%  perf-profile.self.cycles-pp.__perf_event_header__init_id
      0.00            +0.1        0.11 ± 19%  perf-profile.self.cycles-pp.perf_callchain
      0.15 ± 17%      +0.1        0.26 ± 13%  perf-profile.self.cycles-pp.__build_skb_around
      0.00            +0.1        0.11 ± 23%  perf-profile.self.cycles-pp.unfreeze_partials
      0.32 ±  2%      +0.1        0.43 ±  7%  perf-profile.self.cycles-pp.__alloc_skb
      0.16 ± 15%      +0.1        0.28 ± 23%  perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime
      0.00            +0.1        0.12 ± 27%  perf-profile.self.cycles-pp.obj_cgroup_charge_pages
      0.00            +0.1        0.12 ± 24%  perf-profile.self.cycles-pp.obj_cgroup_uncharge_pages
      0.00            +0.1        0.13 ± 17%  perf-profile.self.cycles-pp.__is_insn_slot_addr
      0.00            +0.1        0.14 ± 15%  perf-profile.self.cycles-pp.local_clock
      0.10 ± 25%      +0.1        0.24 ± 18%  perf-profile.self.cycles-pp.perf_trace_sched_switch
      0.00            +0.2        0.16 ± 15%  perf-profile.self.cycles-pp.get_callchain_entry
      0.01 ±223%      +0.2        0.17 ± 20%  perf-profile.self.cycles-pp.get_partial_node
      0.11 ± 24%      +0.2        0.28 ± 31%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.00            +0.2        0.17 ± 14%  perf-profile.self.cycles-pp.perf_tp_event_match
      0.30 ±  7%      +0.2        0.47 ±  5%  perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
      0.17 ±  9%      +0.2        0.35 ± 14%  perf-profile.self.cycles-pp.skb_release_data
      0.01 ±223%      +0.2        0.19 ± 11%  perf-profile.self.cycles-pp.bpf_ksym_find
      0.22 ± 15%      +0.2        0.40 ± 13%  perf-profile.self.cycles-pp.perf_tp_event
      0.42 ±  7%      +0.2        0.63 ± 11%  perf-profile.self.cycles-pp.skb_set_owner_w
      0.33 ±  3%      +0.2        0.54 ± 12%  perf-profile.self.cycles-pp.sock_def_readable
      0.16 ± 22%      +0.2        0.38 ± 17%  perf-profile.self.cycles-pp.___slab_alloc
      0.01 ±223%      +0.2        0.24 ± 13%  perf-profile.self.cycles-pp.perf_event_output_forward
      0.50 ±  7%      +0.2        0.74 ± 12%  perf-profile.self.cycles-pp.sock_wfree
      0.76 ±  4%      +0.3        1.04 ± 10%  perf-profile.self.cycles-pp.__fget_files
      0.40 ±  4%      +0.3        0.68 ± 10%  perf-profile.self.cycles-pp.__check_object_size
      0.01 ±223%      +0.3        0.29 ± 16%  perf-profile.self.cycles-pp.perf_callchain_user
      0.01 ±223%      +0.3        0.30 ± 17%  perf-profile.self.cycles-pp.perf_prepare_sample
      0.01 ±223%      +0.3        0.33 ± 18%  perf-profile.self.cycles-pp.get_perf_callchain
      0.02 ±223%      +0.3        0.34 ± 17%  perf-profile.self.cycles-pp.__kernel_text_address
      0.02 ±223%      +0.3        0.35 ± 15%  perf-profile.self.cycles-pp.perf_output_begin_forward
      0.02 ±223%      +0.3        0.35 ± 11%  perf-profile.self.cycles-pp.__task_pid_nr_ns
      0.02 ±223%      +0.3        0.36 ± 16%  perf-profile.self.cycles-pp.ftrace_graph_ret_addr
      0.02 ±223%      +0.5        0.48 ± 17%  perf-profile.self.cycles-pp.unwind_get_return_address
      0.02 ±223%      +0.5        0.49 ± 15%  perf-profile.self.cycles-pp.__get_user_nocheck_8
      0.84 ±  3%      +0.5        1.32 ± 11%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.03 ±223%      +0.6        0.63 ± 17%  perf-profile.self.cycles-pp.kernel_text_address
      0.03 ±223%      +0.6        0.64 ± 13%  perf-profile.self.cycles-pp.kvm_is_in_guest
      0.03 ±223%      +0.7        0.72 ± 17%  perf-profile.self.cycles-pp.__unwind_start
      0.46 ± 11%      +1.0        1.45 ± 11%  perf-profile.self.cycles-pp.__slab_free
      0.00            +1.2        1.21 ± 53%  perf-profile.self.cycles-pp.intel_idle
      0.06 ±223%      +1.2        1.27 ± 17%  perf-profile.self.cycles-pp.stack_access_ok
      0.07 ±223%      +1.5        1.55 ± 16%  perf-profile.self.cycles-pp.perf_callchain_kernel
      0.09 ±223%      +2.1        2.18 ± 15%  perf-profile.self.cycles-pp.orc_find
      0.34 ±  9%      +2.1        2.46 ± 20%  perf-profile.self.cycles-pp.propagate_protected_usage
      0.76 ±  8%      +3.2        3.97 ± 19%  perf-profile.self.cycles-pp.page_counter_cancel
      0.16 ±223%      +3.6        3.81 ± 16%  perf-profile.self.cycles-pp.__orc_find
      0.89 ±  8%      +3.8        4.66 ± 19%  perf-profile.self.cycles-pp.page_counter_try_charge
      0.29 ±223%      +6.4        6.64 ± 17%  perf-profile.self.cycles-pp.unwind_next_frame
      1.12 ± 17%      +6.5        7.63 ±  8%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath


                                                                                
                                hackbench.throughput                            
                                                                                
  120000 +------------------------------------------------------------------+   
         |OOOOOOOOOOOOOOOO O OO OOO OOOOOOOOO OOOOO O  O  O  O   O         O|   
  100000 |-+              O    O                                            |   
         |                                                                  |   
         |                                        ++++++                    |   
   80000 |-+                                      :                         |   
         |                                +++++  :                          |   
   60000 |+++ +++++++++++       ++++ ++++ :+   +++                          |   
         |   +      +    +++++++    +    +                                  |   
   40000 |-+                                                                |   
         |                                                                  |   
         |                                                                  |   
   20000 |-+                                                                |   
         |                                                                  |   
       0 +------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                       hackbench.time.voluntary_context_switches                
                                                                                
    4e+09 +-----------------------------------------------------------------+   
          |                                         +                       |   
  3.5e+09 |++   + +    +          +   +     ++++  ++ +++                    |   
    3e+09 |-++++ ++++++ ++++++++++ +++ +++++    ++                          |   
          |                                                                 |   
  2.5e+09 |-+                                                               |   
          |                                                                 |   
    2e+09 |-+                                                               |   
          |                                                                 |   
  1.5e+09 |-+                                                         O     |   
    1e+09 |-+                                            O  O  OO  OO       |   
          |              O   OOO  O  OO OO O  O O   O  OO  O  O  O  OO OOOO |   
    5e+08 |OOOOOOOOOOOOOO OOO   OO OO  O  O OO O OOO      O  O    O        O|   
          |                                                                 |   
        0 +-----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                      hackbench.time.involuntary_context_switches               
                                                                                
  2.5e+09 +-----------------------------------------------------------------+   
          |                                  +     + +++                    |   
          |+    + +    +   +   ++ +   +     + ++  +                         |   
    2e+09 |-++ + ++++ + ++ :+++  + + + ++ ++    ++                          |   
          |   +      +    +         +    +                                  |   
          |                                                                 |   
  1.5e+09 |-+                                                               |   
          |                                                                 |   
    1e+09 |-+                                                               |   
          |                                                                 |   
          |                                                         O O     |   
    5e+08 |-+                                            O  O  OO  O        |   
          |              O O OOO  O  OO OO O  O O   O  OO  O  O  O  OO OOOO |   
          |OOOOOOOOOOOOOO O O   OO OO  O  O OO O OOO      O  O    O        O|   
        0 +-----------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample

***************************************************************************************************
lkp-csl-2sp4: 96 threads 2 sockets Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/ipc/iterations/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode:
  gcc-9/performance/socket/8/x86_64-rhel-8.3/process/1600%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp4/hackbench/0x4003006

commit: 
  68ac5b3c8d ("mm/memcg: cache vmstat data in percpu memcg_stock_pcp")
  5387c90490 ("mm/memcg: improve refill_obj_stock() performance")

68ac5b3c8db2fda0 5387c90490f7f42df3209154ca9 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     88731 ±  2%     +51.9%     134791        hackbench.throughput
      1198 ±  2%     -29.4%     846.30        hackbench.time.elapsed_time
      1198 ±  2%     -29.4%     846.30        hackbench.time.elapsed_time.max
 3.018e+08 ± 19%     -80.7%   58143527 ±  4%  hackbench.time.involuntary_context_switches
      8720            -3.9%       8384        hackbench.time.percent_of_cpu_this_job_got
    103040 ±  2%     -32.3%      69790        hackbench.time.system_time
      1444 ±  3%     -19.0%       1169        hackbench.time.user_time
  6.95e+08 ±  9%     -47.3%  3.664e+08        hackbench.time.voluntary_context_switches
      1235 ±  2%     -28.5%     883.79        uptime.boot
  3.53e+08 ±  3%      +5.9%  3.739e+08 ±  4%  cpuidle.C1.time
  11398249 ±  7%     +20.0%   13679143 ± 13%  cpuidle.C1.usage
   4054497 ±  7%     +31.0%    5312525 ± 21%  numa-numastat.node1.local_node
   4091772 ±  7%     +30.1%    5321980 ± 21%  numa-numastat.node1.numa_hit
   2127053           +14.6%    2438337 ± 12%  meminfo.Inactive
   2126906           +14.6%    2438190 ± 12%  meminfo.Inactive(anon)
     48105 ± 13%    +517.3%     296955 ± 81%  meminfo.Mapped
      9.59            +5.6       15.23 ± 12%  mpstat.cpu.all.idle%
      0.00 ± 21%      +0.0        0.00 ± 14%  mpstat.cpu.all.iowait%
      1.25            +0.2        1.45        mpstat.cpu.all.usr%
      6676 ±  3%     -27.5%       4838 ±  5%  vmstat.procs.r
    876931 ± 10%     -35.4%     566878        vmstat.system.cs
    198694 ± 15%      +8.1%     214875        vmstat.system.in
      7497 ± 35%    +100.0%      14992 ± 22%  numa-vmstat.node0.nr_mapped
     22560 ± 44%    +449.2%     123907 ± 51%  numa-vmstat.node1.nr_inactive_anon
    363.67 ±  9%     +43.3%     521.00 ±  7%  numa-vmstat.node1.nr_page_table_pages
     93398 ±  6%     -30.7%      64683 ±  7%  numa-vmstat.node1.nr_slab_unreclaimable
     22560 ± 44%    +449.2%     123907 ± 51%  numa-vmstat.node1.nr_zone_inactive_anon
    527933           +15.7%     610634 ± 12%  proc-vmstat.nr_inactive_anon
     12053 ±  8%    +533.6%      76375 ± 81%  proc-vmstat.nr_mapped
    712630            -7.3%     660684        proc-vmstat.nr_slab_unreclaimable
    527933           +15.7%     610634 ± 12%  proc-vmstat.nr_zone_inactive_anon
    185313 ± 21%     +79.2%     332164 ± 41%  proc-vmstat.numa_pte_updates
    961071            -3.3%     929685        proc-vmstat.pgreuse
  11391736 ±  7%     +20.1%   13679615 ± 13%  turbostat.C1
      0.31 ±  4%      +0.2        0.46 ±  4%  turbostat.C1%
      8.10 ±  3%     +39.8%      11.33 ±  2%  turbostat.CPU%c1
     75.83 ±  2%      +4.2%      79.00        turbostat.PkgTmp
    274.06            +4.4%     286.20        turbostat.PkgWatt
     71.28           +14.8%      81.85        turbostat.RAMWatt
     29763 ± 35%     +94.1%      57779 ± 22%  numa-meminfo.node0.Mapped
    213202 ± 25%     +86.4%     397378 ± 18%  numa-meminfo.node1.AnonPages.max
     90610 ± 42%    +434.9%     484697 ± 50%  numa-meminfo.node1.Inactive
     90610 ± 42%    +434.9%     484697 ± 50%  numa-meminfo.node1.Inactive(anon)
      1462 ± 10%     +41.8%       2073 ±  8%  numa-meminfo.node1.PageTables
    424993 ±  5%     -32.9%     285287 ±  6%  numa-meminfo.node1.SUnreclaim
    503312 ±  7%     -28.1%     361751 ±  5%  numa-meminfo.node1.Slab
      2069 ±  7%     +19.2%       2467 ± 10%  slabinfo.dmaengine-unmap-16.active_objs
      2069 ±  7%     +19.2%       2467 ± 10%  slabinfo.dmaengine-unmap-16.num_objs
     67777 ±  3%     -19.8%      54363 ±  2%  slabinfo.kmalloc-256.active_objs
      4029 ±  3%     -20.4%       3206 ±  8%  slabinfo.kmalloc-256.active_slabs
    128973 ±  3%     -20.4%     102611 ±  8%  slabinfo.kmalloc-256.num_objs
      4029 ±  3%     -20.4%       3206 ±  8%  slabinfo.kmalloc-256.num_slabs
    305469 ±  3%     -18.8%     248152 ±  2%  slabinfo.kmalloc-512.active_objs
     23018 ±  4%     -27.0%      16815 ±  4%  slabinfo.kmalloc-512.active_slabs
    736603 ±  4%     -26.9%     538104 ±  4%  slabinfo.kmalloc-512.num_objs
     23018 ±  4%     -27.0%      16815 ±  4%  slabinfo.kmalloc-512.num_slabs
     57170 ±  6%      +9.9%      62827 ±  6%  slabinfo.proc_inode_cache.active_objs
    213837 ±  4%     -30.0%     149771 ±  4%  slabinfo.skbuff_head_cache.active_objs
     20252 ±  4%     -31.3%      13913 ±  5%  slabinfo.skbuff_head_cache.active_slabs
    648092 ±  4%     -31.3%     445250 ±  5%  slabinfo.skbuff_head_cache.num_objs
     20252 ±  4%     -31.3%      13913 ±  5%  slabinfo.skbuff_head_cache.num_slabs
      9.09 ±  2%      +5.1%       9.55 ±  4%  perf-stat.i.MPKI
 7.058e+09 ±  2%     +14.1%  8.056e+09 ±  2%  perf-stat.i.branch-instructions
  42700294 ±  2%      +9.6%   46778564 ±  5%  perf-stat.i.branch-misses
  1.42e+08 ±  3%     +27.3%  1.806e+08        perf-stat.i.cache-misses
 3.069e+08 ±  3%     +21.1%  3.716e+08 ±  4%  perf-stat.i.cache-references
    790961 ±  7%     -15.5%     668663 ±  3%  perf-stat.i.context-switches
      6.83            -6.3%       6.40        perf-stat.i.cpi
 2.103e+11            -7.0%  1.957e+11        perf-stat.i.cpu-cycles
     43342 ±  3%     +16.5%      50479 ±  5%  perf-stat.i.cpu-migrations
 9.593e+09 ±  2%     +15.9%  1.112e+10 ±  3%  perf-stat.i.dTLB-loads
 5.023e+09 ±  2%     +17.0%  5.875e+09 ±  3%  perf-stat.i.dTLB-stores
     60.11            -2.0       58.09        perf-stat.i.iTLB-load-miss-rate%
  22838344 ±  3%     +12.7%   25735632 ±  5%  perf-stat.i.iTLB-load-misses
   6214874 ±  5%     -14.4%    5317074 ±  3%  perf-stat.i.iTLB-loads
 3.441e+10 ±  2%     +15.0%  3.957e+10 ±  3%  perf-stat.i.instructions
      3456 ±  3%      +9.2%       3776        perf-stat.i.instructions-per-iTLB-miss
      0.19           +14.6%       0.22        perf-stat.i.ipc
    826.53 ± 11%     +25.0%       1033 ± 11%  perf-stat.i.major-faults
      2.15            -7.4%       1.99        perf-stat.i.metric.GHz
    932.12 ±  2%     +16.5%       1086        perf-stat.i.metric.K/sec
    226.32 ±  2%     +14.6%     259.45 ±  3%  perf-stat.i.metric.M/sec
     45074 ±  2%     +16.6%      52551 ±  2%  perf-stat.i.minor-faults
  17095614 ±  2%     +16.8%   19974228 ±  2%  perf-stat.i.node-load-misses
  25241388 ±  4%     +25.9%   31770755 ±  2%  perf-stat.i.node-loads
   8040076 ±  3%      +5.4%    8478188        perf-stat.i.node-store-misses
  25780743 ±  3%     +23.9%   31948210        perf-stat.i.node-stores
     45900 ±  2%     +16.7%      53584        perf-stat.i.page-faults
      8.96 ±  2%      +4.2%       9.34        perf-stat.overall.MPKI
      0.63            -0.0        0.59        perf-stat.overall.branch-miss-rate%
     51.11 ±  2%      +4.3       55.39        perf-stat.overall.cache-miss-rate%
      5.55           -26.5%       4.08        perf-stat.overall.cpi
      1212 ±  3%     -34.9%     789.00        perf-stat.overall.cycles-between-cache-misses
     84.57            +6.9       91.44        perf-stat.overall.iTLB-load-miss-rate%
      1308            +1.8%       1332        perf-stat.overall.instructions-per-iTLB-miss
      0.18           +36.0%       0.25        perf-stat.overall.ipc
     32.99            -1.6       31.38        perf-stat.overall.node-load-miss-rate%
     18.38            -3.7       14.73 ±  2%  perf-stat.overall.node-store-miss-rate%
 9.668e+09           +29.8%  1.255e+10        perf-stat.ps.branch-instructions
  61121486 ±  2%     +20.2%   73498533        perf-stat.ps.branch-misses
 2.236e+08 ±  3%     +47.8%  3.304e+08        perf-stat.ps.cache-misses
 4.376e+08 ±  3%     +36.3%  5.967e+08        perf-stat.ps.cache-references
    868230 ± 10%     -35.4%     560685        perf-stat.ps.context-switches
 2.708e+11            -3.7%  2.607e+11        perf-stat.ps.cpu-cycles
     22081 ±  3%     +19.4%      26354 ±  6%  perf-stat.ps.cpu-migrations
 1.389e+10           +31.7%  1.829e+10        perf-stat.ps.dTLB-loads
 8.253e+09           +32.3%  1.092e+10        perf-stat.ps.dTLB-stores
  37312739           +28.5%   47963236        perf-stat.ps.iTLB-load-misses
   6820471 ± 10%     -34.2%    4490884        perf-stat.ps.iTLB-loads
 4.881e+10           +30.9%  6.388e+10        perf-stat.ps.instructions
    238.96 ±  9%     +51.7%     362.46 ±  9%  perf-stat.ps.major-faults
     16479 ±  2%     +40.7%      23188        perf-stat.ps.minor-faults
  19674114 ±  2%     +33.9%   26336370        perf-stat.ps.node-load-misses
  39977675 ±  3%     +44.1%   57598395        perf-stat.ps.node-loads
  10261782 ±  3%     +10.2%   11306322 ±  2%  perf-stat.ps.node-store-misses
  45563654 ±  2%     +43.6%   65439023        perf-stat.ps.node-stores
     16718 ±  2%     +40.9%      23550        perf-stat.ps.page-faults
 5.849e+13            -7.5%   5.41e+13        perf-stat.total.instructions
     74.65 ±174%     -95.2%       3.62 ± 10%  perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
      6.38 ± 37%     -90.1%       0.63 ± 10%  perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.82 ±205%    +700.9%      22.58 ± 99%  perf-sched.sch_delay.avg.ms.pipe_read.new_sync_read.vfs_read.ksys_read
     61.66 ± 55%     -94.4%       3.45 ±  9%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
     55.16 ±190%     -94.3%       3.14 ±  6%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg
     61.35 ±130%     -97.5%       1.51 ± 18%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
      0.00 ±223%  +1.7e+05%       4.82 ± 48%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.switch_task_namespaces.do_exit.do_group_exit
      0.05 ±182%   +5386.3%       2.80 ± 94%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.03 ±223%    +655.6%       0.24 ± 82%  perf-sched.sch_delay.avg.ms.preempt_schedule_common.__cond_resched.unmap_page_range.unmap_vmas.exit_mmap
    642.60 ±104%    -100.0%       0.01        perf-sched.sch_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
     81.46 ± 26%     -78.6%      17.43 ±  2%  perf-sched.sch_delay.avg.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     30.24 ± 14%     -90.8%       2.78 ± 34%  perf-sched.sch_delay.avg.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.00 ±223%    +800.0%       0.00 ± 33%  perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
      3.97 ±159%   +5369.6%     216.94 ± 96%  perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown]
     51249 ± 10%     -87.2%       6550 ± 19%  perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
     48.63 ±215%   +6430.7%       3175 ± 99%  perf-sched.sch_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
     47502 ±  9%     -95.6%       2108 ± 97%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
     16.80 ± 58%    +112.8%      35.76 ± 38%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.remove_vma.exit_mmap.mmput
    336.46 ±141%    +532.8%       2129 ± 85%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.shrink_dentry_list.shrink_dcache_parent.d_invalidate
      0.00 ±223%  +2.6e+05%       7.32 ±  2%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.switch_task_namespaces.do_exit.do_group_exit
      0.44 ±207%   +2924.7%      13.35 ± 74%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.03 ±223%  +12398.4%       3.94 ± 95%  perf-sched.sch_delay.max.ms.preempt_schedule_common.__cond_resched.unmap_page_range.unmap_vmas.exit_mmap
     10700 ±146%    -100.0%       0.01 ± 10%  perf-sched.sch_delay.max.ms.rcu_gp_kthread.kthread.ret_from_fork
     50088 ± 11%     -87.1%       6447 ± 18%  perf-sched.sch_delay.max.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     51831 ± 10%     -86.9%       6804 ± 23%  perf-sched.sch_delay.max.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.03 ± 74%  +1.2e+06%     351.38 ± 99%  perf-sched.sch_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork
      0.00 ±223%   +2750.0%       0.01 ± 78%  perf-sched.sch_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open.isra
     28.77 ±  9%     -88.0%       3.44 ± 33%  perf-sched.total_sch_delay.average.ms
     51831 ± 10%     -84.6%       7979 ±  5%  perf-sched.total_sch_delay.max.ms
    500.44 ± 30%     -91.7%      41.45 ± 10%  perf-sched.total_wait_and_delay.average.ms
    103802 ± 10%     -86.6%      13886 ± 24%  perf-sched.total_wait_and_delay.max.ms
    471.67 ± 31%     -91.9%      38.01 ±  8%  perf-sched.total_wait_time.average.ms
     52524 ±  9%     -82.2%       9330 ±  6%  perf-sched.total_wait_time.max.ms
      7243 ± 40%     -97.3%     193.02 ± 10%  perf-sched.wait_and_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      2463 ± 45%     -95.0%     122.45 ±100%  perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
    151.19 ± 35%     -91.5%      12.91 ±  7%  perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2134 ± 40%     -96.1%      82.24 ± 36%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
      2717 ± 24%     -95.6%     120.86 ± 27%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg
      1830 ± 34%     -91.8%     150.13 ± 59%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
      2670 ± 45%     -95.3%     126.44 ± 32%  perf-sched.wait_and_delay.avg.ms.preempt_schedule_common.__cond_resched.wait_for_unix_gc.unix_stream_sendmsg.sock_sendmsg
      1984 ± 34%     -90.7%     184.87 ± 44%  perf-sched.wait_and_delay.avg.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
    427.53 ± 25%     -91.7%      35.57 ± 21%  perf-sched.wait_and_delay.avg.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      6459 ± 47%     -88.3%     756.04 ± 75%  perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
      2610 ± 30%     -94.7%     137.44 ± 67%  perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork
    958.17 ± 53%    +977.9%      10328 ± 77%  perf-sched.wait_and_delay.count.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      3.50 ±147%   +5057.1%     180.50 ± 90%  perf-sched.wait_and_delay.count.pipe_read.new_sync_read.vfs_read.ksys_read
     41.50 ±148%   +1483.1%     657.00 ± 82%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_recvmsg.sock_recvmsg
    192.83 ± 32%    +612.3%       1373 ± 82%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
     83.00 ± 20%    +336.7%     362.50 ± 74%  perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.wait_for_unix_gc.unix_stream_sendmsg.sock_sendmsg
      0.83 ±223%    +980.0%       9.00 ± 33%  perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
      1076 ± 47%    +884.3%      10591 ± 77%  perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork
     76448 ± 32%     -87.9%       9266 ±  2%  perf-sched.wait_and_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
     52597 ± 37%     -93.8%       3243 ±100%  perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
    101251 ± 11%     -86.7%      13467 ± 21%  perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
     94618 ± 10%     -91.5%       8053 ±  2%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
     51519 ± 10%     -86.1%       7183 ± 13%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg
     53886 ± 30%     -86.8%       7106 ± 21%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
     49146 ± 11%     -87.2%       6274 ± 22%  perf-sched.wait_and_delay.max.ms.preempt_schedule_common.__cond_resched.wait_for_unix_gc.unix_stream_sendmsg.sock_sendmsg
     99599 ± 10%     -87.2%      12761 ± 20%  perf-sched.wait_and_delay.max.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
    103736 ± 10%     -86.7%      13844 ± 24%  perf-sched.wait_and_delay.max.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     51474 ± 11%     -81.9%       9330 ±  6%  perf-sched.wait_and_delay.max.ms.smpboot_thread_fn.kthread.ret_from_fork
     69804 ± 26%     -87.4%       8767 ±  5%  perf-sched.wait_and_delay.max.ms.worker_thread.kthread.ret_from_fork
      7024 ± 40%     -97.3%     188.98 ± 11%  perf-sched.wait_time.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      2388 ± 42%     -94.1%     140.98 ± 70%  perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
    144.81 ± 35%     -91.5%      12.28 ±  7%  perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.89 ±152%   +2800.1%     112.68 ± 99%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__alloc_pages.alloc_pages_vma.shmem_alloc_page
      2072 ± 41%     -96.2%      78.80 ± 37%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
      2661 ± 27%     -95.6%     117.73 ± 27%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg
      0.05 ± 94%    +586.5%       0.37 ± 89%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.dput.__fput.task_work_run
      0.04 ±150%  +2.9e+05%     122.78 ± 93%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.dput.path_put.free_fs_struct
      0.00 ±223%  +1.7e+05%       4.66 ± 59%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.exit_signals.do_exit.do_group_exit
      1768 ± 34%     -91.6%     148.62 ± 60%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
      0.00 ±223%  +8.1e+06%     162.30 ± 99%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.mmput.do_exit.do_group_exit
      0.21 ±186%   +5716.7%      12.26 ± 77%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.unmap_page_range.unmap_vmas.exit_mmap
    431.11 ± 37%     -96.3%      15.87 ± 56%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
      2662 ± 45%     -95.3%     124.57 ± 32%  perf-sched.wait_time.avg.ms.preempt_schedule_common.__cond_resched.wait_for_unix_gc.unix_stream_sendmsg.sock_sendmsg
    917.87 ± 80%     -99.7%       2.66 ± 12%  perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
    612.52 ± 78%     -94.2%      35.51 ± 73%  perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
      1902 ± 35%     -91.2%     167.44 ± 48%  perf-sched.wait_time.avg.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
    397.28 ± 27%     -91.7%      32.78 ± 20%  perf-sched.wait_time.avg.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      6459 ± 47%     -88.3%     755.56 ± 75%  perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
      2571 ± 31%     -94.7%     137.15 ± 67%  perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork
     51872 ± 10%     -85.0%       7779 ± 16%  perf-sched.wait_time.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
     44962 ± 16%     -92.0%       3613 ± 79%  perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
     52368 ±  9%     -84.8%       7967 ± 15%  perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      5.17 ±141%   +4384.5%     232.00 ± 93%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__alloc_pages.alloc_pages_vma.shmem_alloc_page
     52181 ±  9%     -86.2%       7196 ± 14%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
     51516 ± 10%     -86.1%       7179 ± 13%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.aa_sk_perm.security_socket_sendmsg.sock_sendmsg
      0.24 ±121%   +7956.8%      18.95 ± 99%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.dput.__fput.task_work_run
      0.10 ±173%  +2.3e+06%       2173 ± 98%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.dput.path_put.free_fs_struct
      0.00 ±223%  +5.2e+05%      13.99 ±  5%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.exit_signals.do_exit.do_group_exit
     49218 ± 14%     -85.6%       7106 ± 21%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
      0.00 ±223%  +2.7e+07%     530.74 ± 99%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.mmput.do_exit.do_group_exit
      0.23 ±171%  +1.9e+05%     438.66 ± 96%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.unmap_page_range.unmap_vmas.exit_mmap
     29872 ± 46%     -91.4%       2563 ± 93%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_completion.affine_move_task.__set_cpus_allowed_ptr
     49135 ± 11%     -87.2%       6274 ± 22%  perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.wait_for_unix_gc.unix_stream_sendmsg.sock_sendmsg
     14166 ±110%    -100.0%       3.50 ± 14%  perf-sched.wait_time.max.ms.rcu_gp_kthread.kthread.ret_from_fork
     52040 ± 10%     -84.8%       7888 ± 16%  perf-sched.wait_time.max.ms.schedule_timeout.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     52228 ±  9%     -84.9%       7898 ± 16%  perf-sched.wait_time.max.ms.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     51474 ± 11%     -81.9%       9330 ±  6%  perf-sched.wait_time.max.ms.smpboot_thread_fn.kthread.ret_from_fork
     51558 ± 10%     -86.2%       7136 ± 30%  perf-sched.wait_time.max.ms.worker_thread.kthread.ret_from_fork
     90666 ± 10%     -42.1%      52520        softirqs.CPU0.RCU
     51463 ±  3%      -7.9%      47422        softirqs.CPU0.SCHED
     90265 ±  7%     -40.6%      53641        softirqs.CPU1.RCU
     89635 ± 14%     -41.2%      52698        softirqs.CPU10.RCU
     48032 ±  4%      -8.3%      44041        softirqs.CPU10.SCHED
     91634 ± 11%     -42.0%      53161        softirqs.CPU11.RCU
     47798 ±  4%      -7.7%      44097        softirqs.CPU11.SCHED
     90853 ± 11%     -42.3%      52394        softirqs.CPU12.RCU
     90341 ± 11%     -42.4%      52071        softirqs.CPU13.RCU
     90927 ± 11%     -46.8%      48391 ±  9%  softirqs.CPU14.RCU
     90667 ± 11%     -42.9%      51795        softirqs.CPU15.RCU
     99573 ± 12%     -42.6%      57185 ±  3%  softirqs.CPU16.RCU
     97966 ± 13%     -41.4%      57371 ±  3%  softirqs.CPU17.RCU
    101014 ± 12%     -42.0%      58586 ±  4%  softirqs.CPU18.RCU
    100440 ± 11%     -42.3%      57965 ±  3%  softirqs.CPU19.RCU
     90949 ± 11%     -41.8%      52957        softirqs.CPU2.RCU
    100584 ± 11%     -42.0%      58364 ±  3%  softirqs.CPU20.RCU
    100354 ± 11%     -40.1%      60121        softirqs.CPU21.RCU
     99481 ± 11%     -42.4%      57252 ±  3%  softirqs.CPU22.RCU
     99254 ± 11%     -41.9%      57620 ±  3%  softirqs.CPU23.RCU
     97263 ± 11%     -40.7%      57647 ±  2%  softirqs.CPU24.RCU
     96476 ± 12%     -41.0%      56898 ±  2%  softirqs.CPU25.RCU
     96395 ± 11%     -41.1%      56742        softirqs.CPU26.RCU
     94372 ± 13%     -39.9%      56724 ±  2%  softirqs.CPU27.RCU
     95926 ± 12%     -39.6%      57921        softirqs.CPU28.RCU
     95279 ± 12%     -39.8%      57381        softirqs.CPU29.RCU
     90706 ± 11%     -41.9%      52660        softirqs.CPU3.RCU
     48176 ±  4%      -7.3%      44642        softirqs.CPU3.SCHED
     94335 ± 10%     -39.6%      57009 ±  2%  softirqs.CPU30.RCU
     96239 ± 12%     -40.8%      56966 ±  2%  softirqs.CPU31.RCU
     90870 ± 12%     -41.4%      53255 ±  5%  softirqs.CPU32.RCU
     90844 ± 12%     -41.5%      53125 ±  5%  softirqs.CPU33.RCU
     90742 ± 12%     -41.6%      52956 ±  6%  softirqs.CPU34.RCU
     44647 ±  3%      -8.2%      40988        softirqs.CPU34.SCHED
     90796 ± 12%     -37.3%      56933 ± 11%  softirqs.CPU35.RCU
     44182 ±  3%      -8.9%      40263        softirqs.CPU35.SCHED
     91525 ± 12%     -45.6%      49821 ± 13%  softirqs.CPU36.RCU
     91537 ± 12%     -41.4%      53607 ±  5%  softirqs.CPU37.RCU
     90960 ± 11%     -41.2%      53490 ±  5%  softirqs.CPU38.RCU
     90620 ± 12%     -41.5%      53040 ±  5%  softirqs.CPU39.RCU
     91567 ± 10%     -42.2%      52904        softirqs.CPU4.RCU
     90523 ± 11%     -40.3%      54022 ±  5%  softirqs.CPU40.RCU
     90743 ± 12%     -40.8%      53759 ±  5%  softirqs.CPU41.RCU
     91862 ± 12%     -40.0%      55081 ±  5%  softirqs.CPU42.RCU
     91010 ± 12%     -41.5%      53199 ±  5%  softirqs.CPU43.RCU
     91228 ± 11%     -41.0%      53796 ±  5%  softirqs.CPU44.RCU
     90426 ± 12%     -41.3%      53111 ±  6%  softirqs.CPU45.RCU
     90685 ± 11%     -41.6%      52997 ±  5%  softirqs.CPU46.RCU
     90912 ± 12%     -41.6%      53098 ±  6%  softirqs.CPU47.RCU
     91490 ± 12%     -41.9%      53170        softirqs.CPU48.RCU
     89350 ±  8%     -40.1%      53536        softirqs.CPU49.RCU
     92261 ± 11%     -42.9%      52639        softirqs.CPU5.RCU
     48355 ±  4%      -8.7%      44172        softirqs.CPU5.SCHED
     90939 ± 11%     -42.8%      51994        softirqs.CPU50.RCU
     48293 ±  4%      -8.5%      44180        softirqs.CPU50.SCHED
     91370 ± 11%     -41.9%      53087        softirqs.CPU51.RCU
     92263 ± 12%     -42.2%      53351 ±  2%  softirqs.CPU52.RCU
     48457 ±  4%      -9.3%      43929        softirqs.CPU52.SCHED
     91577 ± 11%     -42.3%      52806 ±  2%  softirqs.CPU53.RCU
     92103 ± 11%     -42.4%      53037 ±  2%  softirqs.CPU54.RCU
     91884 ± 11%     -42.2%      53116 ±  2%  softirqs.CPU55.RCU
     90404 ± 11%     -42.8%      51732 ±  2%  softirqs.CPU56.RCU
     48444 ±  4%      -7.1%      44985        softirqs.CPU56.SCHED
     91686 ± 13%     -41.9%      53236        softirqs.CPU57.RCU
     48647 ±  4%      -7.6%      44927        softirqs.CPU57.SCHED
     90029 ± 14%     -41.0%      53128        softirqs.CPU58.RCU
     92244 ± 11%     -42.4%      53153 ±  2%  softirqs.CPU59.RCU
     90959 ± 12%     -42.6%      52202        softirqs.CPU6.RCU
     92044 ± 11%     -42.6%      52791 ±  2%  softirqs.CPU60.RCU
     91630 ± 11%     -42.0%      53171        softirqs.CPU61.RCU
     48620 ±  4%      -7.2%      45114        softirqs.CPU61.SCHED
     90861 ± 11%     -46.0%      49068 ±  4%  softirqs.CPU62.RCU
     48682 ±  4%      -7.6%      44962        softirqs.CPU62.SCHED
     91707 ± 11%     -42.4%      52788        softirqs.CPU63.RCU
    100669 ± 11%     -41.9%      58458 ±  3%  softirqs.CPU64.RCU
     97372 ± 14%     -40.2%      58204 ±  4%  softirqs.CPU65.RCU
    102174 ± 10%     -39.2%      62079 ±  8%  softirqs.CPU66.RCU
    101076 ± 11%     -41.3%      59348 ±  4%  softirqs.CPU67.RCU
     49027 ±  5%      -8.4%      44896        softirqs.CPU67.SCHED
    101268 ± 10%     -41.7%      59004 ±  3%  softirqs.CPU68.RCU
     48450 ±  4%      -7.5%      44815        softirqs.CPU68.SCHED
    102974 ± 12%     -40.9%      60814        softirqs.CPU69.RCU
     92197 ± 10%     -42.8%      52778        softirqs.CPU7.RCU
     48087 ±  5%      -9.5%      43505        softirqs.CPU7.SCHED
     99972 ± 11%     -42.1%      57915 ±  3%  softirqs.CPU70.RCU
    100098 ± 11%     -41.4%      58704 ±  3%  softirqs.CPU71.RCU
     97160 ± 11%     -40.6%      57754 ±  2%  softirqs.CPU72.RCU
     96268 ± 12%     -40.2%      57598        softirqs.CPU73.RCU
     96164 ± 11%     -40.6%      57137        softirqs.CPU74.RCU
     94295 ± 13%     -39.2%      57325 ±  2%  softirqs.CPU75.RCU
     95673 ± 11%     -40.3%      57103 ±  2%  softirqs.CPU76.RCU
     94985 ± 11%     -38.7%      58209 ±  4%  softirqs.CPU77.RCU
     94691 ±  9%     -39.5%      57304 ±  2%  softirqs.CPU78.RCU
     96298 ± 11%     -40.6%      57235 ±  2%  softirqs.CPU79.RCU
     91480 ± 11%     -42.8%      52334        softirqs.CPU8.RCU
     48241 ±  3%      -8.0%      44373        softirqs.CPU8.SCHED
     90984 ± 11%     -41.0%      53650 ±  5%  softirqs.CPU80.RCU
     91361 ± 11%     -41.2%      53727 ±  5%  softirqs.CPU81.RCU
     91808 ± 12%     -40.8%      54316 ±  5%  softirqs.CPU82.RCU
     92117 ± 12%     -40.9%      54474 ±  5%  softirqs.CPU83.RCU
     90851 ± 12%     -42.7%      52046 ±  7%  softirqs.CPU84.RCU
     90966 ± 12%     -41.1%      53568 ±  4%  softirqs.CPU85.RCU
     91375 ± 11%     -41.2%      53737 ±  5%  softirqs.CPU86.RCU
     91211 ± 12%     -40.7%      54047 ±  3%  softirqs.CPU87.RCU
     92204 ± 12%     -40.7%      54685 ±  5%  softirqs.CPU88.RCU
     44711 ±  3%      -8.8%      40770        softirqs.CPU88.SCHED
     92197 ± 12%     -41.1%      54310 ±  4%  softirqs.CPU89.RCU
     91370 ± 11%     -42.2%      52772        softirqs.CPU9.RCU
     47961 ±  4%      -7.7%      44262        softirqs.CPU9.SCHED
     91228 ± 12%     -40.5%      54251 ±  5%  softirqs.CPU90.RCU
     91678 ± 12%     -41.3%      53774 ±  4%  softirqs.CPU91.RCU
     91366 ± 12%     -40.9%      53966 ±  4%  softirqs.CPU92.RCU
     91670 ± 12%     -41.4%      53740 ±  5%  softirqs.CPU93.RCU
     91846 ± 11%     -41.4%      53849 ±  5%  softirqs.CPU94.RCU
     91251 ± 11%     -41.2%      53680 ±  4%  softirqs.CPU95.RCU
   8973612 ± 11%     -41.4%    5254181 ±  3%  softirqs.RCU
    142298 ±  6%     -31.4%      97607        softirqs.TIMER
      1171 ±  2%     -29.3%     828.00        interrupts.293:PCI-MSI.327680-edge.xhci_hcd
      0.67 ±141%  +90125.0%     601.50 ± 96%  interrupts.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
      0.67 ±223%  +2.6e+05%       1702 ± 89%  interrupts.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
     14.17 ±211%  +11984.7%       1712 ± 80%  interrupts.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
      0.33 ±223%  +1.9e+05%     617.50 ± 99%  interrupts.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
      0.00       +9.1e+104%     908.00 ± 98%  interrupts.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
   9672064 ± 11%     -16.1%    8112763 ±  6%  interrupts.CAL:Function_call_interrupts
      0.33 ±141%  +1.8e+05%     600.50 ± 96%  interrupts.CPU0.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
    108653 ± 35%     -51.2%      53039 ± 13%  interrupts.CPU0.CAL:Function_call_interrupts
    153129 ± 24%     -40.9%      90491        interrupts.CPU0.RES:Rescheduling_interrupts
    137010 ± 24%     -33.8%      90658        interrupts.CPU1.RES:Rescheduling_interrupts
      1171 ±  2%     -29.3%     828.00        interrupts.CPU10.293:PCI-MSI.327680-edge.xhci_hcd
     98261 ± 28%     -59.2%      40075 ± 36%  interrupts.CPU10.CAL:Function_call_interrupts
      8709           -27.4%       6321 ±  8%  interrupts.CPU10.NMI:Non-maskable_interrupts
      8709           -27.4%       6321 ±  8%  interrupts.CPU10.PMI:Performance_monitoring_interrupts
     83384 ± 22%     -48.0%      43324 ± 19%  interrupts.CPU11.CAL:Function_call_interrupts
      8679           -27.1%       6330 ±  8%  interrupts.CPU11.NMI:Non-maskable_interrupts
      8679           -27.1%       6330 ±  8%  interrupts.CPU11.PMI:Performance_monitoring_interrupts
    126665 ± 17%     -31.6%      86592        interrupts.CPU11.RES:Rescheduling_interrupts
    137653 ± 22%     -36.9%      86888 ±  5%  interrupts.CPU12.RES:Rescheduling_interrupts
     94196 ± 21%     -46.8%      50088 ± 23%  interrupts.CPU13.CAL:Function_call_interrupts
      8679           -27.4%       6301 ±  9%  interrupts.CPU13.NMI:Non-maskable_interrupts
      8679           -27.4%       6301 ±  9%  interrupts.CPU13.PMI:Performance_monitoring_interrupts
    150899 ± 13%     -39.7%      90941        interrupts.CPU13.RES:Rescheduling_interrupts
     88472 ± 17%     -50.4%      43838 ± 15%  interrupts.CPU14.CAL:Function_call_interrupts
    145702 ± 17%     -39.2%      88557 ±  9%  interrupts.CPU15.RES:Rescheduling_interrupts
    107349 ± 18%     -57.2%      45983 ± 17%  interrupts.CPU16.CAL:Function_call_interrupts
    162249 ± 27%     -42.7%      92892 ±  7%  interrupts.CPU16.RES:Rescheduling_interrupts
     94151 ± 21%     -53.2%      44062 ± 38%  interrupts.CPU17.CAL:Function_call_interrupts
    154164 ± 14%     -44.7%      85208        interrupts.CPU17.RES:Rescheduling_interrupts
     93957 ± 18%     -51.4%      45677 ± 24%  interrupts.CPU18.CAL:Function_call_interrupts
    156643 ± 17%     -42.9%      89440 ±  2%  interrupts.CPU18.RES:Rescheduling_interrupts
     14.00 ±214%  +12128.6%       1712 ± 80%  interrupts.CPU19.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
     97845 ± 10%     -51.5%      47434 ±  7%  interrupts.CPU2.CAL:Function_call_interrupts
    154321 ± 22%     -41.3%      90564 ±  2%  interrupts.CPU2.RES:Rescheduling_interrupts
     97332 ± 33%     -65.1%      33960 ± 16%  interrupts.CPU20.CAL:Function_call_interrupts
    161508 ± 26%     -48.3%      83533 ±  2%  interrupts.CPU20.RES:Rescheduling_interrupts
    101433 ± 24%     -49.8%      50929 ± 39%  interrupts.CPU21.CAL:Function_call_interrupts
      8678           -27.3%       6309 ±  8%  interrupts.CPU21.NMI:Non-maskable_interrupts
      8678           -27.3%       6309 ±  8%  interrupts.CPU21.PMI:Performance_monitoring_interrupts
    146323 ± 23%     -40.0%      87782        interrupts.CPU21.RES:Rescheduling_interrupts
     89347 ± 16%     -50.4%      44339 ±  9%  interrupts.CPU22.CAL:Function_call_interrupts
      8680           -27.5%       6292 ±  8%  interrupts.CPU22.NMI:Non-maskable_interrupts
      8680           -27.5%       6292 ±  8%  interrupts.CPU22.PMI:Performance_monitoring_interrupts
     92971 ±  8%     -44.2%      51920 ± 32%  interrupts.CPU23.CAL:Function_call_interrupts
      8681           -26.8%       6353 ± 10%  interrupts.CPU24.NMI:Non-maskable_interrupts
      8681           -26.8%       6353 ± 10%  interrupts.CPU24.PMI:Performance_monitoring_interrupts
    107963 ± 26%     +40.5%     151674 ± 30%  interrupts.CPU25.CAL:Function_call_interrupts
     95907 ± 22%     +80.8%     173388 ± 34%  interrupts.CPU26.CAL:Function_call_interrupts
      8678           -27.0%       6337 ± 10%  interrupts.CPU29.NMI:Non-maskable_interrupts
      8678           -27.0%       6337 ± 10%  interrupts.CPU29.PMI:Performance_monitoring_interrupts
    146737 ± 19%     -39.4%      88973 ±  2%  interrupts.CPU3.RES:Rescheduling_interrupts
     82742 ± 23%     +42.9%     118237 ± 12%  interrupts.CPU30.CAL:Function_call_interrupts
      8680           -47.1%       4590 ± 23%  interrupts.CPU30.NMI:Non-maskable_interrupts
      8680           -47.1%       4590 ± 23%  interrupts.CPU30.PMI:Performance_monitoring_interrupts
      8678           -26.7%       6361 ± 10%  interrupts.CPU32.NMI:Non-maskable_interrupts
      8678           -26.7%       6361 ± 10%  interrupts.CPU32.PMI:Performance_monitoring_interrupts
    101076 ± 19%     +21.6%     122921 ± 14%  interrupts.CPU33.CAL:Function_call_interrupts
      8681           -43.4%       4917 ± 42%  interrupts.CPU34.NMI:Non-maskable_interrupts
      8681           -43.4%       4917 ± 42%  interrupts.CPU34.PMI:Performance_monitoring_interrupts
     88529 ± 15%     +71.6%     151900 ± 21%  interrupts.CPU37.CAL:Function_call_interrupts
     91637 ± 22%     +42.0%     130151 ±  4%  interrupts.CPU39.CAL:Function_call_interrupts
     98424 ± 23%     -52.7%      46561 ± 18%  interrupts.CPU4.CAL:Function_call_interrupts
    135853 ±  8%     -31.8%      92647 ±  7%  interrupts.CPU4.RES:Rescheduling_interrupts
      8681           -26.4%       6392 ± 11%  interrupts.CPU41.NMI:Non-maskable_interrupts
      8681           -26.4%       6392 ± 11%  interrupts.CPU41.PMI:Performance_monitoring_interrupts
      8691           -27.1%       6334 ± 10%  interrupts.CPU42.NMI:Non-maskable_interrupts
      8691           -27.1%       6334 ± 10%  interrupts.CPU42.PMI:Performance_monitoring_interrupts
     85664 ± 16%     +70.1%     145682 ± 24%  interrupts.CPU44.CAL:Function_call_interrupts
     96126 ± 17%     +30.4%     125315 ± 18%  interrupts.CPU46.CAL:Function_call_interrupts
    129280 ± 33%     -65.7%      44346 ± 23%  interrupts.CPU48.CAL:Function_call_interrupts
      0.17 ±223%  +3.7e+05%     617.50 ± 99%  interrupts.CPU49.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
     87848 ± 13%     -45.6%      47768 ± 32%  interrupts.CPU49.CAL:Function_call_interrupts
      8677           -26.9%       6343 ±  9%  interrupts.CPU49.NMI:Non-maskable_interrupts
      8677           -26.9%       6343 ±  9%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
    157134 ± 32%     -43.1%      89471 ±  5%  interrupts.CPU49.RES:Rescheduling_interrupts
     94157 ±  9%     -55.7%      41675 ± 30%  interrupts.CPU5.CAL:Function_call_interrupts
    137144 ± 21%     -35.0%      89077 ±  2%  interrupts.CPU5.RES:Rescheduling_interrupts
     96730 ± 30%     -45.9%      52337 ± 35%  interrupts.CPU50.CAL:Function_call_interrupts
    169729 ± 33%     -49.1%      86377 ±  2%  interrupts.CPU50.RES:Rescheduling_interrupts
     85659 ± 17%     -44.8%      47268 ± 23%  interrupts.CPU51.CAL:Function_call_interrupts
      8679           -63.6%       3162 ±  9%  interrupts.CPU51.NMI:Non-maskable_interrupts
      8679           -63.6%       3162 ±  9%  interrupts.CPU51.PMI:Performance_monitoring_interrupts
    150936 ± 21%     -44.4%      83937 ±  9%  interrupts.CPU51.RES:Rescheduling_interrupts
     89499 ± 11%     -50.0%      44788 ± 33%  interrupts.CPU52.CAL:Function_call_interrupts
    136534 ± 13%     -38.5%      84029 ±  5%  interrupts.CPU52.RES:Rescheduling_interrupts
      0.00       +9.1e+104%     907.00 ± 98%  interrupts.CPU53.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
     95165 ± 19%     -60.2%      37920 ± 24%  interrupts.CPU54.CAL:Function_call_interrupts
      8677           -25.4%       6475 ±  5%  interrupts.CPU54.NMI:Non-maskable_interrupts
      8677           -25.4%       6475 ±  5%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
    144257 ± 24%     -46.1%      77713        interrupts.CPU54.RES:Rescheduling_interrupts
     86110 ± 23%     -48.8%      44102 ± 28%  interrupts.CPU55.CAL:Function_call_interrupts
    165553 ± 39%     -50.9%      81250 ±  2%  interrupts.CPU55.RES:Rescheduling_interrupts
     88875 ± 11%     -43.7%      49999 ± 23%  interrupts.CPU56.CAL:Function_call_interrupts
      8678           -26.8%       6348 ±  9%  interrupts.CPU56.NMI:Non-maskable_interrupts
      8678           -26.8%       6348 ±  9%  interrupts.CPU56.PMI:Performance_monitoring_interrupts
    152559 ± 29%     -41.3%      89528 ±  2%  interrupts.CPU56.RES:Rescheduling_interrupts
    104697 ± 24%     -65.9%      35666 ± 27%  interrupts.CPU57.CAL:Function_call_interrupts
     93088 ± 27%     -49.5%      47014 ± 38%  interrupts.CPU58.CAL:Function_call_interrupts
    136961 ± 30%     -30.7%      94848 ±  2%  interrupts.CPU58.RES:Rescheduling_interrupts
     89163 ± 25%     -55.2%      39970 ±  2%  interrupts.CPU59.CAL:Function_call_interrupts
    137811 ± 16%     -41.7%      80338 ±  3%  interrupts.CPU59.RES:Rescheduling_interrupts
      0.67 ±223%  +2.6e+05%       1702 ± 89%  interrupts.CPU6.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
     95706 ± 21%     -50.2%      47643        interrupts.CPU6.CAL:Function_call_interrupts
     93374 ± 20%     -53.4%      43499 ± 40%  interrupts.CPU60.CAL:Function_call_interrupts
      8677           -47.3%       4573 ± 25%  interrupts.CPU60.NMI:Non-maskable_interrupts
      8677           -47.3%       4573 ± 25%  interrupts.CPU60.PMI:Performance_monitoring_interrupts
    144391 ± 29%     -45.4%      78879        interrupts.CPU60.RES:Rescheduling_interrupts
    110191 ± 24%     -58.2%      46066 ± 33%  interrupts.CPU61.CAL:Function_call_interrupts
    161787 ± 23%     -52.2%      77254        interrupts.CPU61.RES:Rescheduling_interrupts
     92640 ± 21%     -48.6%      47661 ± 13%  interrupts.CPU62.CAL:Function_call_interrupts
      8676           -27.4%       6297 ±  9%  interrupts.CPU62.NMI:Non-maskable_interrupts
      8676           -27.4%       6297 ±  9%  interrupts.CPU62.PMI:Performance_monitoring_interrupts
    132790 ± 19%     -44.1%      74282        interrupts.CPU62.RES:Rescheduling_interrupts
     89631 ± 30%     -58.2%      37443 ±  5%  interrupts.CPU63.CAL:Function_call_interrupts
    156124 ± 26%     -44.4%      86878 ±  5%  interrupts.CPU63.RES:Rescheduling_interrupts
    103552 ± 21%     -62.3%      39058 ± 20%  interrupts.CPU64.CAL:Function_call_interrupts
    166368 ± 28%     -51.7%      80391 ±  3%  interrupts.CPU64.RES:Rescheduling_interrupts
     91047 ± 16%     -47.1%      48199 ± 41%  interrupts.CPU65.CAL:Function_call_interrupts
    153443 ± 22%     -52.2%      73270        interrupts.CPU65.RES:Rescheduling_interrupts
     96228 ± 15%     -53.2%      44992 ±  4%  interrupts.CPU66.CAL:Function_call_interrupts
      8679           -27.4%       6305 ±  9%  interrupts.CPU66.NMI:Non-maskable_interrupts
      8679           -27.4%       6305 ±  9%  interrupts.CPU66.PMI:Performance_monitoring_interrupts
    180396 ± 28%     -53.5%      83869        interrupts.CPU66.RES:Rescheduling_interrupts
     95624 ± 24%     -59.0%      39222 ± 30%  interrupts.CPU67.CAL:Function_call_interrupts
    103497 ± 27%     -55.8%      45774 ± 24%  interrupts.CPU68.CAL:Function_call_interrupts
    166658 ± 29%     -51.0%      81734        interrupts.CPU68.RES:Rescheduling_interrupts
    105198 ± 12%     -49.1%      53522 ± 11%  interrupts.CPU69.CAL:Function_call_interrupts
      8676           -27.3%       6308 ±  9%  interrupts.CPU69.NMI:Non-maskable_interrupts
      8676           -27.3%       6308 ±  9%  interrupts.CPU69.PMI:Performance_monitoring_interrupts
    139760 ± 23%     -44.2%      77968        interrupts.CPU69.RES:Rescheduling_interrupts
     92717 ± 30%     -51.5%      44928 ±  6%  interrupts.CPU7.CAL:Function_call_interrupts
     98184 ± 28%     -57.0%      42241 ± 38%  interrupts.CPU70.CAL:Function_call_interrupts
     93861 ± 24%     -57.0%      40372 ± 26%  interrupts.CPU71.CAL:Function_call_interrupts
    136432 ± 18%     -40.9%      80625 ±  3%  interrupts.CPU71.RES:Rescheduling_interrupts
      8677           -27.0%       6335 ± 10%  interrupts.CPU73.NMI:Non-maskable_interrupts
      8677           -27.0%       6335 ± 10%  interrupts.CPU73.PMI:Performance_monitoring_interrupts
      8677           -47.0%       4596 ± 24%  interrupts.CPU75.NMI:Non-maskable_interrupts
      8677           -47.0%       4596 ± 24%  interrupts.CPU75.PMI:Performance_monitoring_interrupts
      8679           -27.1%       6326 ± 10%  interrupts.CPU76.NMI:Non-maskable_interrupts
      8679           -27.1%       6326 ± 10%  interrupts.CPU76.PMI:Performance_monitoring_interrupts
     86491 ± 27%     -42.9%      49374 ±  9%  interrupts.CPU8.CAL:Function_call_interrupts
      8682           -63.3%       3184 ±  9%  interrupts.CPU8.NMI:Non-maskable_interrupts
      8682           -63.3%       3184 ±  9%  interrupts.CPU8.PMI:Performance_monitoring_interrupts
    101544 ± 23%     +26.6%     128589 ± 15%  interrupts.CPU82.CAL:Function_call_interrupts
      8680           -47.0%       4603 ± 24%  interrupts.CPU85.NMI:Non-maskable_interrupts
      8680           -47.0%       4603 ± 24%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
      8675           -47.1%       4585 ± 23%  interrupts.CPU86.NMI:Non-maskable_interrupts
      8675           -47.1%       4585 ± 23%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
      8677           -47.1%       4587 ± 23%  interrupts.CPU88.NMI:Non-maskable_interrupts
      8677           -47.1%       4587 ± 23%  interrupts.CPU88.PMI:Performance_monitoring_interrupts
      8679           -26.4%       6384 ± 11%  interrupts.CPU89.NMI:Non-maskable_interrupts
      8679           -26.4%       6384 ± 11%  interrupts.CPU89.PMI:Performance_monitoring_interrupts
     86292 ± 14%     -39.4%      52293 ±  3%  interrupts.CPU9.CAL:Function_call_interrupts
      8679           -27.4%       6301 ±  8%  interrupts.CPU9.NMI:Non-maskable_interrupts
      8679           -27.4%       6301 ±  8%  interrupts.CPU9.PMI:Performance_monitoring_interrupts
      7232 ± 28%     -56.0%       3181 ± 10%  interrupts.CPU94.NMI:Non-maskable_interrupts
      7232 ± 28%     -56.0%       3181 ± 10%  interrupts.CPU94.PMI:Performance_monitoring_interrupts
    288.00           -33.3%     192.00        interrupts.MCP:Machine_check_polls
    763672           -26.8%     558809 ±  8%  interrupts.NMI:Non-maskable_interrupts
    763672           -26.8%     558809 ±  8%  interrupts.PMI:Performance_monitoring_interrupts
  12807267 ± 11%     -25.5%    9535680 ± 15%  interrupts.RES:Rescheduling_interrupts
     39.16           -14.8       24.36 ±  4%  perf-profile.calltrace.cycles-pp.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
     39.22           -14.8       24.45 ±  4%  perf-profile.calltrace.cycles-pp.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
     40.41           -14.1       26.34 ±  4%  perf-profile.calltrace.cycles-pp.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
     12.52 ±  2%     -12.5        0.00        perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb
     20.73           -12.5        8.28 ±  4%  perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg
     19.57            -7.5       12.12 ±  2%  perf-profile.calltrace.cycles-pp.kfree.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
     14.54            -6.2        8.34 ±  2%  perf-profile.calltrace.cycles-pp.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
     23.30            -5.9       17.39 ±  2%  perf-profile.calltrace.cycles-pp.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      5.72 ±  2%      -5.7        0.00        perf-profile.calltrace.cycles-pp.refill_obj_stock.kfree.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
      5.62 ±  2%      -5.6        0.00        perf-profile.calltrace.cycles-pp.drain_obj_stock.refill_obj_stock.kfree.consume_skb.unix_stream_read_generic
      5.57            -5.6        0.00        perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags
     47.67            -4.8       42.88        perf-profile.calltrace.cycles-pp.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write
     47.98            -4.7       43.34        perf-profile.calltrace.cycles-pp.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write.ksys_write
     48.20            -4.5       43.66        perf-profile.calltrace.cycles-pp.sock_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
     48.38            -4.2       44.14        perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
     46.61            -3.9       42.70        perf-profile.calltrace.cycles-pp.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read.vfs_read
     46.71            -3.9       42.83        perf-profile.calltrace.cycles-pp.unix_stream_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read
     47.21            -3.6       43.60        perf-profile.calltrace.cycles-pp.sock_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64
     47.37            -3.5       43.86        perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
     17.37            -2.7       14.64 ±  4%  perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb
     17.44            -2.7       14.74 ±  4%  perf-profile.calltrace.cycles-pp.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg
      8.71 ±  3%      -2.3        6.42 ± 16%  perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
      8.77 ±  3%      -2.3        6.48 ± 16%  perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
      8.96 ±  3%      -2.2        6.72 ± 15%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_write
      8.94 ±  3%      -2.2        6.70 ± 15%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
      9.06 ±  3%      -2.2        6.82 ± 15%  perf-profile.calltrace.cycles-pp.__libc_write
      8.52 ±  4%      -2.1        6.38 ± 13%  perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read
      8.57 ±  4%      -2.1        6.43 ± 13%  perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read
      8.65 ±  4%      -2.1        6.52 ± 13%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_read
      8.63 ±  4%      -2.1        6.50 ± 13%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read
      8.76 ±  4%      -2.1        6.64 ± 13%  perf-profile.calltrace.cycles-pp.__libc_read
      0.62 ±  2%      +0.0        0.66 ±  3%  perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.54 ±  4%      +0.2        0.70 ±  4%  perf-profile.calltrace.cycles-pp.unix_write_space.sock_wfree.unix_destruct_scm.skb_release_head_state.skb_release_all
      1.23 ±  3%      +0.2        1.41 ±  4%  perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
      0.61 ±  2%      +0.2        0.80 ±  2%  perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor
      0.62            +0.2        0.82 ±  3%  perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic
      1.26 ±  3%      +0.2        1.46 ±  4%  perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor
      1.41 ±  3%      +0.3        1.66 ±  3%  perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic
      0.77 ±  2%      +0.3        1.09 ±  4%  perf-profile.calltrace.cycles-pp.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
      2.08 ±  2%      +0.5        2.55 ±  3%  perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg
      2.09 ±  2%      +0.5        2.58 ±  3%  perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      2.10 ±  2%      +0.5        2.60 ±  3%  perf-profile.calltrace.cycles-pp.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      0.00            +0.5        0.53 ±  3%  perf-profile.calltrace.cycles-pp.zap_pte_range.unmap_page_range.unmap_vmas.exit_mmap.mmput
      0.00            +0.5        0.54 ±  4%  perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit
      0.00            +0.6        0.56 ±  5%  perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.do_group_exit
      0.00            +0.6        0.58 ±  4%  perf-profile.calltrace.cycles-pp._copy_from_iter.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
      0.00            +0.6        0.62 ±  4%  perf-profile.calltrace.cycles-pp.__build_skb_around.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg
      0.00            +0.6        0.63 ±  7%  perf-profile.calltrace.cycles-pp.mutex_unlock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      0.00            +0.7        0.70        perf-profile.calltrace.cycles-pp.__slab_free.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.00            +0.7        0.70        perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_prepare
      0.00            +0.7        0.72        perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode
      1.86 ±  2%      +0.7        2.60 ±  4%  perf-profile.calltrace.cycles-pp.sock_wfree.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb
      0.00            +0.7        0.74 ± 16%  perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.unix_stream_read_generic
      0.80            +0.8        1.58 ±  6%  perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      0.00            +0.8        0.81        perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.skb_queue_tail.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
      0.00            +0.8        0.81 ±  3%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common
      0.00            +0.8        0.84        perf-profile.calltrace.cycles-pp.skb_queue_tail.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
      0.08 ±223%      +0.9        0.94 ±  6%  perf-profile.calltrace.cycles-pp.skb_set_owner_w.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
      1.14 ±  3%      +0.9        2.00 ±  5%  perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
      0.00            +0.9        0.89 ± 31%  perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg
      0.00            +0.9        0.90 ±  4%  perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      0.72 ± 15%      +0.9        1.66        perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.0        0.95 ± 29%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg
      0.81 ± 14%      +1.0        1.79        perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.91 ±  2%      +1.0        2.92 ±  4%  perf-profile.calltrace.cycles-pp.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic
      1.94 ±  2%      +1.0        2.96 ±  4%  perf-profile.calltrace.cycles-pp.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      1.93 ±  2%      +1.0        2.96 ±  4%  perf-profile.calltrace.cycles-pp.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
      0.00            +1.0        1.04 ±  2%  perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.skb_unlink.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.00            +1.1        1.06 ± 18%  perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc_node
      0.00            +1.1        1.06 ±  2%  perf-profile.calltrace.cycles-pp.skb_unlink.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      0.00            +1.1        1.07        perf-profile.calltrace.cycles-pp.unwind_next_frame.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample
      0.00            +1.1        1.10 ±  2%  perf-profile.calltrace.cycles-pp.__slab_free.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      0.00            +1.1        1.12 ± 26%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      0.11 ±223%      +1.1        1.25        perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
      0.11 ±223%      +1.1        1.26        perf-profile.calltrace.cycles-pp.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.73 ±  8%      +1.2        1.90        perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity
      0.74 ±  8%      +1.2        1.94        perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair
      0.69 ±  8%      +1.2        1.92        perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.schedule_timeout
      0.75 ±  7%      +1.2        2.00        perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.schedule_timeout.unix_stream_read_generic
      0.75 ±  8%      +1.2        2.00        perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate
      0.73 ±  8%      +1.3        2.04 ±  3%  perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template
      0.74 ±  8%      +1.3        2.05 ±  3%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up
      0.74 ±  8%      +1.3        2.06 ±  3%  perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function
      0.79 ±  8%      +1.3        2.11        perf-profile.calltrace.cycles-pp.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
      0.89 ±  7%      +1.3        2.24 ±  2%  perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity
      0.00            +1.4        1.35 ± 27%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      0.00            +1.4        1.36 ±  5%  perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
      0.92 ±  6%      +1.4        2.28 ±  2%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair
      0.00            +1.4        1.36 ±  4%  perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      0.00            +1.4        1.37 ± 27%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.77 ±  7%      +1.4        2.14 ±  3%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common
      0.96 ±  6%      +1.4        2.34 ±  2%  perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair.__schedule
      0.80 ±  7%      +1.4        2.20 ±  3%  perf-profile.calltrace.cycles-pp.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      1.00 ±  6%      +1.5        2.46 ±  2%  perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
      0.90 ±  8%      +1.5        2.38        perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
      0.00            +1.5        1.48 ± 15%  perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_uncharge.obj_cgroup_uncharge_pages.kfree.consume_skb
      1.04 ±  6%      +1.6        2.62 ±  2%  perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout
      1.01 ±  7%      +1.7        2.67        perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
      0.00            +1.7        1.66 ± 28%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.00            +1.7        1.66 ± 28%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.00            +1.7        1.66 ± 28%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
      1.03 ±  7%      +1.7        2.70        perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      0.00            +1.7        1.72 ± 29%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
      1.14 ±  6%      +1.8        2.90        perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.unix_stream_read_generic
      0.00            +1.9        1.86 ± 11%  perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.9        1.86 ± 11%  perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.00            +1.9        1.86 ± 11%  perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.66 ±  8%      +1.9        2.52        perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch
      0.68 ±  8%      +1.9        2.56        perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule
      0.68 ±  8%      +1.9        2.56        perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule.schedule
      0.08 ±223%      +2.0        2.08 ± 18%  perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.__kmalloc_node_track_caller
      0.00            +2.0        2.04 ± 13%  perf-profile.calltrace.cycles-pp.perf_callchain_user.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward
      1.57 ±  7%      +2.5        4.09        perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime
      1.60 ±  7%      +2.5        4.12        perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr
      0.00            +4.2        4.23 ±  3%  perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.unix_stream_read_generic
      2.78 ±  6%      +4.5        7.28        perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg
      2.80 ±  6%      +4.5        7.32        perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      2.83 ±  6%      +4.5        7.37        perf-profile.calltrace.cycles-pp.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
      0.17 ±223%      +4.6        4.74        perf-profile.calltrace.cycles-pp.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward
      1.18 ±  6%      +4.7        5.89 ±  7%  perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb
      3.29 ± 15%      +4.9        8.22 ±  2%  perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable
      3.31 ± 15%      +5.0        8.26 ±  2%  perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg
      3.35 ± 15%      +5.0        8.34 ±  2%  perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg
      1.32 ±  5%      +5.0        6.36 ±  6%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags
      1.37 ±  5%      +5.1        6.45 ±  6%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb
      0.00            +5.1        5.14 ±  5%  perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg
      2.66 ±  8%      +5.1        7.80        perf-profile.calltrace.cycles-pp.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow
      2.68 ±  8%      +5.2        7.84        perf-profile.calltrace.cycles-pp.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow
      2.88 ±  7%      +5.4        8.24        perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event
      0.00            +5.6        5.58 ±  4%  perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
      3.49 ± 11%      +6.0        9.52 ±  6%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
      4.02 ± 10%      +7.0       10.97 ±  5%  perf-profile.calltrace.cycles-pp.sock_def_readable.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
      0.00            +8.3        8.28 ±  2%  perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kfree.consume_skb
      2.63 ± 13%      +9.0       11.59 ±  6%  perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.__kmalloc_node_track_caller.kmalloc_reserve
      3.38 ±  5%      +9.3       12.64 ±  5%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags
      3.22 ± 11%      +9.3       12.51 ±  5%  perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb
      0.00           +10.1       10.07 ±  4%  perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kfree.consume_skb.unix_stream_read_generic
      0.00           +11.0       10.96 ±  3%  perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kfree.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
     18.12 ±  2%     -17.5        0.60 ±  8%  perf-profile.children.cycles-pp.get_obj_cgroup_from_current
     39.18           -14.8       24.38 ±  4%  perf-profile.children.cycles-pp.__alloc_skb
     39.22           -14.8       24.46 ±  4%  perf-profile.children.cycles-pp.alloc_skb_with_frags
     40.41           -14.1       26.35 ±  4%  perf-profile.children.cycles-pp.sock_alloc_send_pskb
     20.76           -12.4        8.32 ±  4%  perf-profile.children.cycles-pp.kmem_cache_alloc_node
      9.95            -9.8        0.17        perf-profile.children.cycles-pp.refill_obj_stock
      9.77            -9.8        0.00        perf-profile.children.cycles-pp.drain_obj_stock
     19.57            -7.4       12.14 ±  2%  perf-profile.children.cycles-pp.kfree
     23.30            -5.9       17.39 ±  2%  perf-profile.children.cycles-pp.consume_skb
     14.56            -5.9        8.68 ±  2%  perf-profile.children.cycles-pp.kmem_cache_free
     47.69            -4.8       42.92        perf-profile.children.cycles-pp.unix_stream_sendmsg
     48.00            -4.6       43.35        perf-profile.children.cycles-pp.sock_sendmsg
     48.20            -4.5       43.66        perf-profile.children.cycles-pp.sock_write_iter
     48.39            -4.2       44.16        perf-profile.children.cycles-pp.new_sync_write
     48.96            -4.0       44.98        perf-profile.children.cycles-pp.vfs_write
     46.63            -3.9       42.72        perf-profile.children.cycles-pp.unix_stream_read_generic
     49.27            -3.9       45.40        perf-profile.children.cycles-pp.ksys_write
     46.71            -3.9       42.84        perf-profile.children.cycles-pp.unix_stream_recvmsg
     47.21            -3.6       43.60        perf-profile.children.cycles-pp.sock_read_iter
     47.38            -3.5       43.87        perf-profile.children.cycles-pp.new_sync_read
      5.10            -3.4        1.72 ±  4%  perf-profile.children.cycles-pp.mod_objcg_state
     48.06            -3.2       44.86        perf-profile.children.cycles-pp.vfs_read
     98.81            -3.1       95.68        perf-profile.children.cycles-pp.do_syscall_64
     48.31            -3.1       45.20        perf-profile.children.cycles-pp.ksys_read
     98.97            -3.0       95.92        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     17.41            -2.7       14.70 ±  4%  perf-profile.children.cycles-pp.__kmalloc_node_track_caller
     17.45            -2.7       14.76 ±  4%  perf-profile.children.cycles-pp.kmalloc_reserve
      9.08 ±  3%      -2.2        6.85 ± 15%  perf-profile.children.cycles-pp.__libc_write
      8.79 ±  4%      -2.1        6.67 ± 13%  perf-profile.children.cycles-pp.__libc_read
      2.45 ±  3%      -1.4        1.04 ± 11%  perf-profile.children.cycles-pp.get_mem_cgroup_from_objcg
      0.08 ±  6%      +0.0        0.09        perf-profile.children.cycles-pp.check_stack_object
      0.42            +0.0        0.44        perf-profile.children.cycles-pp.task_tick_fair
      0.07 ±  5%      +0.0        0.09        perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
      0.06 ±  7%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
      0.06 ±  8%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.get_stack_info
      0.06 ±  8%      +0.0        0.09        perf-profile.children.cycles-pp.syscall_enter_from_user_mode
      0.04 ± 72%      +0.0        0.08 ± 12%  perf-profile.children.cycles-pp.mem_cgroup_from_task
      0.13 ±  3%      +0.0        0.16 ±  3%  perf-profile.children.cycles-pp.aa_file_perm
      0.06 ±  6%      +0.0        0.10        perf-profile.children.cycles-pp.security_socket_getpeersec_dgram
      0.10 ±  4%      +0.0        0.14        perf-profile.children.cycles-pp.__task_pid_nr_ns
      0.07 ±  7%      +0.0        0.11        perf-profile.children.cycles-pp.rcu_all_qs
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.kmalloc_slab
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.build_id__mark_dso_hit
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.__calc_delta
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.__mmdrop
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.preempt_schedule_common
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.__dentry_kill
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.d_invalidate
      0.45            +0.1        0.50 ±  2%  perf-profile.children.cycles-pp.scheduler_tick
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.process_one_work
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.update_min_vruntime
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.machines__deliver_event
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.___perf_sw_event
      0.00            +0.1        0.06 ±  9%  perf-profile.children.cycles-pp.copy_fpregs_to_fpstate
      0.01 ±223%      +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.perf_tp_event_match
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.get_callchain_entry
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.__is_insn_slot_addr
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.perf_trace_buf_update
      0.00            +0.1        0.06        perf-profile.children.cycles-pp.get_stack_info_noinstr
      0.00            +0.1        0.06 ± 16%  perf-profile.children.cycles-pp.ktime_get
      0.11            +0.1        0.17        perf-profile.children.cycles-pp.perf_event_pid_type
      0.08            +0.1        0.14        perf-profile.children.cycles-pp.__update_load_avg_se
      0.01 ±223%      +0.1        0.07        perf-profile.children.cycles-pp.perf_misc_flags
      0.15 ±  4%      +0.1        0.22 ±  2%  perf-profile.children.cycles-pp.__might_fault
      0.10 ±  4%      +0.1        0.16        perf-profile.children.cycles-pp.rcu_read_unlock_strict
      0.00            +0.1        0.06 ± 23%  perf-profile.children.cycles-pp.ordered_events__queue
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.__free_pages_ok
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.pick_next_entity
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.perf_trace_buf_alloc
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.proc_invalidate_siblings_dcache
      0.08 ±  6%      +0.1        0.14        perf-profile.children.cycles-pp.native_sched_clock
      0.00            +0.1        0.07 ± 28%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.00            +0.1        0.07 ± 28%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.00            +0.1        0.07 ± 14%  perf-profile.children.cycles-pp.clockevents_program_event
      0.00            +0.1        0.07        perf-profile.children.cycles-pp.put_prev_entity
      0.17 ±  2%      +0.1        0.24 ±  2%  perf-profile.children.cycles-pp.__ksize
      0.09 ±  4%      +0.1        0.16 ±  6%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.09 ±  5%      +0.1        0.16 ±  3%  perf-profile.children.cycles-pp.__switch_to_asm
      0.10 ±  4%      +0.1        0.17 ±  5%  perf-profile.children.cycles-pp.set_next_entity
      0.00            +0.1        0.08 ± 33%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.00            +0.1        0.08 ± 33%  perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.05 ±  7%      +0.1        0.13        perf-profile.children.cycles-pp.cpuacct_charge
      0.05 ± 45%      +0.1        0.12 ±  4%  perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
      0.12 ±  4%      +0.1        0.20 ±  2%  perf-profile.children.cycles-pp.wait_for_unix_gc
      0.07            +0.1        0.15        perf-profile.children.cycles-pp.__list_del_entry_valid
      0.08 ±  5%      +0.1        0.16 ±  3%  perf-profile.children.cycles-pp.__switch_to
      0.00            +0.1        0.08 ± 37%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.00            +0.1        0.08        perf-profile.children.cycles-pp.bpf_ksym_find
      0.00            +0.1        0.08 ± 25%  perf-profile.children.cycles-pp.smpboot_thread_fn
      0.00            +0.1        0.08 ± 25%  perf-profile.children.cycles-pp.run_ksoftirqd
      0.51            +0.1        0.59 ±  3%  perf-profile.children.cycles-pp.tick_sched_handle
      0.05 ±  8%      +0.1        0.14 ±  3%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.17 ±  3%      +0.1        0.26        perf-profile.children.cycles-pp.__cond_resched
      0.00            +0.1        0.08 ±  5%  perf-profile.children.cycles-pp.kvm_is_in_guest
      0.00            +0.1        0.08 ±  5%  perf-profile.children.cycles-pp.unlink_file_vma
      0.08 ±  6%      +0.1        0.16        perf-profile.children.cycles-pp.perf_output_begin_forward
      0.52            +0.1        0.60 ±  4%  perf-profile.children.cycles-pp.tick_sched_timer
      0.09 ±  5%      +0.1        0.18        perf-profile.children.cycles-pp.load_new_mm_cr3
      0.07 ± 10%      +0.1        0.16 ±  3%  perf-profile.children.cycles-pp.update_rq_clock
      0.01 ±223%      +0.1        0.10 ±  5%  perf-profile.children.cycles-pp.check_preempt_wakeup
      0.49            +0.1        0.58 ±  3%  perf-profile.children.cycles-pp.update_process_times
      0.26 ±  2%      +0.1        0.34 ± 10%  perf-profile.children.cycles-pp.__virt_addr_valid
      0.00            +0.1        0.09 ± 11%  perf-profile.children.cycles-pp.worker_thread
      0.27 ±  3%      +0.1        0.36        perf-profile.children.cycles-pp.__entry_text_start
      0.08 ±  8%      +0.1        0.18 ±  2%  perf-profile.children.cycles-pp.ftrace_graph_ret_addr
      0.24 ±  2%      +0.1        0.34        perf-profile.children.cycles-pp.security_socket_sendmsg
      0.00            +0.1        0.10 ± 15%  perf-profile.children.cycles-pp.filemap_map_pages
      0.00            +0.1        0.10 ±  5%  perf-profile.children.cycles-pp.uncharge_batch
      0.23            +0.1        0.32        perf-profile.children.cycles-pp.__might_sleep
      0.01 ±223%      +0.1        0.10 ±  4%  perf-profile.children.cycles-pp.bad_get_user
      0.00            +0.1        0.10 ± 40%  perf-profile.children.cycles-pp.copy_page_range
      0.00            +0.1        0.10 ± 10%  perf-profile.children.cycles-pp.release_task
      0.09 ±  4%      +0.1        0.19        perf-profile.children.cycles-pp.reweight_entity
      0.01 ±223%      +0.1        0.11        perf-profile.children.cycles-pp.is_bpf_text_address
      0.56            +0.1        0.66 ±  3%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.10 ±  4%      +0.1        0.20 ±  2%  perf-profile.children.cycles-pp.cmp_ex_search
      0.02 ±141%      +0.1        0.12 ±  4%  perf-profile.children.cycles-pp.check_preempt_curr
      0.00            +0.1        0.11 ± 18%  perf-profile.children.cycles-pp.do_fault
      0.00            +0.1        0.11        perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
      0.00            +0.1        0.11 ±  9%  perf-profile.children.cycles-pp.wait_task_zombie
      0.08 ±  7%      +0.1        0.20 ±  7%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.00            +0.1        0.12 ± 13%  perf-profile.children.cycles-pp.irq_exit_rcu
      0.00            +0.1        0.12 ± 13%  perf-profile.children.cycles-pp.rcu_do_batch
      0.17 ±  6%      +0.1        0.28        perf-profile.children.cycles-pp.switch_fpu_return
      0.00            +0.1        0.12        perf-profile.children.cycles-pp.remove_vma
      0.20 ±  2%      +0.1        0.32        perf-profile.children.cycles-pp.__perf_event_header__init_id
      0.41 ±  2%      +0.1        0.54        perf-profile.children.cycles-pp.__fget_light
      0.00            +0.1        0.12 ± 12%  perf-profile.children.cycles-pp.rcu_core
      0.28 ±  2%      +0.1        0.41        perf-profile.children.cycles-pp.__check_heap_object
      0.01 ±223%      +0.1        0.14 ±  3%  perf-profile.children.cycles-pp.unfreeze_partials
      0.00            +0.1        0.13 ± 38%  perf-profile.children.cycles-pp.__alloc_pages
      0.00            +0.1        0.13 ±  7%  perf-profile.children.cycles-pp.perf_session__deliver_event
      0.06 ±  7%      +0.1        0.20 ±  4%  perf-profile.children.cycles-pp.update_cfs_group
      0.02 ±141%      +0.1        0.16 ±  3%  perf-profile.children.cycles-pp.put_cpu_partial
      0.00            +0.1        0.14 ±  7%  perf-profile.children.cycles-pp.perf_session__process_user_event
      0.00            +0.1        0.14 ±  7%  perf-profile.children.cycles-pp.__ordered_events__flush
      0.46 ±  2%      +0.1        0.60        perf-profile.children.cycles-pp.__fdget_pos
      0.25 ±  2%      +0.1        0.40        perf-profile.children.cycles-pp.security_socket_recvmsg
      0.30 ±  4%      +0.1        0.44        perf-profile.children.cycles-pp.fsnotify
      0.64 ±  2%      +0.2        0.80 ±  5%  perf-profile.children.cycles-pp.hrtimer_interrupt
      0.64 ±  2%      +0.2        0.80 ±  4%  perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
      0.15 ±  2%      +0.2        0.31 ±  3%  perf-profile.children.cycles-pp.drain_stock
      0.33 ±  2%      +0.2        0.50 ± 13%  perf-profile.children.cycles-pp.copyin
      0.66 ±  3%      +0.2        0.82 ±  2%  perf-profile.children.cycles-pp.unix_write_space
      0.41 ±  3%      +0.2        0.57        perf-profile.children.cycles-pp.common_file_perm
      0.52 ±  3%      +0.2        0.69        perf-profile.children.cycles-pp._copy_from_iter
      0.00            +0.2        0.17 ±  5%  perf-profile.children.cycles-pp.kthread
      0.00            +0.2        0.17 ±  5%  perf-profile.children.cycles-pp.__softirqentry_text_start
      1.53 ±  3%      +0.2        1.70        perf-profile.children.cycles-pp.copyout
      0.30 ±  2%      +0.2        0.47 ±  2%  perf-profile.children.cycles-pp.sock_recvmsg
      0.56 ±  3%      +0.2        0.73        perf-profile.children.cycles-pp.__build_skb_around
      0.39 ±  3%      +0.2        0.56        perf-profile.children.cycles-pp.mutex_lock
      0.15 ±  5%      +0.2        0.32        perf-profile.children.cycles-pp.bsearch
      0.34 ±  3%      +0.2        0.52        perf-profile.children.cycles-pp.___might_sleep
      0.23 ±  3%      +0.2        0.41 ±  2%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.38            +0.2        0.56        perf-profile.children.cycles-pp.aa_sk_perm
      0.00            +0.2        0.19 ± 21%  perf-profile.children.cycles-pp.wp_page_copy
      0.00            +0.2        0.19        perf-profile.children.cycles-pp.ret_from_fork
      0.15 ±  3%      +0.2        0.34        perf-profile.children.cycles-pp.search_extable
      0.47 ±  3%      +0.2        0.66        perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.17 ±  4%      +0.2        0.36 ±  4%  perf-profile.children.cycles-pp.refill_stock
      0.16 ±  4%      +0.2        0.35        perf-profile.children.cycles-pp.search_exception_tables
      0.00            +0.2        0.20 ± 33%  perf-profile.children.cycles-pp.schedule_idle
      0.00            +0.2        0.20        perf-profile.children.cycles-pp.__memcg_kmem_uncharge_page
      0.76 ±  2%      +0.2        0.96        perf-profile.children.cycles-pp.simple_copy_to_iter
      0.00            +0.2        0.20 ±  7%  perf-profile.children.cycles-pp.unlink_anon_vmas
      0.00            +0.2        0.21 ±  4%  perf-profile.children.cycles-pp.put_task_stack
      0.18 ±  3%      +0.2        0.40        perf-profile.children.cycles-pp.fixup_exception
      0.00            +0.2        0.22 ±  4%  perf-profile.children.cycles-pp.process_simple
      0.00            +0.2        0.22 ± 33%  perf-profile.children.cycles-pp.dup_mmap
      0.10 ±  3%      +0.2        0.33 ±  9%  perf-profile.children.cycles-pp.prepare_to_wait
      0.00            +0.2        0.24 ±  4%  perf-profile.children.cycles-pp.cmd_record
      0.00            +0.2        0.24 ±  4%  perf-profile.children.cycles-pp.record__finish_output
      0.00            +0.2        0.24 ±  4%  perf-profile.children.cycles-pp.perf_session__process_events
      0.21 ±  4%      +0.2        0.46        perf-profile.children.cycles-pp.kernelmode_fixup_or_oops
      1.71 ±  2%      +0.2        1.95 ±  2%  perf-profile.children.cycles-pp._copy_to_iter
      0.00            +0.2        0.24 ± 34%  perf-profile.children.cycles-pp.dup_mm
      0.00            +0.2        0.25 ±  4%  perf-profile.children.cycles-pp.page_remove_rmap
      0.60 ±  2%      +0.3        0.86        perf-profile.children.cycles-pp.security_file_permission
      0.68 ±  2%      +0.3        0.94 ±  6%  perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
      0.28 ±  5%      +0.3        0.56        perf-profile.children.cycles-pp.get_partial_node
      0.00            +0.3        0.29 ±  3%  perf-profile.children.cycles-pp.wait_consider_task
      0.19 ±  4%      +0.3        0.48        perf-profile.children.cycles-pp.kernel_text_address
      0.00            +0.3        0.30 ± 42%  perf-profile.children.cycles-pp.queued_write_lock_slowpath
      0.27 ±  4%      +0.3        0.56        perf-profile.children.cycles-pp.native_irq_return_iret
      0.20 ±  6%      +0.3        0.50        perf-profile.children.cycles-pp.stack_access_ok
      0.72 ±  4%      +0.3        1.02 ±  6%  perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
      0.14 ±  4%      +0.3        0.44 ±  2%  perf-profile.children.cycles-pp.try_charge
      0.00            +0.3        0.30 ±  3%  perf-profile.children.cycles-pp.release_pages
      1.83 ±  2%      +0.3        2.14        perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.00            +0.3        0.32 ±  7%  perf-profile.children.cycles-pp.free_pgtables
      0.00            +0.3        0.32 ± 34%  perf-profile.children.cycles-pp.copy_process
      0.95 ±  2%      +0.3        1.28        perf-profile.children.cycles-pp.skb_copy_datagram_from_iter
      0.00            +0.3        0.34 ±  2%  perf-profile.children.cycles-pp.tlb_flush_mmu
      0.00            +0.3        0.34 ± 36%  perf-profile.children.cycles-pp.__do_sys_clone
      0.00            +0.3        0.34 ± 36%  perf-profile.children.cycles-pp.kernel_clone
      1.11            +0.3        1.46        perf-profile.children.cycles-pp.__check_object_size
      0.19 ±  3%      +0.3        0.54 ±  6%  perf-profile.children.cycles-pp.update_load_avg
      0.00            +0.4        0.35 ±  2%  perf-profile.children.cycles-pp.tlb_finish_mmu
      0.00            +0.4        0.36 ± 21%  perf-profile.children.cycles-pp.__handle_mm_fault
      0.25 ±  4%      +0.4        0.62        perf-profile.children.cycles-pp.__kernel_text_address
      0.00            +0.4        0.38 ± 20%  perf-profile.children.cycles-pp.perf_trace_sched_migrate_task
      0.00            +0.4        0.38 ± 23%  perf-profile.children.cycles-pp.handle_mm_fault
      0.25 ±  6%      +0.4        0.64 ±  5%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.04 ± 44%      +0.4        0.45 ±  6%  perf-profile.children.cycles-pp.finish_task_switch
      0.00            +0.4        0.42 ± 36%  perf-profile.children.cycles-pp.__libc_fork
      0.00            +0.4        0.42 ± 19%  perf-profile.children.cycles-pp.set_task_cpu
      0.32 ±  4%      +0.4        0.76 ±  4%  perf-profile.children.cycles-pp.mutex_unlock
      0.44 ±  5%      +0.4        0.88 ±  2%  perf-profile.children.cycles-pp.___slab_alloc
      0.45 ±  4%      +0.4        0.90 ±  2%  perf-profile.children.cycles-pp.__slab_alloc
      2.52 ±  2%      +0.5        2.98        perf-profile.children.cycles-pp.__skb_datagram_iter
      0.00            +0.5        0.46 ±  2%  perf-profile.children.cycles-pp.__do_sys_wait4
      0.00            +0.5        0.46 ±  2%  perf-profile.children.cycles-pp.kernel_wait4
      0.00            +0.5        0.46 ±  2%  perf-profile.children.cycles-pp.do_wait
      2.54 ±  2%      +0.5        3.00        perf-profile.children.cycles-pp.skb_copy_datagram_iter
      0.00            +0.5        0.46 ±  3%  perf-profile.children.cycles-pp.__libc_wait
      0.32 ±  4%      +0.5        0.79 ±  3%  perf-profile.children.cycles-pp.orc_find
      0.32 ±  3%      +0.5        0.78        perf-profile.children.cycles-pp.unwind_get_return_address
      0.00            +0.5        0.46 ± 20%  perf-profile.children.cycles-pp.do_user_addr_fault
      2.56 ±  2%      +0.5        3.02        perf-profile.children.cycles-pp.unix_stream_read_actor
      0.60 ±  2%      +0.5        1.10 ±  3%  perf-profile.children.cycles-pp.skb_set_owner_w
      0.00            +0.5        0.54 ±  4%  perf-profile.children.cycles-pp.zap_pte_range
      0.00            +0.5        0.54 ±  4%  perf-profile.children.cycles-pp.unmap_page_range
      0.00            +0.6        0.56 ±  5%  perf-profile.children.cycles-pp.unmap_vmas
      0.18 ± 22%      +0.6        0.80 ± 10%  perf-profile.children.cycles-pp.__mod_memcg_state
      0.35 ±  4%      +0.6        0.99 ±  2%  perf-profile.children.cycles-pp.skb_queue_tail
      0.26 ± 15%      +0.7        0.94 ±  8%  perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
      0.28 ±  3%      +0.7        1.00 ±  9%  perf-profile.children.cycles-pp.exc_page_fault
      2.26 ±  2%      +0.8        3.04        perf-profile.children.cycles-pp.sock_wfree
      2.33 ±  2%      +0.8        3.13        perf-profile.children.cycles-pp.unix_destruct_scm
      2.36 ±  2%      +0.8        3.16        perf-profile.children.cycles-pp.skb_release_all
      2.35 ±  2%      +0.8        3.16        perf-profile.children.cycles-pp.skb_release_head_state
      0.61 ±  3%      +0.8        1.42        perf-profile.children.cycles-pp.__orc_find
      0.44 ±  4%      +0.8        1.26        perf-profile.children.cycles-pp.skb_unlink
      0.91 ± 11%      +1.0        1.92        perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      1.02 ± 10%      +1.0        2.07        perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      0.00            +1.2        1.17 ± 28%  perf-profile.children.cycles-pp.intel_idle
      0.80 ±  2%      +1.4        2.16        perf-profile.children.cycles-pp.__slab_free
      0.00            +1.4        1.36 ±  5%  perf-profile.children.cycles-pp.exit_mmap
      0.00            +1.4        1.36 ±  4%  perf-profile.children.cycles-pp.mmput
      0.00            +1.4        1.41 ± 28%  perf-profile.children.cycles-pp.cpuidle_enter_state
      0.00            +1.4        1.42 ± 28%  perf-profile.children.cycles-pp.cpuidle_enter
      0.84 ±  4%      +1.5        2.33 ±  4%  perf-profile.children.cycles-pp.asm_exc_page_fault
      1.15 ±  3%      +1.5        2.66        perf-profile.children.cycles-pp.__unwind_start
      1.15 ±  3%      +1.5        2.70 ±  4%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      1.40 ±  4%      +1.6        3.00        perf-profile.children.cycles-pp.__get_user_nocheck_8
      1.28 ±  3%      +1.6        2.91        perf-profile.children.cycles-pp.enqueue_entity
      0.00            +1.7        1.66 ± 28%  perf-profile.children.cycles-pp.start_secondary
      1.52 ±  2%      +1.7        3.22 ±  2%  perf-profile.children.cycles-pp.dequeue_entity
      1.49 ±  4%      +1.7        3.21        perf-profile.children.cycles-pp.perf_callchain_user
      0.00            +1.7        1.72 ± 29%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
      0.00            +1.7        1.72 ± 29%  perf-profile.children.cycles-pp.cpu_startup_entry
      0.00            +1.7        1.72 ± 29%  perf-profile.children.cycles-pp.do_idle
      1.43 ±  3%      +1.8        3.26        perf-profile.children.cycles-pp.enqueue_task_fair
      1.46 ±  3%      +1.8        3.30        perf-profile.children.cycles-pp.ttwu_do_activate
      1.46 ±  6%      +1.9        3.32 ±  3%  perf-profile.children.cycles-pp.perf_trace_sched_switch
      0.00            +1.9        1.87 ± 11%  perf-profile.children.cycles-pp.__x64_sys_exit_group
      0.00            +1.9        1.87 ± 11%  perf-profile.children.cycles-pp.do_group_exit
      0.00            +1.9        1.87 ± 11%  perf-profile.children.cycles-pp.do_exit
      1.66 ±  2%      +1.9        3.56 ±  2%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.84 ±  4%      +2.8        3.64 ± 11%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.08 ± 20%      +2.8        2.90 ± 16%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      2.80 ±  2%      +2.9        5.66        perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      2.14 ±  4%      +3.0        5.12        perf-profile.children.cycles-pp.unwind_next_frame
      2.97 ±  2%      +3.1        6.12        perf-profile.children.cycles-pp.update_curr
      2.63 ±  3%      +3.7        6.30 ±  2%  perf-profile.children.cycles-pp._raw_spin_lock
      2.82 ±  4%      +3.9        6.71        perf-profile.children.cycles-pp.perf_callchain_kernel
      3.48 ±  2%      +4.4        7.93        perf-profile.children.cycles-pp.schedule_timeout
      3.87 ± 10%      +4.9        8.73 ±  2%  perf-profile.children.cycles-pp.autoremove_wake_function
      3.84 ± 10%      +4.9        8.72 ±  2%  perf-profile.children.cycles-pp.try_to_wake_up
      3.91 ± 10%      +4.9        8.80 ±  2%  perf-profile.children.cycles-pp.__wake_up_common
      1.53 ±  7%      +5.3        6.82 ± 14%  perf-profile.children.cycles-pp.propagate_protected_usage
      4.04 ±  4%      +5.3        9.35        perf-profile.children.cycles-pp.schedule
      4.06 ±  4%      +5.5        9.59 ±  2%  perf-profile.children.cycles-pp.__schedule
      4.42 ±  4%      +5.7       10.11        perf-profile.children.cycles-pp.get_perf_callchain
      4.45 ±  4%      +5.7       10.16        perf-profile.children.cycles-pp.perf_callchain
      4.79 ±  3%      +5.9       10.72        perf-profile.children.cycles-pp.perf_prepare_sample
      3.97 ± 10%      +6.0       10.00 ±  5%  perf-profile.children.cycles-pp.__wake_up_common_lock
      4.93 ±  4%      +6.4       11.28 ±  3%  perf-profile.children.cycles-pp.perf_event_output_forward
      5.03 ±  4%      +6.4       11.39 ±  3%  perf-profile.children.cycles-pp.perf_swevent_overflow
      4.99 ±  4%      +6.4       11.35 ±  3%  perf-profile.children.cycles-pp.__perf_event_overflow
      5.19 ±  3%      +6.5       11.70 ±  3%  perf-profile.children.cycles-pp.perf_tp_event
      4.02 ± 10%      +7.0       10.97 ±  5%  perf-profile.children.cycles-pp.sock_def_readable
      2.74 ±  9%     +10.2       12.93 ±  2%  perf-profile.children.cycles-pp.page_counter_cancel
      5.47 ±  3%     +11.5       16.93 ±  3%  perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
      3.39 ±  7%     +12.6       15.94 ±  4%  perf-profile.children.cycles-pp.page_counter_uncharge
      4.32 ±  6%     +13.6       17.88 ±  6%  perf-profile.children.cycles-pp.page_counter_try_charge
      4.91 ±  5%     +14.0       18.92 ±  5%  perf-profile.children.cycles-pp.obj_cgroup_charge_pages
      5.05 ±  5%     +14.1       19.10 ±  5%  perf-profile.children.cycles-pp.obj_cgroup_charge
     17.91 ±  2%     -17.4        0.49 ±  8%  perf-profile.self.cycles-pp.get_obj_cgroup_from_current
     11.30 ±  2%     -10.7        0.62        perf-profile.self.cycles-pp.kfree
      7.86            -6.9        0.94        perf-profile.self.cycles-pp.kmem_cache_free
      7.66 ±  2%      -6.9        0.76        perf-profile.self.cycles-pp.__kmalloc_node_track_caller
      5.86 ±  3%      -5.3        0.52        perf-profile.self.cycles-pp.kmem_cache_alloc_node
      4.83            -4.0        0.80        perf-profile.self.cycles-pp.mod_objcg_state
      2.44 ±  3%      -1.4        1.02 ± 11%  perf-profile.self.cycles-pp.get_mem_cgroup_from_objcg
      0.36 ± 44%      -0.2        0.18        perf-profile.self.cycles-pp.select_idle_cpu
      0.05            +0.0        0.06        perf-profile.self.cycles-pp.__skb_datagram_iter
      0.06 ±  8%      +0.0        0.07        perf-profile.self.cycles-pp.syscall_exit_to_user_mode
      0.07 ±  5%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
      0.05            +0.0        0.07        perf-profile.self.cycles-pp.__fdget_pos
      0.06 ±  7%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
      0.05 ± 13%      +0.0        0.08 ± 20%  perf-profile.self.cycles-pp.perf_event_output_forward
      0.06 ±  6%      +0.0        0.08        perf-profile.self.cycles-pp.unix_destruct_scm
      0.05            +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.sock_recvmsg
      0.05 ±  7%      +0.0        0.08        perf-profile.self.cycles-pp.reweight_entity
      0.04 ± 73%      +0.0        0.07 ± 14%  perf-profile.self.cycles-pp.mem_cgroup_from_task
      0.05 ±  8%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.ksys_write
      0.08 ±  4%      +0.0        0.11        perf-profile.self.cycles-pp.unix_stream_recvmsg
      0.11 ±  4%      +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.aa_file_perm
      0.05 ±  7%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.skb_copy_datagram_from_iter
      0.04 ± 44%      +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.ksys_read
      0.05            +0.0        0.08 ±  5%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.12 ±  5%      +0.0        0.16 ±  3%  perf-profile.self.cycles-pp._copy_to_iter
      0.09 ±  4%      +0.0        0.12 ±  4%  perf-profile.self.cycles-pp.security_file_permission
      0.06 ±  7%      +0.0        0.10        perf-profile.self.cycles-pp.__cond_resched
      0.03 ± 70%      +0.0        0.07        perf-profile.self.cycles-pp.syscall_enter_from_user_mode
      0.04 ± 44%      +0.0        0.08        perf-profile.self.cycles-pp.rcu_all_qs
      0.12 ±  4%      +0.0        0.16 ±  3%  perf-profile.self.cycles-pp._copy_from_iter
      0.06 ±  7%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.sock_sendmsg
      0.06 ±  7%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.06            +0.0        0.10        perf-profile.self.cycles-pp.rcu_read_unlock_strict
      0.09 ±  4%      +0.0        0.13        perf-profile.self.cycles-pp.sock_alloc_send_pskb
      0.09 ±  5%      +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.__task_pid_nr_ns
      0.03 ± 70%      +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.alloc_skb_with_frags
      0.05 ±  7%      +0.0        0.10 ±  5%  perf-profile.self.cycles-pp.enqueue_entity
      0.09            +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.do_syscall_64
      0.04 ± 45%      +0.0        0.09        perf-profile.self.cycles-pp.dequeue_task_fair
      0.15 ±  3%      +0.0        0.20 ±  2%  perf-profile.self.cycles-pp.exit_to_user_mode_prepare
      0.10 ±  7%      +0.1        0.16 ±  3%  perf-profile.self.cycles-pp.get_partial_node
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.exc_page_fault
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.refill_stock
      0.00            +0.1        0.05        perf-profile.self.cycles-pp.__calc_delta
      0.01 ±223%      +0.1        0.06        perf-profile.self.cycles-pp.kmalloc_reserve
      0.10 ±  4%      +0.1        0.15        perf-profile.self.cycles-pp.perf_prepare_sample
      0.00            +0.1        0.06 ±  9%  perf-profile.self.cycles-pp.update_min_vruntime
      0.00            +0.1        0.06 ±  9%  perf-profile.self.cycles-pp.copy_fpregs_to_fpstate
      0.01 ±223%      +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.perf_tp_event_match
      0.11 ±  6%      +0.1        0.17        perf-profile.self.cycles-pp.refill_obj_stock
      0.06 ±  9%      +0.1        0.12        perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.schedule_timeout
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.kernelmode_fixup_or_oops
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.security_socket_recvmsg
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.security_socket_getpeersec_dgram
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.get_callchain_entry
      0.00            +0.1        0.06 ± 16%  perf-profile.self.cycles-pp.do_wait
      0.00            +0.1        0.06 ± 16%  perf-profile.self.cycles-pp.try_charge
      0.08 ±  6%      +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.native_sched_clock
      0.08 ±  6%      +0.1        0.14        perf-profile.self.cycles-pp.__update_load_avg_se
      0.17            +0.1        0.24 ±  2%  perf-profile.self.cycles-pp.__ksize
      0.12 ±  4%      +0.1        0.18 ± 13%  perf-profile.self.cycles-pp.obj_cgroup_charge
      0.07 ±  8%      +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.get_perf_callchain
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.check_preempt_wakeup
      0.05 ±  8%      +0.1        0.12        perf-profile.self.cycles-pp.__kernel_text_address
      0.03 ± 70%      +0.1        0.10        perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime
      0.06 ±  8%      +0.1        0.12 ±  4%  perf-profile.self.cycles-pp.prepare_to_wait
      0.05 ±  7%      +0.1        0.12        perf-profile.self.cycles-pp.bsearch
      0.08 ±  7%      +0.1        0.15        perf-profile.self.cycles-pp.ftrace_graph_ret_addr
      0.00            +0.1        0.07        perf-profile.self.cycles-pp.select_idle_sibling
      0.00            +0.1        0.07        perf-profile.self.cycles-pp.pick_next_task_fair
      0.00            +0.1        0.07        perf-profile.self.cycles-pp.wait_for_unix_gc
      0.00            +0.1        0.07        perf-profile.self.cycles-pp.unfreeze_partials
      0.09 ±  5%      +0.1        0.16 ±  3%  perf-profile.self.cycles-pp.__switch_to_asm
      0.07 ±  7%      +0.1        0.14        perf-profile.self.cycles-pp.__list_del_entry_valid
      0.05            +0.1        0.12 ±  4%  perf-profile.self.cycles-pp.cpuacct_charge
      0.00            +0.1        0.08 ±  6%  perf-profile.self.cycles-pp.__wake_up_common
      0.00            +0.1        0.08 ±  6%  perf-profile.self.cycles-pp.kvm_is_in_guest
      0.22 ±  3%      +0.1        0.30 ±  3%  perf-profile.self.cycles-pp.__entry_text_start
      0.04 ± 71%      +0.1        0.12 ±  4%  perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
      0.00            +0.1        0.08        perf-profile.self.cycles-pp.bpf_ksym_find
      0.06 ±  7%      +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.perf_output_begin_forward
      0.06 ±  9%      +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.__switch_to
      0.20 ±  5%      +0.1        0.28        perf-profile.self.cycles-pp.vfs_read
      0.25 ±  3%      +0.1        0.33 ±  9%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.09 ±  4%      +0.1        0.18 ±  2%  perf-profile.self.cycles-pp.perf_tp_event
      0.09 ±  4%      +0.1        0.18 ±  2%  perf-profile.self.cycles-pp.load_new_mm_cr3
      0.17 ±  4%      +0.1        0.25        perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.15 ±  3%      +0.1        0.24 ±  2%  perf-profile.self.cycles-pp.new_sync_read
      0.06            +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.try_to_wake_up
      0.20 ±  2%      +0.1        0.29 ±  3%  perf-profile.self.cycles-pp.__might_sleep
      0.00            +0.1        0.09        perf-profile.self.cycles-pp.select_task_rq_fair
      0.02 ±141%      +0.1        0.11        perf-profile.self.cycles-pp.update_rq_clock
      0.08 ± 11%      +0.1        0.18 ±  5%  perf-profile.self.cycles-pp.perf_callchain_user
      0.00            +0.1        0.10 ±  5%  perf-profile.self.cycles-pp.asm_exc_page_fault
      0.20 ±  3%      +0.1        0.30        perf-profile.self.cycles-pp.sock_read_iter
      0.06 ±  7%      +0.1        0.16        perf-profile.self.cycles-pp.unwind_get_return_address
      0.24 ±  3%      +0.1        0.34        perf-profile.self.cycles-pp.vfs_write
      0.00            +0.1        0.10 ± 10%  perf-profile.self.cycles-pp.page_counter_uncharge
      0.23 ±  2%      +0.1        0.33        perf-profile.self.cycles-pp.aa_sk_perm
      0.15 ±  2%      +0.1        0.26        perf-profile.self.cycles-pp.new_sync_write
      0.09 ±  4%      +0.1        0.20        perf-profile.self.cycles-pp.cmp_ex_search
      0.21 ±  4%      +0.1        0.32 ±  3%  perf-profile.self.cycles-pp.sock_write_iter
      0.00            +0.1        0.12 ±  4%  perf-profile.self.cycles-pp.release_pages
      0.40 ±  3%      +0.1        0.52        perf-profile.self.cycles-pp.__fget_light
      0.51 ±  3%      +0.1        0.62 ±  2%  perf-profile.self.cycles-pp.__check_object_size
      0.16 ±  5%      +0.1        0.28        perf-profile.self.cycles-pp.switch_fpu_return
      0.28 ±  3%      +0.1        0.40        perf-profile.self.cycles-pp.common_file_perm
      0.16 ±  2%      +0.1        0.28        perf-profile.self.cycles-pp.___slab_alloc
      0.29 ±  2%      +0.1        0.42        perf-profile.self.cycles-pp.mutex_lock
      0.27 ±  2%      +0.1        0.40        perf-profile.self.cycles-pp.__check_heap_object
      0.32 ±  2%      +0.1        0.46 ±  2%  perf-profile.self.cycles-pp.__alloc_skb
      0.08 ±  5%      +0.1        0.22        perf-profile.self.cycles-pp.kernel_text_address
      0.06 ±  7%      +0.1        0.20 ±  4%  perf-profile.self.cycles-pp.update_cfs_group
      0.07 ±  7%      +0.1        0.20 ±  2%  perf-profile.self.cycles-pp.update_curr
      0.00            +0.1        0.14 ± 28%  perf-profile.self.cycles-pp.queued_write_lock_slowpath
      0.46 ±  4%      +0.1        0.60        perf-profile.self.cycles-pp.__build_skb_around
      0.09 ±  5%      +0.1        0.24        perf-profile.self.cycles-pp.__unwind_start
      0.28 ±  3%      +0.2        0.43        perf-profile.self.cycles-pp.fsnotify
      0.18 ±  4%      +0.2        0.35 ±  2%  perf-profile.self.cycles-pp.unix_write_space
      0.33 ±  4%      +0.2        0.51        perf-profile.self.cycles-pp.___might_sleep
      0.47 ±  3%      +0.2        0.65        perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.24 ±  6%      +0.2        0.43 ±  2%  perf-profile.self.cycles-pp.__schedule
      0.06            +0.2        0.26 ±  7%  perf-profile.self.cycles-pp.update_load_avg
      0.00            +0.2        0.20 ±  2%  perf-profile.self.cycles-pp.page_remove_rmap
      0.00            +0.2        0.23 ±  4%  perf-profile.self.cycles-pp.zap_pte_range
      0.20 ±  3%      +0.2        0.44 ±  2%  perf-profile.self.cycles-pp.consume_skb
      0.32            +0.2        0.57 ±  3%  perf-profile.self.cycles-pp.unix_stream_sendmsg
      0.18 ±  6%      +0.3        0.44        perf-profile.self.cycles-pp.stack_access_ok
      0.00            +0.3        0.28 ±  3%  perf-profile.self.cycles-pp.wait_consider_task
      0.27 ±  4%      +0.3        0.56        perf-profile.self.cycles-pp.native_irq_return_iret
      0.16 ±  7%      +0.3        0.45 ±  6%  perf-profile.self.cycles-pp.switch_mm_irqs_off
      1.82 ±  3%      +0.3        2.12        perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.24 ±  5%      +0.3        0.55        perf-profile.self.cycles-pp.perf_callchain_kernel
      0.08 ± 19%      +0.4        0.46 ±  9%  perf-profile.self.cycles-pp.obj_cgroup_charge_pages
      0.08 ± 19%      +0.4        0.50 ± 13%  perf-profile.self.cycles-pp.obj_cgroup_uncharge_pages
      0.31 ±  5%      +0.4        0.74 ±  4%  perf-profile.self.cycles-pp.mutex_unlock
      0.31 ±  3%      +0.4        0.76 ±  3%  perf-profile.self.cycles-pp.orc_find
      0.59 ±  2%      +0.5        1.09 ±  3%  perf-profile.self.cycles-pp.skb_set_owner_w
      1.58 ±  2%      +0.6        2.18        perf-profile.self.cycles-pp.sock_wfree
      0.18 ± 23%      +0.6        0.79 ± 10%  perf-profile.self.cycles-pp.__mod_memcg_state
      0.61 ±  3%      +0.8        1.41        perf-profile.self.cycles-pp.__orc_find
      0.96 ±  2%      +0.8        1.77 ±  2%  perf-profile.self.cycles-pp.unix_stream_read_generic
      0.53 ±  5%      +0.9        1.44        perf-profile.self.cycles-pp.sock_def_readable
      0.80 ±  4%      +1.0        1.76        perf-profile.self.cycles-pp.__get_user_nocheck_8
      0.00            +1.2        1.17 ± 28%  perf-profile.self.cycles-pp.intel_idle
      0.79 ±  2%      +1.3        2.13        perf-profile.self.cycles-pp.__slab_free
      0.95 ±  4%      +1.4        2.31        perf-profile.self.cycles-pp.unwind_next_frame
      0.84 ±  4%      +1.7        2.54        perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      2.53 ±  2%      +2.1        4.63 ±  2%  perf-profile.self.cycles-pp._raw_spin_lock
      0.08 ± 20%      +2.8        2.89 ± 16%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      1.52 ±  7%      +5.2        6.76 ± 14%  perf-profile.self.cycles-pp.propagate_protected_usage
      2.74 ±  9%     +10.1       12.82 ±  2%  perf-profile.self.cycles-pp.page_counter_cancel
      3.39 ±  8%     +10.5       13.86 ±  4%  perf-profile.self.cycles-pp.page_counter_try_charge





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.13.0-00079-g5387c90490f7" of type "text/plain" (174163 bytes)

View attachment "job-script" of type "text/plain" (7746 bytes)

View attachment "job.yaml" of type "text/plain" (5188 bytes)

View attachment "reproduce" of type "text/plain" (530 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ