lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:   Fri, 23 Oct 2020 08:58:54 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Chuck Lever <chuck.lever@...cle.com>
Cc:     Anna Schumaker <Anna.Schumaker@...app.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com
Subject: [NFS] cd2ed9bdc0: netperf.Throughput_tps 18.6% improvement

Greeting,

FYI, we noticed a 18.6% improvement of netperf.Throughput_tps due to commit:


commit: cd2ed9bdc0794464d57a5ae2d979b1543a75694b ("NFS: Add a tracepoint in nfs_set_pgio_error()")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: netperf
on test machine: 144 threads Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory
with following parameters:

	ip: ipv4
	runtime: 300s
	nr_threads: 16
	cluster: cs-localhost
	test: TCP_CRR
	cpufreq_governor: performance
	ucode: 0x700001c

test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/





Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode:
  cs-localhost/gcc-9/performance/ipv4/x86_64-rhel-8.3/16/debian-10.4-x86_64-20200603.cgz/300s/lkp-cpl-4sp1/TCP_CRR/netperf/0x700001c

commit: 
  fd2b612141 ("NFS: Trace short NFS READs")
  cd2ed9bdc0 ("NFS: Add a tracepoint in nfs_set_pgio_error()")

fd2b6121415539c3 cd2ed9bdc0794464d57a5ae2d97 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    344552           +18.6%     408472        netperf.Throughput_total_tps
     21534           +18.6%      25529        netperf.Throughput_tps
    696891            +2.5%     714654        netperf.time.involuntary_context_switches
     11571            +5.6%      12225 ±  2%  netperf.time.minor_page_faults
    846.25            +2.4%     866.25        netperf.time.percent_of_cpu_this_job_got
      2531            +1.9%       2580        netperf.time.system_time
     51.72           +23.0%      63.62        netperf.time.user_time
 1.903e+08           +24.0%   2.36e+08        netperf.time.voluntary_context_switches
 1.034e+08           +18.6%  1.225e+08        netperf.workload
     35611 ±  6%     -13.0%      30991 ±  7%  numa-vmstat.node0.nr_slab_unreclaimable
      0.68            +0.1        0.77        mpstat.cpu.all.irq%
      0.24            +0.0        0.27 ±  2%  mpstat.cpu.all.usr%
    142446 ±  6%     -13.0%     123962 ±  7%  numa-meminfo.node0.SUnreclaim
     54368 ± 64%     -70.7%      15945 ±111%  numa-meminfo.node2.AnonHugePages
     85.00            -1.2%      84.00        vmstat.cpu.id
   2260239           +10.1%    2488445        vmstat.system.cs
    266.03 ±134%     -88.7%      30.01 ± 14%  sched_debug.cfs_rq:/.load_avg.stddev
     50625 ± 57%     +84.5%      93412 ±  5%  sched_debug.cfs_rq:/.spread0.max
    112.94 ±  4%      -8.0%     103.95        sched_debug.cfs_rq:/.util_est_enqueued.avg
 1.912e+08           -11.3%  1.696e+08        cpuidle.C1.usage
  74059064           -36.3%   47207216 ± 30%  cpuidle.C1E.usage
 3.701e+08           +13.6%  4.204e+08        cpuidle.POLL.time
  1.55e+08           +38.6%  2.148e+08        cpuidle.POLL.usage
     77888           -12.0%      68513        slabinfo.sock_inode_cache.active_objs
      2000           -12.0%       1760        slabinfo.sock_inode_cache.active_slabs
     78049           -12.0%      68681        slabinfo.sock_inode_cache.num_objs
      2000           -12.0%       1760        slabinfo.sock_inode_cache.num_slabs
     82549            -0.9%      81783        proc-vmstat.nr_active_anon
     11275            -4.5%      10767 ±  2%  proc-vmstat.nr_shmem
     46843            -4.9%      44558        proc-vmstat.nr_slab_reclaimable
    119991            -0.8%     119086        proc-vmstat.nr_slab_unreclaimable
     82549            -0.9%      81783        proc-vmstat.nr_zone_active_anon
   1054811           +10.2%    1162809        proc-vmstat.numa_hit
    984545           +11.0%    1092545        proc-vmstat.numa_local
   1637946           +55.6%    2548597 ±  3%  proc-vmstat.pgalloc_normal
   1645287           +55.3%    2554964 ±  3%  proc-vmstat.pgfree
     14.04            -7.5%      12.98 ±  2%  perf-stat.i.MPKI
  8.41e+09           +16.2%  9.771e+09        perf-stat.i.branch-instructions
 1.729e+08           +15.1%   1.99e+08        perf-stat.i.branch-misses
     13.68            -3.6       10.11 ±  4%  perf-stat.i.cache-miss-rate%
  79625575           -23.5%   60928499 ±  4%  perf-stat.i.cache-misses
 5.928e+08            +1.9%  6.044e+08        perf-stat.i.cache-references
   2282102           +10.1%    2512440        perf-stat.i.context-switches
      1.96           -13.4%       1.70        perf-stat.i.cpi
 8.137e+10            -1.2%  8.042e+10        perf-stat.i.cpu-cycles
      1025           +39.0%       1426 ±  3%  perf-stat.i.cycles-between-cache-misses
 1.276e+10           +16.5%  1.486e+10        perf-stat.i.dTLB-loads
      0.02 ±  3%      -0.0        0.01 ± 11%  perf-stat.i.dTLB-store-miss-rate%
   1452729 ±  3%     -48.1%     754050 ±  2%  perf-stat.i.dTLB-store-misses
 7.504e+09           +16.5%   8.74e+09        perf-stat.i.dTLB-stores
     88.85            +2.1       90.96        perf-stat.i.iTLB-load-miss-rate%
 1.311e+08           +17.4%   1.54e+08        perf-stat.i.iTLB-load-misses
  15307315            -7.9%   14092472        perf-stat.i.iTLB-loads
 4.213e+10           +16.3%    4.9e+10        perf-stat.i.instructions
      0.52           +17.4%       0.61        perf-stat.i.ipc
      0.57            -1.2%       0.56        perf-stat.i.metric.GHz
      0.07            -6.2%       0.07        perf-stat.i.metric.K/sec
    203.53           +16.1%     236.27        perf-stat.i.metric.M/sec
     90.88            -0.9       89.96        perf-stat.i.node-load-miss-rate%
  16351518 ±  2%     -20.2%   13044449 ±  2%  perf-stat.i.node-load-misses
   1638072           -12.5%    1432598 ±  2%  perf-stat.i.node-loads
   7126496           +19.8%    8540461        perf-stat.i.node-store-misses
    505279           +17.4%     593125 ±  3%  perf-stat.i.node-stores
     14.07           -12.3%      12.34        perf-stat.overall.MPKI
     13.43            -3.4       10.08 ±  3%  perf-stat.overall.cache-miss-rate%
      1.93           -15.0%       1.64        perf-stat.overall.cpi
      1022           +29.4%       1322 ±  4%  perf-stat.overall.cycles-between-cache-misses
      0.01 ±  2%      -0.0        0.01 ±  5%  perf-stat.overall.dTLB-load-miss-rate%
      0.02 ±  3%      -0.0        0.01 ±  2%  perf-stat.overall.dTLB-store-miss-rate%
     89.55            +2.1       91.62        perf-stat.overall.iTLB-load-miss-rate%
      0.52           +17.7%       0.61        perf-stat.overall.ipc
    124335            -1.9%     121971        perf-stat.overall.path-length
 8.383e+09           +16.2%  9.739e+09        perf-stat.ps.branch-instructions
 1.723e+08           +15.1%  1.984e+08        perf-stat.ps.branch-misses
  79364332           -23.5%   60722285 ±  4%  perf-stat.ps.cache-misses
 5.909e+08            +1.9%  6.023e+08        perf-stat.ps.cache-references
   2274506           +10.1%    2503968        perf-stat.ps.context-switches
  8.11e+10            -1.2%  8.015e+10        perf-stat.ps.cpu-cycles
 1.272e+10           +16.5%  1.481e+10        perf-stat.ps.dTLB-loads
   1447936 ±  3%     -48.1%     751551 ±  2%  perf-stat.ps.dTLB-store-misses
 7.479e+09           +16.5%  8.711e+09        perf-stat.ps.dTLB-stores
 1.307e+08           +17.4%  1.535e+08        perf-stat.ps.iTLB-load-misses
  15256427            -7.9%   14044651        perf-stat.ps.iTLB-loads
 4.199e+10           +16.3%  4.883e+10        perf-stat.ps.instructions
  16297319 ±  2%     -20.2%   12999740 ±  2%  perf-stat.ps.node-load-misses
   1632987           -12.5%    1428325 ±  2%  perf-stat.ps.node-loads
   7103017           +19.8%    8511899        perf-stat.ps.node-store-misses
    504382           +17.4%     592137 ±  3%  perf-stat.ps.node-stores
 1.285e+13           +16.3%  1.495e+13        perf-stat.total.instructions
      1596 ±122%    +312.9%       6591 ± 71%  interrupts.32:PCI-MSI.524290-edge.eth0-TxRx-1
      1596 ±122%    +312.9%       6591 ± 71%  interrupts.CPU10.32:PCI-MSI.524290-edge.eth0-TxRx-1
      4202 ± 12%     -31.8%       2865 ± 14%  interrupts.CPU100.RES:Rescheduling_interrupts
      3472           -18.5%       2829 ± 12%  interrupts.CPU101.RES:Rescheduling_interrupts
      3584 ± 11%     -24.2%       2716 ±  6%  interrupts.CPU102.RES:Rescheduling_interrupts
      2279 ± 15%     -32.2%       1545 ± 20%  interrupts.CPU103.NMI:Non-maskable_interrupts
      2279 ± 15%     -32.2%       1545 ± 20%  interrupts.CPU103.PMI:Performance_monitoring_interrupts
      4094 ± 13%     -30.5%       2845 ±  6%  interrupts.CPU103.RES:Rescheduling_interrupts
      4082 ±  9%     -27.4%       2962 ± 10%  interrupts.CPU104.RES:Rescheduling_interrupts
      3178 ± 13%     -57.1%       1362 ± 20%  interrupts.CPU105.NMI:Non-maskable_interrupts
      3178 ± 13%     -57.1%       1362 ± 20%  interrupts.CPU105.PMI:Performance_monitoring_interrupts
      3966 ±  2%     -27.2%       2889 ±  6%  interrupts.CPU105.RES:Rescheduling_interrupts
      3843 ±  7%     -25.9%       2847 ±  4%  interrupts.CPU106.RES:Rescheduling_interrupts
      3867 ± 14%     -25.3%       2890 ±  8%  interrupts.CPU107.RES:Rescheduling_interrupts
      3498 ±  2%     -16.9%       2907 ±  5%  interrupts.CPU110.RES:Rescheduling_interrupts
      3425 ± 15%     -35.4%       2212 ± 27%  interrupts.CPU112.NMI:Non-maskable_interrupts
      3425 ± 15%     -35.4%       2212 ± 27%  interrupts.CPU112.PMI:Performance_monitoring_interrupts
      2627 ± 27%     -44.5%       1459 ± 56%  interrupts.CPU114.NMI:Non-maskable_interrupts
      2627 ± 27%     -44.5%       1459 ± 56%  interrupts.CPU114.PMI:Performance_monitoring_interrupts
      3487 ± 11%     -21.6%       2735 ± 13%  interrupts.CPU115.RES:Rescheduling_interrupts
      3597 ± 10%     -20.9%       2846 ± 10%  interrupts.CPU116.RES:Rescheduling_interrupts
      3498 ±  6%     -25.1%       2621 ± 10%  interrupts.CPU117.RES:Rescheduling_interrupts
      4029 ± 10%     -30.1%       2814 ± 15%  interrupts.CPU118.RES:Rescheduling_interrupts
      1879 ± 23%     -43.4%       1063 ±  9%  interrupts.CPU119.NMI:Non-maskable_interrupts
      1879 ± 23%     -43.4%       1063 ±  9%  interrupts.CPU119.PMI:Performance_monitoring_interrupts
      3516 ±  6%     -22.0%       2742 ± 10%  interrupts.CPU119.RES:Rescheduling_interrupts
      3639 ±  6%     -32.0%       2476 ± 14%  interrupts.CPU120.RES:Rescheduling_interrupts
      3655 ± 15%     -30.5%       2541 ± 10%  interrupts.CPU121.RES:Rescheduling_interrupts
      3819 ± 14%     -38.3%       2355 ± 13%  interrupts.CPU122.RES:Rescheduling_interrupts
      3551 ±  3%     -28.8%       2527 ± 23%  interrupts.CPU123.RES:Rescheduling_interrupts
      3513 ± 12%     -35.2%       2277 ± 11%  interrupts.CPU124.RES:Rescheduling_interrupts
    159.25 ±102%     -88.4%      18.50 ±139%  interrupts.CPU124.TLB:TLB_shootdowns
      3330 ±  5%     -35.3%       2155 ± 14%  interrupts.CPU125.RES:Rescheduling_interrupts
      1504 ±  2%     -18.7%       1222 ±  4%  interrupts.CPU128.CAL:Function_call_interrupts
      7814 ±  6%     -16.0%       6564 ±  8%  interrupts.CPU19.RES:Rescheduling_interrupts
      6584 ±  7%     -10.4%       5901        interrupts.CPU2.RES:Rescheduling_interrupts
      6750 ±  5%     -13.0%       5871 ±  9%  interrupts.CPU20.RES:Rescheduling_interrupts
      6671 ±  7%     -14.5%       5706 ±  8%  interrupts.CPU21.RES:Rescheduling_interrupts
      3685 ±  7%     -28.5%       2634 ± 20%  interrupts.CPU36.NMI:Non-maskable_interrupts
      3685 ±  7%     -28.5%       2634 ± 20%  interrupts.CPU36.PMI:Performance_monitoring_interrupts
      6860           -14.9%       5835 ±  5%  interrupts.CPU36.RES:Rescheduling_interrupts
      8275 ±  3%     -13.9%       7127        interrupts.CPU37.RES:Rescheduling_interrupts
      7063 ±  7%     -14.2%       6062 ±  8%  interrupts.CPU38.RES:Rescheduling_interrupts
      7154 ±  9%     -13.7%       6175 ±  6%  interrupts.CPU39.RES:Rescheduling_interrupts
      3750 ± 11%     -39.1%       2285 ± 27%  interrupts.CPU40.NMI:Non-maskable_interrupts
      3750 ± 11%     -39.1%       2285 ± 27%  interrupts.CPU40.PMI:Performance_monitoring_interrupts
      6273 ±  7%     -13.4%       5430        interrupts.CPU41.RES:Rescheduling_interrupts
      6081 ±  3%     -11.0%       5411 ±  3%  interrupts.CPU42.RES:Rescheduling_interrupts
      5887 ±  8%     -16.3%       4928 ±  5%  interrupts.CPU43.RES:Rescheduling_interrupts
      3884 ± 10%     -14.8%       3310 ±  3%  interrupts.CPU51.RES:Rescheduling_interrupts
      4014 ±  8%     -33.4%       2672 ± 43%  interrupts.CPU54.NMI:Non-maskable_interrupts
      4014 ±  8%     -33.4%       2672 ± 43%  interrupts.CPU54.PMI:Performance_monitoring_interrupts
      7221 ±  6%     -12.5%       6317 ±  7%  interrupts.CPU56.RES:Rescheduling_interrupts
     86.00 ± 34%     -64.8%      30.25 ± 52%  interrupts.CPU60.TLB:TLB_shootdowns
     59.00 ± 76%     -74.2%      15.25 ±112%  interrupts.CPU64.TLB:TLB_shootdowns
      4485 ± 12%     -13.2%       3891 ±  7%  interrupts.CPU69.RES:Rescheduling_interrupts
      2828 ±  9%     -35.4%       1828 ± 11%  interrupts.CPU72.NMI:Non-maskable_interrupts
      2828 ±  9%     -35.4%       1828 ± 11%  interrupts.CPU72.PMI:Performance_monitoring_interrupts
      3405 ±  8%     -17.4%       2811 ±  8%  interrupts.CPU73.RES:Rescheduling_interrupts
      4192 ±  8%     -17.3%       3466 ± 14%  interrupts.CPU76.RES:Rescheduling_interrupts
     66.75 ± 65%     -68.9%      20.75 ± 95%  interrupts.CPU76.TLB:TLB_shootdowns
      4103 ±  7%     -19.4%       3307 ±  5%  interrupts.CPU78.RES:Rescheduling_interrupts
      3990 ±  8%     -16.6%       3328 ± 11%  interrupts.CPU79.RES:Rescheduling_interrupts
      3940 ± 10%     -20.4%       3135 ± 12%  interrupts.CPU80.RES:Rescheduling_interrupts
      1588 ± 31%     +32.4%       2103 ± 11%  interrupts.CPU81.NMI:Non-maskable_interrupts
      1588 ± 31%     +32.4%       2103 ± 11%  interrupts.CPU81.PMI:Performance_monitoring_interrupts
      3756 ±  6%     -23.1%       2890 ± 13%  interrupts.CPU82.RES:Rescheduling_interrupts
      2664 ± 24%     -38.1%       1650 ± 23%  interrupts.CPU84.NMI:Non-maskable_interrupts
      2664 ± 24%     -38.1%       1650 ± 23%  interrupts.CPU84.PMI:Performance_monitoring_interrupts
      3933 ± 12%     -25.3%       2937 ± 19%  interrupts.CPU84.RES:Rescheduling_interrupts
      2883 ± 23%     -37.3%       1808 ± 19%  interrupts.CPU85.NMI:Non-maskable_interrupts
      2883 ± 23%     -37.3%       1808 ± 19%  interrupts.CPU85.PMI:Performance_monitoring_interrupts
      4577 ±  7%     -28.6%       3269 ± 10%  interrupts.CPU85.RES:Rescheduling_interrupts
      2533 ± 10%     -33.6%       1683 ± 27%  interrupts.CPU86.NMI:Non-maskable_interrupts
      2533 ± 10%     -33.6%       1683 ± 27%  interrupts.CPU86.PMI:Performance_monitoring_interrupts
      4210 ±  5%     -36.5%       2674 ± 10%  interrupts.CPU87.RES:Rescheduling_interrupts
      4207 ±  4%     -33.3%       2807 ± 17%  interrupts.CPU88.RES:Rescheduling_interrupts
      4244 ± 14%     -38.3%       2617 ± 12%  interrupts.CPU89.RES:Rescheduling_interrupts
      1813 ± 35%     +50.4%       2728 ±  6%  interrupts.CPU90.NMI:Non-maskable_interrupts
      1813 ± 35%     +50.4%       2728 ±  6%  interrupts.CPU90.PMI:Performance_monitoring_interrupts
      1747 ± 41%     +73.6%       3034 ± 18%  interrupts.CPU92.NMI:Non-maskable_interrupts
      1747 ± 41%     +73.6%       3034 ± 18%  interrupts.CPU92.PMI:Performance_monitoring_interrupts
      3482 ±  5%     -16.3%       2914 ±  9%  interrupts.CPU93.RES:Rescheduling_interrupts
      3743 ±  8%     -17.1%       3102 ±  4%  interrupts.CPU98.RES:Rescheduling_interrupts
      3843 ± 10%     -21.3%       3025 ±  7%  interrupts.CPU99.RES:Rescheduling_interrupts
    321364 ±  3%      -9.5%     290702 ±  5%  interrupts.NMI:Non-maskable_interrupts
    321364 ±  3%      -9.5%     290702 ±  5%  interrupts.PMI:Performance_monitoring_interrupts
    620411 ±  2%     -11.1%     551544 ±  3%  interrupts.RES:Rescheduling_interrupts
   3593372 ±  3%     +24.1%    4458722 ±  5%  softirqs.CPU1.NET_RX
    226535 ±  2%     +21.9%     276124 ±  3%  softirqs.CPU1.RCU
   1986693 ±  8%     +37.1%    2723958 ± 11%  softirqs.CPU10.NET_RX
    158646 ±  4%     +25.5%     199166 ±  5%  softirqs.CPU10.RCU
    119014            -9.4%     107770 ±  2%  softirqs.CPU100.TIMER
    118480 ±  2%      -9.1%     107703        softirqs.CPU101.TIMER
   2207946 ±  4%     -14.1%    1897640 ±  7%  softirqs.CPU104.NET_RX
    120528           -10.0%     108443 ±  3%  softirqs.CPU104.TIMER
    120600            -9.0%     109800 ±  2%  softirqs.CPU106.TIMER
    120545           -10.1%     108427 ±  2%  softirqs.CPU107.TIMER
   1582511 ±  7%     +23.0%    1946344 ±  7%  softirqs.CPU109.NET_RX
    141528 ±  3%     +15.6%     163591 ±  4%  softirqs.CPU109.RCU
    118009 ±  2%      -8.9%     107517        softirqs.CPU109.TIMER
   1912511 ± 18%     +42.7%    2728897 ±  7%  softirqs.CPU11.NET_RX
    155760 ± 10%     +28.7%     200424 ±  4%  softirqs.CPU11.RCU
    146133 ±  7%     +12.1%     163827 ±  4%  softirqs.CPU110.RCU
   1626185 ± 15%     +23.6%    2009224 ±  4%  softirqs.CPU111.NET_RX
    142074 ±  7%     +16.6%     165660 ±  2%  softirqs.CPU111.RCU
   1747237 ±  8%     +16.6%    2038148 ±  5%  softirqs.CPU114.NET_RX
    153419 ±  4%     +15.9%     177751 ±  2%  softirqs.CPU114.RCU
   2110126 ±  7%     +28.4%    2708515 ±  4%  softirqs.CPU12.NET_RX
    166607 ±  4%     +20.6%     200889 ±  2%  softirqs.CPU12.RCU
   2113615 ±  5%     -13.5%    1827266 ±  8%  softirqs.CPU120.NET_RX
    120534 ±  2%      -7.8%     111115 ±  2%  softirqs.CPU124.TIMER
   1909929 ±  7%     -16.4%    1596274 ± 10%  softirqs.CPU125.NET_RX
   1636286 ± 11%     +28.3%    2099950 ±  5%  softirqs.CPU126.NET_RX
    137556 ±  6%     +18.6%     163127 ±  3%  softirqs.CPU126.RCU
    119192           -10.1%     107168 ±  4%  softirqs.CPU126.TIMER
   1475844 ±  4%     +24.9%    1842610        softirqs.CPU127.NET_RX
    129985           +16.3%     151196        softirqs.CPU127.RCU
   1452187 ±  7%     +33.3%    1935909 ± 15%  softirqs.CPU128.NET_RX
    132133 ±  3%     +22.4%     161687 ±  8%  softirqs.CPU128.RCU
    135284 ±  8%     +20.4%     162872 ±  7%  softirqs.CPU129.RCU
   2011051 ± 11%     +32.6%    2666473 ±  5%  softirqs.CPU13.NET_RX
    162143 ±  6%     +23.0%     199371 ±  3%  softirqs.CPU13.RCU
    121124            -9.3%     109854 ±  4%  softirqs.CPU130.TIMER
    131083 ±  2%     +17.7%     154299 ±  5%  softirqs.CPU131.RCU
    119764           -11.4%     106134 ±  4%  softirqs.CPU131.TIMER
   1452793 ±  7%     +18.9%    1727905 ±  6%  softirqs.CPU132.NET_RX
    132592 ±  3%     +16.1%     153885 ±  3%  softirqs.CPU132.RCU
    121779           -10.9%     108527 ±  4%  softirqs.CPU132.TIMER
   1392612 ±  8%     +31.3%    1828076 ± 11%  softirqs.CPU134.NET_RX
    129678 ±  4%     +21.3%     157332 ±  5%  softirqs.CPU134.RCU
    134110           +11.5%     149577 ±  5%  softirqs.CPU135.RCU
    119023           -11.2%     105731 ±  4%  softirqs.CPU135.TIMER
    125517 ±  6%     +15.7%     145278 ±  5%  softirqs.CPU136.RCU
    119262           -11.0%     106099 ±  3%  softirqs.CPU136.TIMER
    121415           -13.1%     105464 ±  4%  softirqs.CPU137.TIMER
    122181           -11.3%     108337 ±  3%  softirqs.CPU138.TIMER
    122335           -11.3%     108451 ±  3%  softirqs.CPU139.TIMER
   1955730 ±  7%     +45.8%    2851594 ±  3%  softirqs.CPU14.NET_RX
    158244 ±  4%     +28.8%     203771 ±  2%  softirqs.CPU14.RCU
    117804 ±  3%     -10.7%     105216 ±  2%  softirqs.CPU140.TIMER
   1436375 ± 12%     +21.0%    1738245 ±  6%  softirqs.CPU142.NET_RX
    130378 ±  5%     +15.8%     151042 ±  2%  softirqs.CPU142.RCU
    122696           -12.5%     107390        softirqs.CPU142.TIMER
    127172 ±  6%     +13.1%     143830 ±  3%  softirqs.CPU143.RCU
    120429           -10.6%     107672 ±  4%  softirqs.CPU143.TIMER
   1934365           +42.6%    2758014 ±  6%  softirqs.CPU15.NET_RX
    156614           +27.7%     199936 ±  3%  softirqs.CPU15.RCU
   1682969 ±  7%     +53.2%    2577586 ±  6%  softirqs.CPU16.NET_RX
    139353 ±  3%     +30.7%     182084 ±  3%  softirqs.CPU16.RCU
   1667289 ±  2%     +47.7%    2461831 ±  6%  softirqs.CPU17.NET_RX
    137886           +28.3%     176873 ±  4%  softirqs.CPU17.RCU
    243373 ±  2%     +15.8%     281889 ±  6%  softirqs.CPU18.RCU
   3597851 ±  4%     +15.6%    4159558 ±  5%  softirqs.CPU19.NET_RX
    230245 ±  3%     +15.6%     266243 ±  4%  softirqs.CPU19.RCU
   3260027 ±  6%     +20.1%    3915431 ±  5%  softirqs.CPU2.NET_RX
    214070 ±  3%     +18.0%     252670 ±  4%  softirqs.CPU2.RCU
   3336728 ±  6%     +15.6%    3857806 ±  7%  softirqs.CPU20.NET_RX
    219501 ±  3%     +15.3%     253004 ±  4%  softirqs.CPU20.RCU
   3158811 ±  3%     +23.2%    3892880 ± 10%  softirqs.CPU21.NET_RX
    212206 ±  2%     +20.5%     255774 ±  7%  softirqs.CPU21.RCU
    210621 ±  2%     +18.5%     249495 ±  8%  softirqs.CPU22.RCU
   2884709 ±  8%     +27.9%    3690802 ± 13%  softirqs.CPU23.NET_RX
    202022 ±  5%     +22.4%     247237 ±  9%  softirqs.CPU23.RCU
   2664674 ±  4%     +28.4%    3422601 ± 11%  softirqs.CPU24.NET_RX
    191442 ±  3%     +21.9%     233288 ±  8%  softirqs.CPU24.RCU
   2490550 ±  4%     +38.3%    3443438 ± 14%  softirqs.CPU25.NET_RX
    184538 ±  2%     +27.7%     235614 ± 10%  softirqs.CPU25.RCU
   2337283 ±  3%     +40.3%    3278081 ± 15%  softirqs.CPU26.NET_RX
    178781           +27.6%     228079 ± 10%  softirqs.CPU26.RCU
   2220201 ±  2%     +47.3%    3270829 ± 12%  softirqs.CPU27.NET_RX
    172858 ±  2%     +31.6%     227541 ±  8%  softirqs.CPU27.RCU
   2321206 ±  5%     +35.2%    3137549 ± 12%  softirqs.CPU28.NET_RX
    177082 ±  2%     +25.0%     221425 ±  8%  softirqs.CPU28.RCU
   2246678 ±  6%     +31.9%    2964377 ± 12%  softirqs.CPU29.NET_RX
    171083           +24.1%     212231 ±  8%  softirqs.CPU29.RCU
    127186 ± 16%     -14.2%     109173        softirqs.CPU29.TIMER
   3226488 ±  6%     +19.3%    3848958 ±  8%  softirqs.CPU3.NET_RX
    213112 ±  4%     +16.8%     248948 ±  5%  softirqs.CPU3.RCU
   2113065 ±  6%     +31.8%    2785406 ± 10%  softirqs.CPU30.NET_RX
    168449 ±  2%     +22.6%     206573 ±  7%  softirqs.CPU30.RCU
   2115777 ±  3%     +36.7%    2891924 ±  7%  softirqs.CPU31.NET_RX
    168113 ±  2%     +25.3%     210584 ±  4%  softirqs.CPU31.RCU
   1866022 ±  3%     +45.6%    2716794 ± 13%  softirqs.CPU32.NET_RX
    153261           +27.6%     195634 ±  9%  softirqs.CPU32.RCU
   1914777 ±  8%     +36.7%    2618195 ± 13%  softirqs.CPU33.NET_RX
    155525 ±  4%     +23.0%     191256 ±  9%  softirqs.CPU33.RCU
   1918176 ±  7%     +32.2%    2536083 ± 18%  softirqs.CPU34.NET_RX
    156200 ±  4%     +20.8%     188697 ± 11%  softirqs.CPU34.RCU
   1859446 ± 11%     +43.6%    2670610 ± 10%  softirqs.CPU35.NET_RX
    153154 ±  5%     +27.7%     195597 ±  6%  softirqs.CPU35.RCU
   4028702 ±  5%     +17.3%    4725668 ±  5%  softirqs.CPU36.NET_RX
    249892 ±  4%     +15.9%     289642 ±  4%  softirqs.CPU36.RCU
   3901006 ±  4%     +18.5%    4621206 ±  5%  softirqs.CPU37.NET_RX
    246085 ±  3%     +17.5%     289260 ±  4%  softirqs.CPU37.RCU
   3453472 ±  4%     +17.5%    4059413 ±  5%  softirqs.CPU38.NET_RX
    227481 ±  3%     +16.1%     264060 ±  3%  softirqs.CPU38.RCU
   3486864 ±  8%     +16.7%    4070191 ±  8%  softirqs.CPU39.NET_RX
    228240 ±  5%     +16.9%     266796 ±  5%  softirqs.CPU39.RCU
   2847467 ±  9%     +27.0%    3616029 ±  8%  softirqs.CPU4.NET_RX
    196920 ±  6%     +22.9%     242024 ±  5%  softirqs.CPU4.RCU
   3341551 ±  3%     +16.2%    3881977 ±  4%  softirqs.CPU40.NET_RX
    223409 ±  2%     +15.5%     257937 ±  3%  softirqs.CPU40.RCU
   3023399 ±  6%     +23.2%    3726154 ±  6%  softirqs.CPU41.NET_RX
    208766 ±  4%     +19.9%     250363 ±  4%  softirqs.CPU41.RCU
   2957016 ±  6%     +18.3%    3497870 ±  3%  softirqs.CPU42.NET_RX
    205603 ±  3%     +16.4%     239352 ±  2%  softirqs.CPU42.RCU
   2734344 ±  5%     +23.6%    3379733 ±  6%  softirqs.CPU43.NET_RX
    196564 ±  4%     +19.3%     234447 ±  4%  softirqs.CPU43.RCU
   2439722 ±  4%     +26.0%    3073133 ± 13%  softirqs.CPU44.NET_RX
    183663 ±  3%     +20.3%     221001 ±  8%  softirqs.CPU44.RCU
   2347126 ±  2%     +28.6%    3018639 ±  7%  softirqs.CPU45.NET_RX
    179921           +20.9%     217552 ±  4%  softirqs.CPU45.RCU
   2117973 ±  4%     +47.1%    3115648 ±  8%  softirqs.CPU46.NET_RX
    169760 ±  2%     +30.4%     221452 ±  5%  softirqs.CPU46.RCU
   2197927 ±  7%     +32.2%    2905245 ±  4%  softirqs.CPU47.NET_RX
    174027 ±  4%     +22.1%     212537 ±  3%  softirqs.CPU47.RCU
   2209516 ± 13%     +22.3%    2702620 ±  5%  softirqs.CPU48.NET_RX
    171322 ±  7%     +17.4%     201079 ±  3%  softirqs.CPU48.RCU
   2132649 ±  4%     +28.1%    2731631 ±  2%  softirqs.CPU49.NET_RX
    167794 ±  4%     +21.0%     203072        softirqs.CPU49.RCU
   2790329 ± 10%     +26.4%    3526292        softirqs.CPU5.NET_RX
    194162 ±  6%     +22.0%     236849        softirqs.CPU5.RCU
   2085514 ±  3%     +27.6%    2661937 ±  6%  softirqs.CPU50.NET_RX
    167584           +18.0%     197794 ±  4%  softirqs.CPU50.RCU
   1991718 ±  8%     +25.2%    2494153 ±  6%  softirqs.CPU51.NET_RX
    163095 ±  4%     +17.6%     191788 ±  3%  softirqs.CPU51.RCU
   2133613 ±  8%     +22.2%    2606830 ±  7%  softirqs.CPU52.NET_RX
    169663 ±  5%     +17.2%     198894 ±  4%  softirqs.CPU52.RCU
   2066577 ±  7%     +28.5%    2656488 ±  8%  softirqs.CPU53.NET_RX
    166297 ±  3%     +20.1%     199660 ±  4%  softirqs.CPU53.RCU
   4000568 ±  2%     +24.1%    4965013 ±  2%  softirqs.CPU54.NET_RX
    243490           +21.6%     295986 ±  2%  softirqs.CPU54.RCU
   3805713 ±  8%     +27.1%    4838877 ±  3%  softirqs.CPU55.NET_RX
    235071 ±  5%     +24.1%     291795 ±  3%  softirqs.CPU55.RCU
   3335036 ±  3%     +30.0%    4336664 ±  4%  softirqs.CPU56.NET_RX
    215881 ±  2%     +24.1%     268008 ±  3%  softirqs.CPU56.RCU
   3306944 ±  3%     +21.7%    4024256 ±  3%  softirqs.CPU57.NET_RX
    214474 ±  2%     +19.3%     255972 ±  2%  softirqs.CPU57.RCU
   2864592 ±  2%     +30.4%    3734762 ±  8%  softirqs.CPU58.NET_RX
    195973           +24.3%     243647 ±  5%  softirqs.CPU58.RCU
   2683800 ±  2%     +40.3%    3766474 ± 10%  softirqs.CPU59.NET_RX
    188865           +29.8%     245156 ±  7%  softirqs.CPU59.RCU
   2519426 ±  5%     +35.5%    3414021 ±  4%  softirqs.CPU6.NET_RX
    180725 ±  2%     +26.6%     228828 ±  2%  softirqs.CPU6.RCU
   2536942 ±  2%     +38.2%    3506452 ±  6%  softirqs.CPU60.NET_RX
    182554           +28.1%     233925 ±  4%  softirqs.CPU60.RCU
   2409532 ±  9%     +38.7%    3342882 ±  8%  softirqs.CPU61.NET_RX
    176350 ±  5%     +28.5%     226650 ±  5%  softirqs.CPU61.RCU
   2252649 ± 11%     +28.7%    2899665 ±  9%  softirqs.CPU62.NET_RX
    170252 ±  5%     +19.0%     202671 ±  5%  softirqs.CPU62.RCU
   2106398 ±  7%     +34.2%    2825938 ± 13%  softirqs.CPU63.NET_RX
    164218 ±  3%     +23.3%     202447 ±  8%  softirqs.CPU63.RCU
   2170137 ±  9%     +24.5%    2701698 ±  8%  softirqs.CPU64.NET_RX
    167624 ±  5%     +18.0%     197837 ±  5%  softirqs.CPU64.RCU
   2129554 ± 10%     +32.8%    2827714 ±  8%  softirqs.CPU65.NET_RX
    165952 ±  6%     +22.1%     202621 ±  5%  softirqs.CPU65.RCU
   2031092 ±  5%     +31.8%    2677262 ±  7%  softirqs.CPU66.NET_RX
    161584 ±  2%     +22.6%     198169 ±  4%  softirqs.CPU66.RCU
   2106872 ±  4%     +29.9%    2737450 ±  3%  softirqs.CPU67.NET_RX
    164853 ±  2%     +21.7%     200598 ±  2%  softirqs.CPU67.RCU
   2004926 ±  4%     +35.1%    2709009 ± 12%  softirqs.CPU68.NET_RX
    160577 ±  2%     +23.1%     197654 ±  7%  softirqs.CPU68.RCU
   2107869 ±  6%     +33.1%    2805708 ± 11%  softirqs.CPU69.NET_RX
    164080 ±  2%     +23.0%     201767 ±  7%  softirqs.CPU69.RCU
   2618567 ±  6%     +21.3%    3176081 ±  6%  softirqs.CPU7.NET_RX
    186722 ±  4%     +18.6%     221432 ±  4%  softirqs.CPU7.RCU
   1995860 ±  4%     +33.7%    2668106 ±  9%  softirqs.CPU70.NET_RX
    160498 ±  2%     +22.7%     197002 ±  6%  softirqs.CPU70.RCU
   2086691 ±  7%     +24.0%    2588389 ± 14%  softirqs.CPU71.NET_RX
    164539 ±  3%     +17.7%     193735 ±  8%  softirqs.CPU71.RCU
   1583296 ±  5%     +25.5%    1986784 ± 10%  softirqs.CPU72.NET_RX
    146349 ±  3%     +17.8%     172393 ±  5%  softirqs.CPU72.RCU
   1723540 ±  3%     +19.3%    2056671 ±  9%  softirqs.CPU73.NET_RX
    154770           +13.9%     176248 ±  4%  softirqs.CPU73.RCU
   2132400 ±  5%     +13.4%    2418332 ±  6%  softirqs.CPU76.NET_RX
    170748           +13.3%     193404 ±  4%  softirqs.CPU76.RCU
    169841            +9.8%     186537 ±  6%  softirqs.CPU77.RCU
    172572 ±  4%     +12.9%     194754 ±  4%  softirqs.CPU79.RCU
   2165682 ± 10%     +33.0%    2880495 ±  3%  softirqs.CPU8.NET_RX
    168076 ±  5%     +23.6%     207768 ±  2%  softirqs.CPU8.RCU
    173735            +9.6%     190394 ±  6%  softirqs.CPU80.RCU
    170255 ±  5%      +6.9%     182041 ±  6%  softirqs.CPU86.RCU
    120389            -9.3%     109250 ±  2%  softirqs.CPU88.TIMER
   2341253 ± 12%     -17.7%    1927807 ± 13%  softirqs.CPU89.NET_RX
     51644 ±  3%      -7.1%      47971 ±  3%  softirqs.CPU89.SCHED
   2224210 ±  9%     +30.2%    2896872 ±  9%  softirqs.CPU9.NET_RX
    170317 ±  5%     +21.6%     207023 ±  5%  softirqs.CPU9.RCU
   1680399 ± 10%     +32.9%    2233023 ± 13%  softirqs.CPU91.NET_RX
    145790 ±  4%     +21.7%     177408 ±  7%  softirqs.CPU91.RCU
    152008 ±  6%     +13.5%     172492 ±  3%  softirqs.CPU93.RCU
    119850 ±  2%      -8.7%     109385 ±  2%  softirqs.CPU93.TIMER
   1769949 ±  9%     +20.5%    2133146 ±  7%  softirqs.CPU94.NET_RX
    151556 ±  3%     +17.1%     177407 ±  5%  softirqs.CPU94.RCU
    119053 ±  2%      -8.4%     109067 ±  3%  softirqs.CPU94.TIMER
    120111            -9.3%     108987 ±  2%  softirqs.CPU96.TIMER
    119393            -9.6%     107881 ±  2%  softirqs.CPU99.TIMER
 3.185e+08           +18.7%   3.78e+08        softirqs.NET_RX
  24554353           +15.9%   28462115        softirqs.RCU
     39.93            -6.5       33.45 ± 10%  perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
     50.65            -6.0       44.69 ±  6%  perf-profile.calltrace.cycles-pp.secondary_startup_64
     50.31            -6.0       44.35 ±  6%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     50.33            -5.9       44.38 ±  6%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
     50.34            -5.9       44.40 ±  6%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
     45.56            -5.9       39.62 ±  7%  perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
     45.16            -5.7       39.47 ±  7%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
      5.86            -0.8        5.06 ±  6%  perf-profile.calltrace.cycles-pp.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.__sys_connect
      7.05            -0.7        6.31 ±  6%  perf-profile.calltrace.cycles-pp.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect
      4.76            -0.6        4.17 ±  6%  perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect
      1.75 ± 10%      -0.5        1.22        perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
      4.01            -0.5        3.53 ±  6%  perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect.tcp_v4_connect
      3.98            -0.5        3.51 ±  6%  perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect
      4.34            -0.4        3.93 ±  6%  perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect
      2.21            -0.4        1.81 ±  6%  perf-profile.calltrace.cycles-pp.tcp_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
      1.32            -0.4        0.94 ±  6%  perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg
      1.36            -0.4        0.99 ±  5%  perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
      1.41            -0.4        1.05 ±  5%  perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto
      1.05 ±  2%      -0.4        0.69 ±  5%  perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
      1.46            -0.4        1.11 ±  5%  perf-profile.calltrace.cycles-pp.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
      0.56            -0.2        0.41 ± 57%  perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
      0.59 ±  2%      +0.1        0.65 ±  5%  perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
      0.65 ±  2%      +0.1        0.73 ±  4%  perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule_idle.do_idle
      0.55 ±  4%      +0.1        0.64 ±  5%  perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout
      0.61 ±  3%      +0.1        0.71 ±  5%  perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.wait_woken
      0.60 ±  2%      +0.1        0.70 ±  5%  perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_child_process.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
      0.86            +0.1        0.99 ±  4%  perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.93 ±  2%      +0.1        1.07 ±  7%  perf-profile.calltrace.cycles-pp.__x64_sys_bind.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.93            +0.1        1.06 ±  6%  perf-profile.calltrace.cycles-pp.__sys_bind.__x64_sys_bind.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.79            +0.1        0.93 ±  5%  perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
      0.71 ±  2%      +0.2        0.87 ±  4%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      1.32 ±  3%      +0.2        1.48 ±  4%  perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
      0.51            +0.2        0.69 ±  5%  perf-profile.calltrace.cycles-pp.sock_alloc_file.__sys_accept4_file.__sys_accept4.__x64_sys_accept.do_syscall_64
      0.76            +0.2        0.94 ±  6%  perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_child_process
      0.75 ±  2%      +0.2        0.93 ±  6%  perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable
      0.51            +0.2        0.69 ±  5%  perf-profile.calltrace.cycles-pp.alloc_file_pseudo.sock_alloc_file.__sys_accept4_file.__sys_accept4.__x64_sys_accept
      0.77 ±  2%      +0.2        0.95 ±  6%  perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_child_process.tcp_v4_rcv
      0.52 ±  4%      +0.2        0.70 ±  5%  perf-profile.calltrace.cycles-pp.__sk_destruct.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
      0.52            +0.2        0.70 ±  5%  perf-profile.calltrace.cycles-pp.__dentry_kill.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
      0.53 ±  3%      +0.2        0.72 ±  5%  perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.inet_csk_accept.inet_accept.__sys_accept4_file
      0.57 ±  3%      +0.2        0.77 ±  6%  perf-profile.calltrace.cycles-pp.schedule_timeout.inet_csk_accept.inet_accept.__sys_accept4_file.__sys_accept4
      0.53            +0.2        0.73 ±  8%  perf-profile.calltrace.cycles-pp.sock_alloc_file.__sys_socket.__x64_sys_socket.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.83            +0.2        1.03 ±  6%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_child_process.tcp_v4_rcv.ip_protocol_deliver_rcu
      0.65 ±  2%      +0.2        0.85 ±  5%  perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_wakeup.tcp_fin
      0.52            +0.2        0.73 ±  8%  perf-profile.calltrace.cycles-pp.alloc_file_pseudo.sock_alloc_file.__sys_socket.__x64_sys_socket.do_syscall_64
      1.25 ±  2%      +0.2        1.46 ±  5%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_woken.sk_wait_data
      0.90            +0.2        1.11 ±  6%  perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_child_process.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
      0.68 ±  2%      +0.2        0.90 ±  5%  perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_wakeup.tcp_fin.tcp_data_queue
      1.38 ±  2%      +0.2        1.60 ±  5%  perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg
      1.31            +0.2        1.53 ±  5%  perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg
      0.58 ±  2%      +0.2        0.81 ±  4%  perf-profile.calltrace.cycles-pp.tcp_send_fin.tcp_close.inet_release.__sock_release.sock_close
      0.73 ±  2%      +0.2        0.97 ±  5%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_wakeup.tcp_fin.tcp_data_queue.tcp_rcv_established
      1.49            +0.2        1.73 ±  6%  perf-profile.calltrace.cycles-pp.__sock_create.__sys_socket.__x64_sys_socket.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.38 ±  3%      +0.2        1.62 ±  6%  perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.tcp_close.inet_release.__sock_release
      1.37 ±  3%      +0.2        1.61 ±  6%  perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.tcp_close.inet_release
      0.76 ±  2%      +0.2        1.00 ±  6%  perf-profile.calltrace.cycles-pp.sock_def_wakeup.tcp_fin.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv
      1.41 ±  3%      +0.2        1.65 ±  6%  perf-profile.calltrace.cycles-pp.__release_sock.tcp_close.inet_release.__sock_release.sock_close
      0.81 ±  3%      +0.2        1.06 ±  6%  perf-profile.calltrace.cycles-pp.tcp_fin.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
      0.75 ±  3%      +0.2        1.00 ±  6%  perf-profile.calltrace.cycles-pp.sk_clone_lock.inet_csk_clone_lock.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req
      0.77 ±  2%      +0.3        1.02 ±  6%  perf-profile.calltrace.cycles-pp.inet_csk_clone_lock.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_rcv
      0.68            +0.3        0.94 ±  5%  perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established
      0.89 ±  2%      +0.3        1.15 ±  6%  perf-profile.calltrace.cycles-pp.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_rcv.ip_protocol_deliver_rcu
      1.60 ±  2%      +0.3        1.87 ±  5%  perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
      0.72            +0.3        1.00 ±  5%  perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv
      1.69            +0.3        1.98 ±  4%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      1.73            +0.3        2.02 ±  4%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
      1.61 ±  2%      +0.3        1.91 ±  5%  perf-profile.calltrace.cycles-pp.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
      0.40 ± 57%      +0.3        0.70 ±  5%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.inet_csk_accept.inet_accept
      0.97 ±  2%      +0.3        1.28 ±  6%  perf-profile.calltrace.cycles-pp.inet_csk_accept.inet_accept.__sys_accept4_file.__sys_accept4.__x64_sys_accept
      0.78            +0.3        1.08 ±  5%  perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
      0.83            +0.3        1.15 ±  5%  perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
      1.54            +0.3        1.88 ±  5%  perf-profile.calltrace.cycles-pp.tcp_child_process.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
      0.25 ±100%      +0.4        0.65 ±  6%  perf-profile.calltrace.cycles-pp.__sk_destruct.inet_release.__sock_release.sock_close.__fput
      2.07            +0.5        2.53 ±  7%  perf-profile.calltrace.cycles-pp.__x64_sys_socket.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.06            +0.5        2.52 ±  7%  perf-profile.calltrace.cycles-pp.__sys_socket.__x64_sys_socket.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.13 ±173%      +0.5        0.63 ±  6%  perf-profile.calltrace.cycles-pp.security_file_free.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
      0.13 ±173%      +0.5        0.63 ±  6%  perf-profile.calltrace.cycles-pp.apparmor_file_free_security.security_file_free.__fput.task_work_run.exit_to_usermode_loop
      4.47            +0.5        5.00 ±  5%  perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_synsent_state_process.tcp_rcv_state_process.tcp_v4_do_rcv
      0.00            +0.5        0.54 ±  4%  perf-profile.calltrace.cycles-pp.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv
      4.25            +0.5        4.79 ±  5%  perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_synsent_state_process
      0.00            +0.6        0.55 ±  5%  perf-profile.calltrace.cycles-pp.__sk_mem_reduce_allocated.tcp_close.inet_release.__sock_release.sock_close
      0.00            +0.6        0.55 ±  4%  perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
      4.59            +0.6        5.15 ±  5%  perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_rcv_synsent_state_process.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock
      0.00            +0.6        0.56 ±  4%  perf-profile.calltrace.cycles-pp.lock_sock_nested.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
      4.33            +0.6        4.89 ±  5%  perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_synsent_state_process.tcp_rcv_state_process
      0.00            +0.6        0.58 ±  6%  perf-profile.calltrace.cycles-pp.inet_csk_destroy_sock.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.tcp_close
      0.00            +0.6        0.58 ±  9%  perf-profile.calltrace.cycles-pp.tcp_done.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv
      0.00            +0.6        0.64 ±  5%  perf-profile.calltrace.cycles-pp.inet_csk_destroy_sock.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv
      1.71            +0.6        2.35 ±  5%  perf-profile.calltrace.cycles-pp.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv
      1.74            +0.7        2.40 ±  5%  perf-profile.calltrace.cycles-pp.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
      0.00            +0.7        0.69 ± 32%  perf-profile.calltrace.cycles-pp.__inet_lookup_established.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
      4.01            +0.8        4.79 ±  5%  perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
      3.21            +0.8        4.04 ±  5%  perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
      4.40 ±  2%      +0.9        5.26 ±  4%  perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64
      4.42 ±  2%      +0.9        5.29 ±  4%  perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.31 ±  2%      +0.9        2.25 ±  4%  perf-profile.calltrace.cycles-pp.inet_accept.__sys_accept4_file.__sys_accept4.__x64_sys_accept.do_syscall_64
      4.91            +1.0        5.91 ±  4%  perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
      4.89            +1.0        5.89 ±  4%  perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
      8.90            +1.1        9.95 ±  5%  perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
      2.15            +1.2        3.37 ±  4%  perf-profile.calltrace.cycles-pp.__sys_accept4_file.__sys_accept4.__x64_sys_accept.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.19 ±  2%      +1.2        3.42 ±  4%  perf-profile.calltrace.cycles-pp.__x64_sys_accept.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.18 ±  2%      +1.2        3.41 ±  4%  perf-profile.calltrace.cycles-pp.__sys_accept4.__x64_sys_accept.do_syscall_64.entry_SYSCALL_64_after_hwframe
      7.99            +1.3        9.31 ±  4%  perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_close.inet_release.__sock_release
      6.61            +1.3        7.94 ±  5%  perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_close
      8.00            +1.3        9.33 ±  4%  perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_close.inet_release.__sock_release.sock_close
      6.86            +1.4        8.27 ±  4%  perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_close.inet_release
     11.56            +1.7       13.28 ±  4%  perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit
     11.70            +1.7       13.44 ±  4%  perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
     10.78            +2.1       12.86 ±  4%  perf-profile.calltrace.cycles-pp.tcp_close.inet_release.__sock_release.sock_close.__fput
     11.34            +2.3       13.63 ±  5%  perf-profile.calltrace.cycles-pp.inet_release.__sock_release.sock_close.__fput.task_work_run
     11.45            +2.3       13.78 ±  5%  perf-profile.calltrace.cycles-pp.__sock_release.sock_close.__fput.task_work_run.exit_to_usermode_loop
     11.46            +2.3       13.80 ±  5%  perf-profile.calltrace.cycles-pp.sock_close.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
     15.90            +2.4       18.32 ±  5%  perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core
     15.93            +2.4       18.36 ±  5%  perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog
     15.50            +2.5       17.96 ±  5%  perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv
     15.97            +2.5       18.45 ±  5%  perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action
     12.72            +2.7       15.47 ±  5%  perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
     12.89            +2.8       15.68 ±  5%  perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
     13.00            +2.8       15.84 ±  5%  perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
     47.98            +5.6       53.61 ±  5%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
     48.15            +5.7       53.81 ±  5%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     40.11            -6.5       33.62 ± 10%  perf-profile.children.cycles-pp.intel_idle
     50.63            -6.0       44.67 ±  6%  perf-profile.children.cycles-pp.do_idle
     50.65            -6.0       44.69 ±  6%  perf-profile.children.cycles-pp.secondary_startup_64
     50.65            -6.0       44.69 ±  6%  perf-profile.children.cycles-pp.cpu_startup_entry
     45.83            -6.0       39.88 ±  7%  perf-profile.children.cycles-pp.cpuidle_enter
     45.82            -6.0       39.87 ±  7%  perf-profile.children.cycles-pp.cpuidle_enter_state
     50.34            -5.9       44.40 ±  6%  perf-profile.children.cycles-pp.start_secondary
      1.83            -1.6        0.22 ±  6%  perf-profile.children.cycles-pp.tcp_schedule_loss_probe
      1.57            -1.3        0.30 ±  7%  perf-profile.children.cycles-pp.ip_rcv_finish_core
      1.59            -1.3        0.34 ±  6%  perf-profile.children.cycles-pp.ip_rcv_finish
      5.86            -0.8        5.06 ±  6%  perf-profile.children.cycles-pp.tcp_connect
      7.05            -0.7        6.31 ±  6%  perf-profile.children.cycles-pp.tcp_v4_connect
      2.92            -0.7        2.21 ±  5%  perf-profile.children.cycles-pp.tcp_ack
      0.68            -0.6        0.13 ±  5%  perf-profile.children.cycles-pp.tcp_parse_options
      1.77 ± 10%      -0.5        1.22        perf-profile.children.cycles-pp.menu_select
      0.56 ±  3%      -0.4        0.14 ±  6%  perf-profile.children.cycles-pp.tcp_sync_mss
      0.45            -0.4        0.06        perf-profile.children.cycles-pp.tcp_stream_memory_free
      2.21            -0.4        1.82 ±  6%  perf-profile.children.cycles-pp.tcp_conn_request
      0.46 ±  2%      -0.4        0.08        perf-profile.children.cycles-pp.secure_tcp_ts_off
      0.55 ±  3%      -0.3        0.21 ±  8%  perf-profile.children.cycles-pp.tcp_connect_init
      0.33 ±  2%      -0.3        0.07 ± 10%  perf-profile.children.cycles-pp.tcp_mtup_init
      0.17            -0.1        0.07 ± 17%  perf-profile.children.cycles-pp.inet_lhash2_lookup
      0.19            -0.1        0.11 ± 15%  perf-profile.children.cycles-pp.__inet_lookup_listener
      0.17 ±  7%      -0.0        0.13 ±  9%  perf-profile.children.cycles-pp.irq_enter
      0.08 ± 10%      -0.0        0.04 ± 58%  perf-profile.children.cycles-pp.ip_build_and_send_pkt
      0.14 ±  9%      -0.0        0.10 ±  8%  perf-profile.children.cycles-pp.tick_irq_enter
      0.05            +0.0        0.06        perf-profile.children.cycles-pp.bictcp_acked
      0.07            +0.0        0.08 ±  5%  perf-profile.children.cycles-pp._atomic_dec_and_lock
      0.05 ±  8%      +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.__calc_delta
      0.06 ± 11%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.tcp_release_cb
      0.05 ±  8%      +0.0        0.07 ± 10%  perf-profile.children.cycles-pp.__cgroup_bpf_run_filter_sock_ops
      0.05 ±  8%      +0.0        0.07        perf-profile.children.cycles-pp.move_addr_to_kernel
      0.05            +0.0        0.07 ±  6%  perf-profile.children.cycles-pp.__list_del_entry_valid
      0.05 ±  9%      +0.0        0.07 ±  5%  perf-profile.children.cycles-pp.account_entity_dequeue
      0.06 ±  7%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.kfree_skbmem
      0.11 ±  4%      +0.0        0.12 ±  4%  perf-profile.children.cycles-pp.cgroup_rstat_updated
      0.10 ±  5%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.tcp_current_mss
      0.07 ± 11%      +0.0        0.09 ±  4%  perf-profile.children.cycles-pp._copy_to_user
      0.11            +0.0        0.13 ±  5%  perf-profile.children.cycles-pp._raw_spin_trylock
      0.07 ±  5%      +0.0        0.09 ±  8%  perf-profile.children.cycles-pp.tcp_init_buffer_space
      0.08            +0.0        0.10        perf-profile.children.cycles-pp.tcp_cleanup_rbuf
      0.07 ±  5%      +0.0        0.09 ±  8%  perf-profile.children.cycles-pp.security_socket_bind
      0.07 ±  5%      +0.0        0.09 ±  8%  perf-profile.children.cycles-pp.tcp_send_mss
      0.07 ± 15%      +0.0        0.09 ±  8%  perf-profile.children.cycles-pp.tcp_openreq_init_rwin
      0.06 ±  6%      +0.0        0.08 ± 10%  perf-profile.children.cycles-pp.skb_page_frag_refill
      0.05 ±  9%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.tcp_check_space
      0.08 ±  5%      +0.0        0.10 ±  7%  perf-profile.children.cycles-pp.rcu_segcblist_enqueue
      0.06 ±  6%      +0.0        0.09 ± 13%  perf-profile.children.cycles-pp.sk_page_frag_refill
      0.13 ±  5%      +0.0        0.15 ±  7%  perf-profile.children.cycles-pp.__cgroup_account_cputime
      0.12 ±  5%      +0.0        0.14 ±  5%  perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
      0.09            +0.0        0.11 ±  7%  perf-profile.children.cycles-pp.inode_init_always
      0.08 ±  6%      +0.0        0.10 ±  7%  perf-profile.children.cycles-pp.iput
      0.04 ± 57%      +0.0        0.06 ±  6%  perf-profile.children.cycles-pp.put_prev_task_fair
      0.06 ±  9%      +0.0        0.08 ±  8%  perf-profile.children.cycles-pp._raw_spin_lock_irq
      0.06 ±  9%      +0.0        0.08 ±  8%  perf-profile.children.cycles-pp.fsnotify_destroy_marks
      0.08 ±  5%      +0.0        0.10 ±  4%  perf-profile.children.cycles-pp.netif_skb_features
      0.06            +0.0        0.09 ± 10%  perf-profile.children.cycles-pp.rcu_all_qs
      0.16 ±  4%      +0.0        0.19 ±  6%  perf-profile.children.cycles-pp.__update_load_avg_se
      0.08 ±  5%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.memset_erms
      0.04 ± 57%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.kfree_skb
      0.06 ±  9%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.tcp_update_skb_after_send
      0.04 ± 58%      +0.0        0.07 ± 12%  perf-profile.children.cycles-pp.del_timer_sync
      0.06 ±  7%      +0.0        0.09 ± 10%  perf-profile.children.cycles-pp.move_addr_to_user
      0.11 ±  7%      +0.0        0.14 ±  3%  perf-profile.children.cycles-pp.simple_copy_to_iter
      0.18 ±  2%      +0.0        0.21 ±  2%  perf-profile.children.cycles-pp.__check_object_size
      0.14 ±  3%      +0.0        0.17 ±  5%  perf-profile.children.cycles-pp.finish_task_switch
      0.08 ±  5%      +0.0        0.11 ±  9%  perf-profile.children.cycles-pp.dput
      0.07 ±  7%      +0.0        0.10 ±  9%  perf-profile.children.cycles-pp.kmem_cache_alloc_trace
      0.07 ±  7%      +0.0        0.10 ± 11%  perf-profile.children.cycles-pp.tcp_queue_rcv
      0.07 ± 12%      +0.0        0.10 ±  8%  perf-profile.children.cycles-pp.sock_setsockopt
      0.08 ±  5%      +0.0        0.12 ± 13%  perf-profile.children.cycles-pp.raw_local_deliver
      0.18            +0.0        0.21 ±  3%  perf-profile.children.cycles-pp.pick_next_entity
      0.15 ±  3%      +0.0        0.18 ±  4%  perf-profile.children.cycles-pp.account_entity_enqueue
      0.14 ±  3%      +0.0        0.17 ±  2%  perf-profile.children.cycles-pp.tcp_rcv_space_adjust
      0.14 ±  3%      +0.0        0.17 ±  5%  perf-profile.children.cycles-pp.scheduler_tick
      0.13 ±  5%      +0.0        0.16 ±  9%  perf-profile.children.cycles-pp.sk_setup_caps
      0.07 ±  5%      +0.0        0.11 ±  4%  perf-profile.children.cycles-pp.tcp_init_xmit_timers
      0.07            +0.0        0.10 ± 12%  perf-profile.children.cycles-pp.inet_twsk_alloc
      0.07            +0.0        0.10 ±  4%  perf-profile.children.cycles-pp.nf_hook_slow
      0.06            +0.0        0.09 ±  8%  perf-profile.children.cycles-pp.__get_user_4
      0.08 ±  6%      +0.0        0.11 ±  6%  perf-profile.children.cycles-pp.__destroy_inode
      0.21 ±  6%      +0.0        0.24 ±  3%  perf-profile.children.cycles-pp.__x64_sys_close
      0.03 ±100%      +0.0        0.06 ±  6%  perf-profile.children.cycles-pp.minmax_running_min
      0.18 ±  2%      +0.0        0.22 ±  3%  perf-profile.children.cycles-pp.__netif_receive_skb_core
      0.17 ±  2%      +0.0        0.21 ±  5%  perf-profile.children.cycles-pp.update_ts_time_stats
      0.11 ±  4%      +0.0        0.15 ±  5%  perf-profile.children.cycles-pp.resched_curr
      0.09 ±  4%      +0.0        0.13        perf-profile.children.cycles-pp.sock_put
      0.09 ±  7%      +0.0        0.13 ±  6%  perf-profile.children.cycles-pp.apparmor_sk_alloc_security
      0.06 ±  7%      +0.0        0.10 ±  5%  perf-profile.children.cycles-pp.inet_sock_destruct
      0.04 ± 57%      +0.0        0.08 ±  6%  perf-profile.children.cycles-pp.rcu_eqs_enter
      0.11 ±  6%      +0.0        0.15 ±  8%  perf-profile.children.cycles-pp.d_alloc_pseudo
      0.18 ±  3%      +0.0        0.22 ±  7%  perf-profile.children.cycles-pp.reweight_entity
      0.55 ±  4%      +0.0        0.59 ±  3%  perf-profile.children.cycles-pp.irq_exit
      0.19 ±  2%      +0.0        0.23 ±  4%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      0.03 ±100%      +0.0        0.07 ±  7%  perf-profile.children.cycles-pp.__hrtimer_init
      0.22 ±  3%      +0.0        0.26 ±  5%  perf-profile.children.cycles-pp.__kmalloc_reserve
      0.15 ±  5%      +0.0        0.19 ±  8%  perf-profile.children.cycles-pp.fib_table_lookup
      0.14 ±  7%      +0.0        0.18 ±  5%  perf-profile.children.cycles-pp.kfree
      0.12 ±  3%      +0.0        0.16 ±  8%  perf-profile.children.cycles-pp.__fget_light
      0.11 ±  4%      +0.0        0.15 ±  7%  perf-profile.children.cycles-pp.copyout
      0.09 ±  4%      +0.0        0.13 ±  3%  perf-profile.children.cycles-pp.security_sk_alloc
      0.11 ±  7%      +0.0        0.15 ±  8%  perf-profile.children.cycles-pp.__d_alloc
      0.19 ±  3%      +0.0        0.23 ±  7%  perf-profile.children.cycles-pp.__kmalloc_node_track_caller
      0.15 ±  7%      +0.0        0.20 ±  2%  perf-profile.children.cycles-pp.security_socket_getsockopt
      0.08 ±  6%      +0.0        0.12 ±  9%  perf-profile.children.cycles-pp.destroy_inode
      0.01 ±173%      +0.0        0.05 ±  9%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.01 ±173%      +0.0        0.05 ±  9%  perf-profile.children.cycles-pp.tcp_v4_inbound_md5_hash
      0.18 ±  2%      +0.0        0.22 ±  5%  perf-profile.children.cycles-pp.nr_iowait_cpu
      0.15 ±  5%      +0.0        0.19 ±  6%  perf-profile.children.cycles-pp.sock_getsockopt
      0.16 ±  4%      +0.0        0.20 ±  7%  perf-profile.children.cycles-pp.memcg_kmem_get_cache
      0.12 ±  3%      +0.0        0.17 ± 12%  perf-profile.children.cycles-pp._cond_resched
      0.14 ±  3%      +0.0        0.18 ±  6%  perf-profile.children.cycles-pp.__indirect_thunk_start
      0.13            +0.0        0.17 ±  2%  perf-profile.children.cycles-pp.__might_fault
      0.13 ±  7%      +0.0        0.17 ±  7%  perf-profile.children.cycles-pp.sock_alloc_inode
      0.10 ±  8%      +0.0        0.15 ±  3%  perf-profile.children.cycles-pp.d_instantiate
      0.27 ±  2%      +0.0        0.32 ±  4%  perf-profile.children.cycles-pp.tick_nohz_idle_exit
      0.04 ± 57%      +0.0        0.08 ± 10%  perf-profile.children.cycles-pp.tcp_rearm_rto
      0.17 ±  2%      +0.0        0.21 ±  9%  perf-profile.children.cycles-pp.copy_user_generic_unrolled
      0.16 ±  2%      +0.0        0.20 ±  5%  perf-profile.children.cycles-pp.validate_xmit_skb
      0.14 ±  5%      +0.0        0.19 ±  6%  perf-profile.children.cycles-pp._copy_to_iter
      0.13 ±  3%      +0.0        0.17 ±  4%  perf-profile.children.cycles-pp.sockfd_lookup_light
      0.01 ±173%      +0.0        0.06        perf-profile.children.cycles-pp.menu_reflect
      0.16            +0.0        0.21 ±  5%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.12            +0.0        0.17 ±  4%  perf-profile.children.cycles-pp.ip_send_check
      0.18 ±  2%      +0.0        0.23 ±  8%  perf-profile.children.cycles-pp.sock_rfree
      0.20 ±  2%      +0.0        0.24 ±  6%  perf-profile.children.cycles-pp.__ksize
      0.18 ±  6%      +0.0        0.23 ±  8%  perf-profile.children.cycles-pp.rcu_do_batch
      0.10 ±  4%      +0.0        0.15 ± 11%  perf-profile.children.cycles-pp.run_ksoftirqd
      0.01 ±173%      +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.security_sock_rcv_skb
      0.00            +0.1        0.05        perf-profile.children.cycles-pp.tcp_select_initial_window
      0.03 ±100%      +0.1        0.08 ± 11%  perf-profile.children.cycles-pp.fsnotify_grab_connector
      0.15            +0.1        0.20 ±  3%  perf-profile.children.cycles-pp.check_preempt_curr
      0.21 ±  3%      +0.1        0.26 ±  4%  perf-profile.children.cycles-pp.call_rcu
      0.13 ±  3%      +0.1        0.18 ±  2%  perf-profile.children.cycles-pp.ip_finish_output
      0.00            +0.1        0.05 ±  8%  perf-profile.children.cycles-pp.ip_queue_xmit
      0.17 ±  3%      +0.1        0.22 ±  5%  perf-profile.children.cycles-pp.__x64_sys_setsockopt
      0.11 ±  3%      +0.1        0.17 ± 10%  perf-profile.children.cycles-pp.smpboot_thread_fn
      0.23 ±  5%      +0.1        0.28 ±  6%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.28 ±  2%      +0.1        0.33 ±  6%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.26 ±  2%      +0.1        0.32 ±  6%  perf-profile.children.cycles-pp.__switch_to_asm
      0.19 ±  2%      +0.1        0.25 ±  5%  perf-profile.children.cycles-pp.sk_filter_trim_cap
      0.00            +0.1        0.05 ±  9%  perf-profile.children.cycles-pp.inet_sk_rx_dst_set
      0.00            +0.1        0.05 ±  9%  perf-profile.children.cycles-pp.try_to_del_timer_sync
      0.03 ±100%      +0.1        0.08 ±  8%  perf-profile.children.cycles-pp.tcp_synack_rtt_meas
      0.01 ±173%      +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.__d_instantiate
      0.13 ±  5%      +0.1        0.19 ± 11%  perf-profile.children.cycles-pp.ret_from_fork
      0.13 ±  5%      +0.1        0.19 ± 11%  perf-profile.children.cycles-pp.kthread
      0.20 ±  5%      +0.1        0.26 ±  8%  perf-profile.children.cycles-pp.__inet_inherit_port
      0.19 ±  3%      +0.1        0.25 ±  8%  perf-profile.children.cycles-pp.entry_SYSCALL_64
      0.15 ±  3%      +0.1        0.20 ±  6%  perf-profile.children.cycles-pp.ipv4_mtu
      0.14 ±  6%      +0.1        0.19 ±  4%  perf-profile.children.cycles-pp.sk_stream_kill_queues
      0.00            +0.1        0.06 ±  7%  perf-profile.children.cycles-pp.__inet_twsk_schedule
      0.15 ±  2%      +0.1        0.21 ±  3%  perf-profile.children.cycles-pp.__ip_local_out
      0.16 ±  5%      +0.1        0.22 ±  6%  perf-profile.children.cycles-pp.del_timer
      0.27 ±  4%      +0.1        0.33 ±  5%  perf-profile.children.cycles-pp.__tcp_send_ack
      0.16 ±  2%      +0.1        0.22 ±  5%  perf-profile.children.cycles-pp.__sys_setsockopt
      0.27            +0.1        0.33 ±  2%  perf-profile.children.cycles-pp.tick_sched_handle
      0.26 ±  5%      +0.1        0.32 ±  7%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.16 ±  4%      +0.1        0.22 ±  3%  perf-profile.children.cycles-pp.__might_sleep
      0.00            +0.1        0.06 ±  6%  perf-profile.children.cycles-pp.__list_add_valid
      0.00            +0.1        0.06 ± 13%  perf-profile.children.cycles-pp.calc_global_load_tick
      0.12 ±  3%      +0.1        0.18 ±  8%  perf-profile.children.cycles-pp.evict
      0.22            +0.1        0.29 ±  6%  perf-profile.children.cycles-pp.security_socket_sendmsg
      0.17 ±  3%      +0.1        0.23 ±  3%  perf-profile.children.cycles-pp.ip_local_out
      0.14 ±  3%      +0.1        0.21 ±  8%  perf-profile.children.cycles-pp.kmem_cache_alloc_node
      0.00            +0.1        0.07 ±  7%  perf-profile.children.cycles-pp.inet_ehash_nolisten
      0.00            +0.1        0.07 ±  7%  perf-profile.children.cycles-pp.tcp_rack_update_reo_wnd
      0.20 ±  4%      +0.1        0.27 ±  6%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.18 ±  2%      +0.1        0.25 ±  2%  perf-profile.children.cycles-pp.__cgroup_bpf_run_filter_skb
      0.00            +0.1        0.07 ± 12%  perf-profile.children.cycles-pp.skb_entail
      0.00            +0.1        0.07 ±  6%  perf-profile.children.cycles-pp.ip_copy_addrs
      0.21 ±  2%      +0.1        0.28 ± 20%  perf-profile.children.cycles-pp.ktime_get_with_offset
      0.31 ±  2%      +0.1        0.38 ±  5%  perf-profile.children.cycles-pp.native_sched_clock
      0.26 ±  2%      +0.1        0.33 ±  2%  perf-profile.children.cycles-pp.update_process_times
      0.20 ±  2%      +0.1        0.27 ±  4%  perf-profile.children.cycles-pp.__skb_clone
      0.00            +0.1        0.07 ± 10%  perf-profile.children.cycles-pp.ipv4_default_advmss
      0.26 ±  4%      +0.1        0.33 ±  7%  perf-profile.children.cycles-pp.rcu_core
      0.23 ±  2%      +0.1        0.30 ±  6%  perf-profile.children.cycles-pp.enqueue_to_backlog
      0.22 ±  3%      +0.1        0.29 ±  7%  perf-profile.children.cycles-pp.alloc_inode
      0.33 ±  3%      +0.1        0.40 ±  6%  perf-profile.children.cycles-pp.sched_clock
      0.00            +0.1        0.07 ±  5%  perf-profile.children.cycles-pp.tcp_assign_congestion_control
      0.34            +0.1        0.42 ±  5%  perf-profile.children.cycles-pp.tcp_mstamp_refresh
      0.31 ±  6%      +0.1        0.39 ±  6%  perf-profile.children.cycles-pp.security_sk_clone
      0.08 ±  5%      +0.1        0.16 ±  4%  perf-profile.children.cycles-pp.inet_sk_rebuild_header
      0.19 ±  4%      +0.1        0.27 ±  9%  perf-profile.children.cycles-pp.inet_csk_clear_xmit_timers
      0.31 ±  6%      +0.1        0.39 ±  6%  perf-profile.children.cycles-pp.apparmor_sk_clone_security
      0.01 ±173%      +0.1        0.09 ± 11%  perf-profile.children.cycles-pp.inet_reqsk_alloc
      0.26 ±  2%      +0.1        0.34 ±  3%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.07 ±  6%      +0.1        0.15 ±  5%  perf-profile.children.cycles-pp.tcp_update_pacing_rate
      0.38 ±  4%      +0.1        0.46 ±  3%  perf-profile.children.cycles-pp.update_curr
      0.04 ± 57%      +0.1        0.12 ± 18%  perf-profile.children.cycles-pp.inet_twsk_hashdance
      0.36 ±  2%      +0.1        0.44 ±  6%  perf-profile.children.cycles-pp.sched_clock_cpu
      0.35 ±  3%      +0.1        0.44 ±  2%  perf-profile.children.cycles-pp.tick_sched_timer
      0.23 ±  7%      +0.1        0.32 ±  7%  perf-profile.children.cycles-pp.inet_unhash
      0.19            +0.1        0.27 ±  6%  perf-profile.children.cycles-pp.inet_ehash_insert
      0.22 ±  5%      +0.1        0.30 ±  7%  perf-profile.children.cycles-pp.sk_stop_timer
      0.20 ±  4%      +0.1        0.28 ±  5%  perf-profile.children.cycles-pp.sk_prot_alloc
      0.28 ±  4%      +0.1        0.36 ±  6%  perf-profile.children.cycles-pp.apparmor_sk_free_security
      0.46 ±  3%      +0.1        0.55 ±  2%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      0.28            +0.1        0.37 ±  5%  perf-profile.children.cycles-pp.inet_csk_reqsk_queue_hash_add
      0.06 ±  9%      +0.1        0.15 ±  7%  perf-profile.children.cycles-pp.inet_lookup_ifaddr_rcu
      0.66            +0.1        0.75 ±  4%  perf-profile.children.cycles-pp.set_next_entity
      0.54 ±  2%      +0.1        0.63 ±  6%  perf-profile.children.cycles-pp.ip_route_output_flow
      0.36 ±  2%      +0.1        0.45 ±  3%  perf-profile.children.cycles-pp.security_socket_recvmsg
      0.22 ±  5%      +0.1        0.31 ±  6%  perf-profile.children.cycles-pp.__slab_free
      0.07 ±  7%      +0.1        0.16 ±  6%  perf-profile.children.cycles-pp.__ip_dev_find
      0.00            +0.1        0.09 ±  4%  perf-profile.children.cycles-pp.sock_prot_inuse_add
      0.37 ±  2%      +0.1        0.46 ±  6%  perf-profile.children.cycles-pp.sk_alloc
      0.40 ±  3%      +0.1        0.49 ±  5%  perf-profile.children.cycles-pp.__skb_datagram_iter
      0.37            +0.1        0.46 ±  7%  perf-profile.children.cycles-pp.___might_sleep
      0.27 ±  3%      +0.1        0.36 ±  7%  perf-profile.children.cycles-pp.tcp_write_queue_purge
      0.34 ±  3%      +0.1        0.44 ±  6%  perf-profile.children.cycles-pp.apparmor_socket_post_create
      0.32 ±  2%      +0.1        0.42 ±  5%  perf-profile.children.cycles-pp.skb_release_head_state
      0.36            +0.1        0.46 ±  2%  perf-profile.children.cycles-pp.sock_recvmsg
      0.34 ±  3%      +0.1        0.44 ±  6%  perf-profile.children.cycles-pp.security_socket_post_create
      0.29 ±  5%      +0.1        0.38 ±  8%  perf-profile.children.cycles-pp.__inet_check_established
      0.00            +0.1        0.10 ±  4%  perf-profile.children.cycles-pp.__sk_free
      0.11 ±  4%      +0.1        0.21 ± 10%  perf-profile.children.cycles-pp.inet_twsk_kill
      0.41 ±  2%      +0.1        0.50 ±  5%  perf-profile.children.cycles-pp.skb_copy_datagram_iter
      0.37 ±  5%      +0.1        0.47 ±  5%  perf-profile.children.cycles-pp.clockevents_program_event
      0.79            +0.1        0.89 ±  6%  perf-profile.children.cycles-pp.ip_route_output_key_hash
      0.29 ±  3%      +0.1        0.39 ±  6%  perf-profile.children.cycles-pp.security_sk_free
      0.34            +0.1        0.44 ±  5%  perf-profile.children.cycles-pp.skb_release_all
      0.46            +0.1        0.56 ±  2%  perf-profile.children.cycles-pp.dst_release
      0.11 ±  4%      +0.1        0.21 ±  5%  perf-profile.children.cycles-pp.tcp_ack_update_rtt
      0.36 ±  2%      +0.1        0.46 ±  4%  perf-profile.children.cycles-pp.skb_release_data
      0.58            +0.1        0.68 ±  7%  perf-profile.children.cycles-pp.update_rq_clock
      0.29 ±  3%      +0.1        0.40 ±  7%  perf-profile.children.cycles-pp.new_inode_pseudo
      0.12            +0.1        0.23 ±  7%  perf-profile.children.cycles-pp.inet_twsk_deschedule_put
      0.75            +0.1        0.86 ±  6%  perf-profile.children.cycles-pp.update_load_avg
      0.30 ±  3%      +0.1        0.41 ±  6%  perf-profile.children.cycles-pp.sock_alloc
      0.23            +0.1        0.34 ± 13%  perf-profile.children.cycles-pp.inet_put_port
      0.40 ±  4%      +0.1        0.52 ±  5%  perf-profile.children.cycles-pp.__sys_getsockopt
      0.31 ±  2%      +0.1        0.43 ±  5%  perf-profile.children.cycles-pp.tcp_finish_connect
      0.00            +0.1        0.12 ±  5%  perf-profile.children.cycles-pp.__tcp_select_window
      0.50 ±  2%      +0.1        0.63 ±  4%  perf-profile.children.cycles-pp.tcp_event_new_data_sent
      0.40 ±  4%      +0.1        0.53 ±  5%  perf-profile.children.cycles-pp.__x64_sys_getsockopt
      0.34 ±  2%      +0.1        0.46 ±  3%  perf-profile.children.cycles-pp.lock_timer_base
      0.42 ±  3%      +0.1        0.55 ± 11%  perf-profile.children.cycles-pp.netif_rx_internal
      0.36 ±  3%      +0.1        0.50 ±  6%  perf-profile.children.cycles-pp.kmem_cache_free
      0.42 ±  3%      +0.1        0.56 ± 11%  perf-profile.children.cycles-pp.netif_rx
      0.38 ±  4%      +0.1        0.51 ±  8%  perf-profile.children.cycles-pp.inet_csk_bind_conflict
      0.42 ±  3%      +0.1        0.55 ±  7%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.93 ±  2%      +0.1        1.07 ±  7%  perf-profile.children.cycles-pp.__x64_sys_bind
      0.49 ±  2%      +0.1        0.63 ±  6%  perf-profile.children.cycles-pp.security_file_free
      0.93            +0.1        1.06 ±  6%  perf-profile.children.cycles-pp.__sys_bind
      0.32 ±  5%      +0.1        0.46 ±  7%  perf-profile.children.cycles-pp.__inet_hash_connect
      0.49 ±  3%      +0.1        0.63 ±  6%  perf-profile.children.cycles-pp.apparmor_file_free_security
      0.95            +0.1        1.10 ±  3%  perf-profile.children.cycles-pp.pick_next_task_fair
      1.27            +0.1        1.42 ±  4%  perf-profile.children.cycles-pp.ktime_get
      0.50            +0.2        0.65 ±  6%  perf-profile.children.cycles-pp.read_tsc
      0.59 ±  3%      +0.2        0.75 ±  9%  perf-profile.children.cycles-pp.tcp_set_state
      0.88 ±  2%      +0.2        1.04 ±  6%  perf-profile.children.cycles-pp.enqueue_entity
      0.52 ±  3%      +0.2        0.68 ±  2%  perf-profile.children.cycles-pp.mod_timer
      0.42 ±  4%      +0.2        0.58 ±  6%  perf-profile.children.cycles-pp.tcp_v4_destroy_sock
      0.59 ±  3%      +0.2        0.76 ±  2%  perf-profile.children.cycles-pp.sk_reset_timer
      0.47 ±  2%      +0.2        0.65 ±  6%  perf-profile.children.cycles-pp.sk_stream_alloc_skb
      0.21 ±  2%      +0.2        0.38 ±  4%  perf-profile.children.cycles-pp.__sk_dst_check
      0.80 ±  3%      +0.2        0.98 ±  4%  perf-profile.children.cycles-pp.dequeue_entity
      0.76            +0.2        0.94 ±  6%  perf-profile.children.cycles-pp.autoremove_wake_function
      0.62 ±  2%      +0.2        0.80 ±  6%  perf-profile.children.cycles-pp.tcp_init_transfer
      0.52 ±  2%      +0.2        0.70 ±  6%  perf-profile.children.cycles-pp.__dentry_kill
      0.54 ±  3%      +0.2        0.73 ±  7%  perf-profile.children.cycles-pp.apparmor_file_alloc_security
      0.21 ±  2%      +0.2        0.41 ±  5%  perf-profile.children.cycles-pp.ipv4_dst_check
      0.94 ±  2%      +0.2        1.14 ±  3%  perf-profile.children.cycles-pp.hrtimer_interrupt
      1.10            +0.2        1.29 ±  6%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.88 ±  3%      +0.2        1.07 ±  4%  perf-profile.children.cycles-pp.dequeue_task_fair
      1.11            +0.2        1.30 ±  6%  perf-profile.children.cycles-pp.activate_task
      1.12            +0.2        1.31 ±  6%  perf-profile.children.cycles-pp.ttwu_do_activate
      1.68 ±  2%      +0.2        1.88 ±  3%  perf-profile.children.cycles-pp.smp_apic_timer_interrupt
      0.34 ±  2%      +0.2        0.54 ±  4%  perf-profile.children.cycles-pp.tcp_update_metrics
      0.60 ±  2%      +0.2        0.81 ±  7%  perf-profile.children.cycles-pp.security_file_alloc
      0.33 ±  2%      +0.2        0.54 ±  4%  perf-profile.children.cycles-pp.tcp_time_wait
      0.72 ±  2%      +0.2        0.94 ±  6%  perf-profile.children.cycles-pp.__alloc_skb
      0.47            +0.2        0.69 ±  8%  perf-profile.children.cycles-pp.__tcp_get_metrics
      0.97            +0.2        1.19 ±  4%  perf-profile.children.cycles-pp._raw_spin_lock_irqsave
      0.58 ±  2%      +0.2        0.81 ±  4%  perf-profile.children.cycles-pp.tcp_send_fin
      0.91 ±  2%      +0.2        1.14 ±  3%  perf-profile.children.cycles-pp.aa_sk_perm
      0.28 ±  3%      +0.2        0.52 ±  7%  perf-profile.children.cycles-pp.tcp_init_metrics
      1.49            +0.2        1.73 ±  6%  perf-profile.children.cycles-pp.__sock_create
      0.81            +0.2        1.05 ±  9%  perf-profile.children.cycles-pp.loopback_xmit
      0.75 ±  3%      +0.2        1.00 ±  6%  perf-profile.children.cycles-pp.sk_clone_lock
      0.84            +0.3        1.10 ±  4%  perf-profile.children.cycles-pp.__kfree_skb
      0.77 ±  2%      +0.3        1.02 ±  6%  perf-profile.children.cycles-pp.inet_csk_clone_lock
      0.85 ±  2%      +0.3        1.10 ±  5%  perf-profile.children.cycles-pp.sock_def_wakeup
      0.67 ±  4%      +0.3        0.93 ±  9%  perf-profile.children.cycles-pp.tcp_done
      0.89 ±  2%      +0.3        1.15 ±  6%  perf-profile.children.cycles-pp.tcp_create_openreq_child
      0.69 ±  2%      +0.3        0.96 ±  5%  perf-profile.children.cycles-pp.__sk_mem_reduce_allocated
      0.86            +0.3        1.14 ±  9%  perf-profile.children.cycles-pp.dev_hard_start_xmit
      1.62 ±  2%      +0.3        1.90 ±  4%  perf-profile.children.cycles-pp.wait_woken
      0.79            +0.3        1.07 ±  7%  perf-profile.children.cycles-pp.alloc_empty_file
      0.80            +0.3        1.08 ±  7%  perf-profile.children.cycles-pp.alloc_file
      0.78            +0.3        1.06 ±  7%  perf-profile.children.cycles-pp.__alloc_file
      0.62            +0.3        0.91 ±  5%  perf-profile.children.cycles-pp.percpu_counter_add_batch
      1.75            +0.3        2.04 ±  4%  perf-profile.children.cycles-pp.schedule_idle
      0.98 ±  2%      +0.3        1.29 ±  6%  perf-profile.children.cycles-pp.inet_csk_accept
      1.61 ±  2%      +0.3        1.92 ±  5%  perf-profile.children.cycles-pp.tcp_v4_syn_recv_sock
      0.80 ±  2%      +0.3        1.12 ±  3%  perf-profile.children.cycles-pp.tcp_clean_rtx_queue
      2.27            +0.3        2.59 ±  5%  perf-profile.children.cycles-pp.sock_def_readable
      1.03 ±  2%      +0.3        1.36 ±  5%  perf-profile.children.cycles-pp.__sk_destruct
      0.61 ±  4%      +0.3        0.94 ±  5%  perf-profile.children.cycles-pp.sk_forced_mem_schedule
      1.54            +0.3        1.88 ±  5%  perf-profile.children.cycles-pp.tcp_child_process
      0.53            +0.4        0.88 ±  7%  perf-profile.children.cycles-pp.tcp_get_metrics
      0.87 ±  2%      +0.4        1.23 ±  5%  perf-profile.children.cycles-pp.inet_csk_destroy_sock
      1.04            +0.4        1.42 ±  7%  perf-profile.children.cycles-pp.alloc_file_pseudo
      1.04            +0.4        1.43 ±  7%  perf-profile.children.cycles-pp.sock_alloc_file
      0.19 ±  4%      +0.4        0.57 ±  7%  perf-profile.children.cycles-pp.inet_ehashfn
      1.86 ±  2%      +0.4        2.28 ±  5%  perf-profile.children.cycles-pp.schedule
      1.96 ±  2%      +0.4        2.38 ±  5%  perf-profile.children.cycles-pp.schedule_timeout
      2.06            +0.5        2.52 ±  7%  perf-profile.children.cycles-pp.__sys_socket
      2.07            +0.5        2.53 ±  7%  perf-profile.children.cycles-pp.__x64_sys_socket
      2.49            +0.5        2.96 ±  6%  perf-profile.children.cycles-pp.try_to_wake_up
      1.38            +0.5        1.86 ±  7%  perf-profile.children.cycles-pp.__dev_queue_xmit
      2.63            +0.5        3.12 ±  5%  perf-profile.children.cycles-pp.__wake_up_common
      0.83 ±  4%      +0.5        1.34 ±  3%  perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
      1.77            +0.5        2.29 ±  5%  perf-profile.children.cycles-pp._raw_spin_lock
      2.90            +0.5        3.43 ±  5%  perf-profile.children.cycles-pp.__wake_up_common_lock
      1.02            +0.6        1.57 ±  6%  perf-profile.children.cycles-pp.__inet_lookup_established
      1.06 ±  2%      +0.6        1.61 ±  4%  perf-profile.children.cycles-pp.lock_sock_nested
      1.33 ±  3%      +0.7        2.00 ±  4%  perf-profile.children.cycles-pp._raw_spin_lock_bh
      3.53            +0.7        4.22 ±  4%  perf-profile.children.cycles-pp.__schedule
      3.26 ±  2%      +0.8        4.11 ±  5%  perf-profile.children.cycles-pp.poll_idle
      4.41 ±  2%      +0.9        5.27 ±  4%  perf-profile.children.cycles-pp.tcp_recvmsg
      4.42 ±  2%      +0.9        5.29 ±  4%  perf-profile.children.cycles-pp.inet_recvmsg
      3.57            +0.9        4.44 ±  5%  perf-profile.children.cycles-pp.tcp_data_queue
      2.54            +0.9        3.42 ±  5%  perf-profile.children.cycles-pp.tcp_fin
      1.31 ±  2%      +0.9        2.25 ±  4%  perf-profile.children.cycles-pp.inet_accept
      4.89            +1.0        5.90 ±  4%  perf-profile.children.cycles-pp.__sys_recvfrom
      4.91            +1.0        5.92 ±  4%  perf-profile.children.cycles-pp.__x64_sys_recvfrom
      2.16            +1.2        3.38 ±  4%  perf-profile.children.cycles-pp.__sys_accept4_file
      2.18 ±  2%      +1.2        3.41 ±  4%  perf-profile.children.cycles-pp.__sys_accept4
      2.19 ±  2%      +1.2        3.42 ±  4%  perf-profile.children.cycles-pp.__x64_sys_accept
     15.09            +1.7       16.81 ±  4%  perf-profile.children.cycles-pp.tcp_write_xmit
     15.11            +1.7       16.84 ±  4%  perf-profile.children.cycles-pp.__tcp_push_pending_frames
     10.78            +2.1       12.88 ±  4%  perf-profile.children.cycles-pp.tcp_close
     11.34            +2.3       13.64 ±  5%  perf-profile.children.cycles-pp.inet_release
     11.45            +2.3       13.78 ±  5%  perf-profile.children.cycles-pp.__sock_release
     11.46            +2.3       13.81 ±  5%  perf-profile.children.cycles-pp.sock_close
     16.08            +2.5       18.54 ±  5%  perf-profile.children.cycles-pp.ip_protocol_deliver_rcu
     16.10            +2.5       18.57 ±  5%  perf-profile.children.cycles-pp.ip_local_deliver_finish
     15.69            +2.5       18.18 ±  5%  perf-profile.children.cycles-pp.tcp_v4_rcv
     16.15            +2.5       18.67 ±  5%  perf-profile.children.cycles-pp.ip_local_deliver
     12.72            +2.8       15.48 ±  5%  perf-profile.children.cycles-pp.__fput
     12.89            +2.8       15.69 ±  5%  perf-profile.children.cycles-pp.task_work_run
     13.02            +2.8       15.86 ±  5%  perf-profile.children.cycles-pp.exit_to_usermode_loop
     48.04            +5.6       53.68 ±  5%  perf-profile.children.cycles-pp.do_syscall_64
     48.20            +5.7       53.88 ±  5%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
     40.11            -6.5       33.61 ± 10%  perf-profile.self.cycles-pp.intel_idle
      1.79            -1.6        0.19 ±  6%  perf-profile.self.cycles-pp.tcp_schedule_loss_probe
      1.56            -1.3        0.30 ±  6%  perf-profile.self.cycles-pp.ip_rcv_finish_core
      1.36 ± 10%      -0.6        0.79 ±  3%  perf-profile.self.cycles-pp.menu_select
      0.68 ±  2%      -0.6        0.13 ±  5%  perf-profile.self.cycles-pp.tcp_parse_options
      0.94 ±  7%      -0.5        0.46 ±  4%  perf-profile.self.cycles-pp.cpuidle_enter_state
      0.64 ±  2%      -0.5        0.18 ± 10%  perf-profile.self.cycles-pp.tcp_conn_request
      0.55 ±  3%      -0.4        0.13 ±  5%  perf-profile.self.cycles-pp.tcp_sync_mss
      0.44 ±  2%      -0.4        0.03 ±100%  perf-profile.self.cycles-pp.secure_tcp_ts_off
      0.45 ±  2%      -0.4        0.06 ±  7%  perf-profile.self.cycles-pp.tcp_stream_memory_free
      0.35 ±  2%      -0.3        0.06 ± 13%  perf-profile.self.cycles-pp.tcp_connect_init
      0.33 ±  2%      -0.3        0.07 ± 12%  perf-profile.self.cycles-pp.tcp_mtup_init
      0.77            -0.2        0.53 ±  8%  perf-profile.self.cycles-pp.__ip_queue_xmit
      1.08            -0.2        0.90 ±  5%  perf-profile.self.cycles-pp.__tcp_transmit_skb
      0.23 ±  3%      -0.2        0.05 ±  9%  perf-profile.self.cycles-pp.tcp_init_sock
      0.17            -0.1        0.06 ± 20%  perf-profile.self.cycles-pp.inet_lhash2_lookup
      0.19 ±  3%      -0.1        0.10 ± 15%  perf-profile.self.cycles-pp.inet_csk_get_port
      0.31 ±  2%      -0.1        0.24 ±  7%  perf-profile.self.cycles-pp.ip_protocol_deliver_rcu
      0.61 ±  2%      -0.0        0.57 ±  5%  perf-profile.self.cycles-pp.tcp_ack
      0.08 ±  8%      -0.0        0.04 ± 58%  perf-profile.self.cycles-pp.ip_build_and_send_pkt
      0.15            -0.0        0.12 ±  7%  perf-profile.self.cycles-pp.tcp_connect
      0.20 ±  4%      -0.0        0.17 ±  4%  perf-profile.self.cycles-pp.__ip_finish_output
      0.15 ±  2%      -0.0        0.13 ± 10%  perf-profile.self.cycles-pp.tcp_newly_delivered
      0.13 ±  3%      -0.0        0.11 ±  7%  perf-profile.self.cycles-pp.tcp_set_state
      0.11 ±  4%      -0.0        0.09 ±  5%  perf-profile.self.cycles-pp.__inet_bind
      0.05 ±  8%      +0.0        0.07 ±  6%  perf-profile.self.cycles-pp.ip_rcv
      0.05 ±  8%      +0.0        0.07 ±  6%  perf-profile.self.cycles-pp.__calc_delta
      0.05 ±  8%      +0.0        0.07 ±  6%  perf-profile.self.cycles-pp.__sock_wfree
      0.13 ±  5%      +0.0        0.15 ±  3%  perf-profile.self.cycles-pp.account_entity_enqueue
      0.06 ±  7%      +0.0        0.07 ±  5%  perf-profile.self.cycles-pp.schedule
      0.06            +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.__netif_receive_skb_one_core
      0.06 ±  6%      +0.0        0.08 ±  8%  perf-profile.self.cycles-pp.skb_page_frag_refill
      0.05            +0.0        0.07 ± 12%  perf-profile.self.cycles-pp.lock_sock_nested
      0.05 ±  8%      +0.0        0.07        perf-profile.self.cycles-pp.__might_fault
      0.06 ±  9%      +0.0        0.07 ±  5%  perf-profile.self.cycles-pp.sock_def_wakeup
      0.13 ±  6%      +0.0        0.15 ±  2%  perf-profile.self.cycles-pp.update_curr
      0.11 ±  4%      +0.0        0.12 ±  4%  perf-profile.self.cycles-pp.cgroup_rstat_updated
      0.08 ±  5%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.tcp_cleanup_rbuf
      0.11            +0.0        0.13 ±  5%  perf-profile.self.cycles-pp._raw_spin_trylock
      0.08 ±  5%      +0.0        0.10 ±  8%  perf-profile.self.cycles-pp.rcu_segcblist_enqueue
      0.07 ±  7%      +0.0        0.09 ±  5%  perf-profile.self.cycles-pp.sk_filter_trim_cap
      0.05 ±  8%      +0.0        0.07 ±  5%  perf-profile.self.cycles-pp.tcp_check_space
      0.05 ±  8%      +0.0        0.07 ±  5%  perf-profile.self.cycles-pp.tcp_release_cb
      0.30 ±  3%      +0.0        0.33        perf-profile.self.cycles-pp.ip_output
      0.10            +0.0        0.12 ±  6%  perf-profile.self.cycles-pp.finish_task_switch
      0.08 ±  6%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.validate_xmit_skb
      0.08 ±  6%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.tcp_rcv_space_adjust
      0.04 ± 57%      +0.0        0.06        perf-profile.self.cycles-pp.update_min_vruntime
      0.07 ±  6%      +0.0        0.09 ±  7%  perf-profile.self.cycles-pp.tcp_v4_do_rcv
      0.16 ±  4%      +0.0        0.18 ±  4%  perf-profile.self.cycles-pp.__update_load_avg_se
      0.12 ±  5%      +0.0        0.14 ±  5%  perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
      0.08 ±  5%      +0.0        0.10 ±  8%  perf-profile.self.cycles-pp.memset_erms
      0.05 ±  8%      +0.0        0.08 ±  5%  perf-profile.self.cycles-pp.tcp_data_queue
      0.08 ±  5%      +0.0        0.10 ±  4%  perf-profile.self.cycles-pp.release_sock
      0.06 ±  7%      +0.0        0.08 ± 10%  perf-profile.self.cycles-pp.inode_init_always
      0.14 ±  6%      +0.0        0.17 ±  3%  perf-profile.self.cycles-pp.try_to_wake_up
      0.10 ±  4%      +0.0        0.12 ±  4%  perf-profile.self.cycles-pp.__indirect_thunk_start
      0.05 ±  8%      +0.0        0.08 ±  8%  perf-profile.self.cycles-pp._raw_spin_lock_irq
      0.08 ±  5%      +0.0        0.11 ± 11%  perf-profile.self.cycles-pp.raw_local_deliver
      0.07            +0.0        0.10 ± 11%  perf-profile.self.cycles-pp.inet_csk_accept
      0.07 ±  6%      +0.0        0.10 ±  9%  perf-profile.self.cycles-pp.inet_twsk_alloc
      0.06            +0.0        0.09 ±  4%  perf-profile.self.cycles-pp.__get_user_4
      0.07 ±  7%      +0.0        0.09 ±  8%  perf-profile.self.cycles-pp.tcp_queue_rcv
      0.11 ±  4%      +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.sk_reset_timer
      0.11 ±  4%      +0.0        0.14 ±  7%  perf-profile.self.cycles-pp.rcu_eqs_exit
      0.11 ±  7%      +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.__check_object_size
      0.13 ±  3%      +0.0        0.16 ±  6%  perf-profile.self.cycles-pp.sk_setup_caps
      0.11 ±  7%      +0.0        0.15 ±  7%  perf-profile.self.cycles-pp.__kmalloc_node_track_caller
      0.17            +0.0        0.20 ±  4%  perf-profile.self.cycles-pp.pick_next_entity
      0.17 ±  6%      +0.0        0.20 ±  5%  perf-profile.self.cycles-pp.sock_def_readable
      0.11 ±  4%      +0.0        0.14 ±  3%  perf-profile.self.cycles-pp.call_rcu
      0.08 ± 10%      +0.0        0.11 ± 11%  perf-profile.self.cycles-pp.__alloc_file
      0.03 ±100%      +0.0        0.06        perf-profile.self.cycles-pp.__list_del_entry_valid
      0.22 ±  3%      +0.0        0.26 ±  3%  perf-profile.self.cycles-pp.tcp_rcv_established
      0.15 ±  5%      +0.0        0.18 ±  6%  perf-profile.self.cycles-pp.fib_table_lookup
      0.14 ±  6%      +0.0        0.17 ±  6%  perf-profile.self.cycles-pp.kfree
      0.12 ±  5%      +0.0        0.15 ±  7%  perf-profile.self.cycles-pp.do_softirq
      0.09 ±  4%      +0.0        0.13 ±  3%  perf-profile.self.cycles-pp.sock_put
      0.04 ± 57%      +0.0        0.07 ±  5%  perf-profile.self.cycles-pp.rcu_eqs_enter
      0.03 ±100%      +0.0        0.06 ±  6%  perf-profile.self.cycles-pp.minmax_running_min
      0.17 ±  3%      +0.0        0.20 ±  4%  perf-profile.self.cycles-pp.select_task_rq_fair
      0.15 ±  3%      +0.0        0.18 ±  7%  perf-profile.self.cycles-pp.enqueue_to_backlog
      0.12 ±  6%      +0.0        0.16 ±  2%  perf-profile.self.cycles-pp.net_rx_action
      0.11 ±  3%      +0.0        0.15 ±  8%  perf-profile.self.cycles-pp.__fget_light
      0.11 ±  4%      +0.0        0.15 ±  5%  perf-profile.self.cycles-pp.resched_curr
      0.11 ±  3%      +0.0        0.15 ±  8%  perf-profile.self.cycles-pp.mod_timer
      0.18 ±  2%      +0.0        0.22 ±  5%  perf-profile.self.cycles-pp.__netif_receive_skb_core
      0.03 ±100%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.__sys_recvfrom
      0.03 ±100%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.__hrtimer_init
      0.22            +0.0        0.26 ±  7%  perf-profile.self.cycles-pp.enqueue_entity
      0.16 ±  4%      +0.0        0.20 ±  7%  perf-profile.self.cycles-pp.memcg_kmem_get_cache
      0.18 ±  4%      +0.0        0.23 ±  4%  perf-profile.self.cycles-pp.switch_mm_irqs_off
      0.01 ±173%      +0.0        0.05 ±  9%  perf-profile.self.cycles-pp.tcp_v4_fill_cb
      0.01 ±173%      +0.0        0.05 ±  9%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.23 ±  2%      +0.0        0.27 ±  6%  perf-profile.self.cycles-pp.sk_alloc
      0.18 ±  2%      +0.0        0.22 ±  5%  perf-profile.self.cycles-pp.nr_iowait_cpu
      0.17 ±  3%      +0.0        0.21 ±  3%  perf-profile.self.cycles-pp.process_backlog
      0.13 ±  3%      +0.0        0.18 ±  6%  perf-profile.self.cycles-pp.loopback_xmit
      0.10 ±  7%      +0.0        0.14 ±  7%  perf-profile.self.cycles-pp.kmem_cache_alloc_node
      0.03 ±100%      +0.0        0.07 ± 10%  perf-profile.self.cycles-pp.__cgroup_bpf_run_filter_sock_ops
      0.04 ± 57%      +0.0        0.08 ± 10%  perf-profile.self.cycles-pp.dev_hard_start_xmit
      0.01 ±173%      +0.0        0.06 ± 14%  perf-profile.self.cycles-pp.tcp_child_process
      0.16            +0.0        0.21 ±  2%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.18            +0.0        0.23 ±  7%  perf-profile.self.cycles-pp.sock_rfree
      0.01 ±173%      +0.0        0.06 ± 11%  perf-profile.self.cycles-pp.rcu_all_qs
      0.01 ±173%      +0.0        0.06 ± 11%  perf-profile.self.cycles-pp.tcp_v4_connect
      0.03 ±100%      +0.0        0.07 ±  5%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.16 ±  4%      +0.0        0.21 ±  9%  perf-profile.self.cycles-pp.copy_user_generic_unrolled
      0.14 ±  3%      +0.0        0.18 ±  7%  perf-profile.self.cycles-pp.kmem_cache_alloc
      0.14 ±  3%      +0.0        0.18 ±  7%  perf-profile.self.cycles-pp.ipv4_mtu
      0.36 ±  3%      +0.0        0.41 ±  5%  perf-profile.self.cycles-pp.update_load_avg
      0.25 ±  3%      +0.0        0.30 ±  5%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.01 ±173%      +0.1        0.06 ± 13%  perf-profile.self.cycles-pp.tcp_rcv_synsent_state_process
      0.01 ±173%      +0.1        0.06 ±  6%  perf-profile.self.cycles-pp.lock_timer_base
      0.12 ±  5%      +0.1        0.17 ±  7%  perf-profile.self.cycles-pp.sk_clone_lock
      0.17 ±  3%      +0.1        0.22 ±  6%  perf-profile.self.cycles-pp.__alloc_skb
      0.19 ±  2%      +0.1        0.24 ±  6%  perf-profile.self.cycles-pp.__ksize
      0.11 ±  4%      +0.1        0.17 ±  4%  perf-profile.self.cycles-pp.ip_send_check
      0.24 ±  6%      +0.1        0.29 ±  2%  perf-profile.self.cycles-pp.wait_woken
      0.19 ±  3%      +0.1        0.24 ±  8%  perf-profile.self.cycles-pp.entry_SYSCALL_64
      0.06 ±  7%      +0.1        0.11 ±  3%  perf-profile.self.cycles-pp.tcp_update_metrics
      0.00            +0.1        0.05 ±  9%  perf-profile.self.cycles-pp.inet_sk_rx_dst_set
      0.23 ±  2%      +0.1        0.28 ±  4%  perf-profile.self.cycles-pp.__softirqentry_text_start
      0.23 ±  2%      +0.1        0.29 ±  2%  perf-profile.self.cycles-pp.do_syscall_64
      0.14 ±  5%      +0.1        0.20 ±  4%  perf-profile.self.cycles-pp.__might_sleep
      0.00            +0.1        0.06 ±  7%  perf-profile.self.cycles-pp.tcp_mstamp_refresh
      0.16 ±  2%      +0.1        0.22 ±  4%  perf-profile.self.cycles-pp.__skb_clone
      0.26 ±  3%      +0.1        0.32 ±  6%  perf-profile.self.cycles-pp.__switch_to_asm
      0.00            +0.1        0.06 ± 11%  perf-profile.self.cycles-pp.__list_add_valid
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.__inet_hash_connect
      0.00            +0.1        0.06        perf-profile.self.cycles-pp.kmem_cache_alloc_trace
      0.00            +0.1        0.06 ± 11%  perf-profile.self.cycles-pp.calc_global_load_tick
      0.33 ±  4%      +0.1        0.39 ±  2%  perf-profile.self.cycles-pp.set_next_entity
      0.16 ±  5%      +0.1        0.22 ±  6%  perf-profile.self.cycles-pp.__local_bh_enable_ip
      0.35 ±  3%      +0.1        0.42 ±  4%  perf-profile.self.cycles-pp.do_idle
      0.18 ±  3%      +0.1        0.24        perf-profile.self.cycles-pp.__cgroup_bpf_run_filter_skb
      0.00            +0.1        0.06 ±  6%  perf-profile.self.cycles-pp.skb_entail
      0.00            +0.1        0.06 ± 13%  perf-profile.self.cycles-pp.rb_first
      0.00            +0.1        0.07 ±  7%  perf-profile.self.cycles-pp.tcp_rack_update_reo_wnd
      0.00            +0.1        0.07 ±  6%  perf-profile.self.cycles-pp.tcp_init_metrics
      0.00            +0.1        0.07 ±  6%  perf-profile.self.cycles-pp.inet_put_port
      0.00            +0.1        0.07 ±  6%  perf-profile.self.cycles-pp.tcp_rearm_rto
      0.00            +0.1        0.07 ±  6%  perf-profile.self.cycles-pp.tcp_assign_congestion_control
      0.00            +0.1        0.07 ±  6%  perf-profile.self.cycles-pp.ip_copy_addrs
      0.30 ±  2%      +0.1        0.37 ±  5%  perf-profile.self.cycles-pp.native_sched_clock
      0.22            +0.1        0.29 ±  8%  perf-profile.self.cycles-pp.kmem_cache_free
      0.18 ±  4%      +0.1        0.26 ± 11%  perf-profile.self.cycles-pp.tcp_close
      0.00            +0.1        0.07 ±  5%  perf-profile.self.cycles-pp.inet_twsk_kill
      0.19 ±  6%      +0.1        0.27 ±  6%  perf-profile.self.cycles-pp.tcp_sendmsg_locked
      0.30 ±  5%      +0.1        0.38 ±  5%  perf-profile.self.cycles-pp.apparmor_sk_clone_security
      0.26 ±  4%      +0.1        0.34 ±  3%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.00            +0.1        0.08 ±  8%  perf-profile.self.cycles-pp.inet_reqsk_alloc
      0.00            +0.1        0.08 ±  5%  perf-profile.self.cycles-pp.__sk_free
      0.07 ±  7%      +0.1        0.15 ±  5%  perf-profile.self.cycles-pp.tcp_update_pacing_rate
      0.01 ±173%      +0.1        0.10 ±  9%  perf-profile.self.cycles-pp.ip_local_deliver
      0.23 ±  4%      +0.1        0.32 ± 11%  perf-profile.self.cycles-pp.ip_finish_output2
      0.45 ±  2%      +0.1        0.54 ±  6%  perf-profile.self.cycles-pp.update_rq_clock
      0.20 ±  2%      +0.1        0.28 ±  3%  perf-profile.self.cycles-pp.tcp_clean_rtx_queue
      0.05            +0.1        0.14 ±  3%  perf-profile.self.cycles-pp.tcp_ack_update_rtt
      0.36            +0.1        0.45 ±  6%  perf-profile.self.cycles-pp.___might_sleep
      0.28 ±  4%      +0.1        0.36 ±  6%  perf-profile.self.cycles-pp.apparmor_sk_free_security
      0.21 ±  5%      +0.1        0.30 ±  8%  perf-profile.self.cycles-pp.__slab_free
      0.00            +0.1        0.09 ±  7%  perf-profile.self.cycles-pp.sock_prot_inuse_add
      0.34 ±  4%      +0.1        0.43 ±  7%  perf-profile.self.cycles-pp.apparmor_socket_post_create
      0.04 ± 58%      +0.1        0.14 ±  7%  perf-profile.self.cycles-pp.inet_lookup_ifaddr_rcu
      0.35 ±  3%      +0.1        0.46 ±  4%  perf-profile.self.cycles-pp.skb_release_data
      0.45 ±  2%      +0.1        0.56 ±  2%  perf-profile.self.cycles-pp.dst_release
      0.00            +0.1        0.12 ±  5%  perf-profile.self.cycles-pp.__tcp_select_window
      0.38 ±  4%      +0.1        0.50 ±  8%  perf-profile.self.cycles-pp.inet_csk_bind_conflict
      0.06 ± 11%      +0.1        0.19 ±  7%  perf-profile.self.cycles-pp.tcp_get_metrics
      0.30 ±  2%      +0.1        0.43 ±  5%  perf-profile.self.cycles-pp.__dev_queue_xmit
      0.48 ±  2%      +0.1        0.62 ±  5%  perf-profile.self.cycles-pp.apparmor_file_free_security
      0.43 ±  5%      +0.1        0.57 ±  4%  perf-profile.self.cycles-pp.tcp_recvmsg
      0.49            +0.1        0.63 ±  6%  perf-profile.self.cycles-pp.read_tsc
      0.15 ±  4%      +0.2        0.31 ±  5%  perf-profile.self.cycles-pp.tcp_write_xmit
      0.62 ±  2%      +0.2        0.78 ±  6%  perf-profile.self.cycles-pp.__sk_destruct
      0.71 ±  2%      +0.2        0.89 ±  7%  perf-profile.self.cycles-pp.__schedule
      0.52 ±  3%      +0.2        0.71 ±  6%  perf-profile.self.cycles-pp.apparmor_file_alloc_security
      0.21 ±  3%      +0.2        0.40 ±  4%  perf-profile.self.cycles-pp.ipv4_dst_check
      0.85 ±  2%      +0.2        1.06 ±  3%  perf-profile.self.cycles-pp.aa_sk_perm
      0.95            +0.2        1.16 ±  4%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.47            +0.2        0.69 ±  7%  perf-profile.self.cycles-pp.__tcp_get_metrics
      0.86 ±  2%      +0.2        1.08 ±  6%  perf-profile.self.cycles-pp.__inet_lookup_established
      0.68 ±  2%      +0.3        0.96 ±  5%  perf-profile.self.cycles-pp.__sk_mem_reduce_allocated
      0.89 ±  3%      +0.3        1.18 ±  5%  perf-profile.self.cycles-pp._raw_spin_lock_bh
      0.61 ±  2%      +0.3        0.90 ±  6%  perf-profile.self.cycles-pp.percpu_counter_add_batch
      0.61 ±  4%      +0.3        0.93 ±  5%  perf-profile.self.cycles-pp.sk_forced_mem_schedule
      0.19 ±  4%      +0.4        0.57 ±  7%  perf-profile.self.cycles-pp.inet_ehashfn
      1.35            +0.4        1.74 ±  5%  perf-profile.self.cycles-pp._raw_spin_lock
      0.83 ±  4%      +0.5        1.33 ±  3%  perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
      3.20 ±  2%      +0.8        4.03 ±  5%  perf-profile.self.cycles-pp.poll_idle


                                                                                
                               netperf.Throughput_tps                           
                                                                                
  28000 +-------------------------------------------------------------------+   
        |      O                                                            |   
  27000 |-O  O   O          O  O O O O  O O O                               |   
        |          O  O O O                                                 |   
  26000 |-+                                                                 |   
        |                                      O O O O  O O O O  O O O O  O |   
  25000 |-+                                                                 |   
        |                                                                   |   
  24000 |-+                                                                 |   
        |             +                                                     |   
  23000 |-+          + + .+.+..   .+.  .+.                                  |   
        |     .+.+. +   +      +.+   +.   +                                 |   
  22000 |.+..+     +                       +                                |   
        |                                   +..+.+.+.+..+                   |   
  21000 +-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.7.0-rc7-00021-gcd2ed9bdc07944" of type "text/plain" (157510 bytes)

View attachment "job-script" of type "text/plain" (8226 bytes)

View attachment "job.yaml" of type "text/plain" (5447 bytes)

View attachment "reproduce" of type "text/plain" (1091 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ