lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20210407054647.GA22260@xsang-OptiPlex-9020>
Date:   Wed, 7 Apr 2021 13:46:47 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Sean Christopherson <seanjc@...gle.com>
Cc:     Kees Cook <keescook@...omium.org>,
        Nick Desaulniers <ndesaulniers@...gle.com>,
        Sami Tolvanen <samitolvanen@...gle.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com
Subject: [kbuild]  6a3193cdd5:  netperf.Throughput_tps -11.9% regression



Greeting,

FYI, we noticed a -11.9% regression of netperf.Throughput_tps due to commit:


commit: 6a3193cdd5e5b96ac65f04ee42555c216da332af ("kbuild: lto: Merge module sections if and only if CONFIG_LTO_CLANG is enabled")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: netperf
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:

	ip: ipv4
	runtime: 300s
	nr_threads: 200%
	cluster: cs-localhost
	test: SCTP_RR
	cpufreq_governor: performance
	ucode: 0x5003006

test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/



If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install                job.yaml  # job file is attached in this email
        bin/lkp split-job --compatible job.yaml
        bin/lkp run                    compatible-job.yaml

=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode:
  cs-localhost/gcc-9/performance/ipv4/x86_64-rhel-8.3/200%/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2ap4/SCTP_RR/netperf/0x5003006

commit: 
  v5.12-rc5
  6a3193cdd5 ("kbuild: lto: Merge module sections if and only if CONFIG_LTO_CLANG is enabled")

       v5.12-rc5 6a3193cdd5e5b96ac65f04ee425 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
   8115808           -11.9%    7153872 ±  5%  netperf.Throughput_total_tps
     21134           -11.9%      18629 ±  5%  netperf.Throughput_tps
    693.55           -17.8%     569.92 ±  8%  netperf.time.user_time
 1.545e+09 ±  4%     -16.9%  1.284e+09 ±  9%  netperf.time.voluntary_context_switches
 2.435e+09           -11.9%  2.146e+09 ±  5%  netperf.workload
      2.18            -0.4        1.79 ±  6%  mpstat.cpu.all.usr%
  15729179           -11.8%   13877781 ±  5%  vmstat.system.cs
    206.22 ±  4%     -19.5%     165.92 ± 11%  perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
    205.96 ±  4%     -19.7%     165.43 ± 11%  perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
    101.21 ± 17%     +27.3%     128.81 ± 14%  sched_debug.cpu.clock.stddev
  12713848           -15.4%   10758148 ± 11%  sched_debug.cpu.nr_switches.avg
  13522095           -15.8%   11384163 ± 11%  sched_debug.cpu.nr_switches.max
  11502986 ±  2%     -15.8%    9681359 ± 10%  sched_debug.cpu.nr_switches.min
     12117 ± 37%     -50.0%       6059 ± 59%  interrupts.CPU122.RES:Rescheduling_interrupts
     20352 ± 31%     -56.3%       8885 ± 42%  interrupts.CPU129.RES:Rescheduling_interrupts
     12887 ± 14%     -56.8%       5566 ± 48%  interrupts.CPU144.RES:Rescheduling_interrupts
     21257 ± 36%     -65.0%       7436 ± 33%  interrupts.CPU33.RES:Rescheduling_interrupts
     23491 ± 49%     -66.4%       7891 ± 52%  interrupts.CPU37.RES:Rescheduling_interrupts
     20236 ± 68%     -72.5%       5569 ± 66%  interrupts.CPU42.RES:Rescheduling_interrupts
     27420 ± 52%     -69.3%       8408 ± 63%  interrupts.CPU43.RES:Rescheduling_interrupts
      3.73 ±  5%     +20.4%       4.49 ±  5%  perf-stat.i.MPKI
 7.683e+10           -11.7%  6.786e+10 ±  5%  perf-stat.i.branch-instructions
 1.132e+09           -11.2%  1.005e+09 ±  6%  perf-stat.i.branch-misses
 1.311e+09 ±  2%      +9.7%  1.438e+09 ±  2%  perf-stat.i.cache-references
  15907089           -11.9%   14013775 ±  5%  perf-stat.i.context-switches
      1.48           +16.0%       1.71 ±  6%  perf-stat.i.cpi
 5.518e+11            +1.6%  5.607e+11        perf-stat.i.cpu-cycles
 1.099e+11           -11.8%  9.698e+10 ±  5%  perf-stat.i.dTLB-loads
 6.456e+10           -11.8%  5.694e+10 ±  5%  perf-stat.i.dTLB-stores
 6.525e+08           -10.2%  5.861e+08 ±  5%  perf-stat.i.iTLB-load-misses
  9.93e+08           -11.8%   8.76e+08 ±  7%  perf-stat.i.iTLB-loads
 3.814e+11           -11.7%  3.368e+11 ±  5%  perf-stat.i.instructions
      0.69           -13.0%       0.60 ±  6%  perf-stat.i.ipc
      2.87            +1.6%       2.92        perf-stat.i.metric.GHz
      1321           -11.6%       1167 ±  5%  perf-stat.i.metric.M/sec
      3.44           +24.5%       4.28 ±  5%  perf-stat.overall.MPKI
      1.45           +15.5%       1.67 ±  6%  perf-stat.overall.cpi
      0.69           -13.1%       0.60 ±  6%  perf-stat.overall.ipc
 7.658e+10           -11.7%  6.766e+10 ±  5%  perf-stat.ps.branch-instructions
 1.128e+09           -11.2%  1.002e+09 ±  6%  perf-stat.ps.branch-misses
 1.307e+09 ±  2%      +9.7%  1.433e+09 ±  2%  perf-stat.ps.cache-references
  15850472           -11.9%   13965528 ±  5%  perf-stat.ps.context-switches
 5.499e+11            +1.6%  5.588e+11        perf-stat.ps.cpu-cycles
 1.095e+11           -11.7%  9.667e+10 ±  5%  perf-stat.ps.dTLB-loads
 6.434e+10           -11.8%  5.675e+10 ±  5%  perf-stat.ps.dTLB-stores
 6.502e+08           -10.2%  5.841e+08 ±  5%  perf-stat.ps.iTLB-load-misses
 9.896e+08           -11.8%   8.73e+08 ±  7%  perf-stat.ps.iTLB-loads
 3.801e+11           -11.7%  3.357e+11 ±  5%  perf-stat.ps.instructions
 1.172e+14           -11.6%  1.036e+14 ±  5%  perf-stat.total.instructions
  12513761           -14.7%   10668648 ±  6%  softirqs.CPU0.NET_RX
  12397650 ±  2%     -13.0%   10790163 ±  7%  softirqs.CPU1.NET_RX
  12607726           -14.3%   10810466 ±  6%  softirqs.CPU10.NET_RX
  12533080           -13.4%   10851508 ±  6%  softirqs.CPU100.NET_RX
  12541751 ±  2%     -13.9%   10803502 ±  6%  softirqs.CPU101.NET_RX
  12515887 ±  2%     -13.3%   10855527 ±  6%  softirqs.CPU102.NET_RX
  12564354 ±  2%     -13.0%   10929528 ±  6%  softirqs.CPU103.NET_RX
  12649300           -13.2%   10982927 ±  6%  softirqs.CPU104.NET_RX
  12683644           -14.6%   10829093 ±  6%  softirqs.CPU105.NET_RX
  12596669           -14.3%   10796183 ±  8%  softirqs.CPU106.NET_RX
  12577615 ±  3%     -14.8%   10721629 ±  6%  softirqs.CPU107.NET_RX
  12665495           -14.1%   10873758 ±  6%  softirqs.CPU108.NET_RX
  12650114 ±  2%     -14.4%   10834338 ±  6%  softirqs.CPU109.NET_RX
  12533583 ±  3%     -14.7%   10693357 ±  7%  softirqs.CPU11.NET_RX
  12675474 ±  2%     -14.2%   10869630 ±  6%  softirqs.CPU110.NET_RX
  12582768           -13.4%   10894687 ±  6%  softirqs.CPU111.NET_RX
  12630835           -12.8%   11009060 ±  7%  softirqs.CPU112.NET_RX
  12577664 ±  2%     -13.9%   10831804 ±  6%  softirqs.CPU113.NET_RX
  12597944 ±  3%     -12.7%   10995157 ±  6%  softirqs.CPU114.NET_RX
  12685743 ±  2%     -13.4%   10984145 ±  6%  softirqs.CPU115.NET_RX
  12572944 ±  3%     -12.7%   10973959 ±  7%  softirqs.CPU116.NET_RX
  12740201           -14.5%   10887401 ±  6%  softirqs.CPU117.NET_RX
  12427669           -11.6%   10982588 ±  6%  softirqs.CPU118.NET_RX
  12641482           -12.7%   11040887 ±  6%  softirqs.CPU119.NET_RX
  12594970           -13.8%   10860494 ±  6%  softirqs.CPU12.NET_RX
  12606643           -10.8%   11244805 ±  4%  softirqs.CPU121.NET_RX
  12672911           -14.2%   10877836 ±  5%  softirqs.CPU13.NET_RX
  12659787 ±  3%     -11.3%   11227532 ±  5%  softirqs.CPU132.NET_RX
  12611189 ±  3%      -9.5%   11408500 ±  4%  softirqs.CPU136.NET_RX
  12638413 ±  2%     -14.3%   10829268 ±  6%  softirqs.CPU14.NET_RX
  12416276           -13.0%   10798908 ±  3%  softirqs.CPU144.NET_RX
  13146847           -12.1%   11555211 ±  5%  softirqs.CPU148.NET_RX
  13249376           -13.4%   11473982 ±  5%  softirqs.CPU149.NET_RX
  12517375           -13.6%   10815164 ±  6%  softirqs.CPU15.NET_RX
  13109075           -12.5%   11468759 ±  5%  softirqs.CPU150.NET_RX
  13155012 ±  2%     -11.8%   11599981 ±  5%  softirqs.CPU151.NET_RX
  13206557 ±  2%     -12.7%   11528835 ±  5%  softirqs.CPU153.NET_RX
  13246800           -13.2%   11493216 ±  5%  softirqs.CPU155.NET_RX
  13230596 ±  2%     -12.4%   11586729 ±  6%  softirqs.CPU157.NET_RX
  12378590 ±  4%     -11.7%   10929811 ±  6%  softirqs.CPU16.NET_RX
  13198758           -13.3%   11443942 ±  4%  softirqs.CPU161.NET_RX
  13118407           -12.4%   11494052 ±  5%  softirqs.CPU163.NET_RX
  13288864           -13.0%   11561730 ±  5%  softirqs.CPU164.NET_RX
  13035472           -11.6%   11529561 ±  6%  softirqs.CPU165.NET_RX
  13108823           -11.9%   11552717 ±  6%  softirqs.CPU166.NET_RX
  12043645 ±  2%     -11.3%   10684377 ±  5%  softirqs.CPU168.NET_RX
  12582735 ±  2%     -12.0%   11076683 ±  6%  softirqs.CPU169.NET_RX
  12325594           -12.7%   10756612 ±  7%  softirqs.CPU17.NET_RX
  12349199 ±  2%     -10.9%   11003192 ±  6%  softirqs.CPU170.NET_RX
  12461022 ±  2%     -10.1%   11198876 ±  5%  softirqs.CPU171.NET_RX
  12690027 ±  2%     -13.1%   11022020 ±  6%  softirqs.CPU172.NET_RX
  12610934           -12.1%   11090140 ±  6%  softirqs.CPU173.NET_RX
  12604233 ±  2%     -11.7%   11133060 ±  5%  softirqs.CPU178.NET_RX
  12468100 ±  3%     -10.8%   11123580 ±  5%  softirqs.CPU179.NET_RX
  12352477 ±  2%     -13.3%   10714367 ±  7%  softirqs.CPU18.NET_RX
  12816064 ±  3%     -13.0%   11146671 ±  4%  softirqs.CPU180.NET_RX
  12661358 ±  2%     -12.5%   11083897 ±  6%  softirqs.CPU181.NET_RX
  12795268 ±  2%     -12.5%   11189948 ±  5%  softirqs.CPU182.NET_RX
  12648597           -10.9%   11265641 ±  6%  softirqs.CPU184.NET_RX
  12634864           -11.4%   11197056 ±  6%  softirqs.CPU186.NET_RX
  12666420 ±  2%     -12.4%   11093061 ±  7%  softirqs.CPU187.NET_RX
  12674576 ±  2%     -11.9%   11171697 ±  6%  softirqs.CPU189.NET_RX
  12524410 ±  2%     -12.4%   10975849 ±  5%  softirqs.CPU19.NET_RX
  12718850 ±  2%     -11.8%   11212682 ±  5%  softirqs.CPU190.NET_RX
  12277122           -12.7%   10711880 ±  5%  softirqs.CPU191.NET_RX
  12625433           -13.7%   10889915 ±  5%  softirqs.CPU2.NET_RX
  12656157           -14.1%   10877041 ±  6%  softirqs.CPU20.NET_RX
  12603711           -13.6%   10883305 ±  6%  softirqs.CPU21.NET_RX
  12410468           -13.3%   10756719 ±  6%  softirqs.CPU22.NET_RX
  12340513 ±  4%     -11.5%   10921254 ±  6%  softirqs.CPU23.NET_RX
  12201186           -11.8%   10764254 ±  5%  softirqs.CPU24.NET_RX
  12518924 ±  3%     -11.0%   11144932 ±  4%  softirqs.CPU25.NET_RX
  12738200 ±  3%     -12.5%   11141596 ±  5%  softirqs.CPU29.NET_RX
  12638695           -14.5%   10805230 ±  6%  softirqs.CPU3.NET_RX
  12685139 ±  3%     -11.5%   11225432 ±  4%  softirqs.CPU31.NET_RX
  12498908 ±  4%     -10.3%   11210292 ±  5%  softirqs.CPU35.NET_RX
  12599396           -14.4%   10787579 ±  6%  softirqs.CPU4.NET_RX
  12602340 ±  3%     -10.4%   11286246 ±  4%  softirqs.CPU40.NET_RX
  12577256 ±  3%     -10.8%   11214474 ±  4%  softirqs.CPU43.NET_RX
  12720527           -12.2%   11171273 ±  5%  softirqs.CPU44.NET_RX
  12551986 ±  3%     -10.1%   11279713 ±  4%  softirqs.CPU45.NET_RX
  12668364 ±  2%     -11.7%   11187115 ±  5%  softirqs.CPU46.NET_RX
  12146229 ±  2%     -11.4%   10760484 ±  4%  softirqs.CPU48.NET_RX
  13082731           -12.6%   11429841 ±  6%  softirqs.CPU49.NET_RX
  12613585           -13.5%   10914497 ±  5%  softirqs.CPU5.NET_RX
  12884219 ±  2%     -10.6%   11513768 ±  5%  softirqs.CPU50.NET_RX
  13058029           -12.4%   11433845 ±  5%  softirqs.CPU52.NET_RX
  13156374           -11.7%   11613793 ±  5%  softirqs.CPU53.NET_RX
  13166166           -12.6%   11504359 ±  5%  softirqs.CPU54.NET_RX
  13223045           -13.0%   11499593 ±  6%  softirqs.CPU58.NET_RX
  12657040 ±  2%     -14.8%   10786343 ±  6%  softirqs.CPU6.NET_RX
  13213868 ±  2%     -12.8%   11516377 ±  5%  softirqs.CPU61.NET_RX
  12685588 ±  3%      -9.2%   11513720 ±  5%  softirqs.CPU62.NET_RX
  13190208 ±  2%     -12.6%   11525735 ±  5%  softirqs.CPU63.NET_RX
  13146426           -13.0%   11441178 ±  6%  softirqs.CPU65.NET_RX
  13074482           -11.7%   11549990 ±  6%  softirqs.CPU66.NET_RX
  12968886           -11.6%   11463906 ±  5%  softirqs.CPU67.NET_RX
  13158609           -12.3%   11541720 ±  5%  softirqs.CPU68.NET_RX
  12590822 ±  2%     -13.9%   10846184 ±  7%  softirqs.CPU7.NET_RX
  12983955 ±  2%     -11.3%   11510734 ±  6%  softirqs.CPU70.NET_RX
  12608930           -12.3%   11063733 ±  5%  softirqs.CPU73.NET_RX
  12618178 ±  2%     -11.9%   11110507 ±  6%  softirqs.CPU75.NET_RX
  12585201           -12.0%   11079833 ±  6%  softirqs.CPU76.NET_RX
  12579423 ±  2%     -11.6%   11115054 ±  6%  softirqs.CPU77.NET_RX
  12514577 ±  2%     -12.0%   11015829 ±  6%  softirqs.CPU79.NET_RX
  12726020           -14.7%   10859487 ±  6%  softirqs.CPU8.NET_RX
  12515117 ±  2%     -12.2%   10984750 ±  4%  softirqs.CPU82.NET_RX
  12610968 ±  4%     -12.0%   11102570 ±  6%  softirqs.CPU84.NET_RX
  12465347 ±  2%     -11.7%   11010761 ±  7%  softirqs.CPU85.NET_RX
  12432119 ±  3%     -10.4%   11141968 ±  6%  softirqs.CPU88.NET_RX
  12740077           -15.3%   10792233 ±  5%  softirqs.CPU9.NET_RX
  12596147           -12.1%   11076260 ±  6%  softirqs.CPU90.NET_RX
  12556062 ±  3%     -12.1%   11038827 ±  6%  softirqs.CPU91.NET_RX
  12540278 ±  3%     -11.8%   11057534 ±  5%  softirqs.CPU93.NET_RX
  12577314 ±  3%     -11.9%   11080032 ±  5%  softirqs.CPU94.NET_RX
  12368266           -14.7%   10548148 ±  7%  softirqs.CPU96.NET_RX
  12453194           -12.7%   10874061 ±  6%  softirqs.CPU97.NET_RX
  12470741           -12.8%   10871333 ±  6%  softirqs.CPU98.NET_RX
  12473761 ±  2%     -13.8%   10750094 ±  5%  softirqs.CPU99.NET_RX
 2.435e+09           -11.9%  2.146e+09 ±  5%  softirqs.NET_RX
      6.63            -0.5        6.15 ±  4%  perf-profile.calltrace.cycles-pp.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg
      5.65            -0.5        5.18 ±  5%  perf-profile.calltrace.cycles-pp.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
      5.53            -0.5        5.07 ±  5%  perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg
      5.38            -0.5        4.92 ±  5%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg
      5.62 ±  2%      -0.4        5.20 ±  4%  perf-profile.calltrace.cycles-pp.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg
      4.94            -0.4        4.54 ±  5%  perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      4.65            -0.4        4.25 ±  5%  perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      0.65 ±  5%      -0.3        0.38 ± 71%  perf-profile.calltrace.cycles-pp.irqtime_account_irq.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2
      2.27            -0.2        2.04 ±  4%  perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
      2.72 ±  2%      -0.2        2.49 ±  4%  perf-profile.calltrace.cycles-pp.sctp_make_sack.sctp_packet_append_chunk.sctp_packet_transmit_chunk.sctp_outq_flush.sctp_cmd_interpreter
      2.23            -0.2        2.01 ±  4%  perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
      1.65 ±  2%      -0.2        1.44 ±  5%  perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg
      1.61 ±  2%      -0.2        1.39 ±  5%  perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
      2.41            -0.2        2.20 ±  3%  perf-profile.calltrace.cycles-pp.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
      2.27            -0.2        2.08 ±  4%  perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram
      1.32 ±  2%      -0.2        1.13 ±  3%  perf-profile.calltrace.cycles-pp.copy_msghdr_from_user.recvmsg_copy_msghdr.___sys_recvmsg.__sys_recvmsg.do_syscall_64
      1.33 ±  2%      -0.2        1.15 ±  3%  perf-profile.calltrace.cycles-pp.recvmsg_copy_msghdr.___sys_recvmsg.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.30 ±  2%      -0.2        1.15 ±  4%  perf-profile.calltrace.cycles-pp.__alloc_skb.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
      1.29            -0.1        1.15 ±  3%  perf-profile.calltrace.cycles-pp.sendmsg_copy_msghdr.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.96 ±  5%      -0.1        0.82 ±  8%  perf-profile.calltrace.cycles-pp.sctp_v4_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
      1.28            -0.1        1.14 ±  3%  perf-profile.calltrace.cycles-pp.copy_msghdr_from_user.sendmsg_copy_msghdr.___sys_sendmsg.__sys_sendmsg.do_syscall_64
      1.15            -0.1        1.03 ±  5%  perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
      0.72 ±  2%      -0.1        0.62 ±  6%  perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg
      0.73 ±  4%      -0.1        0.63 ±  5%  perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg
      0.93            -0.1        0.85 ±  4%  perf-profile.calltrace.cycles-pp.switch_fpu_return.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
      0.62 ±  4%      -0.1        0.54 ±  4%  perf-profile.calltrace.cycles-pp.ip_rcv_finish.ip_rcv.__netif_receive_skb_one_core.process_backlog.__napi_poll
      0.71 ±  5%      -0.1        0.63 ±  3%  perf-profile.calltrace.cycles-pp.import_iovec.copy_msghdr_from_user.recvmsg_copy_msghdr.___sys_recvmsg.__sys_recvmsg
      0.96            -0.1        0.88 ±  4%  perf-profile.calltrace.cycles-pp.__alloc_skb._sctp_make_chunk.sctp_make_sack.sctp_packet_append_chunk.sctp_packet_transmit_chunk
      0.68 ±  5%      -0.1        0.60 ±  3%  perf-profile.calltrace.cycles-pp.__import_iovec.import_iovec.copy_msghdr_from_user.recvmsg_copy_msghdr.___sys_recvmsg
      0.65 ±  2%      -0.1        0.58 ±  7%  perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg
      0.67            -0.1        0.60 ±  4%  perf-profile.calltrace.cycles-pp.__import_iovec.import_iovec.copy_msghdr_from_user.sendmsg_copy_msghdr.___sys_sendmsg
      0.70            -0.1        0.64 ±  4%  perf-profile.calltrace.cycles-pp.import_iovec.copy_msghdr_from_user.sendmsg_copy_msghdr.___sys_sendmsg.__sys_sendmsg
      0.67            -0.1        0.61 ±  6%  perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram
      0.66 ±  2%      -0.1        0.61 ±  6%  perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode
     97.64            +0.2       97.85        perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.76 ±  3%      +0.4        1.13 ± 13%  perf-profile.calltrace.cycles-pp.kfree_skb.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg
      1.30 ± 22%      +0.6        1.85 ±  9%  perf-profile.calltrace.cycles-pp.sctp_packet_config.sctp_outq_select_transport.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
      0.00            +0.6        0.55 ±  8%  perf-profile.calltrace.cycles-pp.kfree_skb.sctp_queue_purge_ulpevents.sctp_ulpq_tail_event.do_ulpq_tail_event.sctp_cmd_interpreter
     92.14            +0.7       92.81        perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.63 ±  3%      +0.7        2.34 ± 15%  perf-profile.calltrace.cycles-pp.sctp_sf_eat_data_6_2.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu
      1.38 ±  4%      +0.7        2.11 ± 16%  perf-profile.calltrace.cycles-pp.sctp_eat_data.sctp_sf_eat_data_6_2.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv
      0.00            +0.8        0.81 ± 20%  perf-profile.calltrace.cycles-pp.skb_release_head_state.skb_release_all.kfree_skb.sctp_recvmsg.inet_recvmsg
      0.00            +0.8        0.81 ± 20%  perf-profile.calltrace.cycles-pp.skb_release_all.kfree_skb.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
      1.14 ± 70%      +0.8        1.98 ±  5%  perf-profile.calltrace.cycles-pp.sctp_ulpevent_make_sender_dry_event.sctp_sf_do_no_pending_tsn.sctp_do_sm.sctp_cmd_interpreter.sctp_do_sm
      1.25 ± 70%      +0.9        2.14 ±  5%  perf-profile.calltrace.cycles-pp.sctp_sf_do_no_pending_tsn.sctp_do_sm.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv
      1.17 ± 70%      +0.9        2.06 ±  7%  perf-profile.calltrace.cycles-pp.sctp_outq_select_transport.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND
      0.00            +1.0        1.00 ± 27%  perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv
     74.98            +1.2       76.13        perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
     31.84            +1.2       33.00        perf-profile.calltrace.cycles-pp.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv
     74.43            +1.2       75.66        perf-profile.calltrace.cycles-pp.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
     72.97            +1.4       74.35        perf-profile.calltrace.cycles-pp.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
     67.91            +1.4       69.35        perf-profile.calltrace.cycles-pp.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg
     69.86            +1.5       71.39        perf-profile.calltrace.cycles-pp.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg
     70.66            +1.6       72.25        perf-profile.calltrace.cycles-pp.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64
      3.72 ± 37%      -1.2        2.51 ±  4%  perf-profile.children.cycles-pp.sctp_make_sack
      8.88            -0.7        8.14 ±  5%  perf-profile.children.cycles-pp.schedule
      8.61            -0.7        7.90 ±  5%  perf-profile.children.cycles-pp.__schedule
      5.86            -0.5        5.35 ±  5%  perf-profile.children.cycles-pp.__wake_up_common_lock
      5.65            -0.5        5.17 ±  5%  perf-profile.children.cycles-pp.__wake_up_common
      5.48            -0.5        5.00 ±  5%  perf-profile.children.cycles-pp.try_to_wake_up
      5.66            -0.5        5.18 ±  5%  perf-profile.children.cycles-pp.schedule_timeout
      6.66            -0.5        6.18 ±  4%  perf-profile.children.cycles-pp.sctp_skb_recv_datagram
      4.61            -0.5        4.13 ±  4%  perf-profile.children.cycles-pp.sctp_packet_transmit_chunk
      5.59            -0.5        5.12 ±  5%  perf-profile.children.cycles-pp.autoremove_wake_function
      4.83 ±  2%      -0.4        4.40 ±  4%  perf-profile.children.cycles-pp.__alloc_skb
      5.64 ±  2%      -0.4        5.22 ±  4%  perf-profile.children.cycles-pp.sctp_datamsg_from_user
      4.72            -0.4        4.30 ±  5%  perf-profile.children.cycles-pp.exit_to_user_mode_prepare
      4.96            -0.4        4.56 ±  5%  perf-profile.children.cycles-pp.syscall_exit_to_user_mode
      2.61 ±  2%      -0.3        2.28 ±  3%  perf-profile.children.cycles-pp.copy_msghdr_from_user
      1.26 ± 27%      -0.3        0.94 ±  4%  perf-profile.children.cycles-pp.sctp_addto_chunk
      2.28 ±  2%      -0.2        2.05 ±  4%  perf-profile.children.cycles-pp.ttwu_do_activate
      1.87            -0.2        1.64 ±  3%  perf-profile.children.cycles-pp._copy_from_user
      2.23            -0.2        2.01 ±  4%  perf-profile.children.cycles-pp.enqueue_task_fair
      1.66 ±  2%      -0.2        1.44 ±  5%  perf-profile.children.cycles-pp.skb_copy_datagram_iter
      2.46            -0.2        2.24 ±  3%  perf-profile.children.cycles-pp.sctp_packet_pack
      1.61 ±  2%      -0.2        1.40 ±  5%  perf-profile.children.cycles-pp.__skb_datagram_iter
      0.39 ± 44%      -0.2        0.19 ± 24%  perf-profile.children.cycles-pp.sctp_hash_key
      2.27            -0.2        2.09 ±  4%  perf-profile.children.cycles-pp.dequeue_task_fair
      1.34 ±  3%      -0.2        1.16 ±  3%  perf-profile.children.cycles-pp.recvmsg_copy_msghdr
      1.69 ±  2%      -0.2        1.51 ±  5%  perf-profile.children.cycles-pp.kmem_cache_free
      1.83 ±  2%      -0.2        1.65 ±  4%  perf-profile.children.cycles-pp.__check_object_size
      1.07 ±  3%      -0.2        0.90 ±  4%  perf-profile.children.cycles-pp.__copy_msghdr_from_user
      1.83 ±  2%      -0.2        1.67 ±  6%  perf-profile.children.cycles-pp.kfree
      1.76 ±  2%      -0.2        1.60 ±  6%  perf-profile.children.cycles-pp.mod_timer
      0.64 ±  7%      -0.2        0.49 ±  5%  perf-profile.children.cycles-pp.validate_xmit_skb
      1.42            -0.2        1.27 ±  3%  perf-profile.children.cycles-pp.__kmalloc_node_track_caller
      1.42 ±  3%      -0.1        1.28 ±  3%  perf-profile.children.cycles-pp.import_iovec
      1.35 ±  3%      -0.1        1.21 ±  3%  perf-profile.children.cycles-pp.__import_iovec
      0.96 ±  5%      -0.1        0.82 ±  8%  perf-profile.children.cycles-pp.sctp_v4_xmit
      1.30            -0.1        1.16 ±  4%  perf-profile.children.cycles-pp.sendmsg_copy_msghdr
      1.65 ±  2%      -0.1        1.51 ±  6%  perf-profile.children.cycles-pp.sctp_chunkify
      1.68 ±  2%      -0.1        1.54 ±  4%  perf-profile.children.cycles-pp.update_load_avg
      1.55 ±  2%      -0.1        1.41 ±  5%  perf-profile.children.cycles-pp.kmem_cache_alloc
      1.64            -0.1        1.51 ±  4%  perf-profile.children.cycles-pp.kmalloc_reserve
      1.07 ±  3%      -0.1        0.93 ±  4%  perf-profile.children.cycles-pp.iovec_from_user
      1.13 ±  2%      -0.1        1.01 ±  6%  perf-profile.children.cycles-pp._raw_spin_lock
      1.17            -0.1        1.05 ±  5%  perf-profile.children.cycles-pp.enqueue_entity
      1.34            -0.1        1.23 ±  6%  perf-profile.children.cycles-pp.switch_mm_irqs_off
      1.01 ±  2%      -0.1        0.90 ±  4%  perf-profile.children.cycles-pp.lock_sock_nested
      0.92 ±  3%      -0.1        0.81 ±  4%  perf-profile.children.cycles-pp.copy_user_generic_unrolled
      1.15 ±  4%      -0.1        1.04 ±  4%  perf-profile.children.cycles-pp.kmem_cache_alloc_node
      0.96            -0.1        0.86 ±  3%  perf-profile.children.cycles-pp.___might_sleep
      0.76 ±  4%      -0.1        0.66 ±  5%  perf-profile.children.cycles-pp.sockfd_lookup_light
      0.75 ±  4%      -0.1        0.65 ±  4%  perf-profile.children.cycles-pp._copy_to_iter
      0.67 ±  5%      -0.1        0.57 ±  9%  perf-profile.children.cycles-pp.irqtime_account_irq
      0.95 ±  2%      -0.1        0.85 ±  4%  perf-profile.children.cycles-pp.__might_fault
      0.71 ±  3%      -0.1        0.61 ±  4%  perf-profile.children.cycles-pp.set_next_entity
      0.73 ±  2%      -0.1        0.63 ±  6%  perf-profile.children.cycles-pp.simple_copy_to_iter
      0.47 ±  6%      -0.1        0.38 ±  7%  perf-profile.children.cycles-pp.__ip_finish_output
      0.32 ± 13%      -0.1        0.23 ±  9%  perf-profile.children.cycles-pp.netif_skb_features
      0.94            -0.1        0.85 ±  4%  perf-profile.children.cycles-pp.switch_fpu_return
      1.00            -0.1        0.91 ±  4%  perf-profile.children.cycles-pp.memset_erms
      0.62 ±  2%      -0.1        0.53 ±  7%  perf-profile.children.cycles-pp.__switch_to_asm
      0.38 ± 10%      -0.1        0.29 ± 13%  perf-profile.children.cycles-pp.ipv4_dst_check
      0.96            -0.1        0.88 ±  4%  perf-profile.children.cycles-pp.__might_sleep
      0.79 ±  4%      -0.1        0.70 ±  5%  perf-profile.children.cycles-pp.reweight_entity
      0.63 ±  4%      -0.1        0.55 ±  4%  perf-profile.children.cycles-pp.ip_rcv_finish
      0.31 ±  6%      -0.1        0.23 ±  6%  perf-profile.children.cycles-pp.ip_rcv_core
      0.43 ±  2%      -0.1        0.35 ±  8%  perf-profile.children.cycles-pp.security_socket_sendmsg
      0.93 ±  2%      -0.1        0.85 ±  4%  perf-profile.children.cycles-pp.__ksize
      0.79 ±  2%      -0.1        0.72 ±  3%  perf-profile.children.cycles-pp._raw_spin_lock_bh
      0.45 ±  2%      -0.1        0.38 ±  6%  perf-profile.children.cycles-pp.kmem_cache_alloc_trace
      0.52 ±  6%      -0.1        0.45 ±  4%  perf-profile.children.cycles-pp.ip_rcv_finish_core
      0.89            -0.1        0.82 ±  5%  perf-profile.children.cycles-pp.load_new_mm_cr3
      0.37 ±  4%      -0.1        0.30 ±  4%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.58            -0.1        0.52 ±  3%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.41 ±  4%      -0.1        0.36 ±  4%  perf-profile.children.cycles-pp.skb_dequeue
      0.33 ±  6%      -0.1        0.27 ±  6%  perf-profile.children.cycles-pp.copyout
      0.39 ±  3%      -0.1        0.33 ±  4%  perf-profile.children.cycles-pp.__cond_resched
      0.56            -0.1        0.51 ±  4%  perf-profile.children.cycles-pp.aa_sk_perm
      0.52 ±  2%      -0.1        0.47 ±  4%  perf-profile.children.cycles-pp.__virt_addr_valid
      0.42 ±  4%      -0.1        0.37 ±  4%  perf-profile.children.cycles-pp.skb_release_data
      0.52            -0.0        0.47 ±  5%  perf-profile.children.cycles-pp.__build_skb_around
      0.21 ±  5%      -0.0        0.16 ±  8%  perf-profile.children.cycles-pp.perf_tp_event
      0.19 ± 12%      -0.0        0.15 ± 13%  perf-profile.children.cycles-pp.detach_if_pending
      0.53            -0.0        0.49 ±  4%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.32 ±  2%      -0.0        0.28 ±  3%  perf-profile.children.cycles-pp.tick_sched_timer
      0.49 ±  2%      -0.0        0.45 ±  6%  perf-profile.children.cycles-pp.memcpy_erms
      0.17 ± 11%      -0.0        0.13 ±  9%  perf-profile.children.cycles-pp.skb_network_protocol
      0.44            -0.0        0.40 ±  3%  perf-profile.children.cycles-pp.security_socket_recvmsg
      0.49 ±  2%      -0.0        0.45 ±  3%  perf-profile.children.cycles-pp.sock_recvmsg
      0.33 ±  3%      -0.0        0.29 ±  5%  perf-profile.children.cycles-pp.sctp_transport_hold
      0.35 ±  4%      -0.0        0.32 ±  4%  perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
      0.37 ±  2%      -0.0        0.33 ±  5%  perf-profile.children.cycles-pp.read_tsc
      0.37 ±  2%      -0.0        0.34 ±  5%  perf-profile.children.cycles-pp.sctp_sf_eat_sack_6_2
      0.31 ±  5%      -0.0        0.28 ±  6%  perf-profile.children.cycles-pp.skb_clone
      0.22 ±  4%      -0.0        0.19 ±  4%  perf-profile.children.cycles-pp.ip_local_out
      0.41 ±  2%      -0.0        0.39 ±  4%  perf-profile.children.cycles-pp.sctp_association_hold
      0.20 ±  3%      -0.0        0.18 ±  6%  perf-profile.children.cycles-pp.sctp_chunk_hold
      0.19            -0.0        0.17 ±  4%  perf-profile.children.cycles-pp.__ip_local_out
      0.10 ±  7%      -0.0        0.08 ±  4%  perf-profile.children.cycles-pp.rb_next
      0.29 ±  2%      -0.0        0.27 ±  2%  perf-profile.children.cycles-pp.sock_wfree
      0.19 ±  2%      -0.0        0.17 ±  4%  perf-profile.children.cycles-pp.rcu_all_qs
      0.08 ±  8%      -0.0        0.06 ±  6%  perf-profile.children.cycles-pp.perf_trace_buf_update
      0.08 ± 12%      -0.0        0.06 ±  6%  perf-profile.children.cycles-pp.sctp_transport_raise_cwnd
      0.12 ±  3%      -0.0        0.10 ±  6%  perf-profile.children.cycles-pp.ip_send_check
      0.08            -0.0        0.06 ± 11%  perf-profile.children.cycles-pp.apparmor_socket_sendmsg
      0.09 ±  6%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.__fdget
      0.11 ±  4%      -0.0        0.10 ±  6%  perf-profile.children.cycles-pp.__x64_sys_recvmsg
      0.07            -0.0        0.06        perf-profile.children.cycles-pp.update_irq_load_avg
      0.07 ±  7%      +0.0        0.09 ± 10%  perf-profile.children.cycles-pp.wakeup_preempt_entity
      0.36 ±  8%      +0.1        0.42 ±  7%  perf-profile.children.cycles-pp.enqueue_to_backlog
      0.40 ± 11%      +0.1        0.53 ± 13%  perf-profile.children.cycles-pp.sctp_ulpevent_receive_data
     97.69            +0.2       97.89        perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.14 ± 17%      +0.2        0.34 ± 21%  perf-profile.children.cycles-pp.inet_sendmsg
      1.60 ±  8%      +0.3        1.86 ±  9%  perf-profile.children.cycles-pp.sctp_packet_config
      0.15 ± 71%      +0.3        0.44 ± 17%  perf-profile.children.cycles-pp.sctp_bind_addr_match
      1.68 ±  5%      +0.3        2.00 ±  5%  perf-profile.children.cycles-pp.sctp_ulpevent_make_sender_dry_event
      1.74 ±  3%      +0.3        2.07 ±  7%  perf-profile.children.cycles-pp.sctp_outq_select_transport
      8.34 ±  2%      +0.4        8.70 ±  2%  perf-profile.children.cycles-pp.skb_release_all
      8.27 ±  2%      +0.4        8.63 ±  2%  perf-profile.children.cycles-pp.skb_release_head_state
      1.23 ±  3%      +0.5        1.70 ± 11%  perf-profile.children.cycles-pp.kfree_skb
      0.03 ± 99%      +0.5        0.54 ± 39%  perf-profile.children.cycles-pp.sctp_sched_dequeue_done
      0.45 ±  6%      +0.6        1.07 ± 22%  perf-profile.children.cycles-pp.release_sock
      0.20 ± 71%      +0.7        0.87 ± 25%  perf-profile.children.cycles-pp.sctp_sock_rfree
     92.17            +0.7       92.84        perf-profile.children.cycles-pp.do_syscall_64
      1.64 ±  3%      +0.7        2.34 ± 15%  perf-profile.children.cycles-pp.sctp_sf_eat_data_6_2
      1.39 ±  4%      +0.7        2.13 ± 16%  perf-profile.children.cycles-pp.sctp_eat_data
      1.26 ± 70%      +0.9        2.15 ±  5%  perf-profile.children.cycles-pp.sctp_sf_do_no_pending_tsn
     75.00            +1.1       76.14        perf-profile.children.cycles-pp.__sys_sendmsg
     31.90            +1.2       33.05        perf-profile.children.cycles-pp.sctp_rcv
     74.44            +1.2       75.67        perf-profile.children.cycles-pp.___sys_sendmsg
     72.98            +1.4       74.37        perf-profile.children.cycles-pp.____sys_sendmsg
     67.95            +1.4       69.39        perf-profile.children.cycles-pp.sctp_sendmsg_to_asoc
     69.94            +1.5       71.45        perf-profile.children.cycles-pp.sctp_sendmsg
     70.67            +1.6       72.26        perf-profile.children.cycles-pp.sock_sendmsg
      0.38 ± 45%      -0.2        0.19 ± 24%  perf-profile.self.cycles-pp.sctp_hash_key
      1.66 ±  2%      -0.2        1.48 ±  4%  perf-profile.self.cycles-pp.kmem_cache_free
      1.79 ±  2%      -0.2        1.63 ±  6%  perf-profile.self.cycles-pp.kfree
      0.95 ±  5%      -0.1        0.81 ±  8%  perf-profile.self.cycles-pp.sctp_v4_xmit
      1.11 ±  2%      -0.1        0.99 ±  6%  perf-profile.self.cycles-pp._raw_spin_lock
      0.88 ±  3%      -0.1        0.77 ±  4%  perf-profile.self.cycles-pp.copy_user_generic_unrolled
      0.47 ±  5%      -0.1        0.36 ±  6%  perf-profile.self.cycles-pp.ip_output
      0.88 ±  2%      -0.1        0.78 ±  3%  perf-profile.self.cycles-pp.__kmalloc_node_track_caller
      0.94 ±  2%      -0.1        0.84 ±  4%  perf-profile.self.cycles-pp.___might_sleep
      0.96 ±  3%      -0.1        0.86 ±  5%  perf-profile.self.cycles-pp.__alloc_skb
      0.40 ±  8%      -0.1        0.30 ±  8%  perf-profile.self.cycles-pp.ip_protocol_deliver_rcu
      0.48 ±  3%      -0.1        0.39 ±  4%  perf-profile.self.cycles-pp.net_rx_action
      1.00            -0.1        0.91 ±  4%  perf-profile.self.cycles-pp.sctp_do_sm
      0.38 ±  9%      -0.1        0.29 ± 14%  perf-profile.self.cycles-pp.ipv4_dst_check
      0.61 ±  2%      -0.1        0.52 ±  7%  perf-profile.self.cycles-pp.__switch_to_asm
      0.42 ±  3%      -0.1        0.33 ±  6%  perf-profile.self.cycles-pp.____sys_sendmsg
      0.85 ±  4%      -0.1        0.76 ±  6%  perf-profile.self.cycles-pp.update_load_avg
      0.96            -0.1        0.87 ±  4%  perf-profile.self.cycles-pp.memset_erms
      0.31 ±  7%      -0.1        0.22 ±  6%  perf-profile.self.cycles-pp.ip_rcv_core
      0.89            -0.1        0.81 ±  3%  perf-profile.self.cycles-pp.switch_fpu_return
      0.63 ±  6%      -0.1        0.55 ±  7%  perf-profile.self.cycles-pp.sctp_datamsg_from_user
      0.90 ±  2%      -0.1        0.82 ±  4%  perf-profile.self.cycles-pp.__ksize
      0.89            -0.1        0.82 ±  5%  perf-profile.self.cycles-pp.load_new_mm_cr3
      0.83            -0.1        0.75 ±  3%  perf-profile.self.cycles-pp.__might_sleep
      0.76 ±  2%      -0.1        0.69 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock_bh
      0.52 ±  6%      -0.1        0.44 ±  4%  perf-profile.self.cycles-pp.ip_rcv_finish_core
      0.83 ±  3%      -0.1        0.76 ±  5%  perf-profile.self.cycles-pp.kmem_cache_alloc_node
      0.68 ±  2%      -0.1        0.61 ±  4%  perf-profile.self.cycles-pp.__check_object_size
      0.33 ±  4%      -0.1        0.26 ± 10%  perf-profile.self.cycles-pp.__ip_finish_output
      0.17 ± 21%      -0.1        0.11 ± 11%  perf-profile.self.cycles-pp.netif_skb_features
      0.12 ± 61%      -0.1        0.05 ±  7%  perf-profile.self.cycles-pp.sctp_tsnmap_mark
      0.38 ±  7%      -0.1        0.31 ±  5%  perf-profile.self.cycles-pp.enqueue_entity
      0.36 ±  7%      -0.1        0.29 ±  5%  perf-profile.self.cycles-pp.__local_bh_enable_ip
      0.24 ±  2%      -0.1        0.18 ± 13%  perf-profile.self.cycles-pp.irqtime_account_irq
      0.45 ±  4%      -0.1        0.39 ±  4%  perf-profile.self.cycles-pp.__ip_queue_xmit
      0.53 ±  7%      -0.1        0.48 ±  5%  perf-profile.self.cycles-pp.lock_timer_base
      0.52            -0.1        0.47 ±  3%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.18 ±  8%      -0.1        0.12 ± 10%  perf-profile.self.cycles-pp.sock_sendmsg
      0.40 ±  3%      -0.1        0.35 ±  6%  perf-profile.self.cycles-pp.sctp_skb_recv_datagram
      0.52 ±  7%      -0.0        0.47 ±  4%  perf-profile.self.cycles-pp.sctp_make_sack
      0.24 ±  4%      -0.0        0.19 ±  8%  perf-profile.self.cycles-pp.__skb_clone
      0.42 ±  3%      -0.0        0.37 ±  4%  perf-profile.self.cycles-pp.skb_release_data
      0.52 ±  4%      -0.0        0.48 ±  5%  perf-profile.self.cycles-pp.ip_finish_output2
      0.28 ±  4%      -0.0        0.23 ±  7%  perf-profile.self.cycles-pp.kmem_cache_alloc_trace
      0.49 ±  2%      -0.0        0.44 ±  4%  perf-profile.self.cycles-pp.__virt_addr_valid
      0.52            -0.0        0.48 ±  4%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.47 ±  2%      -0.0        0.42 ±  4%  perf-profile.self.cycles-pp.native_sched_clock
      0.47 ±  2%      -0.0        0.43 ±  5%  perf-profile.self.cycles-pp.memcpy_erms
      0.46            -0.0        0.41 ±  4%  perf-profile.self.cycles-pp.aa_sk_perm
      0.25 ±  6%      -0.0        0.21 ±  5%  perf-profile.self.cycles-pp.sctp_ulpq_tail_data
      0.43 ±  4%      -0.0        0.39 ±  3%  perf-profile.self.cycles-pp.process_backlog
      0.31 ±  3%      -0.0        0.27 ±  5%  perf-profile.self.cycles-pp.sctp_transport_hold
      0.32 ±  2%      -0.0        0.29 ±  4%  perf-profile.self.cycles-pp.enqueue_task_fair
      0.27            -0.0        0.23 ±  5%  perf-profile.self.cycles-pp._copy_from_user
      0.32 ±  4%      -0.0        0.29 ±  4%  perf-profile.self.cycles-pp.sctp_transport_reset_t3_rtx
      0.19 ±  6%      -0.0        0.16 ±  4%  perf-profile.self.cycles-pp.__cond_resched
      0.15 ±  7%      -0.0        0.12 ± 10%  perf-profile.self.cycles-pp.skb_network_protocol
      0.17 ±  3%      -0.0        0.14 ±  4%  perf-profile.self.cycles-pp.iovec_from_user
      0.40 ±  2%      -0.0        0.37 ±  3%  perf-profile.self.cycles-pp.sctp_association_hold
      0.19 ±  4%      -0.0        0.17 ±  4%  perf-profile.self.cycles-pp.sctp_chunk_hold
      0.13 ±  9%      -0.0        0.10 ±  4%  perf-profile.self.cycles-pp.sockfd_lookup_light
      0.27 ±  3%      -0.0        0.24 ±  2%  perf-profile.self.cycles-pp.set_next_buddy
      0.16 ±  3%      -0.0        0.13 ±  5%  perf-profile.self.cycles-pp.rcu_all_qs
      0.12 ±  5%      -0.0        0.10 ±  6%  perf-profile.self.cycles-pp.perf_tp_event
      0.10 ±  7%      -0.0        0.08        perf-profile.self.cycles-pp.rb_next
      0.10 ±  7%      -0.0        0.07 ± 10%  perf-profile.self.cycles-pp.ip_local_deliver_finish
      0.26            -0.0        0.23 ±  6%  perf-profile.self.cycles-pp.sctp_ulpevent_init
      0.19 ±  5%      -0.0        0.17 ±  4%  perf-profile.self.cycles-pp.dequeue_task_fair
      0.19 ±  3%      -0.0        0.17 ±  7%  perf-profile.self.cycles-pp.sock_kmalloc
      0.26 ±  4%      -0.0        0.24 ±  5%  perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
      0.12 ±  3%      -0.0        0.10 ±  3%  perf-profile.self.cycles-pp.ip_send_check
      0.29 ±  3%      -0.0        0.27        perf-profile.self.cycles-pp.__import_iovec
      0.17 ±  4%      -0.0        0.15 ±  6%  perf-profile.self.cycles-pp.__build_skb_around
      0.07            -0.0        0.06 ±  8%  perf-profile.self.cycles-pp.apparmor_socket_sendmsg
      0.07            -0.0        0.06        perf-profile.self.cycles-pp.update_irq_load_avg
      0.11            +0.0        0.12 ±  6%  perf-profile.self.cycles-pp.sock_kfree_s
      0.06 ±  9%      +0.0        0.08 ± 11%  perf-profile.self.cycles-pp.wakeup_preempt_entity
      0.20 ±  3%      +0.2        0.37 ± 18%  perf-profile.self.cycles-pp.sctp_ulpevent_receive_data
      0.17 ±  8%      +0.2        0.34 ± 19%  perf-profile.self.cycles-pp.inet_recvmsg
      0.10 ± 17%      +0.2        0.29 ± 23%  perf-profile.self.cycles-pp.inet_sendmsg
      0.50 ±  2%      +0.2        0.70 ± 10%  perf-profile.self.cycles-pp.sctp_recvmsg
      0.10 ± 71%      +0.3        0.36 ± 21%  perf-profile.self.cycles-pp.sctp_bind_addr_match
      0.18 ±  9%      +0.3        0.46 ± 24%  perf-profile.self.cycles-pp.sctp_ulpevent_make_rcvmsg
      1.01 ±  5%      +0.4        1.36 ±  8%  perf-profile.self.cycles-pp.sctp_rcv
      0.34 ± 15%      +0.4        0.73 ± 19%  perf-profile.self.cycles-pp.sctp_ulpevent_make_sender_dry_event
      0.96 ±  9%      +0.4        1.37 ± 10%  perf-profile.self.cycles-pp.sctp_packet_config
      1.90 ±  3%      +0.4        2.33 ±  9%  perf-profile.self.cycles-pp.sctp_cmd_interpreter
      0.36 ±  2%      +0.4        0.80 ± 20%  perf-profile.self.cycles-pp.sctp_wfree
      0.54 ±  3%      +0.5        1.05 ± 18%  perf-profile.self.cycles-pp.sctp_packet_transmit
      0.01 ±223%      +0.5        0.53 ± 39%  perf-profile.self.cycles-pp.sctp_sched_dequeue_done
      0.09 ± 21%      +0.6        0.73 ± 33%  perf-profile.self.cycles-pp.release_sock
      0.20 ± 71%      +0.7        0.86 ± 25%  perf-profile.self.cycles-pp.sctp_sock_rfree
      0.74 ±  8%      +0.8        1.55 ± 24%  perf-profile.self.cycles-pp.sctp_eat_data
      0.98 ±  6%      +0.8        1.80 ± 21%  perf-profile.self.cycles-pp.sctp_outq_flush
      0.67 ±  4%      +1.3        2.01 ± 29%  perf-profile.self.cycles-pp.sctp_sendmsg_to_asoc


                                                                                
                               netperf.Throughput_tps                           
                                                                                
  22000 +-------------------------------------------------------------------+   
        |..+.+..+.+..+.   +..+..+.+..+.+.    +.+..+.+..+..+.+..+..+.+..+.+..|   
  20000 |-+          O       O                    O O  O          O O  O    |   
  18000 |-+O    O         O                                                 |   
        |         O     O       O         O  O O          O O  O         O  |   
  16000 |-+  O                       O                                      |   
        |                              O                                    |   
  14000 |-+                                                                 |   
        |                                                                   |   
  12000 |-+                                                                 |   
  10000 |-+                                                                 |   
        |                                                                   |   
   8000 |-+                                                                 |   
        |                         O                                         |   
   6000 +-------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


---
0DAY/LKP+ Test Infrastructure                   Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org       Intel Corporation

Thanks,
Oliver Sang


View attachment "config-5.12.0-rc5-00001-g6a3193cdd5e5" of type "text/plain" (172899 bytes)

View attachment "job-script" of type "text/plain" (7887 bytes)

View attachment "job.yaml" of type "text/plain" (5367 bytes)

View attachment "reproduce" of type "text/plain" (19873 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ