lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <20220621143838.GA22340@xsang-OptiPlex-9020>
Date:   Tue, 21 Jun 2022 22:38:38 +0800
From:   kernel test robot <oliver.sang@...el.com>
To:     Eric Dumazet <edumazet@...gle.com>
Cc:     "David S. Miller" <davem@...emloft.net>,
        LKML <linux-kernel@...r.kernel.org>, netdev@...r.kernel.org,
        lkp@...ts.01.org, lkp@...el.com, ying.huang@...el.com,
        feng.tang@...el.com, zhengjun.xing@...ux.intel.com,
        fengwei.yin@...el.com, guobing.chen@...el.com,
        ming.a.chen@...el.com, frank.du@...el.com, Shuhua.Fan@...el.com,
        wangyang.guo@...el.com, Wenhuan.Huang@...el.com,
        jessica.ji@...el.com, shan.kang@...el.com, guangli.li@...el.com,
        tiejun.li@...el.com, yu.ma@...el.com, dapeng1.mi@...el.com,
        jiebin.sun@...el.com, gengxin.xie@...el.com, fan.zhao@...el.com
Subject: [net]  9098765002:
 phoronix-test-suite.mcperf.Get.1.operations_per_second -6.0% regression



Greeting,

FYI, we noticed a -6.0% regression of phoronix-test-suite.mcperf.Get.1.operations_per_second due to commit:


commit: 909876500251b3b48480a840bbf9053588254eee ("net: call skb_defer_free_flush() before each napi_poll()")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master

in testcase: phoronix-test-suite
on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory
with following parameters:

	test: mcperf-1.4.0
	option_a: Get
	option_b: 1
	cpufreq_governor: performance
	ucode: 0x500320a

test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added.
test-url: http://www.phoronix-test-suite.com/



If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        sudo bin/lkp install job.yaml           # job file is attached in this email
        bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
        sudo bin/lkp run generated-yaml-file

        # if come across any failure that blocks the test,
        # please remove ~/.lkp and /lkp dir to run from a clean state.

=========================================================================================
compiler/cpufreq_governor/kconfig/option_a/option_b/rootfs/tbox_group/test/testcase/ucode:
  gcc-11/performance/x86_64-rhel-8.3/Get/1/debian-x86_64-phoronix/lkp-csl-2sp7/mcperf-1.4.0/phoronix-test-suite/0x500320a

commit: 
  39564c3fdc ("net: add skb_defer_max sysctl")
  9098765002 ("net: call skb_defer_free_flush() before each napi_poll()")

39564c3fdc6684c6 909876500251b3b48480a840bbf 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     97403            -6.0%      91602        phoronix-test-suite.mcperf.Get.1.operations_per_second
    103.24            +9.4%     112.97 ± 10%  phoronix-test-suite.time.elapsed_time
    103.24            +9.4%     112.97 ± 10%  phoronix-test-suite.time.elapsed_time.max
     47.17            +4.9%      49.50        phoronix-test-suite.time.percent_of_cpu_this_job_got
      0.13 ±  2%      -0.0        0.11 ±  6%  turbostat.POLL%
    114218            -3.5%     110266        vmstat.system.cs
 8.613e+08            +2.2%  8.806e+08        perf-stat.i.branch-instructions
   1801639 ± 12%     +23.9%    2232353 ±  6%  perf-stat.i.iTLB-loads
 4.268e+09            +2.2%  4.362e+09        perf-stat.i.instructions
    183037            +1.5%     185699        proc-vmstat.nr_shmem
    649911           +10.7%     719236 ±  6%  proc-vmstat.numa_hit
    581361           +12.1%     651561 ±  7%  proc-vmstat.numa_local
    655631           +10.5%     724491 ±  6%  proc-vmstat.pgalloc_normal
    752632            +5.7%     795170 ±  6%  proc-vmstat.pgfault
    527788           +11.4%     587940 ± 18%  proc-vmstat.pgfree
    105406            +6.7%     112508 ±  7%  proc-vmstat.pgreuse
     82.15 ±  5%     -11.9       70.29 ±  9%  perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     74.79 ±  4%     -11.9       62.94 ± 10%  perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
     74.83 ±  5%     -11.5       63.33 ± 10%  perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
     84.78 ±  4%      -9.5       75.28 ±  7%  perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
     83.60 ±  4%      -9.2       74.44 ±  7%  perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     83.64 ±  4%      -9.1       74.50 ±  7%  perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
     83.64 ±  4%      -9.1       74.50 ±  7%  perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
     50.58 ±  7%      -7.3       43.24 ± 12%  perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call
      2.77 ± 31%      -1.8        0.98 ± 56%  perf-profile.calltrace.cycles-pp.read
      2.72 ± 32%      -1.7        0.97 ± 56%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
      2.71 ± 31%      -1.7        0.97 ± 57%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
      2.70 ± 32%      -1.7        0.96 ± 57%  perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
      2.70 ± 31%      -1.7        0.97 ± 57%  perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
      2.45 ± 33%      -1.6        0.82 ± 59%  perf-profile.calltrace.cycles-pp.seq_read_iter.seq_read.vfs_read.ksys_read.do_syscall_64
      2.45 ± 33%      -1.6        0.82 ± 59%  perf-profile.calltrace.cycles-pp.seq_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.16 ± 35%      -1.4        0.72 ± 58%  perf-profile.calltrace.cycles-pp.proc_single_show.seq_read_iter.seq_read.vfs_read.ksys_read
      1.55 ± 28%      -1.2        0.35 ±104%  perf-profile.calltrace.cycles-pp.proc_pid_status.proc_single_show.seq_read_iter.seq_read.vfs_read
      1.84 ± 47%      -1.1        0.75 ± 52%  perf-profile.calltrace.cycles-pp.ret_from_fork
      1.83 ± 48%      -1.1        0.75 ± 52%  perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
      1.71 ± 51%      -1.0        0.67 ± 52%  perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
      1.57 ± 52%      -1.0        0.54 ± 75%  perf-profile.calltrace.cycles-pp.memcpy_toio.drm_fb_helper_damage_blit_real.drm_fb_helper_damage_work.process_one_work.worker_thread
      1.68 ± 52%      -1.0        0.66 ± 53%  perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
      1.60 ± 52%      -1.0        0.63 ± 52%  perf-profile.calltrace.cycles-pp.drm_fb_helper_damage_blit_real.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread
      1.60 ± 52%      -1.0        0.63 ± 52%  perf-profile.calltrace.cycles-pp.drm_fb_helper_damage_work.process_one_work.worker_thread.kthread.ret_from_fork
      2.98 ±  8%      -0.9        2.05 ± 20%  perf-profile.calltrace.cycles-pp.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
      2.56 ±  9%      -0.9        1.64 ± 20%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
      1.09 ± 11%      -0.4        0.72 ± 47%  perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
      0.09 ±223%      +0.8        0.89 ± 36%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_tp_event.perf_trace_sched_switch.__schedule.schedule_idle
      0.09 ±223%      +0.8        0.92 ± 35%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule_idle.do_idle
      0.10 ±223%      +0.8        0.95 ± 35%  perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.13 ±223%      +0.9        0.98 ± 36%  perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_wakeup_template.ttwu_do_wakeup
      0.13 ±223%      +0.9        0.99 ± 35%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_tp_event.perf_trace_sched_wakeup_template.ttwu_do_wakeup.sched_ttwu_pending
      0.10 ±223%      +0.9        0.97 ± 30%  perf-profile.calltrace.cycles-pp.tcp_recvmsg_locked.tcp_recvmsg.inet6_recvmsg.sock_read_iter.new_sync_read
      0.13 ±223%      +0.9        1.03 ± 36%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_wakeup_template.ttwu_do_wakeup.sched_ttwu_pending.__sysvec_call_function_single
      0.14 ±223%      +0.9        1.06 ± 38%  perf-profile.calltrace.cycles-pp.perf_trace_sched_wakeup_template.ttwu_do_wakeup.sched_ttwu_pending.__sysvec_call_function_single.sysvec_call_function_single
      0.14 ±223%      +0.9        1.07 ± 38%  perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.sched_ttwu_pending.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single
      0.14 ±223%      +1.1        1.28 ± 28%  perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet6_recvmsg.sock_read_iter.new_sync_read.vfs_read
      0.14 ±223%      +1.1        1.28 ± 29%  perf-profile.calltrace.cycles-pp.inet6_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read
      0.15 ±223%      +1.2        1.30 ± 35%  perf-profile.calltrace.cycles-pp.sched_ttwu_pending.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch
      0.15 ±223%      +1.2        1.38 ± 32%  perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_stat_runtime
      0.16 ±223%      +1.2        1.40 ± 37%  perf-profile.calltrace.cycles-pp.__sysvec_call_function_single.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch.__schedule
      0.15 ±223%      +1.2        1.40 ± 28%  perf-profile.calltrace.cycles-pp.sock_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64
      0.16 ±223%      +1.3        1.43 ± 28%  perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.16 ±223%      +1.3        1.47 ± 37%  perf-profile.calltrace.cycles-pp.sysvec_call_function_single.asm_sysvec_call_function_single.finish_task_switch.__schedule.schedule_idle
      0.18 ±223%      +1.4        1.53 ± 29%  perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.18 ±223%      +1.4        1.54 ± 32%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_tp_event.perf_trace_sched_switch.__schedule.schedule
      0.18 ±223%      +1.4        1.57 ± 31%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.schedule_hrtimeout_range_clock
      0.18 ±223%      +1.4        1.60 ± 32%  perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.schedule_hrtimeout_range_clock.ep_poll
      0.18 ±223%      +1.4        1.60 ± 30%  perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity
      0.18 ±223%      +1.4        1.60 ± 30%  perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr
      0.19 ±223%      +1.4        1.61 ± 30%  perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair
      0.18 ±223%      +1.5        1.64 ± 29%  perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.19 ±223%      +1.5        1.64 ± 30%  perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair.__schedule
      0.17 ±223%      +1.5        1.66 ± 36%  perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry
      0.19 ±223%      +1.5        1.68 ± 36%  perf-profile.calltrace.cycles-pp.asm_sysvec_call_function_single.finish_task_switch.__schedule.schedule_idle.do_idle
      0.20 ±223%      +1.5        1.71 ± 30%  perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
      0.21 ±223%      +1.6        1.81 ± 30%  perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_hrtimeout_range_clock
      0.22 ±223%      +1.6        1.84 ± 30%  perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_hrtimeout_range_clock.ep_poll
      0.24 ±223%      +1.7        1.92 ± 30%  perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v6_do_rcv.tcp_v6_rcv.ip6_protocol_deliver_rcu.ip6_input_finish
      0.24 ±223%      +1.7        1.96 ± 30%  perf-profile.calltrace.cycles-pp.tcp_v6_do_rcv.tcp_v6_rcv.ip6_protocol_deliver_rcu.ip6_input_finish.__netif_receive_skb_one_core
      0.14 ±223%      +1.8        1.94 ± 40%  perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_switch
      0.27 ±223%      +2.0        2.29 ± 37%  perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.____sys_sendmsg
      0.30 ±223%      +2.1        2.38 ± 26%  perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.sock_write_iter
      0.30 ±223%      +2.1        2.42 ± 31%  perf-profile.calltrace.cycles-pp.tcp_v6_rcv.ip6_protocol_deliver_rcu.ip6_input_finish.__netif_receive_skb_one_core.process_backlog
      0.30 ±223%      +2.2        2.45 ± 31%  perf-profile.calltrace.cycles-pp.ip6_protocol_deliver_rcu.ip6_input_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll
      0.27 ±223%      +2.2        2.42 ± 33%  perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_switch.__schedule
      0.30 ±223%      +2.2        2.50 ± 31%  perf-profile.calltrace.cycles-pp.ip6_input_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action
      0.33 ±223%      +2.3        2.59 ± 31%  perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start
      0.32 ±223%      +2.3        2.66 ± 36%  perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg
      0.34 ±223%      +2.3        2.68 ± 32%  perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq
      0.34 ±223%      +2.3        2.69 ± 31%  perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip
      0.34 ±223%      +2.4        2.75 ± 26%  perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.sock_write_iter.do_iter_readv_writev
      0.32 ±223%      +2.4        2.73 ± 36%  perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg
      0.33 ±223%      +2.4        2.77 ± 36%  perf-profile.calltrace.cycles-pp.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64
      0.36 ±223%      +2.4        2.80 ± 26%  perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.sock_write_iter.do_iter_readv_writev.do_iter_write
      0.34 ±223%      +2.5        2.80 ± 36%  perf-profile.calltrace.cycles-pp.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.36 ±223%      +2.5        2.83 ± 27%  perf-profile.calltrace.cycles-pp.sock_sendmsg.sock_write_iter.do_iter_readv_writev.do_iter_write.vfs_writev
      0.36 ±223%      +2.5        2.86 ± 28%  perf-profile.calltrace.cycles-pp.sock_write_iter.do_iter_readv_writev.do_iter_write.vfs_writev.do_writev
      0.36 ±223%      +2.5        2.88 ± 28%  perf-profile.calltrace.cycles-pp.do_iter_readv_writev.do_iter_write.vfs_writev.do_writev.do_syscall_64
      0.37 ±223%      +2.6        2.93 ± 27%  perf-profile.calltrace.cycles-pp.do_iter_write.vfs_writev.do_writev.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.35 ±223%      +2.6        2.92 ± 36%  perf-profile.calltrace.cycles-pp.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.35 ±223%      +2.6        2.98 ± 36%  perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.40 ±223%      +2.7        3.11 ± 27%  perf-profile.calltrace.cycles-pp.vfs_writev.do_writev.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.41 ±223%      +2.7        3.14 ± 27%  perf-profile.calltrace.cycles-pp.do_writev.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.39 ±223%      +2.8        3.20 ± 30%  perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip6_finish_output2
      0.35 ±223%      +2.9        3.23 ± 35%  perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
      0.36 ±223%      +2.9        3.25 ± 35%  perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
      0.41 ±223%      +2.9        3.31 ± 30%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip6_finish_output2.ip6_finish_output
      0.42 ±223%      +2.9        3.33 ± 30%  perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip6_finish_output2.ip6_finish_output.ip6_xmit.inet6_csk_xmit
      0.41 ±223%      +2.9        3.32 ± 30%  perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip6_finish_output2.ip6_finish_output.ip6_xmit
      0.39 ±223%      +3.1        3.45 ± 39%  perf-profile.calltrace.cycles-pp.ep_send_events.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64
      0.46 ±223%      +3.2        3.71 ± 30%  perf-profile.calltrace.cycles-pp.ip6_finish_output2.ip6_finish_output.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb
      0.38 ±223%      +3.3        3.66 ± 42%  perf-profile.calltrace.cycles-pp.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow
      0.38 ±223%      +3.3        3.68 ± 42%  perf-profile.calltrace.cycles-pp.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_tp_event
      0.47 ±223%      +3.3        3.79 ± 30%  perf-profile.calltrace.cycles-pp.ip6_finish_output.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit
      0.44 ±223%      +3.3        3.78 ± 31%  perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait
      0.45 ±223%      +3.4        3.81 ± 31%  perf-profile.calltrace.cycles-pp.schedule.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
      0.46 ±223%      +3.4        3.87 ± 31%  perf-profile.calltrace.cycles-pp.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64
      0.48 ±223%      +3.4        3.90 ± 30%  perf-profile.calltrace.cycles-pp.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
      0.49 ±223%      +3.6        4.06 ± 30%  perf-profile.calltrace.cycles-pp.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked
      0.52 ±223%      +3.9        4.38 ± 31%  perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg
      0.57 ±223%      +4.1        4.66 ± 31%  perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
      0.97 ±223%      +7.5        8.49 ± 35%  perf-profile.calltrace.cycles-pp.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.02 ±223%      +7.8        8.83 ± 35%  perf-profile.calltrace.cycles-pp.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
      1.10 ±223%      +8.4        9.53 ± 36%  perf-profile.calltrace.cycles-pp.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.60 ±115%     +14.5       18.12 ± 32%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.64 ±116%     +14.7       18.38 ± 32%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
     83.34 ±  4%     -12.2       71.10 ±  9%  perf-profile.children.cycles-pp.cpuidle_idle_call
     75.88 ±  4%     -11.9       64.02 ± 10%  perf-profile.children.cycles-pp.cpuidle_enter
     75.77 ±  4%     -11.8       63.95 ± 10%  perf-profile.children.cycles-pp.cpuidle_enter_state
     84.78 ±  4%      -9.5       75.27 ±  7%  perf-profile.children.cycles-pp.do_idle
     84.78 ±  4%      -9.5       75.28 ±  7%  perf-profile.children.cycles-pp.secondary_startup_64_no_verify
     84.78 ±  4%      -9.5       75.28 ±  7%  perf-profile.children.cycles-pp.cpu_startup_entry
     83.64 ±  4%      -9.1       74.50 ±  7%  perf-profile.children.cycles-pp.start_secondary
      2.80 ± 32%      -1.7        1.06 ± 40%  perf-profile.children.cycles-pp.read
      2.64 ± 31%      -1.7        0.99 ± 43%  perf-profile.children.cycles-pp.seq_read_iter
      2.48 ± 33%      -1.6        0.92 ± 43%  perf-profile.children.cycles-pp.seq_read
      2.18 ± 34%      -1.5        0.72 ± 58%  perf-profile.children.cycles-pp.proc_single_show
      1.57 ± 29%      -1.1        0.50 ± 54%  perf-profile.children.cycles-pp.proc_pid_status
      1.85 ± 47%      -1.0        0.81 ± 40%  perf-profile.children.cycles-pp.ret_from_fork
      1.83 ± 48%      -1.0        0.79 ± 40%  perf-profile.children.cycles-pp.kthread
      1.71 ± 51%      -1.0        0.69 ± 43%  perf-profile.children.cycles-pp.worker_thread
      1.68 ± 52%      -1.0        0.68 ± 44%  perf-profile.children.cycles-pp.process_one_work
      1.46 ± 34%      -1.0        0.50 ± 43%  perf-profile.children.cycles-pp.__x64_sys_openat
      1.60 ± 52%      -1.0        0.64 ± 48%  perf-profile.children.cycles-pp.memcpy_toio
      1.60 ± 52%      -1.0        0.64 ± 48%  perf-profile.children.cycles-pp.drm_fb_helper_damage_work
      1.60 ± 52%      -1.0        0.64 ± 48%  perf-profile.children.cycles-pp.drm_fb_helper_damage_blit_real
      1.44 ± 33%      -0.9        0.49 ± 43%  perf-profile.children.cycles-pp.do_sys_openat2
      1.20 ± 43%      -0.9        0.34 ± 55%  perf-profile.children.cycles-pp.open64
      1.22 ± 34%      -0.8        0.43 ± 42%  perf-profile.children.cycles-pp.do_filp_open
      1.21 ± 34%      -0.8        0.43 ± 42%  perf-profile.children.cycles-pp.path_openat
      1.30 ± 38%      -0.8        0.52 ± 21%  perf-profile.children.cycles-pp.do_user_addr_fault
      3.11 ±  7%      -0.7        2.36 ±  9%  perf-profile.children.cycles-pp.__irq_exit_rcu
      1.22 ± 39%      -0.7        0.47 ± 23%  perf-profile.children.cycles-pp.handle_mm_fault
      1.14 ± 38%      -0.7        0.45 ± 22%  perf-profile.children.cycles-pp.__handle_mm_fault
      3.87 ±  7%      -0.7        3.18 ± 14%  perf-profile.children.cycles-pp.tick_sched_handle
      1.34 ± 34%      -0.6        0.72 ± 11%  perf-profile.children.cycles-pp.exc_page_fault
      0.74 ± 29%      -0.5        0.25 ± 24%  perf-profile.children.cycles-pp.seq_printf
      0.73 ± 26%      -0.5        0.27 ± 30%  perf-profile.children.cycles-pp.vsnprintf
      0.64 ± 30%      -0.4        0.24 ± 22%  perf-profile.children.cycles-pp.exit_mmap
      0.64 ± 30%      -0.4        0.24 ± 23%  perf-profile.children.cycles-pp.mmput
      0.49 ± 43%      -0.4        0.14 ± 26%  perf-profile.children.cycles-pp.exit_mm
      0.50 ± 41%      -0.3        0.16 ± 57%  perf-profile.children.cycles-pp.seq_put_decimal_ull_width
      0.48 ± 48%      -0.3        0.16 ± 67%  perf-profile.children.cycles-pp.__close
      0.52 ± 43%      -0.3        0.21 ± 15%  perf-profile.children.cycles-pp.do_fault
      0.66 ± 20%      -0.3        0.37 ± 19%  perf-profile.children.cycles-pp.rcu_sched_clock_irq
      0.41 ± 38%      -0.3        0.12 ± 34%  perf-profile.children.cycles-pp.unmap_vmas
      0.43 ± 57%      -0.3        0.15 ± 79%  perf-profile.children.cycles-pp.exit_to_user_mode_loop
      0.40 ± 36%      -0.3        0.13 ± 55%  perf-profile.children.cycles-pp.kmem_cache_alloc
      0.38 ± 38%      -0.3        0.12 ± 36%  perf-profile.children.cycles-pp.unmap_page_range
      0.36 ± 32%      -0.3        0.11 ± 53%  perf-profile.children.cycles-pp.__alloc_file
      0.37 ± 38%      -0.2        0.12 ± 36%  perf-profile.children.cycles-pp.zap_pmd_range
      0.41 ± 32%      -0.2        0.17 ± 36%  perf-profile.children.cycles-pp.link_path_walk
      0.38 ± 37%      -0.2        0.14 ± 31%  perf-profile.children.cycles-pp.__xstat64
      0.35 ± 37%      -0.2        0.12 ± 35%  perf-profile.children.cycles-pp.zap_pte_range
      1.12 ± 11%      -0.2        0.89 ± 13%  perf-profile.children.cycles-pp.rebalance_domains
      0.33 ± 35%      -0.2        0.10 ± 58%  perf-profile.children.cycles-pp.task_state
      0.33 ± 37%      -0.2        0.10 ± 52%  perf-profile.children.cycles-pp.alloc_empty_file
      0.37 ± 56%      -0.2        0.15 ± 67%  perf-profile.children.cycles-pp.task_work_run
      0.29 ± 32%      -0.2        0.07 ± 80%  perf-profile.children.cycles-pp.cpuset_task_status_allowed
      0.30 ± 31%      -0.2        0.08 ± 58%  perf-profile.children.cycles-pp.bitmap_string
      0.32 ± 31%      -0.2        0.12 ± 56%  perf-profile.children.cycles-pp.seq_puts
      0.30 ± 46%      -0.2        0.10 ± 54%  perf-profile.children.cycles-pp.lookup_fast
      0.45 ± 17%      -0.2        0.27 ± 19%  perf-profile.children.cycles-pp.do_execveat_common
      0.45 ± 17%      -0.2        0.27 ± 21%  perf-profile.children.cycles-pp.__x64_sys_execve
      0.52 ± 10%      -0.2        0.34 ± 27%  perf-profile.children.cycles-pp.update_blocked_averages
      0.30 ± 38%      -0.2        0.13 ± 39%  perf-profile.children.cycles-pp.walk_component
      0.23 ± 56%      -0.2        0.06 ± 78%  perf-profile.children.cycles-pp.num_to_str
      0.52 ± 17%      -0.2        0.35 ± 30%  perf-profile.children.cycles-pp.run_rebalance_domains
      0.25 ± 34%      -0.2        0.10 ± 26%  perf-profile.children.cycles-pp.vm_mmap_pgoff
      0.32 ± 24%      -0.1        0.18 ± 22%  perf-profile.children.cycles-pp.load_elf_binary
      0.32 ± 24%      -0.1        0.18 ± 24%  perf-profile.children.cycles-pp.exec_binprm
      0.32 ± 24%      -0.1        0.18 ± 24%  perf-profile.children.cycles-pp.search_binary_handler
      0.19 ± 29%      -0.1        0.05 ± 84%  perf-profile.children.cycles-pp.page_remove_rmap
      0.20 ± 31%      -0.1        0.07 ± 53%  perf-profile.children.cycles-pp.ksys_mmap_pgoff
      0.18 ± 47%      -0.1        0.06 ± 82%  perf-profile.children.cycles-pp.clear_page_erms
      0.18 ± 24%      -0.1        0.06 ± 83%  perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook
      0.15 ± 35%      -0.1        0.04 ±120%  perf-profile.children.cycles-pp.__kmalloc_node
      0.45 ± 12%      -0.1        0.34 ± 14%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      0.14 ± 42%      -0.1        0.06 ± 51%  perf-profile.children.cycles-pp.__x64_sys_getdents64
      0.14 ± 42%      -0.1        0.06 ± 51%  perf-profile.children.cycles-pp.getdents64
      0.12 ± 25%      -0.1        0.05 ±101%  perf-profile.children.cycles-pp.mod_objcg_state
      0.13 ± 37%      -0.1        0.06 ± 50%  perf-profile.children.cycles-pp.proc_pid_readdir
      0.13 ± 37%      -0.1        0.06 ± 51%  perf-profile.children.cycles-pp.iterate_dir
      0.12 ± 29%      -0.1        0.06 ± 48%  perf-profile.children.cycles-pp.update_rt_rq_load_avg
      0.00            +0.1        0.07 ± 20%  perf-profile.children.cycles-pp.__fdget_pos
      0.02 ±146%      +0.1        0.10 ± 22%  perf-profile.children.cycles-pp._copy_from_user
      0.02 ±223%      +0.1        0.10 ± 35%  perf-profile.children.cycles-pp.tcp_event_new_data_sent
      0.02 ±223%      +0.1        0.10 ± 31%  perf-profile.children.cycles-pp.bsearch
      0.03 ±103%      +0.1        0.12 ± 23%  perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
      0.00            +0.1        0.09 ± 30%  perf-profile.children.cycles-pp.inet6_csk_route_socket
      0.00            +0.1        0.09 ± 30%  perf-profile.children.cycles-pp.sendmsg_copy_msghdr
      0.02 ±223%      +0.1        0.11 ± 28%  perf-profile.children.cycles-pp.simple_copy_to_iter
      0.00            +0.1        0.10 ± 12%  perf-profile.children.cycles-pp.tcp_current_mss
      0.00            +0.1        0.10 ±  8%  perf-profile.children.cycles-pp.tcp_send_mss
      0.02 ±223%      +0.1        0.12 ± 30%  perf-profile.children.cycles-pp.copy_page_from_iter_atomic
      0.01 ±223%      +0.1        0.12 ± 37%  perf-profile.children.cycles-pp._copy_from_iter
      0.02 ±223%      +0.1        0.13 ± 31%  perf-profile.children.cycles-pp.fixup_exception
      0.01 ±223%      +0.1        0.12 ± 20%  perf-profile.children.cycles-pp.prepare_task_switch
      0.04 ±142%      +0.1        0.15 ± 15%  perf-profile.children.cycles-pp.copyout
      0.07 ± 83%      +0.1        0.19 ± 20%  perf-profile.children.cycles-pp._copy_to_iter
      0.01 ±223%      +0.1        0.13 ± 41%  perf-profile.children.cycles-pp.sock_rfree
      0.02 ±223%      +0.1        0.14 ± 33%  perf-profile.children.cycles-pp.kernelmode_fixup_or_oops
      0.02 ±223%      +0.1        0.14 ± 22%  perf-profile.children.cycles-pp.iovec_from_user
      0.00            +0.1        0.13 ± 34%  perf-profile.children.cycles-pp.enqueue_entity
      0.02 ±223%      +0.1        0.15 ± 39%  perf-profile.children.cycles-pp.loopback_xmit
      0.02 ±223%      +0.1        0.16 ± 41%  perf-profile.children.cycles-pp.napi_consume_skb
      0.01 ±223%      +0.1        0.15 ± 29%  perf-profile.children.cycles-pp.__perf_event_header__init_id
      0.01 ±223%      +0.1        0.15 ± 26%  perf-profile.children.cycles-pp.__kfree_skb
      0.02 ±223%      +0.1        0.16 ± 42%  perf-profile.children.cycles-pp.xmit_one
      0.03 ±223%      +0.1        0.18 ± 42%  perf-profile.children.cycles-pp.__alloc_skb
      0.02 ±223%      +0.1        0.16 ± 43%  perf-profile.children.cycles-pp.dev_hard_start_xmit
      0.06 ±113%      +0.2        0.22 ± 28%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.02 ±223%      +0.2        0.18 ± 23%  perf-profile.children.cycles-pp.__import_iovec
      0.03 ±163%      +0.2        0.19 ± 23%  perf-profile.children.cycles-pp.copyin
      0.03 ±223%      +0.2        0.19 ± 39%  perf-profile.children.cycles-pp.tcp_stream_alloc_skb
      0.03 ±223%      +0.2        0.19 ± 23%  perf-profile.children.cycles-pp.import_iovec
      0.03 ±223%      +0.2        0.19 ± 42%  perf-profile.children.cycles-pp.ttwu_queue_wakelist
      0.04 ±170%      +0.2        0.20 ± 30%  perf-profile.children.cycles-pp.copy_user_short_string
      0.02 ±223%      +0.2        0.20 ± 42%  perf-profile.children.cycles-pp.kernel_text_address
      0.12 ± 74%      +0.2        0.29 ± 38%  perf-profile.children.cycles-pp.__entry_text_start
      0.02 ±223%      +0.2        0.20 ± 21%  perf-profile.children.cycles-pp._raw_read_lock_irqsave
      0.00            +0.2        0.19 ± 30%  perf-profile.children.cycles-pp.enqueue_task_fair
      0.00            +0.2        0.20 ± 31%  perf-profile.children.cycles-pp.ttwu_do_activate
      0.04 ±178%      +0.2        0.25 ± 26%  perf-profile.children.cycles-pp.generic_file_write_iter
      0.04 ±178%      +0.2        0.25 ± 26%  perf-profile.children.cycles-pp.__generic_file_write_iter
      0.04 ±178%      +0.2        0.25 ± 26%  perf-profile.children.cycles-pp.generic_perform_write
      0.04 ±223%      +0.2        0.25 ± 26%  perf-profile.children.cycles-pp.__libc_write
      0.04 ±163%      +0.2        0.26 ± 43%  perf-profile.children.cycles-pp.__kernel_text_address
      0.08 ±123%      +0.2        0.30 ± 42%  perf-profile.children.cycles-pp.autoremove_wake_function
      0.09 ± 84%      +0.2        0.32 ± 37%  perf-profile.children.cycles-pp.stack_access_ok
      0.02 ±223%      +0.2        0.26 ± 38%  perf-profile.children.cycles-pp.__inet6_lookup_established
      0.29 ± 25%      +0.2        0.53 ± 24%  perf-profile.children.cycles-pp.memcpy_erms
      0.04 ±171%      +0.2        0.29 ± 42%  perf-profile.children.cycles-pp.unwind_get_return_address
      0.02 ±223%      +0.2        0.27 ± 31%  perf-profile.children.cycles-pp.skb_release_data
      0.03 ±223%      +0.3        0.28 ± 51%  perf-profile.children.cycles-pp.__fget_light
      0.08 ± 90%      +0.3        0.34 ± 39%  perf-profile.children.cycles-pp.orc_find
      0.04 ±223%      +0.3        0.30 ± 36%  perf-profile.children.cycles-pp.__put_user_nocheck_8
      0.04 ±223%      +0.3        0.31 ± 41%  perf-profile.children.cycles-pp.__dev_queue_xmit
      0.04 ±223%      +0.3        0.34 ± 38%  perf-profile.children.cycles-pp.__put_user_nocheck_4
      0.04 ±223%      +0.3        0.38 ± 24%  perf-profile.children.cycles-pp.tcp_clean_rtx_queue
      0.05 ±223%      +0.4        0.42 ± 25%  perf-profile.children.cycles-pp.__skb_datagram_iter
      0.21 ± 58%      +0.4        0.59 ± 32%  perf-profile.children.cycles-pp.syscall_return_via_sysret
      0.05 ±223%      +0.4        0.42 ± 25%  perf-profile.children.cycles-pp.skb_copy_datagram_iter
      0.08 ±137%      +0.4        0.48 ± 29%  perf-profile.children.cycles-pp.perf_output_copy
      0.06 ±223%      +0.4        0.46 ± 34%  perf-profile.children.cycles-pp.ep_done_scan
      0.10 ±131%      +0.5        0.56 ± 40%  perf-profile.children.cycles-pp.mutex_lock
      0.05 ±223%      +0.5        0.53 ± 41%  perf-profile.children.cycles-pp._raw_write_lock_irq
      0.08 ±223%      +0.5        0.63 ± 26%  perf-profile.children.cycles-pp.tcp_ack
      0.12 ±154%      +0.6        0.72 ± 25%  perf-profile.children.cycles-pp.perf_output_sample
      0.06 ±223%      +0.6        0.68 ± 42%  perf-profile.children.cycles-pp.tcp_poll
      0.14 ±111%      +0.6        0.77 ± 36%  perf-profile.children.cycles-pp.__orc_find
      0.17 ±119%      +0.7        0.83 ± 28%  perf-profile.children.cycles-pp.__wake_up_common
      0.09 ±223%      +0.7        0.80 ± 28%  perf-profile.children.cycles-pp.ep_poll_callback
      0.18 ±125%      +0.7        0.89 ± 30%  perf-profile.children.cycles-pp.__wake_up_common_lock
      0.11 ±223%      +0.8        0.88 ± 31%  perf-profile.children.cycles-pp.sock_def_readable
      0.09 ±223%      +0.8        0.88 ± 39%  perf-profile.children.cycles-pp.select_estimate_accuracy
      0.10 ±223%      +0.8        0.89 ± 42%  perf-profile.children.cycles-pp.ktime_get_ts64
      0.08 ±223%      +0.8        0.91 ± 40%  perf-profile.children.cycles-pp.sock_poll
      0.18 ±148%      +0.9        1.03 ± 23%  perf-profile.children.cycles-pp.__get_user_nocheck_8
      0.10 ±223%      +0.9        0.97 ± 30%  perf-profile.children.cycles-pp.tcp_recvmsg_locked
      0.09 ±223%      +0.9        0.98 ± 41%  perf-profile.children.cycles-pp.ep_item_poll
      0.19 ±151%      +0.9        1.10 ± 25%  perf-profile.children.cycles-pp.perf_callchain_user
      0.24 ±137%      +0.9        1.19 ± 36%  perf-profile.children.cycles-pp.ttwu_do_wakeup
      0.22 ±139%      +1.0        1.18 ± 36%  perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
      0.25 ±106%      +1.0        1.30 ± 38%  perf-profile.children.cycles-pp.__unwind_start
      0.14 ±223%      +1.1        1.28 ± 28%  perf-profile.children.cycles-pp.tcp_recvmsg
      0.14 ±223%      +1.1        1.28 ± 29%  perf-profile.children.cycles-pp.inet6_recvmsg
      0.39 ± 81%      +1.2        1.56 ± 24%  perf-profile.children.cycles-pp.new_sync_read
      0.16 ±223%      +1.2        1.34 ± 34%  perf-profile.children.cycles-pp.sched_ttwu_pending
      0.15 ±223%      +1.2        1.40 ± 28%  perf-profile.children.cycles-pp.sock_read_iter
      0.16 ±223%      +1.3        1.43 ± 36%  perf-profile.children.cycles-pp.__sysvec_call_function_single
      0.18 ±211%      +1.3        1.52 ± 35%  perf-profile.children.cycles-pp.sysvec_call_function_single
      0.49 ± 80%      +1.4        1.85 ± 28%  perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
      0.51 ± 81%      +1.4        1.92 ± 28%  perf-profile.children.cycles-pp.update_curr
      0.36 ±126%      +1.5        1.88 ± 29%  perf-profile.children.cycles-pp.dequeue_entity
      0.21 ±213%      +1.5        1.74 ± 35%  perf-profile.children.cycles-pp.asm_sysvec_call_function_single
      0.36 ±128%      +1.5        1.91 ± 29%  perf-profile.children.cycles-pp.dequeue_task_fair
      0.21 ±223%      +1.7        1.89 ± 36%  perf-profile.children.cycles-pp.finish_task_switch
      0.24 ±223%      +1.7        1.92 ± 30%  perf-profile.children.cycles-pp.tcp_rcv_established
      0.24 ±223%      +1.7        1.97 ± 30%  perf-profile.children.cycles-pp.tcp_v6_do_rcv
      0.54 ± 99%      +1.9        2.40 ± 35%  perf-profile.children.cycles-pp.unwind_next_frame
      3.10 ± 26%      +2.1        5.20 ± 18%  perf-profile.children.cycles-pp.__softirqentry_text_start
      0.30 ±223%      +2.1        2.43 ± 31%  perf-profile.children.cycles-pp.tcp_v6_rcv
      0.30 ±223%      +2.1        2.45 ± 31%  perf-profile.children.cycles-pp.ip6_protocol_deliver_rcu
      0.30 ±223%      +2.2        2.50 ± 31%  perf-profile.children.cycles-pp.ip6_input_finish
      0.38 ±163%      +2.2        2.59 ± 32%  perf-profile.children.cycles-pp.perf_trace_sched_switch
      0.33 ±223%      +2.3        2.59 ± 31%  perf-profile.children.cycles-pp.__netif_receive_skb_one_core
      0.34 ±223%      +2.3        2.68 ± 32%  perf-profile.children.cycles-pp.process_backlog
      0.35 ±223%      +2.3        2.69 ± 31%  perf-profile.children.cycles-pp.__napi_poll
      0.64 ± 99%      +2.4        3.03 ± 35%  perf-profile.children.cycles-pp.perf_callchain_kernel
      0.34 ±223%      +2.5        2.80 ± 36%  perf-profile.children.cycles-pp.____sys_sendmsg
      0.36 ±223%      +2.5        2.86 ± 28%  perf-profile.children.cycles-pp.sock_write_iter
      0.36 ±223%      +2.5        2.89 ± 27%  perf-profile.children.cycles-pp.do_iter_readv_writev
      0.37 ±223%      +2.6        2.93 ± 27%  perf-profile.children.cycles-pp.do_iter_write
      0.35 ±223%      +2.6        2.92 ± 36%  perf-profile.children.cycles-pp.___sys_sendmsg
      0.35 ±223%      +2.6        2.98 ± 36%  perf-profile.children.cycles-pp.__sys_sendmsg
      0.40 ±223%      +2.7        3.11 ± 27%  perf-profile.children.cycles-pp.vfs_writev
      0.41 ±223%      +2.7        3.14 ± 27%  perf-profile.children.cycles-pp.do_writev
      0.45 ±168%      +2.8        3.25 ± 35%  perf-profile.children.cycles-pp.schedule_idle
      0.40 ±223%      +2.8        3.21 ± 30%  perf-profile.children.cycles-pp.net_rx_action
      0.41 ±223%      +2.9        3.32 ± 30%  perf-profile.children.cycles-pp.do_softirq
      0.42 ±223%      +3.0        3.36 ± 30%  perf-profile.children.cycles-pp.__local_bh_enable_ip
      0.39 ±223%      +3.1        3.51 ± 39%  perf-profile.children.cycles-pp.ep_send_events
      0.46 ±223%      +3.2        3.71 ± 30%  perf-profile.children.cycles-pp.ip6_finish_output2
      0.64 ±152%      +3.3        3.96 ± 29%  perf-profile.children.cycles-pp.schedule
      0.47 ±223%      +3.3        3.79 ± 30%  perf-profile.children.cycles-pp.ip6_finish_output
      0.86 ±111%      +3.4        4.23 ± 32%  perf-profile.children.cycles-pp.get_perf_callchain
      0.86 ±110%      +3.4        4.26 ± 32%  perf-profile.children.cycles-pp.perf_callchain
      0.48 ±223%      +3.4        3.90 ± 30%  perf-profile.children.cycles-pp.ip6_xmit
      0.46 ±223%      +3.4        3.88 ± 31%  perf-profile.children.cycles-pp.schedule_hrtimeout_range_clock
      0.49 ±223%      +3.6        4.05 ± 30%  perf-profile.children.cycles-pp.inet6_csk_xmit
      0.90 ±113%      +3.6        4.50 ± 31%  perf-profile.children.cycles-pp.perf_prepare_sample
      0.52 ±223%      +3.9        4.39 ± 31%  perf-profile.children.cycles-pp.__tcp_transmit_skb
      0.57 ±223%      +4.1        4.66 ± 31%  perf-profile.children.cycles-pp.tcp_write_xmit
      0.57 ±223%      +4.1        4.67 ± 31%  perf-profile.children.cycles-pp.__tcp_push_pending_frames
      1.06 ±115%      +4.3        5.36 ± 31%  perf-profile.children.cycles-pp.perf_event_output_forward
      1.08 ±114%      +4.3        5.37 ± 31%  perf-profile.children.cycles-pp.__perf_event_overflow
      1.09 ±116%      +4.4        5.50 ± 30%  perf-profile.children.cycles-pp.perf_tp_event
      0.66 ±223%      +4.7        5.41 ± 31%  perf-profile.children.cycles-pp.tcp_sendmsg_locked
      0.68 ±223%      +4.9        5.54 ± 31%  perf-profile.children.cycles-pp.tcp_sendmsg
      0.69 ±223%      +4.9        5.61 ± 31%  perf-profile.children.cycles-pp.sock_sendmsg
      1.11 ±154%      +6.1        7.18 ± 32%  perf-profile.children.cycles-pp.__schedule
      0.97 ±223%      +7.5        8.49 ± 35%  perf-profile.children.cycles-pp.ep_poll
      1.02 ±223%      +7.8        8.84 ± 35%  perf-profile.children.cycles-pp.do_epoll_wait
      1.10 ±223%      +8.4        9.54 ± 36%  perf-profile.children.cycles-pp.__x64_sys_epoll_wait
     10.60 ± 31%     +10.9       21.54 ± 24%  perf-profile.children.cycles-pp.do_syscall_64
     10.66 ± 32%     +11.1       21.80 ± 24%  perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
      1.57 ± 52%      -0.9        0.63 ± 48%  perf-profile.self.cycles-pp.memcpy_toio
      0.35 ± 26%      -0.2        0.19 ± 23%  perf-profile.self.cycles-pp.rcu_sched_clock_irq
      0.18 ± 51%      -0.1        0.04 ±105%  perf-profile.self.cycles-pp.num_to_str
      0.18 ± 47%      -0.1        0.06 ± 82%  perf-profile.self.cycles-pp.clear_page_erms
      0.45 ± 12%      -0.1        0.34 ± 14%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.12 ± 29%      -0.1        0.06 ± 48%  perf-profile.self.cycles-pp.update_rt_rq_load_avg
      0.00            +0.1        0.07 ± 14%  perf-profile.self.cycles-pp.tcp_current_mss
      0.01 ±223%      +0.1        0.09 ± 33%  perf-profile.self.cycles-pp.perf_tp_event
      0.03 ±103%      +0.1        0.12 ± 23%  perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
      0.02 ±223%      +0.1        0.12 ± 21%  perf-profile.self.cycles-pp.tcp_clean_rtx_queue
      0.01 ±223%      +0.1        0.11 ± 37%  perf-profile.self.cycles-pp.do_syscall_64
      0.01 ±223%      +0.1        0.12 ± 34%  perf-profile.self.cycles-pp.__unwind_start
      0.01 ±223%      +0.1        0.12 ± 45%  perf-profile.self.cycles-pp.sock_rfree
      0.04 ±168%      +0.1        0.16 ± 30%  perf-profile.self.cycles-pp.perf_output_copy
      0.01 ±223%      +0.1        0.14 ± 31%  perf-profile.self.cycles-pp._raw_spin_lock_bh
      0.01 ±223%      +0.1        0.14 ± 34%  perf-profile.self.cycles-pp.__skb_datagram_iter
      0.02 ±223%      +0.1        0.16 ± 20%  perf-profile.self.cycles-pp.net_rx_action
      0.01 ±223%      +0.1        0.15 ± 54%  perf-profile.self.cycles-pp.__tcp_transmit_skb
      0.06 ±113%      +0.2        0.21 ± 27%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.01 ±223%      +0.2        0.17 ± 42%  perf-profile.self.cycles-pp.__schedule
      0.04 ±170%      +0.2        0.20 ± 29%  perf-profile.self.cycles-pp.copy_user_short_string
      0.02 ±223%      +0.2        0.18 ± 44%  perf-profile.self.cycles-pp.ep_poll_callback
      0.02 ±223%      +0.2        0.19 ± 49%  perf-profile.self.cycles-pp.__x64_sys_epoll_wait
      0.03 ±223%      +0.2        0.21 ± 43%  perf-profile.self.cycles-pp.ep_poll
      0.01 ±223%      +0.2        0.20 ± 20%  perf-profile.self.cycles-pp._raw_read_lock_irqsave
      0.02 ±223%      +0.2        0.21 ± 58%  perf-profile.self.cycles-pp.__fget_light
      0.02 ±223%      +0.2        0.21 ± 22%  perf-profile.self.cycles-pp.tcp_sendmsg_locked
      0.02 ±223%      +0.2        0.21 ± 28%  perf-profile.self.cycles-pp.tcp_rcv_established
      0.02 ±223%      +0.2        0.21 ± 22%  perf-profile.self.cycles-pp.tcp_recvmsg_locked
      0.02 ±223%      +0.2        0.21 ± 37%  perf-profile.self.cycles-pp.perf_callchain_kernel
      0.03 ±223%      +0.2        0.23 ± 42%  perf-profile.self.cycles-pp.finish_task_switch
      0.02 ±223%      +0.2        0.23 ± 46%  perf-profile.self.cycles-pp.sock_poll
      0.09 ± 79%      +0.2        0.29 ± 36%  perf-profile.self.cycles-pp.stack_access_ok
      0.04 ±175%      +0.2        0.25 ± 33%  perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
      0.02 ±223%      +0.2        0.23 ± 36%  perf-profile.self.cycles-pp.__inet6_lookup_established
      0.05 ±126%      +0.2        0.28 ± 42%  perf-profile.self.cycles-pp.__entry_text_start
      0.02 ±223%      +0.2        0.25 ± 28%  perf-profile.self.cycles-pp.skb_release_data
      0.28 ± 25%      +0.2        0.51 ± 26%  perf-profile.self.cycles-pp.memcpy_erms
      0.08 ± 87%      +0.3        0.34 ± 40%  perf-profile.self.cycles-pp.orc_find
      0.04 ±223%      +0.3        0.30 ± 36%  perf-profile.self.cycles-pp.__put_user_nocheck_8
      0.04 ±223%      +0.3        0.32 ± 39%  perf-profile.self.cycles-pp.__put_user_nocheck_4
      0.03 ±223%      +0.3        0.34 ± 32%  perf-profile.self.cycles-pp.ktime_get_ts64
      0.08 ±113%      +0.3        0.39 ± 40%  perf-profile.self.cycles-pp.mutex_lock
      0.04 ±223%      +0.4        0.41 ± 45%  perf-profile.self.cycles-pp.ep_send_events
      0.21 ± 57%      +0.4        0.58 ± 33%  perf-profile.self.cycles-pp.syscall_return_via_sysret
      0.03 ±223%      +0.4        0.45 ± 36%  perf-profile.self.cycles-pp.select_estimate_accuracy
      0.05 ±223%      +0.5        0.51 ± 42%  perf-profile.self.cycles-pp._raw_write_lock_irq
      0.08 ±198%      +0.5        0.57 ± 21%  perf-profile.self.cycles-pp.__get_user_nocheck_8
      0.05 ±223%      +0.5        0.57 ± 42%  perf-profile.self.cycles-pp.tcp_poll
      0.14 ±110%      +0.6        0.76 ± 37%  perf-profile.self.cycles-pp.__orc_find
      0.17 ±162%      +0.8        0.92 ± 34%  perf-profile.self.cycles-pp.unwind_next_frame




Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


-- 
0-DAY CI Kernel Test Service
https://01.org/lkp



View attachment "config-5.18.0-rc6-01520-g909876500251" of type "text/plain" (162800 bytes)

View attachment "job-script" of type "text/plain" (7644 bytes)

View attachment "job.yaml" of type "text/plain" (4935 bytes)

View attachment "reproduce" of type "text/plain" (298 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ