lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite for Android: free password hash cracker in your pocket
[<prev] [next>] [day] [month] [year] [list]
Date:   Fri, 7 Feb 2020 21:52:50 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Giovanni Gherdovich <ggherdovich@...e.cz>
Cc:     0day robot <lkp@...el.com>, Peter Zijlstra <peterz@...radead.org>,
        Doug Smythies <dsmythies@...us.net>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org
Subject: [x86,sched] 8e663d38f1: reaim.jobs_per_min -2.1% regression

Greeting,

FYI, we noticed a -2.1% regression of reaim.jobs_per_min due to commit:


commit: 8e663d38f1ce6ed9151c949f952765dd24fbdb22 ("x86,sched: Add support for frequency invariance")
https://github.com/0day-ci/linux/commits/Giovanni-Gherdovich/Add-support-for-frequency-invariance-for-some-x86/20200124-181636

in testcase: reaim
on test machine: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
with following parameters:

	runtime: 300s
	nr_task: 100%
	test: compute
	cpufreq_governor: performance
	ucode: 0xb000038

test-description: REAIM is an updated and improved version of AIM 7 benchmark.
test-url: https://sourceforge.net/projects/re-aim-7/



If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
  gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-20191114.cgz/300s/lkp-bdw-ep6/compute/reaim/0xb000038

commit: 
  248ed51048 ("x86/nmi: Remove irq_work from the long duration NMI handler")
  8e663d38f1 ("x86,sched: Add support for frequency invariance")

248ed51048c40d36 8e663d38f1ce6ed9151c949f952 
---------------- --------------------------- 
       fail:runs  %reproduction    fail:runs
           |             |             |    
          2:4            1%           2:4     perf-profile.children.cycles-pp.error_entry
          1:4            2%           1:4     perf-profile.self.cycles-pp.error_entry
         %stddev     %change         %stddev
             \          |                \  
    546252            -2.1%     534691        reaim.jobs_per_min
      6207            -2.1%       6076        reaim.jobs_per_min_child
    562840            -1.8%     552636        reaim.max_jobs_per_min
      0.98            +2.2%       1.00        reaim.parent_time
      1.88           +23.9%       2.33        reaim.std_dev_percent
      0.02            +8.3%       0.02        reaim.std_dev_time
    125280            +6.7%     133627        reaim.time.involuntary_context_switches
      2676            -1.1%       2647        reaim.time.percent_of_cpu_this_job_got
    506010           -11.4%     448390        reaim.time.voluntary_context_switches
     35831 ±  2%     +47.1%      52701 ±  3%  turbostat.C1
      4503           +14.5%       5155        vmstat.system.cs
    947553 ±  3%     +33.5%    1265411 ±  3%  cpuidle.C1.time
     36765 ±  2%     +46.5%      53879 ±  3%  cpuidle.C1.usage
    103178 ±  3%     +18.8%     122529 ±  3%  cpuidle.POLL.time
     33743 ±  5%     +14.5%      38636 ±  4%  cpuidle.POLL.usage
     74648            +4.5%      78014        proc-vmstat.nr_active_anon
     70661            +4.6%      73934        proc-vmstat.nr_anon_pages
     14719            +0.9%      14859        proc-vmstat.nr_kernel_stack
     44619            -1.5%      43969        proc-vmstat.nr_slab_unreclaimable
     74648            +4.5%      78014        proc-vmstat.nr_zone_active_anon
     43255            -2.3%      42247        proc-vmstat.pgactivate
     10538 ±  5%     -11.2%       9362 ±  2%  softirqs.CPU15.NET_RX
     86956 ±  4%      +6.6%      92671 ±  4%  softirqs.CPU3.RCU
      9969 ±  3%      -8.0%       9175 ±  4%  softirqs.CPU44.NET_RX
     10274 ±  4%      -8.5%       9403 ±  7%  softirqs.CPU48.NET_RX
      9432 ±  3%      +7.6%      10147 ±  3%  softirqs.CPU73.NET_RX
     29906 ±  3%      +4.9%      31360 ±  4%  softirqs.CPU79.SCHED
      9365 ±  8%     +13.1%      10591 ±  4%  softirqs.CPU8.NET_RX
     30010 ±  3%      +5.0%      31520 ±  4%  softirqs.CPU84.SCHED
   2634992            +3.1%    2716654        perf-stat.i.cache-misses
      4510           +14.8%       5176        perf-stat.i.context-switches
    483.73           +43.6%     694.51        perf-stat.i.cpu-migrations
     30358 ±  3%     -15.3%      25712 ±  2%  perf-stat.i.cycles-between-cache-misses
     82.01            +2.8       84.80        perf-stat.i.node-load-miss-rate%
    858999            +5.2%     903580        perf-stat.i.node-load-misses
    174029            -6.9%     162061        perf-stat.i.node-loads
      1.10 ±  2%      +0.0        1.14        perf-stat.overall.branch-miss-rate%
      0.28            +0.0        0.29        perf-stat.overall.cache-miss-rate%
     30703            -3.5%      29631        perf-stat.overall.cycles-between-cache-misses
     83.14            +1.6       84.79        perf-stat.overall.node-load-miss-rate%
 8.424e+09            -1.0%  8.344e+09        perf-stat.ps.branch-instructions
   2620634            +3.0%    2699663        perf-stat.ps.cache-misses
      4487           +14.7%       5146        perf-stat.ps.context-switches
    480.47           +43.5%     689.70        perf-stat.ps.cpu-migrations
 6.271e+10            -1.0%  6.212e+10        perf-stat.ps.instructions
    406885            -1.0%     402757        perf-stat.ps.minor-faults
    854104            +5.1%     897717        perf-stat.ps.node-load-misses
    173148            -7.0%     161075        perf-stat.ps.node-loads
    406885            -1.0%     402757        perf-stat.ps.page-faults
    170908 ±133%    +301.7%     686613 ± 32%  sched_debug.cfs_rq:/.load.max
     26898 ±137%    +246.3%      93142 ± 30%  sched_debug.cfs_rq:/.load.stddev
      5.69 ± 31%     -69.3%       1.75 ± 41%  sched_debug.cfs_rq:/.load_avg.min
      0.73 ± 26%     -53.0%       0.34 ± 22%  sched_debug.cfs_rq:/.nr_running.avg
    113.63 ±131%    +285.0%     437.54 ± 45%  sched_debug.cfs_rq:/.runnable_load_avg.max
    159449 ±143%    +328.6%     683368 ± 32%  sched_debug.cfs_rq:/.runnable_weight.max
     25239 ±148%    +267.5%      92754 ± 31%  sched_debug.cfs_rq:/.runnable_weight.stddev
    736.96 ± 26%     -54.9%     332.09 ± 20%  sched_debug.cfs_rq:/.util_avg.avg
      1225 ± 14%     -23.0%     943.50 ±  9%  sched_debug.cfs_rq:/.util_avg.max
    502.59 ± 36%     -72.8%     136.75 ± 49%  sched_debug.cfs_rq:/.util_avg.min
    577.11 ± 30%     -63.6%     210.12 ± 27%  sched_debug.cfs_rq:/.util_est_enqueued.avg
      5.03 ± 30%     -37.1%       3.17 ±  5%  sched_debug.cpu.clock.stddev
      5.03 ± 30%     -37.1%       3.17 ±  5%  sched_debug.cpu.clock_task.stddev
     32433 ± 34%     -66.8%      10782 ±  7%  sched_debug.cpu.curr->pid.avg
     40168 ±  6%      -8.4%      36800        sched_debug.cpu.curr->pid.max
      4951 ±115%     -96.9%     154.50 ±100%  sched_debug.cpu.curr->pid.min
      0.00 ± 14%     -32.7%       0.00 ± 14%  sched_debug.cpu.next_balance.stddev
      8579 ±  8%     +22.0%      10471        sched_debug.cpu.nr_switches.avg
      6285 ±  8%     +21.3%       7627 ±  5%  sched_debug.cpu.nr_switches.min
      7011 ± 10%     +31.3%       9209        sched_debug.cpu.sched_count.avg
      5325 ± 12%     +33.1%       7090 ±  3%  sched_debug.cpu.sched_count.min
      1792 ± 10%     +67.9%       3010        sched_debug.cpu.sched_goidle.avg
      1153 ± 11%     +88.6%       2175 ±  2%  sched_debug.cpu.sched_goidle.min
    869.40 ±  2%     +18.1%       1026 ±  9%  sched_debug.cpu.sched_goidle.stddev
      3785 ±  7%     -25.3%       2826 ±  4%  sched_debug.cpu.ttwu_local.max
    349.73 ± 11%     -34.0%     230.74 ± 12%  sched_debug.cpu.ttwu_local.stddev
    311.00 ± 13%    +243.7%       1069 ± 55%  interrupts.CPU1.RES:Rescheduling_interrupts
    292.50 ±  9%     +75.4%     513.00 ± 20%  interrupts.CPU10.RES:Rescheduling_interrupts
    292.00 ±  9%     +56.6%     457.25 ±  4%  interrupts.CPU12.RES:Rescheduling_interrupts
    328.00 ± 14%     +45.6%     477.50 ±  4%  interrupts.CPU13.RES:Rescheduling_interrupts
    328.50 ± 11%     +39.4%     458.00 ±  4%  interrupts.CPU14.RES:Rescheduling_interrupts
    302.75 ±  7%     +58.1%     478.75 ±  7%  interrupts.CPU15.RES:Rescheduling_interrupts
    283.75 ± 18%     +59.6%     453.00 ± 13%  interrupts.CPU16.RES:Rescheduling_interrupts
    307.50 ± 13%     +38.0%     424.25 ±  8%  interrupts.CPU17.RES:Rescheduling_interrupts
    300.00 ±  5%     +55.9%     467.75 ±  8%  interrupts.CPU18.RES:Rescheduling_interrupts
    321.25 ± 21%     +36.7%     439.25 ±  7%  interrupts.CPU19.RES:Rescheduling_interrupts
    309.75 ± 19%     +50.1%     465.00 ± 10%  interrupts.CPU20.RES:Rescheduling_interrupts
    277.75 ± 10%     +78.8%     496.50 ±  9%  interrupts.CPU21.RES:Rescheduling_interrupts
    339.50 ± 18%     +32.5%     449.75 ±  5%  interrupts.CPU22.RES:Rescheduling_interrupts
    313.75 ±  6%     +37.7%     432.00 ±  3%  interrupts.CPU23.RES:Rescheduling_interrupts
    338.50 ± 12%     +29.8%     439.25 ±  6%  interrupts.CPU24.RES:Rescheduling_interrupts
    309.50 ± 19%     +45.5%     450.25 ±  9%  interrupts.CPU25.RES:Rescheduling_interrupts
      2165 ± 31%     +41.8%       3070 ±  2%  interrupts.CPU26.NMI:Non-maskable_interrupts
      2165 ± 31%     +41.8%       3070 ±  2%  interrupts.CPU26.PMI:Performance_monitoring_interrupts
    308.25 ±  4%     +52.1%     469.00 ±  6%  interrupts.CPU26.RES:Rescheduling_interrupts
    301.50 ±  6%     +54.7%     466.50 ±  8%  interrupts.CPU27.RES:Rescheduling_interrupts
    311.75 ±  4%     +46.0%     455.25 ±  3%  interrupts.CPU28.RES:Rescheduling_interrupts
    284.25 ± 10%     +65.4%     470.25 ±  7%  interrupts.CPU29.RES:Rescheduling_interrupts
    330.75 ± 14%     +30.4%     431.25 ±  7%  interrupts.CPU30.RES:Rescheduling_interrupts
    295.50 ±  7%     +61.7%     477.75 ± 17%  interrupts.CPU31.RES:Rescheduling_interrupts
    312.25 ±  9%     +41.8%     442.75 ± 12%  interrupts.CPU32.RES:Rescheduling_interrupts
    336.50 ± 21%     +41.7%     476.75 ± 15%  interrupts.CPU33.RES:Rescheduling_interrupts
    291.00 ±  6%     +51.7%     441.50 ±  5%  interrupts.CPU34.RES:Rescheduling_interrupts
    326.75 ±  5%     +37.5%     449.25 ±  6%  interrupts.CPU35.RES:Rescheduling_interrupts
    318.00 ±  4%     +36.6%     434.50 ±  6%  interrupts.CPU36.RES:Rescheduling_interrupts
    333.25 ± 16%     +41.0%     470.00 ±  5%  interrupts.CPU39.RES:Rescheduling_interrupts
    308.00 ± 16%     +41.2%     434.75 ±  8%  interrupts.CPU40.RES:Rescheduling_interrupts
    319.25 ± 13%     +42.8%     456.00 ± 10%  interrupts.CPU41.RES:Rescheduling_interrupts
    300.00 ±  5%     +60.5%     481.50 ± 12%  interrupts.CPU42.RES:Rescheduling_interrupts
      3648 ± 21%     -58.0%       1532 ± 15%  interrupts.CPU43.RES:Rescheduling_interrupts
    293.25 ± 15%     +48.8%     436.25 ±  7%  interrupts.CPU44.RES:Rescheduling_interrupts
    272.75 ±  7%     +63.1%     444.75 ±  9%  interrupts.CPU45.RES:Rescheduling_interrupts
      2189 ± 30%     +41.2%       3091 ±  3%  interrupts.CPU49.NMI:Non-maskable_interrupts
      2189 ± 30%     +41.2%       3091 ±  3%  interrupts.CPU49.PMI:Performance_monitoring_interrupts
    355.75 ± 11%     +35.8%     483.00 ± 12%  interrupts.CPU51.RES:Rescheduling_interrupts
      3496 ±  3%      -9.1%       3178 ±  7%  interrupts.CPU52.CAL:Function_call_interrupts
      2147 ± 32%     +42.6%       3062 ±  2%  interrupts.CPU52.NMI:Non-maskable_interrupts
      2147 ± 32%     +42.6%       3062 ±  2%  interrupts.CPU52.PMI:Performance_monitoring_interrupts
    322.75 ±  5%     +38.3%     446.25 ±  4%  interrupts.CPU52.RES:Rescheduling_interrupts
    272.00 ±  4%     +57.0%     427.00 ±  8%  interrupts.CPU53.RES:Rescheduling_interrupts
    300.50 ± 12%     +52.0%     456.75        interrupts.CPU55.RES:Rescheduling_interrupts
    290.75 ±  7%     +46.9%     427.25 ±  8%  interrupts.CPU56.RES:Rescheduling_interrupts
    315.75 ± 16%     +33.7%     422.25 ±  4%  interrupts.CPU57.RES:Rescheduling_interrupts
    334.75 ± 16%     +26.9%     424.75 ±  5%  interrupts.CPU59.RES:Rescheduling_interrupts
    357.50 ± 17%     +30.8%     467.50 ±  5%  interrupts.CPU6.RES:Rescheduling_interrupts
    274.00 ± 11%     +60.9%     440.75 ±  5%  interrupts.CPU60.RES:Rescheduling_interrupts
    310.50 ±  6%     +52.7%     474.25 ± 15%  interrupts.CPU62.RES:Rescheduling_interrupts
    311.25 ±  9%     +35.3%     421.25 ±  2%  interrupts.CPU63.RES:Rescheduling_interrupts
    280.50 ±  9%     +52.6%     428.00 ±  8%  interrupts.CPU64.RES:Rescheduling_interrupts
    265.50 ± 10%     +67.7%     445.25 ±  4%  interrupts.CPU65.RES:Rescheduling_interrupts
    303.50 ± 20%     +53.2%     465.00 ±  2%  interrupts.CPU66.RES:Rescheduling_interrupts
    308.25 ± 20%     +48.0%     456.25 ±  2%  interrupts.CPU68.RES:Rescheduling_interrupts
    278.75 ±  4%     +56.1%     435.25 ±  6%  interrupts.CPU69.RES:Rescheduling_interrupts
    328.25 ±  9%     +40.4%     460.75 ± 11%  interrupts.CPU7.RES:Rescheduling_interrupts
    289.25 ±  5%     +44.3%     417.25 ±  2%  interrupts.CPU70.RES:Rescheduling_interrupts
    280.25 ± 11%     +55.8%     436.75 ±  8%  interrupts.CPU71.RES:Rescheduling_interrupts
    297.25 ±  4%     +53.8%     457.25 ±  7%  interrupts.CPU72.RES:Rescheduling_interrupts
    276.25 ±  4%     +68.3%     465.00 ±  9%  interrupts.CPU73.RES:Rescheduling_interrupts
    293.50 ±  7%     +46.2%     429.00 ±  5%  interrupts.CPU74.RES:Rescheduling_interrupts
    282.75 ±  7%     +53.8%     435.00 ±  8%  interrupts.CPU75.RES:Rescheduling_interrupts
    288.00 ±  9%     +51.6%     436.50 ±  5%  interrupts.CPU76.RES:Rescheduling_interrupts
    276.25 ±  6%     +49.6%     413.25 ± 12%  interrupts.CPU77.RES:Rescheduling_interrupts
    277.50 ±  3%     +65.8%     460.00 ± 12%  interrupts.CPU78.RES:Rescheduling_interrupts
    304.75 ±  6%     +45.8%     444.25 ± 12%  interrupts.CPU79.RES:Rescheduling_interrupts
    288.50 ±  8%     +46.8%     423.50 ±  2%  interrupts.CPU8.RES:Rescheduling_interrupts
    324.25 ± 13%     +42.9%     463.50 ± 19%  interrupts.CPU80.RES:Rescheduling_interrupts
    298.75 ±  5%     +44.8%     432.50 ±  7%  interrupts.CPU81.RES:Rescheduling_interrupts
    274.75 ± 10%     +60.9%     442.00 ±  6%  interrupts.CPU83.RES:Rescheduling_interrupts
    288.75 ± 11%     +59.0%     459.25 ± 20%  interrupts.CPU85.RES:Rescheduling_interrupts
    278.75 ± 15%     +59.6%     445.00 ±  3%  interrupts.CPU86.RES:Rescheduling_interrupts
    254.50 ±  8%     +78.6%     454.50 ± 11%  interrupts.CPU87.RES:Rescheduling_interrupts
    327.00 ± 14%     +35.8%     444.00 ±  4%  interrupts.CPU9.RES:Rescheduling_interrupts
     34175 ±  2%     +24.0%      42384        interrupts.RES:Rescheduling_interrupts
    696.00 ± 23%     +60.6%       1118 ± 21%  interrupts.TLB:TLB_shootdowns
      8.75 ±  2%      -1.5        7.21 ±  8%  perf-profile.calltrace.cycles-pp.__strncat_chk
      5.61            -1.2        4.45 ±  7%  perf-profile.calltrace.cycles-pp.brk
      4.87            -1.0        3.85 ±  7%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk
      4.84            -1.0        3.82 ±  7%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
      4.85            -0.9        3.99 ±  6%  perf-profile.calltrace.cycles-pp.__strcat_chk
      3.90            -0.8        3.08 ±  6%  perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
      2.01            -0.4        1.60 ±  6%  perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
      1.55            -0.4        1.19 ±  5%  perf-profile.calltrace.cycles-pp.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
      1.40 ±  2%      -0.3        1.09 ±  6%  perf-profile.calltrace.cycles-pp.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64
      1.38 ±  2%      -0.3        1.08 ±  6%  perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk
      0.81 ± 47%      -0.3        0.55 ±  2%  perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
      0.80 ±  4%      -0.2        0.60 ±  6%  perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap
      1.07 ±  3%      -0.2        0.88 ±  2%  perf-profile.calltrace.cycles-pp.expm1
      0.77 ±  4%      -0.2        0.58 ±  6%  perf-profile.calltrace.cycles-pp.flush_tlb_func_common.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.unmap_region
      0.75 ±  4%      -0.2        0.57 ±  7%  perf-profile.calltrace.cycles-pp.native_flush_tlb_one_user.flush_tlb_func_common.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu
      1.69 ±  2%      -0.1        1.60 ±  2%  perf-profile.calltrace.cycles-pp.execve
      1.67 ±  2%      -0.1        1.58 ±  2%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve
      1.67 ±  2%      -0.1        1.58 ±  2%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      1.67 ±  2%      -0.1        1.58 ±  2%  perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      1.65 ±  2%      -0.1        1.57 ±  2%  perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
      0.68 ±  3%      -0.1        0.61 ±  2%  perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
      0.69 ±  3%      -0.1        0.64 ±  2%  perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
      1.10            -0.0        1.05 ±  2%  perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64
      0.70 ±  5%      +0.1        0.76 ±  3%  perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
      0.70 ±  6%      +0.1        0.77 ±  4%  perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
      0.95 ±  3%      +0.1        1.07 ±  5%  perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.95 ±  3%      +0.1        1.07 ±  5%  perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.95 ±  3%      +0.1        1.07 ±  5%  perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.83 ±  9%      +0.1        0.95 ±  6%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
      1.07 ±  7%      +0.1        1.21 ±  6%  perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
      1.83            +0.2        2.02 ±  5%  perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
      2.71 ±  9%      +0.2        2.95 ±  3%  perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
      0.00            +0.6        0.64 ±  6%  perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.49 ± 58%      +0.8        1.24 ±  5%  perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
      0.32 ±101%      +0.9        1.22        perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
      3.67 ±  9%      +1.7        5.34 ±  4%  perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
      3.67 ± 10%      +1.7        5.37 ±  4%  perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
      8.76 ±  2%      -1.5        7.23 ±  8%  perf-profile.children.cycles-pp.__strncat_chk
      5.67            -1.2        4.48 ±  7%  perf-profile.children.cycles-pp.brk
      4.86            -0.9        3.99 ±  6%  perf-profile.children.cycles-pp.__strcat_chk
      1.07 ±  2%      -0.2        0.89 ±  2%  perf-profile.children.cycles-pp.expm1
      1.69 ±  2%      -0.1        1.60 ±  2%  perf-profile.children.cycles-pp.execve
      0.71 ±  4%      -0.1        0.63 ±  7%  perf-profile.children.cycles-pp.__xstat64
      0.42 ±  2%      -0.1        0.35 ±  6%  perf-profile.children.cycles-pp.malloc
      0.26 ±  8%      -0.0        0.21 ±  6%  perf-profile.children.cycles-pp.random_r
      0.17 ±  9%      -0.0        0.13 ±  6%  perf-profile.children.cycles-pp.tanh
      0.08 ± 14%      -0.0        0.04 ± 60%  perf-profile.children.cycles-pp.sincos
      0.17 ±  4%      -0.0        0.14 ± 10%  perf-profile.children.cycles-pp.security_mmap_addr
      0.13 ± 12%      -0.0        0.11 ±  8%  perf-profile.children.cycles-pp.__count_memcg_events
      0.09 ±  4%      -0.0        0.07 ±  6%  perf-profile.children.cycles-pp.__ctype_toupper_loc
      0.05            +0.0        0.06        perf-profile.children.cycles-pp.ip_make_skb
      0.25 ±  4%      +0.0        0.28        perf-profile.children.cycles-pp._dl_addr
      0.13 ±  5%      +0.0        0.15 ±  7%  perf-profile.children.cycles-pp.do_wait
      0.11 ±  7%      +0.0        0.13 ±  8%  perf-profile.children.cycles-pp.perf_event_mmap_output
      0.15 ± 11%      +0.0        0.17 ±  4%  perf-profile.children.cycles-pp.__vm_munmap
      0.09 ±  8%      +0.0        0.12 ± 10%  perf-profile.children.cycles-pp.vma_interval_tree_insert
      0.04 ± 58%      +0.0        0.07 ±  5%  perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
      0.07 ± 17%      +0.0        0.10 ±  8%  perf-profile.children.cycles-pp.irq_work_needs_cpu
      0.10 ± 15%      +0.0        0.14 ±  6%  perf-profile.children.cycles-pp.vma_link
      0.09 ± 12%      +0.0        0.12 ±  8%  perf-profile.children.cycles-pp.unlink_file_vma
      0.03 ±100%      +0.0        0.06 ±  6%  perf-profile.children.cycles-pp.__rb_insert_augmented
      0.22 ±  8%      +0.0        0.26 ±  2%  perf-profile.children.cycles-pp.sock_write_iter
      0.11 ± 14%      +0.0        0.14 ±  5%  perf-profile.children.cycles-pp.rcu_idle_exit
      0.12 ± 18%      +0.0        0.16 ±  7%  perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
      0.04 ± 59%      +0.0        0.08 ±  5%  perf-profile.children.cycles-pp.rcu_eqs_exit
      0.22 ±  3%      +0.0        0.26 ±  4%  perf-profile.children.cycles-pp.page_remove_rmap
      0.13 ± 17%      +0.0        0.17 ±  7%  perf-profile.children.cycles-pp.arch_cpu_idle_enter
      0.27 ±  8%      +0.0        0.31        perf-profile.children.cycles-pp.free_pgtables
      0.01 ±173%      +0.0        0.06 ± 14%  perf-profile.children.cycles-pp.__vma_link_rb
      0.27 ± 12%      +0.1        0.32 ±  5%  perf-profile.children.cycles-pp.__split_vma
      0.03 ±100%      +0.1        0.08 ± 12%  perf-profile.children.cycles-pp.do_task_dead
      0.05 ± 61%      +0.1        0.11 ± 10%  perf-profile.children.cycles-pp.rb_insert_color
      0.64 ±  4%      +0.1        0.70 ±  6%  perf-profile.children.cycles-pp.filename_lookup
      0.53 ±  2%      +0.1        0.59 ±  7%  perf-profile.children.cycles-pp.flush_old_exec
      0.64 ±  7%      +0.1        0.71 ±  6%  perf-profile.children.cycles-pp.path_openat
      0.38 ±  8%      +0.1        0.45 ±  5%  perf-profile.children.cycles-pp.ksys_mmap_pgoff
      0.08 ± 11%      +0.1        0.14 ±  7%  perf-profile.children.cycles-pp.newidle_balance
      0.10 ±  5%      +0.1        0.16 ±  6%  perf-profile.children.cycles-pp.pick_next_task_fair
      0.54 ±  6%      +0.1        0.61 ±  6%  perf-profile.children.cycles-pp.link_path_walk
      0.65 ±  7%      +0.1        0.72 ±  7%  perf-profile.children.cycles-pp.do_filp_open
      0.12 ± 15%      +0.1        0.20 ± 11%  perf-profile.children.cycles-pp.update_cfs_group
      0.35 ±  4%      +0.1        0.43 ±  5%  perf-profile.children.cycles-pp.mmap_region
      0.21 ± 28%      +0.1        0.29 ±  6%  perf-profile.children.cycles-pp.timerqueue_add
      0.43 ±  4%      +0.1        0.52 ±  6%  perf-profile.children.cycles-pp.do_mmap
      0.24 ± 27%      +0.1        0.33 ±  7%  perf-profile.children.cycles-pp.enqueue_hrtimer
      0.48 ±  3%      +0.1        0.57 ±  5%  perf-profile.children.cycles-pp.vm_mmap_pgoff
      1.15 ±  2%      +0.1        1.25        perf-profile.children.cycles-pp.load_elf_binary
      1.15 ±  2%      +0.1        1.25        perf-profile.children.cycles-pp.search_binary_handler
      0.97 ±  3%      +0.1        1.09 ±  6%  perf-profile.children.cycles-pp.__x64_sys_exit_group
      0.97 ±  3%      +0.1        1.09 ±  6%  perf-profile.children.cycles-pp.do_group_exit
      0.96 ±  3%      +0.1        1.09 ±  6%  perf-profile.children.cycles-pp.do_exit
      1.19 ±  3%      +0.1        1.32 ±  3%  perf-profile.children.cycles-pp.mmput
      1.18 ±  4%      +0.1        1.32 ±  3%  perf-profile.children.cycles-pp.exit_mmap
      1.72 ±  3%      +0.1        1.86        perf-profile.children.cycles-pp.__do_execve_file
      1.74 ±  3%      +0.1        1.88        perf-profile.children.cycles-pp.__x64_sys_execve
      0.00            +0.1        0.15 ± 15%  perf-profile.children.cycles-pp.native_read_msr
      0.00            +0.2        0.21 ± 15%  perf-profile.children.cycles-pp.arch_scale_freq_tick
      1.09 ± 12%      +0.2        1.32        perf-profile.children.cycles-pp.scheduler_tick
      3.78 ±  7%      +0.4        4.15 ±  2%  perf-profile.children.cycles-pp.__hrtimer_run_queues
      8.68 ±  2%      -1.5        7.16 ±  8%  perf-profile.self.cycles-pp.__strncat_chk
      4.80            -0.8        3.96 ±  6%  perf-profile.self.cycles-pp.__strcat_chk
      1.06 ±  3%      -0.2        0.87 ±  2%  perf-profile.self.cycles-pp.expm1
      0.40 ±  3%      -0.1        0.33 ±  6%  perf-profile.self.cycles-pp.malloc
      0.41 ±  6%      -0.1        0.36 ±  3%  perf-profile.self.cycles-pp._raw_spin_lock_irqsave
      0.23 ±  6%      -0.0        0.19 ±  5%  perf-profile.self.cycles-pp.random_r
      0.18 ±  8%      -0.0        0.14 ± 17%  perf-profile.self.cycles-pp.free
      0.20 ±  9%      -0.0        0.16 ±  8%  perf-profile.self.cycles-pp.__sinh_finite
      0.16 ±  7%      -0.0        0.13 ±  6%  perf-profile.self.cycles-pp.tanh
      0.08 ± 11%      -0.0        0.04 ± 60%  perf-profile.self.cycles-pp.sincos
      0.12 ±  8%      -0.0        0.10 ±  7%  perf-profile.self.cycles-pp.__count_memcg_events
      0.08 ± 15%      -0.0        0.06 ± 11%  perf-profile.self.cycles-pp.__mod_lruvec_state
      0.09 ±  4%      -0.0        0.07 ±  6%  perf-profile.self.cycles-pp.__ctype_toupper_loc
      0.08 ± 11%      +0.0        0.09 ±  8%  perf-profile.self.cycles-pp.perf_event_mmap_output
      0.10 ± 11%      +0.0        0.12 ±  3%  perf-profile.self.cycles-pp.copy_p4d_range
      0.25 ±  2%      +0.0        0.27        perf-profile.self.cycles-pp._dl_addr
      0.08 ± 11%      +0.0        0.10 ± 18%  perf-profile.self.cycles-pp.free_pages_and_swap_cache
      0.09 ±  7%      +0.0        0.12 ±  7%  perf-profile.self.cycles-pp.vma_interval_tree_insert
      0.04 ± 59%      +0.0        0.08 ±  6%  perf-profile.self.cycles-pp.hrtimer_forward
      0.18            +0.0        0.21 ±  5%  perf-profile.self.cycles-pp.page_remove_rmap
      0.04 ± 57%      +0.0        0.07 ± 10%  perf-profile.self.cycles-pp.up_read
      0.03 ±100%      +0.0        0.07 ±  7%  perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
      0.05 ± 60%      +0.0        0.09 ±  9%  perf-profile.self.cycles-pp.irq_work_needs_cpu
      0.01 ±173%      +0.0        0.06 ± 14%  perf-profile.self.cycles-pp.__vma_link_rb
      0.48 ±  5%      +0.0        0.53 ±  5%  perf-profile.self.cycles-pp.unmap_page_range
      0.05 ± 61%      +0.0        0.10 ± 13%  perf-profile.self.cycles-pp.rb_insert_color
      0.12 ± 15%      +0.1        0.20 ± 11%  perf-profile.self.cycles-pp.update_cfs_group
      0.00            +0.1        0.08 ± 14%  perf-profile.self.cycles-pp.arch_scale_freq_tick
      0.00            +0.1        0.14 ± 18%  perf-profile.self.cycles-pp.native_read_msr


                                                                                
                      reaim.time.percent_of_cpu_this_job_got                    
                                                                                
  2685 +-+------------------------------------------------------------------+   
       |              .+..+.+..+..       .+.+..                             |   
  2680 +-+         .+.            +.+..+.      +.+..+..+.+..+..+.           |   
  2675 +-++.+..  .+                                              +..+..+    |   
       |       +.                                                           |   
  2670 +-+                                                                  |   
  2665 +-+                                                                  |   
       |                                                                    |   
  2660 +-+                                                                  |   
  2655 +-+        O                                                         |   
       |  O                 O                                               |   
  2650 +-+          O          O  O O  O  O         O                  O    |   
  2645 O-+  O  O       O  O                    O         O          O    O  |   
       |                                    O    O     O    O  O O          O   
  2640 +-+------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                        reaim.time.voluntary_context_switches                   
                                                                                
  520000 +-+----------------------------------------------------------------+   
         |           .+.+..+..+.+..+.+..+..+.+..+.+..                       |   
  510000 +-++.+.. .+.                                +.  .+.. .+..+.  .+    |   
  500000 +-+     +                                     +.    +      +.      |   
         |                                                                  |   
  490000 +-+                                                                |   
         |                                                                  |   
  480000 +-+                                                                |   
         |                                                                  |   
  470000 +-+                                                                |   
  460000 +-+                                                                |   
         O  O    O O  O O  O  O O  O    O                                   |   
  450000 +-+  O                      O     O         O              O  O    |   
         |                                   O  O O    O  O  O O  O      O  O   
  440000 +-+----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                  reaim.parent_time                             
                                                                                
  1.005 +-+-------------------------------------------------------O---------+   
        |               O                                      O            |   
      1 O-+     O         O       O                                 O       O   
        |    O       O               O O  O  O O  O O  O  O O            O  |   
  0.995 +-+       O             O                                      O    |   
        |  O                 O                                              |   
   0.99 +-+                                                                 |   
        |                                                                   |   
  0.985 +-+                                                                 |   
        |                                                                   |   
   0.98 +-++.        +                         +                       +    |   
        |..  +..+. .. +             .+.+..+.. + +   +..+..+.+..      ..     |   
  0.975 +-+       +    + .+..+..+.+.         +   + +           +..+.+       |   
        |               +                         +                         |   
   0.97 +-+-----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                                 reaim.jobs_per_min                             
                                                                                
  550000 +-+----------------------------------------------------------------+   
  548000 +-+            +..                       +..                       |   
         |..      .+.. :   +..+.+..+.       .+.. :    .+..  .+.+..+.+..     |   
  546000 +-+ .+..+     :             +..+..+     :   +    +.                |   
  544000 +-++         +                         +                      +    |   
         |                                                                  |   
  542000 +-+                                                                |   
  540000 +-+                                                                |   
  538000 +-+                                                                |   
         |  O      O          O O                                           |   
  536000 +-+                            O         O          O         O    |   
  534000 O-+  O  O    O            O O     O O  O    O O  O         O    O  O   
         |              O  O                                   O            |   
  532000 +-+                                                      O         |   
  530000 +-+----------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                             reaim.jobs_per_min_child                           
                                                                                
  6240 +-+------------------------------------------------------------------+   
  6220 +-+        +    +.. .+..                  +..                        |   
       |.. .+.. .. :  +   +    +..+.+..    .+.. +   +..+.+..+..+.+..+..     |   
  6200 +-++    +   : +                 +..+    +                            |   
  6180 +-+          +                                                  +    |   
       |                                                                    |   
  6160 +-+                                                                  |   
  6140 +-+                                                                  |   
  6120 +-+                                                                  |   
       |                                                                    |   
  6100 +-+O       O         O  O                                       O    |   
  6080 +-+                          O  O    O  O O     O O  O            O  |   
       O    O  O    O     O       O       O         O               O       O   
  6060 +-+             O                                       O            |   
  6040 +-+-------------------------------------------------------O----------+   
                                                                                
                                                                                                                                                                
                               reaim.std_dev_percent                            
                                                                                
  2.5 +-+-------------------------------------------------------------------+   
      |                                                                     |   
  2.4 +-+                        O                             O O          |   
      O    O  O    O  O  O          O O     O    O    O     O       O    O  O   
  2.3 +-+O                  O O          O    O     O    O             O    |   
      |          O                                                          |   
  2.2 +-+                                                                   |   
      |                                                                     |   
  2.1 +-+                                                                   |   
      |                                                                     |   
    2 +-+                                                                   |   
      |                                             +.  .+..                |   
  1.9 +-++.+..+.. .+..                  .+.. .+.. ..  +.    +..+.  .+..+    |   
      |.         +    +..+..+.+..+..+.+.    +    +               +.         |   
  1.8 +-+-------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
                               reaim.max_jobs_per_min                           
                                                                                
  568000 +-+----------------------------------------------------------------+   
  566000 +-+:        :   :      :  :   :      :                ::           |   
         | : :       :   :     :    :  :      :               : :           |   
  564000 +-+ :      :     :    :    : :        :              :  :          |   
  562000 +-+  :     :     :   :      ::        :             :   :          |   
         |    +..+.+       +..+      +          +.+..+.+..+..+    +.+..+    |   
  560000 +-+                                                                |   
  558000 +-+                                                                |   
  556000 +-+                                                                |   
         |  O O  O O  O       O O  O O  O         O          O    O O  O    |   
  554000 +-+                                                                |   
  552000 +-+                                                                |   
         |                                                                  |   
  550000 O-+            O  O               O O  O    O O  O    O         O  O   
  548000 +-+----------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample



Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.5.0-rc4-00007-g8e663d38f1ce6e" of type "text/plain" (202322 bytes)

View attachment "job-script" of type "text/plain" (7819 bytes)

View attachment "job.yaml" of type "text/plain" (5403 bytes)

View attachment "reproduce" of type "text/plain" (10247 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ