lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Date:	Thu, 17 Sep 2015 11:13:42 +0800
From:	kernel test robot <ying.huang@...el.com>
TO:	Srikar Dronamraju <srikar@...ux.vnet.ibm.com>
CC:	Ingo Molnar <mingo@...nel.org>
Subject: [lkp] [sched/numa] 2a595721a1: No primary change, -4.1% pigz.time.system_time, -35.6%
 pigz.time.involuntary_context_switches

FYI, we noticed the below changes on

https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git master
commit 2a595721a1fa6b684c1c818f379bef834ac3d65e ("sched/numa: Convert sched_numa_balancing to a static_branch")


=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/cpufreq_governor/nr_threads/blocksize:
  brickland1/pigz/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/performance/25%/512K

commit: 
  2b49d84b259fc18e131026e5d38e7855352f71b9
  2a595721a1fa6b684c1c818f379bef834ac3d65e

2b49d84b259fc18e 2a595721a1fa6b684c1c818f37 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      8893 ±  3%     -35.6%       5725 ±  2%  pigz.time.involuntary_context_switches
    529645 ±  7%     -84.6%      81746 ±  2%  pigz.time.minor_page_faults
    136.12 ±  0%      -4.1%     130.53 ±  0%  pigz.time.system_time
     49894 ±  0%     -12.0%      43908 ±  0%  vmstat.system.in
     23110 ±  4%     +10.4%      25504 ±  3%  numa-meminfo.node2.Active(file)
     34491 ±  7%      +9.9%      37902 ±  7%  numa-meminfo.node3.SUnreclaim
   2198559 ± 85%    +298.4%    8759838 ± 40%  numa-numastat.node3.local_node
   2201064 ± 85%    +298.1%    8762796 ± 40%  numa-numastat.node3.numa_hit
      8893 ±  3%     -35.6%       5725 ±  2%  time.involuntary_context_switches
    529645 ±  7%     -84.6%      81746 ±  2%  time.minor_page_faults
    921.83 ±  0%      +4.0%     958.44 ±  0%  turbostat.CorWatt
    935.50 ±  0%      +3.9%     972.09 ±  0%  turbostat.PkgWatt
   1210520 ±116%    +466.6%    6858564 ±173%  latency_stats.avg.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
   1210520 ±116%    +466.6%    6858564 ±173%  latency_stats.max.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
   1210520 ±116%    +466.6%    6858564 ±173%  latency_stats.sum.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
      5777 ±  4%     +10.4%       6375 ±  3%  numa-vmstat.node2.nr_active_file
      8622 ±  7%      +9.9%       9475 ±  7%  numa-vmstat.node3.nr_slab_unreclaimable
   1397511 ±112%    +225.2%    4545159 ± 45%  numa-vmstat.node3.numa_hit
   1344766 ±116%    +234.2%    4494534 ± 45%  numa-vmstat.node3.numa_local
    446934 ±  9%    -100.0%       0.00 ± -1%  proc-vmstat.numa_hint_faults
    156287 ±  8%    -100.0%       0.00 ± -1%  proc-vmstat.numa_hint_faults_local
     79222 ±  3%    -100.0%       0.00 ± -1%  proc-vmstat.numa_pages_migrated
    606436 ± 10%    -100.0%       0.00 ± -1%  proc-vmstat.numa_pte_updates
   1325944 ±  3%     -34.0%     875483 ±  0%  proc-vmstat.pgfault
      2944 ± 22%    -100.0%       0.00 ± -1%  proc-vmstat.pgmigrate_fail
     79222 ±  3%    -100.0%       0.00 ± -1%  proc-vmstat.pgmigrate_success
      1.66 ± 88%     -90.3%       0.16 ± 35%  perf-profile.cpu-cycles.__acct_update_integrals.acct_account_cputime.account_user_time.account_process_tick.update_process_times
     51.92 ± 11%     -18.3%      42.43 ± 14%  perf-profile.cpu-cycles.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
     29.38 ±  7%     -23.4%      22.52 ± 14%  perf-profile.cpu-cycles.ktime_get.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt
     29.13 ±  7%     -23.4%      22.32 ± 13%  perf-profile.cpu-cycles.read_hpet.ktime_get.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      1.17 ± 31%    +112.8%       2.48 ± 17%  perf-profile.cpu-cycles.read_hpet.update_wall_time.tick_do_update_jiffies64.tick_sched_do_timer.tick_sched_timer
      1.78 ± 32%    +107.3%       3.70 ± 13%  perf-profile.cpu-cycles.tick_do_update_jiffies64.tick_sched_do_timer.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      1.78 ± 32%    +107.4%       3.70 ± 13%  perf-profile.cpu-cycles.tick_sched_do_timer.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt
     50.82 ± 11%     -18.1%      41.61 ± 14%  perf-profile.cpu-cycles.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt
      1.77 ± 32%    +106.6%       3.67 ± 13%  perf-profile.cpu-cycles.update_wall_time.tick_do_update_jiffies64.tick_sched_do_timer.tick_sched_timer.__hrtimer_run_queues
    116261 ±  3%     -24.1%      88256 ±  7%  sched_debug.cfs_rq[0]:/.exec_clock
   3830581 ±  1%     -24.8%    2878817 ±  7%  sched_debug.cfs_rq[0]:/.min_vruntime
    133.00 ± 55%     -98.7%       1.67 ± 74%  sched_debug.cfs_rq[100]:/.util_avg
  -3659940 ± -3%     -24.4%   -2765978 ± -7%  sched_debug.cfs_rq[101]:/.spread0
  -3278346 ± -8%     -20.5%   -2604920 ±-18%  sched_debug.cfs_rq[102]:/.spread0
  -3435271 ±-11%     -22.2%   -2672848 ±-15%  sched_debug.cfs_rq[103]:/.spread0
  -3566499 ± -3%     -29.6%   -2512386 ±-20%  sched_debug.cfs_rq[104]:/.spread0
  -3574386 ±-10%     -24.6%   -2693594 ±-14%  sched_debug.cfs_rq[105]:/.spread0
      2881 ±120%   +1131.0%      35471 ± 40%  sched_debug.cfs_rq[106]:/.exec_clock
      0.50 ±173%   +1100.0%       6.00 ± 31%  sched_debug.cfs_rq[106]:/.load_avg
    145030 ± 68%    +703.4%    1165173 ± 40%  sched_debug.cfs_rq[106]:/.min_vruntime
  -3686246 ± -3%     -53.5%   -1714418 ±-32%  sched_debug.cfs_rq[106]:/.spread0
      0.50 ±173%   +1100.0%       6.00 ± 31%  sched_debug.cfs_rq[106]:/.tg_load_avg_contrib
      2.75 ±132%   +7254.5%     202.25 ± 26%  sched_debug.cfs_rq[106]:/.util_avg
     18683 ± 58%     -85.0%       2799 ± 95%  sched_debug.cfs_rq[107]:/.exec_clock
  -3196208 ±-10%     -15.4%   -2705137 ±-11%  sched_debug.cfs_rq[107]:/.spread0
    750.95 ± 58%   +1665.3%      13256 ± 95%  sched_debug.cfs_rq[108]:/.exec_clock
     66759 ± 44%    +599.7%     467098 ± 81%  sched_debug.cfs_rq[108]:/.min_vruntime
  -3764526 ±  0%     -35.9%   -2412505 ±-20%  sched_debug.cfs_rq[108]:/.spread0
  -3621586 ± -2%     -23.4%   -2774188 ± -7%  sched_debug.cfs_rq[109]:/.spread0
     17.25 ± 25%     -36.2%      11.00 ± 23%  sched_debug.cfs_rq[10]:/.load_avg
  -2053233 ±-43%     -51.5%    -994945 ±-61%  sched_debug.cfs_rq[10]:/.spread0
     17.25 ± 25%     -36.2%      11.00 ± 23%  sched_debug.cfs_rq[10]:/.tg_load_avg_contrib
  -3753277 ±  0%     -36.5%   -2382031 ±-18%  sched_debug.cfs_rq[110]:/.spread0
      6278 ±157%    +389.1%      30704 ± 39%  sched_debug.cfs_rq[111]:/.exec_clock
      0.00 ±  0%      +Inf%       6.00 ± 20%  sched_debug.cfs_rq[111]:/.load_avg
    229896 ±131%    +344.9%    1022781 ± 37%  sched_debug.cfs_rq[111]:/.min_vruntime
  -3601405 ± -8%     -48.4%   -1856844 ±-24%  sched_debug.cfs_rq[111]:/.spread0
      0.00 ±  0%      +Inf%       6.00 ± 20%  sched_debug.cfs_rq[111]:/.tg_load_avg_contrib
      1.67 ±101%  +10235.0%     172.25 ±  0%  sched_debug.cfs_rq[111]:/.util_avg
    737.39 ± 29%    +726.5%       6094 ±137%  sched_debug.cfs_rq[112]:/.exec_clock
     67404 ± 35%    +324.5%     286110 ± 83%  sched_debug.cfs_rq[112]:/.min_vruntime
  -3763902 ± -1%     -31.1%   -2593520 ±-15%  sched_debug.cfs_rq[112]:/.spread0
  -3486522 ± -9%     -26.7%   -2556764 ±-22%  sched_debug.cfs_rq[113]:/.spread0
      1443 ± 78%    +667.7%      11079 ±111%  sched_debug.cfs_rq[114]:/.exec_clock
  -3740179 ± -1%     -33.8%   -2474399 ±-19%  sched_debug.cfs_rq[114]:/.spread0
      1.00 ± 81%   +8650.0%      87.50 ± 94%  sched_debug.cfs_rq[114]:/.util_avg
  -3696449 ± -3%     -34.1%   -2434206 ±-28%  sched_debug.cfs_rq[115]:/.spread0
  -3332046 ±-11%     -15.3%   -2822306 ± -7%  sched_debug.cfs_rq[116]:/.spread0
  -3750772 ±  0%     -27.2%   -2730139 ± -5%  sched_debug.cfs_rq[117]:/.spread0
    781.26 ± 27%    +197.5%       2324 ± 72%  sched_debug.cfs_rq[118]:/.exec_clock
     62554 ± 40%    +131.9%     145063 ± 37%  sched_debug.cfs_rq[118]:/.min_vruntime
  -3768786 ± -1%     -27.4%   -2734597 ± -9%  sched_debug.cfs_rq[118]:/.spread0
     34.00 ±109%     -99.0%       0.33 ±141%  sched_debug.cfs_rq[118]:/.util_avg
    964.82 ± 17%    +535.2%       6128 ±139%  sched_debug.cfs_rq[119]:/.exec_clock
  -3743042 ± -1%     -29.5%   -2638522 ±-16%  sched_debug.cfs_rq[119]:/.spread0
     33831 ± 35%    +136.1%      79889 ± 18%  sched_debug.cfs_rq[11]:/.exec_clock
   1598925 ± 14%     +69.9%    2717005 ± 13%  sched_debug.cfs_rq[11]:/.min_vruntime
      6.00 ± 65%    +150.0%      15.00 ± 33%  sched_debug.cfs_rq[11]:/.runnable_load_avg
  -2231731 ±-10%     -92.7%    -161883 ±-290%  sched_debug.cfs_rq[11]:/.spread0
    211.00 ± 48%    +145.1%     517.25 ± 30%  sched_debug.cfs_rq[11]:/.util_avg
  -1733896 ±-28%     -95.5%     -78376 ±-1047%  sched_debug.cfs_rq[12]:/.spread0
     30322 ± 29%    +114.8%      65119 ± 41%  sched_debug.cfs_rq[13]:/.exec_clock
  -2454110 ±-10%     -75.7%    -597570 ±-187%  sched_debug.cfs_rq[13]:/.spread0
  -2559592 ±-14%     -62.8%    -952814 ±-46%  sched_debug.cfs_rq[14]:/.spread0
    109741 ±  2%     -10.9%      97760 ±  2%  sched_debug.cfs_rq[15]:/.exec_clock
   3599873 ±  5%     -12.0%    3168005 ±  4%  sched_debug.cfs_rq[15]:/.min_vruntime
   -230805 ±-64%    -225.3%     289094 ± 42%  sched_debug.cfs_rq[15]:/.spread0
    -93388 ±-171%   -1216.9%    1043029 ± 44%  sched_debug.cfs_rq[16]:/.spread0
  -1052675 ±-33%    -165.5%     689427 ± 65%  sched_debug.cfs_rq[18]:/.spread0
      1.00 ±  0%    -100.0%       0.00 ± -1%  sched_debug.cfs_rq[21]:/.nr_spread_over
  -1248598 ±-26%     -54.5%    -568164 ±-71%  sched_debug.cfs_rq[21]:/.spread0
     67072 ± 27%     -82.4%      11829 ± 54%  sched_debug.cfs_rq[22]:/.exec_clock
     10.75 ± 19%     -53.5%       5.00 ±  0%  sched_debug.cfs_rq[22]:/.load
     13.25 ± 14%     -45.3%       7.25 ± 24%  sched_debug.cfs_rq[22]:/.load_avg
   2526358 ± 34%     -61.6%     970591 ± 40%  sched_debug.cfs_rq[22]:/.min_vruntime
     11.00 ± 21%     -56.8%       4.75 ±  9%  sched_debug.cfs_rq[22]:/.runnable_load_avg
     13.25 ± 14%     -45.3%       7.25 ± 24%  sched_debug.cfs_rq[22]:/.tg_load_avg_contrib
    404.75 ± 15%     -55.7%     179.25 ±  8%  sched_debug.cfs_rq[22]:/.util_avg
     34903 ± 43%    +111.9%      73956 ±  7%  sched_debug.cfs_rq[24]:/.exec_clock
   1459089 ± 37%     +78.7%    2607295 ±  6%  sched_debug.cfs_rq[24]:/.min_vruntime
  -2371657 ±-21%     -88.5%    -271682 ±-51%  sched_debug.cfs_rq[24]:/.spread0
    114156 ± 14%     -24.2%      86563 ±  5%  sched_debug.cfs_rq[2]:/.exec_clock
    108423 ±  6%     -19.3%      87469 ± 16%  sched_debug.cfs_rq[30]:/.exec_clock
     23.25 ±  9%     -28.0%      16.75 ± 12%  sched_debug.cfs_rq[30]:/.load_avg
   3552781 ±  5%     -19.5%    2860014 ± 16%  sched_debug.cfs_rq[30]:/.min_vruntime
     23.25 ±  9%     -28.0%      16.75 ± 12%  sched_debug.cfs_rq[30]:/.tg_load_avg_contrib
    738.50 ±  8%     -23.7%     563.25 ± 12%  sched_debug.cfs_rq[30]:/.util_avg
   -435993 ±-87%    -290.1%     828697 ± 66%  sched_debug.cfs_rq[31]:/.spread0
  -1171740 ±-71%    -119.6%     229420 ±240%  sched_debug.cfs_rq[32]:/.spread0
  -1371768 ±-44%    -104.5%      61104 ±1230%  sched_debug.cfs_rq[33]:/.spread0
    616.00 ± 16%     -29.3%     435.50 ± 38%  sched_debug.cfs_rq[36]:/.util_avg
     40119 ± 43%     +65.1%      66221 ± 18%  sched_debug.cfs_rq[38]:/.exec_clock
  -2124064 ±-28%     -78.3%    -460976 ±-79%  sched_debug.cfs_rq[38]:/.spread0
  -1798066 ±-18%     -82.6%    -312882 ±-148%  sched_debug.cfs_rq[39]:/.spread0
    114466 ±  5%     -40.3%      68312 ± 40%  sched_debug.cfs_rq[3]:/.exec_clock
   3814268 ±  5%     -33.5%    2537783 ± 32%  sched_debug.cfs_rq[3]:/.min_vruntime
    688.00 ± 15%     -46.4%     369.00 ± 35%  sched_debug.cfs_rq[3]:/.util_avg
  -1624917 ±-29%     -70.9%    -473178 ±-168%  sched_debug.cfs_rq[41]:/.spread0
     10.75 ± 31%     -53.5%       5.00 ± 70%  sched_debug.cfs_rq[42]:/.load
    112152 ±  7%     -28.8%      79900 ±  5%  sched_debug.cfs_rq[45]:/.exec_clock
     27.25 ± 38%     -67.9%       8.75 ± 74%  sched_debug.cfs_rq[45]:/.load
     23.25 ±  8%     -52.7%      11.00 ± 60%  sched_debug.cfs_rq[45]:/.load_avg
   3652753 ±  5%     -24.6%    2754845 ±  3%  sched_debug.cfs_rq[45]:/.min_vruntime
     22.25 ± 10%     -65.2%       7.75 ± 73%  sched_debug.cfs_rq[45]:/.runnable_load_avg
     23.25 ±  8%     -52.7%      11.00 ± 60%  sched_debug.cfs_rq[45]:/.tg_load_avg_contrib
    744.75 ±  9%     -62.0%     283.25 ± 65%  sched_debug.cfs_rq[45]:/.util_avg
    101629 ±  3%     -44.1%      56764 ± 13%  sched_debug.cfs_rq[46]:/.exec_clock
     20.00 ± 19%     -51.2%       9.75 ± 60%  sched_debug.cfs_rq[46]:/.load
     21.50 ± 18%     -50.0%      10.75 ± 59%  sched_debug.cfs_rq[46]:/.load_avg
   3325558 ±  2%     -36.6%    2107303 ± 12%  sched_debug.cfs_rq[46]:/.min_vruntime
     19.75 ± 18%     -51.9%       9.50 ± 60%  sched_debug.cfs_rq[46]:/.runnable_load_avg
     21.50 ± 18%     -50.0%      10.75 ± 59%  sched_debug.cfs_rq[46]:/.tg_load_avg_contrib
    680.50 ± 18%     -50.8%     335.00 ± 59%  sched_debug.cfs_rq[46]:/.util_avg
     92913 ±  2%     -35.2%      60227 ± 38%  sched_debug.cfs_rq[47]:/.exec_clock
    730.50 ±  9%     -48.3%     378.00 ± 47%  sched_debug.cfs_rq[47]:/.util_avg
    100043 ±  6%     -35.7%      64337 ± 10%  sched_debug.cfs_rq[48]:/.exec_clock
   3482864 ±  9%     -32.0%    2368231 ±  9%  sched_debug.cfs_rq[48]:/.min_vruntime
    682.50 ± 15%     -31.2%     469.75 ± 28%  sched_debug.cfs_rq[4]:/.util_avg
  -1795812 ±-34%     -99.6%      -7570 ±-10364%  sched_debug.cfs_rq[52]:/.spread0
  -1189477 ±-80%    -101.2%      13908 ±4111%  sched_debug.cfs_rq[53]:/.spread0
  -2198387 ±-28%     -73.4%    -585016 ±-64%  sched_debug.cfs_rq[55]:/.spread0
    272.50 ± 24%     +46.1%     398.00 ±  4%  sched_debug.cfs_rq[55]:/.util_avg
   1882614 ± 10%     +30.9%    2464360 ±  4%  sched_debug.cfs_rq[56]:/.min_vruntime
  -1948373 ±-11%     -78.7%    -414875 ±-44%  sched_debug.cfs_rq[56]:/.spread0
      6.25 ± 34%    +100.0%      12.50 ± 20%  sched_debug.cfs_rq[57]:/.load
      6.00 ± 28%    +108.3%      12.50 ± 20%  sched_debug.cfs_rq[57]:/.runnable_load_avg
  -2176925 ±-24%    -104.0%      86742 ±1111%  sched_debug.cfs_rq[57]:/.spread0
    223.00 ± 33%     +91.1%     426.25 ± 19%  sched_debug.cfs_rq[57]:/.util_avg
  -2261079 ±-41%     -78.7%    -482338 ±-65%  sched_debug.cfs_rq[58]:/.spread0
  -1954361 ±-42%     -78.4%    -421282 ±-115%  sched_debug.cfs_rq[59]:/.spread0
     94715 ±  3%     -34.4%      62135 ± 26%  sched_debug.cfs_rq[5]:/.exec_clock
     17.50 ± 21%     -57.1%       7.50 ± 33%  sched_debug.cfs_rq[5]:/.load
   3311193 ±  9%     -27.7%    2394814 ± 23%  sched_debug.cfs_rq[5]:/.min_vruntime
    632.25 ± 24%     -59.1%     258.75 ± 33%  sched_debug.cfs_rq[5]:/.util_avg
      0.33 ±141%   +2900.0%      10.00 ± 66%  sched_debug.cfs_rq[60]:/.load_avg
  -3742126 ±  0%     -36.8%   -2365254 ±-24%  sched_debug.cfs_rq[60]:/.spread0
      0.33 ±141%   +2900.0%      10.00 ± 66%  sched_debug.cfs_rq[60]:/.tg_load_avg_contrib
  -3554476 ± -7%     -21.3%   -2796294 ± -9%  sched_debug.cfs_rq[61]:/.spread0
  -3612954 ± -6%     -28.9%   -2568207 ±-16%  sched_debug.cfs_rq[63]:/.spread0
  -3759598 ± -1%     -34.4%   -2464987 ±-15%  sched_debug.cfs_rq[65]:/.spread0
    980.95 ± 17%   +2645.6%      26932 ± 60%  sched_debug.cfs_rq[66]:/.exec_clock
    105444 ± 34%    +751.5%     897829 ± 57%  sched_debug.cfs_rq[66]:/.min_vruntime
  -3725607 ± -1%     -46.8%   -1981493 ±-23%  sched_debug.cfs_rq[66]:/.spread0
  -3656770 ± -3%     -31.5%   -2503974 ±-10%  sched_debug.cfs_rq[67]:/.spread0
  -3680625 ± -3%     -39.5%   -2226211 ±-55%  sched_debug.cfs_rq[68]:/.spread0
  -3594149 ± -5%     -22.2%   -2795647 ± -7%  sched_debug.cfs_rq[69]:/.spread0
    451.25 ± 29%     -50.7%     222.25 ± 55%  sched_debug.cfs_rq[6]:/.util_avg
  -3731439 ±  0%     -30.3%   -2601216 ±-15%  sched_debug.cfs_rq[71]:/.spread0
      1121 ± 22%     -27.4%     814.73 ± 17%  sched_debug.cfs_rq[72]:/.exec_clock
    128857 ± 49%     -54.6%      58446 ±  9%  sched_debug.cfs_rq[72]:/.min_vruntime
  -3702229 ±  0%     -23.8%   -2820926 ± -7%  sched_debug.cfs_rq[72]:/.spread0
  -3669791 ± -3%     -25.3%   -2740420 ±-12%  sched_debug.cfs_rq[73]:/.spread0
  -3674440 ± -4%     -24.1%   -2788078 ±-10%  sched_debug.cfs_rq[74]:/.spread0
  -3770001 ±  0%     -27.8%   -2721945 ±-13%  sched_debug.cfs_rq[75]:/.spread0
      3.50 ± 58%   +4264.3%     152.75 ± 86%  sched_debug.cfs_rq[75]:/.util_avg
  -3736543 ±  0%     -25.8%   -2771201 ± -9%  sched_debug.cfs_rq[76]:/.spread0
    734.97 ± 63%   +1526.6%      11954 ± 90%  sched_debug.cfs_rq[78]:/.exec_clock
  -3772623 ±  0%     -34.7%   -2462353 ±-23%  sched_debug.cfs_rq[78]:/.spread0
  -3552096 ± -6%     -38.4%   -2187150 ±-30%  sched_debug.cfs_rq[79]:/.spread0
     63492 ± 10%     -22.1%      49436 ± 13%  sched_debug.cfs_rq[7]:/.exec_clock
   2387489 ± 14%     -21.1%    1883110 ± 16%  sched_debug.cfs_rq[7]:/.min_vruntime
  -3751786 ± -1%     -26.6%   -2754141 ± -5%  sched_debug.cfs_rq[80]:/.spread0
  -3554010 ± -6%     -21.4%   -2792868 ± -6%  sched_debug.cfs_rq[81]:/.spread0
  -3632345 ± -6%     -28.9%   -2581916 ±-14%  sched_debug.cfs_rq[86]:/.spread0
  -3760781 ±  0%     -43.9%   -2111066 ±-31%  sched_debug.cfs_rq[87]:/.spread0
     26902 ± 64%     -74.7%       6797 ±163%  sched_debug.cfs_rq[88]:/.exec_clock
    884822 ± 59%     -72.3%     244816 ±150%  sched_debug.cfs_rq[88]:/.min_vruntime
  -3666833 ± -3%     -29.3%   -2591895 ±-21%  sched_debug.cfs_rq[89]:/.spread0
  -3552123 ± -6%     -36.1%   -2270416 ±-23%  sched_debug.cfs_rq[90]:/.spread0
  -3734940 ± -1%     -26.2%   -2755171 ±-10%  sched_debug.cfs_rq[91]:/.spread0
    655826 ± 83%     -91.1%      58454 ± 31%  sched_debug.cfs_rq[93]:/.min_vruntime
      1479 ± 11%     -19.0%       1198 ± 14%  sched_debug.cfs_rq[93]:/.tg_load_avg
     87.25 ± 96%     -98.6%       1.25 ± 66%  sched_debug.cfs_rq[94]:/.util_avg
     35140 ± 37%     -98.7%     444.99 ± 54%  sched_debug.cfs_rq[95]:/.exec_clock
   1158811 ± 34%     -96.8%      37162 ± 63%  sched_debug.cfs_rq[95]:/.min_vruntime
  -3744235 ±  0%     -35.4%   -2417077 ±-18%  sched_debug.cfs_rq[96]:/.spread0
  -3403276 ±-13%     -17.3%   -2814514 ± -7%  sched_debug.cfs_rq[97]:/.spread0
    633334 ± 52%     -81.4%     117729 ± 62%  sched_debug.cfs_rq[98]:/.min_vruntime
  -3197900 ± -9%     -13.6%   -2761812 ± -6%  sched_debug.cfs_rq[98]:/.spread0
  -3375824 ± -6%     -18.2%   -2760505 ± -8%  sched_debug.cfs_rq[99]:/.spread0
      8.75 ± 16%     +65.7%      14.50 ± 20%  sched_debug.cfs_rq[9]:/.load_avg
  -2128634 ±-31%     -80.4%    -416709 ±-118%  sched_debug.cfs_rq[9]:/.spread0
      8.75 ± 16%     +65.7%      14.50 ± 20%  sched_debug.cfs_rq[9]:/.tg_load_avg_contrib
    225.50 ± 41%     +87.3%     422.25 ± 21%  sched_debug.cfs_rq[9]:/.util_avg
    122178 ±  2%     -23.0%      94103 ±  6%  sched_debug.cpu#0.nr_load_updates
      7369 ± 22%     -42.4%       4245 ± 23%  sched_debug.cpu#10.ttwu_count
    924.50 ± 59%     +78.6%       1650 ± 32%  sched_debug.cpu#104.ttwu_count
    675.50 ± 12%     +85.4%       1252 ± 26%  sched_debug.cpu#105.nr_switches
    676.00 ± 12%     +85.5%       1253 ± 26%  sched_debug.cpu#105.sched_count
    287.50 ±  9%     +89.2%     544.00 ± 27%  sched_debug.cpu#105.sched_goidle
    431.50 ± 71%    +457.5%       2405 ± 86%  sched_debug.cpu#105.ttwu_count
    134.75 ± 12%    +157.9%     347.50 ± 35%  sched_debug.cpu#105.ttwu_local
     43808 ±  5%     +55.4%      68059 ± 16%  sched_debug.cpu#106.nr_load_updates
    423.75 ± 24%    +808.6%       3850 ± 80%  sched_debug.cpu#106.ttwu_count
     55428 ± 14%     -23.5%      42409 ±  9%  sched_debug.cpu#107.nr_load_updates
    673.75 ± 26%    +297.4%       2677 ± 92%  sched_debug.cpu#107.nr_switches
      2.75 ± 82%      -9.1%       2.50 ±142%  sched_debug.cpu#107.nr_uninterruptible
    675.00 ± 26%    +296.9%       2679 ± 92%  sched_debug.cpu#107.sched_count
    286.75 ± 26%    +334.6%       1246 ± 99%  sched_debug.cpu#107.sched_goidle
    714.00 ±  5%     +89.0%       1349 ± 51%  sched_debug.cpu#108.nr_switches
    714.75 ±  4%     +88.9%       1350 ± 51%  sched_debug.cpu#108.sched_count
    308.25 ±  5%     +92.8%     594.25 ± 57%  sched_debug.cpu#108.sched_goidle
    364.00 ± 46%    +169.8%     982.25 ± 33%  sched_debug.cpu#108.ttwu_count
    150.75 ± 14%     +54.2%     232.50 ± 11%  sched_debug.cpu#108.ttwu_local
      6.00 ± 65%    +150.0%      15.00 ± 33%  sched_debug.cpu#11.cpu_load[0]
      6.00 ± 65%    +150.0%      15.00 ± 33%  sched_debug.cpu#11.cpu_load[1]
      6.00 ± 65%    +150.0%      15.00 ± 33%  sched_debug.cpu#11.cpu_load[2]
      5.75 ± 65%    +160.9%      15.00 ± 33%  sched_debug.cpu#11.cpu_load[3]
      5.75 ± 65%    +160.9%      15.00 ± 33%  sched_debug.cpu#11.cpu_load[4]
    933.00 ± 64%    +218.0%       2966 ± 41%  sched_debug.cpu#11.curr->pid
     74672 ± 10%     +39.5%     104165 ±  9%  sched_debug.cpu#11.nr_load_updates
     23887 ± 35%     -60.2%       9514 ± 55%  sched_debug.cpu#11.nr_switches
     23935 ± 34%     -60.2%       9517 ± 55%  sched_debug.cpu#11.sched_count
     11797 ± 35%     -60.5%       4657 ± 56%  sched_debug.cpu#11.sched_goidle
    617.00 ± 14%    +285.7%       2379 ± 91%  sched_debug.cpu#110.nr_switches
    618.00 ± 14%    +285.2%       2380 ± 91%  sched_debug.cpu#110.sched_count
    260.75 ± 11%    +333.4%       1130 ± 95%  sched_debug.cpu#110.sched_goidle
    242.75 ± 25%    +494.5%       1443 ± 90%  sched_debug.cpu#110.ttwu_count
    135.00 ± 18%     +53.9%     207.75 ± 13%  sched_debug.cpu#110.ttwu_local
    985570 ±  1%     -13.1%     856012 ±  1%  sched_debug.cpu#111.avg_idle
     45139 ± 17%     +43.1%      64592 ± 14%  sched_debug.cpu#111.nr_load_updates
    378.00 ± 77%    +464.0%       2132 ± 38%  sched_debug.cpu#111.ttwu_count
    740.50 ± 25%    +181.4%       2084 ± 87%  sched_debug.cpu#112.nr_switches
    741.50 ± 25%    +181.3%       2085 ± 87%  sched_debug.cpu#112.sched_count
    313.75 ± 27%    +203.7%     952.75 ± 96%  sched_debug.cpu#112.sched_goidle
    733.25 ± 41%     +84.6%       1353 ± 36%  sched_debug.cpu#115.nr_switches
    734.25 ± 41%     +84.5%       1354 ± 36%  sched_debug.cpu#115.sched_count
    322.00 ± 40%     +86.8%     601.50 ± 40%  sched_debug.cpu#115.sched_goidle
    808.50 ± 15%    +416.0%       4171 ± 57%  sched_debug.cpu#118.nr_switches
      1004 ± 34%    +315.4%       4173 ± 57%  sched_debug.cpu#118.sched_count
    348.25 ± 15%    +471.2%       1989 ± 60%  sched_debug.cpu#118.sched_goidle
     15394 ± 20%     -64.2%       5513 ± 60%  sched_debug.cpu#12.nr_switches
     15483 ± 20%     -64.4%       5515 ± 60%  sched_debug.cpu#12.sched_count
      7564 ± 21%     -64.8%       2665 ± 62%  sched_debug.cpu#12.sched_goidle
      7731 ± 19%     -32.4%       5229 ± 38%  sched_debug.cpu#12.ttwu_count
    782.75 ± 11%     -43.9%     438.75 ±  4%  sched_debug.cpu#12.ttwu_local
      1002 ±  5%     -62.6%     374.75 ± 25%  sched_debug.cpu#13.ttwu_local
     -0.25 ±-591%   +1500.0%      -4.00 ±-35%  sched_debug.cpu#14.nr_uninterruptible
    795.75 ±  9%     -46.3%     427.00 ±  9%  sched_debug.cpu#14.ttwu_local
     -3.00 ±-81%    -141.7%       1.25 ±228%  sched_debug.cpu#17.nr_uninterruptible
      4479 ± 30%     +29.2%       5787 ± 17%  sched_debug.cpu#18.ttwu_count
    335.00 ± 35%     -41.0%     197.50 ± 19%  sched_debug.cpu#18.ttwu_local
      9528 ± 57%    +159.3%      24709 ± 50%  sched_debug.cpu#2.nr_switches
      9621 ± 57%    +156.9%      24713 ± 50%  sched_debug.cpu#2.sched_count
      4569 ± 60%    +167.5%      12220 ± 50%  sched_debug.cpu#2.sched_goidle
      5817 ±  9%     +61.1%       9374 ± 29%  sched_debug.cpu#2.ttwu_count
     11.00 ± 21%     -56.8%       4.75 ±  9%  sched_debug.cpu#22.cpu_load[0]
     11.00 ± 21%     -56.8%       4.75 ±  9%  sched_debug.cpu#22.cpu_load[1]
     11.00 ± 21%     -56.8%       4.75 ±  9%  sched_debug.cpu#22.cpu_load[2]
     11.00 ± 21%     -56.8%       4.75 ±  9%  sched_debug.cpu#22.cpu_load[3]
     11.00 ± 21%     -56.8%       4.75 ±  9%  sched_debug.cpu#22.cpu_load[4]
      2778 ± 10%     -61.6%       1066 ± 43%  sched_debug.cpu#22.curr->pid
     10.75 ± 19%     -53.5%       5.00 ±  0%  sched_debug.cpu#22.load
     96429 ± 15%     -39.1%      58700 ± 10%  sched_debug.cpu#22.nr_load_updates
    281.75 ± 28%    +119.5%     618.50 ± 23%  sched_debug.cpu#22.ttwu_local
    842.75 ± 89%    +267.5%       3097 ± 44%  sched_debug.cpu#23.curr->pid
     72493 ± 15%     +39.1%     100851 ±  3%  sched_debug.cpu#24.nr_load_updates
     20.00 ± 17%     -45.0%      11.00 ± 45%  sched_debug.cpu#3.cpu_load[1]
     20.00 ± 17%     -45.0%      11.00 ± 45%  sched_debug.cpu#3.cpu_load[2]
     20.00 ± 17%     -46.2%      10.75 ± 43%  sched_debug.cpu#3.cpu_load[3]
     20.00 ± 17%     -46.2%      10.75 ± 43%  sched_debug.cpu#3.cpu_load[4]
      4116 ± 16%     -48.0%       2142 ± 59%  sched_debug.cpu#3.curr->pid
    127716 ±  3%     -26.1%      94370 ± 23%  sched_debug.cpu#3.nr_load_updates
    985032 ±  1%     -13.4%     852699 ±  5%  sched_debug.cpu#32.avg_idle
    253.25 ± 18%     +72.4%     436.50 ± 18%  sched_debug.cpu#35.ttwu_local
      3857 ± 13%     -36.0%       2470 ± 39%  sched_debug.cpu#36.curr->pid
      4029 ± 14%     -36.4%       2563 ± 35%  sched_debug.cpu#4.curr->pid
     10.75 ± 31%     -53.5%       5.00 ± 70%  sched_debug.cpu#42.load
     22.25 ± 10%     -65.2%       7.75 ± 73%  sched_debug.cpu#45.cpu_load[0]
     22.25 ± 10%     -65.2%       7.75 ± 73%  sched_debug.cpu#45.cpu_load[1]
     22.25 ± 10%     -65.2%       7.75 ± 73%  sched_debug.cpu#45.cpu_load[2]
     22.25 ± 10%     -65.2%       7.75 ± 73%  sched_debug.cpu#45.cpu_load[3]
     22.25 ± 10%     -65.2%       7.75 ± 73%  sched_debug.cpu#45.cpu_load[4]
      4517 ±  7%     -63.5%       1650 ± 91%  sched_debug.cpu#45.curr->pid
     27.25 ± 38%     -67.9%       8.75 ± 74%  sched_debug.cpu#45.load
    126272 ±  4%     -17.7%     103981 ±  2%  sched_debug.cpu#45.nr_load_updates
      2986 ± 50%    +268.2%      10993 ± 12%  sched_debug.cpu#45.nr_switches
      3060 ± 46%    +259.3%      10997 ± 12%  sched_debug.cpu#45.sched_count
      1349 ± 56%    +295.6%       5336 ± 13%  sched_debug.cpu#45.sched_goidle
      4670 ±  3%     +18.0%       5508 ±  6%  sched_debug.cpu#45.ttwu_count
    229.25 ± 11%     +90.9%     437.75 ± 16%  sched_debug.cpu#45.ttwu_local
     19.75 ± 18%     -55.7%       8.75 ± 62%  sched_debug.cpu#46.cpu_load[0]
     19.75 ± 18%     -55.7%       8.75 ± 62%  sched_debug.cpu#46.cpu_load[1]
     19.75 ± 18%     -54.4%       9.00 ± 61%  sched_debug.cpu#46.cpu_load[2]
     19.75 ± 18%     -54.4%       9.00 ± 61%  sched_debug.cpu#46.cpu_load[3]
     19.75 ± 18%     -55.7%       8.75 ± 62%  sched_debug.cpu#46.cpu_load[4]
     21.50 ± 12%     -54.7%       9.75 ± 60%  sched_debug.cpu#46.load
    118521 ±  1%     -25.9%      87824 ±  6%  sched_debug.cpu#46.nr_load_updates
      3312 ± 57%    +310.0%      13580 ± 52%  sched_debug.cpu#46.nr_switches
      3392 ± 54%    +300.5%      13585 ± 52%  sched_debug.cpu#46.sched_count
      1508 ± 62%    +339.1%       6624 ± 54%  sched_debug.cpu#46.sched_goidle
     21.75 ±  9%     -46.0%      11.75 ± 45%  sched_debug.cpu#47.cpu_load[4]
      4444 ± 12%     -49.7%       2235 ± 50%  sched_debug.cpu#47.curr->pid
    112219 ±  1%     -18.9%      91025 ± 18%  sched_debug.cpu#47.nr_load_updates
      3516 ± 60%    +371.4%      16575 ± 32%  sched_debug.cpu#47.nr_switches
      3560 ± 59%    +365.7%      16580 ± 32%  sched_debug.cpu#47.sched_count
      1631 ± 65%    +400.6%       8168 ± 33%  sched_debug.cpu#47.sched_goidle
      3937 ± 14%     +62.5%       6398 ± 20%  sched_debug.cpu#47.ttwu_count
    191.00 ± 18%    +189.0%     552.00 ± 14%  sched_debug.cpu#47.ttwu_local
    119687 ±  4%     -21.9%      93518 ±  5%  sched_debug.cpu#48.nr_load_updates
      2246 ± 83%    +352.0%      10153 ± 74%  sched_debug.cpu#49.sched_goidle
    197.75 ± 21%     +82.4%     360.75 ± 47%  sched_debug.cpu#49.ttwu_local
      4103 ± 26%     -63.9%       1482 ± 44%  sched_debug.cpu#5.curr->pid
     18.25 ± 24%     -58.9%       7.50 ± 33%  sched_debug.cpu#5.load
    113195 ±  4%     -21.4%      88966 ± 12%  sched_debug.cpu#5.nr_load_updates
    255.75 ± 29%     +37.4%     351.50 ± 22%  sched_debug.cpu#50.ttwu_local
      1848 ± 43%     +65.1%       3051 ± 35%  sched_debug.cpu#54.curr->pid
    257.75 ± 20%     +37.3%     354.00 ± 23%  sched_debug.cpu#54.ttwu_local
      3400 ± 25%     +67.6%       5698 ± 41%  sched_debug.cpu#55.ttwu_count
     82247 ±  3%     +12.2%      92289 ±  2%  sched_debug.cpu#56.nr_load_updates
      7470 ±118%    +216.4%      23636 ± 41%  sched_debug.cpu#56.nr_switches
      7527 ±117%    +214.0%      23638 ± 41%  sched_debug.cpu#56.sched_count
      3652 ±121%    +220.7%      11713 ± 41%  sched_debug.cpu#56.sched_goidle
      2864 ± 16%    +137.4%       6799 ± 50%  sched_debug.cpu#56.ttwu_count
      6.00 ± 28%    +108.3%      12.50 ± 20%  sched_debug.cpu#57.cpu_load[0]
      6.00 ± 28%    +108.3%      12.50 ± 20%  sched_debug.cpu#57.cpu_load[1]
      6.00 ± 28%    +108.3%      12.50 ± 20%  sched_debug.cpu#57.cpu_load[2]
      6.00 ± 28%    +108.3%      12.50 ± 20%  sched_debug.cpu#57.cpu_load[3]
      6.00 ± 28%    +108.3%      12.50 ± 20%  sched_debug.cpu#57.cpu_load[4]
      6.25 ± 34%    +100.0%      12.50 ± 20%  sched_debug.cpu#57.load
      2554 ± 28%     +94.0%       4955 ± 32%  sched_debug.cpu#57.ttwu_count
      4928 ± 54%    +373.3%      23326 ± 39%  sched_debug.cpu#58.nr_switches
      4962 ± 54%    +370.1%      23328 ± 39%  sched_debug.cpu#58.sched_count
      2388 ± 56%    +384.7%      11576 ± 39%  sched_debug.cpu#58.sched_goidle
      2382 ± 50%    +168.0%       6385 ± 30%  sched_debug.cpu#58.ttwu_count
      2857 ± 30%     -45.9%       1544 ± 66%  sched_debug.cpu#6.curr->pid
      3210 ± 42%     -74.7%     813.50 ± 32%  sched_debug.cpu#61.nr_switches
      4.00 ± 77%    -100.0%       0.00 ±  1%  sched_debug.cpu#61.nr_uninterruptible
      3212 ± 42%     -74.6%     815.25 ± 32%  sched_debug.cpu#61.sched_count
      1485 ± 46%     -76.2%     353.50 ± 36%  sched_debug.cpu#61.sched_goidle
    645.00 ± 24%     +97.9%       1276 ± 23%  sched_debug.cpu#62.nr_switches
    645.50 ± 24%     +97.9%       1277 ± 23%  sched_debug.cpu#62.sched_count
    277.00 ± 24%    +107.7%     575.25 ± 25%  sched_debug.cpu#62.sched_goidle
    142.25 ± 29%     +55.5%     221.25 ± 21%  sched_debug.cpu#62.ttwu_local
     43304 ±  1%     +44.5%      62557 ± 19%  sched_debug.cpu#66.nr_load_updates
      1942 ± 59%     -65.9%     662.50 ± 27%  sched_debug.cpu#68.nr_switches
      1943 ± 59%     -65.9%     662.75 ± 27%  sched_debug.cpu#68.sched_count
    871.75 ± 63%     -66.4%     292.75 ± 27%  sched_debug.cpu#68.sched_goidle
      2863 ±100%     -68.4%     905.75 ±121%  sched_debug.cpu#68.ttwu_count
    304.25 ± 11%     -48.9%     155.50 ± 47%  sched_debug.cpu#68.ttwu_local
      3742 ± 63%     -70.0%       1122 ± 17%  sched_debug.cpu#69.nr_switches
      3743 ± 63%     -70.0%       1123 ± 17%  sched_debug.cpu#69.sched_count
      1767 ± 67%     -72.4%     488.50 ± 16%  sched_debug.cpu#69.sched_goidle
    338.75 ±  8%     -34.8%     221.00 ± 27%  sched_debug.cpu#69.ttwu_local
      6904 ± 20%     -37.2%       4338 ± 23%  sched_debug.cpu#7.ttwu_count
      3540 ± 48%     -75.2%     877.00 ± 86%  sched_debug.cpu#70.ttwu_count
    545.75 ± 73%     -63.3%     200.50 ± 30%  sched_debug.cpu#70.ttwu_local
      1629 ± 14%     -50.8%     801.75 ± 39%  sched_debug.cpu#71.nr_switches
      1822 ± 27%     -56.0%     802.00 ± 39%  sched_debug.cpu#71.sched_count
    701.50 ± 14%     -49.4%     355.00 ± 38%  sched_debug.cpu#71.sched_goidle
    335.25 ± 21%     -52.0%     161.00 ± 35%  sched_debug.cpu#71.ttwu_local
      2889 ± 72%     -68.4%     914.25 ± 16%  sched_debug.cpu#72.nr_switches
      2889 ± 72%     -68.3%     915.25 ± 16%  sched_debug.cpu#72.sched_count
      1351 ± 77%     -69.8%     408.75 ± 15%  sched_debug.cpu#72.sched_goidle
      1367 ± 15%     -36.3%     871.25 ± 25%  sched_debug.cpu#73.nr_switches
      1368 ± 15%     -36.3%     872.00 ± 25%  sched_debug.cpu#73.sched_count
    595.25 ± 15%     -34.8%     388.25 ± 29%  sched_debug.cpu#73.sched_goidle
      4466 ±104%     -88.9%     497.75 ± 21%  sched_debug.cpu#73.ttwu_count
      2033 ± 20%     -55.1%     913.75 ± 33%  sched_debug.cpu#74.nr_switches
      2034 ± 20%     -55.1%     914.50 ± 33%  sched_debug.cpu#74.sched_count
    887.00 ± 25%     -54.1%     407.25 ± 33%  sched_debug.cpu#74.sched_goidle
    536.75 ± 47%     -63.2%     197.75 ± 26%  sched_debug.cpu#74.ttwu_local
    355.00 ± 21%     -25.7%     263.75 ±  3%  sched_debug.cpu#77.sched_goidle
     42672 ±  1%     +20.1%      51258 ± 15%  sched_debug.cpu#78.nr_load_updates
     30851 ± 46%     -73.6%       8131 ± 83%  sched_debug.cpu#8.nr_switches
      1.50 ±300%    -400.0%      -4.50 ±-24%  sched_debug.cpu#8.nr_uninterruptible
     30940 ± 46%     -73.7%       8134 ± 82%  sched_debug.cpu#8.sched_count
     15271 ± 46%     -74.0%       3967 ± 84%  sched_debug.cpu#8.sched_goidle
      0.75 ±404%     -66.7%       0.25 ±331%  sched_debug.cpu#83.nr_uninterruptible
     62144 ± 20%     -23.7%      47431 ± 17%  sched_debug.cpu#88.nr_load_updates
      3349 ± 60%     -76.1%     799.00 ± 25%  sched_debug.cpu#89.nr_switches
      3.75 ± 22%     -86.7%       0.50 ±100%  sched_debug.cpu#89.nr_uninterruptible
      3350 ± 60%     -76.1%     799.25 ± 25%  sched_debug.cpu#89.sched_count
      1579 ± 66%     -78.1%     346.50 ± 22%  sched_debug.cpu#89.sched_goidle
      5.00 ± 56%    +135.0%      11.75 ± 29%  sched_debug.cpu#9.cpu_load[2]
      5.00 ± 56%    +145.0%      12.25 ± 22%  sched_debug.cpu#9.cpu_load[3]
      4.75 ± 67%    +163.2%      12.50 ± 20%  sched_debug.cpu#9.cpu_load[4]
      7871 ± 17%     -39.6%       4756 ± 22%  sched_debug.cpu#9.ttwu_count
      1391 ± 55%     -58.6%     576.50 ± 11%  sched_debug.cpu#9.ttwu_local
    142.50 ± 15%    +122.6%     317.25 ± 66%  sched_debug.cpu#90.ttwu_local
     55305 ± 21%     -22.6%      42803 ±  0%  sched_debug.cpu#93.nr_load_updates
     67974 ± 14%     -37.5%      42516 ±  0%  sched_debug.cpu#95.nr_load_updates
      4.00 ± 30%     -75.0%       1.00 ± 70%  sched_debug.cpu#95.nr_uninterruptible
    299.50 ± 15%     +28.9%     386.00 ±  9%  sched_debug.cpu#95.sched_goidle
      3575 ± 72%     -89.5%     373.75 ±  9%  sched_debug.cpu#95.ttwu_count
    153.75 ± 12%     +36.6%     210.00 ± 11%  sched_debug.cpu#95.ttwu_local
     41155 ±  4%     +24.5%      51234 ± 16%  sched_debug.cpu#96.nr_load_updates
    353.25 ± 46%    +625.9%       2564 ± 42%  sched_debug.cpu#96.ttwu_count
     48865 ± 11%     -10.2%      43872 ±  4%  sched_debug.cpu#98.nr_load_updates


brickland1: Brickland Ivy Bridge-EX
Memory: 128G




                             pigz.time.minor_page_faults

  700000 ++-----------------------------------------------------------------+
         |                                                                  |
  600000 ++  .*..                 .*        .*..               *..          |
         *..*                .*.*.  +  .*..*    *.*..*.*..    +   *.        |
  500000 ++      *.*..*.*..*.        *.                   *..*      *..*    |
         |                                                                  |
  400000 ++                                                                 |
         |                                                                  |
  300000 ++                                                                 |
         |                                                                  |
  200000 ++                                                                 |
         |                                                                  |
  100000 O+ O O  O O  O O  O  O O  O O  O  O O  O O  O O  O  O O  O O  O O  O
         |                                                                  |
       0 ++-----------------------------------------------------------------+


                               time.minor_page_faults

  700000 ++-----------------------------------------------------------------+
         |                                                                  |
  600000 ++  .*..                 .*        .*..               *..          |
         *..*                .*.*.  +  .*..*    *.*..*.*..    +   *.        |
  500000 ++      *.*..*.*..*.        *.                   *..*      *..*    |
         |                                                                  |
  400000 ++                                                                 |
         |                                                                  |
  300000 ++                                                                 |
         |                                                                  |
  200000 ++                                                                 |
         |                                                                  |
  100000 O+ O O  O O  O O  O  O O  O O  O  O O  O O  O O  O  O O  O O  O O  O
         |                                                                  |
       0 ++-----------------------------------------------------------------+


                                  vmstat.system.in

  51000 ++------------------------------------------------------------------+
        |   .*..*              .*.*..            .*.  .*..                  |
  50000 *+.*     +  .*..*.*..*.      *.     .*.*.   *.    *.*..*..*.*..*    |
  49000 ++        *.                   *..*.                                |
        |                                                                   |
  48000 ++                                                                  |
        |                                                                   |
  47000 ++                                                                  |
        |                                                                   |
  46000 ++                                                                  |
  45000 ++                                                                  |
        |                                                                   |
  44000 ++ O O  O O  O  O O  O  O    O       O O    O     O O  O  O    O    O
        O                         O    O  O       O    O            O    O  |
  43000 ++------------------------------------------------------------------+


                                  proc-vmstat.pgfault

  1.5e+06 ++----------------------------------------------------------------+
          |                                                                 |
  1.4e+06 ++   *..                .*..        *.               *..          |
          *.. +                 .*     .*.. ..  *..*.*..*.    +   *.        |
  1.3e+06 ++ *    *.*..*.*..*.*.      *    *              *..*      *..*    |
          |                                                                 |
  1.2e+06 ++                                                                |
          |                                                                 |
  1.1e+06 ++                                                                |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   900000 O+   O  O      O  O    O O  O O     O O    O    O  O O  O O    O  |
          |  O      O  O      O            O       O    O              O    O
   800000 ++----------------------------------------------------------------+


	[*] bisect-good sample
	[O] bisect-bad  sample

To reproduce:

        git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Ying Huang

View attachment "job.yaml" of type "text/plain" (3209 bytes)

View attachment "reproduce" of type "text/plain" (8891 bytes)

Powered by blists - more mailing lists