lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <1423805855.5968.139.camel@intel.com>
Date:	Fri, 13 Feb 2015 13:37:35 +0800
From:	Huang Ying <ying.huang@...el.com>
To:	Jason Low <jason.low2@...com>
Cc:	Peter Zijlstra <peterz@...radead.org>,
	LKML <linux-kernel@...r.kernel.org>, LKP ML <lkp@...org>
Subject: [LKP] [mutex] 6aa15f5a2fe: -9.2% will-it-scale.per_process_ops

FYI, we noticed the below changes on

git://git.kernel.org/pub/scm/linux/kernel/git/peterz/queue.git locking/core
commit 6aa15f5a2febe058056180786bb39513ad5ae70d ("mutex: In mutex_spin_on_owner(), return true when owner changes")


testbox/testcase/testparams: wsm/will-it-scale/performance-writeseek3

afffc6c1805d98e0  6aa15f5a2febe058056180786b  
----------------  --------------------------  
         %stddev     %change         %stddev
             \          |                \  
  27329774 ±  5%     -98.7%     350559 ±  4%  will-it-scale.time.voluntary_context_switches
      1401 ±  4%    +340.4%       6172 ±  9%  will-it-scale.time.involuntary_context_switches
       402 ±  7%    +157.9%       1036 ±  0%  will-it-scale.time.system_time
       141 ±  6%    +146.3%        347 ±  0%  will-it-scale.time.percent_of_cpu_this_job_got
     28.29 ±  4%     -25.7%      21.01 ±  1%  will-it-scale.time.user_time
    777773 ±  0%      -9.2%     706114 ±  7%  will-it-scale.per_process_ops
   4995546 ± 11%     -99.4%      31990 ± 29%  sched_debug.cpu#11.sched_count
    332497 ±  9%     -87.9%      40257 ±  4%  softirqs.SCHED
      0.96 ± 20%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.hrtimer_try_to_cancel.hrtimer_cancel.tick_nohz_restart.tick_nohz_idle_exit.cpu_startup_entry
      0.99 ± 14%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.hrtimer_cancel.tick_nohz_restart.tick_nohz_idle_exit.cpu_startup_entry.start_secondary
      1.40 ±  3%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.dequeue_entity.dequeue_task_fair.dequeue_task.deactivate_task.__schedule
      1.36 ± 15%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.get_nohz_timer_target.__hrtimer_start_range_ns.hrtimer_start.tick_nohz_stop_sched_tick.__tick_nohz_idle_enter
      1.62 ±  4%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.pick_next_task_fair.__schedule.schedule_preempt_disabled.cpu_startup_entry.start_secondary
      1.69 ±  2%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.dequeue_task_fair.dequeue_task.deactivate_task.__schedule.schedule_preempt_disabled
     15.54 ± 32%    +351.5%      70.18 ±  2%  perf-profile.cpu-cycles.mutex_optimistic_spin.__mutex_lock_slowpath.mutex_lock.generic_file_write_iter.new_sync_write
      1.94 ±  3%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.dequeue_task.deactivate_task.__schedule.schedule_preempt_disabled.__mutex_lock_slowpath
      1.96 ±  4%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.deactivate_task.__schedule.schedule_preempt_disabled.__mutex_lock_slowpath.mutex_lock
      2.08 ± 11%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles._raw_spin_lock.try_to_wake_up.wake_up_process.__mutex_unlock_slowpath.mutex_unlock
     20.14 ± 10%     -82.3%       3.56 ± 34%  perf-profile.cpu-cycles.start_secondary
     20.04 ± 10%     -82.2%       3.56 ± 34%  perf-profile.cpu-cycles.cpu_startup_entry.start_secondary
      2.67 ±  8%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles._raw_spin_unlock_irqrestore.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit
   4495470 ±  7%     -99.4%      25868 ± 12%  sched_debug.cpu#9.nr_switches
   4496190 ±  7%     -99.4%      26052 ± 12%  sched_debug.cpu#9.sched_count
  40599.18 ± 41%    -100.0%       0.00 ±  0%  sched_debug.cfs_rq[6]:/.max_vruntime
      3.30 ±  8%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.__hrtimer_start_range_ns.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit.cpu_startup_entry
      3.33 ±  6%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.hrtimer_start_range_ns.tick_nohz_restart.tick_nohz_idle_exit.cpu_startup_entry.start_secondary
   2247155 ±  7%     -99.4%      12447 ± 14%  sched_debug.cpu#9.sched_goidle
  40599.18 ± 41%    -100.0%       0.00 ±  0%  sched_debug.cfs_rq[6]:/.MIN_vruntime
      3.99 ±  6%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles.__schedule.schedule_preempt_disabled.__mutex_lock_slowpath.mutex_lock.generic_file_write_iter
   2448071 ±  2%     -99.4%      13482 ±  9%  sched_debug.cpu#6.ttwu_count
   2554386 ±  2%     -99.5%      13020 ±  8%  sched_debug.cpu#6.sched_goidle
   5111673 ±  2%     -99.5%      26787 ±  8%  sched_debug.cpu#6.sched_count
   2527550 ±  6%     -99.5%      12538 ± 14%  sched_debug.cpu#9.ttwu_count
   5109913 ±  2%     -99.5%      26531 ±  8%  sched_debug.cpu#6.nr_switches
     54085 ± 37%    +845.7%     511463 ± 40%  sched_debug.cfs_rq[5]:/.min_vruntime
      8424 ± 16%    +560.9%      55678 ± 42%  sched_debug.cfs_rq[5]:/.exec_clock
   1201871 ± 19%     -83.0%     204673 ± 49%  sched_debug.cpu#5.sched_count
        10 ± 28%    +490.5%         62 ± 31%  sched_debug.cpu#5.cpu_load[4]
  93687275 ± 19%     -94.0%    5611171 ± 33%  cpuidle.C1-NHM.time
    558262 ± 18%     -96.2%      21169 ±  6%  cpuidle.C1-NHM.usage
 9.831e+08 ± 15%     -98.8%   11473350 ± 25%  cpuidle.C3-NHM.time
   3976387 ± 13%     -99.3%      26803 ±  6%  cpuidle.C3-NHM.usage
   1390481 ±  7%     -95.5%      63030 ±  4%  cpuidle.C6-NHM.usage
      0.92 ±  8%    -100.0%       0.00 ±  0%  perf-profile.cpu-cycles._raw_spin_lock_irqsave.try_to_wake_up.wake_up_process.__mutex_unlock_slowpath.mutex_unlock
   5406764 ±  9%     -99.3%      38661 ± 36%  sched_debug.cpu#8.nr_switches
  27329774 ±  5%     -98.7%     350559 ±  4%  time.voluntary_context_switches
   2702648 ±  9%     -99.3%      18971 ± 37%  sched_debug.cpu#8.sched_goidle
   5408351 ±  9%     -99.3%      38886 ± 36%  sched_debug.cpu#8.sched_count
     23.91 ± 12%     -99.1%       0.22 ± 40%  turbostat.CPU%c3
   1588237 ±  8%     -87.6%     197379 ± 28%  sched_debug.cpu#1.sched_goidle
        12 ± 21%    +400.0%         61 ± 31%  sched_debug.cpu#5.cpu_load[3]
        14 ± 15%    +324.6%         60 ± 30%  sched_debug.cpu#5.cpu_load[2]
   2804909 ±  4%     -99.5%      15331 ± 33%  sched_debug.cpu#11.ttwu_count
   2496582 ± 11%     -99.4%      14895 ± 31%  sched_debug.cpu#11.sched_goidle
   2449189 ±  2%     -99.2%      19646 ± 34%  sched_debug.cpu#8.ttwu_count
   2672337 ±  9%     -98.3%      44488 ± 29%  sched_debug.cpu#0.nr_switches
   4995012 ± 11%     -99.4%      31857 ± 29%  sched_debug.cpu#11.nr_switches
   1201660 ± 19%     -83.0%     204494 ± 49%  sched_debug.cpu#5.nr_switches
    955232 ± 15%     -85.7%     136563 ± 20%  sched_debug.cpu#4.ttwu_count
    995565 ± 13%     -86.3%     136302 ± 19%  sched_debug.cpu#4.sched_goidle
   1992443 ± 13%     -86.2%     274424 ± 19%  sched_debug.cpu#4.sched_count
   2673257 ±  9%     -98.3%      44671 ± 29%  sched_debug.cpu#0.sched_count
   1334237 ±  9%     -98.5%      20205 ± 32%  sched_debug.cpu#0.sched_goidle
   1354162 ±  5%     -98.3%      22809 ± 28%  sched_debug.cpu#0.ttwu_count
  26659.70 ± 14%    -100.0%       0.00 ±  0%  sched_debug.cfs_rq[9]:/.MIN_vruntime
   1992050 ± 13%     -86.2%     274292 ± 19%  sched_debug.cpu#4.nr_switches
     88563 ± 27%    +365.2%     411997 ± 25%  sched_debug.cfs_rq[3]:/.min_vruntime
  26659.70 ± 14%    -100.0%       0.00 ±  0%  sched_debug.cfs_rq[9]:/.max_vruntime
   1531974 ± 19%     -89.7%     157815 ± 23%  sched_debug.cpu#2.ttwu_count
   1650173 ± 16%     -90.5%     157023 ± 24%  sched_debug.cpu#2.sched_goidle
   2264230 ±  4%     -99.5%      12323 ±  7%  sched_debug.cpu#10.ttwu_count
   3177630 ±  8%     -87.5%     395822 ± 28%  sched_debug.cpu#1.nr_switches
   3302396 ± 16%     -90.4%     315490 ± 24%  sched_debug.cpu#2.sched_count
   4365273 ±  5%     -99.4%      24251 ±  6%  sched_debug.cpu#10.nr_switches
   3301465 ± 16%     -90.4%     315323 ± 24%  sched_debug.cpu#2.nr_switches
   4366326 ±  5%     -99.4%      24433 ±  6%  sched_debug.cpu#10.sched_count
   2182166 ±  5%     -99.5%      11526 ±  7%  sched_debug.cpu#10.sched_goidle
   1462067 ±  3%     -86.5%     197145 ± 29%  sched_debug.cpu#1.ttwu_count
   3178415 ±  8%     -87.5%     396013 ± 28%  sched_debug.cpu#1.sched_count
    145590 ± 45%    +280.1%     553319 ± 14%  sched_debug.cfs_rq[1]:/.min_vruntime
      1.14 ± 19%     -78.9%       0.24 ± 34%  perf-profile.cpu-cycles.shmem_file_llseek.sys_lseek.system_call_fastpath
     14.24 ±  4%     -82.6%       2.48 ± 43%  perf-profile.cpu-cycles.__mutex_unlock_slowpath.mutex_unlock.generic_file_write_iter.new_sync_write.vfs_write
     14.38 ±  4%     -82.2%       2.56 ± 41%  perf-profile.cpu-cycles.mutex_unlock.generic_file_write_iter.new_sync_write.vfs_write.sys_write
     98519 ± 38%    +276.0%     370400 ± 40%  sched_debug.cfs_rq[4]:/.min_vruntime
        12 ± 23%    +324.5%         52 ± 23%  sched_debug.cpu#3.cpu_load[4]
       148 ± 13%    +291.3%        582 ± 28%  sched_debug.cfs_rq[5]:/.tg_runnable_contrib
      6860 ± 12%    +288.6%      26657 ± 28%  sched_debug.cfs_rq[5]:/.avg->runnable_avg_sum
      1401 ±  4%    +340.4%       6172 ±  9%  time.involuntary_context_switches
    962541 ± 20%     -74.3%     247827 ± 22%  sched_debug.cpu#3.ttwu_count
  27121946 ± 39%    +207.6%   83418729 ± 41%  cpuidle.POLL.time
     13141 ± 10%    +248.4%      45786 ± 28%  sched_debug.cfs_rq[3]:/.exec_clock
    871810 ± 19%     -71.6%     247691 ± 22%  sched_debug.cpu#3.sched_goidle
   1744545 ± 19%     -71.5%     497212 ± 22%  sched_debug.cpu#3.nr_switches
   1744810 ± 19%     -71.5%     497350 ± 22%  sched_debug.cpu#3.sched_count
      8013 ± 48%    +177.9%      22273 ± 26%  sched_debug.cfs_rq[4]:/.avg->runnable_avg_sum
       175 ± 48%    +177.1%        485 ± 26%  sched_debug.cfs_rq[4]:/.tg_runnable_contrib
        19 ± 21%    +236.4%         64 ± 30%  sched_debug.cfs_rq[5]:/.runnable_load_avg
        18 ± 35%    +236.0%         63 ± 14%  sched_debug.cpu#1.cpu_load[4]
        18 ± 14%    +226.0%         59 ± 28%  sched_debug.cpu#5.cpu_load[1]
     20.76 ± 23%    +239.0%      70.38 ±  2%  perf-profile.cpu-cycles.__mutex_lock_slowpath.mutex_lock.generic_file_write_iter.new_sync_write.vfs_write
    152212 ± 36%    +234.5%     509104 ±  9%  sched_debug.cfs_rq[2]:/.min_vruntime
      7857 ± 13%    +193.3%      23042 ± 16%  sched_debug.cfs_rq[3]:/.avg->runnable_avg_sum
       171 ± 13%    +192.1%        501 ± 16%  sched_debug.cfs_rq[3]:/.tg_runnable_contrib
        14 ± 26%    +267.2%         53 ± 21%  sched_debug.cpu#3.cpu_load[3]
        18 ± 33%    +213.5%         58 ±  7%  sched_debug.cpu#2.cpu_load[4]
     23.57 ± 20%    +205.2%      71.91 ±  2%  perf-profile.cpu-cycles.mutex_lock.generic_file_write_iter.new_sync_write.vfs_write.sys_write
        20 ± 30%    +214.8%         63 ± 14%  sched_debug.cpu#1.cpu_load[3]
      2.08 ± 12%     -66.5%       0.70 ± 11%  perf-profile.cpu-cycles.sys_lseek.system_call_fastpath
      1.42 ± 15%     -73.2%       0.38 ± 22%  perf-profile.cpu-cycles.file_update_time.__generic_file_write_iter.generic_file_write_iter.new_sync_write.vfs_write
        18 ± 37%    +194.7%         55 ± 18%  sched_debug.cpu#3.cpu_load[2]
       740 ± 11%    +182.5%       2091 ± 17%  sched_debug.cpu#5.curr->pid
     21881 ± 23%    +163.3%      57608 ± 16%  sched_debug.cfs_rq[1]:/.exec_clock
    246670 ± 26%    +164.8%     653087 ±  5%  sched_debug.cfs_rq[8]:/.min_vruntime
    114092 ±  5%     -67.0%      37644 ±  5%  softirqs.RCU
        30 ± 30%    +125.6%         68 ± 15%  sched_debug.cpu#1.cpu_load[0]
        36 ± 44%    +132.7%         85 ± 19%  sched_debug.cfs_rq[0]:/.runnable_load_avg
        28 ± 16%    +163.7%         74 ±  5%  sched_debug.cpu#8.cpu_load[4]
       258 ± 22%    +139.6%        620 ±  9%  sched_debug.cfs_rq[1]:/.tg_runnable_contrib
     11830 ± 21%    +139.7%      28352 ±  9%  sched_debug.cfs_rq[1]:/.avg->runnable_avg_sum
        22 ± 27%    +185.6%         64 ± 13%  sched_debug.cpu#1.cpu_load[2]
    430107 ± 20%    +153.1%    1088393 ±  0%  softirqs.TIMER
        21 ± 21%    +178.6%         58 ±  7%  sched_debug.cpu#2.cpu_load[3]
        24 ± 19%    +144.3%         59 ± 26%  sched_debug.cpu#5.cpu_load[0]
       818 ± 29%    +131.7%       1895 ±  6%  sched_debug.cpu#3.curr->pid
     11124 ± 29%    +135.6%      26209 ±  5%  sched_debug.cfs_rq[2]:/.avg->runnable_avg_sum
        31 ± 13%    +141.9%         75 ±  5%  sched_debug.cpu#8.cpu_load[3]
       243 ± 29%    +134.7%        571 ±  5%  sched_debug.cfs_rq[2]:/.tg_runnable_contrib
        28 ± 20%    +142.6%         69 ± 13%  sched_debug.cpu#7.cpu_load[4]
       402 ±  7%    +157.9%       1036 ±  0%  time.system_time
       834 ± 18%    +152.6%       2108 ± 14%  sched_debug.cpu#1.curr->pid
      1.13 ±  8%     -59.6%       0.46 ±  3%  perf-profile.cpu-cycles.__sb_end_write.vfs_write.sys_write.system_call_fastpath
        30 ± 17%    +130.1%         70 ± 14%  sched_debug.cpu#7.cpu_load[3]
    253168 ± 22%    +141.0%     610051 ± 10%  sched_debug.cfs_rq[7]:/.min_vruntime
        26 ±  9%    +147.7%         66 ±  2%  sched_debug.cfs_rq[1]:/.runnable_load_avg
       141 ±  6%    +146.3%        347 ±  0%  time.percent_of_cpu_this_job_got
        25 ± 24%    +154.4%         65 ± 14%  sched_debug.cpu#1.cpu_load[1]
     31986 ± 39%    +129.0%      73256 ± 16%  sched_debug.cfs_rq[0]:/.exec_clock
      1.19 ± 11%     -53.6%       0.55 ±  3%  perf-profile.cpu-cycles.__sb_start_write.vfs_write.sys_write.system_call_fastpath
    215936 ± 21%    +135.4%     508378 ± 30%  sched_debug.cfs_rq[10]:/.min_vruntime
    233932 ± 23%    +100.7%     469477 ± 20%  sched_debug.cfs_rq[9]:/.min_vruntime
      0.93 ± 13%     -55.3%       0.41 ±  8%  perf-profile.cpu-cycles.__srcu_read_unlock.fsnotify.vfs_write.sys_write.system_call_fastpath
      1.23 ± 16%     -57.2%       0.53 ±  6%  perf-profile.cpu-cycles.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_write_begin.generic_perform_write
        32 ± 10%    +123.7%         73 ± 16%  sched_debug.cpu#7.cpu_load[2]
    187996 ± 37%    +213.3%     588915 ± 10%  sched_debug.cfs_rq[0]:/.min_vruntime
      1684 ±  8%     -59.5%        681 ± 19%  cpuidle.POLL.usage
      1.50 ± 14%     -56.7%       0.65 ±  7%  perf-profile.cpu-cycles.unlock_page.shmem_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
        35 ±  9%    +115.5%         76 ±  6%  sched_debug.cpu#8.cpu_load[2]
        30 ± 13%     +94.2%         58 ± 24%  sched_debug.cpu#10.cpu_load[4]
      3.56 ±  8%     -51.2%       1.74 ± 19%  perf-profile.cpu-cycles.shmem_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write
      7.42 ±  6%     -52.0%       3.56 ±  2%  perf-profile.cpu-cycles.copy_user_generic_string.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write
      3508 ± 17%    +104.5%       7174 ±  0%  sched_debug.cfs_rq[2]:/.tg->runnable_avg
      3508 ± 17%    +104.5%       7175 ±  0%  sched_debug.cfs_rq[3]:/.tg->runnable_avg
      3513 ± 17%    +104.3%       7177 ±  0%  sched_debug.cfs_rq[4]:/.tg->runnable_avg
      3516 ± 17%    +104.2%       7179 ±  0%  sched_debug.cfs_rq[5]:/.tg->runnable_avg
      3517 ± 17%    +104.2%       7181 ±  0%  sched_debug.cfs_rq[6]:/.tg->runnable_avg
      3520 ± 17%    +104.1%       7183 ±  0%  sched_debug.cfs_rq[7]:/.tg->runnable_avg
      3522 ± 17%    +104.0%       7184 ±  0%  sched_debug.cfs_rq[8]:/.tg->runnable_avg
      3524 ± 17%    +103.9%       7185 ±  0%  sched_debug.cfs_rq[9]:/.tg->runnable_avg
      2.21 ± 11%     -55.5%       0.98 ±  7%  perf-profile.cpu-cycles.find_lock_entry.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter
      3528 ± 17%    +103.7%       7186 ±  0%  sched_debug.cfs_rq[10]:/.tg->runnable_avg
      3532 ± 17%    +103.5%       7188 ±  0%  sched_debug.cfs_rq[11]:/.tg->runnable_avg
      3509 ± 17%    +104.5%       7177 ±  0%  sched_debug.cfs_rq[0]:/.tg->runnable_avg
      3513 ± 17%    +104.2%       7173 ±  0%  sched_debug.cfs_rq[1]:/.tg->runnable_avg
      3.50 ±  6%     -52.9%       1.65 ±  8%  perf-profile.cpu-cycles.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write
      2.96 ±  9%     -54.3%       1.35 ±  5%  perf-profile.cpu-cycles.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter
      1.33 ± 10%     -52.2%       0.64 ±  1%  perf-profile.cpu-cycles.system_call
      2.91 ±  6%     -49.0%       1.48 ± 13%  perf-profile.cpu-cycles.fsnotify.vfs_write.sys_write.system_call_fastpath
       968 ± 32%    +111.7%       2049 ± 11%  sched_debug.cpu#2.curr->pid
     22881 ± 17%    +125.4%      51569 ±  9%  sched_debug.cfs_rq[2]:/.exec_clock
     20.55 ±  4%     -50.4%      10.20 ±  3%  perf-profile.cpu-cycles.__generic_file_write_iter.generic_file_write_iter.new_sync_write.vfs_write.sys_write
        25 ± 16%    +131.7%         58 ±  7%  sched_debug.cpu#2.cpu_load[2]
     12228 ± 24%    +149.6%      30527 ±  9%  sched_debug.cfs_rq[0]:/.avg->runnable_avg_sum
       267 ± 24%    +149.2%        666 ±  8%  sched_debug.cfs_rq[0]:/.tg_runnable_contrib
     36965 ± 14%     +90.9%      70555 ±  6%  sched_debug.cfs_rq[8]:/.exec_clock
       974 ± 17%    +118.5%       2129 ±  7%  sched_debug.cpu#0.curr->pid
        33 ± 15%     +79.3%         60 ± 22%  sched_debug.cpu#10.cpu_load[3]
      1018 ± 10%     +86.4%       1898 ± 26%  sched_debug.cpu#10.curr->pid
       344 ± 20%     +92.7%        664 ±  9%  sched_debug.cfs_rq[7]:/.tg_runnable_contrib
     15780 ± 20%     +93.2%      30482 ±  9%  sched_debug.cfs_rq[7]:/.avg->runnable_avg_sum
      1.18 ±  6%     -50.1%       0.59 ±  6%  perf-profile.cpu-cycles.__srcu_read_lock.fsnotify.vfs_write.sys_write.system_call_fastpath
      1.36 ±  8%     -50.6%       0.67 ±  3%  perf-profile.cpu-cycles.system_call_after_swapgs
     17.36 ±  6%     -48.1%       9.00 ±  2%  perf-profile.cpu-cycles.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write.vfs_write
       348 ± 12%     +98.7%        691 ±  4%  sched_debug.cfs_rq[8]:/.tg_runnable_contrib
     15908 ± 12%     +99.2%      31685 ±  4%  sched_debug.cfs_rq[8]:/.avg->runnable_avg_sum
         2 ± 15%    +109.1%          5 ±  7%  vmstat.procs.r
        57 ± 18%     +76.6%        102 ± 26%  sched_debug.cfs_rq[0]:/.load
        39 ± 19%     +61.1%         63 ± 20%  sched_debug.cpu#10.cpu_load[2]
       979 ± 12%     +93.5%       1894 ± 19%  sched_debug.cpu#4.curr->pid
        36 ± 12%    +113.0%         77 ± 22%  sched_debug.cpu#7.cpu_load[1]
      2.58 ±  4%     -56.6%       1.12 ± 41%  perf-profile.cpu-cycles._raw_spin_lock.__mutex_unlock_slowpath.mutex_unlock.generic_file_write_iter.new_sync_write
        29 ± 20%     +89.9%         56 ± 19%  sched_debug.cpu#9.cpu_load[4]
       328 ± 16%     +66.5%        547 ± 15%  sched_debug.cfs_rq[9]:/.tg_runnable_contrib
        28 ± 21%     +67.5%         47 ± 43%  sched_debug.cpu#11.cpu_load[3]
     15011 ± 16%     +67.0%      25062 ± 15%  sched_debug.cfs_rq[9]:/.avg->runnable_avg_sum
      6.06 ± 27%     +64.2%       9.95 ±  3%  perf-profile.cpu-cycles.mutex_spin_on_owner.mutex_optimistic_spin.__mutex_lock_slowpath.mutex_lock.generic_file_write_iter
      1328 ±  8%     +72.3%       2288 ± 11%  sched_debug.cpu#6.curr->pid
      3035 ±  6%     -43.1%       1727 ±  0%  uptime.idle
        62 ± 19%     +64.1%        103 ± 26%  sched_debug.cpu#0.load
        27 ± 25%     +65.8%         46 ± 46%  sched_debug.cpu#11.cpu_load[4]
        30 ± 23%     +91.0%         58 ±  8%  sched_debug.cpu#2.cpu_load[1]
        33 ± 20%     +73.5%         57 ± 18%  sched_debug.cpu#9.cpu_load[3]
       335 ±  6%     +70.3%        570 ± 23%  sched_debug.cfs_rq[10]:/.tg_runnable_contrib
     15314 ±  6%     +70.7%      26147 ± 23%  sched_debug.cfs_rq[10]:/.avg->runnable_avg_sum
        43 ± 15%     +83.2%         79 ±  8%  sched_debug.cpu#8.cpu_load[1]
      1002 ± 29%     +96.0%       1964 ± 16%  sched_debug.cpu#9.curr->pid
        37 ± 26%     +56.3%         59 ± 16%  sched_debug.cpu#9.cpu_load[2]
     38074 ± 11%     +70.5%      64907 ± 14%  sched_debug.cfs_rq[7]:/.exec_clock
     35574 ± 12%     +37.3%      48848 ± 26%  sched_debug.cfs_rq[9]:/.exec_clock
      1446 ± 22%     +53.7%       2223 ± 10%  sched_debug.cpu#7.curr->pid
    303929 ±  8%     +49.3%     453870 ± 17%  sched_debug.cpu#9.avg_idle
     39159 ± 16%     +64.5%      64413 ± 14%  sched_debug.cpu#3.nr_load_updates
    487643 ± 21%     +71.0%     834025 ±  5%  sched_debug.cfs_rq[6]:/.min_vruntime
        45 ± 30%     +90.2%         87 ± 30%  sched_debug.cpu#7.cpu_load[0]
        55 ± 18%     +65.3%         91 ± 26%  sched_debug.cpu#1.load
     59.50 ±  5%     +43.1%      85.14 ±  2%  perf-profile.cpu-cycles.generic_file_write_iter.new_sync_write.vfs_write.sys_write.system_call_fastpath
     24882 ± 19%     +51.9%      37790 ±  7%  sched_debug.cfs_rq[6]:/.avg->runnable_avg_sum
       543 ± 19%     +51.8%        824 ±  7%  sched_debug.cfs_rq[6]:/.tg_runnable_contrib
     63.20 ±  5%     +38.4%      87.45 ±  3%  perf-profile.cpu-cycles.new_sync_write.vfs_write.sys_write.system_call_fastpath
      2.83 ±  3%     -31.4%       1.94 ± 14%  perf-profile.cpu-cycles.mutex_unlock.new_sync_write.vfs_write.sys_write.system_call_fastpath
      2391 ±  3%     +43.0%       3419 ±  1%  proc-vmstat.pgactivate
      1330 ± 33%     +71.0%       2275 ±  4%  sched_debug.cpu#8.curr->pid
     28.29 ±  4%     -25.7%      21.01 ±  1%  time.user_time
     31.42 ±  7%     -24.9%      23.60 ±  3%  turbostat.CPU%c1
     70.99 ±  4%     +28.4%      91.13 ±  2%  perf-profile.cpu-cycles.vfs_write.sys_write.system_call_fastpath
     72.19 ±  3%     +27.1%      91.74 ±  2%  perf-profile.cpu-cycles.sys_write.system_call_fastpath
     74.71 ±  3%     +24.0%      92.63 ±  2%  perf-profile.cpu-cycles.system_call_fastpath
      2766 ±  1%     +26.2%       3491 ±  0%  proc-vmstat.nr_shmem
     11068 ±  1%     +26.2%      13969 ±  0%  meminfo.Shmem
        54 ± 17%     +40.1%         76 ± 13%  sched_debug.cfs_rq[1]:/.load
        55 ± 32%     +43.0%         79 ± 13%  sched_debug.cfs_rq[8]:/.runnable_load_avg
      2690 ±  5%     -10.1%       2417 ±  2%  slabinfo.kmalloc-256.active_objs
        60 ±  1%     +10.4%         66 ±  2%  turbostat.CoreTmp
      6214 ±  2%      -7.0%       5777 ±  5%  slabinfo.vm_area_struct.num_objs
     24089 ±  4%      +9.4%      26356 ±  0%  meminfo.Active(anon)
      6024 ±  4%      +9.4%       6589 ±  0%  proc-vmstat.nr_active_anon
     17.44 ±  1%      -9.4%      15.80 ±  2%  turbostat.CPU%c6
   1064863 ± 12%     -13.3%     923694 ±  0%  cpuidle.C1E-NHM.usage
    378254 ±  4%     -97.0%      11409 ±  2%  vmstat.system.cs
     27.23 ± 16%    +121.7%      60.38 ±  1%  turbostat.%Busy
       959 ± 16%    +121.5%       2124 ±  1%  turbostat.Avg_MHz
      7791 ±  4%     +33.8%      10421 ±  0%  vmstat.system.in

wsm: Westmere
Memory: 6G




                                 time.system_time

  1100 ++-------------------------------------------------------------------+
       O  O O  O  O O  O  O O  O  O O  O  O O  O O  O  O O  O  O O  O  O O  O
  1000 ++                                                                   |
   900 ++                                                                   |
       |                                                                    |
   800 ++                                                                   |
       |                                                                    |
   700 ++              *                                                    |
       |              + :                                                   |
   600 ++            +  :                                                   |
   500 ++           *    :                                                  |
       |      .*.. +     :         .*..                    .*               |
   400 *+.*.*.    *       *.*..*..*    *..*.*..*.*..    .*.                 |
       |                                            *..*                    |
   300 ++-------------------------------------------------------------------+


                         time.percent_of_cpu_this_job_got

  350 O+-O-O--O--O-O--O--O--O-O--O--O-O--O--O-O--O--O-O--O--O--O-O--O--O-O--O
      |                                                                     |
      |                                                                     |
  300 ++                                                                    |
      |                                                                     |
      |                                                                     |
  250 ++              *                                                     |
      |              + :                                                    |
  200 ++            +  :                                                    |
      |            *    :                                                   |
      |           +     :                                                   |
  150 ++  .*..*..*       :   .*..  .*.  .*..               .*               |
      *..*               *..*    *.   *.    *.*..*..*.*..*.                 |
      |                                                                     |
  100 ++--------------------------------------------------------------------+


                            time.voluntary_context_switches

    3e+07 ++-----------------------------------------*----------------------+
          *..                              *..      +   *.*..               |
  2.5e+07 ++     .*.*..*.  .*.*..    .*. ..   *.*..*         *              |
          |  *.*.        *.      *.*.   *                                   |
          |                                                                 |
    2e+07 ++                                                                |
          |                                                                 |
  1.5e+07 ++                                                                |
          |                                                                 |
    1e+07 ++                                                                |
          |                                                                 |
          |                                                                 |
    5e+06 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                                   softirqs.SCHED

  450000 ++-----------------------------------------------------------------+
         |            *                                                     |
  400000 ++          + +                            .*                      |
  350000 ++         +   *..                      .*.  +      *              |
         |   .*..*.*           .*..*.*..*..  *..*      *.. ..               |
  300000 *+.*              *..*             +             *                 |
  250000 ++                                *                                |
         |                                                                  |
  200000 ++                                                                 |
  150000 ++                                                                 |
         |                                                                  |
  100000 ++                                                                 |
   50000 ++                                                                 |
         O  O O  O O  O O  O  O O  O O  O  O O  O O  O O  O  O O  O O  O O  O
       0 ++-----------------------------------------------------------------+


                                    softirqs.RCU

  130000 ++-----------------------------------------------------------------+
  120000 ++                          *..                     *              |
         | .*.  .*.*..         .*.. +   *..     *     .*.. ..               |
  110000 *+   *.           *..*    *       *   + +  .*    *                 |
  100000 ++           *. ..                 + +   *.                        |
         |              *                    *                              |
   90000 ++                                                                 |
   80000 ++                                                                 |
   70000 ++                                                                 |
         |                                                                  |
   60000 ++                                                                 |
   50000 ++                                                                 |
         |         O               O                                        |
   40000 O+ O O  O    O O  O  O O    O  O  O O    O  O O     O O  O O  O O  O
   30000 ++-------------------------------------O---------O-----------------+


                                cpuidle.C1-NHM.usage

  900000 ++-----------------------------------------------------------------+
         |                             .*       *.*                         |
  800000 ++           *.             *.  :     :   :                        |
  700000 ++          :  *..*..      :    :     :    :        *              |
         |           :              :     :   :     :       +               |
  600000 *+.*.*..   :         *.*..*      : .*       *     +                |
  500000 ++      *.*                       *          +  .*                 |
         |                                             *.                   |
  400000 ++                                                                 |
  300000 ++                                                                 |
         |                                                                  |
  200000 ++                                                                 |
  100000 ++                                                                 |
         |                      O  O O  O                                   |
       0 O+-O-O--O-O--O-O--O--O------------O-O--O-O--O-O--O--O-O--O-O--O-O--O


                                 cpuidle.C6-NHM.usage

  1.8e+06 ++----------------------------------------------------------------+
          |         *                 *.*..                                 |
  1.6e+06 *+. .*.. + +       .*..    +     *..  *..*        .*              |
  1.4e+06 ++ *    *   +     *    *. +          +    +    .*.                |
          |            *. ..       *          *      *..*                   |
  1.2e+06 ++             *                                                  |
    1e+06 ++                                                                |
          |                                                                 |
   800000 ++                                                                |
   600000 ++                                                                |
          |                                                                 |
   400000 ++                                                                |
   200000 ++                                                                |
          |    O    O              O            O         O              O  |
        0 O+-O----O----O-O--O-O--O----O-O--O--O----O-O--O----O-O--O-O--O----O


                          will-it-scale.time.system_time

  1100 ++-------------------------------------------------------------------+
       O  O O  O  O O  O  O O  O  O O  O  O O  O O  O  O O  O  O O  O  O O  O
  1000 ++                                                                   |
   900 ++                                                                   |
       |                                                                    |
   800 ++                                                                   |
       |                                                                    |
   700 ++              *                                                    |
       |              + :                                                   |
   600 ++            +  :                                                   |
   500 ++           *    :                                                  |
       |      .*.. +     :         .*..                    .*               |
   400 *+.*.*.    *       *.*..*..*    *..*.*..*.*..    .*.                 |
       |                                            *..*                    |
   300 ++-------------------------------------------------------------------+


                  will-it-scale.time.percent_of_cpu_this_job_got

  350 O+-O-O--O--O-O--O--O--O-O--O--O-O--O--O-O--O--O-O--O--O--O-O--O--O-O--O
      |                                                                     |
      |                                                                     |
  300 ++                                                                    |
      |                                                                     |
      |                                                                     |
  250 ++              *                                                     |
      |              + :                                                    |
  200 ++            +  :                                                    |
      |            *    :                                                   |
      |           +     :                                                   |
  150 ++  .*..*..*       :   .*..  .*.  .*..               .*               |
      *..*               *..*    *.   *.    *.*..*..*.*..*.                 |
      |                                                                     |
  100 ++--------------------------------------------------------------------+


                     will-it-scale.time.voluntary_context_switches

    3e+07 ++-----------------------------------------*----------------------+
          *..                              *..      +   *.*..               |
  2.5e+07 ++     .*.*..*.  .*.*..    .*. ..   *.*..*         *              |
          |  *.*.        *.      *.*.   *                                   |
          |                                                                 |
    2e+07 ++                                                                |
          |                                                                 |
  1.5e+07 ++                                                                |
          |                                                                 |
    1e+07 ++                                                                |
          |                                                                 |
          |                                                                 |
    5e+06 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                                  vmstat.system.cs

  450000 ++-----------------------------------------------------------------+
         *..                                                                |
  400000 ++ *    *.*..        *.*.. .*..        *.    .*..*..*              |
  350000 ++  + ..           ..     *    *..   ..  *..*                      |
         |    *       *    *               *.*                              |
  300000 ++            + ..                                                 |
  250000 ++             *                                                   |
         |                                                                  |
  200000 ++                                                                 |
  150000 ++                                                                 |
         |                                                                  |
  100000 ++                                                                 |
   50000 ++                                                                 |
         |                                                                  |
       0 O+-O-O--O-O--O-O--O--O-O--O-O--O--O-O--O-O--O-O--O--O-O--O-O--O-O--O


                             sched_debug.cpu#0.nr_switches

  3.5e+06 ++-----------------------*----------------------------------------+
          |                      *  +                                       |
    3e+06 *+.      .*..     *. ..    +     *..           .*..               |
          |  *    *        +  *       *. ..    .*..     *                   |
  2.5e+06 ++  + ..     *. +             *     *    *. ..     *              |
          |    *         *                           *                      |
    2e+06 ++                                                                |
          |                                                                 |
  1.5e+06 ++                                                                |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#0.sched_count

  3.5e+06 ++-----------------------*----------------------------------------+
          |                      *  +                                       |
    3e+06 *+.      .*..     *. ..    +     *..           .*..               |
          |  *    *        +  *       *. ..    .*..    .*                   |
  2.5e+06 ++  + ..     *. +             *     *    *.*.      *              |
          |    *         *                                                  |
    2e+06 ++                                                                |
          |                                                                 |
  1.5e+06 ++                                                                |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                            sched_debug.cpu#0.sched_goidle

  1.8e+06 ++----------------------------------------------------------------+
          |                      *.*..                                      |
  1.6e+06 *+.                   +          *..           .*..               |
  1.4e+06 ++ *    *.*..     *. +      *. ..    .*..     *                   |
          |   + ..     *   +  *         *     *       ..     *              |
  1.2e+06 ++   *        + +                        *.*                      |
    1e+06 ++             *                                                  |
          |                                                                 |
   800000 ++                                                                |
   600000 ++                                                                |
          |                                                                 |
   400000 ++                                                                |
   200000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#0.ttwu_count

  1.8e+06 ++-----------------------*----------------------------------------+
          |                       : +                                       |
  1.6e+06 ++                      :  +                                      |
  1.4e+06 *+.     *.        *.*..*    *    *..  *..    .*.*..*              |
          |  *   +  *..*   +           + ..    +    .*.                     |
  1.2e+06 ++  + +       + +             *     *    *                        |
    1e+06 ++   *         *                                                  |
          |                                                                 |
   800000 ++                                                                |
   600000 ++                                                                |
          |                                                                 |
   400000 ++                                                                |
   200000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#1.nr_switches

    4e+06 *+----------------------------------------------------------------+
          |:                                                                |
  3.5e+06 ++:                     .*..                 .*.                  |
    3e+06 ++:    .*.*..       *..*    *           .*.*.   *..               |
          |  *.*.            +         +     .*.*.           *              |
  2.5e+06 ++           *.  .*           *..*.                               |
          |              *.                                                 |
    2e+06 ++                                                                |
          |                                                                 |
  1.5e+06 ++                                                                |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++ O    O    O                      O    O         O      O       |
          O    O    O    O  O O  O O  O O  O    O    O  O O    O  O    O O  O
        0 ++----------------------------------------------------------------+


                             sched_debug.cpu#1.sched_count

    4e+06 *+----------------------------------------------------------------+
          |:                                                                |
  3.5e+06 ++:                     .*..                 .*.                  |
    3e+06 ++:    .*.*..       *..*    *           .*.*.   *..               |
          |  *.*.            +         +     .*.*.           *              |
  2.5e+06 ++           *.  .*           *..*.                               |
          |              *.                                                 |
    2e+06 ++                                                                |
          |                                                                 |
  1.5e+06 ++                                                                |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++ O    O    O                      O    O         O      O       |
          O    O    O    O  O O  O O  O O  O    O    O  O O    O  O    O O  O
        0 ++----------------------------------------------------------------+


                            sched_debug.cpu#1.sched_goidle

    2e+06 *+----------------------------------------------------------------+
  1.8e+06 ++                                                                |
          | :                     .*..                 .*.                  |
  1.6e+06 ++:    .*.*..       *..*    *           .*.*.   *..               |
  1.4e+06 ++ *.*.            +         +     .*.*.           *              |
          |            *.  .*           *..*.                               |
  1.2e+06 ++             *.                                                 |
    1e+06 ++                                                                |
   800000 ++                                                                |
          |                                                                 |
   600000 ++                                                                |
   400000 ++                                                                |
          |  O    O    O                      O    O         O      O       |
   200000 O+   O    O    O  O O  O O  O O  O    O    O  O O    O  O    O O  O
        0 ++----------------------------------------------------------------+


                             sched_debug.cpu#1.ttwu_count

  1.8e+06 ++----------------------------------------------------------------+
          *..                                                               |
  1.6e+06 ++      *.*..       *..*.*..*                .*.                  |
  1.4e+06 ++ *. ..           +         +  .*.. .*..*.*.   *..*              |
          |    *       *.  .*           *.    *                             |
  1.2e+06 ++             *.                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   800000 ++                                                                |
   600000 ++                                                                |
          |                                                                 |
   400000 ++                                  O                             |
   200000 ++ O O  O    O    O         O            O         O      O    O  O
          O         O    O    O  O O    O  O    O    O  O O    O  O    O    |
        0 ++----------------------------------------------------------------+


                             sched_debug.cpu#2.nr_switches

  4.5e+06 ++----------------------------------------------------------------+
          |                                                  *              |
    4e+06 ++                                               ..               |
  3.5e+06 ++                                              *                 |
          | .*     .*..*    *     .*.. .*..*.. .*..      +                  |
    3e+06 *+  :   *     :  + +  .*    *       *    *.  .*                   |
  2.5e+06 ++  : ..      : +   *.                     *.                     |
          |    *         *                                                  |
    2e+06 ++                                                                |
  1.5e+06 ++                                                                |
          |                                                                 |
    1e+06 ++                                                                |
   500000 ++   O    O    O    O       O              O         O            |
          O  O         O    O    O O    O  O    O  O    O O  O    O O  O O  O
        0 ++------O---------------------------O-----------------------------+


                             sched_debug.cpu#2.sched_count

  4.5e+06 ++----------------------------------------------------------------+
          |                                                  *              |
    4e+06 ++                                               ..               |
  3.5e+06 ++                                              *                 |
          | .*     .*..*    *     .*.. .*..*.. .*..      +                  |
    3e+06 *+  :   *     :  + +  .*    *       *    *.  .*                   |
  2.5e+06 ++  : ..      : +   *.                     *.                     |
          |    *         *                                                  |
    2e+06 ++                                                                |
  1.5e+06 ++                                                                |
          |                                                                 |
    1e+06 ++                                                                |
   500000 ++   O    O    O    O       O              O         O            |
          O  O         O    O    O O    O  O    O  O    O O  O    O O  O O  O
        0 ++------O---------------------------O-----------------------------+


                            sched_debug.cpu#2.sched_goidle

  2.2e+06 ++----------------------------------------------------------------+
    2e+06 ++                                                 *              |
          |                                                ..               |
  1.8e+06 ++        *..                                  .*                 |
  1.6e+06 ++.*     +   *    *     .*.. .*..*.. .*..     *                   |
  1.4e+06 *+  +  .*     :  + +  .*    *       *    *. ..                    |
  1.2e+06 ++   *.       : +   *.                     *                      |
          |              *                                                  |
    1e+06 ++                                                                |
   800000 ++                                                                |
   600000 ++                                                                |
   400000 ++                                                                |
          |    O    O    O    O       O              O         O            |
   200000 O+ O         O    O    O O    O  O  O O  O    O O  O    O O  O O  O
        0 ++------O---------------------------------------------------------+


                             sched_debug.cpu#2.ttwu_count

    2e+06 ++-------------------------------------------------*--------------+
  1.8e+06 ++                                                +               |
          |         *..                                    +                |
  1.6e+06 *+.      :   *    *.    .*..          *..      .*                 |
  1.4e+06 ++ *     :    :  +  *..*    *.*..*.. +   *    *                   |
          |   +  .*     : +                   *     + ..                    |
  1.2e+06 ++   *.        *                           *                      |
    1e+06 ++                                                                |
   800000 ++                                                                |
          |                                                                 |
   600000 ++                                                                |
   400000 ++                                                                |
          |    O    O    O    O       O              O         O            |
   200000 O+ O         O    O    O O    O  O  O O  O    O O  O    O O  O O  O
        0 ++------O---------------------------------------------------------+


                            sched_debug.cpu#6.nr_switches

  6e+06 ++--------*---------------------------------------------------------+
        | .*     : :                   *..                                  |
  5e+06 *+  :    : :           .*     +               .*..*.*               |
        |   :  .*   :        *.  :   *    *    *..*.*.                      |
        |    *.     :       +    : ..      :   :                            |
  4e+06 ++           : .*. +      *         : :                             |
        |            *.   *                 : :                             |
  3e+06 ++                                   *                              |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                            sched_debug.cpu#6.sched_count

  6e+06 ++--------*---------------------------------------------------------+
        | .*     : :                   *..                                  |
  5e+06 *+  :    : :           .*     +               .*..*.*               |
        |   :  .*   :        *.  :   *    *    *..*.*.                      |
        |    *.     :       +    : ..      :   :                            |
  4e+06 ++           : .*. +      *         : :                             |
        |            *.   *                 : :                             |
  3e+06 ++                                   *                              |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                            sched_debug.cpu#6.sched_goidle

    3e+06 ++--------*-------------------------------------------------------+
          | .*     : :                  *..                                 |
  2.5e+06 *+  :    : :          .*     +               .*.*..*              |
          |   :  .*   :       *.  :   *    *    *..*.*.                     |
          |    *.     :      :    : ..      :   :                           |
    2e+06 ++           :.*.. :     *         : :                            |
          |            *    *                : :                            |
  1.5e+06 ++                                  *                             |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#6.ttwu_count

    3e+06 ++----------------------------------------------------------------+
          |        .*         *..                                           |
  2.5e+06 *+.     *  :        :        .*..              .*..*              |
          |  *   +    :      :   *    *         *..*.*..*                   |
          |   + +     :      :    + ..     *    :                           |
    2e+06 ++   *       *.*.. :     *        +  :                            |
          |                 :                + :                            |
  1.5e+06 ++                *                 *                             |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                            sched_debug.cpu#7.nr_switches

  6e+06 ++------------------------------------------------------------------+
        |       *.*          *..    .*.                    .*               |
  5e+06 *+.*   +   :        :    .*.   *..     *.. .*..*..*                 |
        |   + +     :       :   *         *    :  *                         |
        |    *      :      :               +  :                             |
  4e+06 ++           *..*. :                + :                             |
        |                 *                  *                              |
  3e+06 ++                                                                  |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                              O    |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O----O--O


                            sched_debug.cpu#7.sched_count

  6e+06 ++------------------------------------------------------------------+
        |       *.*          *..    .*.                    .*               |
  5e+06 *+.*   +   :        :    .*.   *..     *.. .*..*..*                 |
        |   + +     :       :   *         *    :  *                         |
        |    *      :      :               +  :                             |
  4e+06 ++           *..*. :                + :                             |
        |                 *                  *                              |
  3e+06 ++                                                                  |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                              O    |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O----O--O


                            sched_debug.cpu#7.sched_goidle

    3e+06 ++----------------------------------------------------------------+
          |       *.*         *..    .*.                    .*              |
  2.5e+06 *+.*   +   :        :   .*.   *..     *.. .*..*.*.                |
          |   + +     :      :   *         *    :  *                        |
          |    *      :      :              +  :                            |
    2e+06 ++           *.*..:                + :                            |
          |                 *                 *                             |
  1.5e+06 ++                                                                |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
          |                                                                 |
   500000 ++                                                                |
          |                                                            O    |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O----O--O


                             sched_debug.cpu#7.ttwu_count

  3.5e+06 ++----------------------------------------------------------------+
          |                                                                 |
    3e+06 ++.*                                                              |
          *.  :   *.*           .*.  .*.*..              .*..               |
  2.5e+06 ++  :  +   +        *.   *.      *    *..*.*..*    *              |
          |    :+     +      :              :   :                           |
    2e+06 ++   *       *.*.. :               : :                            |
          |                 *                : :                            |
  1.5e+06 ++                                  *                             |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                            sched_debug.cpu#8.nr_switches

  7e+06 ++------------------------------------------------------------------+
        |       *            *                                              |
  6e+06 ++     : :          : +                       .*..                  |
        *..    : :          :  +      .*..     *..  *.                      |
  5e+06 ++ *  :   *..      :    *.  .*         :   +      *.                |
        |   + :        .*. :      *.      *.. :   *         *               |
  4e+06 ++   *       *.   *                   :                             |
        |                                    *                              |
  3e+06 ++                                                                  |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                            sched_debug.cpu#8.sched_count

  7e+06 ++------------------------------------------------------------------+
        |       *            *                                              |
  6e+06 ++     : :          : +                       .*..                  |
        *..    : :          :  +      .*..     *..  *.                      |
  5e+06 ++ *  :   *..      :    *.  .*         :   +      *.                |
        |   + :        .*. :      *.      *.. :   *         *               |
  4e+06 ++   *       *.   *                   :                             |
        |                                    *                              |
  3e+06 ++                                                                  |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                            sched_debug.cpu#8.sched_goidle

  3.5e+06 ++----------------------------------------------------------------+
          |       *           *                                             |
    3e+06 ++     : :          :+                       .*                   |
          *..    : :         :  +      .*..     *..  *.  +                  |
  2.5e+06 ++ *  :   *..      :   *.  .*         :   +     *..               |
          |   + :       .*..:      *.      *.. :   *         *              |
    2e+06 ++   *       *    *                  :                            |
          |                                   *                             |
  1.5e+06 ++                                                                |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#8.ttwu_count

    3e+06 ++----------------------------------------------------------------+
          *..                                                               |
  2.5e+06 ++      *.          *..*    *.               .*.                  |
          |  *   +  *..       :   + ..  *..*    *..*.*.   *..*              |
          |   + +       .*.. :     *        :   :                           |
    2e+06 ++   *       *     :               : :                            |
          |                 *                : :                            |
  1.5e+06 ++                                  *                             |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#9.ttwu_count

    3e+06 ++----------------------------------------------------------------+
          *..       *                                    .*..               |
  2.5e+06 ++ *     + :        *..      .*..     *    *..*                   |
          |   :   *  :        :      .*         :+  :        *              |
          |   : ..    :  *.. :   *.*.      *   :  + :                       |
    2e+06 ++   *      : :    :              :  :   *                        |
          |            ::   *                : :                            |
  1.5e+06 ++           *                     ::                             |
          |                                   *                             |
    1e+06 ++                                                                |
          |                                                                 |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                           sched_debug.cpu#10.nr_switches

  6e+06 ++------------------------------------------------------------------+
        *                                                                   |
  5e+06 ++                     .*.  .*.*..     *..                          |
        | +      .*          *.   *.      *    :      .*.. .*               |
        |  *.*..*  :        :              :  :   *.*.    *                 |
  4e+06 ++          :   *   :              :  :                             |
        |           : .. + :                : :                             |
  3e+06 ++           *    *                 ::                              |
        |                                    *                              |
  2e+06 ++                                                                  |
        |                                                                   |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                           sched_debug.cpu#10.sched_count

  6e+06 ++------------------------------------------------------------------+
        *                                                                   |
  5e+06 ++                     .*.  .*.*..     *..                          |
        | +      .*          *.   *.      *    :      .*.. .*               |
        |  *.*..*  :        :              :  :   *.*.    *                 |
  4e+06 ++          :   *   :              :  :                             |
        |           : .. + :                : :                             |
  3e+06 ++           *    *                 ::                              |
        |                                    *                              |
  2e+06 ++                                                                  |
        |                                                                   |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                            sched_debug.cpu#10.sched_goidle

    3e+06 ++----------------------------------------------------------------+
          *                                                                 |
  2.5e+06 ++                    .*.  .*.*..     *..                         |
          | +      .*         *.   *.      *    :      .*.  .*              |
          |  *.*..*  :        :             :  :   *.*.   *.                |
    2e+06 ++          :  *.. :              :  :                            |
          |           : +    :               : :                            |
  1.5e+06 ++           *    *                ::                             |
          |                                   *                             |
    1e+06 ++                                                                |
          |                                                                 |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#10.ttwu_countTO: 
CC: 
CC: 
CC: 



    3e+06 ++-*--------------------------------------------------------------+
          *. :                                                              |
  2.5e+06 ++  :                 .*.        *                                |
          |   :               *.   *..*. .. :   *..*.  .*.*..*              |
          |    : .*.*    *    :         *   :   :    *.                     |
    2e+06 ++   *.    +  : +  :               : :                            |
          |           + :  + :               : :                            |
  1.5e+06 ++           *    *                 *                             |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                           sched_debug.cpu#11.nr_switches

  7e+06 ++------------------------------------------------------------------+
        |                                                                   |
  6e+06 *+.*                                              *                 |
        |  :                 *..*.             *..       + +                |
  5e+06 ++  :    .*         :     *..*.*..*    :  *.    +   *               |
        |   :   *  +    *   :              :  :     *..*                    |
  4e+06 ++  :  +    + .. + :                : :                             |
        |    :+      *    *                 ::                              |
  3e+06 ++   *                               *                              |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                           sched_debug.cpu#11.sched_count

  7e+06 ++------------------------------------------------------------------+
        |                                                                   |
  6e+06 *+.*                                              *                 |
        |  :                 *..*.             *..       + +                |
  5e+06 ++  :    .*         :     *..*.*..*    :  *.    +   *               |
        |   :   *  +    *   :              :  :     *..*                    |
  4e+06 ++  :  +    + .. + :                : :                             |
        |    :+      *    *                 ::                              |
  3e+06 ++   *                               *                              |
        |                                                                   |
  2e+06 ++                                                                  |
        |                                                                   |
  1e+06 ++                                                                  |
        |                                                                   |
      0 O+-O-O--O-O--O--O-O--O--O-O--O-O--O--O-O--O-O--O--O-O--O--O-O--O-O--O


                            sched_debug.cpu#11.sched_goidle

  3.5e+06 ++----------------------------------------------------------------+
          |                                                                 |
    3e+06 *+.*                                            *..               |
          |  :                *..*.             *..      :                  |
  2.5e+06 ++  :    .*         :    *..*.*..*    :  *.    :   *              |
          |   :   *  +   *.. :              :  :     *..*                   |
    2e+06 ++  :  +    + +    :               : :                            |
          |    :+      *    *                ::                             |
  1.5e+06 ++   *                              *                             |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O


                             sched_debug.cpu#11.ttwu_count

  3.5e+06 ++----------------------------------------------------------------+
          |        .*                                                       |
    3e+06 *+.     * :                                    .*..               |
          |      :   :        *..*.     *..     *.. .*..*    *              |
  2.5e+06 ++ *   :   :       :     *.. +   *    :  *                        |
          |   + :     :  *.. :        *     +  :                            |
    2e+06 ++   *      : :   *                + :                            |
          |            ::                     *                             |
  1.5e+06 ++           *                                                    |
          |                                                                 |
    1e+06 ++                                                                |
          |                                                                 |
   500000 ++                                                                |
          |                                                                 |
        0 O+-O-O--O-O--O-O--O-O--O-O--O-O--O--O-O--O-O--O-O--O-O--O-O--O-O--O

        [*] bisect-good sample
        [O] bisect-bad  sample

To reproduce:

        apt-get install ruby
        git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
        cd lkp-tests
        bin/setup-local job.yaml # the job file attached in this email
        bin/run-local   job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Fengguang




View attachment "job.yaml" of type "text/plain" (1645 bytes)

View attachment "reproduce" of type "text/plain" (41 bytes)

_______________________________________________
LKP mailing list
LKP@...ux.intel.com

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ