lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date:	Mon, 14 Mar 2016 10:14:37 +0800
From:	kernel test robot <xiaolong.ye@...el.com>
To:	Ville Syrjälä <ville.syrjala@...ux.intel.com>
Cc:	Jani Nikula <jani.nikula@...el.com>,
	LKML <linux-kernel@...r.kernel.org>, lkp@...org
Subject: [lkp] [drm/i915] 0bbca274a3: 3.6% piglit.time.elapsed_time

FYI, we noticed that piglit.time.elapsed_time 3.6% regression on

https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
commit 0bbca274a31c2366414d8d3f95e03d1c4674d93f ("drm/i915: Actually retry with bit-banging after GMBUS timeout")


=========================================================================================
compiler/group/kconfig/rootfs/tbox_group/testcase:
  gcc-4.9/igt-039/x86_64-rhel/debian-x86_64-2015-02-07.cgz/snb-black/piglit

commit: 
  2f791908a70e95768596f5bb9e6de4f441d7bf13
  0bbca274a31c2366414d8d3f95e03d1c4674d93f

2f791908a70e9576 0bbca274a31c2366414d8d3f95 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    188.79 ±  0%      +3.6%     195.58 ±  0%  piglit.time.elapsed_time
    188.79 ±  0%      +3.6%     195.58 ±  0%  piglit.time.elapsed_time.max
      5.00 ±  0%     +60.0%       8.00 ±  0%  piglit.time.percent_of_cpu_this_job_got
      7.86 ±  0%     +83.5%      14.42 ±  0%  piglit.time.system_time
      5.00 ±  0%     +60.0%       8.00 ±  0%  time.percent_of_cpu_this_job_got
      7.86 ±  0%     +83.5%      14.42 ±  0%  time.system_time

=========================================================================================
compiler/group/kconfig/rootfs/tbox_group/testcase:
  gcc-4.9/igt-036/x86_64-rhel/debian-x86_64-2015-02-07.cgz/lkp-u410/piglit

commit: 
  2f791908a70e95768596f5bb9e6de4f441d7bf13
  0bbca274a31c2366414d8d3f95e03d1c4674d93f

2f791908a70e9576 0bbca274a31c2366414d8d3f95 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    141.15 ±  0%      +6.9%     150.94 ±  0%  piglit.time.elapsed_time
    141.15 ±  0%      +6.9%     150.94 ±  0%  piglit.time.elapsed_time.max
     10.00 ±  0%     +60.0%      16.00 ±  0%  piglit.time.percent_of_cpu_this_job_got
     10.61 ±  0%     +88.8%      20.04 ±  0%  piglit.time.system_time
     10.00 ±  0%     +60.0%      16.00 ±  0%  time.percent_of_cpu_this_job_got
     10.61 ±  0%     +88.8%      20.04 ±  0%  time.system_time


snb-black: Sandy Bridge
Memory: 8G

lkp-u410: Ivy Bridge
Memory: 4G



                             piglit.time.system_time

  21 ++---------------------------------------------------------------------+
  20 O+ O  O  O  O  O  O  O  O  O  O  O  O O  O  O  O  O  O  O  O  O  O     |
     |                                                                      |
  19 ++                                                                     |
  18 ++                                                                     |
  17 ++                                                                     |
  16 ++                                                                     |
     |                                                                      |
  15 ++                                                                     |
  14 ++                                                                     |
  13 ++                                                                     |
  12 ++                                                                     |
     |                                                                      |
  11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
  10 ++---------------------------------------------------------------------+


                     piglit.time.percent_of_cpu_this_job_got

  16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
     |                                                                      |
  15 ++                                                                     |
     |                                                                      |
     |                                                                      |
  14 ++                                                                     |
     |                                                                      |
  13 ++                                                                     |
     |                                                                      |
  12 ++                                                                     |
     |                                                                      |
     |                                                                      |
  11 *+.                  *..         *..           *..                     |
     |                  ..          ..            ..                        |
  10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*


                             piglit.time.elapsed_time

  152 ++--------------------------------------------------------------------+
      |  O  O  O  O  O  O O  O  O  O  O  O  O  O  O  O  O  O O  O  O  O     |
  150 O+                                                                    |
      |                                                                     |
      |                                                                     |
  148 ++                                                                    |
      |                                                                     |
  146 ++                                                                    |
      |                                                                     |
  144 ++                                                                    |
      |                                                                     |
      |                                                                     |
  142 ++                 .*..                                               |
      *..     .*..*..*..*    *..*..*..*..     .*..*..*..    .*..*..*..*..*..*
  140 ++-*--*----------------------------*--*-----------*--*----------------+


                           piglit.time.elapsed_time.max

  152 ++--------------------------------------------------------------------+
      |  O  O  O  O  O  O O  O  O  O  O  O  O  O  O  O  O  O O  O  O  O     |
  150 O+                                                                    |
      |                                                                     |
      |                                                                     |
  148 ++                                                                    |
      |                                                                     |
  146 ++                                                                    |
      |                                                                     |
  144 ++                                                                    |
      |                                                                     |
      |                                                                     |
  142 ++                 .*..                                               |
      *..     .*..*..*..*    *..*..*..*..     .*..*..*..    .*..*..*..*..*..*
  140 ++-*--*----------------------------*--*-----------*--*----------------+


                                time.system_time

  21 ++---------------------------------------------------------------------+
  20 O+ O  O  O  O  O  O  O  O  O  O  O  O O  O  O  O  O  O  O  O  O  O     |
     |                                                                      |
  19 ++                                                                     |
  18 ++                                                                     |
  17 ++                                                                     |
  16 ++                                                                     |
     |                                                                      |
  15 ++                                                                     |
  14 ++                                                                     |
  13 ++                                                                     |
  12 ++                                                                     |
     |                                                                      |
  11 *+.*..*..*..*..*..*..*..*..*..*..*..*.*..*..*..*..*..*..*..*..*..*..*..*
  10 ++---------------------------------------------------------------------+


                        time.percent_of_cpu_this_job_got

  16 O+-O--O--O--O--O--O--O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O-----+
     |                                                                      |
  15 ++                                                                     |
     |                                                                      |
     |                                                                      |
  14 ++                                                                     |
     |                                                                      |
  13 ++                                                                     |
     |                                                                      |
  12 ++                                                                     |
     |                                                                      |
     |                                                                      |
  11 *+.                  *..         *..           *..                     |
     |                  ..          ..            ..                        |
  10 ++-*--*--*--*--*--*-----*--*--*-----*-*--*--*-----*--*--*--*--*--*--*--*


 

                             piglit.time.system_time

  15 ++---------------------------------------------------------------------+
     O  O  O  O O  O  O  O  O  O O  O  O  O  O  O O  O  O  O  O  O O  O  O  |
  14 ++                                                                     |
  13 ++                                                                     |
     |                                                                      |
  12 ++                                                                     |
     |                                                                      |
  11 ++                                                                     |
     |                                                                      |
  10 ++                                                                     |
   9 ++                                                                     |
     |                                                                      |
   8 ++        .*..*..     .*..             .*..*.           .*..*.*..*..  .*
     *..*..*..*       *..*.    *.*..*..*..*.      *..*..*..*.            *. |
   7 ++---------------------------------------------------------------------+


                             piglit.time.elapsed_time

  450 ++--------------------------------------------------------------------+
      |                                                                     |
  400 ++                                     O                              |
      |                                                                     |
      |                                                                     |
  350 ++                                                                    |
      |                                                                     |
  300 ++                                                                    |
      |                                                                     |
  250 ++                                                                    |
      |                                                                     |
      |                                                                     |
  200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
      |                                                                     |
  150 ++--------------------------------------------------------------------+


                           piglit.time.elapsed_time.max

  450 ++--------------------------------------------------------------------+
      |                                                                     |
  400 ++                                     O                              |
      |                                                                     |
      |                                                                     |
  350 ++                                                                    |
      |                                                                     |
  300 ++                                                                    |
      |                                                                     |
  250 ++                                                                    |
      |                                                                     |
      |                                                                     |
  200 O+.O..O.O..O..O..O..O.O..O..O..O..O.O..*..O..O..O.O..O..O..O..O.O..O..*
      |                                                                     |
  150 ++--------------------------------------------------------------------+


                                time.system_time

  15 ++---------------------------------------------------------------------+
     O  O  O  O O  O  O  O  O  O O  O  O  O  O  O O  O  O  O  O  O O  O  O  |
  14 ++                                                                     |
  13 ++                                                                     |
     |                                                                      |
  12 ++                                                                     |
     |                                                                      |
  11 ++                                                                     |
     |                                                                      |
  10 ++                                                                     |
   9 ++                                                                     |
     |                                                                      |
   8 ++        .*..*..     .*..             .*..*.           .*..*.*..*..  .*
     *..*..*..*       *..*.    *.*..*..*..*.      *..*..*..*.            *. |
   7 ++---------------------------------------------------------------------+

	[*] bisect-good sample
	[O] bisect-bad  sample

To reproduce:

        git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Xiaolong Ye

View attachment "job.yaml" of type "text/plain" (2868 bytes)

View attachment "reproduce" of type "text/plain" (180 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ