lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date:   Fri, 2 Oct 2020 16:27:40 +0800
From:   kernel test robot <rong.a.chen@...el.com>
To:     Chris Wilson <chris@...is-wilson.co.uk>
Cc:     Rodrigo Vivi <rodrigo.vivi@...el.com>,
        Andi Shyti <andi.shyti@...el.com>,
        Lyude Paul <lyude@...hat.com>,
        LKML <linux-kernel@...r.kernel.org>, lkp@...ts.01.org,
        lkp@...el.com, ying.huang@...el.com, feng.tang@...el.com,
        zhengjun.xing@...el.com, guobing.chen@...el.com,
        ming.a.chen@...el.com, frank.du@...el.com, Shuhua.Fan@...el.com,
        wangyang.guo@...el.com, Wenhuan.Huang@...el.com,
        jessica.ji@...el.com, shan.kang@...el.com, guangli.li@...el.com,
        tiejun.li@...el.com, yu.ma@...el.com, dapeng1.mi@...el.com,
        jiebin.sun@...el.com, gengxin.xie@...el.com, fan.zhao@...el.com
Subject: [drm/i915/gt] 98479ada42:
 phoronix-test-suite.supertuxkart.1024x768.Windowed.Basic.1.OldMine.frames_per_second
 -36.0% regression

Greeting,

FYI, we noticed a -36.0% regression of phoronix-test-suite.supertuxkart.1024x768.Windowed.Basic.1.OldMine.frames_per_second due to commit:


commit: 98479ada421a8fd2123b98efd398a6f1379307ab ("drm/i915/gt: Treat idling as a RPS downclock event")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master


in testcase: phoronix-test-suite
on test machine: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory
with following parameters:

	need_x: true
	test: supertuxkart-1.5.2
	option_a: Windowed
	option_b: Basic
	option_c: 1
	option_d: Old Mine [Approximately 90k triangles]
	cpufreq_governor: performance
	ucode: 0xd6

test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added.
test-url: http://www.phoronix-test-suite.com/

In addition to that, the commit also has significant impact on the following tests:

+------------------+---------------------------------------------------------------------------------------------------------------------------------------+
| testcase: change | phoronix-test-suite: phoronix-test-suite.supertuxkart.1024x768.Windowed.Basic.1.CocoaTemple.frames_per_second -13.3% regression       |
| test machine     | 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory                                                                    |
| test parameters  | cpufreq_governor=performance                                                                                                          |
|                  | need_x=true                                                                                                                           |
|                  | option_a=Windowed                                                                                                                     |
|                  | option_b=Basic                                                                                                                        |
|                  | option_c=1                                                                                                                            |
|                  | option_d=Cocoa Temple [Approximately 300k triangles; advanced graphics]                                                               |
|                  | test=supertuxkart-1.5.2                                                                                                               |
|                  | ucode=0xd6                                                                                                                            |
+------------------+---------------------------------------------------------------------------------------------------------------------------------------+
| testcase: change | phoronix-test-suite: phoronix-test-suite.paraview.WaveletVolume.1024x768.mivoxels___sec -51.1% regression                             |
| test machine     | 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory                                                                    |
| test parameters  | cpufreq_governor=performance                                                                                                          |
|                  | need_x=true                                                                                                                           |
|                  | option_a=Wavelet Volume                                                                                                               |
|                  | test=paraview-1.0.2                                                                                                                   |
|                  | ucode=0xd6                                                                                                                            |
+------------------+---------------------------------------------------------------------------------------------------------------------------------------+
| testcase: change | phoronix-test-suite: phoronix-test-suite.supertuxkart.1024x768.Windowed.Basic.8.AntediluvianAbyss.frames_per_second -48.8% regression |
| test machine     | 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory                                                                    |
| test parameters  | cpufreq_governor=performance                                                                                                          |
|                  | need_x=true                                                                                                                           |
|                  | option_a=Windowed                                                                                                                     |
|                  | option_b=Basic                                                                                                                        |
|                  | option_c=8                                                                                                                            |
|                  | option_d=Antediluvian Abyss [Approximately 240k triangles; advanced graphics]                                                         |
|                  | test=supertuxkart-1.5.2                                                                                                               |
|                  | ucode=0xd6                                                                                                                            |
+------------------+---------------------------------------------------------------------------------------------------------------------------------------+


If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen@...el.com>


Details are as below:
-------------------------------------------------------------------------------------------------->


To reproduce:

        git clone https://github.com/intel/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml

=========================================================================================
compiler/cpufreq_governor/kconfig/need_x/option_a/option_b/option_c/option_d/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/true/Windowed/Basic/1/Old Mine [Approximately 90k triangles]/debian-x86_64-phoronix/lkp-kbl-nuc1/supertuxkart-1.5.2/phoronix-test-suite/0xd6

commit: 
  a24c57d0b3 ("drm/i915/gt: Cancel a hung context if already closed")
  98479ada42 ("drm/i915/gt: Treat idling as a RPS downclock event")

a24c57d0b3ed9be0 98479ada421a8fd2123b98efd39 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    650.98           -36.0%     416.63        phoronix-test-suite.supertuxkart.1024x768.Windowed.Basic.1.OldMine.frames_per_second
    239.42           +38.0%     330.29 ± 18%  phoronix-test-suite.time.elapsed_time
    239.42           +38.0%     330.29 ± 18%  phoronix-test-suite.time.elapsed_time.max
      2512 ± 85%    +505.3%      15205 ± 94%  phoronix-test-suite.time.involuntary_context_switches
    215317           +21.2%     260934 ± 11%  phoronix-test-suite.time.minor_page_faults
     84.00           -39.9%      50.50        phoronix-test-suite.time.percent_of_cpu_this_job_got
     26.33           -22.5%      20.41 ± 19%  phoronix-test-suite.time.system_time
    175.94           -15.9%     148.02 ± 18%  phoronix-test-suite.time.user_time
    189640          +104.4%     387650 ± 18%  phoronix-test-suite.time.voluntary_context_switches


                                                                                
                                                                                
                                                                                
  700 +---------------------------------------------------------------------+   
      |                                                                     |   
  650 |.+.+ .+.+.+.++.+.+.+.++.+.+.+.++.+.+.++.+.+.+.++.+.+.+.++.+.+.+.++.+.|   
      | +  +                                                                |   
      |                                                                     |   
  600 |-+                                                                   |   
      |                                                                     |   
  550 |-+                                                                   |   
      |                                                                     |   
  500 |-+                                                                   |   
      |                                                                     |   
      |                                                                     |   
  450 |-+                                                                   |   
      | O OO O O O OO O O O OO O O O OO                                     |   
  400 +---------------------------------------------------------------------+   
                                                                                
                                                                                                                                                                
              phoronix-test-suite.time.percent_of_cpu_this_job_got              
                                                                                
  85 +----------------------------------------------------------------------+   
     | +       + .+.+  +.+.+                     +      +   +    +   +      |   
  80 |-+        +                                                           |   
  75 |-+                                                                    |   
     |                                                                      |   
  70 |-+                                                                    |   
     |                                                                      |   
  65 |-+                                                                    |   
     |                                                                      |   
  60 |-+                                                                    |   
  55 |-+                                                                    |   
     |                                                                      |   
  50 |-O OO O O   O OO O O O OO O O O O                                     |   
     |          O                                                           |   
  45 +----------------------------------------------------------------------+   
                                                                                
                                                                                
[*] bisect-good sample
[O] bisect-bad  sample

***************************************************************************************************
lkp-kbl-nuc1: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/need_x/option_a/option_b/option_c/option_d/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/true/Windowed/Basic/1/Cocoa Temple [Approximately 300k triangles; advanced graphics]/debian-x86_64-phoronix/lkp-kbl-nuc1/supertuxkart-1.5.2/phoronix-test-suite/0xd6

commit: 
  a24c57d0b3 ("drm/i915/gt: Cancel a hung context if already closed")
  98479ada42 ("drm/i915/gt: Treat idling as a RPS downclock event")

a24c57d0b3ed9be0 98479ada421a8fd2123b98efd39 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    256.74           -13.3%     222.46        phoronix-test-suite.supertuxkart.1024x768.Windowed.Basic.1.CocoaTemple.frames_per_second
     84.50           -12.1%      74.25        phoronix-test-suite.time.percent_of_cpu_this_job_got



***************************************************************************************************
lkp-kbl-nuc1: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/need_x/option_a/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/true/Wavelet Volume/debian-x86_64-phoronix/lkp-kbl-nuc1/paraview-1.0.2/phoronix-test-suite/0xd6

commit: 
  a24c57d0b3 ("drm/i915/gt: Cancel a hung context if already closed")
  98479ada42 ("drm/i915/gt: Treat idling as a RPS downclock event")

a24c57d0b3ed9be0 98479ada421a8fd2123b98efd39 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
     44.28 ± 24%     -51.1%      21.64 ±  6%  phoronix-test-suite.paraview.WaveletVolume.1024x768.frames___sec
    708.54 ± 24%     -51.1%     346.21 ±  6%  phoronix-test-suite.paraview.WaveletVolume.1024x768.mivoxels___sec
    284183          +122.9%     633483 ± 46%  phoronix-test-suite.time.minor_page_faults



***************************************************************************************************
lkp-kbl-nuc1: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/need_x/option_a/option_b/option_c/option_d/rootfs/tbox_group/test/testcase/ucode:
  gcc-9/performance/x86_64-rhel-8.3/true/Windowed/Basic/8/Antediluvian Abyss [Approximately 240k triangles; advanced graphics]/debian-x86_64-phoronix/lkp-kbl-nuc1/supertuxkart-1.5.2/phoronix-test-suite/0xd6

commit: 
  a24c57d0b3 ("drm/i915/gt: Cancel a hung context if already closed")
  98479ada42 ("drm/i915/gt: Treat idling as a RPS downclock event")

a24c57d0b3ed9be0 98479ada421a8fd2123b98efd39 
---------------- --------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    428.34           -48.8%     219.30 ±  4%  phoronix-test-suite.supertuxkart.1024x768.Windowed.Basic.8.AntediluvianAbyss.frames_per_second
      1494 ± 60%   +1913.0%      30074 ± 43%  phoronix-test-suite.time.involuntary_context_switches
     84.00 ±  2%     -55.4%      37.50 ±  4%  phoronix-test-suite.time.percent_of_cpu_this_job_got
    395421 ± 86%    +168.5%    1061674 ± 42%  phoronix-test-suite.time.voluntary_context_switches





Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Rong Chen


View attachment "config-5.6.0-rc5-01490-g98479ada421a8" of type "text/plain" (155088 bytes)

View attachment "job-script" of type "text/plain" (7529 bytes)

View attachment "job.yaml" of type "text/plain" (5108 bytes)

View attachment "reproduce" of type "text/plain" (304 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ