lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date:   Thu, 26 Nov 2020 09:44:55 +0800
From:   Xing Zhengjun <zhengjun.xing@...ux.intel.com>
To:     Chris Wilson <chris@...is-wilson.co.uk>,
        Joonas Lahtinen <joonas.lahtinen@...ux.intel.com>,
        Oliver Sang <oliver.sang@...el.com>
Cc:     feng.tang@...el.com, tiejun.li@...el.com, frank.du@...el.com,
        guobing.chen@...el.com, jiebin.sun@...el.com, Shuhua.Fan@...el.com,
        Matthew Auld <matthew.auld@...el.com>, fan.zhao@...el.com,
        ying.huang@...el.com, shan.kang@...el.com, zhengjun.xing@...el.com,
        Wenhuan.Huang@...el.com, intel-gfx@...ts.freedesktop.org,
        guangli.li@...el.com, gengxin.xie@...el.com, ming.a.chen@...el.com,
        yu.ma@...el.com, jessica.ji@...el.com, lkp@...ts.01.org,
        wangyang.guo@...el.com, dapeng1.mi@...el.com,
        LKML <linux-kernel@...r.kernel.org>
Subject: Re: [Intel-gfx] [drm/i915/gem] 59dd13ad31:
 phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second
 -54.0% regression



On 11/25/2020 4:47 AM, Chris Wilson wrote:
> Quoting Oliver Sang (2020-11-19 07:20:18)
>> On Fri, Nov 13, 2020 at 04:27:13PM +0200, Joonas Lahtinen wrote:
>>> Hi,
>>>
>>> Could you add intel-gfx@...ts.freedesktop.org into reports going
>>> forward.
>>>
>>> Quoting kernel test robot (2020-11-11 17:58:11)
>>>>
>>>> Greeting,
>>>>
>>>> FYI, we noticed a -54.0% regression of phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second due to commit:
>>>
>>> How many runs are there on the bad version to ensure the bisect is
>>> repeatable?
>>
>> test 4 times.
>> zxing@inn:/result/phoronix-test-suite/performance-true-Radial_Gradient_Paint-1024x1024-jxrendermark-1.2.4-ucode=0xd6-monitor=da39a3ee/lkp-cfl-d1/debian-x86_64-phoronix/x86_64-rhel-8.3/gcc-9/59dd13ad310793757e34afa489dd6fc8544fc3da$ grep -r "operations_per_second" */stats.json
>> 0/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4133.487932,
>> 1/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4120.421503,
>> 2/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4188.414835,
>> 3/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4068.549514,
> 
> a w/o revert (drm-tip)
> b w/ revert
> +mB----------------------------------------------------------------------------+
> |                             ..b                                              |
> |                             ..b.aa                                           |
> |                             ....a.a                                          |
> |                             ....a.a                                          |
> |                      b  b  ........a                                         |
> |                   b  b  b b......... a                                       |
> |                   b  bb bbb...........                                       |
> |b               ab bbab.bb.b............ba b a a            ab               a|
> |                             |__A__|                                          |
> |                             |MA_|                                            |
> +------------------------------------------------------------------------------+
>      N                Min           Max        Median           Avg        Stddev
> a 120          3621.8761     7356.4442     4606.7895     4607.9132     156.17693
> b 120          2664.0563     6359.9686     4519.5036     4534.4463     95.471121
> 
> The patch is not expected to have any impact on the machine you are testing on.
> -Chris
> 

What's your code base?
For my side:
1) sync the code to the head of Linux mainline
2) git reset --hard 59dd13ad31
3) git revert 59dd13ad3107
We compare the test result of commit 59dd13ad3107 (step 2) and 
2052847b06f8 (step 3, revert 59dd13ad3107), the regression should 
related with 59dd13ad3107. Each test case we run 5 times.
=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/need_x/test/option_a/option_b/cpufreq_governor/ucode/debug-setup:
 
lkp-cfl-d1/phoronix-test-suite/debian-x86_64-phoronix/x86_64-rhel-8.3/gcc-9/true/jxrendermark-1.2.4/Radial 
Gradient Paint/1024x1024/performance/0xde/regression_test

commit:
   0dccdba51e852271a3dbc9358375f4c882b863f2
   59dd13ad310793757e34afa489dd6fc8544fc3da
   2052847b06f863a028f7f3bbc62401e043b34301 (revert 59dd13ad3107)

0dccdba51e852271 59dd13ad310793757e34afa489d 2052847b06f863a028f7f3bbc62
---------------- --------------------------- ---------------------------
          %stddev     %change         %stddev     %change         %stddev
              \          |                \          |                \
       8145 ±  2%     -53.1%       3817 ±  3%      -1.8%       7995 
 
phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second


-- 
Zhengjun Xing

Powered by blists - more mailing lists