linux-kernel - Re: [Intel-gfx] [drm/i915/gem] 59dd13ad31: phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <ab9ebc5a-7d79-8003-c7bc-5cf0923983c6@linux.intel.com>
Date:   Thu, 26 Nov 2020 09:44:55 +0800
From:   Xing Zhengjun <zhengjun.xing@...ux.intel.com>
To:     Chris Wilson <chris@...is-wilson.co.uk>,
        Joonas Lahtinen <joonas.lahtinen@...ux.intel.com>,
        Oliver Sang <oliver.sang@...el.com>
Cc:     feng.tang@...el.com, tiejun.li@...el.com, frank.du@...el.com,
        guobing.chen@...el.com, jiebin.sun@...el.com, Shuhua.Fan@...el.com,
        Matthew Auld <matthew.auld@...el.com>, fan.zhao@...el.com,
        ying.huang@...el.com, shan.kang@...el.com, zhengjun.xing@...el.com,
        Wenhuan.Huang@...el.com, intel-gfx@...ts.freedesktop.org,
        guangli.li@...el.com, gengxin.xie@...el.com, ming.a.chen@...el.com,
        yu.ma@...el.com, jessica.ji@...el.com, lkp@...ts.01.org,
        wangyang.guo@...el.com, dapeng1.mi@...el.com,
        LKML <linux-kernel@...r.kernel.org>
Subject: Re: [Intel-gfx] [drm/i915/gem] 59dd13ad31:
 phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second
 -54.0% regression



On 11/25/2020 4:47 AM, Chris Wilson wrote:
> Quoting Oliver Sang (2020-11-19 07:20:18)
>> On Fri, Nov 13, 2020 at 04:27:13PM +0200, Joonas Lahtinen wrote:
>>> Hi,
>>>
>>> Could you add intel-gfx@...ts.freedesktop.org into reports going
>>> forward.
>>>
>>> Quoting kernel test robot (2020-11-11 17:58:11)
>>>>
>>>> Greeting,
>>>>
>>>> FYI, we noticed a -54.0% regression of phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second due to commit:
>>>
>>> How many runs are there on the bad version to ensure the bisect is
>>> repeatable?
>>
>> test 4 times.
>> zxing@inn:/result/phoronix-test-suite/performance-true-Radial_Gradient_Paint-1024x1024-jxrendermark-1.2.4-ucode=0xd6-monitor=da39a3ee/lkp-cfl-d1/debian-x86_64-phoronix/x86_64-rhel-8.3/gcc-9/59dd13ad310793757e34afa489dd6fc8544fc3da$ grep -r "operations_per_second" */stats.json
>> 0/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4133.487932,
>> 1/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4120.421503,
>> 2/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4188.414835,
>> 3/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4068.549514,
> 
> a w/o revert (drm-tip)
> b w/ revert
> +mB----------------------------------------------------------------------------+
> |                             ..b                                              |
> |                             ..b.aa                                           |
> |                             ....a.a                                          |
> |                             ....a.a                                          |
> |                      b  b  ........a                                         |
> |                   b  b  b b......... a                                       |
> |                   b  bb bbb...........                                       |
> |b               ab bbab.bb.b............ba b a a            ab               a|
> |                             |__A__|                                          |
> |                             |MA_|                                            |
> +------------------------------------------------------------------------------+
>      N                Min           Max        Median           Avg        Stddev
> a 120          3621.8761     7356.4442     4606.7895     4607.9132     156.17693
> b 120          2664.0563     6359.9686     4519.5036     4534.4463     95.471121
> 
> The patch is not expected to have any impact on the machine you are testing on.
> -Chris
> 

What's your code base?
For my side:
1) sync the code to the head of Linux mainline
2) git reset --hard 59dd13ad31
3) git revert 59dd13ad3107
We compare the test result of commit 59dd13ad3107 (step 2) and 
2052847b06f8 (step 3, revert 59dd13ad3107), the regression should 
related with 59dd13ad3107. Each test case we run 5 times.
=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/need_x/test/option_a/option_b/cpufreq_governor/ucode/debug-setup:
 
lkp-cfl-d1/phoronix-test-suite/debian-x86_64-phoronix/x86_64-rhel-8.3/gcc-9/true/jxrendermark-1.2.4/Radial 
Gradient Paint/1024x1024/performance/0xde/regression_test

commit:
   0dccdba51e852271a3dbc9358375f4c882b863f2
   59dd13ad310793757e34afa489dd6fc8544fc3da
   2052847b06f863a028f7f3bbc62401e043b34301 (revert 59dd13ad3107)

0dccdba51e852271 59dd13ad310793757e34afa489d 2052847b06f863a028f7f3bbc62
---------------- --------------------------- ---------------------------
          %stddev     %change         %stddev     %change         %stddev
              \          |                \          |                \
       8145 ±  2%     -53.1%       3817 ±  3%      -1.8%       7995 
 
phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second


-- 
Zhengjun Xing