netdev - Re: [TEST] Flake report

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <6de8eb78-53d6-4347-9a5b-ec4285b96723@blackwall.org>
Date: Fri, 10 May 2024 17:45:40 +0300
From: Nikolay Aleksandrov <razor@...ckwall.org>
To: Jakub Kicinski <kuba@...nel.org>, Florian Westphal <fw@...len.de>,
 Simon Horman <horms@...nel.org>, Hangbin Liu <liuhangbin@...il.com>,
 Jaehee Park <jhpark1013@...il.com>, Petr Machata <petrm@...dia.com>,
 Ido Schimmel <idosch@...dia.com>, Davide Caratti <dcaratti@...hat.com>,
 Matthieu Baerts <matttbe@...nel.org>
Cc: netdev@...r.kernel.org
Subject: Re: [TEST] Flake report

On 10/05/2024 02:09, Jakub Kicinski wrote:
> Hi!
> 
> Feels like the efforts to get rid of flaky tests have slowed down a bit,
> so I thought I'd poke people..
> 
> Here's the full list:
> https://netdev.bots.linux.dev/flakes.html?min-flip=0&pw-y=0
> click on test name to get the list of runs and links to outputs.
> 
> As a reminder please see these instructions for repro:
> https://github.com/linux-netdev/nipa/wiki/How-to-run-netdev-selftests-CI-style
> 
> I'll try to tag folks who touched the tests most recently, but please
> don't hesitate to chime in.
> 
> 
[snip]
> bridge-igmp-sh, bridge-mld-sh
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> To: Nikolay Aleksandrov <razor@...ckwall.org>
> Cc: Ido Schimmel <idosch@...dia.com>
> 
> On debug kernels it always fails with:
> 
> # TEST: IGMPv3 group 239.10.10.10 exclude timeout                     [FAIL]
> # Entry 192.0.2.21 has blocked flag failed
> 
> For MLD:
> 
> # TEST: MLDv2 group ff02::cc exclude timeout                          [FAIL]
> # Entry 2001:db8:1::21 has blocked flag failed
> 

I think the problem is the short timeout on slower (debug) runs. Perhaps increasing
it from 3 to 5 seconds would be enough to cover the 2 second waits for setup and
the verifications being done. I'll give it a go and post a patch.