linux-kernel - Re: Regression in v4.19.106 breaking waking up of readers of /proc/kmsg and /dev/kmsg

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <87r1yfvzy5.fsf@linutronix.de>
Date:   Fri, 28 Feb 2020 10:11:30 +0100
From:   John Ogness <john.ogness@...utronix.de>
To:     Sergey Senozhatsky <sergey.senozhatsky.work@...il.com>
Cc:     Lech Perczak <l.perczak@...lintechnologies.com>,
        Petr Mladek <pmladek@...e.com>,
        Steven Rostedt <rostedt@...dmis.org>,
        Greg Kroah-Hartman <gregkh@...uxfoundation.org>,
        "linux-kernel\@vger.kernel.org" <linux-kernel@...r.kernel.org>,
        Theodore Ts'o <tytso@....edu>, Arnd Bergmann <arnd@...db.de>,
        Krzysztof Drobiński 
        <k.drobinski@...lintechnologies.com>,
        Pawel Lenkow <p.lenkow@...lintechnologies.com>
Subject: Re: Regression in v4.19.106 breaking waking up of readers of /proc/kmsg and /dev/kmsg

On 2020-02-28, Sergey Senozhatsky <sergey.senozhatsky.work@...il.com> wrote:
> Cc-ing Petr, Steven, John

Thanks.

> https://lore.kernel.org/lkml/e9358218-98c9-2866-8f40-5955d093dc1b@camlintechnologies.com
>
> On (20/02/27 14:08), Lech Perczak wrote:
>> >>> My test scenario for bisecting was:
>> >>> 1. run 'dmesg --follow' as root
>> >>> 2. run 'echo t > /proc/sysrq-trigger'
>> >>> 3. If trace appears in dmesg output -> good, otherwise, bad. If trace doesn't appear in output of 'dmesg --follow', re-running it will show the trace.
>> >>>
>> >>> I ran my tests on Debian 10.3 with configuration based directly on one from 4.19.0-8-amd64 (4.19.98-1) in Qemu.
>> >>> I could reproduce the same issue on several boards with x86 and ARMv7 CPUs alike, with 100% reproducibility.
>
> This is very-very odd... Hmm.
> Just out of curiosity, what happens if you comment out that
> printk() entirely?
>
> printk_deferred() should not affect the PRINTK_PENDING_WAKEUP path.

It is the printk_deferred() causing the issue. This is relatively early,
so perhaps something is not yet properly initialized.

> Either we never queue wakeup irq_work(), e.g. because
> waitqueue_active() never lets us to do so or because `(curr_log_seq !=
> log_next_seq)' is always zero

wake_up_klogd() is called and the waitqueue (@log_wait) is
active. irq_work_queue() is called, but the work function,
wake_up_klogd_work_func(), is never called.

Perhaps @wake_up_klogd_work gets broken somehow. I'm looking into it.

John Ogness