linux-kernel - Re: 6.10/regression/bisected - after f1d97e769152 I spotted increased execution time of the kswapd0 process and symptoms as if there is not enough memory

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <CAL3q7H74jpSoMvvkSvmrtB_VGiscz8zN5aHnApWuYU+hpKe+rA@mail.gmail.com>
Date: Thu, 4 Jul 2024 10:48:51 +0100
From: Filipe Manana <fdmanana@...nel.org>
To: Andrea Gelmini <andrea.gelmini@...il.com>
Cc: Mikhail Gavrilov <mikhail.v.gavrilov@...il.com>, 
	Linux List Kernel Mailing <linux-kernel@...r.kernel.org>, 
	Linux regressions mailing list <regressions@...ts.linux.dev>, Btrfs BTRFS <linux-btrfs@...r.kernel.org>, 
	dsterba@...e.com, josef@...icpanda.com
Subject: Re: 6.10/regression/bisected - after f1d97e769152 I spotted increased
 execution time of the kswapd0 process and symptoms as if there is not enough memory

On Wed, Jul 3, 2024 at 10:07 PM Andrea Gelmini <andrea.gelmini@...il.com> wrote:
>
> Il giorno mer 3 lug 2024 alle ore 13:59 Filipe Manana
> <fdmanana@...nel.org> ha scritto:
> >
> > I'm collecting all the patches in this branch:
> >
> > https://git.kernel.org/pub/scm/linux/kernel/git/fdmanana/linux.git/log/?h=em_shrinker_6.10
> >
> > They apply cleanly to 6.10-rc.
>
> Yeap, as I wrote before, same problem here.
> I tried the branch over today Linus git (master), and nothing changed.
> But, good news, I can provide a few more details.
>
> So, no need to use restic. On my laptop (nvme + ssd, 32GB RAM, Lenovo T480):
> a) boot up;
> b) just open Window Maker and two Konsole, one with htop (with a few
> tricks to view PSI and so on);
> c) on one terminal run: tar cp /home/ | pv > /dev/null
> d) wait less than one minutes, and I see "PSI full memory" increase
> more than 50, memory pressure on swap, and two CPU threads (out of
> eight) busy at  100%;

I'll try that soon and see if I can reproduce.

In the meanwhile, just curious: are you using swapfiles on btrfs?

Thanks.

> e) system get sluggish (on htop I see no process eating CPU);
> f) if I kill tar, PSI memory keeps going up and down, so the threads.
> After lots of minutes, everything get back to no activity. In these
> minutes I see by iotop there's no activity nor on ssd or nvme. Until
> the end, the system is unresponsive, oh well, really slow.
>
> My / is BTRFS. Not many years of aging. Usually with daily snapshots
> and forced compression.
>
> Less than 4.000.000 files on the system. Usually .git and source code.
>
> root@...n:/home/gelma# btrfs filesystem usage /
> Overall:
>    Device size:                   3.54TiB
>    Device allocated:              2.14TiB
>    Device unallocated:            1.40TiB
>    Device missing:                  0.00B
>    Device slack:                    0.00B
>    Used:                          2.03TiB
>    Free (estimated):              1.50TiB      (min: 1.50TiB)
>    Free (statfs, df):             1.50TiB
>    Data ratio:                       1.00
>    Metadata ratio:                   1.00
>    Global reserve:              512.00MiB      (used: 0.00B)
>    Multiple profiles:                  no
>
> Data,single: Size:2.12TiB, Used:2.02TiB (95.09%)
>   /dev/mapper/sda6_crypt          2.12TiB
>
> Metadata,single: Size:16.00GiB, Used:14.73GiB (92.04%)
>   /dev/mapper/sda6_crypt         16.00GiB
>
> System,single: Size:32.00MiB, Used:320.00KiB (0.98%)
>   /dev/mapper/sda6_crypt         32.00MiB
>
> Unallocated:
>   /dev/mapper/sda6_crypt          1.40TiB