linux-kernel - Re: [PATCH v9 0/7] Preparatory changes for Proxy Execution v9

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <CANDhNCoYVeWyhfePPrMqsLTY_1nTUM3GekgtpsyOm7QNLZYpXA@mail.gmail.com>
Date: Mon, 1 Apr 2024 14:28:35 -0700
From: John Stultz <jstultz@...gle.com>
To: K Prateek Nayak <kprateek.nayak@....com>
Cc: LKML <linux-kernel@...r.kernel.org>, Joel Fernandes <joelaf@...gle.com>, 
	Qais Yousef <qyousef@...gle.com>, Ingo Molnar <mingo@...hat.com>, 
	Peter Zijlstra <peterz@...radead.org>, Juri Lelli <juri.lelli@...hat.com>, 
	Vincent Guittot <vincent.guittot@...aro.org>, Dietmar Eggemann <dietmar.eggemann@....com>, 
	Valentin Schneider <vschneid@...hat.com>, Steven Rostedt <rostedt@...dmis.org>, 
	Ben Segall <bsegall@...gle.com>, Zimuzo Ezeozue <zezeozue@...gle.com>, 
	Youssef Esmat <youssefesmat@...gle.com>, Mel Gorman <mgorman@...e.de>, 
	Daniel Bristot de Oliveira <bristot@...hat.com>, Will Deacon <will@...nel.org>, Waiman Long <longman@...hat.com>, 
	Boqun Feng <boqun.feng@...il.com>, "Paul E. McKenney" <paulmck@...nel.org>, 
	Metin Kaya <Metin.Kaya@....com>, Xuewen Yan <xuewen.yan94@...il.com>, 
	Thomas Gleixner <tglx@...utronix.de>, kernel-team@...roid.com
Subject: Re: [PATCH v9 0/7] Preparatory changes for Proxy Execution v9

On Sun, Mar 24, 2024 at 11:44 PM 'K Prateek Nayak' via kernel-team
<kernel-team@...roid.com> wrote:
> On 3/15/2024 10:09 AM, John Stultz wrote:
> > As mentioned last time[1], after previous submissions of the
> > Proxy Execution series, I got feedback that the patch series was
> > getting a bit unwieldy to review, and Qais suggested I break out
> > just the cleanups/preparatory components of the patch series and
> > submit them on their own in the hope we can start to merge the
> > less complex bits and discussion can focus on the more
> > complicated portions afterwards. This so far has not been very
> > successful, with the submission & RESEND of the v8 preparatory
> > changes not getting much in the way of review.
> >
> > Nonetheless, for v9 of this series, I’m again only submitting
> > those early cleanup/preparatory changes here (which have not
> > changed since the v8 submissions, but to avoid confusion with the
> > git branch names, I’m labeling it as v9). In the meantime, I’ve
> > continued to put a lot of effort into the full series, mostly
> > focused on polishing the series for correctness, and fixing some
> > hard to trip races.
> >
> > If you are interested, the full v9 series, it can be found here:
> >   https://github.com/johnstultz-work/linux-dev/commits/proxy-exec-v9-6.8
> >   https://github.com/johnstultz-work/linux-dev.git proxy-exec-v9-6.8
>
> Tested the v9 of the series.
>
> tl;dr
>
> o I still see a small regression for hackbench. I'll get some perf
>   profiles for the same and leave them in this thread soon (I do
>   not have them at the moment unfortunately)
>
> o There is a regression for some combinations in schbench. I'll
>   have to recheck if I can consistently reproduce this or not and
>   look at the perf profile to see if something is sticking out.

Much appreciated for the extra testing of the whole series!

I've not had much time to dig further on performance tuning since v8
(v9 mostly focused on fixes), so I didn't expect much change.
As I do some more detailed analysis of behavior via tracing for
correctness, I'm hoping there will be some finds there to further
improve things, but I'm not sure all of the overhead of handling proxy
rq-migrations and re-selecting the next task will be avoidable. So I
expect some potential throughput impact, but hopefully the latency
improvements will be worth it.

> > New in v9:
> > (In the git tree. Again, none of the preparatory patches
> > submitted here have changed since v8)
>
> Since these changes in this preparatory series have remained the same,
> please feel free to add:
>
> Tested-by: K Prateek Nayak <kprateek.nayak@....com>

Just added to my WIP tree. I'll likely be sending a RESEND of the v9
prep patches in the next few days, and will add them there as well.

Thank you so much again!
-john