lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
Open Source and information security mailing list archives
| ||
|
Date: Tue, 24 Nov 2020 10:09:55 +0100 From: Peter Zijlstra <peterz@...radead.org> To: Balbir Singh <bsingharora@...il.com> Cc: Vineeth Pillai <viremana@...ux.microsoft.com>, "Joel Fernandes (Google)" <joel@...lfernandes.org>, Nishanth Aravamudan <naravamudan@...italocean.com>, Julien Desfossez <jdesfossez@...italocean.com>, Tim Chen <tim.c.chen@...ux.intel.com>, Aaron Lu <aaron.lwe@...il.com>, Aubrey Li <aubrey.intel@...il.com>, tglx@...utronix.de, linux-kernel@...r.kernel.org, mingo@...nel.org, torvalds@...ux-foundation.org, fweisbec@...il.com, keescook@...omium.org, kerrnel@...gle.com, Phil Auld <pauld@...hat.com>, Valentin Schneider <valentin.schneider@....com>, Mel Gorman <mgorman@...hsingularity.net>, Pawan Gupta <pawan.kumar.gupta@...ux.intel.com>, Paolo Bonzini <pbonzini@...hat.com>, vineeth@...byteword.org, Chen Yu <yu.c.chen@...el.com>, Christian Brauner <christian.brauner@...ntu.com>, Agata Gruza <agata.gruza@...el.com>, Antonio Gomez Iglesias <antonio.gomez.iglesias@...el.com>, graf@...zon.com, konrad.wilk@...cle.com, dfaggioli@...e.com, pjt@...gle.com, rostedt@...dmis.org, derkling@...gle.com, benbjiang@...cent.com, Alexandre Chartre <alexandre.chartre@...cle.com>, James.Bottomley@...senpartnership.com, OWeisse@...ch.edu, Dhaval Giani <dhaval.giani@...cle.com>, Junaid Shahid <junaids@...gle.com>, jsbarnes@...gle.com, chris.hyser@...cle.com, Ben Segall <bsegall@...gle.com>, Josh Don <joshdon@...gle.com>, Hao Luo <haoluo@...gle.com>, Tom Lendacky <thomas.lendacky@....com>, Aubrey Li <aubrey.li@...ux.intel.com>, "Paul E. McKenney" <paulmck@...nel.org>, Tim Chen <tim.c.chen@...el.com> Subject: Re: [PATCH -tip 09/32] sched/fair: Snapshot the min_vruntime of CPUs on force idle On Tue, Nov 24, 2020 at 10:31:49AM +1100, Balbir Singh wrote: > On Mon, Nov 23, 2020 at 07:31:31AM -0500, Vineeth Pillai wrote: > > Hi Balbir, > > > > On 11/22/20 6:44 AM, Balbir Singh wrote: > > > > > > This seems cumbersome, is there no way to track the min_vruntime via > > > rq->core->min_vruntime? > > Do you mean to have a core wide min_vruntime? We had a > > similar approach from v3 to v7 and it had major issues which > > broke the assumptions of cfs. There were some lengthy > > discussions and Peter explained in-depth about the issues: > > > > https://lwn.net/ml/linux-kernel/20200506143506.GH5298@hirez.programming.kicks-ass.net/ > > https://lwn.net/ml/linux-kernel/20200515103844.GG2978@hirez.programming.kicks-ass.net/ > > > > One of the equations in the link is > > ">From which immediately follows that: > > T_k + T_l > S_k+l = --------- (13) > W_k + W_l > > On which we can define a combined lag: > > lag_k+l(i) := S_k+l - s_i (14) > > And that gives us the tools to compare tasks across a combined runqueue. > " > > S_k+l reads like rq->core->vruntime, but it sounds like the equivalent > of rq->core->vruntime is updated when we enter forced idle as opposed to > all the time. Yes, but actually computing and maintaining it is hella hard. Try it with the very first example in that email (the infeasible weight scenario) and tell me how it works for you ;-) Also note that the text below (6) mentions dynamic, then look up the EEVDF paper which describes some of the dynamics -- the paper is incomplete and contains a bug, I forget if it ever got updated or if there's another paper that completes it (the BQF I/O scheduler started from that and fixed it). I'm not saying it cannot be done, I'm just saying it is really rather involved and probably not worth it. The basic observation the current approach relies on is that al that faffery basically boils down to the fact that vruntime only means something when there is contention. And that only the progression is important not the actual value. That is, this is all fundamentally a differential equation and our integration constant is meaningless (also embodied in (7)). Also, I think the code as proposed here relies on SMT2 and is buggered for SMT3+. Now, that second link above describes means of making SMT3+ work, but we're not there yet.
Powered by blists - more mailing lists