linux-kernel - Re: [PATCH 12/14] mm, oom: protect !costly allocations some more

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite for Android: free password hash cracker in your pocket

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20160504181916.GB21490@dhcp22.suse.cz>
Date:	Wed, 4 May 2016 20:19:16 +0200
From:	Michal Hocko <mhocko@...nel.org>
To:	Joonsoo Kim <js1304@...il.com>
Cc:	Joonsoo Kim <iamjoonsoo.kim@....com>,
	Andrew Morton <akpm@...ux-foundation.org>,
	Linus Torvalds <torvalds@...ux-foundation.org>,
	Johannes Weiner <hannes@...xchg.org>,
	Mel Gorman <mgorman@...e.de>,
	David Rientjes <rientjes@...gle.com>,
	Tetsuo Handa <penguin-kernel@...ove.sakura.ne.jp>,
	Hillf Danton <hillf.zj@...baba-inc.com>,
	Vlastimil Babka <vbabka@...e.cz>,
	Linux Memory Management List <linux-mm@...ck.org>,
	LKML <linux-kernel@...r.kernel.org>
Subject: Re: [PATCH 12/14] mm, oom: protect !costly allocations some more

On Wed 04-05-16 23:57:50, Joonsoo Kim wrote:
> 2016-05-04 17:56 GMT+09:00 Michal Hocko <mhocko@...nel.org>:
> > On Wed 04-05-16 15:31:12, Joonsoo Kim wrote:
> >> On Wed, May 04, 2016 at 03:01:24PM +0900, Joonsoo Kim wrote:
> >> > On Wed, Apr 20, 2016 at 03:47:25PM -0400, Michal Hocko wrote:
> > [...]
> >> > > @@ -3408,6 +3456,17 @@ __alloc_pages_slowpath(gfp_t gfp_mask, unsigned int order,
> >> > >                            no_progress_loops))
> >> > >           goto retry;
> >> > >
> >> > > + /*
> >> > > +  * It doesn't make any sense to retry for the compaction if the order-0
> >> > > +  * reclaim is not able to make any progress because the current
> >> > > +  * implementation of the compaction depends on the sufficient amount
> >> > > +  * of free memory (see __compaction_suitable)
> >> > > +  */
> >> > > + if (did_some_progress > 0 &&
> >> > > +                 should_compact_retry(order, compact_result,
> >> > > +                         &migration_mode, compaction_retries))
> >> >
> >> > Checking did_some_progress on each round have subtle corner case. Think
> >> > about following situation.
> >> >
> >> > round, compaction, did_some_progress, compaction
> >> > 0, defer, 1
> >> > 0, defer, 1
> >> > 0, defer, 1
> >> > 0, defer, 1
> >> > 0, defer, 0
> >>
> >> Oops...Example should be below one.
> >>
> >> 0, defer, 1
> >> 1, defer, 1
> >> 2, defer, 1
> >> 3, defer, 1
> >> 4, defer, 0
> >
> > I am not sure I understand. The point of the check is that if the
> > reclaim doesn't make _any_ progress then checking the result of the
> > compaction after it didn't lead to a successful allocation just doesn't
> > make any sense.
> 
> Even if this round (#4) doesn't reclaim any pages, previous rounds
> (#0, #1, #2, #3) would reclaim enough pages to succeed future
> compaction attempt.

Then the compaction shouldn't back off and I would consider it a
compaction bug. I haven't see this happening though. Vlastimil is
already working on patches which would simply guarantee that really
important allocations will not defer.

So unless I can see an example of a real issue with this I think it is
just a theoretical issue which shouldn't block the patch as is.
-- 
Michal Hocko
SUSE Labs