linux-kernel - Re: [patch 13/13] mm: memcontrol: rewrite uncharge API

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20140723150608.GF1725@cmpxchg.org>
Date:	Wed, 23 Jul 2014 11:06:08 -0400
From:	Johannes Weiner <hannes@...xchg.org>
To:	Michal Hocko <mhocko@...e.cz>
Cc:	Miklos Szeredi <miklos@...redi.hu>,
	Andrew Morton <akpm@...ux-foundation.org>,
	Hugh Dickins <hughd@...gle.com>, Tejun Heo <tj@...nel.org>,
	Vladimir Davydov <vdavydov@...allels.com>, linux-mm@...ck.org,
	cgroups@...r.kernel.org,
	Kernel Mailing List <linux-kernel@...r.kernel.org>
Subject: Re: [patch 13/13] mm: memcontrol: rewrite uncharge API

On Wed, Jul 23, 2014 at 04:38:47PM +0200, Michal Hocko wrote:
> On Tue 22-07-14 17:44:43, Miklos Szeredi wrote:
> > On Tue, Jul 22, 2014 at 5:08 PM, Michal Hocko <mhocko@...e.cz> wrote:
> > > On Sat 19-07-14 13:39:11, Johannes Weiner wrote:
> > >> On Fri, Jul 18, 2014 at 05:12:54PM +0200, Miklos Szeredi wrote:
> > >> > On Fri, Jul 18, 2014 at 4:45 PM, Johannes Weiner <hannes@...xchg.org> wrote:
> > >> >
> > >> > > I assumed the source page would always be new, according to this part
> > >> > > in fuse_try_move_page():
> > >> > >
> > >> > >         /*
> > >> > >          * This is a new and locked page, it shouldn't be mapped or
> > >> > >          * have any special flags on it
> > >> > >          */
> > >> > >         if (WARN_ON(page_mapped(oldpage)))
> > >> > >                 goto out_fallback_unlock;
> > >> > >         if (WARN_ON(page_has_private(oldpage)))
> > >> > >                 goto out_fallback_unlock;
> > >> > >         if (WARN_ON(PageDirty(oldpage) || PageWriteback(oldpage)))
> > >> > >                 goto out_fallback_unlock;
> > >> > >         if (WARN_ON(PageMlocked(oldpage)))
> > >> > >                 goto out_fallback_unlock;
> > >> > >
> > >> > > However, it's in the page cache and I can't really convince myself
> > >> > > that it's not also on the LRU.  Miklos, I have trouble pinpointing
> > >> > > where oldpage is instantiated exactly and what state it might be in -
> > >> > > can it already be on the LRU?
> > >> >
> > >> > oldpage comes from ->readpages() (*NOT* ->readpage()), i.e. readahead.
> > >> >
> > >> > AFAICS it is added to the LRU in read_cache_pages(), so it looks like
> > >> > it is definitely on the LRU at that point.
> > >
> > > OK, so my understanding of the code was wrong :/ and staring at it for
> > > quite a while didn't help much. The fuse code is so full of indirection
> > > it makes my head spin.
> > 
> > Definitely needs a rewrite.  But forget the complexities for the
> > moment and just consider this single case:
> > 
> >  ->readpages() is called to do some readahead, pages are locked, added
> > to the page cache and, AFAICS, charged to a memcg (in
> > add_to_page_cache_lru()).
> > 
> >  - fuse sends a READ request to userspace and it gets a reply with
> > splice(... SPLICE_F_MOVE).  What this means that a bunch of pages of
> > indefinite origin are to replace (if possible) the pages already in
> > the page cache.  If not possible, for some reason, it falls back to
> > copying the contents.  So, AFAICS, the oldpage and the newpage can be
> > charged to a different memcg.

Can the new page be anything else than previous page cache?  The pipe
buffer stealing code truncates them, but at that point they would
already be charged as cache.

> OK, thanks for the clarification. I had this feeling but couldn't wrap
> my head around the indirection of the code.
> 
> It seems that checkig PageCgroupUsed(new) and bail out early in
> mem_cgroup_migrate should just work, no?

If the new page is already charged as page cache, we could just drop
the call to mem_cgroup_migrate() altogether.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/