linux-kernel - Re: [PATCH v4 03/11] mm: memcontrol: make lruvec lock safe when LRU pages are reparented

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <Yo4pPw+IHPBZvZUv@FVFYT0MHHV2J.googleapis.com>
Date:   Wed, 25 May 2022 21:03:59 +0800
From:   Muchun Song <songmuchun@...edance.com>
To:     Johannes Weiner <hannes@...xchg.org>
Cc:     mhocko@...nel.org, roman.gushchin@...ux.dev, shakeelb@...gle.com,
        cgroups@...r.kernel.org, linux-mm@...ck.org,
        linux-kernel@...r.kernel.org, duanxiongchun@...edance.com,
        longman@...hat.com
Subject: Re: [PATCH v4 03/11] mm: memcontrol: make lruvec lock safe when LRU
 pages are reparented

On Wed, May 25, 2022 at 08:30:15AM -0400, Johannes Weiner wrote:
> On Wed, May 25, 2022 at 05:53:30PM +0800, Muchun Song wrote:
> > On Tue, May 24, 2022 at 03:27:20PM -0400, Johannes Weiner wrote:
> > > On Tue, May 24, 2022 at 02:05:43PM +0800, Muchun Song wrote:
> > > > The diagram below shows how to make the folio lruvec lock safe when LRU
> > > > pages are reparented.
> > > > 
> > > > folio_lruvec_lock(folio)
> > > >     retry:
> > > > 	lruvec = folio_lruvec(folio);
> > > > 
> > > >         // The folio is reparented at this time.
> > > >         spin_lock(&lruvec->lru_lock);
> > > > 
> > > >         if (unlikely(lruvec_memcg(lruvec) != folio_memcg(folio)))
> > > >             // Acquired the wrong lruvec lock and need to retry.
> > > >             // Because this folio is on the parent memcg lruvec list.
> > > >             goto retry;
> > > > 
> > > >         // If we reach here, it means that folio_memcg(folio) is stable.
> > > > 
> > > > memcg_reparent_objcgs(memcg)
> > > >     // lruvec belongs to memcg and lruvec_parent belongs to parent memcg.
> > > >     spin_lock(&lruvec->lru_lock);
> > > >     spin_lock(&lruvec_parent->lru_lock);
> > > > 
> > > >     // Move all the pages from the lruvec list to the parent lruvec list.
> > > > 
> > > >     spin_unlock(&lruvec_parent->lru_lock);
> > > >     spin_unlock(&lruvec->lru_lock);
> > > > 
> > > > After we acquire the lruvec lock, we need to check whether the folio is
> > > > reparented. If so, we need to reacquire the new lruvec lock. On the
> > > > routine of the LRU pages reparenting, we will also acquire the lruvec
> > > > lock (will be implemented in the later patch). So folio_memcg() cannot
> > > > be changed when we hold the lruvec lock.
> > > > 
> > > > Since lruvec_memcg(lruvec) is always equal to folio_memcg(folio) after
> > > > we hold the lruvec lock, lruvec_memcg_debug() check is pointless. So
> > > > remove it.
> > > > 
> > > > This is a preparation for reparenting the LRU pages.
> > > > 
> > > > Signed-off-by: Muchun Song <songmuchun@...edance.com>
> > > 
> > > This looks good to me. Just one question:
> > > 
> > > > @@ -1230,10 +1213,23 @@ void lruvec_memcg_debug(struct lruvec *lruvec, struct folio *folio)
> > > >   */
> > > >  struct lruvec *folio_lruvec_lock(struct folio *folio)
> > > >  {
> > > > -	struct lruvec *lruvec = folio_lruvec(folio);
> > > > +	struct lruvec *lruvec;
> > > >  
> > > > +	rcu_read_lock();
> > > > +retry:
> > > > +	lruvec = folio_lruvec(folio);
> > > >  	spin_lock(&lruvec->lru_lock);
> > > > -	lruvec_memcg_debug(lruvec, folio);
> > > > +
> > > > +	if (unlikely(lruvec_memcg(lruvec) != folio_memcg(folio))) {
> > > > +		spin_unlock(&lruvec->lru_lock);
> > > > +		goto retry;
> > > > +	}
> > > > +
> > > > +	/*
> > > > +	 * Preemption is disabled in the internal of spin_lock, which can serve
> > > > +	 * as RCU read-side critical sections.
> > > > +	 */
> > > > +	rcu_read_unlock();
> > > 
> > > The code looks right to me, but I don't understand the comment: why do
> > > we care that the rcu read-side continues? With the lru_lock held,
> > > reparenting is on hold and the lruvec cannot be rcu-freed anyway, no?
> > >
> > 
> > Right. We could hold rcu read lock until end of reparting.  So you mean
> > we do rcu_read_unlock in folio_lruvec_lock()?
> 
> The comment seems to suggest that disabling preemption is what keeps
> the lruvec alive. But it's the lru_lock that keeps it alive. The
> cgroup destruction path tries to take the lru_lock long before it even
> gets to synchronize_rcu(). Once you hold the lru_lock, having an
> implied read-side critical section as well doesn't seem to matter.
>

Well, I thought that spinlocks have implicit read-side critical sections
because it disables preemption (I learned from the comments above
synchronize_rcu() that says interrupts, preemption, or softirqs have been
disabled also serve as RCU read-side critical sections).  So I have a
question: is it still true in a PREEMPT_RT kernel (I am not familiar with
this)?

> Should the comment be deleted?
>

I think we could remove the comments. If the above question is false, seems
like we should continue holding rcu read lock.

Thanks.