Message-ID: <20191021082841.GD9379@dhcp22.suse.cz>
Date:   Mon, 21 Oct 2019 10:28:41 +0200
From:   Michal Hocko <mhocko@...nel.org>
To:     linux-kernel@...r.kernel.org
Cc:     akpm@...ux-foundation.org, alexander.h.duyck@...ux.intel.com,
        aneesh.kumar@...ux.ibm.com, anshuman.khandual@....com,
        benh@...nel.crashing.org, borntraeger@...ibm.com, bp@...en8.de,
        cai@....pw, catalin.marinas@....com, christophe.leroy@....fr,
        dalias@...c.org, damian.tometzki@...il.com,
        dan.j.williams@...el.com, dave.hansen@...ux.intel.com,
        david@...hat.com, fenghua.yu@...el.com, gerald.schaefer@...ibm.com,
        glider@...gle.com, gor@...ux.ibm.com, gregkh@...uxfoundation.org,
        heiko.carstens@...ibm.com, hpa@...or.com, ira.weiny@...el.com,
        jgg@...pe.ca, linux-mm@...ck.org, logang@...tatee.com,
        luto@...nel.org, mark.rutland@....com, mgorman@...hsingularity.net,
        mingo@...hat.com, mm-commits@...r.kernel.org, mpe@...erman.id.au,
        osalvador@...e.de, pagupta@...hat.com, pasha.tatashin@...een.com,
        pasic@...ux.ibm.com, paulus@...ba.org,
        pavel.tatashin@...rosoft.com, peterz@...radead.org,
        richard.weiyang@...il.com, richardw.yang@...ux.intel.com,
        robin.murphy@....com, rppt@...ux.ibm.com, stable@...r.kernel.org,
        steve.capper@....com, tglx@...utronix.de, thomas.lendacky@....com,
        tony.luck@...el.com, torvalds@...ux-foundation.org, vbabka@...e.cz,
        will@...nel.org, willy@...radead.org,
        yamada.masahiro@...ionext.com, yaojun8558363@...il.com,
        ysato@...rs.sourceforge.jp, yuzhao@...gle.com
Subject: Re: [patch 06/26] mm/memory_hotplug: don't access uninitialized
 memmaps in shrink_pgdat_span()

Has this been reviewed properly? I do not see any Acks nor Reviewed-bys.
Did Aneesh gave it some testing?

On Fri 18-10-19 20:19:33, Andrew Morton wrote:
> From: David Hildenbrand <david@...hat.com>
> Subject: mm/memory_hotplug: don't access uninitialized memmaps in shrink_pgdat_span()
> 
> We might use the nid of memmaps that were never initialized.  For example,
> if the memmap was poisoned, we will crash the kernel in pfn_to_nid() right
> now.  Let's use the calculated boundaries of the separate zones instead. 
> This now also avoids having to iterate over a whole bunch of subsections
> again, after shrinking one zone.
> 
> Before commit d0dc12e86b31 ("mm/memory_hotplug: optimize memory hotplug"),
> the memmap was initialized to 0 and the node was set to the right value. 
> After that commit, the node might be garbage.
> 
> We'll have to fix shrink_zone_span() next.
> 
> Link: http://lkml.kernel.org/r/20191006085646.5768-4-david@redhat.com
> Fixes: f1dd2cd13c4b ("mm, memory_hotplug: do not associate hotadded memory to zones until online")	[d0dc12e86b319]
> Signed-off-by: David Hildenbrand <david@...hat.com>
> Reported-by: Aneesh Kumar K.V <aneesh.kumar@...ux.ibm.com>
> Cc: Oscar Salvador <osalvador@...e.de>
> Cc: David Hildenbrand <david@...hat.com>
> Cc: Michal Hocko <mhocko@...e.com>
> Cc: Pavel Tatashin <pasha.tatashin@...een.com>
> Cc: Dan Williams <dan.j.williams@...el.com>
> Cc: Wei Yang <richardw.yang@...ux.intel.com>
> Cc: Alexander Duyck <alexander.h.duyck@...ux.intel.com>
> Cc: Alexander Potapenko <glider@...gle.com>
> Cc: Andy Lutomirski <luto@...nel.org>
> Cc: Anshuman Khandual <anshuman.khandual@....com>
> Cc: Benjamin Herrenschmidt <benh@...nel.crashing.org>
> Cc: Borislav Petkov <bp@...en8.de>
> Cc: Catalin Marinas <catalin.marinas@....com>
> Cc: Christian Borntraeger <borntraeger@...ibm.com>
> Cc: Christophe Leroy <christophe.leroy@....fr>
> Cc: Damian Tometzki <damian.tometzki@...il.com>
> Cc: Dave Hansen <dave.hansen@...ux.intel.com>
> Cc: Fenghua Yu <fenghua.yu@...el.com>
> Cc: Gerald Schaefer <gerald.schaefer@...ibm.com>
> Cc: Greg Kroah-Hartman <gregkh@...uxfoundation.org>
> Cc: Halil Pasic <pasic@...ux.ibm.com>
> Cc: Heiko Carstens <heiko.carstens@...ibm.com>
> Cc: "H. Peter Anvin" <hpa@...or.com>
> Cc: Ingo Molnar <mingo@...hat.com>
> Cc: Ira Weiny <ira.weiny@...el.com>
> Cc: Jason Gunthorpe <jgg@...pe.ca>
> Cc: Jun Yao <yaojun8558363@...il.com>
> Cc: Logan Gunthorpe <logang@...tatee.com>
> Cc: Mark Rutland <mark.rutland@....com>
> Cc: Masahiro Yamada <yamada.masahiro@...ionext.com>
> Cc: "Matthew Wilcox (Oracle)" <willy@...radead.org>
> Cc: Mel Gorman <mgorman@...hsingularity.net>
> Cc: Michael Ellerman <mpe@...erman.id.au>
> Cc: Mike Rapoport <rppt@...ux.ibm.com>
> Cc: Pankaj Gupta <pagupta@...hat.com>
> Cc: Paul Mackerras <paulus@...ba.org>
> Cc: Pavel Tatashin <pavel.tatashin@...rosoft.com>
> Cc: Peter Zijlstra <peterz@...radead.org>
> Cc: Qian Cai <cai@....pw>
> Cc: Rich Felker <dalias@...c.org>
> Cc: Robin Murphy <robin.murphy@....com>
> Cc: Steve Capper <steve.capper@....com>
> Cc: Thomas Gleixner <tglx@...utronix.de>
> Cc: Tom Lendacky <thomas.lendacky@....com>
> Cc: Tony Luck <tony.luck@...el.com>
> Cc: Vasily Gorbik <gor@...ux.ibm.com>
> Cc: Vlastimil Babka <vbabka@...e.cz>
> Cc: Wei Yang <richard.weiyang@...il.com>
> Cc: Will Deacon <will@...nel.org>
> Cc: Yoshinori Sato <ysato@...rs.sourceforge.jp>
> Cc: Yu Zhao <yuzhao@...gle.com>
> Cc: <stable@...r.kernel.org>	[4.13+]
> Signed-off-by: Andrew Morton <akpm@...ux-foundation.org>
> ---
> 
>  mm/memory_hotplug.c |   74 +++++++++---------------------------------
>  1 file changed, 16 insertions(+), 58 deletions(-)
> 
> --- a/mm/memory_hotplug.c~mm-memory_hotplug-dont-access-uninitialized-memmaps-in-shrink_pgdat_span
> +++ a/mm/memory_hotplug.c
> @@ -436,67 +436,25 @@ static void shrink_zone_span(struct zone
>  	zone_span_writeunlock(zone);
>  }
>  
> -static void shrink_pgdat_span(struct pglist_data *pgdat,
> -			      unsigned long start_pfn, unsigned long end_pfn)
> +static void update_pgdat_span(struct pglist_data *pgdat)
>  {
> -	unsigned long pgdat_start_pfn = pgdat->node_start_pfn;
> -	unsigned long p = pgdat_end_pfn(pgdat); /* pgdat_end_pfn namespace clash */
> -	unsigned long pgdat_end_pfn = p;
> -	unsigned long pfn;
> -	int nid = pgdat->node_id;
> -
> -	if (pgdat_start_pfn == start_pfn) {
> -		/*
> -		 * If the section is smallest section in the pgdat, it need
> -		 * shrink pgdat->node_start_pfn and pgdat->node_spanned_pages.
> -		 * In this case, we find second smallest valid mem_section
> -		 * for shrinking zone.
> -		 */
> -		pfn = find_smallest_section_pfn(nid, NULL, end_pfn,
> -						pgdat_end_pfn);
> -		if (pfn) {
> -			pgdat->node_start_pfn = pfn;
> -			pgdat->node_spanned_pages = pgdat_end_pfn - pfn;
> -		}
> -	} else if (pgdat_end_pfn == end_pfn) {
> -		/*
> -		 * If the section is biggest section in the pgdat, it need
> -		 * shrink pgdat->node_spanned_pages.
> -		 * In this case, we find second biggest valid mem_section for
> -		 * shrinking zone.
> -		 */
> -		pfn = find_biggest_section_pfn(nid, NULL, pgdat_start_pfn,
> -					       start_pfn);
> -		if (pfn)
> -			pgdat->node_spanned_pages = pfn - pgdat_start_pfn + 1;
> -	}
> -
> -	/*
> -	 * If the section is not biggest or smallest mem_section in the pgdat,
> -	 * it only creates a hole in the pgdat. So in this case, we need not
> -	 * change the pgdat.
> -	 * But perhaps, the pgdat has only hole data. Thus it check the pgdat
> -	 * has only hole or not.
> -	 */
> -	pfn = pgdat_start_pfn;
> -	for (; pfn < pgdat_end_pfn; pfn += PAGES_PER_SUBSECTION) {
> -		if (unlikely(!pfn_valid(pfn)))
> -			continue;
> -
> -		if (pfn_to_nid(pfn) != nid)
> -			continue;
> -
> -		/* Skip range to be removed */
> -		if (pfn >= start_pfn && pfn < end_pfn)
> -			continue;
> +	unsigned long node_start_pfn = 0, node_end_pfn = 0;
> +	struct zone *zone;
>  
> -		/* If we find valid section, we have nothing to do */
> -		return;
> +	for (zone = pgdat->node_zones;
> +	     zone < pgdat->node_zones + MAX_NR_ZONES; zone++) {
> +		unsigned long zone_end_pfn = zone->zone_start_pfn +
> +					     zone->spanned_pages;
> +
> +		/* No need to lock the zones, they can't change. */
> +		if (zone_end_pfn > node_end_pfn)
> +			node_end_pfn = zone_end_pfn;
> +		if (zone->zone_start_pfn < node_start_pfn)
> +			node_start_pfn = zone->zone_start_pfn;
>  	}
>  
> -	/* The pgdat has no valid section */
> -	pgdat->node_start_pfn = 0;
> -	pgdat->node_spanned_pages = 0;
> +	pgdat->node_start_pfn = node_start_pfn;
> +	pgdat->node_spanned_pages = node_end_pfn - node_start_pfn;
>  }
>  
>  static void __remove_zone(struct zone *zone, unsigned long start_pfn,
> @@ -507,7 +465,7 @@ static void __remove_zone(struct zone *z
>  
>  	pgdat_resize_lock(zone->zone_pgdat, &flags);
>  	shrink_zone_span(zone, start_pfn, start_pfn + nr_pages);
> -	shrink_pgdat_span(pgdat, start_pfn, start_pfn + nr_pages);
> +	update_pgdat_span(pgdat);
>  	pgdat_resize_unlock(zone->zone_pgdat, &flags);
>  }
>  
> _

-- 
Michal Hocko
SUSE Labs

Powered by blists - more mailing lists