linux-kernel - Re: [PATCH 01/18] mm, hugetlb: protect reserved pages when softofflining requests the pages

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <87siytwfl0.fsf@linux.vnet.ibm.com>
Date:	Thu, 01 Aug 2013 21:47:31 +0530
From:	"Aneesh Kumar K.V" <aneesh.kumar@...ux.vnet.ibm.com>
To:	Hillf Danton <dhillf@...il.com>,
	Joonsoo Kim <iamjoonsoo.kim@....com>
Cc:	Andrew Morton <akpm@...ux-foundation.org>,
	Rik van Riel <riel@...hat.com>, Mel Gorman <mgorman@...e.de>,
	Michal Hocko <mhocko@...e.cz>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@...fujitsu.com>,
	Hugh Dickins <hughd@...gle.com>,
	Davidlohr Bueso <davidlohr.bueso@...com>,
	David Gibson <david@...son.dropbear.id.au>, linux-mm@...ck.org,
	linux-kernel@...r.kernel.org,
	Wanpeng Li <liwanp@...ux.vnet.ibm.com>,
	Naoya Horiguchi <n-horiguchi@...jp.nec.com>
Subject: Re: [PATCH 01/18] mm, hugetlb: protect reserved pages when softofflining requests the pages

Hillf Danton <dhillf@...il.com> writes:

> On Wed, Jul 31, 2013 at 2:37 PM, Joonsoo Kim <iamjoonsoo.kim@....com> wrote:
>> On Wed, Jul 31, 2013 at 02:21:38PM +0800, Hillf Danton wrote:
>>> On Wed, Jul 31, 2013 at 12:41 PM, Joonsoo Kim <iamjoonsoo.kim@....com> wrote:
>>> > On Wed, Jul 31, 2013 at 10:49:24AM +0800, Hillf Danton wrote:
>>> >> On Wed, Jul 31, 2013 at 10:27 AM, Joonsoo Kim <iamjoonsoo.kim@....com> wrote:
>>> >> > On Mon, Jul 29, 2013 at 03:24:46PM +0800, Hillf Danton wrote:
>>> >> >> On Mon, Jul 29, 2013 at 1:31 PM, Joonsoo Kim <iamjoonsoo.kim@....com> wrote:
>>> >> >> > alloc_huge_page_node() use dequeue_huge_page_node() without
>>> >> >> > any validation check, so it can steal reserved page unconditionally.
>>> >> >>
>>> >> >> Well, why is it illegal to use reserved page here?
>>> >> >
>>> >> > If we use reserved page here, other processes which are promised to use
>>> >> > enough hugepages cannot get enough hugepages and can die. This is
>>> >> > unexpected result to them.
>>> >> >
>>> >> But, how do you determine that a huge page is requested by a process
>>> >> that is not allowed to use reserved pages?
>>> >
>>> > Reserved page is just one for each address or file offset. If we need to
>>> > move this page, this means that it already use it's own reserved page, this
>>> > page is it. So we should not use other reserved page for moving this page.
>>> >
>>> Hm, how do you determine "this page" is not buddy?
>>
>> If this page comes from the buddy, it doesn't matter. It imply that
>> this mapping cannot use reserved page pool, because we always allocate
>> a page from reserved page pool first.
>>
> A buddy page also implies, if the mapping can use reserved pages, that no
> reserved page was available when requested. Now we can try reserved
> page again.

I didn't quiet get that. My understanding is, the new page we are
allocating here for soft offline should not be allocated from the
reserve pool. If we do that we may possibly have allocation failure
later for a request that had done page reservation. Now to
avoid that we make sure we have enough free pages outside reserve pool
so that we can dequeue the huge page. If not we use buddy to allocate
the hugepage.

-aneesh

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/