linux-kernel - Re: [PATCH 00/35] Enhance memory utilization with DMEMFS

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite for Android: free password hash cracker in your pocket

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <CACZOiM2UbA-1hTVQkA4sjX+PVduCdjycFdenR2QxPqkG8kYxpg@mail.gmail.com>
Date:   Tue, 13 Oct 2020 10:45:14 +0800
From:   yulei zhang <yulei.kernel@...il.com>
To:     "Zengtao (B)" <prime.zeng@...ilicon.com>
Cc:     "akpm@...ux-foundation.org" <akpm@...ux-foundation.org>,
        "naoya.horiguchi@....com" <naoya.horiguchi@....com>,
        "viro@...iv.linux.org.uk" <viro@...iv.linux.org.uk>,
        "pbonzini@...hat.com" <pbonzini@...hat.com>,
        "linux-fsdevel@...r.kernel.org" <linux-fsdevel@...r.kernel.org>,
        "kvm@...r.kernel.org" <kvm@...r.kernel.org>,
        "linux-kernel@...r.kernel.org" <linux-kernel@...r.kernel.org>,
        "xiaoguangrong.eric@...il.com" <xiaoguangrong.eric@...il.com>,
        "kernellwp@...il.com" <kernellwp@...il.com>,
        "lihaiwei.kernel@...il.com" <lihaiwei.kernel@...il.com>,
        Yulei Zhang <yuleixzhang@...cent.com>
Subject: Re: [PATCH 00/35] Enhance memory utilization with DMEMFS

On Mon, Oct 12, 2020 at 7:57 PM Zengtao (B) <prime.zeng@...ilicon.com> wrote:
>
>
> > -----Original Message-----
> > From: yulei.kernel@...il.com [mailto:yulei.kernel@...il.com]
> > Sent: Thursday, October 08, 2020 3:54 PM
> > To: akpm@...ux-foundation.org; naoya.horiguchi@....com;
> > viro@...iv.linux.org.uk; pbonzini@...hat.com
> > Cc: linux-fsdevel@...r.kernel.org; kvm@...r.kernel.org;
> > linux-kernel@...r.kernel.org; xiaoguangrong.eric@...il.com;
> > kernellwp@...il.com; lihaiwei.kernel@...il.com; Yulei Zhang
> > Subject: [PATCH 00/35] Enhance memory utilization with DMEMFS
> >
> > From: Yulei Zhang <yuleixzhang@...cent.com>
> >
> > In current system each physical memory page is assocaited with
> > a page structure which is used to track the usage of this page.
> > But due to the memory usage rapidly growing in cloud environment,
> > we find the resource consuming for page structure storage becomes
> > highly remarkable. So is it an expense that we could spare?
> >
> > This patchset introduces an idea about how to save the extra
> > memory through a new virtual filesystem -- dmemfs.
> >
> > Dmemfs (Direct Memory filesystem) is device memory or reserved
> > memory based filesystem. This kind of memory is special as it
> > is not managed by kernel and most important it is without 'struct page'.
> > Therefore we can leverage the extra memory from the host system
> > to support more tenants in our cloud service.
> >
> > We uses a kernel boot parameter 'dmem=' to reserve the system
> > memory when the host system boots up, the details can be checked
> > in /Documentation/admin-guide/kernel-parameters.txt.
> >
> > Theoretically for each 4k physical page it can save 64 bytes if
> > we drop the 'struct page', so for guest memory with 320G it can
> > save about 5G physical memory totally.
>
> Sounds interesting, but seems your patch only support x86, have you
>  considered aarch64?
>
> Regards
> Zengtao

Thanks, so far we only verify it on x86 server, may extend to arm platform
in the future.