linux-kernel - [RFC PATCH 0/5] hot page swap to zram, cold page swap to swapfile directly

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-Id: <20231008095924.1165106-1-lincheng.yang@transsion.com>
Date:   Sun,  8 Oct 2023 17:59:19 +0800
From:   Lincheng Yang <lincheng.yang@...nssion.corp-partner.google.com>
To:     akpm@...ux-foundation.org, rostedt@...dmis.org,
        mhiramat@...nel.org, willy@...radead.org, hughd@...gle.com,
        peterx@...hat.com, mike.kravetz@...cle.com, jgg@...pe.ca,
        surenb@...gle.com, steven.price@....com, pasha.tatashin@...een.com,
        kirill.shutemov@...ux.intel.com, yuanchu@...gle.com,
        david@...hat.com, mathieu.desnoyers@...icios.com,
        dhowells@...hat.com, shakeelb@...gle.com, pcc@...gle.com,
        tytso@....edu, 42.hyeyoo@...il.com, vbabka@...e.cz,
        catalin.marinas@....com, lrh2000@....edu.cn, ying.huang@...el.com,
        mhocko@...e.com, vishal.moola@...il.com, yosryahmed@...gle.com,
        findns94@...il.com, neilb@...e.de
Cc:     linux-kernel@...r.kernel.org, linux-mm@...ck.org,
        wanbin.wang@...nssion.com, chunlei.zhuang@...nssion.com,
        jinsheng.zhao@...nssion.com, jiajun.ling@...nssion.com,
        dongyun.liu@...nssion.com,
        Lincheng Yang <lincheng.yang@...nssion.com>
Subject: [RFC PATCH 0/5] hot page swap to zram, cold page swap to swapfile directly

Hi All,

We team developed a feature in Android linux v4.19 that can directly swapout
cold pages to the swapfile device and hot pages to the ZRAM device. This can
reduce the lag when writing back cold pages to backing-dev through ZRAM when
there is a lot of memory pressure, saving the ZRAM compression/decompression
process. Especially for low-end Android devices, low CPU frequency and small
memory.

Currently, Android uses the GKI strategy. We cannot directly modify the Linux
kernel to support this feature. We can only support it through the hook vendor.
However, this feature involves too many modifications. Google TAM suggested
that we push this feature to the Linux community.

The main changes are as follows:
[PATCH 2/5]: Set the hot and cold status for each page.
             If it is a cold page, it is swapout to the swapfile directly.
             If it is a hot page, it is swapout to the ZRAM device.
[PATCH 3/5]: When a VMA has many hot pages, predict that the VMA is hot,
             so that all anonymous pages of this VMA are hot and are only
             swapout to the ZRAM device.
[PATCH 4/5]: When user space uses madvise/process_madvise(MADV_PAGEOUT),
             swapout to the swapfile device directly.
[PATCH 5/5]: When the storage life of the external storage device is too
             low or the amount of daily writes to swapfile is too high,
             the user turns off swapout hot/cold page to the swapfile
             device and can only swapout to the ZRAM device.

This series is based on linux v6.5, this is just porting the core function to
linux v6.5.

If similar function already exists in the kernel, please let me know and give
it a shout, also comments and suggestions are welcome.

Thanks,
Lincheng Yang


Lincheng Yang (5):
  mm/swap_slots: cleanup swap slot cache
  mm: introduce hot and cold anon page flags
  mm: add VMA hot flag
  mm: add page implyreclaim flag
  mm/swapfile: add swapfile_write_enable interface

 fs/proc/task_mmu.c             |   3 +
 include/linux/mm.h             |  32 +++++++
 include/linux/mm_types.h       |   2 +
 include/linux/mm_types_task.h  |  10 +++
 include/linux/mmzone.h         |   1 +
 include/linux/page-flags.h     |   9 ++
 include/linux/swap.h           |   8 +-
 include/linux/swap_slots.h     |   2 +-
 include/trace/events/mmflags.h |   6 +-
 mm/filemap.c                   |   2 +
 mm/madvise.c                   |   7 +-
 mm/memory.c                    |  44 ++++++++++
 mm/migrate.c                   |   6 ++
 mm/rmap.c                      |   3 +
 mm/shmem.c                     |   2 +-
 mm/swap.h                      |   4 +-
 mm/swap_slots.c                | 133 +++++++++++++++++-----------
 mm/swap_state.c                |   4 +-
 mm/swapfile.c                  | 153 +++++++++++++++++++++++++++++++--
 mm/vmscan.c                    |  22 ++++-
 20 files changed, 384 insertions(+), 69 deletions(-)

--
2.34.1