linux-kernel - [RFC PATCH 0/4] Add speculative numa fault support

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite for Android: free password hash cracker in your pocket

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Date:   Sun, 12 Dec 2021 19:31:56 +0800
From:   Baolin Wang <baolin.wang@...ux.alibaba.com>
To:     akpm@...ux-foundation.org, ying.huang@...el.com,
        dave.hansen@...ux.intel.com
Cc:     ziy@...dia.com, shy828301@...il.com, baolin.wang@...ux.alibaba.com,
        zhongjiang-ali@...ux.alibaba.com, xlpang@...ux.alibaba.com,
        linux-mm@...ck.org, linux-kernel@...r.kernel.org
Subject: [RFC PATCH 0/4] Add speculative numa fault support

Hi,

This RFC patch set adds speculative numa fault support for some scenarios,
like tiered memory system. On tiered memory system, it will rely on the
numa balancing to promote slow and hot memory to fast memory to improve
performance. So we can promote several sequential pages on slow memory
in advance according to the data locality for some workloads to improve
the performance.

So now how much pages need to be promoted to fast memory is the best? 
Now this RFC patch set only implements a basic and simple mechanism to
speculate the numa fault window for each VMA. It will introduce a new
atomic member for each VMA to record the numa fault window information,
which is used to determine if it is a sequential stream to expand or
reduance the numa fault window.

Now I can see about 6% improvement when testing mysql on tiered memory
system, more data can be found in patch 1. Looking forword to comments
and suggestion to make the algorithm more robust and suitable for more
scenarios. Thanks in advance.

Note: this patch set is based on the patch set implemented the tiered memory
promotion[1].

[1]
https://lore.kernel.org/lkml/87bl2gsnrd.fsf@yhuang6-desk2.ccr.corp.intel.com/T/

Baolin Wang (4):
  mm: Add speculative numa fault support
  mm: Add a debug interface to control the range of speculative numa
    fault
  mm: Add speculative numa fault stats
  mm: Update the speculative pages' accessing time

 include/linux/mm_types.h      |   3 +
 include/linux/vm_event_item.h |   1 +
 mm/memory.c                   | 222 ++++++++++++++++++++++++++++++++--
 mm/vmstat.c                   |   1 +
 4 files changed, 216 insertions(+), 11 deletions(-)

-- 
2.27.0