| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <157401267421.43284.2135775608523385279.stgit@dwillia2-desk3.amr.corp.intel.com>
Date: Sun, 17 Nov 2019 09:44:34 -0800
From: Dan Williams <dan.j.williams@...el.com>
To: linux-nvdimm@...ts.01.org
Cc: Ira Weiny <ira.weiny@...el.com>,
David Hildenbrand <david@...hat.com>,
Borislav Petkov <bp@...en8.de>,
Vishal Verma <vishal.l.verma@...el.com>,
"H. Peter Anvin" <hpa@...or.com>,
Thomas Gleixner <tglx@...utronix.de>,
"Aneesh Kumar K.V" <aneesh.kumar@...ux.ibm.com>,
kbuild test robot <lkp@...el.com>,
Andrew Morton <akpm@...ux-foundation.org>,
Peter Zijlstra <peterz@...radead.org>,
Benjamin Herrenschmidt <benh@...nel.crashing.org>,
Michal Hocko <mhocko@...e.com>,
Paul Mackerras <paulus@...ba.org>,
Christoph Hellwig <hch@....de>, Ingo Molnar <mingo@...hat.com>,
Dave Hansen <dave.hansen@...ux.intel.com>,
"Aneesh Kumar K.V" <aneesh.kumar@...ux.ibm.com>,
Michael Ellerman <mpe@...erman.id.au>, x86@...nel.org,
Oliver O'Halloran <oohall@...il.com>,
"Rafael J. Wysocki" <rjw@...ysocki.net>,
Andy Lutomirski <luto@...nel.org>,
linux-kernel@...r.kernel.org, linux-mm@...ck.org,
linux-acpi@...r.kernel.org
Subject: [PATCH v2 00/18] Memory Hierarchy: Enable target node lookups for
reserved memory
Changes since v1 [1]:
- Rework numa_map_to_online_node() to be compatible with papr_scm_node()
(Aneesh)
- Export the 'target_node' attribute for nvdimm regions and namespaces
(Aneesh)
- Rename memory_add_physaddr_to_target_nid() to phys_to_target_node()
and make it independent of CONFIG_MEMORY_HOTPLUG=y. Put a weak
definition in mm/mempolicy.c that can be overridden by an arch
implementation.
- Fix various build reports (kbuild-robot)
- Collect some reviewed-by's from Aneesh.
[1]: https://lore.kernel.org/r/157309899529.1582359.15358067933360719580.stgit@dwillia2-desk3.amr.corp.intel.com/
---
As mentioned in the v1 cover letter [1] the libnvdimm device-type cleanup is
intertwined with the new target_node infrastructure. The more interesting
patches for arch and mm folks start at patch 14.
This new infrastructure will prove more valuable over time for Memory
Tiers / Hierarchy management as more platforms (via the ACPI HMAT and
EFI Specific Purpose Memory) publish reserved or "soft-reserved" ranges
to Linux. Linux system administrators will expect to be able to interact
with those ranges with a unique numa node number when/if that memory is
onlined via the dax_kmem driver [2].
One configuration that currently fails to properly convey the target
node for the resulting memory hotplug operation is persistent memory
defined by the memmap=nn!ss parameter. For example, today if node1 is a
memory only node, and all the memory from node1 is specified to
memmap=nn!ss and subsequently onlined, it will end up being onlined as
node0 memory. As it stands, memory_add_physaddr_to_nid() can only
identify online nodes and since node1 in this example has no online cpus
/ memory the target node is initialized node0.
The fix is to preserve rather than discard the numa_meminfo entries that
are relevant for reserved memory ranges, and to uplevel the node
distance helper for determining the "local" (closest) node relative to
an initiator node.
The first 13 patches are cleanups to make sure that all nvdimm devices
and their children properly export a numa_node attribute, and add a
'target_node' attribute by default to regions and namespaces. The switch
to a device-type is less code and less error prone as a result.
Patch 14 - 17 are the core changes to allow numa node
information for offline memory to be tracked, and to provide a unified
node mapping distance helper across architectures
numa_map_to_online_node.
Patches 18 uses this new capability to fix the conveyance of target_node
information for memmap=nn!ss assignments. See patch 18 for more details
and the test case.
Given the timeframe to the v5.5 merge window I expect patch 14 - 18 will
likely miss due to not enough time to review, but posting them for
feedback nonetheless.
[2]: https://pmem.io/ndctl/daxctl-reconfigure-device.html
---
Dan Williams (18):
libnvdimm: Move attribute groups to device type
libnvdimm: Move region attribute group definition
libnvdimm: Move nd_device_attribute_group to device_type
libnvdimm: Move nd_numa_attribute_group to device_type
libnvdimm: Move nd_region_attribute_group to device_type
libnvdimm: Move nd_mapping_attribute_group to device_type
libnvdimm: Move nvdimm_attribute_group to device_type
libnvdimm: Move nvdimm_bus_attribute_group to device_type
dax: Create a dax device_type
dax: Simplify root read-only definition for the 'resource' attribute
libnvdimm: Simplify root read-only definition for the 'resource' attribute
dax: Add numa_node to the default device-dax attributes
libnvdimm: Export the target_node attribute for regions and namespaces
acpi/numa: Up-level "map to online node" functionality
mm/numa: Skip NUMA_NO_NODE and online nodes in numa_map_to_online_node()
powerpc/papr_scm: Switch to numa_map_to_online_node()
x86/numa: Provide a range-to-target_node lookup facility
libnvdimm/e820: Retrieve and populate correct 'target_node' info
arch/powerpc/platforms/pseries/papr_scm.c | 46 ------
arch/x86/mm/numa.c | 76 +++++++++
drivers/acpi/nfit/core.c | 7 -
drivers/acpi/numa.c | 41 -----
drivers/dax/bus.c | 22 ++-
drivers/nvdimm/btt_devs.c | 24 +--
drivers/nvdimm/bus.c | 44 +++++
drivers/nvdimm/core.c | 8 +
drivers/nvdimm/dax_devs.c | 27 +--
drivers/nvdimm/dimm_devs.c | 30 ++--
drivers/nvdimm/e820.c | 31 ----
drivers/nvdimm/namespace_devs.c | 77 +++++-----
drivers/nvdimm/nd.h | 5 -
drivers/nvdimm/of_pmem.c | 13 --
drivers/nvdimm/pfn_devs.c | 38 ++---
drivers/nvdimm/region_devs.c | 235 +++++++++++++++--------------
include/linux/acpi.h | 23 +++
include/linux/libnvdimm.h | 7 -
include/linux/numa.h | 17 ++
mm/mempolicy.c | 35 ++++
20 files changed, 430 insertions(+), 376 deletions(-)
Powered by blists - more mailing lists