[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <cover.1751979184.git.leon@kernel.org>
Date: Wed, 9 Jul 2025 09:42:07 +0300
From: Leon Romanovsky <leon@...nel.org>
To: Jason Gunthorpe <jgg@...dia.com>
Cc: Edward Srouji <edwards@...dia.com>,
linux-rdma@...r.kernel.org,
Michael Guralnik <michaelgur@...dia.com>,
netdev@...r.kernel.org,
Saeed Mahameed <saeedm@...dia.com>,
Tariq Toukan <tariqt@...dia.com>
Subject: [PATCH rdma-next 0/4] Optimize DMABUF mkey page size in mlx5
>From Edward:
This patch series enables the mlx5 driver to dynamically choose the
optimal page size for a DMABUF-based memory key (mkey), rather than
always registering with a fixed page size.
Previously, DMABUF memory registration used a fixed 4K page size for
mkeys which could lead to suboptimal performance when the underlying
memory layout may offer better page sizes.
This approach did not take advantage of larger page size capabilities
advertised by the HCA, and the driver was not setting the proper page
size mask in the mkey mask when performing page size changes, potentially
leading to invalid registrations when updating to a very large pages.
This series improves DMABUF performance by dynamically selecting the
best page size for a given memory region (MR) both at creation time and
on page fault occurrences, based on the underlying layout and fixing
related gaps and bugs.
By doing so, we reduce the number of page table entries (and thus MTT/
KSM descriptors) that the HCA must traverse, which in turn reduces
cache-line fetches.
Thanks
Edward Srouji (2):
RDMA/mlx5: Fix UMR modifying of mkey page size
RDMA/mlx5: Optimize DMABUF mkey page size
Michael Guralnik (2):
net/mlx5: Expose HCA capability bits for mkey max page size
RDMA/mlx5: Align mkc page size capability check to PRM
drivers/infiniband/hw/mlx5/mlx5_ib.h | 77 +++++--
drivers/infiniband/hw/mlx5/mr.c | 10 +-
drivers/infiniband/hw/mlx5/odp.c | 31 ++-
drivers/infiniband/hw/mlx5/umr.c | 306 ++++++++++++++++++++++++---
drivers/infiniband/hw/mlx5/umr.h | 13 +-
include/linux/mlx5/device.h | 1 +
include/linux/mlx5/mlx5_ifc.h | 4 +-
7 files changed, 387 insertions(+), 55 deletions(-)
--
2.50.0
Powered by blists - more mailing lists