linux-kernel - [PATCH] - Improve drain pages performance on large systems

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-ID: <20110215223840.GA27420@sgi.com>
Date:	Tue, 15 Feb 2011 16:38:40 -0600
From:	Jack Steiner <steiner@....com>
To:	linux-mm@...ck.org, akpm@...ux-foundation.org
Cc:	linux-kernel@...r.kernel.org
Subject: [PATCH] - Improve drain pages performance on large systems

Heavy swapping within a cpuset causes frequent calls to drain_all_pages().
This sends IPIs to all cpus to free PCP pages. In most cases, there are
no pages to be freed on cpus outside of the swapping cpuset.

Add checks to minimize locking and updates to potentially hot cachelines.
Before acquiring locks, do a quick check to see if any pages are in the PCP
queues. Exit if none.

On a 128 node SGI UV system, this reduced the IPI overhead to cpus outside of the
swapping cpuset by 38% and improved time to run a pass of the swaping test
from 98 sec to 51 sec. These times are obviously test & configuration
dependent but the improvements are significant.

Signed-off-by: Jack Steiner <steiner@....com>

---
 mm/page_alloc.c |   14 ++++++++++++++
 1 file changed, 14 insertions(+)

Index: linux/mm/page_alloc.c
===================================================================
--- linux.orig/mm/page_alloc.c	2011-02-15 16:28:36.165921713 -0600
+++ linux/mm/page_alloc.c	2011-02-15 16:29:43.085502487 -0600
@@ -592,10 +592,24 @@ static void free_pcppages_bulk(struct zo
 	int batch_free = 0;
 	int to_free = count;

+	/*
+	 * Quick scan of zones. If all are empty, there is nothing to do.
+	 */
+	for (migratetype = 0; migratetype < MIGRATE_PCPTYPES; migratetype++) {
+		struct list_head *list;
+
+		list = &pcp->lists[migratetype];
+		if (!list_empty(list))
+			break;
+	}
+	if (migratetype == MIGRATE_PCPTYPES)
+		return;
+
 	spin_lock(&zone->lock);
 	zone->all_unreclaimable = 0;
 	zone->pages_scanned = 0;

+	migratetype = 0;
 	while (to_free) {
 		struct page *page;
 		struct list_head *list;
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/