| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <alpine.DEB.2.00.0911290834470.20857@sebohet.brgvxre.pu> Date: Sun, 29 Nov 2009 08:42:09 +0100 (CET) From: Tobi Oetiker <tobi@...iker.ch> To: Mel Gorman <mel@....ul.ie> cc: Andrew Morton <akpm@...ux-foundation.org>, KOSAKI Motohiro <kosaki.motohiro@...fujitsu.com>, Frans Pop <elendil@...net.nl>, Jiri Kosina <jkosina@...e.cz>, Sven Geggus <lists@...hsschwanzdomain.de>, Karol Lewandowski <karol.k.lewandowski@...il.com>, linux-kernel@...r.kernel.org, "linux-mm@...ck.org" <linux-mm@...ck.org>, Pekka Enberg <penberg@...helsinki.fi>, Rik van Riel <riel@...hat.com>, Christoph Lameter <cl@...ux-foundation.org>, Stephan von Krawczynski <skraw@...net.com>, "Rafael J. Wysocki" <rjw@...k.pl>, Kernel Testers List <kernel-testers@...r.kernel.org> Subject: still getting allocation failures (was Re: [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2) Hi Mel, Thursday Tobias Oetiker wrote: > Hi Mel, > > Nov 13 Mel Gorman wrote: > > > The last version has a stupid bug in it. Sorry. > > > > Changelog since V1 > > o Fix incorrect negation > > o Rename kswapd_no_congestion_wait to kswapd_skip_congestion_wait as > > suggested by Rik > > > > If reclaim fails to make sufficient progress, the priority is raised. > > Once the priority is higher, kswapd starts waiting on congestion. However, > > if the zone is below the min watermark then kswapd needs to continue working > > without delay as there is a danger of an increased rate of GFP_ATOMIC > > allocation failure. > > > > This patch changes the conditions under which kswapd waits on > > congestion by only going to sleep if the min watermarks are being met. > > I finally got around to test this together with the whole series on > 2.6.31.6. after running it for a day I have not yet seen a single > order:5 allocation problem ... (while I had several an hour before) > for the record, my kernel is now running with the following > patches: > > patch1:Date: Thu, 12 Nov 2009 19:30:31 +0000 > patch1:Subject: [PATCH 1/5] page allocator: Always wake kswapd when restarting an allocation attempt after direct reclaim failed > > patch2:Date: Thu, 12 Nov 2009 19:30:32 +0000 > patch2:Subject: [PATCH 2/5] page allocator: Do not allow interrupts to use ALLOC_HARDER > > patch3:Date: Thu, 12 Nov 2009 19:30:33 +0000 > patch3:Subject: [PATCH 3/5] page allocator: Wait on both sync and async congestion after direct reclaim > > patch4:Date: Thu, 12 Nov 2009 19:30:34 +0000 > patch4:Subject: [PATCH 4/5] vmscan: Have kswapd sleep for a short interval and double check it should be asleep > > patch5:Date: Fri, 13 Nov 2009 20:03:57 +0000 > patch5:Subject: [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2 > > patch6:Date: Tue, 17 Nov 2009 10:34:21 +0000 > patch6:Subject: [PATCH] vmscan: Have kswapd sleep for a short interval and double check it should be asleep fix 1 > I have now been running the new kernel for a few days and I am sorry to report that about a day after booting the allocation failures started showing again. More order:4 instead of order:5 ... Nov 29 07:16:17 johan kernel: [261565.598627] nfsd: page allocation failure. order:4, mode:0x4020 [kern.warning] Nov 29 07:16:17 johan kernel: [261565.598638] Pid: 6956, comm: nfsd Tainted: G D 2.6.31.6-oep #1 [kern.warning] Nov 29 07:16:17 johan kernel: [261565.598641] Call Trace: [kern.warning] Nov 29 07:16:17 johan kernel: [261565.598646] <IRQ> [<ffffffff810cb730>] __alloc_pages_nodemask+0x570/0x690 [kern.warning] Nov 29 07:16:17 johan kernel: [261565.598672] [<ffffffff8142aba5>] ? tcp_tso_segment+0x265/0x2e0 [kern.warning] Nov 29 07:16:17 johan kernel: [261565.598680] [<ffffffff810faf08>] kmalloc_large_node+0x68/0xc0 [kern.warning] Nov 29 07:16:17 johan kernel: [261565.598692] [<ffffffff810febfa>] __kmalloc_node_track_caller+0x11a/0x180 [kern.warning] the fact that there were no problems right after booting might give some indication as to where the problem is. This is on a machine with 24 GB of memory, as you can see from the 'top' headers, it has plenty of room to spare and should never run into allocation problems anyway. The only thing that would have changed after running it for about a day is that more memory is used for caching ... # cat /proc/meminfo MemTotal: 24746268 kB MemFree: 128012 kB Buffers: 6255988 kB Cached: 10600780 kB SwapCached: 23668 kB Active: 13078944 kB Inactive: 9229172 kB Active(anon): 5455164 kB Inactive(anon): 508616 kB Active(file): 7623780 kB Inactive(file): 8720556 kB Unevictable: 291768 kB Mlocked: 291768 kB SwapTotal: 83886056 kB SwapFree: 83846520 kB Dirty: 2028 kB Writeback: 0 kB AnonPages: 5723748 kB Mapped: 152240 kB Slab: 1339176 kB SReclaimable: 1270156 kB SUnreclaim: 69020 kB PageTables: 31208 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 101208440 kB Committed_AS: 8146696 kB VmallocTotal: 34359738367 kB VmallocUsed: 115084 kB VmallocChunk: 34359518011 kB HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB DirectMap4k: 10176 kB DirectMap2M: 25155584 kB hth tobi -- Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland http://it.oetiker.ch tobi@...iker.ch ++41 62 775 9902 / sb: -9900 -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@...r.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Powered by blists - more mailing lists