[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20140318140717.GA21372@localhost>
Date: Tue, 18 Mar 2014 22:07:17 +0800
From: Fengguang Wu <fengguang.wu@...el.com>
To: Lars Ellenberg <lars.ellenberg@...bit.com>
Cc: Philipp Reisner <philipp.reisner@...bit.com>,
drbd-user@...ts.linbit.com, linux-kernel@...r.kernel.org
Subject: [drbd] Kernel panic - not syncing: Out of memory and no killable
processes...
Greetings,
We get the below OOM errors in our KVM boot tests and they are
bisected to
commit 23361cf32b58efdf09945a64e1d8d41fa6117157
Author: Lars Ellenberg <lars.ellenberg@...bit.com>
AuthorDate: Thu Mar 31 16:36:43 2011 +0200
Commit: Philipp Reisner <philipp.reisner@...bit.com>
CommitDate: Thu Nov 8 16:45:02 2012 +0100
drbd: get rid of bio_split, allow bios of "arbitrary" size
Where "arbitrary" size is currently 1 MiB, which is the BIO_MAX_SIZE
for architectures with 4k PAGE_CACHE_SIZE (most).
Signed-off-by: Philipp Reisner <philipp.reisner@...bit.com>
Signed-off-by: Lars Ellenberg <lars.ellenberg@...bit.com>
[ 0.675459] pci 0000:00:02.0: Boot video device
[ 0.676167] PCI: CLS 0 bytes, default 64
[ 0.677713] Trying to unpack rootfs image as initramfs...
[ 2.464631] swapper invoked oom-killer: gfp_mask=0x200d2, order=0, oom_score_adj=0
[ 2.465725] CPU: 0 PID: 1 Comm: swapper Not tainted 3.14.0-rc6-01061-g73305b7 #2
[ 2.466746] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
[ 2.467543] 0000000000000000 ffff88000e3598e8 ffffffff8168b022 ffff88000e359960
[ 2.468629] ffffffff81687e8c ffff88000e356010 0000000000000000 0000000000000000
[ 2.469712] ffffffff81e174a0 ffff88000e359928 ffffffff81266579 ffff88000e359938
[ 2.470792] Call Trace:
[ 2.471172] [<ffffffff8168b022>] dump_stack+0x19/0x1b
[ 2.471879] [<ffffffff81687e8c>] dump_header.isra.13+0x6d/0x1b3
[ 2.472723] [<ffffffff81266579>] ? __delay+0xf/0x11
[ 2.473416] [<ffffffff812665a1>] ? __const_udelay+0x26/0x28
[ 2.474203] [<ffffffff810f9b5a>] out_of_memory+0x22f/0x284
[ 2.474966] [<ffffffff810fd64b>] __alloc_pages_nodemask+0x5fb/0x73f
[ 2.475843] [<ffffffff810f74fe>] grab_cache_page_write_begin+0x73/0xc5
[ 2.476768] [<ffffffff81145ef4>] simple_write_begin+0x2b/0x82
[ 2.477582] [<ffffffff810f6d95>] generic_file_buffered_write+0xfd/0x224
[ 2.478520] [<ffffffff810f7cb0>] __generic_file_aio_write+0x1c1/0x1f8
[ 2.479434] [<ffffffff820e4f33>] ? initrd_load+0x2c4/0x2c4
[ 2.480196] [<ffffffff810f7d3d>] generic_file_aio_write+0x56/0xc3
[ 2.481053] [<ffffffff81127acf>] do_sync_write+0x61/0x7c
[ 2.481784] [<ffffffff811282b0>] vfs_write+0xa5/0xe1
[ 2.482497] [<ffffffff8112891b>] SyS_write+0x49/0x7f
[ 2.483193] [<ffffffff820e5216>] do_copy+0x73/0x8e
[ 2.483864] [<ffffffff820e4fce>] write_buffer+0x21/0x30
[ 2.484599] [<ffffffff820e5005>] flush_buffer+0x28/0x81
[ 2.485320] [<ffffffff8210f04c>] gunzip+0x264/0x2f3
[ 2.485994] [<ffffffff8210eddf>] ? bunzip2+0x391/0x391
[ 2.486734] [<ffffffff820e4fdd>] ? write_buffer+0x30/0x30
[ 2.487446] [<ffffffff820e537d>] unpack_to_rootfs+0x14c/0x267
[ 2.488231] [<ffffffff820e4f33>] ? initrd_load+0x2c4/0x2c4
[ 2.488943] [<ffffffff820e591c>] ? clean_rootfs+0x156/0x156
[ 2.489722] [<ffffffff820e5979>] populate_rootfs+0x5d/0xd8
[ 2.490489] [<ffffffff820e591c>] ? clean_rootfs+0x156/0x156
[ 2.491271] [<ffffffff810002aa>] do_one_initcall+0x82/0x112
[ 2.492054] [<ffffffff8108017a>] ? parse_args+0x189/0x247
[ 2.492803] [<ffffffff820e3e96>] kernel_init_freeable+0x115/0x19a
[ 2.493661] [<ffffffff820e371d>] ? do_early_param+0x88/0x88
[ 2.494451] [<ffffffff8167f95d>] ? rest_init+0xc1/0xc1
[ 2.495167] [<ffffffff8167f96b>] kernel_init+0xe/0xda
[ 2.495882] [<ffffffff81694bba>] ret_from_fork+0x7a/0xb0
[ 2.496632] [<ffffffff8167f95d>] ? rest_init+0xc1/0xc1
[ 2.497361] Mem-Info:
[ 2.497680] DMA per-cpu:
[ 2.498051] CPU 0: hi: 0, btch: 1 usd: 0
git bisect start v3.8 v3.7 --
git bisect bad 8d91a42e54eebc43f4d8f6064751ccba73528275 # 06:38 0- 10 Merge tag 'omap-late-cleanups' of git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc
git bisect good 770b6cb4d21fb3e3df2a7a51e186a3c14db1ec30 # 07:04 20+ 20 ARM: OMAP: Fix drivers to depend on omap for internal devices
git bisect bad e32795503de02da4e7e74a5e039cc268f6a0ecfb # 07:17 8- 20 Merge tags 'dt-for-linus', 'gpio-for-linus' and 'spi-for-linus' of git://git.secretlab.ca/git/linux-2.6
git bisect bad 9a8a5702c5a7298c0edd125464aa178dd8b50440 # 07:46 0- 7 Merge tag 'for-3.8' of git://openrisc.net/~jonas/linux
git bisect good 9360b53661a2c7754517b2925580055bacc8ec38 # 08:14 26+ 24 Revert "bdi: add a user-tunable cpu_list for the bdi flusher threads"
git bisect bad ea88eeac0cb8328014b53d80ca631e8dc0dc18dc # 08:22 0- 2 Merge tag 'md-3.8' of git://neil.brown.name/md
git bisect bad ce4a9cc579381bc70b12ebb91c57da31baf8e3b7 # 08:38 0- 10 mm,numa: fix update_mmu_cache_pmd call
git bisect bad 9228ff90387e276ad67b10c0eb525c9d6a57d5e9 # 08:58 8- 17 Merge branch 'for-3.8/drivers' of git://git.kernel.dk/linux-block
git bisect bad cd1d9950f69b46d88002b39652ed0cf3608d008b # 09:17 6- 20 drbd: Inlined drbd_free_mdev(); it got called only from one place
git bisect good 3c13b680ce210313c6f7ad163435b62979958c09 # 09:37 26+ 0 drbd: only wakeup if something changed in update_peer_seq
git bisect good 28284ceff043b14defcf8122b765fe0b21bd9344 # 09:53 26+ 0 drbd: recv_dless_read(): Return 0 upon success and an error code otherwise
git bisect good 6038178ebe29e6b5e4d519a5ac56653d156c90f9 # 10:47 26+ 0 drbd: Change how the "handshake" packets are called
git bisect bad 52b061a44021ca11ee2fd238040e91341ff8066d # 11:36 11- 9 drbd: Introduce drbd_header_size()
git bisect bad da9fbc276e9d42638df68e8515d06750695612ca # 11:55 0- 10 drbd: Introduced a new type union drbd_dev_state
git bisect bad 23361cf32b58efdf09945a64e1d8d41fa6117157 # 12:20 0- 4 drbd: get rid of bio_split, allow bios of "arbitrary" size
git bisect good 181286ad22bf9bfb85de625e8501285de5261b35 # 12:39 32+ 0 drbd: preparation commit, pass drbd_interval to drbd_al_begin/complete_io
git bisect good 7726547e67a1fda0d12e1de5ec917a2e5d4b8186 # 13:13 32+ 0 drbd: prepare to activate two activity log extents at once
# first bad commit: [23361cf32b58efdf09945a64e1d8d41fa6117157] drbd: get rid of bio_split, allow bios of "arbitrary" size
git bisect good 7726547e67a1fda0d12e1de5ec917a2e5d4b8186 # 13:21 96+ 0 drbd: prepare to activate two activity log extents at once
git bisect bad 73305b72fffe2ad01b7a672f991953d0efe21319 # 13:21 0- 19 0day head guard for 'devel-hourly-2014031621'
git bisect bad dcb99fd9b08cfe1afe426af4d8d3cbc429190f15 # 14:09 0- 8 Linux 3.14-rc7
git bisect bad ed87ead565a6130174fc27a46af65169cbff7677 # 14:09 0- 9 Add linux-next specific files for 20140314
Thanks,
Fengguang
View attachment "dmesg-quantal-cairo-28:20140317011307:x86_64-randconfig-r2-03170038:3.14.0-rc6-01061-g73305b7:2" of type "text/plain" (37990 bytes)
Download attachment "x86_64-randconfig-r2-03170038-73305b72fffe2ad01b7a672f991953d0efe21319-Kernel-panic---not-syncing:-Out-of-memory-and-no-killable-processes----91118.log" of type "application/octet-stream" (100350 bytes)
View attachment "config-3.14.0-rc6-01061-g73305b7" of type "text/plain" (93954 bytes)
Powered by blists - more mailing lists