lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <20140318140717.GA21372@localhost>
Date:	Tue, 18 Mar 2014 22:07:17 +0800
From:	Fengguang Wu <fengguang.wu@...el.com>
To:	Lars Ellenberg <lars.ellenberg@...bit.com>
Cc:	Philipp Reisner <philipp.reisner@...bit.com>,
	drbd-user@...ts.linbit.com, linux-kernel@...r.kernel.org
Subject: [drbd] Kernel panic - not syncing: Out of memory and no killable
 processes...

Greetings,

We get the below OOM errors in our KVM boot tests and they are
bisected to

commit 23361cf32b58efdf09945a64e1d8d41fa6117157
Author:     Lars Ellenberg <lars.ellenberg@...bit.com>
AuthorDate: Thu Mar 31 16:36:43 2011 +0200
Commit:     Philipp Reisner <philipp.reisner@...bit.com>
CommitDate: Thu Nov 8 16:45:02 2012 +0100

    drbd: get rid of bio_split, allow bios of "arbitrary" size
    
    Where "arbitrary" size is currently 1 MiB, which is the BIO_MAX_SIZE
    for architectures with 4k PAGE_CACHE_SIZE (most).
    
    Signed-off-by: Philipp Reisner <philipp.reisner@...bit.com>
    Signed-off-by: Lars Ellenberg <lars.ellenberg@...bit.com>


[    0.675459] pci 0000:00:02.0: Boot video device
[    0.676167] PCI: CLS 0 bytes, default 64
[    0.677713] Trying to unpack rootfs image as initramfs...
[    2.464631] swapper invoked oom-killer: gfp_mask=0x200d2, order=0, oom_score_adj=0
[    2.465725] CPU: 0 PID: 1 Comm: swapper Not tainted 3.14.0-rc6-01061-g73305b7 #2
[    2.466746] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011
[    2.467543]  0000000000000000 ffff88000e3598e8 ffffffff8168b022 ffff88000e359960
[    2.468629]  ffffffff81687e8c ffff88000e356010 0000000000000000 0000000000000000
[    2.469712]  ffffffff81e174a0 ffff88000e359928 ffffffff81266579 ffff88000e359938
[    2.470792] Call Trace:
[    2.471172]  [<ffffffff8168b022>] dump_stack+0x19/0x1b
[    2.471879]  [<ffffffff81687e8c>] dump_header.isra.13+0x6d/0x1b3
[    2.472723]  [<ffffffff81266579>] ? __delay+0xf/0x11
[    2.473416]  [<ffffffff812665a1>] ? __const_udelay+0x26/0x28
[    2.474203]  [<ffffffff810f9b5a>] out_of_memory+0x22f/0x284
[    2.474966]  [<ffffffff810fd64b>] __alloc_pages_nodemask+0x5fb/0x73f
[    2.475843]  [<ffffffff810f74fe>] grab_cache_page_write_begin+0x73/0xc5
[    2.476768]  [<ffffffff81145ef4>] simple_write_begin+0x2b/0x82
[    2.477582]  [<ffffffff810f6d95>] generic_file_buffered_write+0xfd/0x224
[    2.478520]  [<ffffffff810f7cb0>] __generic_file_aio_write+0x1c1/0x1f8
[    2.479434]  [<ffffffff820e4f33>] ? initrd_load+0x2c4/0x2c4
[    2.480196]  [<ffffffff810f7d3d>] generic_file_aio_write+0x56/0xc3
[    2.481053]  [<ffffffff81127acf>] do_sync_write+0x61/0x7c
[    2.481784]  [<ffffffff811282b0>] vfs_write+0xa5/0xe1
[    2.482497]  [<ffffffff8112891b>] SyS_write+0x49/0x7f
[    2.483193]  [<ffffffff820e5216>] do_copy+0x73/0x8e
[    2.483864]  [<ffffffff820e4fce>] write_buffer+0x21/0x30
[    2.484599]  [<ffffffff820e5005>] flush_buffer+0x28/0x81
[    2.485320]  [<ffffffff8210f04c>] gunzip+0x264/0x2f3
[    2.485994]  [<ffffffff8210eddf>] ? bunzip2+0x391/0x391
[    2.486734]  [<ffffffff820e4fdd>] ? write_buffer+0x30/0x30
[    2.487446]  [<ffffffff820e537d>] unpack_to_rootfs+0x14c/0x267
[    2.488231]  [<ffffffff820e4f33>] ? initrd_load+0x2c4/0x2c4
[    2.488943]  [<ffffffff820e591c>] ? clean_rootfs+0x156/0x156
[    2.489722]  [<ffffffff820e5979>] populate_rootfs+0x5d/0xd8
[    2.490489]  [<ffffffff820e591c>] ? clean_rootfs+0x156/0x156
[    2.491271]  [<ffffffff810002aa>] do_one_initcall+0x82/0x112
[    2.492054]  [<ffffffff8108017a>] ? parse_args+0x189/0x247
[    2.492803]  [<ffffffff820e3e96>] kernel_init_freeable+0x115/0x19a
[    2.493661]  [<ffffffff820e371d>] ? do_early_param+0x88/0x88
[    2.494451]  [<ffffffff8167f95d>] ? rest_init+0xc1/0xc1
[    2.495167]  [<ffffffff8167f96b>] kernel_init+0xe/0xda
[    2.495882]  [<ffffffff81694bba>] ret_from_fork+0x7a/0xb0
[    2.496632]  [<ffffffff8167f95d>] ? rest_init+0xc1/0xc1
[    2.497361] Mem-Info:
[    2.497680] DMA per-cpu:
[    2.498051] CPU    0: hi:    0, btch:   1 usd:   0

git bisect start v3.8 v3.7 --
git bisect  bad 8d91a42e54eebc43f4d8f6064751ccba73528275  # 06:38      0-     10  Merge tag 'omap-late-cleanups' of git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc
git bisect good 770b6cb4d21fb3e3df2a7a51e186a3c14db1ec30  # 07:04     20+     20  ARM: OMAP: Fix drivers to depend on omap for internal devices
git bisect  bad e32795503de02da4e7e74a5e039cc268f6a0ecfb  # 07:17      8-     20  Merge tags 'dt-for-linus', 'gpio-for-linus' and 'spi-for-linus' of git://git.secretlab.ca/git/linux-2.6
git bisect  bad 9a8a5702c5a7298c0edd125464aa178dd8b50440  # 07:46      0-      7  Merge tag 'for-3.8' of git://openrisc.net/~jonas/linux
git bisect good 9360b53661a2c7754517b2925580055bacc8ec38  # 08:14     26+     24  Revert "bdi: add a user-tunable cpu_list for the bdi flusher threads"
git bisect  bad ea88eeac0cb8328014b53d80ca631e8dc0dc18dc  # 08:22      0-      2  Merge tag 'md-3.8' of git://neil.brown.name/md
git bisect  bad ce4a9cc579381bc70b12ebb91c57da31baf8e3b7  # 08:38      0-     10  mm,numa: fix update_mmu_cache_pmd call
git bisect  bad 9228ff90387e276ad67b10c0eb525c9d6a57d5e9  # 08:58      8-     17  Merge branch 'for-3.8/drivers' of git://git.kernel.dk/linux-block
git bisect  bad cd1d9950f69b46d88002b39652ed0cf3608d008b  # 09:17      6-     20  drbd: Inlined drbd_free_mdev(); it got called only from one place
git bisect good 3c13b680ce210313c6f7ad163435b62979958c09  # 09:37     26+      0  drbd: only wakeup if something changed in update_peer_seq
git bisect good 28284ceff043b14defcf8122b765fe0b21bd9344  # 09:53     26+      0  drbd: recv_dless_read(): Return 0 upon success and an error code otherwise
git bisect good 6038178ebe29e6b5e4d519a5ac56653d156c90f9  # 10:47     26+      0  drbd: Change how the "handshake" packets are called
git bisect  bad 52b061a44021ca11ee2fd238040e91341ff8066d  # 11:36     11-      9  drbd: Introduce drbd_header_size()
git bisect  bad da9fbc276e9d42638df68e8515d06750695612ca  # 11:55      0-     10  drbd: Introduced a new type union drbd_dev_state
git bisect  bad 23361cf32b58efdf09945a64e1d8d41fa6117157  # 12:20      0-      4  drbd: get rid of bio_split, allow bios of "arbitrary" size
git bisect good 181286ad22bf9bfb85de625e8501285de5261b35  # 12:39     32+      0  drbd: preparation commit, pass drbd_interval to drbd_al_begin/complete_io
git bisect good 7726547e67a1fda0d12e1de5ec917a2e5d4b8186  # 13:13     32+      0  drbd: prepare to activate two activity log extents at once
# first bad commit: [23361cf32b58efdf09945a64e1d8d41fa6117157] drbd: get rid of bio_split, allow bios of "arbitrary" size
git bisect good 7726547e67a1fda0d12e1de5ec917a2e5d4b8186  # 13:21     96+      0  drbd: prepare to activate two activity log extents at once
git bisect  bad 73305b72fffe2ad01b7a672f991953d0efe21319  # 13:21      0-     19  0day head guard for 'devel-hourly-2014031621'
git bisect  bad dcb99fd9b08cfe1afe426af4d8d3cbc429190f15  # 14:09      0-      8  Linux 3.14-rc7
git bisect  bad ed87ead565a6130174fc27a46af65169cbff7677  # 14:09      0-      9  Add linux-next specific files for 20140314

Thanks,
Fengguang

View attachment "dmesg-quantal-cairo-28:20140317011307:x86_64-randconfig-r2-03170038:3.14.0-rc6-01061-g73305b7:2" of type "text/plain" (37990 bytes)

Download attachment "x86_64-randconfig-r2-03170038-73305b72fffe2ad01b7a672f991953d0efe21319-Kernel-panic---not-syncing:-Out-of-memory-and-no-killable-processes----91118.log" of type "application/octet-stream" (100350 bytes)

View attachment "config-3.14.0-rc6-01061-g73305b7" of type "text/plain" (93954 bytes)

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ