[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-Id: <200703021651.16050.gluk@php4.ru>
Date: Fri, 2 Mar 2007 16:51:15 +0300
From: "Alexander Y. Fomichev" <gluk@...4.ru>
To: Linux Kernel Mailing List <linux-kernel@...r.kernel.org>,
admin@...t.net.ru
Subject: kernel BUG at arch/x86_64/mm/../../i386/mm/hugetlbpage.c:140!
G'day
I'm hit a bug on 2.6.21-rc1 at startup of mysql with 'large-pages' flag set.
(at this point mysql trying to allocate pages from hugetlb pool by sysv
shm syscalls). Seems like it could be triggered by previous badness
and probably hugetlb itself is not related. Anyway i couldn't reproduce
it by now with 2.6.21-rc2 git commit 562aa1d4c6a874373f9a48ac184f662fbbb06a04.
Very likely it has been fixed somwhere between 2.6.21-rc1 and -rc2,
but i couldn't find something related by git log so any comments are welcome.
[422123.288864] Bad page state in process 'mysqld'
[422123.288867] page:ffff810004d09800 flags:0x00f0080000000010
mapping:0000000000000000 mapcount:1 count:0
[422123.288869] Trying to fix it up, but a reboot is needed
[422123.288871] Backtrace:
[422123.311745]
[422123.311746] Call Trace:
[422123.311756] [<ffffffff8025d84b>] _spin_unlock_irq+0x9/0xc
[422123.311762] [<ffffffff8029a33a>] bad_page+0x5b/0x89
[422123.311768] [<ffffffff8020b94d>] free_hot_cold_page+0x8c/0x11e
[422123.311773] [<ffffffff8024c0a0>] free_hot_page+0xb/0xd
[422123.311777] [<ffffffff8020cba7>] put_page+0xc8/0xd0
[422123.311784] [<ffffffff802c4af8>] dio_bio_complete+0x7c/0xa4
[422123.311789] [<ffffffff802c59f9>] __blockdev_direct_IO+0x928/0xa4d
[422123.311795] [<ffffffff80322f58>] xfs_vm_direct_IO+0xf0/0x125
[422123.311799] [<ffffffff80323246>] xfs_get_blocks_direct+0x0/0x17
[422123.311803] [<ffffffff803229b3>] xfs_end_io_direct+0x0/0x49
[422123.311808] [<ffffffff80298f45>] generic_file_direct_IO+0xa5/0xeb
[422123.311814] [<ffffffff802163da>] generic_file_aio_read+0xc7/0x194
[422123.311819] [<ffffffff8032a38c>] xfs_read+0x270/0x2e6
[422123.311824] [<ffffffff80326e96>] xfs_file_aio_read+0x5c/0x5e
[422123.311828] [<ffffffff8020cf2e>] do_sync_read+0xe2/0x126
[422123.311834] [<ffffffff80289833>] autoremove_wake_function+0x0/0x38
[422123.311839] [<ffffffff8020b7af>] vfs_read+0xcc/0x155
[422123.311843] [<ffffffff80212929>] sys_pread64+0x55/0x76
[422123.311848] [<ffffffff802583de>] system_call+0x7e/0x83
[422123.311851]
[422123.312248] Bad page state in process 'mysqld'
[422123.312249] page:ffff810004d09840 flags:0x00f0080000000010
mapping:0000000000000000 mapcount:1 count:0
[422123.312251] Trying to fix it up, but a reboot is needed
[422123.312253] Backtrace:
[422123.335123]
[422123.335124] Call Trace:
[422123.335128] [<ffffffff8029a33a>] bad_page+0x5b/0x89
[422123.335132] [<ffffffff8020b94d>] free_hot_cold_page+0x8c/0x11e
[422123.335137] [<ffffffff8024c0a0>] free_hot_page+0xb/0xd
[422123.335140] [<ffffffff8020cba7>] put_page+0xc8/0xd0
[422123.335145] [<ffffffff802c4af8>] dio_bio_complete+0x7c/0xa4
[422123.335150] [<ffffffff802c59f9>] __blockdev_direct_IO+0x928/0xa4d
[422123.335155] [<ffffffff80322f58>] xfs_vm_direct_IO+0xf0/0x125
[422123.335159] [<ffffffff80323246>] xfs_get_blocks_direct+0x0/0x17
[422123.335163] [<ffffffff803229b3>] xfs_end_io_direct+0x0/0x49
[422123.335167] [<ffffffff80298f45>] generic_file_direct_IO+0xa5/0xeb
[422123.335172] [<ffffffff802163da>] generic_file_aio_read+0xc7/0x194
[422123.335177] [<ffffffff8032a38c>] xfs_read+0x270/0x2e6
[422123.335182] [<ffffffff80326e96>] xfs_file_aio_read+0x5c/0x5e
[422123.335186] [<ffffffff8020cf2e>] do_sync_read+0xe2/0x126
[422123.335191] [<ffffffff80289833>] autoremove_wake_function+0x0/0x38
[422123.335195] [<ffffffff8020b7af>] vfs_read+0xcc/0x155
[422123.335200] [<ffffffff80212929>] sys_pread64+0x55/0x76
[422123.335204] [<ffffffff802583de>] system_call+0x7e/0x83
[422123.335206]
[422123.335277] Bad page state in process 'mysqld'
[422123.335278] page:ffff810004d09880 flags:0x00f0080000000010
mapping:0000000000000000 mapcount:1 count:0
[422123.335280] Trying to fix it up, but a reboot is needed
[422123.335282] Backtrace:
[422123.358152]
[422123.358153] Call Trace:
[422123.358157] [<ffffffff8029a33a>] bad_page+0x5b/0x89
[422123.358161] [<ffffffff8020b94d>] free_hot_cold_page+0x8c/0x11e
[422123.358166] [<ffffffff8024c0a0>] free_hot_page+0xb/0xd
[422123.358170] [<ffffffff8020cba7>] put_page+0xc8/0xd0
[422123.358174] [<ffffffff802c4af8>] dio_bio_complete+0x7c/0xa4
[422123.358179] [<ffffffff802c59f9>] __blockdev_direct_IO+0x928/0xa4d
[422123.358184] [<ffffffff80322f58>] xfs_vm_direct_IO+0xf0/0x125
[422123.358188] [<ffffffff80323246>] xfs_get_blocks_direct+0x0/0x17
[422123.358192] [<ffffffff803229b3>] xfs_end_io_direct+0x0/0x49
[422123.358196] [<ffffffff80298f45>] generic_file_direct_IO+0xa5/0xeb
[422123.358201] [<ffffffff802163da>] generic_file_aio_read+0xc7/0x194
[422123.358206] [<ffffffff8032a38c>] xfs_read+0x270/0x2e6
[422123.358211] [<ffffffff80326e96>] xfs_file_aio_read+0x5c/0x5e
[422123.358215] [<ffffffff8020cf2e>] do_sync_read+0xe2/0x126
[422123.358220] [<ffffffff80289833>] autoremove_wake_function+0x0/0x38
[422123.358224] [<ffffffff8020b7af>] vfs_read+0xcc/0x155
[422123.358228] [<ffffffff80212929>] sys_pread64+0x55/0x76
[422123.358233] [<ffffffff802583de>] system_call+0x7e/0x83
[422123.358235]
[422123.358305] Bad page state in process 'mysqld'
[422123.358307] page:ffff810004d098c0 flags:0x00f0080000000010
mapping:0000000000000000 mapcount:1 count:0
[422123.358308] Trying to fix it up, but a reboot is needed
[422123.358310] Backtrace:
[422123.381169]
[422123.381170] Call Trace:
[422123.381174] [<ffffffff8029a33a>] bad_page+0x5b/0x89
[422123.381178] [<ffffffff8020b94d>] free_hot_cold_page+0x8c/0x11e
[422123.381183] [<ffffffff8024c0a0>] free_hot_page+0xb/0xd
[422123.381187] [<ffffffff8020cba7>] put_page+0xc8/0xd0
[422123.381191] [<ffffffff802c4af8>] dio_bio_complete+0x7c/0xa4
[422123.381196] [<ffffffff802c59f9>] __blockdev_direct_IO+0x928/0xa4d
[422123.381201] [<ffffffff80322f58>] xfs_vm_direct_IO+0xf0/0x125
[422123.381205] [<ffffffff80323246>] xfs_get_blocks_direct+0x0/0x17
[422123.381209] [<ffffffff803229b3>] xfs_end_io_direct+0x0/0x49
[422123.381214] [<ffffffff80298f45>] generic_file_direct_IO+0xa5/0xeb
[422123.381218] [<ffffffff802163da>] generic_file_aio_read+0xc7/0x194
[422123.381223] [<ffffffff8032a38c>] xfs_read+0x270/0x2e6
[422123.381228] [<ffffffff80326e96>] xfs_file_aio_read+0x5c/0x5e
[422123.381232] [<ffffffff8020cf2e>] do_sync_read+0xe2/0x126
[422123.381237] [<ffffffff80289833>] autoremove_wake_function+0x0/0x38
[422123.381241] [<ffffffff8020b7af>] vfs_read+0xcc/0x155
[422123.381246] [<ffffffff80212929>] sys_pread64+0x55/0x76
[422123.381250] [<ffffffff802583de>] system_call+0x7e/0x83
[422123.381253]
[422123.381338] ------------[ cut here ]------------
[422123.386310] kernel BUG at arch/x86_64/mm/../../i386/mm/hugetlbpage.c:140!
[422123.393559] invalid opcode: 0000 [1] SMP
[422123.397918] CPU 1
[422123.400168] Modules linked in: xt_state ipt_REJECT iptable_filter
[422123.406736] Pid: 7904, comm: mysqld Tainted: G B 2.6.21-rc1 #2
[422123.413353] RIP: 0010:[<ffffffff8026e114>] [<ffffffff8026e114>]
huge_pte_alloc+0x364/0x377
[422123.422281] RSP: 0000:ffff8100f5015cc8 EFLAGS: 00010202
[422123.427982] RAX: ffff8100f5527560 RBX: ffff8100ed9462b8 RCX:
0000000000000000
[422123.435604] RDX: 00000000f40bc067 RSI: 00002b8295964004 RDI:
ffff8100f4c99800
[422123.443243] RBP: ffff8100f5015d58 R08: 00002b8294ee28c8 R09:
000000000001c000
[422123.450864] R10: ffff8100f5015e38 R11: 0000000000000202 R12:
00002b8295964004
[422123.458494] R13: 0000000000000560 R14: 00002b8295964004 R15:
ffff810005f89088
[422123.466125] FS: 00002b8284792ae0(0000) GS:ffff81010406eec0(0000)
knlGS:0000000000000000
[422123.474774] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[422123.480917] CR2: 00002b8295964004 CR3: 00000000ed946000 CR4:
00000000000006e0
[422123.488565] Process mysqld (pid: 7904, threadinfo ffff8100f5014000, task
ffff8100f5ba7180)
[422123.497370] Stack: 0000000000000002 ffff8100f4c99800 ffff8100f2814050
ffffffff8028b978
[422123.506022] ffff8100f5015d08 ffffffff80302dda 0000000000004000
ffff810004cb0a40
[422123.514007] ffff8100f5015d18 ffffffff8025d857 ffff8100f5015d48
ffffffff802076cf
[422123.521774] Call Trace:
[422123.524692] [<ffffffff8028b978>] up_read+0x9/0xb
[422123.529745] [<ffffffff80302dda>] xfs_iunlock+0x33/0x79
[422123.535341] [<ffffffff8025d857>] _read_unlock_irq+0x9/0xc
[422123.541206] [<ffffffff802076cf>] find_get_page+0x50/0x5b
[422123.546987] [<ffffffff802a5369>] hugetlb_fault+0x28/0xc6
[422123.552756] [<ffffffff80208692>] __handle_mm_fault+0x60/0xc24
[422123.559003] [<ffffffff8020acfa>] do_page_fault+0x457/0x803
[422123.564971] [<ffffffff8025d84b>] _spin_unlock_irq+0x9/0xc
[422123.570838] [<ffffffff8025b649>] thread_return+0x5e/0xf5
[422123.576624] [<ffffffff8025d74d>] _spin_unlock+0x9/0xb
[422123.582135] [<ffffffff8025da1d>] error_exit+0x0/0x84
[422123.587540]
[422123.589218]
[422123.589218] Code: 0f 0b eb fe 48 83 c4 68 5b 41 5c 41 5d 41 5e 41 5f c9 c3
55
[422123.599079] RIP [<ffffffff8026e114>] huge_pte_alloc+0x364/0x377
[422123.605508] RSP <ffff8100f5015cc8>
full dmesg attached.
--
Best regards.
Alexander Y. Fomichev <gluk@...4.ru>
Public PGP key: http://sysadminday.org.ru/gluk.asc
View attachment "dmesg.log" of type "text/x-log" (25243 bytes)
Powered by blists - more mailing lists