Message-ID: <CAGBYx2bxdnkXcZF+A1iOvnsW=xdtDJR7Fx3Rz-HWeWH5n0ByKg@mail.gmail.com>
Date:	Sun, 18 Dec 2011 15:17:18 +0800
From:	Yongqiang Yang <xiaoqiangnk@...il.com>
To:	Wu Fengguang <fengguang.wu@...el.com>
Cc:	"linux-ext4@...r.kernel.org" <linux-ext4@...r.kernel.org>,
	linux-fsdevel@...r.kernel.org, LKML <linux-kernel@...r.kernel.org>
Subject: Re: 3.2.0-rc5 NULL dereference BUG

Hi Fengguang,

Could you try the patch [ext4: do not reference pa_inode from group_pa]?

Thanks,
Yongqiang.

On Sun, Dec 18, 2011 at 2:30 PM, Wu Fengguang <fengguang.wu@...el.com> wrote:
> On Sun, Dec 18, 2011 at 01:53:59PM +0800, Wu Fengguang wrote:
>> This is very reproducible. It occurs in two of my test cases, with
>> different panic messages.
>>
>> It also shows up in 3.2.0-rc3. Kernel config is attached.
>
> Oh well, it happens even in 3.1. Here is the dmesg:
>
> [  210.758668] ------------[ cut here ]------------
> [  210.764665] WARNING: at /c/wfg/linux/kernel/lockdep.c:690 __lock_acquire+0x155/0x938()
> [  210.774369] Hardware name: SandyBridge Platform
> [  210.779898] Modules linked in:
> [  210.783852] Pid: 4409, comm: dd Not tainted 3.1.0+ #299
> [  210.790158] Call Trace:
> [  210.793359]  [<ffffffff810734ec>] warn_slowpath_common+0x85/0x9d
> [  210.800538]  [<ffffffff8107351e>] warn_slowpath_null+0x1a/0x1c
> [  210.807523]  [<ffffffff810a1900>] __lock_acquire+0x155/0x938
> [  210.814312]  [<ffffffff810a21c0>] lock_acquire+0xdd/0x10a
> [  210.820815]  [<ffffffff81063568>] ? double_rq_lock+0x45/0x57
> [  210.827607]  [<ffffffff8199a23b>] _raw_spin_lock+0x36/0x69
> [  210.834145]  [<ffffffff81063568>] ? double_rq_lock+0x45/0x57
> [  210.840927]  [<ffffffff81063568>] double_rq_lock+0x45/0x57
> [  210.847528]  [<ffffffff8106d57c>] load_balance+0x1f1/0x69b
> [  210.854085]  [<ffffffff810a1d12>] ? __lock_acquire+0x567/0x938
> [  210.861076]  [<ffffffff810a1265>] ? lock_release_holdtime+0xa3/0xac
> [  210.868548]  [<ffffffff81997390>] __schedule+0x39a/0x937
> [  210.874952]  [<ffffffff81997309>] ? __schedule+0x313/0x937
> [  210.881556]  [<ffffffff810a1d12>] ? __lock_acquire+0x567/0x938
> [  210.888548]  [<ffffffff8103bebe>] ? native_sched_clock+0x2d/0x5f
> [  210.895733]  [<ffffffff81998180>] ? schedule_timeout+0x242/0x274
> [  210.902904]  [<ffffffff81096611>] ? local_clock+0x41/0x5a
> [  210.909395]  [<ffffffff810a1265>] ? lock_release_holdtime+0xa3/0xac
> [  210.916814]  [<ffffffff81998180>] ? schedule_timeout+0x242/0x274
> [  210.923995]  [<ffffffff81997beb>] schedule+0x5a/0x5c
> [  210.929943]  [<ffffffff81998185>] schedule_timeout+0x247/0x274
> [  210.936933]  [<ffffffff810812e0>] ? del_timer+0xc8/0xc8
> [  210.943246]  [<ffffffff81997ed4>] io_schedule_timeout+0x98/0xe9
> [  210.950271]  [<ffffffff81102e41>] balance_dirty_pages_ratelimited_nr+0x4d2/0x686
> [  210.959399]  [<ffffffff810f9354>] generic_file_buffered_write+0x1c9/0x22d
> [  210.967400]  [<ffffffff810782c2>] ? current_fs_time+0x27/0x2e
> [  210.974295]  [<ffffffff810fadbd>] __generic_file_aio_write+0x32e/0x35e
> [  210.981993]  [<ffffffff810fae53>] generic_file_aio_write+0x66/0xc1
> [  210.989370]  [<ffffffff811deb83>] ext4_file_write+0x1f6/0x24f
> [  210.996212]  [<ffffffff8103bebe>] ? native_sched_clock+0x2d/0x5f
> [  211.003399]  [<ffffffff8117729a>] ? fsnotify+0x216/0x26f
> [  211.009805]  [<ffffffff81096611>] ? local_clock+0x41/0x5a
> [  211.016310]  [<ffffffff81144e86>] do_sync_write+0xcb/0x108
> [  211.022918]  [<ffffffff81145550>] vfs_write+0xb8/0x157
> [  211.029125]  [<ffffffff81145807>] sys_write+0x4d/0x77
> [  211.035228]  [<ffffffff819a1802>] system_call_fastpath+0x16/0x1b
> [  211.042370] ---[ end trace a682372b42c1df33 ]---
> [  443.558240] BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
> [  443.567910] IP: [<ffffffff811f2e62>] perf_trace_ext4_mb_release_group_pa+0x81/0xd6
> [  443.577206] PGD 80e790067 PUD 8133be067 PMD 0
> [  443.582895] Oops: 0000 [#1] SMP DEBUG_PAGEALLOC
> [  443.588602] CPU 11
> [  443.590821] Modules linked in:
> [  443.595323]
> [  443.597439] Pid: 4252, comm: flush-8:16 Tainted: G        W   3.1.0+ #299 Intel Corporation SandyBridge Platform/To be filled by O.E.M.
> [  443.612154] RIP: 0010:[<ffffffff811f2e62>]  [<ffffffff811f2e62>] perf_trace_ext4_mb_release_group_pa+0x81/0xd6
> [  443.624266] RSP: 0018:ffff88041eb695d0  EFLAGS: 00010282
> [  443.630679] RAX: ffffe8fffc407380 RBX: ffff880815c061f8 RCX: ffff88041d9e4500
> [  443.639117] RDX: 0000000000000000 RSI: 0000000000000282 RDI: ffffe8fffc407380
> [  443.647564] RBP: ffff88041eb696b0 R08: ffff88041eb695f0 R09: 0000000000000000
> [  443.656006] R10: ffffe8fffc006ea0 R11: ffffffff8120745f R12: ffffffff81f07698
> [  443.664382] R13: ffff88041eb69760 R14: ffff88081f709750 R15: ffff88080a1a29d8
> [  443.672828] FS:  0000000000000000(0000) GS:ffff88082b400000(0000) knlGS:0000000000000000
> [  443.682722] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [  443.689600] CR2: 0000000000000028 CR3: 00000008133bf000 CR4: 00000000000406e0
> [  443.697984] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [  443.706430] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [  443.714820] Process flush-8:16 (pid: 4252, threadinfo ffff88041eb68000, task ffff88041d9e45e0)
> [  443.725298] Stack:
> [  443.728009]  0000000000000000 0000000000000004 ffff88041eb69660 ffff88041eb695f0
> [  443.737474]  0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [  443.746928]  ffff88041eb69700 0000000000000000 0000000000000000 0000000000000000
> [  443.756380] Call Trace:
> [  443.759585]  [<ffffffff81204abe>] ? ext4_mb_release_group_pa+0x40/0xfe
> [  443.767347]  [<ffffffff81204abe>] ext4_mb_release_group_pa+0x40/0xfe
> [  443.774916]  [<ffffffff8120749f>] ext4_mb_discard_group_preallocations+0x355/0x3eb
> [  443.784233]  [<ffffffff8120a3a5>] ext4_mb_new_blocks+0x2de/0x3f4
> [  443.791414]  [<ffffffff812021c8>] ext4_ext_map_blocks+0xf63/0x1331
> [  443.798796]  [<ffffffff811e2810>] ? ext4_map_blocks+0xf5/0x1fa
> [  443.805782]  [<ffffffff811e2841>] ext4_map_blocks+0x126/0x1fa
> [  443.812671]  [<ffffffff811e5d56>] mpage_da_map_and_submit+0xec/0x3b2
> [  443.820241]  [<ffffffff811e6742>] ext4_da_writepages+0x316/0x4b0
> [  443.827429]  [<ffffffff810a3359>] ? lock_release_non_nested+0x22c/0x293
> [  443.835299]  [<ffffffff81103272>] do_writepages+0x24/0x2d
> [  443.851241]  [<ffffffff811675c9>] writeback_single_inode+0x135/0x2c3
> [  443.858809]  [<ffffffff81167e23>] writeback_sb_inodes+0x182/0x22c
> [  443.866078]  [<ffffffff81168371>] __writeback_inodes_wb+0x78/0xb9
> [  443.873355]  [<ffffffff8116851f>] wb_writeback+0x16d/0x276
> [  443.879951]  [<ffffffff8116897b>] wb_do_writeback+0x1c8/0x1e3
> [  443.886831]  [<ffffffff810812e0>] ? del_timer+0xc8/0xc8
> [  443.893136]  [<ffffffff81168a22>] bdi_writeback_thread+0x8c/0x215
> [  443.900413]  [<ffffffff81168996>] ? wb_do_writeback+0x1e3/0x1e3
> [  443.907490]  [<ffffffff81090930>] kthread+0x8e/0x96
> [  443.913355]  [<ffffffff819a3a04>] kernel_thread_helper+0x4/0x10
> [  443.920403]  [<ffffffff8199ae74>] ? retint_restore_args+0x13/0x13
> [  443.927626]  [<ffffffff810908a2>] ? __init_kthread_worker+0x5b/0x5b
> [  443.935099]  [<ffffffff819a3a00>] ? gs_change+0x13/0x13
> [  443.941388] Code: 89 c2 4c 89 85 38 ff ff ff 48 8d 4d ec 41 0f b7 74 24 48 e8 3a d6 7a 00 4c 8b 85 38 ff ff ff 48 85 c0 74 50 48 8b 93 a0 00 00 00
> [  443.960015]  8b 52 28 8b 52 10 89 50 0c 48 8b 93 80 00 00 00 48 89 50 10
> [  443.970522] RIP  [<ffffffff811f2e62>] perf_trace_ext4_mb_release_group_pa+0x81/0xd6
> [  443.980029]  RSP <ffff88041eb695d0>
> [  443.984374] CR2: 0000000000000028
> [  443.988542] BUG: unable to handle kernel
> [  443.988745] ---[ end trace a682372b42c1df34 ]---
> [  443.999169] NULL pointer dereference at 0000000000000028
> [  444.005637] IP: [<ffffffff811f2e62>] perf_trace_ext4_mb_release_group_pa+0x81/0xd6
> [  444.014987] PGD 810faa067 PUD 8110f6067 PMD 0
> [  444.020575] Oops: 0000 [#2] SMP DEBUG_PAGEALLOC
> [  444.026317] CPU 1
> [  444.028441] Modules linked in:
> [  444.032997]
> [  444.035107] Pid: 5480, comm: dd Tainted: G      D W   3.1.0+ #299 Intel Corporation SandyBridge Platform/To be filled by O.E.M.
> [  444.049013] RIP: 0010:[<ffffffff811f2e62>]  [<ffffffff811f2e62>] perf_trace_ext4_mb_release_group_pa+0x81/0xd6
> [  444.061108] RSP: 0018:ffff880809f252e8  EFLAGS: 00010282
> [  444.067494] RAX: ffffe8fbfd007380 RBX: ffff880811f6f458 RCX: ffff880809862200
> [  444.075922] RDX: 0000000000000000 RSI: 0000000000000282 RDI: ffffe8fbfd007380
> [  444.084349] RBP: ffff880809f253c8 R08: ffff880809f25308 R09: 0000000000000000
> [  444.092776] R10: ffffe8fffd206ea0 R11: ffffffff8120745f R12: ffffffff81f07698
> [  444.101194] R13: ffff880809f25478 R14: ffff88081f709750 R15: ffff880811f42930
> [  444.109607] FS:  00007f2265a23700(0000) GS:ffff88042c000000(0000) knlGS:0000000000000000
> [  444.119477] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [  444.126350] CR2: 0000000000000028 CR3: 00000008110d3000 CR4: 00000000000406e0
> [  444.134777] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [  444.143205] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [  444.151633] Process dd (pid: 5480, threadinfo ffff880809f24000, task ffff8808098622f0)
> [  444.161311] Stack:
> [  444.164001]  ffff880809f25358 0000000000000000 ffff88081d13a650 ffff880809f25308
> [  444.173422]  0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [  444.178355]  ffff880809f25418 0000000000000000 0000000000000000 0000000000000000
> [  444.178358] Call Trace:
> [  444.178364]  [<ffffffff81204abe>] ? ext4_mb_release_group_pa+0x40/0xfe
> [  444.178367]  [<ffffffff81204abe>] ext4_mb_release_group_pa+0x40/0xfe
> [  444.178370]  [<ffffffff8120749f>] ext4_mb_discard_group_preallocations+0x355/0x3eb
> [  444.178374]  [<ffffffff8120a3a5>] ext4_mb_new_blocks+0x2de/0x3f4
> [  444.178378]  [<ffffffff812021c8>] ext4_ext_map_blocks+0xf63/0x1331
> [  444.178382]  [<ffffffff811e2810>] ? ext4_map_blocks+0xf5/0x1fa
> [  444.178385]  [<ffffffff811e2841>] ext4_map_blocks+0x126/0x1fa
> [  444.178388]  [<ffffffff811e5d56>] mpage_da_map_and_submit+0xec/0x3b2
> [  444.178391]  [<ffffffff811e6742>] ext4_da_writepages+0x316/0x4b0
> [  444.178396]  [<ffffffff81103272>] do_writepages+0x24/0x2d
> [  444.178400]  [<ffffffff811675c9>] writeback_single_inode+0x135/0x2c3
> [  444.178403]  [<ffffffff81167e23>] writeback_sb_inodes+0x182/0x22c
> [  444.178406]  [<ffffffff81168371>] __writeback_inodes_wb+0x78/0xb9
> [  444.178409]  [<ffffffff81168799>] writeback_inodes_wb+0x62/0x7c
> [  444.178412]  [<ffffffff81102d4b>] balance_dirty_pages_ratelimited_nr+0x3dc/0x686
> [  444.178417]  [<ffffffff810f9354>] generic_file_buffered_write+0x1c9/0x22d
> [  444.178421]  [<ffffffff810782c2>] ? current_fs_time+0x27/0x2e
> [  444.178424]  [<ffffffff810fadbd>] __generic_file_aio_write+0x32e/0x35e
> [  444.178428]  [<ffffffff810fae53>] generic_file_aio_write+0x66/0xc1
> [  444.178431]  [<ffffffff811deb83>] ext4_file_write+0x1f6/0x24f
> [  444.178435]  [<ffffffff8103bebe>] ? native_sched_clock+0x2d/0x5f
> [  444.178439]  [<ffffffff8117729a>] ? fsnotify+0x216/0x26f
> [  444.178443]  [<ffffffff81096611>] ? local_clock+0x41/0x5a
> [  444.178448]  [<ffffffff81144e86>] do_sync_write+0xcb/0x108
> [  444.178451]  [<ffffffff81145550>] vfs_write+0xb8/0x157
> [  444.178453]  [<ffffffff81145807>] sys_write+0x4d/0x77
> [  444.178456]  [<ffffffff819a1802>] system_call_fastpath+0x16/0x1b
> [  444.178458] Code: 89 c2 4c 89 85 38 ff ff ff 48 8d 4d ec 41 0f b7 74 24 48 e8 3a d6 7a 00 4c 8b 85 38 ff ff ff 48 85 c0 74 50 48 8b 93 a0 00 00 00
> [  444.178471]  8b 52 28 8b 52 10 89 50 0c 48 8b 93 80 00 00 00 48 89 50 10
> [  444.178477] RIP  [<ffffffff811f2e62>] perf_trace_ext4_mb_release_group_pa+0x81/0xd6
> [  444.178481]  RSP <ffff880809f252e8>
> [  444.178482] CR2: 0000000000000028
> [  444.178933] ---[ end trace a682372b42c1df35 ]---
> [  444.178940] ------------[ cut here ]------------
> [  444.178944] WARNING: at /c/wfg/linux/kernel/exit.c:900 do_exit+0x67/0x771()
> [  444.178949] Hardware name: SandyBridge Platform
> [  444.178956] Modules linked in:
> [  444.178962] Pid: 5480, comm: dd Tainted: G      D W   3.1.0+ #299
> [  444.178966] Call Trace:
> [  444.178972]  [<ffffffff810734ec>] warn_slowpath_common+0x85/0x9d
> [  444.178979]  [<ffffffff81074c7a>] ? kmsg_dump+0x8a/0x10c
> [  444.178983]  [<ffffffff8107351e>] warn_slowpath_null+0x1a/0x1c
> [  444.178990]  [<ffffffff81076bab>] do_exit+0x67/0x771
> [  444.178996]  [<ffffffff81074ceb>] ? kmsg_dump+0xfb/0x10c
> [  444.179001]  [<ffffffff81074c7a>] ? kmsg_dump+0x8a/0x10c
> [  444.179013]  [<ffffffff8199bd4c>] oops_end+0xbe/0xc6
> [  444.179022]  [<ffffffff81055e86>] no_context+0x1f9/0x208
> [  444.179029]  [<ffffffff8105605e>] __bad_area_nosemaphore+0x1c9/0x1e9
> [  444.179035]  [<ffffffff810560dd>] bad_area+0x4a/0x51
> [  444.179041]  [<ffffffff8199dece>] do_page_fault+0x27e/0x431
> [  444.179049]  [<ffffffff810f810c>] ? perf_output_copy+0x71/0x71
> [  444.179055]  [<ffffffff810f5d7f>] ? perf_swevent_overflow+0x90/0xaa
> [  444.179072]  [<ffffffff813e985d>] ? trace_hardirqs_off_thunk+0x3a/0x3c
> [  444.179162]  [<ffffffff8120745f>] ? ext4_mb_discard_group_preallocations+0x315/0x3eb
> [  444.179174]  [<ffffffff8199b085>] page_fault+0x25/0x30
> [  444.179178]  [<ffffffff8120745f>] ? ext4_mb_discard_group_preallocations+0x315/0x3eb
> [  444.179222]  [<ffffffff811f2e62>] ? perf_trace_ext4_mb_release_group_pa+0x81/0xd6
> [  444.179248]  [<ffffffff811f2e4f>] ? perf_trace_ext4_mb_release_group_pa+0x6e/0xd6
> [  444.179261]  [<ffffffff81204abe>] ? ext4_mb_release_group_pa+0x40/0xfe
> [  444.179271]  [<ffffffff81204abe>] ext4_mb_release_group_pa+0x40/0xfe
> [  444.179276]  [<ffffffff8120749f>] ext4_mb_discard_group_preallocations+0x355/0x3eb
> [  444.179282]  [<ffffffff8120a3a5>] ext4_mb_new_blocks+0x2de/0x3f4
> [  444.179288]  [<ffffffff812021c8>] ext4_ext_map_blocks+0xf63/0x1331
> [  444.179295]  [<ffffffff811e2810>] ? ext4_map_blocks+0xf5/0x1fa
> [  444.179300]  [<ffffffff811e2841>] ext4_map_blocks+0x126/0x1fa
> [  444.179306]  [<ffffffff811e5d56>] mpage_da_map_and_submit+0xec/0x3b2
> [  444.179311]  [<ffffffff811e6742>] ext4_da_writepages+0x316/0x4b0
> [  444.179317]  [<ffffffff81103272>] do_writepages+0x24/0x2d
> [  444.179477]  [<ffffffff811675c9>] writeback_single_inode+0x135/0x2c3
> [  444.179505]  [<ffffffff81167e23>] writeback_sb_inodes+0x182/0x22c
> [  444.179515]  [<ffffffff81168371>] __writeback_inodes_wb+0x78/0xb9
> [  444.179521]  [<ffffffff81168799>] writeback_inodes_wb+0x62/0x7c
> [  444.179526]  [<ffffffff81102d4b>] balance_dirty_pages_ratelimited_nr+0x3dc/0x686
> [  444.179532]  [<ffffffff810f9354>] generic_file_buffered_write+0x1c9/0x22d
> [  444.179535]  [<ffffffff810782c2>] ? current_fs_time+0x27/0x2e
> [  444.179541]  [<ffffffff810fadbd>] __generic_file_aio_write+0x32e/0x35e
> [  444.179549]  [<ffffffff810fae53>] generic_file_aio_write+0x66/0xc1
> [  444.179555]  [<ffffffff811deb83>] ext4_file_write+0x1f6/0x24f
> [  444.179560]  [<ffffffff8103bebe>] ? native_sched_clock+0x2d/0x5f
> [  444.179563]  [<ffffffff8117729a>] ? fsnotify+0x216/0x26f
> [  444.179569]  [<ffffffff81096611>] ? local_clock+0x41/0x5a
> [  444.179577]  [<ffffffff81144e86>] do_sync_write+0xcb/0x108
> [  444.179581]  [<ffffffff81145550>] vfs_write+0xb8/0x157
> [  444.179586]  [<ffffffff81145807>] sys_write+0x4d/0x77
> [  444.179593]  [<ffffffff819a1802>] system_call_fastpath+0x16/0x1b
> [  444.179597] ---[ end trace a682372b42c1df36 ]---
> [  444.179888] dd used greatest stack depth: 2088 bytes left
> [  504.787849] INFO: rcu_sched_state detected stall on CPU 14 (t=60000 jiffies)
> [  504.787854] INFO: rcu_sched_state detected stall on CPU 27 (t=60000 jiffies)
> [  539.837210] BUG: spinlock lockup on CPU#14, dd/4796, ffff88081103c180
> [  539.845293] Pid: 4796, comm: dd Tainted: G      D W   3.1.0+ #299
> [  539.852582] Call Trace:
> [  539.855792]  [<ffffffff813edf90>] do_raw_spin_lock+0x10c/0x137
> [  539.862796]  [<ffffffff8199a25b>] _raw_spin_lock+0x56/0x69
> [  539.869412]  [<ffffffff81208578>] ? ext4_mb_find_by_goal+0xdb/0x1ce
> [  539.876900]  [<ffffffff81208578>] ext4_mb_find_by_goal+0xdb/0x1ce
> [  539.883455] BUG: spinlock lockup on CPU#27, dd/5336, ffff88081103c080
> [  539.883458] Pid: 5336, comm: dd Tainted: G      D W   3.1.0+ #299
> [  539.883459] Call Trace:
> [  539.883464]  [<ffffffff813edf90>] do_raw_spin_lock+0x10c/0x137
> [  539.883467]  [<ffffffff8199a25b>] _raw_spin_lock+0x56/0x69
> [  539.883471]  [<ffffffff81208578>] ? ext4_mb_find_by_goal+0xdb/0x1ce
> [  539.883474]  [<ffffffff81208578>] ext4_mb_find_by_goal+0xdb/0x1ce
> [  539.883477]  [<ffffffff81205856>] ? ext4_mb_normalize_request+0x2f4/0x480
> [  539.883480]  [<ffffffff81208c6f>] ext4_mb_regular_allocator+0x59/0x312
> [  539.883484]  [<ffffffff8120a25e>] ext4_mb_new_blocks+0x197/0x3f4
> [  539.883487]  [<ffffffff811ff836>] ? ext4_ext_find_extent+0x130/0x2fb
> [  539.883490]  [<ffffffff8199ac03>] ? _raw_spin_unlock+0x2b/0x2f
> [  539.883493]  [<ffffffff812021c8>] ext4_ext_map_blocks+0xf63/0x1331
> [  539.883499]  [<ffffffff811e2810>] ? ext4_map_blocks+0xf5/0x1fa
> [  539.883502]  [<ffffffff811e2841>] ext4_map_blocks+0x126/0x1fa
> [  539.883504]  [<ffffffff811e5d56>] mpage_da_map_and_submit+0xec/0x3b2
> [  539.883507]  [<ffffffff811e6742>] ext4_da_writepages+0x316/0x4b0
> [  539.883513]  [<ffffffff81103272>] do_writepages+0x24/0x2d
> [  539.883520]  [<ffffffff811675c9>] writeback_single_inode+0x135/0x2c3
> [  539.883523]  [<ffffffff81167e23>] writeback_sb_inodes+0x182/0x22c
> [  539.883526]  [<ffffffff81168371>] __writeback_inodes_wb+0x78/0xb9
> [  539.883528]  [<ffffffff81168799>] writeback_inodes_wb+0x62/0x7c
> [  539.883532]  [<ffffffff81102d4b>] balance_dirty_pages_ratelimited_nr+0x3dc/0x686
> [  539.883534]  [<ffffffff8116809e>] ? __mark_inode_dirty+0x2e/0x1cf
> [  539.883539]  [<ffffffff810f9354>] generic_file_buffered_write+0x1c9/0x22d
> [  539.883545]  [<ffffffff810782c2>] ? current_fs_time+0x27/0x2e
> [  539.883548]  [<ffffffff810fadbd>] __generic_file_aio_write+0x32e/0x35e
> [  539.883552]  [<ffffffff810fae53>] generic_file_aio_write+0x66/0xc1
> [  539.883555]  [<ffffffff811deb83>] ext4_file_write+0x1f6/0x24f
> [  539.883559]  [<ffffffff8117729a>] ? fsnotify+0x216/0x26f
> [  539.883565]  [<ffffffff81144e86>] do_sync_write+0xcb/0x108
> [  539.883567]  [<ffffffff81145550>] vfs_write+0xb8/0x157
> [  539.883570]  [<ffffffff81145807>] sys_write+0x4d/0x77
> [  539.883574]  [<ffffffff819a1802>] system_call_fastpath+0x16/0x1b
> [  540.125746]  [<ffffffff81205856>] ? ext4_mb_normalize_request+0x2f4/0x480
> [  540.133817]  [<ffffffff81208c6f>] ext4_mb_regular_allocator+0x59/0x312
> [  540.133820]  [<ffffffff8120a25e>] ext4_mb_new_blocks+0x197/0x3f4
> [  540.133823]  [<ffffffff811ff836>] ? ext4_ext_find_extent+0x130/0x2fb
> [  540.133829]  [<ffffffff8199ac03>] ? _raw_spin_unlock+0x2b/0x2f
> [  540.133831]  [<ffffffff812021c8>] ext4_ext_map_blocks+0xf63/0x1331
> [  540.133838]  [<ffffffff811e2810>] ? ext4_map_blocks+0xf5/0x1fa
> [  540.133840]  [<ffffffff811e2841>] ext4_map_blocks+0x126/0x1fa
> [  540.133843]  [<ffffffff811e5d56>] mpage_da_map_and_submit+0xec/0x3b2
> [  540.133845]  [<ffffffff811e6742>] ext4_da_writepages+0x316/0x4b0
> [  540.133854]  [<ffffffff81103272>] do_writepages+0x24/0x2d
> [  540.133861]  [<ffffffff811675c9>] writeback_single_inode+0x135/0x2c3
> [  540.133863]  [<ffffffff81167e23>] writeback_sb_inodes+0x182/0x22c
> [  540.133866]  [<ffffffff81168371>] __writeback_inodes_wb+0x78/0xb9
> [  540.133869]  [<ffffffff81168799>] writeback_inodes_wb+0x62/0x7c
> [  540.133872]  [<ffffffff81102d4b>] balance_dirty_pages_ratelimited_nr+0x3dc/0x686
> [  540.133875]  [<ffffffff8116809e>] ? __mark_inode_dirty+0x2e/0x1cf
> [  540.133880]  [<ffffffff810f9354>] generic_file_buffered_write+0x1c9/0x22d
> [  540.133886]  [<ffffffff810782c2>] ? current_fs_time+0x27/0x2e
> [  540.133889]  [<ffffffff810fadbd>] __generic_file_aio_write+0x32e/0x35e
> [  540.133892]  [<ffffffff810fae53>] generic_file_aio_write+0x66/0xc1
> [  540.133896]  [<ffffffff811deb83>] ext4_file_write+0x1f6/0x24f
> [  540.133900]  [<ffffffff8117729a>] ? fsnotify+0x216/0x26f
> [  540.133905]  [<ffffffff81144e86>] do_sync_write+0xcb/0x108
> [  540.133908]  [<ffffffff81145550>] vfs_write+0xb8/0x157
> [  540.133910]  [<ffffffff81145807>] sys_write+0x4d/0x77
> [  540.133914]  [<ffffffff819a1802>] system_call_fastpath+0x16/0x1b
> [  684.729866] INFO: rcu_sched_state detected stall on CPU 27 (t=240030 jiffies)
> [  684.730858] INFO: rcu_sched_state detected stall on CPU 14 (t=240030 jiffies)
> [  864.673871] INFO: rcu_sched_state detected stall on CPU 27 (t=420061 jiffies)
> [  864.673877] INFO: rcu_sched_state detected stall on CPU 14 (t=420061 jiffies)
> [ 1044.615889] INFO: rcu_sched_state detected stall on CPU 27 (t=600092 jiffies)
> [ 1044.616884] INFO: rcu_sched_state detected stall on CPU 14 (t=600092 jiffies)
> [ 1224.558902] INFO: rcu_sched_state detected stall on CPU 27 (t=780123 jiffies)
> [ 1224.559899] INFO: rcu_sched_state detected stall on CPU 14 (t=780123 jiffies)
> [ 1404.501917] INFO: rcu_sched_state detected stall on CPU 14 (t=960154 jiffies)
> [ 1404.501922] INFO: rcu_sched_state detected stall on CPU 27 (t=960154 jiffies)
> [ 1584.443929] INFO: rcu_sched_state detected stall on CPU 27 (t=1140184 jiffies)
> [ 1584.443935] INFO: rcu_sched_state detected stall on CPU 14 (t=1140184 jiffies)
> [ 1764.386941] INFO: rcu_sched_state detected stall on CPU 14 (t=1320214 jiffies)
> [ 1764.386944] INFO: rcu_sched_state detected stall on CPU 27 (t=1320215 jiffies)
> [ 1944.328956] INFO: rcu_sched_state detected stall on CPU 14 (t=1500245 jiffies)
> [ 1944.328960] INFO: rcu_sched_state detected stall on CPU 27 (t=1500245 jiffies)
> [ 2124.270971] INFO: rcu_sched_state detected stall on CPU 14 (t=1680275 jiffies)
> [ 2124.270976] INFO: rcu_sched_state detected stall on CPU 27 (t=1680275 jiffies)
> [ 2304.212984] INFO: rcu_sched_state detected stall on CPU 14 (t=1860305 jiffies)
> [ 2304.213983] INFO: rcu_sched_state detected stall on CPU 27 (t=1860306 jiffies)
> [ 2484.155998] INFO: rcu_sched_state detected stall on CPU 27 (t=2040336 jiffies)
> [ 2484.156998] INFO: rcu_sched_state detected stall on CPU 14 (t=2040337 jiffies)
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
> the body of a message to majordomo@...r.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html



-- 
Best Wishes
Yongqiang Yang
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Powered by blists - more mailing lists