Message-ID: <Pine.LNX.4.64.0711040750020.3956@p34.internal.lan>
Date:	Sun, 4 Nov 2007 07:52:00 -0500 (EST)
From:	Justin Piszcz <jpiszcz@...idpixels.com>
To:	Michael Tokarev <mjt@....msk.ru>
cc:	linux-kernel@...r.kernel.org, linux-raid@...r.kernel.org,
	xfs@....sgi.com
Subject: Re: 2.6.23.1: mdadm/raid5 hung/d-state



On Sun, 4 Nov 2007, Michael Tokarev wrote:

> Justin Piszcz wrote:
>> # ps auxww | grep D
>> USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
>> root       273  0.0  0.0      0     0 ?        D    Oct21  14:40 [pdflush]
>> root       274  0.0  0.0      0     0 ?        D    Oct21  13:00 [pdflush]
>>
>> After several days/weeks, this is the second time this has happened,
>> while doing regular file I/O (decompressing a file), everything on the
>> device went into D-state.
>
> The next time you come across something like that, do a SysRq-T dump and
> post that.  It shows a stack trace of all processes - and in particular,
> where exactly each task is stuck.
>
> /mjt
>

Yes I got it before I rebooted, ran that and then dmesg > file.

Here it is:

[1172609.665902]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.668768]  ffffffff80747dc0 ffff81015c3aa918 ffff810091c899b4 ffff810091c899a8
[1172609.668871] Call Trace:
[1172609.674472]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172609.677362]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172609.680243]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172609.683105]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172609.685969]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.688851]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.691712]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.694534]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.697324]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172609.700103]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172609.702856]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172609.705598]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172609.708303]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172609.710999]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172609.713694]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172609.716397]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.719112]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.721824]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172609.724525]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172609.727215]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172609.729880]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.732517] 
[1172609.735115] bash          S 0000000000000000     0 30959  30958
[1172609.737742]  ffff810091c8be88 0000000000000086 0000000000000000 ffff8101ea172e20
[1172609.740404]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.743087]  ffffffff80747dc0 ffff81015c3ab028 ffff810091c8be54 ffff810091c8be48
[1172609.743190] Call Trace:
[1172609.748404]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172609.751071]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172609.753714]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.756345]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.758967] 
[1172609.761522] sr            S 0000000000000000     0 30966  30959
[1172609.764123]  ffff810122d7de88 0000000000000082 0000000000000000 ffff8101eab3ee20
[1172609.766769]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.769442]  ffffffff80747dc0 ffff8101ea173028 ffff810122d7de54 ffff810122d7de48
[1172609.769545] Call Trace:
[1172609.774734]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172609.777369]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.779999]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.782616] 
[1172609.785168] screen        S 0000000000000000     0 30972  30966
[1172609.787768]  ffff810144597f68 0000000000000086 ffff810144597f30 00000000ffffffff
[1172609.790416]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.793085]  ffffffff80747dc0 ffff8101eab3f028 ffff810144597f34 ffff810144597f28
[1172609.793188] Call Trace:
[1172609.798381]  [<ffffffff8022b0c5>] alarm_setitimer+0x35/0x70
[1172609.801049]  [<ffffffff80232a09>] sys_pause+0x19/0x30
[1172609.803705]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.806361] 
[1172609.808980] sshd          S 0000000000000000     0 30973   7582
[1172609.811659]  ffff810084003bf8 0000000000000082 0000000000000000 ffffffff80508e74
[1172609.814376]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.817104]  ffffffff80747dc0 ffff8101ea172208 ffff810084003bc4 ffff810084003bb8
[1172609.817207] Call Trace:
[1172609.822530]  [<ffffffff80508e74>] skb_queue_tail+0x24/0x60
[1172609.825292]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172609.828060]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172609.830820]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172609.833587]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.836344]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172609.839074]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172609.841794]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172609.844488]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172609.847161]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.849848]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172609.852541]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172609.855235]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172609.857922]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172609.860620]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.863343] 
[1172609.866063] sshd          S 0000000000000000     0 30975  30973
[1172609.868838]  ffff810175c219e8 0000000000000086 ffff810175c219b0 0000000000000002
[1172609.871649]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.874490]  ffffffff80747dc0 ffff81021b27d738 ffff810175c219b4 ffff810175c219a8
[1172609.874594] Call Trace:
[1172609.880153]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172609.883020]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172609.885890]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172609.888742]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172609.891581]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.894430]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.897258]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.900060]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.902841]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172609.905606]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172609.908363]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172609.911093]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172609.913795]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172609.916486]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172609.919151]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172609.921799]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172609.924455]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172609.927122]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.929786]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172609.932438]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172609.935083]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172609.937702]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.940292] 
[1172609.942843] bash          S 0000000000000000     0 30976  30975
[1172609.945423]  ffff8101bf371e88 0000000000000082 0000000000000000 ffff81021e322710
[1172609.948037]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.950671]  ffffffff80747dc0 ffff8101882bf738 ffff8101bf371e54 ffff8101bf371e48
[1172609.950774] Call Trace:
[1172609.955888]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172609.958505]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172609.961098]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172609.963662]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172609.966234]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172609.968766]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.971279] 
[1172609.973759] screen        S 0000000000000000     0 30991  30976
[1172609.976308]  ffff8101a8329f68 0000000000000086 0000000000000000 00000000ffffffff
[1172609.978892]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172609.981501]  ffffffff80747dc0 ffff81021e322918 ffff8101a8329f34 ffff8101a8329f28
[1172609.981605] Call Trace:
[1172609.986634]  [<ffffffff8022b0c5>] alarm_setitimer+0x35/0x70
[1172609.989220]  [<ffffffff80232a09>] sys_pause+0x19/0x30
[1172609.991766]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172609.994292] 
[1172609.996787] screen        D ffff8100a18ff800     0 30992  30991
[1172609.999344]  ffff8101a854dd28 0000000000000086 ffff81022854ddb7 ffff8101a854dcd8
[1172610.001953]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.004574]  ffffffff80747dc0 ffff810170233028 ffffffff80656bcb ffffffff8021f8bc
[1172610.004677] Call Trace:
[1172610.009752]  [<ffffffff8021f8bc>] task_rq_lock+0x4c/0x90
[1172610.012366]  [<ffffffff8021fb88>] try_to_wake_up+0x68/0x3b0
[1172610.014981]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172610.017594]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.020208]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172610.022828]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172610.025447]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172610.028076]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172610.030710]  [<ffffffff80284847>] mntput_no_expire+0x27/0xb0
[1172610.033339]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172610.035958]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172610.038547]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172610.041106]  [<ffffffff8026ccc6>] sys_close+0x96/0x100
[1172610.043652]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.046160] 
[1172610.048618] bash          ? 0000000000000000     0 30993  30992
[1172610.051135]  ffff8101aa2a3ee8 0000000000000046 ffff8101aa2a3eb0 0000000000000011
[1172610.053708]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.056312]  ffffffff80747dc0 ffff810170233738 ffff8101aa2a3eb4 ffff8101aa2a3ea8
[1172610.056415] Call Trace:
[1172610.061510]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172610.064172]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172610.066859]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.069537] 
[1172610.072190] sshd          S 0000000000000000     0  7001   7582
[1172610.074908]  ffff8100792b1bf8 0000000000000082 0000000000000000 ffff8101e9c51b80
[1172610.077679]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.080477]  ffffffff80747dc0 ffff8102234ff738 ffff8100792b1bc4 ffff8100792b1bb8
[1172610.080580] Call Trace:
[1172610.086042]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.088861]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.091673]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.094492]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.097318]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.100148]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.102976]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.105822]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.108651]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.111495]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.114319]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.117118]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.119902]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.122638]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.125360] 
[1172610.128056] sshd          S 0000000000000000     0  7003   7001
[1172610.130818]  ffff8100675a39e8 0000000000000082 ffff8100675a39b0 0000000000000002
[1172610.133623]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.136446]  ffffffff80747dc0 ffff810225459028 ffff8100675a39b4 ffff8100675a39a8
[1172610.136549] Call Trace:
[1172610.142064]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.144899]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.147716]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.150495]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.153260]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.156005]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.158707]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.161378]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.164026]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172610.166675]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.169315]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.171917]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.174494]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.177085]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.179638]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.182178]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.184734]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.187290]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.189837]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.192370]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.194900]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.197426] 
[1172610.199919] bash          S 000000000000000e     0  7004   7003
[1172610.202470]  ffff8100cc263e88 0000000000000082 80000000804ca065 ffff81022367f530
[1172610.205071]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.207699]  ffffffff80747dc0 ffff8102234fe918 ffff8100cc263e38 ffff810035a16348
[1172610.207802] Call Trace:
[1172610.212949]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.215618]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.218263]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.220900]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.223509]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.226109]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.228693]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.231240] 
[1172610.233746] aur           S 0000000000000000     0  7014   7004
[1172610.236319]  ffff810098071e88 0000000000000086 ffff810098071e50 ffffffff80232c93
[1172610.238941]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.241566]  ffffffff80747dc0 ffff81022367f738 ffff810098071e54 ffff810098071e48
[1172610.241669] Call Trace:
[1172610.246766]  [<ffffffff80232c93>] get_signal_to_deliver+0x73/0x470
[1172610.249380]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.251983]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.254563]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.257122] 
[1172610.259648] aur           S 0000000000000004     0  7066   7014
[1172610.262226]  ffff810085231e88 0000000000000086 ffff8101ea314ce8 ffffffff80232c93
[1172610.264844]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.267471]  ffffffff80747dc0 ffff8101ea314918 ffffffff802302ce ffffffff8020b3d6
[1172610.267574] Call Trace:
[1172610.272674]  [<ffffffff80232c93>] get_signal_to_deliver+0x73/0x470
[1172610.275315]  [<ffffffff802302ce>] recalc_sigpending+0xe/0x30
[1172610.277948]  [<ffffffff8020b3d6>] do_notify_resume+0x536/0x7a0
[1172610.280577]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.283199]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.285840]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.288491] 
[1172610.291116] unrar         D ffff8100aa785c80     0  7135   7066
[1172610.293792]  ffff8101ecf4ddb8 0000000000000086 ffff8101ecf4dd80 0000000000000000
[1172610.296525]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.299256]  ffffffff80747dc0 ffff81021e53f028 ffff8101ecf4dd84 ffff8101ecf4dd78
[1172610.299359] Call Trace:
[1172610.304629]  [<ffffffff80385635>] vn_iowait+0x75/0xa0
[1172610.307301]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.309979]  [<ffffffff8036d19c>] xfs_trans_alloc+0x9c/0xb0
[1172610.312653]  [<ffffffff80357fb5>] xfs_itruncate_start+0x35/0xe0
[1172610.315340]  [<ffffffff80372c3a>] xfs_free_eofblocks+0x17a/0x280
[1172610.318032]  [<ffffffff80377e74>] xfs_release+0x134/0x1e0
[1172610.320711]  [<ffffffff8037ed7a>] xfs_file_release+0x1a/0x30
[1172610.323417]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172610.326144]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172610.328895]  [<ffffffff8026ccc6>] sys_close+0x96/0x100
[1172610.331631]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.334353] 
[1172610.337050] sshd          D 0000000000000000     0  7187   7582
[1172610.339811]  ffff81002b62fd28 0000000000000086 ffff81002b62fcf0 ffff81002b62fcd8
[1172610.342618]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.345448]  ffffffff80747dc0 ffff8101ccda3028 ffff81002b62fcf4 ffff81002b62fce8
[1172610.345551] Call Trace:
[1172610.351072]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172610.353915]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.356765]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172610.359622]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172610.362477]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172610.365337]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172610.368184]  [<ffffffff8026c04a>] sys_fchmodat+0x6a/0x120
[1172610.371026]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172610.373843]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172610.376628]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172610.379402]  [<ffffffff8026ccc6>] sys_close+0x96/0x100
[1172610.382135]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.384846] 
[1172610.387529] sshd          ? 0000000000000000     0  7218   7187
[1172610.390280]  ffff81013bd7bee8 0000000000000046 ffff81013bd7beb0 0000000000000011
[1172610.393084]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.395907]  ffffffff80747dc0 ffff8101bf6ae918 ffff81013bd7beb4 ffff81013bd7bea8
[1172610.396010] Call Trace:
[1172610.401528]  [<ffffffff8022246c>] __cond_resched+0x1c/0x50
[1172610.404362]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172610.407192]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172610.409993]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.412776] 
[1172610.415520] sshd          S 0000000000000000     0  7236   7582
[1172610.418293]  ffff8101e4a89bf8 0000000000000082 ffff8101e4a89bc0 ffff81013bf542c0
[1172610.421090]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.423898]  ffffffff80747dc0 ffff810168684208 ffff8101e4a89bc4 ffff8101e4a89bb8
[1172610.424001] Call Trace:
[1172610.429474]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.432284]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.435096]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.437896]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.440690]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.443487]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.446249]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.448997]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.451737]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.454491]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.457244]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.459989]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.462724]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.465430]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.468131] 
[1172610.470765] sshd          S 0000000000000000     0  7238   7236
[1172610.473440]  ffff810046e1f9e8 0000000000000082 ffff810046e1f9b0 0000000000000002
[1172610.476161]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.478873]  ffffffff80747dc0 ffff810168685028 ffff810046e1f9b4 ffff810046e1f9a8
[1172610.478975] Call Trace:
[1172610.484236]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.486940]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.489645]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.492340]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.495030]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.497738]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.500417]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.503076]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.505711]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172610.508366]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.511004]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.513638]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.516245]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.518841]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.521423]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.523974]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.526518]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.529058]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.531592]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.534118]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.536645]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.539162] 
[1172610.541651] bash          S 000000000000000e     0  7239   7238
[1172610.544203]  ffff8100aae5fe88 0000000000000082 80000001bab2c065 ffff810145b6ae20
[1172610.546809]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.549446]  ffffffff80747dc0 ffff810168685738 ffff8100aae5fe38 ffff810065785f18
[1172610.549550] Call Trace:
[1172610.554709]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.557368]  [<ffffffff8021ed69>] update_curr+0x109/0x120
[1172610.560022]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.562647]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172610.565267]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.567871]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.570435]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.572998]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.575555]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.578118] 
[1172610.580652] sshd          S 0000000000000000     0  7248   7582
[1172610.583235]  ffff8101120d5bf8 0000000000000082 ffff8101120d5bc0 ffff81001e998dc0
[1172610.585865]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.588489]  ffffffff80747dc0 ffff810130906208 ffff8101120d5bc4 ffff8101120d5bb8
[1172610.588592] Call Trace:
[1172610.593666]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.596253]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.598824]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.601405]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.603992]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.606571]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.609138]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.611720]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.614293]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.616883]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.619463]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.622029]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.624594]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.627144]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.629703] 
[1172610.632237] sshd          S 0000000000000000     0  7250   7248
[1172610.634822]  ffff810126f3d9e8 0000000000000086 ffff810126f3d9b0 0000000000000002
[1172610.637453]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.640086]  ffffffff80747dc0 ffff810130907028 ffff810126f3d9b4 ffff810126f3d9a8
[1172610.640190] Call Trace:
[1172610.645268]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.647857]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.650429]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.652990]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.655552]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.658131]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.660680]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.663230]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.665779]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172610.668368]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.670946]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.673510]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.676075]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.678653]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.681222]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.683798]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.686386]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.688970]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.691546]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.694114]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.696683]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.699244] 
[1172610.701782] bash          S 000000000000000e     0  7251   7250
[1172610.704370]  ffff810121e8de88 0000000000000086 800000008e47c065 ffff8101afbec710
[1172610.707005]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.709641]  ffffffff80747dc0 ffff810130907738 ffff810121e8de38 ffff8101e65ef9d8
[1172610.709744] Call Trace:
[1172610.714827]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.717419]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.719979]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.722535]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.725088]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.727650]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.730203]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.732759] 
[1172610.735278] su            S 0000000000000000     0  7269   7251
[1172610.737850]  ffff8101a5007e88 0000000000000086 ffff8101a5007e50 ffff8100219c0e20
[1172610.740475]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.743107]  ffffffff80747dc0 ffff8101afbec918 ffff8101a5007e54 ffff8101a5007e48
[1172610.743210] Call Trace:
[1172610.748316]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.750913]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.753518]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.756084] 
[1172610.758600] bash          S 0000000000000000     0  7270   7269
[1172610.761175]  ffff81014bc9be88 0000000000000086 ffff81014bc9be50 ffff810139e7c000
[1172610.763792]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.766419]  ffffffff80747dc0 ffff8100219c1028 ffff81014bc9be54 ffff81014bc9be48
[1172610.766521] Call Trace:
[1172610.771636]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.774264]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.776885]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172610.779492]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.782107]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172610.784719]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.787329] 
[1172610.789920] sshd          S 0000000000000000     0  7278   7582
[1172610.792579]  ffff810194cf5bf8 0000000000000086 ffff810194cf5bc0 ffff810010755600
[1172610.795276]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.797987]  ffffffff80747dc0 ffff81002d667738 ffff810194cf5bc4 ffff810194cf5bb8
[1172610.798090] Call Trace:
[1172610.803311]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.805992]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172610.808641]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172610.811284]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.813937]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172610.816593]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.819250]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172610.821914]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172610.824602]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.827337]  [<ffffffff8026b7cf>] __dentry_open+0x11f/0x1b0
[1172610.830101]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172610.832855]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172610.835593]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172610.838321]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.841049] 
[1172610.843744] sshd          S 0000000000000000     0  7280   7278
[1172610.846501]  ffff81013acb39e8 0000000000000082 ffff81013acb39b0 0000000000000002
[1172610.849305]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.852125]  ffffffff80747dc0 ffff81011060e918 ffff81013acb39b4 ffff81013acb39a8
[1172610.852228] Call Trace:
[1172610.857719]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172610.860553]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172610.863393]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172610.866228]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172610.869046]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.871874]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.874652]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.877377]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.880068]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172610.882722]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172610.885354]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172610.887984]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172610.890616]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172610.893251]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172610.895887]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172610.898512]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172610.901144]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172610.903780]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.906421]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172610.909040]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172610.911632]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172610.914215]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.916754] 
[1172610.919253] bash          S 000000000000000e     0  7281   7280
[1172610.921808]  ffff8101919e3e88 0000000000000082 80000001542be065 ffff8100867c7530
[1172610.924409]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.927021]  ffffffff80747dc0 ffff81011060f028 ffff8101919e3e38 ffff8101aae8a930
[1172610.927124] Call Trace:
[1172610.932186]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172610.934771]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.937337]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172610.939863]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.942391]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.944923] 
[1172610.947429] su            S 0000000000000000     0  7288   7281
[1172610.949987]  ffff81004e873e88 0000000000000086 ffff81004e873e50 ffff81011060f530
[1172610.952588]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.955214]  ffffffff80747dc0 ffff8100867c7738 ffff81004e873e54 ffff81004e873e48
[1172610.955317] Call Trace:
[1172610.960412]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172610.963007]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.965602]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172610.968186] 
[1172610.970703] bash          S 0000000000000000     0  7289   7288
[1172610.973262]  ffff810043dbfdb8 0000000000000082 ffff810043dbfd80 0000000000000fee
[1172610.975867]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172610.978487]  ffffffff80747dc0 ffff81011060f738 ffff810043dbfd84 ffff810043dbfd78
[1172610.978590] Call Trace:
[1172610.983666]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172610.986293]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172610.988916]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172610.991531]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172610.994156]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172610.996766]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172610.999359]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.001936]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.004527] 
[1172611.007092] strace        S 0000000000000000     0  7319   7270
[1172611.009707]  ffff8101534a9e88 0000000000000086 ffff8101534a9e50 0000000000000092
[1172611.012368]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.015032]  ffffffff80747dc0 ffff810139e7c208 ffff8101534a9e54 ffff8101534a9e48
[1172611.015135] Call Trace:
[1172611.020281]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.022914]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172611.025526]  [<ffffffff80231aa1>] kill_pid_info+0x51/0x90
[1172611.028133]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.030760]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.033389] 
[1172611.035983] rm            D 0000000000000000     0  7463   7239
[1172611.038664]  ffff8101254a3b08 0000000000000086 ffff8101254a3ad0 ffffffff80592c6c
[1172611.041422]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.044223]  ffffffff80747dc0 ffff810145b6b028 ffff8101254a3ad4 ffff8101254a3ac8
[1172611.044326] Call Trace:
[1172611.049792]  [<ffffffff80592c6c>] __down+0x10c/0x11f
[1172611.052604]  [<ffffffff80592c07>] __down+0xa7/0x11f
[1172611.055405]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.058227]  [<ffffffff80592886>] __down_failed+0x35/0x3a
[1172611.061044]  [<ffffffff8037c09e>] xfs_buf_lock+0x3e/0x40
[1172611.063866]  [<ffffffff80367be5>] xfs_getsb+0x15/0x40
[1172611.066676]  [<ffffffff8036e2da>] xfs_trans_getsb+0x5a/0xb0
[1172611.069478]  [<ffffffff8036d1bf>] xfs_trans_apply_sb_deltas+0xf/0x370
[1172611.072281]  [<ffffffff8036d5be>] _xfs_trans_commit+0x9e/0x3c0
[1172611.075085]  [<ffffffff8039c301>] __up_read+0x21/0xb0
[1172611.077884]  [<ffffffff80327522>] xfs_free_extent+0xe2/0x110
[1172611.080690]  [<ffffffff80379e9c>] kmem_zone_alloc+0x5c/0xd0
[1172611.083499]  [<ffffffff80379e9c>] kmem_zone_alloc+0x5c/0xd0
[1172611.086267]  [<ffffffff80379f42>] kmem_zone_zalloc+0x32/0x50
[1172611.089024]  [<ffffffff80357c9b>] xfs_itruncate_finish+0xdb/0x320
[1172611.091768]  [<ffffffff80378311>] xfs_inactive+0x3f1/0x520
[1172611.094486]  [<ffffffff80384629>] xfs_fs_clear_inode+0xa9/0x100
[1172611.097203]  [<ffffffff802821e8>] clear_inode+0x58/0xf0
[1172611.099883]  [<ffffffff80282369>] generic_delete_inode+0xe9/0xf0
[1172611.102557]  [<ffffffff802783fa>] do_unlinkat+0x14a/0x1c0
[1172611.105235]  [<ffffffff8059301d>] error_exit+0x0/0x84
[1172611.107916]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.110592] 
[1172611.113232] pickup        S 0000000000000000     0  7573  30580
[1172611.115922]  ffff81021d34be58 0000000000000086 ffff81021d34be20 0000000000000000
[1172611.118661]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.121398]  ffffffff80747dc0 ffff8101964af028 ffff81021d34be24 ffff81021d34be18
[1172611.121501] Call Trace:
[1172611.126801]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.129501]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.132189]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172611.134877]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.137570]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.140247] 
[1172611.142890] bash          D 0000000000000000     0  8896      1
[1172611.145570]  ffff8101cdf07ac8 0000000000000046 ffff8101cdf07a90 ffff810226a79800
[1172611.148276]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.150995]  ffffffff80747dc0 ffff810114417738 ffff8101cdf07a94 ffff8101cdf07a88
[1172611.151098] Call Trace:
[1172611.156317]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172611.159006]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.161706]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172611.164401]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172611.167086]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172611.169785]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172611.172499]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.175232]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172611.177948]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172611.180652]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172611.183331]  [<ffffffff80228971>] put_files_struct+0xb1/0xd0
[1172611.185991]  [<ffffffff80229d79>] do_exit+0x1a9/0x8a0
[1172611.188636]  [<ffffffff80230c85>] __dequeue_signal+0x165/0x1f0
[1172611.191258]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.193857]  [<ffffffff80232ee7>] get_signal_to_deliver+0x2c7/0x470
[1172611.196464]  [<ffffffff8020af65>] do_notify_resume+0xc5/0x7a0
[1172611.199077]  [<ffffffff80230992>] send_signal+0x62/0x1f0
[1172611.201678]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.204289]  [<ffffffff80231a2e>] group_send_sig_info+0x6e/0x90
[1172611.206890]  [<ffffffff8020b984>] sys_rt_sigreturn+0x324/0x3d0
[1172611.209498]  [<ffffffff802322be>] sys_rt_sigaction+0x8e/0xc0
[1172611.212068]  [<ffffffff8020bd66>] int_signal+0x12/0x17
[1172611.214618] 
[1172611.217129] su            ? 0000000000000000     0  8903   8896
[1172611.219666]  ffff8101e685dee8 0000000000000046 ffff8101e685deb0 0000000000000011
[1172611.222241]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.224859]  ffffffff80747dc0 ffff8101158e9028 ffff8101e685deb4 ffff8101e685dea8
[1172611.224962] Call Trace:
[1172611.230051]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172611.232666]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.235284]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.237904] 
[1172611.240493] bash          D ffff8101bfb7e600     0  8977      1
[1172611.243132]  ffff810106e37ac8 0000000000000046 ffff810106e37c08 ffff810226a79800
[1172611.245831]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.248548]  ffffffff80747dc0 ffff81018e79d738 0000000000000000 0000000000000000
[1172611.248652] Call Trace:
[1172611.253996]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172611.256787]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.259581]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172611.262374]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172611.265167]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172611.267952]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172611.270733]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172611.273502]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172611.276259]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172611.279016]  [<ffffffff80228971>] put_files_struct+0xb1/0xd0
[1172611.281764]  [<ffffffff80229d79>] do_exit+0x1a9/0x8a0
[1172611.284504]  [<ffffffff80230c85>] __dequeue_signal+0x165/0x1f0
[1172611.287232]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.289939]  [<ffffffff80232ee7>] get_signal_to_deliver+0x2c7/0x470
[1172611.292654]  [<ffffffff8020af65>] do_notify_resume+0xc5/0x7a0
[1172611.295338]  [<ffffffff80230992>] send_signal+0x62/0x1f0
[1172611.298000]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.300678]  [<ffffffff80231a2e>] group_send_sig_info+0x6e/0x90
[1172611.303357]  [<ffffffff8020b984>] sys_rt_sigreturn+0x324/0x3d0
[1172611.306036]  [<ffffffff802322be>] sys_rt_sigaction+0x8e/0xc0
[1172611.308696]  [<ffffffff8020bd66>] int_signal+0x12/0x17
[1172611.311338] 
[1172611.313951] su            ? 0000000000000000     0  8984   8977
[1172611.316601]  ffff810151203ee8 0000000000000046 ffff810151203eb0 0000000000000011
[1172611.319282]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.321981]  ffffffff80747dc0 ffff81021a284918 ffff810151203eb4 ffff810151203ea8
[1172611.322083] Call Trace:
[1172611.327263]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172611.329910]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.332547]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.335180] 
[1172611.337787] sshd          S 0000000000000000     0  9072   7582
[1172611.340453]  ffff81012ee91bf8 0000000000000082 ffff81012ee91bc0 ffff8101b0d95080
[1172611.343161]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.345879]  ffffffff80747dc0 ffff8101cb862918 ffff81012ee91bc4 ffff81012ee91bb8
[1172611.345982] Call Trace:
[1172611.351307]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.354060]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172611.356818]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172611.359584]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.362359]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172611.365126]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.367882]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172611.370649]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172611.373404]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.376174]  [<ffffffff8021e992>] pick_next_task_fair+0x42/0x70
[1172611.378939]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.381719]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172611.384497]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172611.387260]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.390008]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.392729] 
[1172611.395395] sshd          S 0000000000000000     0  9074   9072
[1172611.398114]  ffff8101677179e8 0000000000000086 ffff8101677179b0 0000000000000002
[1172611.400847]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.403591]  ffffffff80747dc0 ffff8101cb863738 ffff8101677179b4 ffff8101677179a8
[1172611.403694] Call Trace:
[1172611.409063]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.411822]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.414587]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172611.417307]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172611.420004]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.422704]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.425339]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.427923]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.430472]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172611.433013]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172611.435547]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172611.438080]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172611.440607]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172611.443136]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172611.445679]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.448224]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172611.450769]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.453330]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.455892]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172611.458451]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172611.460996]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172611.463530]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.466056] 
[1172611.468545] bash          S 0000000000000000     0  9075   9074
[1172611.471088]  ffff8101a8d01db8 0000000000000086 ffff8101a8d01d80 0000000000000ff5
[1172611.473676]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.476296]  ffffffff80747dc0 ffff81010f26c208 ffff8101a8d01d84 ffff8101a8d01d78
[1172611.476398] Call Trace:
[1172611.481491]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.484118]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172611.486724]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172611.489303]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.491890]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172611.494437]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172611.496960]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.499471]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.501978] 
[1172611.504443] sshd          S 0000000000000000     0  9477   7582
[1172611.506967]  ffff810122bb5bf8 0000000000000082 ffff810122bb5bc0 ffff810102e23600
[1172611.509518]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.512071]  ffffffff80747dc0 ffff81019b72e918 ffff810122bb5bc4 ffff810122bb5bb8
[1172611.512174] Call Trace:
[1172611.517102]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.519615]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172611.522128]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172611.524648]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.527170]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172611.529681]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.532193]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172611.534712]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172611.537222]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.539741]  [<ffffffff8021e992>] pick_next_task_fair+0x42/0x70
[1172611.542257]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.544776]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172611.547286]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172611.549793]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.552298]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.554805] 
[1172611.557268] sshd          S 0000000000000000     0  9479   9477
[1172611.559791]  ffff8101d7f7b9e8 0000000000000082 ffff8101d7f7b9b0 0000000000000002
[1172611.562340]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.564892]  ffffffff80747dc0 ffff81019b72f738 ffff8101d7f7b9b4 ffff8101d7f7b9a8
[1172611.564995] Call Trace:
[1172611.569926]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.572443]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.574957]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172611.577469]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172611.579979]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.582500]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.585023]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.587546]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.590069]  [<ffffffff8050bd41>] skb_copy_datagram_iovec+0x1a1/0x260
[1172611.592602]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172611.595136]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172611.597669]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172611.600206]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172611.602755]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.605295]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172611.607838]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.610396]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.612949]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172611.615496]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172611.618033]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172611.620569]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.623100] 
[1172611.625606] bash          S 7fffffffffffffff     0  9480   9479
[1172611.628160]  ffff8101d7ed1db8 0000000000000086 000000000000000b 0000000000000ff5
[1172611.630773]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.633395]  ffffffff80747dc0 ffff8101cb7ee208 0000000000000000 ffff8101657c8018
[1172611.633497] Call Trace:
[1172611.638557]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.641136]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172611.643699]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172611.646256]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.648829]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172611.651389]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172611.653928]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.656463]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.659013] 
[1172611.661536] su            S 0000000000000000     0  9613      1
[1172611.664103]  ffff8101c3c57e88 0000000000000086 ffff8101c3c57e50 ffff810117ac0000
[1172611.666717]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.669327]  ffffffff80747dc0 ffff810106581028 ffff8101c3c57e54 ffff8101c3c57e48
[1172611.669430] Call Trace:
[1172611.674472]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172611.677029]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.679584]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.682132] 
[1172611.684643] bash          S 000000000000000e     0  9614   9613
[1172611.687205]  ffff8101ebc27e88 0000000000000082 80000001df3f8065 ffff8101a86f6710
[1172611.689809]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.692439]  ffffffff80747dc0 ffff810117ac0208 ffff8101ebc27e38 ffff8101786d7a80
[1172611.692542] Call Trace:
[1172611.697656]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172611.700289]  [<ffffffff8021ed69>] update_curr+0x109/0x120
[1172611.702917]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172611.705533]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.708163]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172611.710787]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172611.713422]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.716078]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172611.718716]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.721349] 
[1172611.723928] bash          D ffff81017bb82900     0  9632      1
[1172611.726540]  ffff8101514abac8 0000000000000046 ffff8101514abc08 ffff810226a79800
[1172611.729205]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.731857]  ffffffff80747dc0 ffff810136f4c918 ffff810007139a50 ffff810004cd4a50
[1172611.731960] Call Trace:
[1172611.737092]  [<ffffffff80590f9d>] wait_for_completion+0x7d/0xc0
[1172611.739754]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172611.742431]  [<ffffffff8023706a>] flush_cpu_workqueue+0x6a/0x90
[1172611.745109]  [<ffffffff802371b0>] wq_barrier_func+0x0/0x10
[1172611.747812]  [<ffffffff80237183>] flush_workqueue+0x33/0x50
[1172611.750540]  [<ffffffff803e633f>] release_dev+0x44f/0x750
[1172611.753296]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.756058]  [<ffffffff803e6651>] tty_release+0x11/0x20
[1172611.758805]  [<ffffffff8026e531>] __fput+0xb1/0x1a0
[1172611.761549]  [<ffffffff8026b544>] filp_close+0x54/0x90
[1172611.764295]  [<ffffffff80228971>] put_files_struct+0xb1/0xd0
[1172611.767039]  [<ffffffff80229d79>] do_exit+0x1a9/0x8a0
[1172611.769781]  [<ffffffff80230c85>] __dequeue_signal+0x165/0x1f0
[1172611.772533]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.775279]  [<ffffffff80232ee7>] get_signal_to_deliver+0x2c7/0x470
[1172611.778032]  [<ffffffff8020af65>] do_notify_resume+0xc5/0x7a0
[1172611.780784]  [<ffffffff80230992>] send_signal+0x62/0x1f0
[1172611.783537]  [<ffffffff80231215>] __group_send_sig_info+0x75/0xa0
[1172611.786308]  [<ffffffff80231a2e>] group_send_sig_info+0x6e/0x90
[1172611.789086]  [<ffffffff8020b984>] sys_rt_sigreturn+0x324/0x3d0
[1172611.791858]  [<ffffffff802322be>] sys_rt_sigaction+0x8e/0xc0
[1172611.794615]  [<ffffffff8020bd66>] int_signal+0x12/0x17
[1172611.797334] 
[1172611.799993] su            ? 0000000000000000     0  9639   9632
[1172611.802704]  ffff8101b98afee8 0000000000000046 ffff8101b98afeb0 0000000000000011
[1172611.805431]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.808166]  ffffffff80747dc0 ffff8101243a7028 ffff8101b98afeb4 ffff8101b98afea8
[1172611.808269] Call Trace:
[1172611.813600]  [<ffffffff8022a18e>] do_exit+0x5be/0x8a0
[1172611.816333]  [<ffffffff8022a49c>] do_group_exit+0x2c/0x80
[1172611.819057]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.821794] 
[1172611.824519] mdadm         D 0000000000000000     0  9783   9614
[1172611.827312]  ffff8101aea09a18 0000000000000082 ffff8101aea099e0 ffff8101aea09998
[1172611.830142]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.832994]  ffffffff80747dc0 ffff8101a86f6918 ffff8101aea099e4 ffff8101aea099d8
[1172611.833098] Call Trace:
[1172611.838611]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172611.841427]  [<ffffffff80247ee0>] sync_page+0x0/0x50
[1172611.844200]  [<ffffffff80591348>] io_schedule+0x28/0x40
[1172611.846961]  [<ffffffff80247f1b>] sync_page+0x3b/0x50
[1172611.849716]  [<ffffffff8059181a>] __wait_on_bit_lock+0x4a/0x80
[1172611.852476]  [<ffffffff80247ebf>] __lock_page+0x5f/0x70
[1172611.855220]  [<ffffffff8023acf0>] wake_bit_function+0x0/0x30
[1172611.857968]  [<ffffffff8024f08a>] pagevec_lookup_tag+0x1a/0x30
[1172611.860699]  [<ffffffff8024d991>] write_cache_pages+0x191/0x340
[1172611.863407]  [<ffffffff8024d370>] __writepage+0x0/0x30
[1172611.866104]  [<ffffffff8024db90>] do_writepages+0x20/0x40
[1172611.868763]  [<ffffffff8028c179>] __writeback_single_inode+0x2d9/0x400
[1172611.871430]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172611.874087]  [<ffffffff8028c6ca>] sync_sb_inodes+0x21a/0x300
[1172611.876755]  [<ffffffff8028c851>] sync_inodes_sb+0xa1/0xc0
[1172611.879405]  [<ffffffff8026f08b>] __fsync_super+0xb/0x70
[1172611.882049]  [<ffffffff8026f0f9>] fsync_super+0x9/0x20
[1172611.884692]  [<ffffffff80291486>] fsync_bdev+0x26/0x60
[1172611.887318]  [<ffffffff803929a7>] blkdev_ioctl+0x1c7/0x7a0
[1172611.889939]  [<ffffffff802560f1>] handle_mm_fault+0x1a1/0x8a0
[1172611.892573]  [<ffffffff804b072a>] md_open+0x6a/0x90
[1172611.895186]  [<ffffffff802962e0>] blkdev_open+0x0/0x90
[1172611.897799]  [<ffffffff8039c301>] __up_read+0x21/0xb0
[1172611.900374]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172611.902936]  [<ffffffff8029631c>] blkdev_open+0x3c/0x90
[1172611.905489]  [<ffffffff8029548b>] block_ioctl+0x1b/0x30
[1172611.907994]  [<ffffffff8027a28f>] do_ioctl+0x2f/0xa0
[1172611.910470]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172611.912938]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172611.915381]  [<ffffffff8059301d>] error_exit+0x0/0x84
[1172611.917816]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.920256] 
[1172611.922661] sshd          S 0000000000000000     0  9793   7582
[1172611.925122]  ffff8101a7fabbf8 0000000000000086 ffff8101a7fabbc0 ffff8101cd1f1600
[1172611.927626]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.930154]  ffffffff80747dc0 ffff8101536d0918 ffff8101a7fabbc4 ffff8101a7fabbb8
[1172611.930258] Call Trace:
[1172611.935198]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172611.937753]  [<ffffffff8023ae53>] prepare_to_wait+0x23/0x80
[1172611.940308]  [<ffffffff80575ac6>] unix_stream_recvmsg+0x386/0x550
[1172611.942871]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.945439]  [<ffffffff80277aa0>] link_path_walk+0x80/0xf0
[1172611.947997]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172611.950553]  [<ffffffff8026b5f9>] get_unused_fd_flags+0x79/0x120
[1172611.953111]  [<ffffffff8026d349>] do_sync_read+0xd9/0x120
[1172611.955662]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172611.958225]  [<ffffffff8021e992>] pick_next_task_fair+0x42/0x70
[1172611.960800]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172611.963379]  [<ffffffff8026b96a>] do_filp_open+0x3a/0x50
[1172611.965946]  [<ffffffff8026dcf7>] vfs_read+0x157/0x160
[1172611.968507]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172611.971029]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172611.973523] 
[1172611.975978] sshd          S 0000000000000000     0  9795   9793
[1172611.978461]  ffff81021f41d9e8 0000000000000082 ffff81021f41d9b0 0000000000000002
[1172611.980981]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172611.983533]  ffffffff80747dc0 ffff8101536d1738 ffff81021f41d9b4 ffff81021f41d9a8
[1172611.983636] Call Trace:
[1172611.988598]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172611.991157]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172611.993698]  [<ffffffff8027b528>] do_select+0x468/0x560
[1172611.996208]  [<ffffffff8027bbc0>] __pollwait+0x0/0x130
[1172611.998705]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.001178]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.003617]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.006034]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.008424]  [<ffffffff80267609>] add_partial+0x19/0x60
[1172612.010813]  [<ffffffff80268a0d>] __slab_free+0x15d/0x310
[1172612.013194]  [<ffffffff80592da9>] _spin_lock_bh+0x9/0x20
[1172612.015567]  [<ffffffff80505743>] release_sock+0x13/0xb0
[1172612.017935]  [<ffffffff80547700>] tcp_recvmsg+0x370/0x940
[1172612.020296]  [<ffffffff80505080>] sock_common_recvmsg+0x30/0x50
[1172612.022667]  [<ffffffff80502b9b>] sock_aio_read+0x11b/0x130
[1172612.025029]  [<ffffffff8027b829>] core_sys_select+0x209/0x300
[1172612.027401]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172612.029774]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.032143]  [<ffffffff8022b51e>] current_fs_time+0x1e/0x30
[1172612.034510]  [<ffffffff803e3582>] tty_ldisc_deref+0x52/0x80
[1172612.036880]  [<ffffffff8027bdc1>] sys_select+0xd1/0x1c0
[1172612.039245]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.041607] 
[1172612.043951] bash          S 000000000000000e     0  9796   9795
[1172612.046358]  ffff81013de09e88 0000000000000086 8000000104441065 ffff8101125a2710
[1172612.048809]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.051282]  ffffffff80747dc0 ffff81014da80208 ffff81013de09e38 ffff8101eab7d5e8
[1172612.051385] Call Trace:
[1172612.056215]  [<ffffffff8021cb22>] do_page_fault+0x202/0x890
[1172612.058715]  [<ffffffff8021ed69>] update_curr+0x109/0x120
[1172612.061212]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172612.063714]  [<ffffffff805907c6>] __sched_text_start+0x166/0x23d
[1172612.066238]  [<ffffffff8021f7e3>] __wake_up+0x43/0x70
[1172612.068760]  [<ffffffff8027a520>] vfs_ioctl+0x220/0x2c0
[1172612.071291]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.073847]  [<ffffffff8027a609>] sys_ioctl+0x49/0x80
[1172612.076399]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.078935] 
[1172612.081438] su            S 0000000000000000     0  9804   9796
[1172612.083976]  ffff810184fdbe88 0000000000000082 ffff810184fdbe50 ffff810120808000
[1172612.086547]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.089126]  ffffffff80747dc0 ffff8101125a2918 ffff810184fdbe54 ffff810184fdbe48
[1172612.089229] Call Trace:
[1172612.094170]  [<ffffffff80229439>] do_wait+0x599/0xc90
[1172612.096703]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.099244]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.101772] 
[1172612.104264] bash          S 0000000000000000     0  9805   9804
[1172612.106820]  ffff8101e88f7db8 0000000000000082 ffff8101e88f7d80 0000000000000ff9
[1172612.109419]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.112036]  ffffffff80747dc0 ffff810120808208 ffff8101e88f7d84 ffff8101e88f7d78
[1172612.112139] Call Trace:
[1172612.117216]  [<ffffffff80591755>] schedule_timeout+0x95/0xd0
[1172612.119833]  [<ffffffff8023af8c>] add_wait_queue+0x1c/0x60
[1172612.122446]  [<ffffffff803e9bf8>] read_chan+0x228/0x6f0
[1172612.125058]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.127700]  [<ffffffff803e6710>] tty_read+0xb0/0x100
[1172612.130342]  [<ffffffff8026dc65>] vfs_read+0xc5/0x160
[1172612.132958]  [<ffffffff8026e113>] sys_read+0x53/0x90
[1172612.135554]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.138121] 
[1172612.140634] smtpd         S 0000000000000000     0  9847  30580
[1172612.143203]  ffff8101a6e25e58 0000000000000086 ffff8101a6e25e20 ffff81022583d318
[1172612.145786]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.148371]  ffffffff80747dc0 ffff8101d859a208 ffff8101a6e25e24 ffff8101a6e25e18
[1172612.148474] Call Trace:
[1172612.153514]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172612.156129]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172612.158743]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172612.161385]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.164066]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.166774] 
[1172612.169446] smtpd         S ffff81022583d318     0  9963  30580
[1172612.172187]  ffff8101c5f69eb8 0000000000000082 0000000000000000 ffffffff00000001
[1172612.174990]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.177819]  ffffffff80747dc0 ffff810105b04918 0000000000000000 000000008bcec672
[1172612.177922] Call Trace:
[1172612.183467]  [<ffffffff8022b4c9>] ns_to_timeval+0x9/0x40
[1172612.186321]  [<ffffffff8027da7d>] flock_lock_file_wait+0x14d/0x300
[1172612.189190]  [<ffffffff8023acc0>] autoremove_wake_function+0x0/0x30
[1172612.192057]  [<ffffffff8027e7ab>] sys_flock+0x16b/0x180
[1172612.194913]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.197759] 
[1172612.200578] cleanup       S 0000000000000000     0  9966  30580
[1172612.203466]  ffff8101b50b7e58 0000000000000082 ffff8101b50b7e20 ffff8101a496a828
[1172612.206409]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.209358]  ffffffff80747dc0 ffff810132074208 ffff8101b50b7e24 ffff8101b50b7e18
[1172612.209460] Call Trace:
[1172612.215203]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172612.218127]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172612.221046]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172612.223934]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.226813]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.229693] 
[1172612.232543] local         S 0000000000000000     0  9967  30580
[1172612.235450]  ffff8101c7bf9e58 0000000000000086 ffff8101c7bf9e20 0000000000000000
[1172612.238401]  ffffffff80747dc0 ffffffff80747dc0 ffffffff80747dc0 ffffffff80744d80
[1172612.241380]  ffffffff80747dc0 ffff8101b11bd738 ffff8101c7bf9e24 ffff8101c7bf9e18
[1172612.241483] Call Trace:
[1172612.247296]  [<ffffffff8059171f>] schedule_timeout+0x5f/0xd0
[1172612.250292]  [<ffffffff8022f920>] process_timeout+0x0/0x10
[1172612.253278]  [<ffffffff8029af2d>] sys_epoll_wait+0x1bd/0x4e0
[1172612.256265]  [<ffffffff8021fed0>] default_wake_function+0x0/0x10
[1172612.259237]  [<ffffffff8020bb4e>] system_call+0x7e/0x83
[1172612.262188]
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists