[ 21.620002] ------------[ cut here ]------------ [ 21.620002] WARNING: at /home/peter/src/kernels/next/kernel/watchdog.c:245 watchdog_overflow_callback+0x9f/0xd0() [ 21.620002] Hardware name: Precision WorkStation T5400 [ 21.620002] Watchdog detected hard LOCKUP on cpu 0 [ 21.620002] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 21.620002] Pid: 1286, comm: blkid Not tainted 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch [ 21.620002] Call Trace: [ 21.620002] [] warn_slowpath_common+0x7f/0xc0 [ 21.620002] [] warn_slowpath_fmt+0x46/0x50 [ 21.620002] [] ? touch_nmi_watchdog+0x80/0x80 [ 21.620002] [] watchdog_overflow_callback+0x9f/0xd0 [ 21.620002] [] ? perf_event_task_disable+0x90/0x90 [ 21.620002] [] __perf_event_overflow+0x9d/0x310 [ 21.620002] [] ? x86_perf_event_set_period+0xd9/0x160 [ 21.620002] [] ? x86_perf_event_update+0x55/0xb0 [ 21.620002] [] perf_event_overflow+0x14/0x20 [ 21.620002] [] intel_pmu_handle_irq+0x1be/0x370 [ 21.620002] [] perf_event_nmi_handler+0x1d/0x20 [ 21.620002] [] nmi_handle.isra.2+0xae/0x1f0 [ 21.620002] [] ? nmi_handle.isra.2+0x5/0x1f0 [ 21.620002] [] do_nmi+0x108/0x380 [ 21.620002] [] end_repeat_nmi+0x1e/0x2e [ 21.620002] [] ? native_read_tsc+0x6/0x20 [ 21.620002] [] ? native_read_tsc+0x6/0x20 [ 21.620002] [] ? native_read_tsc+0x6/0x20 [ 21.620002] <> [] delay_tsc+0x36/0xf0 [ 21.620002] [] __delay+0xf/0x20 [ 21.620002] [] do_raw_spin_lock+0xc5/0x120 [ 21.620002] [] _raw_spin_lock_irq+0x4f/0x60 [ 21.620002] [] ? blk_queue_bio+0x1bd/0x560 [ 21.620002] [] blk_queue_bio+0x1bd/0x560 [ 21.620002] [] generic_make_request+0xc2/0x110 [ 21.620002] [] submit_bio+0x79/0x160 [ 21.620002] [] ? bio_alloc_bioset+0x65/0x120 [ 21.620002] [] submit_bh+0x123/0x210 [ 21.620002] [] block_read_full_page+0x205/0x3a0 [ 21.620002] [] ? I_BDEV+0x10/0x10 [ 21.620002] [] ? __lru_cache_add+0x75/0xd0 [ 21.620002] [] blkdev_readpage+0x18/0x20 [ 21.620002] [] __do_page_cache_readahead+0x36a/0x370 [ 21.620002] [] ? __do_page_cache_readahead+0x118/0x370 [ 21.620002] [] ? delayacct_end+0x89/0xa0 [ 21.620002] [] force_page_cache_readahead+0x79/0xb0 [ 21.620002] [] page_cache_sync_readahead+0x43/0x50 [ 21.620002] [] generic_file_aio_read+0x580/0x700 [ 21.620002] [] blkdev_aio_read+0x54/0x80 [ 21.620002] [] do_sync_read+0x77/0xa0 [ 21.620002] [] vfs_read+0xa9/0x180 [ 21.620002] [] sys_read+0x52/0xa0 [ 21.620002] [] system_call_fastpath+0x16/0x1b [ 21.620002] ---[ end trace 159623cd3fb284bb ]--- [ 48.427997] BUG: soft lockup - CPU#1 stuck for 23s! [dmsetup_env:1305] [ 48.428000] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 48.428000] irq event stamp: 0 [ 48.428000] hardirqs last enabled at (0): [< (null)>] (null) [ 48.428000] hardirqs last disabled at (0): [] copy_process.part.23+0x61b/0x16b0 [ 48.428000] softirqs last enabled at (0): [] copy_process.part.23+0x61b/0x16b0 [ 48.428000] softirqs last disabled at (0): [< (null)>] (null) [ 48.428000] CPU 1 [ 48.428000] Pid: 1305, comm: dmsetup_env Tainted: G W 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch Dell Inc. Precision WorkStation T5400 /0RW203 [ 48.428000] RIP: 0010:[] [] sub_preempt_count+0x2e/0xa0 [ 48.428000] RSP: 0018:ffff8802932bbe48 EFLAGS: 00000202 [ 48.428000] RAX: ffff8802932bbfd8 RBX: ffffffff817980b7 RCX: 0000000000000000 [ 48.428000] RDX: 00000036d4e59ccc RSI: 0000000000000000 RDI: 0000000000000001 [ 48.428000] RBP: ffff8802932bbe48 R08: 0000000000000002 R09: 0000000000000000 [ 48.428000] R10: 0000000000000001 R11: 0000000000000000 R12: ffff8802932bbdb8 [ 48.428000] R13: ffff880292a9a100 R14: ffff8802932ba000 R15: ffff8802932bbfd8 [ 48.428000] FS: 00007fe33496d700(0000) GS:ffff8802afc40000(0000) knlGS:0000000000000000 [ 48.428000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 48.428000] CR2: 0000000001cc3768 CR3: 000000029ede1000 CR4: 00000000000007e0 [ 48.428000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 48.428000] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 48.428000] Process dmsetup_env (pid: 1305, threadinfo ffff8802932ba000, task ffff880292a9a100) [ 48.428000] Stack: [ 48.428000] ffff8802932bbe88 ffffffff813acdd9 ffff8802932bbfd8 ffffffff81c053c8 [ 48.428000] 0000000019760b91 0000000094a1ec46 0000000000001000 0000000001cc2760 [ 48.428000] ffff8802932bbe98 ffffffff813acc7f ffff8802932bbed8 ffffffff813b51a5 [ 48.428000] Call Trace: [ 48.428000] [] delay_tsc+0x99/0xf0 [ 48.428000] [] __delay+0xf/0x20 [ 48.428000] [] do_raw_spin_lock+0xc5/0x120 [ 48.428000] [] _raw_spin_lock+0x43/0x50 [ 48.428000] [] ? sys_getcwd+0xa1/0x1f0 [ 48.428000] [] ? _raw_spin_unlock+0x35/0x60 [ 48.428000] [] sys_getcwd+0xa1/0x1f0 [ 48.428000] [] system_call_fastpath+0x16/0x1b [ 48.428000] Code: 66 90 44 8b 0d 14 5f 6f 00 55 48 89 e5 45 85 c9 75 19 65 48 8b 04 25 30 c8 00 00 39 b8 44 e0 ff ff 7c 19 81 ff fe 00 00 00 76 36 <65> 48 8b 04 25 30 c8 00 00 29 b8 44 e0 ff ff 5d c3 e8 cc 31 c1 [ 21.576007] ------------[ cut here ]------------ [ 21.576007] WARNING: at /home/peter/src/kernels/next/kernel/watchdog.c:245 watchdog_overflow_callback+0x9f/0xd0() [ 21.576007] Hardware name: Precision WorkStation T5400 [ 21.576007] Watchdog detected hard LOCKUP on cpu 6 [ 21.576007] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 21.576007] Pid: 1289, comm: dmraid Tainted: G W 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch [ 21.576007] Call Trace: [ 21.576007] [] warn_slowpath_common+0x7f/0xc0 [ 21.576007] [] warn_slowpath_fmt+0x46/0x50 [ 21.576007] [] ? touch_nmi_watchdog+0x80/0x80 [ 21.576007] [] watchdog_overflow_callback+0x9f/0xd0 [ 21.576007] [] ? perf_event_task_disable+0x90/0x90 [ 21.576007] [] __perf_event_overflow+0x9d/0x310 [ 21.576007] [] ? x86_perf_event_set_period+0xd9/0x160 [ 21.576007] [] ? x86_perf_event_update+0x55/0xb0 [ 21.576007] [] perf_event_overflow+0x14/0x20 [ 21.576007] [] intel_pmu_handle_irq+0x1be/0x370 [ 21.576007] [] perf_event_nmi_handler+0x1d/0x20 [ 21.576007] [] nmi_handle.isra.2+0xae/0x1f0 [ 21.576007] [] ? nmi_handle.isra.2+0x5/0x1f0 [ 21.576007] [] do_nmi+0x108/0x380 [ 21.576007] [] end_repeat_nmi+0x1e/0x2e [ 21.576007] [] ? native_read_tsc+0x10/0x20 [ 21.576007] [] ? native_read_tsc+0x10/0x20 [ 21.576007] [] ? native_read_tsc+0x10/0x20 [ 21.576007] <> [] ? delay_tsc+0x36/0xf0 [ 21.576007] [] __delay+0xf/0x20 [ 21.576007] [] do_raw_spin_lock+0xc5/0x120 [ 21.576007] [] _raw_spin_lock+0x43/0x50 [ 21.576007] [] ? dentry_path_raw+0x2e/0x70 [ 21.576007] [] dentry_path_raw+0x2e/0x70 [ 21.576007] [] cgroup_path+0x57/0x100 [ 21.576007] [] cfq_completed_request+0xbb/0x9b0 [ 21.576007] [] ? cfq_completed_request+0x62/0x9b0 [ 21.576007] [] ? mix_pool_bytes.constprop.16+0x44/0x1a0 [ 21.576007] [] ? do_raw_spin_lock+0x4c/0x120 [ 21.576007] [] ? do_raw_spin_unlock+0x5d/0xb0 [ 21.576007] [] elv_completed_request+0x62/0x70 [ 21.576007] [] __blk_put_request+0x37/0x1a0 [ 21.576007] [] blk_finish_request+0xf1/0x3a0 [ 21.576007] [] ? blk_finish_request+0x121/0x3a0 [ 21.576007] [] blk_end_bidi_request+0x52/0x80 [ 21.576007] [] blk_end_request+0x10/0x20 [ 21.576007] [] scsi_io_completion+0xfb/0x6c0 [ 21.576007] [] ? do_raw_spin_unlock+0x5d/0xb0 [ 21.576007] [] scsi_finish_command+0xbd/0x120 [ 21.576007] [] scsi_softirq_done+0x13e/0x150 [ 21.576007] [] blk_done_softirq+0x93/0xb0 [ 21.576007] [] __do_softirq+0xff/0x420 [ 21.576007] [] ? trace_hardirqs_off+0xd/0x10 [ 21.576007] [] call_softirq+0x1c/0x30 [ 21.576007] [] do_softirq+0xa5/0xe0 [ 21.576007] [] irq_exit+0xc5/0xd0 [ 21.576007] [] smp_call_function_single_interrupt+0x35/0x40 [ 21.576007] [] call_function_single_interrupt+0x72/0x80 [ 21.576007] [] ? prepend_path+0x56/0x1f0 [ 21.576007] [] ? prepend_path+0x38/0x1f0 [ 21.576007] [] path_with_deleted+0x5c/0xa0 [ 21.576007] [] d_path+0xbf/0x100 [ 21.576007] [] seq_path+0x51/0xd0 [ 21.576007] [] show_vfsmnt+0x70/0x150 [ 21.576007] [] m_show+0x16/0x20 [ 21.576007] [] seq_read+0x24e/0x3c0 [ 21.576007] [] vfs_read+0xa9/0x180 [ 21.576007] [] sys_read+0x52/0xa0 [ 21.576007] [] system_call_fastpath+0x16/0x1b [ 21.576007] ---[ end trace 159623cd3fb284bc ]--- [ 21.176006] ------------[ cut here ]------------ [ 21.176006] WARNING: at /home/peter/src/kernels/next/kernel/watchdog.c:245 watchdog_overflow_callback+0x9f/0xd0() [ 21.176006] Hardware name: Precision WorkStation T5400 [ 21.176006] Watchdog detected hard LOCKUP on cpu 2 [ 21.176006] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb[ 21.176006] ------------[ cut here ]------------ [ 21.176006] WARNING: at /home/peter/src/kernels/next/net/core/skbuff.c:576 skb_release_head_state+0xed/0x100() [ 21.176006] Hardware name: Precision WorkStation T5400 [ 21.176006] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 21.176006] Pid: 751, comm: mount.ntfs-3g Tainted: G W 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch [ 21.176006] Call Trace: [ 21.176006] [] warn_slowpath_common+0x7f/0xc0 [ 21.176006] [] warn_slowpath_null+0x1a/0x20 [ 21.176006] [] skb_release_head_state+0xed/0x100 [ 21.176006] [] __kfree_skb+0x16/0xa0 [ 21.176006] [] consume_skb+0x30/0x160 [ 21.176006] [] tg3_poll_work+0x99d/0xf20 [tg3] [ 21.176006] [] ? trace_hardirqs_off+0xd/0x10 [ 21.176006] [] ? _raw_write_unlock_irqrestore+0x4a/0x90 [ 21.176006] [] ? create_object+0x253/0x310 [ 21.176006] [] ? trace_hardirqs_off+0xd/0x10 [ 21.176006] [] tg3_poll+0x7f/0x3c0 [tg3] [ 21.176006] [] netpoll_poll_dev+0x1c2/0x3b0 [ 21.176006] [] netpoll_send_skb_on_dev+0x24b/0x3f0 [ 21.176006] [] netpoll_send_udp+0x298/0x3c0 [ 21.176006] [] write_msg+0xc7/0x110 [netconsole] [ 21.176006] [] call_console_drivers.constprop.18+0x92/0x1d0 [ 21.176006] [] console_unlock+0x2b5/0x440 [ 21.176006] [] vprintk_emit+0x27e/0x5a0 [ 21.176006] [] ? trace_hardirqs_off+0xd/0x10 [ 21.176006] [] ? watchdog_overflow_callback+0x9f/0xd0 [ 21.176006] [] printk+0x61/0x63 [ 21.176006] [] print_modules+0x12e/0x160 [ 21.176006] [] warn_slowpath_common+0x7a/0xc0 [ 21.176006] [] warn_slowpath_fmt+0x46/0x50 [ 21.176006] [] ? touch_nmi_watchdog+0x80/0x80 [ 21.176006] [] watchdog_overflow_callback+0x9f/0xd0 [ 21.176006] [] ? perf_event_task_disable+0x90/0x90 [ 21.176006] [] __perf_event_overflow+0x9d/0x310 [ 21.176006] [] ? x86_perf_event_set_period+0xd9/0x160 [ 21.176006] [] ? x86_perf_event_update+0x55/0xb0 [ 21.176006] [] perf_event_overflow+0x14/0x20 [ 21.176006] [] intel_pmu_handle_irq+0x1be/0x370 [ 21.176006] [] perf_event_nmi_handler+0x1d/0x20 [ 21.176006] [] nmi_handle.isra.2+0xae/0x1f0 [ 21.176006] [] ? nmi_handle.isra.2+0x5/0x1f0 [ 21.176006] [] do_nmi+0x108/0x380 [ 21.176006] [] end_repeat_nmi+0x1e/0x2e [ 21.176006] [] ? native_read_tsc+0x6/0x20 [ 21.176006] [] ? native_read_tsc+0x6/0x20 [ 21.176006] [] ? native_read_tsc+0x6/0x20 [ 21.176006] <> [] delay_tsc+0x36/0xf0 [ 21.176006] [] __delay+0xf/0x20 [ 21.176006] [] do_raw_spin_lock+0xc5/0x120 [ 21.176006] [] _raw_spin_lock+0x43/0x50 [ 21.176006] [] ? dentry_path_raw+0x2e/0x70 [ 21.176006] [] dentry_path_raw+0x2e/0x70 [ 21.176006] [] cgroup_path+0x57/0x100 [ 21.176006] [] cfq_insert_request+0xa6/0x630 [ 21.176006] [] ? cfq_insert_request+0x4d/0x630 [ 21.176006] [] ? list_sort+0x19c/0x230 [ 21.176006] [] ? submit_bio+0x79/0x160 [ 21.176006] [] ? blk_flush_plug_list+0x1a7/0x260 [ 21.176006] [] __elv_add_request+0x1b6/0x3b0 [ 21.176006] [] blk_flush_plug_list+0x1d5/0x260 [ 21.176006] [] blk_finish_plug+0x18/0x50 [ 21.176006] [] __do_page_cache_readahead+0x2cc/0x370 [ 21.176006] [] ? __do_page_cache_readahead+0x118/0x370 [ 21.176006] [] ? trace_hardirqs_on+0xd/0x10 [ 21.176006] [] ra_submit+0x21/0x30 [ 21.176006] [] ondemand_readahead+0x10e/0x3d0 [ 21.176006] [] page_cache_async_readahead+0x88/0xb0 [ 21.176006] [] ? find_get_page+0x5/0x230 [ 21.176006] [] generic_file_aio_read+0x54b/0x700 [ 21.176006] [] blkdev_aio_read+0x54/0x80 [ 21.176006] [] do_sync_read+0x77/0xa0 [ 21.176006] [] vfs_read+0xa9/0x180 [ 21.176006] [] sys_pread64+0x9a/0xb0 [ 21.176006] [] system_call_fastpath+0x16/0x1b [ 21.176006] ---[ end trace 159623cd3fb284bd ]--- [ 21.176006] snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 21.176006] Pid: 751, comm: mount.ntfs-3g Tainted: G W 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch [ 21.176006] Call Trace: [ 21.176006] [] warn_slowpath_common+0x7f/0xc0 [ 21.176006] [] warn_slowpath_fmt+0x46/0x50 [ 21.176006] [] ? touch_nmi_watchdog+0x80/0x80 [ 21.176006] [] watchdog_overflow_callback+0x9f/0xd0 [ 21.176006] [] ? perf_event_task_disable+0x90/0x90 [ 21.176006] [] __perf_event_overflow+0x9d/0x310 [ 21.176006] [] ? x86_perf_event_set_period+0xd9/0x160 [ 21.176006] [] ? x86_perf_event_update+0x55/0xb0 [ 21.176006] [] perf_event_overflow+0x14/0x20 [ 21.176006] [] intel_pmu_handle_irq+0x1be/0x370 [ 21.176006] [] perf_event_nmi_handler+0x1d/0x20 [ 21.176006] [] nmi_handle.isra.2+0xae/0x1f0 [ 21.176006] [] ? nmi_handle.isra.2+0x5/0x1f0 [ 21.176006] [] do_nmi+0x108/0x380 [ 21.176006] [] end_repeat_nmi+0x1e/0x2e [ 21.176006] [] ? native_read_tsc+0x6/0x20 [ 21.176006] [] ? native_read_tsc+0x6/0x20 [ 21.176006] [] ? native_read_tsc+0x6/0x20 [ 21.176006] <> [] delay_tsc+0x36/0xf0 [ 21.176006] [] __delay+0xf/0x20 [ 21.176006] [] do_raw_spin_lock+0xc5/0x120 [ 21.176006] [] _raw_spin_lock+0x43/0x50 [ 21.176006] [] ? dentry_path_raw+0x2e/0x70 [ 21.176006] [] dentry_path_raw+0x2e/0x70 [ 21.176006] [] cgroup_path+0x57/0x100 [ 21.176006] [] cfq_insert_request+0xa6/0x630 [ 21.176006] [] ? cfq_insert_request+0x4d/0x630 [ 21.176006] [] ? list_sort+0x19c/0x230 [ 21.176006] [] ? submit_bio+0x79/0x160 [ 21.176006] [] ? blk_flush_plug_list+0x1a7/0x260 [ 21.176006] [] __elv_add_request+0x1b6/0x3b0 [ 21.176006] [] blk_flush_plug_list+0x1d5/0x260 [ 21.176006] [] blk_finish_plug+0x18/0x50 [ 21.176006] [] __do_page_cache_readahead+0x2cc/0x370 [ 21.176006] [] ? __do_page_cache_readahead+0x118/0x370 [ 21.176006] [] ? trace_hardirqs_on+0xd/0x10 [ 21.176006] [] ra_submit+0x21/0x30 [ 21.176006] [] ondemand_readahead+0x10e/0x3d0 [ 21.176006] [] page_cache_async_readahead+0x88/0xb0 [ 21.176006] [] ? find_get_page+0x5/0x230 [ 21.176006] [] generic_file_aio_read+0x54b/0x700 [ 21.176006] [] blkdev_aio_read+0x54/0x80 [ 21.176006] [] do_sync_read+0x77/0xa0 [ 21.176006] [] vfs_read+0xa9/0x180 [ 21.176006] [] sys_pread64+0x9a/0xb0 [ 21.176006] [] system_call_fastpath+0x16/0x1b [ 21.176006] ---[ end trace 159623cd3fb284be ]--- [ 76.427997] BUG: soft lockup - CPU#1 stuck for 23s! [dmsetup_env:1305] [ 76.428000] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 76.428000] irq event stamp: 0 [ 76.428000] hardirqs last enabled at (0): [< (null)>] (null) [ 76.428000] hardirqs last disabled at (0): [] copy_process.part.23+0x61b/0x16b0 [ 76.428000] softirqs last enabled at (0): [] copy_process.part.23+0x61b/0x16b0 [ 76.428000] softirqs last disabled at (0): [< (null)>] (null) [ 76.428000] CPU 1 [ 76.428000] Pid: 1305, comm: dmsetup_env Tainted: G W 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch Dell Inc. Precision WorkStation T5400 /0RW203 [ 76.428000] RIP: 0010:[] [] debug_smp_processor_id+0x33/0xf0 [ 76.428000] RSP: 0018:ffff8802932bbe28 EFLAGS: 00000202 [ 76.428000] RAX: 0000000000000001 RBX: ffff8802932ba000 RCX: 0000000000000000 [ 76.428000] RDX: 000000000000c7c6 RSI: 0000000000000000 RDI: 0000000000000001 [ 76.428000] RBP: ffff8802932bbe48 R08: 0000000000000002 R09: 0000000000000000 [ 76.428000] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000000 [ 76.428000] R13: 0000000000000000 R14: 0000000000010002 R15: 0000000000000000 [ 76.428000] FS: 00007fe33496d700(0000) GS:ffff8802afc40000(0000) knlGS:0000000000000000 [ 76.428000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 76.428000] CR2: 0000000001cc3768 CR3: 000000029ede1000 CR4: 00000000000007e0 [ 76.428000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 76.428000] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 76.428000] Process dmsetup_env (pid: 1305, threadinfo ffff8802932ba000, task ffff880292a9a100) [ 76.428000] Stack: [ 76.428000] 0000000000000202 ffffffff81c053c8 00000000338e3431 0000000094a1ec46 [ 76.428000] ffff8802932bbe88 ffffffff813acd68 000000000000c7c6 ffffffff81c053c8 [ 76.428000] 00000000338e3431 0000000094a1ec46 0000000000001000 0000000001cc2760 [ 76.428000] Call Trace: [ 76.428000] [] delay_tsc+0x28/0xf0 [ 76.428000] [] __delay+0xf/0x20 [ 76.428000] [] do_raw_spin_lock+0xc5/0x120 [ 76.428000] [] _raw_spin_lock+0x43/0x50 [ 76.428000] [] ? sys_getcwd+0xa1/0x1f0 [ 76.428000] [] ? _raw_spin_unlock+0x35/0x60 [ 76.428000] [] sys_getcwd+0xa1/0x1f0 [ 76.428000] [] system_call_fastpath+0x16/0x1b [ 76.428000] Code: 48 89 5d e8 4c 89 65 f0 4c 89 6d f8 65 48 8b 1c 25 30 c8 00 00 8b 83 44 e0 ff ff 65 44 8b 24 25 1c b0 00 00 85 c0 74 11 44 89 e0 <48> 8b 5d e8 4c 8b 65 f0 4c 8b 6d f8 c9 c3 9c 58 66 66 90 66 90 [ 21.384005] ------------[ cut here ]------------ [ 21.384005] WARNING: at /home/peter/src/kernels/next/kernel/watchdog.c:245 watchdog_overflow_callback+0x9f/0xd0() [ 21.384005] Hardware name: Precision WorkStation T5400 [ 21.384005] Watchdog detected hard LOCKUP on cpu 3 [ 21.384005] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 21.384005] Pid: 1160, comm: blkid Tainted: G W 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch [ 21.384005] Call Trace: [ 21.384005] [] warn_slowpath_common+0x7f/0xc0 [ 21.384005] [] warn_slowpath_fmt+0x46/0x50 [ 21.384005] [] ? touch_nmi_watchdog+0x80/0x80 [ 21.384005] [] watchdog_overflow_callback+0x9f/0xd0 [ 21.384005] [] ? perf_event_task_disable+0x90/0x90 [ 21.384005] [] __perf_event_overflow+0x9d/0x310 [ 21.384005] [] ? x86_perf_event_set_period+0xd9/0x160 [ 21.384005] [] ? x86_perf_event_update+0x55/0xb0 [ 21.384005] [] perf_event_overflow+0x14/0x20 [ 21.384005] [] intel_pmu_handle_irq+0x1be/0x370 [ 21.384005] [] perf_event_nmi_handler+0x1d/0x20 [ 21.384005] [] nmi_handle.isra.2+0xae/0x1f0 [ 21.384005] [] ? nmi_handle.isra.2+0x5/0x1f0 [ 21.384005] [] do_nmi+0x108/0x380 [ 21.384005] [] end_repeat_nmi+0x1e/0x2e [ 21.384005] [] ? delay_tsc+0x7d/0xf0 [ 21.384005] [] ? delay_tsc+0x7d/0xf0 [ 21.384005] [] ? delay_tsc+0x7d/0xf0 [ 21.384005] <> [] __delay+0xf/0x20 [ 21.384005] [] do_raw_spin_lock+0xc5/0x120 [ 21.384005] [] _raw_spin_lock+0x43/0x50 [ 21.384005] [] ? dentry_path_raw+0x2e/0x70 [ 21.384005] [] dentry_path_raw+0x2e/0x70 [ 21.384005] [] cgroup_path+0x57/0x100 [ 21.384005] [] cfq_insert_request+0xa6/0x630 [ 21.384005] [] ? cfq_insert_request+0x4d/0x630 [ 21.384005] [] ? list_sort+0x19c/0x230 [ 21.384005] [] ? submit_bio+0x79/0x160 [ 21.384005] [] ? blk_flush_plug_list+0x1a7/0x260 [ 21.384005] [] __elv_add_request+0x1b6/0x3b0 [ 21.384005] [] blk_flush_plug_list+0x1d5/0x260 [ 21.384005] [] blk_finish_plug+0x18/0x50 [ 21.384005] [] __do_page_cache_readahead+0x2cc/0x370 [ 21.384005] [] ? __do_page_cache_readahead+0x118/0x370 [ 21.384005] [] ? delayacct_end+0x89/0xa0 [ 21.384005] [] force_page_cache_readahead+0x79/0xb0 [ 21.384005] [] page_cache_sync_readahead+0x43/0x50 [ 21.384005] [] generic_file_aio_read+0x580/0x700 [ 21.384005] [] blkdev_aio_read+0x54/0x80 [ 21.384005] [] do_sync_read+0x77/0xa0 [ 21.384005] [] vfs_read+0xa9/0x180 [ 21.384005] [] sys_read+0x52/0xa0 [ 21.384005] [] system_call_fastpath+0x16/0x1b [ 21.384005] ---[ end trace 159623cd3fb284bf ]--- [ 104.427996] BUG: soft lockup - CPU#1 stuck for 23s! [dmsetup_env:1305] [ 104.428000] Modules linked in: kvm(+) lp ppdev gpio_ich snd_ctxfi(+) snd_pcm dcdbas snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device microcode btusb snd bluetooth soundcore snd_page_alloc psmouse lpc_ich serio_raw parport_pc parport i5400_edac mac_hid edac_core i5k_amb shpchp netconsole configfs dm_mirror dm_region_hash dm_log hid_logitech_dj hid_generic usbhid hid tg3 e1000e ptp pps_core nouveau ttm drm_kms_helper drm i2c_algo_bit firewire_ohci mxm_wmi firewire_core crc_itu_t video wmi usb_storage [ 104.428000] irq event stamp: 0 [ 104.428000] hardirqs last enabled at (0): [< (null)>] (null) [ 104.428000] hardirqs last disabled at (0): [] copy_process.part.23+0x61b/0x16b0 [ 104.428000] softirqs last enabled at (0): [] copy_process.part.23+0x61b/0x16b0 [ 104.428000] softirqs last disabled at (0): [< (null)>] (null) [ 104.428000] CPU 1 [ 104.428000] Pid: 1305, comm: dmsetup_env Tainted: G W 3.8.0-next-20130204+pcipatch-xeon+lockdep #20130204+pcipatch Dell Inc. Precision WorkStation T5400 /0RW203 [ 104.428000] RIP: 0010:[] [] delay_tsc+0x82/0xf0 [ 104.428000] RSP: 0018:ffff8802932bbe58 EFLAGS: 00000206 [ 104.428000] RAX: 0000005758aec3e4 RBX: 0000000000000001 RCX: 0000000000000000 [ 104.428000] RDX: 0000005758aec3e4 RSI: 0000000000000000 RDI: 0000000000000001 [ 104.428000] RBP: ffff8802932bbe88 R08: 0000000000000002 R09: 0000000000000000 [ 104.428000] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff817980b7 [ 104.428000] R13: 0000000000000001 R14: ffff8802932bbdb8 R15: ffff880292a9a100 [ 104.428000] FS: 00007fe33496d700(0000) GS:ffff8802afc40000(0000) knlGS:0000000000000000 [ 104.428000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 104.428000] CR2: 0000000001cc3768 CR3: 000000029ede1000 CR4: 00000000000007e0 [ 104.428000] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 104.428000] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 104.428000] Process dmsetup_env (pid: 1305, threadinfo ffff8802932ba000, task ffff880292a9a100) [ 104.428000] Stack: [ 104.428000] ffffffff813acd49 ffffffff81c053c8 000000004da7088d 0000000094a1ec46 [ 104.428000] 0000000000001000 0000000001cc2760 ffff8802932bbe98 ffffffff813acc7f [ 104.428000] ffff8802932bbed8 ffffffff813b51a5 ffff8802932bbec8 ffffffff81c053c8 [ 104.428000] Call Trace: [ 104.428000] [] ? delay_tsc+0x9/0xf0 [ 104.428000] [] __delay+0xf/0x20 [ 104.428000] [] do_raw_spin_lock+0xc5/0x120 [ 104.428000] [] _raw_spin_lock+0x43/0x50 [ 104.428000] [] ? sys_getcwd+0xa1/0x1f0 [ 104.428000] [] ? _raw_spin_unlock+0x35/0x60 [ 104.428000] [] sys_getcwd+0xa1/0x1f0 [ 104.428000] [] system_call_fastpath+0x16/0x1b [ 104.428000] Code: 84 24 38 e0 ff ff a8 08 75 5b f3 90 bf 01 00 00 00 e8 43 f0 3e 00 e8 8e 9f 00 00 41 39 c7 75 4c 0f 1f 00 0f ae e8 e8 9e 5c c7 ff <66> 90 48 89 c3 44 29 e8 44 39 f0 bf 01 00 00 00 72 bc e8 77 ef