[ 904.091005] BUG: soft lockup - CPU#0 stuck for 61s! [openvpn:4259] [ 904.091005] Modules linked in: sch_netem sbs sbshc snd_hda_codec_conexant pcm cia snd_hda_intel snd_hda_codec yenta_socket rsrc_nonstatic pcmcia_core iwlagn t hinkpad_acpi snd_hwdep ehci_hcd uhci_hcd [ 904.091005] irq event stamp: 0 [ 904.091005] hardirqs last enabled at (0): [<(null)>] (null) [ 904.091005] hardirqs last disabled at (0): [] copy_process+ 0x39a/0x14b0 [ 904.091005] softirqs last enabled at (0): [] copy_process+ 0x39a/0x14b0 [ 904.091005] softirqs last disabled at (0): [<(null)>] (null) [ 904.091005] CPU 0: [ 904.091005] Modules linked in: sch_netem sbs sbshc snd_hda_codec_conexant pcm cia snd_hda_intel snd_hda_codec yenta_socket rsrc_nonstatic pcmcia_core iwlagn t hinkpad_acpi snd_hwdep ehci_hcd uhci_hcd [ 904.091005] Pid: 4259, comm: openvpn Not tainted 2.6.31-rc1-andres-00199-g25c 4ad0-dirty #56 208252G [ 904.091005] RIP: 0010:[] [] native_read_ tsc+0x6/0x20 [ 904.091005] RSP: 0018:ffff88012d6398b8 EFLAGS: 00000206 [ 904.091005] RAX: 000000007c0f7fae RBX: ffff88012d6398b8 RCX: 000000007c0f7f66 [ 904.091005] RDX: 000000000000012d RSI: ffff8800378e52b8 RDI: 0000000000000001 [ 904.091005] RBP: ffffffff81036b6e R08: 0000000000000002 R09: 0000000000000000 [ 904.091005] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000004086 [ 904.091005] R13: ffff88002ee00000 R14: ffff88012d638000 R15: 0000000000000000 [ 904.091005] FS: 00007ff41addf6f0(0000) GS:ffff88002ee00000(0000) knlGS:00000 00000000000 [ 904.091005] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 904.091005] CR2: 00007f3e776b2000 CR3: 000000012d630000 CR4: 00000000000026f0 [ 904.091005] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 904.091005] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 904.091005] Call Trace: [ 904.091005] [] ? delay_tsc+0x22/0x80 [ 904.091005] [] ? __delay+0xa/0x10 [ 904.091005] [] ? _raw_spin_lock+0xfd/0x170 [ 904.091005] [] ? _spin_lock+0x51/0x70 [ 904.091005] [] ? dev_queue_xmit+0xe6/0x4b0 [ 904.091005] [] ? dev_queue_xmit+0xe6/0x4b0 [ 904.091005] [] ? dev_queue_xmit+0x53/0x4b0 [ 904.091005] [] ? ip_finish_output+0x13c/0x320 [ 904.091005] [] ? ip_output+0x7b/0xd0 [ 904.091005] [] ? ip_local_out+0x20/0x30 [ 904.091005] [] ? ip_queue_xmit+0x165/0x3b0 [ 904.091005] [] ? trace_hardirqs_on+0xd/0x10 [ 904.091005] [] ? tcp_transmit_skb+0x3e9/0x780 [ 904.091005] [] ? tcp_write_xmit+0x1e7/0x9d0 [ 904.091005] [] ? __tcp_push_pending_frames+0x2b/0xd0 [ 904.091005] [] ? tcp_sendmsg+0x89c/0xbe0 [ 904.091005] [] ? sock_sendmsg+0x126/0x140 [ 904.091005] [] ? autoremove_wake_function+0x0/0x40 [ 904.091005] [] ? autoremove_wake_function+0x0/0x40 [ 904.091005] [] ? __up_write+0x20/0x150 [ 904.091005] [] ? sys_sendto+0xf0/0x130 [ 904.091005] [] ? trace_hardirqs_on+0xd/0x10 [ 904.091005] [] ? getnstimeofday+0x57/0xe0 [ 904.091005] [] ? ktime_get_ts+0x51/0x70 [ 904.091005] [] ? system_call_fastpath+0x16/0x1b [ 961.714835] BUG: spinlock lockup on CPU#0, openvpn/4259, ffff8800378e52a0 [ 961.714839] Pid: 4259, comm: openvpn Not tainted 2.6.31-rc1-andres-00199-g25c 4ad0-dirty #56 [ 961.714842] Call Trace: [ 961.714849] [] _raw_spin_lock+0x15e/0x170 [ 961.714854] [] _spin_lock+0x51/0x70 [ 961.714858] [] ? dev_queue_xmit+0xe6/0x4b0 [ 961.714861] [] dev_queue_xmit+0xe6/0x4b0 [ 961.714865] [] ? dev_queue_xmit+0x53/0x4b0 [ 961.714869] [] ip_finish_output+0x13c/0x320 [ 961.714873] [] ip_output+0x7b/0xd0 [ 961.714877] [] ip_local_out+0x20/0x30 [ 961.714881] [] ip_queue_xmit+0x165/0x3b0 [ 961.714884] [] ? trace_hardirqs_on+0xd/0x10 [ 961.714889] [] tcp_transmit_skb+0x3e9/0x780 [ 961.714893] [] tcp_write_xmit+0x1e7/0x9d0 [ 961.714898] [] __tcp_push_pending_frames+0x2b/0xd0 [ 961.714901] [] tcp_sendmsg+0x89c/0xbe0 [ 961.714906] [] sock_sendmsg+0x126/0x140 [ 961.714910] [] ? autoremove_wake_function+0x0/0x40 [ 961.714915] [] ? autoremove_wake_function+0x0/0x40 [ 961.714920] [] ? __up_write+0x20/0x150 [ 961.714925] [] sys_sendto+0xf0/0x130 [ 961.714929] [] ? trace_hardirqs_on+0xd/0x10 [ 961.714933] [] ? getnstimeofday+0x57/0xe0 [ 961.714937] [] ? ktime_get_ts+0x51/0x70 [ 961.714941] [] system_call_fastpath+0x16/0x1b [ 961.714947] BUG: unable to handle kernel NULL pointer dereference at (null) [ 961.714954] IP: [] memcpy_c+0xb/0x20 [ 961.714959] PGD 12d631067 PUD 12d632067 PMD 0 [ 961.714968] Oops: 0002 [#1] SMP [ 961.714975] last sysfs file: /sys/devices/virtual/net/tun2/statistics/collisi ons [ 961.714979] CPU 0 [ 961.714982] Modules linked in: sch_netem sbs sbshc snd_hda_codec_conexant pcm cia snd_hda_intel snd_hda_codec yenta_socket rsrc_nonstatic pcmcia_core iwlagn t hinkpad_acpi snd_hwdep ehci_hcd uhci_hcd [ 961.715004] Pid: 4259, comm: openvpn Not tainted 2.6.31-rc1-andres-00199-g25c 4ad0-dirty #56 208252G [ 961.715004] RIP: 0010:[] [] memcpy_c+0xb /0x20 [ 961.715004] RSP: 0018:ffff88012d6398e0 EFLAGS: 00010246 [ 961.715004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001 [ 961.715004] RDX: 0000000000000000 RSI: ffffffff81c184c0 RDI: 0000000000000000 [ 961.715004] RBP: ffff88012d6398f8 R08: 0000000000000002 R09: 0000000000000000 [ 961.715004] R10: 0000000000000000 R11: 0000000000000001 R12: 000000008eafa238 [ 961.715004] R13: 000000008eafa238 R14: 0000000000000000 R15: ffff8801258c0a98 [ 961.715004] FS: 00007ff41addf6f0(0000) GS:ffff88002ee00000(0000) knlGS:00000 00000000000 [ 961.715004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 961.715004] CR2: 0000000000000000 CR3: 000000012d630000 CR4: 00000000000026f0 [ 961.715004] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 961.715004] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 961.715004] Process openvpn (pid: 4259, threadinfo ffff88012d638000, task fff f88013017a4e0) [ 961.715004] Stack: [ 961.715004] ffffffff8104fc31 ffff8800378e52a0 ffff8800378e52a0 ffff88012d639 928 [ 961.715004] <0> ffffffff812ad203 ffff8800378e52a0 ffff8800378e52b8 ffff88013b 933c00 [ 961.715004] <0> ffff8800378e5200 ffff88012d639958 ffffffff816ed761 ffffffff81 565596 [ 961.715004] Call Trace: [ 961.715004] [] ? __trigger_all_cpu_backtrace+0x31/0x70 [ 961.715004] [] _raw_spin_lock+0x163/0x170 [ 961.715004] [] _spin_lock+0x51/0x70 [ 961.715004] [] ? dev_queue_xmit+0xe6/0x4b0 [ 961.715004] [] dev_queue_xmit+0xe6/0x4b0 [ 961.715004] [] ? dev_queue_xmit+0x53/0x4b0 [ 961.715004] [] ip_finish_output+0x13c/0x320 [ 961.715004] [] ip_output+0x7b/0xd0 [ 961.715004] [] ip_local_out+0x20/0x30 [ 961.715004] [] ip_queue_xmit+0x165/0x3b0 [ 961.715004] [] ? trace_hardirqs_on+0xd/0x10 [ 961.715004] [] tcp_transmit_skb+0x3e9/0x780 [ 961.715004] [] tcp_write_xmit+0x1e7/0x9d0 [ 961.715004] [] __tcp_push_pending_frames+0x2b/0xd0 [ 961.715004] [] tcp_sendmsg+0x89c/0xbe0 [ 961.715004] [] sock_sendmsg+0x126/0x140 [ 961.715004] [] ? autoremove_wake_function+0x0/0x40 [ 961.715004] [] ? autoremove_wake_function+0x0/0x40 [ 961.715004] [] ? __up_write+0x20/0x150 [ 961.715004] [] sys_sendto+0xf0/0x130 [ 961.715004] [] ? trace_hardirqs_on+0xd/0x10 [ 961.715004] [] ? getnstimeofday+0x57/0xe0 [ 961.715004] [] ? ktime_get_ts+0x51/0x70 [ 961.715004] [] system_call_fastpath+0x16/0x1b [ 961.715004] Code: 81 ea d8 1f 00 00 48 3b 42 20 73 07 48 8b 50 f9 31 c0 c3 31 d2 48 c7 c0 f2 ff ff ff c3 90 90 90