Message-ID: <524E8BFB.9080708@icts.kuleuven.be>
Date:	Fri, 04 Oct 2013 11:35:55 +0200
From:	Wim Vandersmissen <Wim.Vandersmissen@...s.kuleuven.be>
To:	netdev@...r.kernel.org
CC:	kaber@...sh.net
Subject: kernel BUG at net/core/skbuff.c:1048!

Hi,

Got the following BUG when using ipv6 netfilter/conntrack/ipv6 
forwarding and traffic flowing.

No issues in 3.4.x, but triggered in 3.10.x (introduced in 3.7)


git bisect tells me:

58a317f1061c894d2344c0b6a18ab4a64b69b815 is the first bad commit
commit 58a317f1061c894d2344c0b6a18ab4a64b69b815
Author: Patrick McHardy <kaber@...sh.net>
Date:   Sun Aug 26 19:14:12 2012 +0200
netfilter: ipv6: add IPv6 NAT support




kernel: kernel BUG at net/core/skbuff.c:1048!
kernel: invalid opcode: 0000 [#1] SMP
kernel: icrocode]
kernel: CPU 2
kernel: Pid: 0, comm: swapper/2 Not tainted 3.6.0-rc2+ #1 HP ProLiant 
DL380 G6
kernel: RIP: 0010:[<ffffffff8126d8b8>]  [<ffffffff8126d8b8>] 
pskb_expand_head+0x30/0x210
kernel: RSP: 0018:ffff88019fc239f0  EFLAGS: 00010202
kernel: RAX: 0000000000000001 RBX: ffff88018ae50880 RCX: 0000000000000020
kernel: RDX: 0000000000000000 RSI: 00000000000002c0 RDI: ffff88018ae50880
kernel: RBP: 0000000000000020 R08: 0000000000000000 R09: 0000000000000000
kernel: R10: ffff88018af4a2c0 R11: ffffffffa0271ff8 R12: 0000000000000000
kernel: R13: ffff880196ca26c0 R14: ffff88018ac55456 R15: ffffffff814b0f40
kernel: FS:  0000000000000000(0000) GS:ffff88019fc20000(0000) 
knlGS:0000000000000000
kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
kernel: CR2: ffffffffff600000 CR3: 000000018b2ab000 CR4: 00000000000007e0
kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
kernel: Process swapper/2 (pid: 0, threadinfo ffff8801990ca000, task 
ffff88019909e090)
kernel: Stack:
kernel: 0000000800000040 ffff88018ae50880 ffff88018ae50880 0000000000000000
kernel: ffff880196ca26c0 ffff88018ac55456 ffffffff814b0f40 ffffffffa02725ab
kernel: 0000000800000000 0006000000000000 402c022a00000000 ffff88018ae508a8
kernel: Call Trace:
kernel: <IRQ>
kernel: [<ffffffffa02725ab>] ? ip6_forward+0x5b3/0x72a [ipv6]
kernel: [<ffffffffa0273bf1>] ? ip6_input+0x51/0x51 [ipv6]
kernel: [<ffffffffa02f7407>] ? __ipv6_conntrack_in+0xed/0x153 
[nf_conntrack_ipv6]
kernel: [<ffffffff81298f00>] ? nf_iterate+0x50/0x8b
kernel: [<ffffffff810372eb>] ? mod_timer+0x15e/0x16c
kernel: [<ffffffffa0273b0a>] ? ip6_xmit+0x2d2/0x368 [ipv6]
kernel: [<ffffffffa0273bf1>] ? ip6_input+0x51/0x51 [ipv6]
kernel: [<ffffffff81299135>] ? nf_hook_slow+0x67/0xfb
kernel: [<ffffffffa0273bf1>] ? ip6_input+0x51/0x51 [ipv6]
kernel: [<ffffffffa0273bf1>] ? ip6_input+0x51/0x51 [ipv6]
kernel: [<ffffffffa02f22c0>] ? nf_ct_frag6_output+0x97/0xe1 [nf_defrag_ipv6]
kernel: [<ffffffffa0273bf1>] ? ip6_input+0x51/0x51 [ipv6]
kernel: [<ffffffffa02f207b>] ? ipv6_defrag+0x7a/0x8f [nf_defrag_ipv6]
kernel: [<ffffffff81298f00>] ? nf_iterate+0x50/0x8b
kernel: [<ffffffffa0273bf1>] ? ip6_input+0x51/0x51 [ipv6]
kernel: [<ffffffff81299135>] ? nf_hook_slow+0x67/0xfb
kernel: [<ffffffffa0273bf1>] ? ip6_input+0x51/0x51 [ipv6]
kernel: [<ffffffffa0273f3f>] ? ipv6_rcv+0x2ea/0x33b [ipv6]
kernel: [<ffffffff8127485b>] ? __netif_receive_skb+0x623/0x692
kernel: [<ffffffff81275e66>] ? netif_receive_skb+0x71/0x77
kernel: [<ffffffff8127a2ec>] ? napi_gro_receive+0xe9/0xfb
kernel: [<ffffffff81275ee5>] ? napi_skb_finish+0x1c/0x51
kernel: [<ffffffffa015da8a>] ? ixgbe_poll+0xcd6/0xf04 [ixgbe]
kernel: [<ffffffff81279093>] ? net_rx_action+0xa7/0x189
kernel: [<ffffffff81031dfd>] ? __do_softirq+0xce/0x1a7
kernel: [<ffffffff8106b1f2>] ? handle_irq_event_percpu+0x16b/0x182
kernel: [<ffffffff813121ac>] ? call_softirq+0x1c/0x30
kernel: [<ffffffff81003885>] ? do_softirq+0x31/0x64
kernel: [<ffffffff81032156>] ? irq_exit+0x43/0x61
kernel: [<ffffffff81002ee9>] ? do_IRQ+0x98/0xae
kernel: [<ffffffff8130b167>] ? common_interrupt+0x67/0x67
kernel: <EOI>
kernel: [<ffffffff81053b71>] ? switched_from_fair+0x4c/0x4c
kernel: [<ffffffff81008b6c>] ? mwait_idle+0xf6/0x17a
kernel: [<ffffffff81008a51>] ? cpu_idle+0x53/0x78
kernel: Code: 55 41 54 55 89 cd 53 48 89 fb 48 83 ec 08 89 34 24 8b b7 
d0 00 00 00 83 3c 24 00 79 04 0f 0b eb fe 8b 87 ec 00 00 00 ff c8 74 04 
<0f> 0b eb fe 89 c8 48 8b 4c 24 38 80 cc 20 f6 87 b0 00 00 00 04
kernel: RIP [<ffffffff8126d8b8>] pskb_expand_head+0x30/0x210
kernel: RSP <ffff88019fc239f0>


git bisect start
# good: [b2824f4e0990716407b0c0e7acee75bb6353febf] Linux 3.6.11
git bisect good b2824f4e0990716407b0c0e7acee75bb6353febf
# bad: [ddffeb8c4d0331609ef2581d84de4d763607bd37] Linux 3.7-rc1
git bisect bad ddffeb8c4d0331609ef2581d84de4d763607bd37
# good: [a0d271cbfed1dd50278c6b06bead3d00ba0a88f9] Linux 3.6
git bisect good a0d271cbfed1dd50278c6b06bead3d00ba0a88f9
# bad: [24d7b40a60cf19008334bcbcbd98da374d4d9c64] ARM: OMAP2+: PM: MPU 
DVFS: use generic CPU device for MPU-SS
git bisect bad 24d7b40a60cf19008334bcbcbd98da374d4d9c64
# good: [d9a807461fc8cc0d6ba589ea0730d139122af012] Merge tag 'usb-3.6' 
of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb
git bisect good d9a807461fc8cc0d6ba589ea0730d139122af012
# good: [a20acf99f75e49271381d65db097c9763060a1e8] Merge 
git://git.kernel.org/pub/scm/linux/kernel/git/davem/sparc-next
git bisect good a20acf99f75e49271381d65db097c9763060a1e8
# bad: [30099b2e9b3a1f88250d31472edf2b6d6f0a7d8b] tcp: TCP Fast Open 
Server - record retransmits after 3WHS
git bisect bad 30099b2e9b3a1f88250d31472edf2b6d6f0a7d8b
# good: [6cc2ff82492d89f763e69ea6b8681926aceda610] netdev/phy: add MDIO 
bus multiplexer driven by a memory-mapped device
git bisect good 6cc2ff82492d89f763e69ea6b8681926aceda610
# bad: [e97563989a609296c3cbf5b6d8c8dc0a3e47b00b] Merge branch 'master' 
of git://git.kernel.org/pub/scm/linux/kernel/git/jkirsher/net-next
git bisect bad e97563989a609296c3cbf5b6d8c8dc0a3e47b00b
# bad: [1e9f0207d3e63fab7a0f8a0e532bdc73ea850baf] Merge branch 'master' 
of git://1984.lsi.us.es/nf-next
git bisect bad 1e9f0207d3e63fab7a0f8a0e532bdc73ea850baf
# good: [eb7e0575966f9c84434e92c8a3f69719cc2e7571] ipv6: remove some 
deadcode
git bisect good eb7e0575966f9c84434e92c8a3f69719cc2e7571
# bad: [236df005614bea6a2f9afa9867e3bdfc206c6291] netfilter: xt_CT: 
refactorize xt_ct_tg_check
git bisect bad 236df005614bea6a2f9afa9867e3bdfc206c6291
# bad: [58a317f1061c894d2344c0b6a18ab4a64b69b815] netfilter: ipv6: add 
IPv6 NAT support
git bisect bad 58a317f1061c894d2344c0b6a18ab4a64b69b815
# good: [811927ccfe90fbfcfff5253ba7f95057f6cae692] netfilter: 
nf_conntrack: restrict NAT helper invocation to IPv4
git bisect good 811927ccfe90fbfcfff5253ba7f95057f6cae692
# good: [c7232c9979cba684c50b64c513c4a83c9aa70563] netfilter: add 
protocol independent NAT core
git bisect good c7232c9979cba684c50b64c513c4a83c9aa70563
# good: [2cf545e835aae92173ef0b1f4af385e9c40f21e8] net: core: add 
function for incremental IPv6 pseudo header checksum updates
git bisect good 2cf545e835aae92173ef0b1f4af385e9c40f21e8

Thanks,


Wim



View attachment "dmesg.txt" of type "text/plain" (63176 bytes)

View attachment "config-3.6.0-rc2.txt" of type "text/plain" (88133 bytes)

Powered by blists - more mailing lists