| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <20111126161513.GA5299@ntm.wq.cz>
Date: Sat, 26 Nov 2011 17:15:20 +0100
From: Milan Kocian <milon@...cz>
To: Stephen Hemminger <shemminger@...tta.com>
Cc: netdev@...r.kernel.org
Subject: Re: sky2 tx watchdog timeout with 1Gb speed
On Tue, Nov 22, 2011 at 10:42:34AM +0100, Milan Kocian wrote:
> hi stephen,
>
> many thanks for reply.
>
> On Mon, Nov 21, 2011 at 04:05:43PM -0800, Stephen Hemminger wrote:
> > On Mon, 21 Nov 2011 00:21:18 +0100
> > Milan Kocian <milon@...cz> wrote:
> >
> > > hi all,
> > >
> > > I switched my home pc from 100Mb/s to 1000Mb/s and I see
> > > this warning below.
> > >
> > > The original kernel was 2.6.39.4 then I tested 3.1.1 with the same
> > > result. (self compiled 32bit vanilla). The workaround is to force 10/100 speed
> > > on my new switch (hp).
> > >
> > > lspci:
> > >
> > > 03:00.0 Ethernet controller: Marvell Technology Group Ltd. 88E8056 PCI-E Gigabit Ethernet Controller (rev 13)
> > > Subsystem: Giga-byte Technology Device e000
> > > Flags: bus master, fast devsel, latency 0, IRQ 45
> > > Memory at f5000000 (64-bit, non-prefetchable) [size=16K]
> > > I/O ports at 9000 [size=256]
> > > [virtual] Expansion ROM at 80300000 [disabled] [size=128K]
> > > Capabilities: [48] Power Management version 3
> > > Capabilities: [50] Vital Product Data
> > > Capabilities: [5c] MSI: Enable+ Count=1/1 Maskable- 64bit+
> > > Capabilities: [e0] Express Legacy Endpoint, MSI 00
> > > Capabilities: [100] Advanced Error Reporting
> > > Kernel driver in use: sky2
> > >
> > >
> > > Nov 20 21:32:54 milu kernel: sky2 0000:03:00.0: eth0: Link is up at 1000 Mbps, full duplex, flow control both
> > > Nov 20 21:35:29 milu kernel: ------------[ cut here ]------------
> > > Nov 20 21:35:29 milu kernel: WARNING: at net/sched/sch_generic.c:255 dev_watchdog+0x1fa/0x206()
> > > Nov 20 21:35:29 milu kernel: Hardware name: 965GM-S2
> > > Nov 20 21:35:29 milu kernel: NETDEV WATCHDOG: eth0 (sky2): transmit queue 0 timed out
> > > Nov 20 21:35:29 milu kernel: Modules linked in: parport_pc parport fuse nfsd ipv6 nfs lockd auth_rpcgss nfs_acl sunrpc usbhid snd_hda_codec_realtek snd_hda_intel snd_hda_codec snd_hwdep snd_intel8x0 sg snd_ac97_codec sr_mod ac97_bus cdrom sky2 snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_dummy snd_seq_oss intel_agp snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_timer snd_seq_device snd bitrev i2c_i801 crc32 intel_gtt uhci_hcd i2c_core ehci_hcd soundcore usbcore agpgart evdev snd_page_alloc
> > > Nov 20 21:35:29 milu kernel: Pid: 0, comm: swapper Not tainted 3.1.1 #2
> > > Nov 20 21:35:29 milu kernel: Call Trace:
> > > Nov 20 21:35:29 milu kernel: [<c102cd5d>] ? warn_slowpath_common+0x6c/0x94
> > > Nov 20 21:35:29 milu kernel: [<c1254deb>] ? dev_watchdog+0x1fa/0x206
> > > Nov 20 21:35:29 milu kernel: [<c1254deb>] ? dev_watchdog+0x1fa/0x206
> > > Nov 20 21:35:29 milu kernel: [<c102ce0e>] ? warn_slowpath_fmt+0x33/0x37
> > > Nov 20 21:35:29 milu kernel: [<c1254deb>] ? dev_watchdog+0x1fa/0x206
> > > Nov 20 21:35:29 milu kernel: [<c1254bf1>] ? qdisc_reset+0x2d/0x2d
> > > Nov 20 21:35:29 milu kernel: [<c1036434>] ? run_timer_softirq+0xc6/0x1c4
> > > Nov 20 21:35:29 milu kernel: [<c1027e9b>] ? run_rebalance_domains+0x148/0x169
> > > Nov 20 21:35:29 milu kernel: [<c103163b>] ? __do_softirq+0x6e/0xea
> > > Nov 20 21:35:29 milu kernel: [<c10315cd>] ? remote_softirq_receive+0x11/0x11
> > > Nov 20 21:35:29 milu kernel: <IRQ> [<c1031906>] ? irq_exit+0x5b/0x67
> > > Nov 20 21:35:29 milu kernel: [<c101631f>] ? smp_apic_timer_interrupt+0x51/0x81
> > > Nov 20 21:35:29 milu kernel: [<c12ccd96>] ? apic_timer_interrupt+0x2a/0x30
> > > Nov 20 21:35:29 milu kernel: [<c13f007b>] ? asus_hides_smbus_hostbridge+0xcb/0x249
> > > Nov 20 21:35:29 milu kernel: [<c1008732>] ? mwait_idle+0x41/0x51
> > > Nov 20 21:35:29 milu kernel: [<c10015d8>] ? cpu_idle+0x74/0x84
> > > Nov 20 21:35:29 milu kernel: [<c13d6638>] ? start_kernel+0x28a/0x28f
> > > Nov 20 21:35:29 milu kernel: [<c13d615e>] ? loglevel+0x2b/0x2b
> > > Nov 20 21:35:29 milu kernel: ---[ end trace ef84175f674c7842 ]---
> > > Nov 20 21:35:29 milu kernel: sky2 0000:03:00.0: eth0: tx timeout
> > > Nov 20 21:35:29 milu kernel: sky2 0000:03:00.0: eth0: transmit ring 52 .. 30 report=52 done=52
> > > Nov 20 21:35:32 milu kernel: sky2 0000:03:00.0: eth0: Link is up at 1000 Mbps, full duplex, flow control both
> > > Nov 20 21:37:13 milu kernel: sky2 0000:03:00.0: eth0: tx timeout
> > > Nov 20 21:37:13 milu kernel: sky2 0000:03:00.0: eth0: transmit ring 37 .. 15 report=37 done=37
> > > Nov 20 21:37:16 milu kernel: sky2 0000:03:00.0: eth0: Link is up at 1000 Mbps, full duplex, flow control both
> > >
> > > Any suggestion ? As I said its home machine so I can test what you want :-).
> >
> > I haven't seen this, is it under heavy or light traffic.
>
> Imho heavy traffic is not needed (will do more tests). After boot all seems ok,
> ping is working. But when I start something to do, net is freezing. It's not possible
> to copy something over net.
>
> > Are you running something that might cause device to miss interrupts?
> >
>
> Imho no. In pc is nvidia card but the warning happens without nvidia driver
> loaded (i tested sending data over net without X, no nvidia driver loaded
> with the same result). For sure I'm sending /proc/interrupts and list of all devices.
>
> I noticed one thing, when 1Gb is set I see this in kerne.log too:
>
> Nov 20 21:49:31 milu kernel: ata1.00: exception Emask 0x10 SAct 0x0 SErr 0x400100 action 0x6 frozen
> Nov 20 21:49:31 milu kernel: ata1.00: irq_stat 0x08000000, interface fatal error
> Nov 20 21:49:31 milu kernel: ata1: SError: { UnrecovData Handshk }
> Nov 20 21:49:31 milu kernel: ata1.00: failed command: WRITE DMA EXT
> Nov 20 21:49:31 milu kernel: ata1.00: cmd 35/00:00:4f:d3:04/00:03:00:00:00/e0 tag 0 dma 393216 out
> Nov 20 21:49:31 milu kernel: res 50/00:00:f6:0c:e6/00:00:06:00:00/e6 Emask 0x10 (ATA bus error)
> Nov 20 21:49:31 milu kernel: ata1.00: status: { DRDY }
> Nov 20 21:49:31 milu kernel: ata1: hard resetting link
> Nov 20 21:49:31 milu kernel: ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
> Nov 20 21:49:31 milu kernel: ata1.00: configured for UDMA/133
> Nov 20 21:49:31 milu kernel: ata1: EH complete
> Nov 20 21:50:12 milu kernel: ata1.00: exception Emask 0x10 SAct 0x0 SErr 0x400100 action 0x6 frozen
> Nov 20 21:50:12 milu kernel: ata1.00: irq_stat 0x08000000, interface fatal error
> Nov 20 21:50:12 milu kernel: ata1: SError: { UnrecovData Handshk }
> Nov 20 21:50:12 milu kernel: ata1.00: failed command: WRITE DMA EXT
> Nov 20 21:50:12 milu kernel: ata1.00: cmd 35/00:e0:17:a2:15/00:03:08:00:00/e0 tag 0 dma 507904 out
> Nov 20 21:50:12 milu kernel: res 50/00:00:16:a2:15/00:00:08:00:00/e0 Emask 0x10 (ATA bus error)
> Nov 20 21:50:12 milu kernel: ata1.00: status: { DRDY }
> Nov 20 21:50:12 milu kernel: ata1: hard resetting link
> Nov 20 21:50:12 milu kernel: ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
> Nov 20 21:50:12 milu kernel: ata1.00: configured for UDMA/133
> Nov 20 21:50:12 milu kernel: ata1: EH complete
> Nov 20 21:50:12 milu kernel: ata1.00: exception Emask 0x10 SAct 0x0 SErr 0x400100 action 0x6 frozen
> Nov 20 21:50:12 milu kernel: ata1.00: irq_stat 0x08000000, interface fatal error
> Nov 20 21:50:12 milu kernel: ata1: SError: { UnrecovData Handshk }
> Nov 20 21:50:12 milu kernel: ata1.00: failed command: WRITE DMA EXT
> Nov 20 21:50:12 milu kernel: ata1.00: cmd 35/00:e0:c7:95:a9/00:03:08:00:00/e0 tag 0 dma 507904 out
> Nov 20 21:50:12 milu kernel: res 50/00:00:c6:95:a9/00:00:08:00:00/e0 Emask 0x10 (ATA bus error)
>
>
> milu:~# cat /proc/interrupts
> CPU0 CPU1
> 0: 555 0 IO-APIC-edge timer
> 1: 58816 0 IO-APIC-edge i8042
> 8: 1 0 IO-APIC-edge rtc0
> 9: 0 0 IO-APIC-fasteoi acpi
> 16: 2757269 0 IO-APIC-fasteoi uhci_hcd:usb3, nvidia
> 18: 206547 0 IO-APIC-fasteoi ahci, ehci_hcd:usb1, uhci_hcd:usb7
> 19: 770339 0 IO-APIC-fasteoi pata_jmicron, uhci_hcd:usb6
> 21: 0 0 IO-APIC-fasteoi uhci_hcd:usb4
> 23: 2 0 IO-APIC-fasteoi ehci_hcd:usb2, uhci_hcd:usb5
> 44: 1606 50210 PCI-MSI-edge ahci
> 45: 1092296 0 PCI-MSI-edge sky2@pci:0000:03:00.0
> 46: 377 0 PCI-MSI-edge snd_hda_intel
> NMI: 0 0 Non-maskable interrupts
> LOC: 133229573 133104650 Local timer interrupts
> SPU: 0 0 Spurious interrupts
> PMI: 0 0 Performance monitoring interrupts
> IWI: 0 0 IRQ work interrupts
> RES: 1719676 2541118 Rescheduling interrupts
> CAL: 72289 222200 Function call interrupts
> TLB: 69670 53360 TLB shootdowns
> TRM: 0 0 Thermal event interrupts
> THR: 0 0 Threshold APIC interrupts
> MCE: 0 0 Machine check exceptions
> MCP: 438 438 Machine check polls
> ERR: 0
> MIS: 0
>
> milu:~# lspci
> 00:00.0 Host bridge: Intel Corporation 82P965/G965 Memory Controller Hub (rev 02)
> 00:01.0 PCI bridge: Intel Corporation 82P965/G965 PCI Express Root Port (rev 02)
> 00:1a.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #4 (rev 02)
> 00:1a.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #5 (rev 02)
> 00:1a.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #2 (rev 02)
> 00:1b.0 Audio device: Intel Corporation 82801H (ICH8 Family) HD Audio Controller (rev 02)
> 00:1c.0 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 1 (rev 02)
> 00:1c.1 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 2 (rev 02)
> 00:1c.2 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 3 (rev 02)
> 00:1d.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #1 (rev 02)
> 00:1d.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #2 (rev 02)
> 00:1d.2 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #3 (rev 02)
> 00:1d.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #1 (rev 02)
> 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev f2)
> 00:1f.0 ISA bridge: Intel Corporation 82801HB/HR (ICH8/R) LPC Interface Controller (rev 02)
> 00:1f.2 SATA controller: Intel Corporation 82801HB (ICH8) 4 port SATA AHCI Controller (rev 02)
> 00:1f.3 SMBus: Intel Corporation 82801H (ICH8 Family) SMBus Controller (rev 02)
> 01:00.0 VGA compatible controller: nVidia Corporation G94 [GeForce 9600 GT] (rev a1)
> 03:00.0 Ethernet controller: Marvell Technology Group Ltd. 88E8056 PCI-E Gigabit Ethernet Controller (rev 13)
> 04:00.0 SATA controller: JMicron Technology Corp. JMB362/JMB363 Serial ATA Controller (rev 02)
> 04:00.1 IDE interface: JMicron Technology Corp. JMB362/JMB363 Serial ATA Controller (rev 02)
> 05:07.0 FireWire (IEEE 1394): Texas Instruments TSB43AB23 IEEE-1394a-2000 Controller (PHY/Link)
>
> Best regards,
>
I have more info:
After boot, when there is no traffic, net seems working
(pure icmp is working eg. ping -s 1500 -i 0.01)
But sending something over ssh freeze network after few seconds.
I saw this errors (with warnings in previous mail):
milu:/var/log# grep sky2 kern.log | grep error
Nov 24 23:20:08 milu kernel: sky2 0000:03:00.0: error interrupt status=0x1
Nov 24 23:20:08 milu kernel: sky2 0000:03:00.0: eth0: descriptor error q=0x280 get=16 put=16
Nov 24 23:54:40 milu kernel: sky2 0000:03:00.0: error interrupt status=0x80000000
Nov 24 23:54:40 milu kernel: sky2 0000:03:00.0: eth0: hw error interrupt status 0x1
Nov 24 23:54:40 milu kernel: sky2 0000:03:00.0: eth0: TCP segmentation error
Nov 25 00:02:02 milu kernel: sky2 0000:03:00.0: error interrupt status=0x1
Nov 25 00:02:02 milu kernel: sky2 0000:03:00.0: eth0: descriptor error q=0x280 get=44 put=44
Nov 25 00:13:20 milu kernel: sky2 0000:03:00.0: error interrupt status=0x1
Nov 25 00:13:20 milu kernel: sky2 0000:03:00.0: eth0: descriptor error q=0x280 get=92 put=92
Nov 25 00:25:29 milu kernel: sky2 0000:03:00.0: error interrupt status=0x1
Nov 25 00:25:29 milu kernel: sky2 0000:03:00.0: eth0: descriptor error q=0x280 get=88 put=88
I tested MSI disabled, 'ethtool -K' all params off, 'ethtool -C' adaptive-rx/tx
off, new BIOS with the same result.
After this tests I added one NIC to PCI slot yet (NIC is surely working)
and it was not detected. So it seems that there is hw problem on the mainboard.
Best regards,
--
Milan Kocian
--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Powered by blists - more mailing lists