[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-Id: <20080616201836.M85480@visp.net.lb>
Date: Mon, 16 Jun 2008 23:20:27 +0300
From: "Denys Fedoryshchenko" <denys@...p.net.lb>
To: Eric Dumazet <dada1@...mosbay.com>
Cc: netdev@...r.kernel.org
Subject: Re: packetloss, on e1000e worse than r8169?
On Mon, 16 Jun 2008 21:48:55 +0200, Eric Dumazet wrote
> Denys Fedoryshchenko a e'crit :
> > Hi again
> >
> > I moved from PCI Realtek 8169 to onboard PCI-Express e1000e, and situation
> > become worse. Strange? Yes.
> >
> > Here is info
> > Load and error rate:
> >
> > MegaRouter-KARAM /sys # ifconfig eth1;sleep 10;ifconfig eth1
> > eth1 Link encap:Ethernet HWaddr 00:19:D1:71:5F:33
> > inet addr:192.168.20.10 Bcast:0.0.0.0 Mask:255.255.255.0
> > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> > RX packets:91991642 errors:0 dropped:1803444 overruns:0 frame:0
> > TX packets:91914611 errors:0 dropped:0 overruns:0 carrier:0
> > collisions:0 txqueuelen:1000
> > RX bytes:316112765 (301.4 MiB) TX bytes:138303107 (131.8 MiB)
> > Memory:90300000-90320000
> >
> > eth1 Link encap:Ethernet HWaddr 00:19:D1:71:5F:33
> > inet addr:192.168.20.10 Bcast:0.0.0.0 Mask:255.255.255.0
> > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> > RX packets:92812514 errors:0 dropped:1815490 overruns:0 frame:0
> > TX packets:92734865 errors:0 dropped:0 overruns:0 carrier:0
> > collisions:0 txqueuelen:1000
> > RX bytes:739941322 (705.6 MiB) TX bytes:560547138 (534.5 MiB)
> > Memory:90300000-90320000
> >
> > System load (there is no NAT, no shapers, just routing, around 600-700
routes):
> > MegaRouter-KARAM /sys # mpstat 1
> > Linux 2.6.26-rc6-git2-build-0029 (MegaRouter-KARAM) 06/16/08
> >
> > 22:36:36 CPU %user %nice %sys %iowait %irq %soft %steal
> > %idle intr/s
> > 22:36:37 all 0.00 0.00 0.00 0.00 0.00 1.49 0.00
> > 98.51 19764.00
> > 22:36:38 all 0.00 0.00 0.50 0.00 0.00 0.50 0.00
> > 99.01 19888.00
> > 22:36:39 all 0.00 0.00 0.00 0.00 0.00 0.50 0.00
> > 99.50 19642.00
> > 22:36:40 all 0.00 0.00 0.00 0.00 1.01 9.05 0.00
> > 89.95 19543.00
> >
> > (system almost idle)
> >
> > MegaRouter-KARAM /sys # ethtool -S eth1
> > NIC statistics:
> > rx_packets: 109977509
> > tx_packets: 109887692
> > rx_bytes: 57656749138
> > tx_bytes: 57536071746
> > rx_broadcast: 6497
> > tx_broadcast: 92
> > rx_multicast: 48995
> > tx_multicast: 1960
> > rx_errors: 0
> > tx_errors: 0
> > tx_dropped: 0
> > multicast: 48995
> > collisions: 0
> > rx_length_errors: 0
> > rx_over_errors: 0
> > rx_crc_errors: 0
> > rx_frame_errors: 0
> > rx_no_buffer_count: 1796
> > rx_missed_errors: 2182679
> > tx_aborted_errors: 0
> > tx_carrier_errors: 0
> > tx_fifo_errors: 0
> > tx_heartbeat_errors: 0
> > tx_window_errors: 0
> > tx_abort_late_coll: 0
> > tx_deferred_ok: 55617
> > tx_single_coll_ok: 0
> > tx_multi_coll_ok: 0
> > tx_timeout_count: 0
> > tx_restart_queue: 1626
> > rx_long_length_errors: 0
> > rx_short_length_errors: 0
> > rx_align_errors: 0
> > tx_tcp_seg_good: 0
> > tx_tcp_seg_failed: 0
> > rx_flow_control_xon: 55461
> > rx_flow_control_xoff: 57329
> > tx_flow_control_xon: 39114
> > tx_flow_control_xoff: 48341
> > rx_long_byte_count: 57656749138
> > rx_csum_offload_good: 104097306
> > rx_csum_offload_errors: 2209
> > rx_header_split: 0
> > alloc_rx_buff_failed: 0
> > tx_smbus: 22
> > rx_smbus: 2201
> > dropped_smbus: 0
> > rx_dma_failed: 0
> > tx_dma_failed: 0
> > MegaRouter-KARAM /sys # ethtool -S eth1
> > NIC statistics:
> > rx_packets: 110154571
> > tx_packets: 110064459
> > rx_bytes: 57753358981
> > tx_bytes: 57632419451
> > rx_broadcast: 6501
> > tx_broadcast: 92
> > rx_multicast: 49155
> > tx_multicast: 1960
> > rx_errors: 0
> > tx_errors: 0
> > tx_dropped: 0
> > multicast: 49155
> > collisions: 0
> > rx_length_errors: 0
> > rx_over_errors: 0
> > rx_crc_errors: 0
> > rx_frame_errors: 0
> > rx_no_buffer_count: 1796
> > rx_missed_errors: 2187703
> > tx_aborted_errors: 0
> > tx_carrier_errors: 0
> > tx_fifo_errors: 0
> > tx_heartbeat_errors: 0
> > tx_window_errors: 0
> > tx_abort_late_coll: 0
> > tx_deferred_ok: 55772
> > tx_single_coll_ok: 0
> > tx_multi_coll_ok: 0
> > tx_timeout_count: 0
> > tx_restart_queue: 1628
> > rx_long_length_errors: 0
> > rx_short_length_errors: 0
> > rx_align_errors: 0
> > tx_tcp_seg_good: 0
> > tx_tcp_seg_failed: 0
> > rx_flow_control_xon: 55615
> > rx_flow_control_xoff: 57488
> > tx_flow_control_xon: 39209
> > tx_flow_control_xoff: 48448
> > rx_long_byte_count: 57753358981
> > rx_csum_offload_good: 104264656
> > rx_csum_offload_errors: 2210
> > rx_header_split: 0
> > alloc_rx_buff_failed: 0
> > tx_smbus: 23
> > rx_smbus: 2207
> > dropped_smbus: 0
> > rx_dma_failed: 0
> > tx_dma_failed: 0
> >
> >
> >
>
> What RX & TX rings look like on e1000e ?
>
> ethtool -g eth1
>
> Also, please post "cat /proc/interrupts"
>
MegaRouter-KARAM ~ # ethtool -g eth1
Ring parameters for eth1:
Pre-set maximums:
RX: 4096
RX Mini: 0
RX Jumbo: 0
TX: 4096
Current hardware settings:
RX: 256
RX Mini: 0
RX Jumbo: 0
TX: 256
After i tried to set ethtool -G eth1 4096 system becomes extremely slow, what
is very strange for me. I had to soft-reboot it (over kexec).
MegaRouter-KARAM ~ # cat /proc/interrupts;sleep 10;cat /proc/interrupts
CPU0 CPU1
0: 86148 0 IO-APIC-edge timer
1: 2 0 IO-APIC-edge i8042
9: 0 0 IO-APIC-fasteoi acpi
12: 5 0 IO-APIC-edge i8042
16: 0 0 IO-APIC-fasteoi uhci_hcd:usb3
18: 0 0 IO-APIC-fasteoi ehci_hcd:usb1, uhci_hcd:usb7
19: 0 0 IO-APIC-fasteoi uhci_hcd:usb6
21: 0 0 IO-APIC-fasteoi uhci_hcd:usb4
23: 968 0 IO-APIC-fasteoi ehci_hcd:usb2, uhci_hcd:usb5
217: 3 1460438 PCI-MSI-edge eth1
NMI: 86087 85892 Non-maskable interrupts
LOC: 0 85892 Local timer interrupts
RES: 44 81 Rescheduling interrupts
CAL: 88 56 function call interrupts
TLB: 91 78 TLB shootdowns
TRM: 0 0 Thermal event interrupts
SPU: 0 0 Spurious interrupts
ERR: 0
MIS: 0
CPU0 CPU1
0: 96150 0 IO-APIC-edge timer
1: 2 0 IO-APIC-edge i8042
9: 0 0 IO-APIC-fasteoi acpi
12: 5 0 IO-APIC-edge i8042
16: 0 0 IO-APIC-fasteoi uhci_hcd:usb3
18: 0 0 IO-APIC-fasteoi ehci_hcd:usb1, uhci_hcd:usb7
19: 0 0 IO-APIC-fasteoi uhci_hcd:usb6
21: 0 0 IO-APIC-fasteoi uhci_hcd:usb4
23: 968 0 IO-APIC-fasteoi ehci_hcd:usb2, uhci_hcd:usb5
217: 3 1646537 PCI-MSI-edge eth1
NMI: 96088 95893 Non-maskable interrupts
LOC: 0 95893 Local timer interrupts
RES: 44 81 Rescheduling interrupts
CAL: 89 56 function call interrupts
TLB: 91 78 TLB shootdowns
TRM: 0 0 Thermal event interrupts
SPU: 0 0 Spurious interrupts
ERR: 0
MIS: 0
About NMI interrupts - nmi_watchdog=1, if i disable it, it doesn't change
anything.
--
Denys Fedoryshchenko
Technical Manager
Virtual ISP S.A.L.
--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Powered by blists - more mailing lists