| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Date: Fri, 04 Mar 2011 16:38:40 -0800
From: Jay Vosburgh <fubar@...ibm.com>
To: Weiping Pan <panweiping3@...il.com>
cc: netdev@...r.kernel.org, bonding-devel@...ts.sourceforge.net,
Linda Wang <lwang@...hat.com>
Subject: Re: bonding can't change to another slave if you ifdown the active slave
Weiping Pan <panweiping3@...il.com> wrote:
>I'm doing some Linux bonding driver test, and I find a problem in
>balance-rr mode.
>That's it can't change to another slave if you ifdown the active slave.
>Any comments are warmly welcomed!
I followed your recipe on a somewhat more recent kernel (2.6.37)
and using real hardware, and I don't see the problem you describe.
I do have a couple of questions, further down.
[...]
>My host is Fedora 14, and I install VirtualBox (4.0.2), and enable 4
I've not ever tried virtualbox, but it may be that its virtual
switch is misbehaving. One possibility that comes to mind is that the
virtual switch is confused by seeing the same MAC address on multiple
ports (which is a problem with a hardware virtual switch I'm familiar
with).
>nics for the guest system.
>My guest is Fedora 14 too.
>First on my host, I run:
>[pwp@...alhost linux-2.6.35-comment]$ uname -a
>Linux localhost.localdomain 2.6.35.11-83.fc14.i686 #1 SMP Mon Feb 7
>07:04:18 UTC 2011 i686 i686 i386 GNU/Linux
>
>[pwp@...alhost linux-2.6.35-comment]$ sudo ifconfig eth0:0 192.168.1.100
>netmask 255.255.255.0 up
>[pwp@...alhost linux-2.6.35-comment]$ sudo ifconfig
>eth0 Link encap:Ethernet HWaddr 64:31:50:3A:B0:B5
> inet addr:10.66.65.228 Bcast:10.66.65.255 Mask:255.255.254.0
> inet6 addr: fe80::6631:50ff:fe3a:b0b5/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:811505 errors:0 dropped:0 overruns:0 frame:0
> TX packets:777018 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:709681583 (676.8 MiB) TX bytes:71520005 (68.2 MiB)
> Interrupt:17
>
>eth0:0 Link encap:Ethernet HWaddr 64:31:50:3A:B0:B5
> inet addr:192.168.1.100 Bcast:192.168.1.255 Mask:255.255.255.0
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> Interrupt:17
>
>Then I enable bonding on my guest, I run:
>[root@...alhost ~]# uname -a
>Linux localhost.localdomain 2.6.35.11-83.fc14.i686 #1 SMP Mon Feb 7
>07:04:18 UTC 2011 i686 i686 i386 GNU/Linux
>
>[root@...alhost ~]# ifconfig
>eth6 Link encap:Ethernet HWaddr 08:00:27:3A:4D:BD
> inet addr:10.66.65.167 Bcast:10.66.65.255 Mask:255.255.254.0
> inet6 addr: fe80::a00:27ff:fe3a:4dbd/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:65 errors:0 dropped:0 overruns:0 frame:0
> TX packets:31 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:9916 (9.6 KiB) TX bytes:3090 (3.0 KiB)
>
>eth7 Link encap:Ethernet HWaddr 08:00:27:26:1B:DB
> inet addr:10.66.65.154 Bcast:10.66.65.255 Mask:255.255.254.0
> inet6 addr: fe80::a00:27ff:fe26:1bdb/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:57 errors:0 dropped:0 overruns:0 frame:0
> TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:7358 (7.1 KiB) TX bytes:1152 (1.1 KiB)
>
>eth8 Link encap:Ethernet HWaddr 08:00:27:B5:FC:D1
> inet addr:10.66.65.169 Bcast:10.66.65.255 Mask:255.255.254.0
> inet6 addr: fe80::a00:27ff:feb5:fcd1/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:57 errors:0 dropped:0 overruns:0 frame:0
> TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:7358 (7.1 KiB) TX bytes:1152 (1.1 KiB)
>
>eth9 Link encap:Ethernet HWaddr 08:00:27:C7:7B:FC
> inet addr:10.66.65.216 Bcast:10.66.65.255 Mask:255.255.254.0
> inet6 addr: fe80::a00:27ff:fec7:7bfc/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:57 errors:0 dropped:0 overruns:0 frame:0
> TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:7358 (7.1 KiB) TX bytes:1152 (1.1 KiB)
>
>lo Link encap:Local Loopback
> inet addr:127.0.0.1 Mask:255.0.0.0
> inet6 addr: ::1/128 Scope:Host
> UP LOOPBACK RUNNING MTU:16436 Metric:1
> RX packets:123 errors:0 dropped:0 overruns:0 frame:0
> TX packets:123 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:13036 (12.7 KiB) TX bytes:13036 (12.7 KiB)
>
>[root@...alhost ~]# ifconfig eth7 down
>[root@...alhost ~]# ifconfig eth8 down
>[root@...alhost ~]# dmesg -c
>[root@...alhost ~]# modprobe bonding mode=0 miimon=100
>[root@...alhost ~]# ifconfig bond0 192.168.1.5 netmask 255.255.255.0 up
>[root@...alhost ~]# ifenslave bond0 eth7
>
>[root@...alhost ~]# dmesg
>[ 304.496463] bonding: Ethernet Channel Bonding Driver: v3.6.0
>(September 26, 2009)
>[ 304.496468] bonding: MII link monitoring set to 100 ms
>[ 353.527680] ADDRCONF(NETDEV_UP): bond0: link is not ready
>[ 355.321626] e1000: eth7 NIC Link is Up 1000 Mbps Full Duplex, Flow
>Control: RX
>[ 355.322250] bonding: bond0: enslaving eth7 as an active interface
>with an up link.
>[ 355.323503] ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
>[ 365.394052] bond0: no IPv6 routers present
>
>[pwp@...alhost ~]$ ping 192.168.1.100 -c 10
At this point, what is in the routing table ("ip route show")
and the ARP table ("ip neigh show")?
>PING 192.168.1.100 (192.168.1.100) 56(84) bytes of data.
>64 bytes from 192.168.1.100: icmp_req=1 ttl=64 time=0.196 ms
>64 bytes from 192.168.1.100: icmp_req=2 ttl=64 time=0.365 ms
>64 bytes from 192.168.1.100: icmp_req=3 ttl=64 time=0.259 ms
>64 bytes from 192.168.1.100: icmp_req=4 ttl=64 time=0.135 ms
>64 bytes from 192.168.1.100: icmp_req=5 ttl=64 time=0.194 ms
>64 bytes from 192.168.1.100: icmp_req=6 ttl=64 time=0.225 ms
>64 bytes from 192.168.1.100: icmp_req=7 ttl=64 time=0.189 ms
>64 bytes from 192.168.1.100: icmp_req=8 ttl=64 time=0.274 ms
>64 bytes from 192.168.1.100: icmp_req=9 ttl=64 time=1.07 ms
>64 bytes from 192.168.1.100: icmp_req=10 ttl=64 time=0.274 ms
>
>--- 192.168.1.100 ping statistics ---
>10 packets transmitted, 10 received, 0% packet loss, time 9002ms
>rtt min/avg/max/mdev = 0.135/0.319/1.079/0.260 ms
>
>[root@...alhost ~]# ifenslave bond0 eth8
>[root@...alhost ~]# dmesg
>[ 304.496463] bonding: Ethernet Channel Bonding Driver: v3.6.0
>(September 26, 2009)
>[ 304.496468] bonding: MII link monitoring set to 100 ms
>[ 353.527680] ADDRCONF(NETDEV_UP): bond0: link is not ready
>[ 355.321626] e1000: eth7 NIC Link is Up 1000 Mbps Full Duplex, Flow
>Control: RX
>[ 355.322250] bonding: bond0: enslaving eth7 as an active interface
>with an up link.
>[ 355.323503] ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
>[ 365.394052] bond0: no IPv6 routers present
>[ 510.913797] e1000: eth8 NIC Link is Up 1000 Mbps Full Duplex, Flow
>Control: RX
>[ 510.917312] bonding: bond0: enslaving eth8 as an active interface
>with an up link.
>
>[pwp@...alhost ~]$ ping 192.168.1.100 -c 10
>PING 192.168.1.100 (192.168.1.100) 56(84) bytes of data.
>64 bytes from 192.168.1.100: icmp_req=1 ttl=64 time=0.182 ms
>64 bytes from 192.168.1.100: icmp_req=2 ttl=64 time=0.211 ms
>64 bytes from 192.168.1.100: icmp_req=3 ttl=64 time=0.270 ms
>64 bytes from 192.168.1.100: icmp_req=4 ttl=64 time=0.248 ms
>64 bytes from 192.168.1.100: icmp_req=5 ttl=64 time=0.132 ms
>64 bytes from 192.168.1.100: icmp_req=6 ttl=64 time=0.291 ms
>64 bytes from 192.168.1.100: icmp_req=7 ttl=64 time=0.246 ms
>64 bytes from 192.168.1.100: icmp_req=8 ttl=64 time=0.272 ms
>64 bytes from 192.168.1.100: icmp_req=9 ttl=64 time=0.293 ms
>64 bytes from 192.168.1.100: icmp_req=10 ttl=64 time=0.133 ms
>
>--- 192.168.1.100 ping statistics ---
>10 packets transmitted, 10 received, 0% packet loss, time 9000ms
>rtt min/avg/max/mdev = 0.132/0.227/0.293/0.060 ms
>
>[root@...alhost ~]# ifconfig
>bond0 Link encap:Ethernet HWaddr 08:00:27:26:1B:DB
> inet addr:192.168.1.5 Bcast:192.168.1.255 Mask:255.255.255.0
> inet6 addr: fe80::a00:27ff:fe26:1bdb/64 Scope:Link
> UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
> RX packets:311 errors:0 dropped:0 overruns:0 frame:0
> TX packets:61 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:38075 (37.1 KiB) TX bytes:8698 (8.4 KiB)
>
>eth7 Link encap:Ethernet HWaddr 08:00:27:26:1B:DB
> inet addr:10.66.65.154 Bcast:10.66.65.255 Mask:255.255.254.0
> UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
> RX packets:181 errors:0 dropped:0 overruns:0 frame:0
> TX packets:39 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:22297 (21.7 KiB) TX bytes:4578 (4.4 KiB)
>
>eth8 Link encap:Ethernet HWaddr 08:00:27:26:1B:DB
> inet addr:192.168.1.15 Bcast:192.168.1.255 Mask:255.255.255.0
> UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
> RX packets:130 errors:0 dropped:0 overruns:0 frame:0
> TX packets:22 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:15778 (15.4 KiB) TX bytes:4120 (4.0 KiB)
>
>[root@...alhost ~]# ifconfig eth7 down
Next question: just after setting eth7 down, what do the routing
and ARP tables look like?
>[root@...alhost ~]# dmesg
>[ 304.496463] bonding: Ethernet Channel Bonding Driver: v3.6.0
>(September 26, 2009)
>[ 304.496468] bonding: MII link monitoring set to 100 ms
>[ 353.527680] ADDRCONF(NETDEV_UP): bond0: link is not ready
>[ 355.321626] e1000: eth7 NIC Link is Up 1000 Mbps Full Duplex, Flow
>Control: RX
>[ 355.322250] bonding: bond0: enslaving eth7 as an active interface
>with an up link.
>[ 355.323503] ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
>[ 365.394052] bond0: no IPv6 routers present
>[ 510.913797] e1000: eth8 NIC Link is Up 1000 Mbps Full Duplex, Flow
>Control: RX
>[ 510.917312] bonding: bond0: enslaving eth8 as an active interface
>with an up link.
>[ 592.208534] bonding: bond0: link status definitely down for interface
>eth7, disabling it
>
>Now, if bonding driver works well, eth8 will be the active slave, and
>the network connection is ok.
>__But__ ...
>
>[pwp@...alhost ~]$ ping 192.168.1.100 -c 10
>PING 192.168.1.100 (192.168.1.100) 56(84) bytes of data.
>>From 192.168.1.5 icmp_seq=10 Destination Host Unreachable
>
>--- 192.168.1.100 ping statistics ---
>10 packets transmitted, 0 received, +1 errors, 100% packet loss, time 8999ms
>
>How strange!
>
>[root@...alhost ~]# ifconfig
>bond0 Link encap:Ethernet HWaddr 08:00:27:26:1B:DB
> inet addr:192.168.1.5 Bcast:192.168.1.255 Mask:255.255.255.0
> inet6 addr: fe80::a00:27ff:fe26:1bdb/64 Scope:Link
> UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
> RX packets:357 errors:0 dropped:0 overruns:0 frame:0
> TX packets:76 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:42971 (41.9 KiB) TX bytes:9832 (9.6 KiB)
>
>eth8 Link encap:Ethernet HWaddr 08:00:27:26:1B:DB
> inet addr:192.168.1.15 Bcast:192.168.1.255 Mask:255.255.255.0
> UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
> RX packets:163 errors:0 dropped:0 overruns:0 frame:0
> TX packets:37 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:19073 (18.6 KiB) TX bytes:5254 (5.1 KiB)
>
>[root@...alhost ~]# arp
>Address HWtype HWaddress Flags
>Mask Iface
>corerouter.nay.redhat.c ether 00:1d:45:20:d5:ff
>C eth6
>192.168.1.100
>(incomplete) bond0
>
>I think maybe there is something wrong about arp.
>So I run ping and tcpdump synchronously.
>
>[pwp@...alhost ~]$ ping 192.168.1.100 -c 10
>PING 192.168.1.100 (192.168.1.100) 56(84) bytes of data.
>>From 192.168.1.5 icmp_seq=2 Destination Host Unreachable
>>From 192.168.1.5 icmp_seq=3 Destination Host Unreachable
>>From 192.168.1.5 icmp_seq=4 Destination Host Unreachable
>>From 192.168.1.5 icmp_seq=6 Destination Host Unreachable
>>From 192.168.1.5 icmp_seq=7 Destination Host Unreachable
>>From 192.168.1.5 icmp_seq=8 Destination Host Unreachable
>>From 192.168.1.5 icmp_seq=9 Destination Host Unreachable
>>From 192.168.1.5 icmp_seq=10 Destination Host Unreachable
>
>--- 192.168.1.100 ping statistics ---
>10 packets transmitted, 0 received, +8 errors, 100% packet loss, time 9002ms
>pipe 3
>
>And meanwhile,
>[root@...alhost ~]# tcpdump -i bond0 -p arp
>tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
>listening on bond0, link-type EN10MB (Ethernet), capture size 65535 bytes
>02:46:56.983092 ARP, Request who-has 192.168.1.100 tell 192.168.1.5,
>length 28
[...]
At this point, does tcpdump on the host system see the incoming
ARP requests?
>But I'm sure eth8 works well.
>
>[root@...alhost ~]# modprobe -r bonding
>[root@...alhost ~]# modprobe bonding mode=0 miimon=100
>[root@...alhost ~]# ifconfig bond0 192.168.1.5 netmask 255.255.255.0 up
>[root@...alhost ~]# ifenslave bond0 eth8
>
>[pwp@...alhost ~]$ ping 192.168.1.100 -c 10
>PING 192.168.1.100 (192.168.1.100) 56(84) bytes of data.
>64 bytes from 192.168.1.100: icmp_req=1 ttl=64 time=0.683 ms
>64 bytes from 192.168.1.100: icmp_req=2 ttl=64 time=0.222 ms
>64 bytes from 192.168.1.100: icmp_req=3 ttl=64 time=0.265 ms
>64 bytes from 192.168.1.100: icmp_req=4 ttl=64 time=0.237 ms
>64 bytes from 192.168.1.100: icmp_req=5 ttl=64 time=0.214 ms
>64 bytes from 192.168.1.100: icmp_req=6 ttl=64 time=0.214 ms
>64 bytes from 192.168.1.100: icmp_req=7 ttl=64 time=0.238 ms
>64 bytes from 192.168.1.100: icmp_req=8 ttl=64 time=0.152 ms
>64 bytes from 192.168.1.100: icmp_req=9 ttl=64 time=0.234 ms
>64 bytes from 192.168.1.100: icmp_req=10 ttl=64 time=0.221 ms
>
>--- 192.168.1.100 ping statistics ---
>10 packets transmitted, 10 received, 0% packet loss, time 9004ms
>rtt min/avg/max/mdev = 0.152/0.268/0.683/0.141 ms
>
>[root@...alhost ~]# ifconfig
>bond0 Link encap:Ethernet HWaddr 08:00:27:B5:FC:D1
> inet addr:192.168.1.5 Bcast:192.168.1.255 Mask:255.255.255.0
> inet6 addr: fe80::a00:27ff:feb5:fcd1/64 Scope:Link
> UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
> RX packets:263 errors:0 dropped:0 overruns:0 frame:0
> TX packets:79 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:0
> RX bytes:28246 (27.5 KiB) TX bytes:9810 (9.5 KiB)
>
>eth8 Link encap:Ethernet HWaddr 08:00:27:B5:FC:D1
> UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
> RX packets:263 errors:0 dropped:0 overruns:0 frame:0
> TX packets:79 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:28246 (27.5 KiB) TX bytes:9810 (9.5 KiB)
>
>[root@...alhost ~]# arp
>Address HWtype HWaddress Flags
>Mask Iface
>corerouter.nay.redhat.c ether 00:1d:45:20:d5:ff
>C eth6
>192.168.1.100 ether 64:31:50:3a:b0:b5
>C bond0
-J
---
-Jay Vosburgh, IBM Linux Technology Center, fubar@...ibm.com
--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Powered by blists - more mailing lists