Date:	Wed, 04 Dec 2013 09:16:59 -0500
From:	Vlad Yasevich <vyasevich@...il.com>
To:	Sun Paul <paulrbk@...il.com>
CC:	netdev@...r.kernel.org, linux-sctp@...r.kernel.org,
	Karl Heiss <kheiss@...il.com>,
	Neil Horman <nhorman@...driver.com>,
	linux-kernel@...r.kernel.org
Subject: Re: Supporting 4 way connections in LKSCTP

On 12/03/2013 08:59 PM, Sun Paul wrote:
> This is the most puzzling area. I really not sure whether it is really
> valid or not. Is there any documented statement supporting this?
> 
> Let me summarize the behavior again.
> 
> NODE-A
> eth1: IP-A
> eth2: IP-B
> 
> NODE-B
> eth1: IP-X
> eth2: IP-Y
> 
> In normal operation, IP-A sends INIT to IP-X, IP-X returns INIT_ACK to
> IP-A. IP-A then sends HB to IP-X, IP-X then returns HB_ACK to IP-A. In
> the meantime, IP-B sends HB to IP-Y and IPY returns HB_ACK.
> 
> In case of the path between IP-A and IP-X is broken, IP-B sends INIT
> to IP-X, NODE-B uses IP-Y to return INIT_ACK to IP-B. Then IP-B sends
> HB to IP-X, and IP-Y returns HB_ACK to IP-B. In the meantime, the HB
> communication between IP-B and IP-Y follows the normal flow.
> 
> Can I confirm, is it really valid?

As long as NODE-B knows about both IP-A and IP-B, and NODE-A knows about
both IP-X and IP-Y (meaning all the addresses were exchanged inside INIT
and INIT-ACK), then this situation is perfectly valid.  In fact, this
has been tested an multiple interops.

Now, not all implementations will pick the source address you seem to
expect.  Linux, does not do source based transport selection.  It only
looks at the destination and picks the best source address based on
routing table decision.  So, in the case of Linux (nodeA), there will
only be 2 transports: one with a dest of IP-X and one with dest of IP-Y.
If it determined at start-up that IP-A is the source to set to IP-X, it
will never try to use IP-B to send to IP-X.  If it detects that
destination IP-X is unreachable, then it will keep probing, but it will
not change the source address.

Remember, HB-ACKs do not have to be returned from the same address that
HB were sent to.  This is because HB contains a nonce and that nonce
is used to locate the correct transport that this HB-ACK belongs to.

So, yes, the above communication is a valid SCTP exchange.

-vlad
> 
> On Tue, Dec 3, 2013 at 11:22 PM, Vlad Yasevich <vyasevich@...il.com> wrote:
>> On 12/03/2013 08:11 AM, Sun Paul wrote:
>>> But how about the HB and HB_ACK?  Still valid?
>>
>> As long as the source address is part of the association, then yes
>> it is perfectly valid.
>>
>> -vlad
>>
>>> On Dec 3, 2013 8:32 PM, "Vlad Yasevich" <vyasevich@...il.com> wrote:
>>>
>>>> On 12/02/2013 09:19 PM, Sun Paul wrote:
>>>>> so in this case, says
>>>>>
>>>>> (NODE-A) IP-B send INIT to IP-X (NODE-B), and then IP-Y (NODE-B)
>>>>> returns INIT_ACK to IP-B (NODE-A)
>>>>>
>>>>> this is also treated as a valid, am I correct?
>>>>
>>>> As long as IP-X (Node-B) is present in the address list of the INIT-ACK
>>>> chunk, yes.
>>>>
>>>> There is the code in __sctp_rcv_lookup_harder() that looks for other
>>>> adddresses in the INIT and INIT-ACK chunks.
>>>>
>>>> -vlad
>>>>>
>>>>>
>>>>> On Tue, Dec 3, 2013 at 10:03 AM, Vlad Yasevich <vyasevich@...il.com>
>>>> wrote:
>>>>>> On 12/02/2013 08:39 PM, Sun Paul wrote:
>>>>>>> Another question
>>>>>>>
>>>>>>> if a wrong source IP is used, does the association still classified as
>>>> normal?
>>>>>>
>>>>>> What do you mean my wrong source IP?  As long as the address is part of
>>>>>> the association, it can be used.
>>>>>>
>>>>>> -vlad
>>>>>>
>>>>>>>
>>>>>>> On Tue, Dec 3, 2013 at 9:31 AM, Sun Paul <paulrbk@...il.com> wrote:
>>>>>>>> Thanks Vlad
>>>>>>>>
>>>>>>>> I checked on the route, and it looks correct.
>>>>>>>>
>>>>>>>> [root@...alhost ~]# ip route get 11.1.1.1 from 110.1.1.1
>>>>>>>> 11.1.1.1 from 110.1.1.1 via 110.1.1.254 dev eth1
>>>>>>>>     cache  mtu 1500 advmss 1460 hoplimit 64
>>>>>>>>
>>>>>>>> [root@...alhost ~]# ip route get 11.1.1.1 from 120.1.1.1
>>>>>>>> 11.1.1.1 from 120.1.1.1 via 120.1.1.254 dev eth2
>>>>>>>>     cache  mtu 1500 advmss 1460 hoplimit 64
>>>>>>>>
>>>>>>>> [root@...alhost ~]# ip route get 12.1.1.1 from 120.1.1.1
>>>>>>>> 12.1.1.1 from 120.1.1.1 via 120.1.1.254 dev eth2
>>>>>>>>     cache  mtu 1500 advmss 1460 hoplimit 64
>>>>>>>>
>>>>>>>> [root@...alhost ~]# ip route get 12.1.1.1 from 110.1.1.1
>>>>>>>> 12.1.1.1 from 110.1.1.1 via 110.1.1.254 dev eth1
>>>>>>>>     cache  mtu 1500 advmss 1460 hoplimit 64
>>>>>>>>
>>>>>>>> so, if this is not being handled in LKSCTP, is it possible to suggest
>>>>>>>> a way how we can achieve it?
>>>>>>>>
>>>>>>>> On Tue, Dec 3, 2013 at 12:42 AM, Vlad Yasevich <vyasevich@...il.com>
>>>> wrote:
>>>>>>>>> On 12/02/2013 10:45 AM, Karl Heiss wrote:
>>>>>>>>>> On Mon, Dec 2, 2013 at 9:38 AM, Vlad Yasevich <vyasevich@...il.com>
>>>> wrote:
>>>>>>>>>>> On 11/27/2013 11:03 PM, Sun Paul wrote:
>>>>>>>>>>>> How LKSCTP select which source address to use for the INIT_ACK or
>>>>>>>>>>>> HB_ACK? below is the testing result where a router is located in
>>>> the
>>>>>>>>>>>> middle.
>>>>>>>>>>>>
>>>>>>>>>>>> Before starting the application. the packet on eth1 and eth2 are
>>>>>>>>>>>>
>>>>>>>>>>>> eth1
>>>>>>>>>>>> 0 packets dropped by kernel
>>>>>>>>>>>> [root@...alhost ~]# tcpdump -i eth1 -s 0 -nn
>>>>>>>>>>>> tcpdump: verbose output suppressed, use -v or -vv for full
>>>> protocol decode
>>>>>>>>>>>> listening on eth1, link-type EN10MB (Ethernet), capture size
>>>> 65535 bytes
>>>>>>>>>>>> 11:24:14.262489 IP 12.1.1.1.2905 > 110.1.1.1.2905: sctp (1) [INIT]
>>>>>>>>>>>> [init tag: 28362903] [rwnd: 102400] [OS: 16] [MIS: 16] [init TSN:
>>>> 0]
>>>>>>>>>>>> 11:24:14.262522 IP 110.1.1.1.2905 > 12.1.1.1.2905: sctp (1)
>>>> [ABORT]
>>>>>>>>>>>> 11:24:14.539486
>>>>>>>>>>>> 11:24:16.262488 IP 12.1.1.1.2905 > 110.1.1.1.2905: sctp (1) [INIT]
>>>>>>>>>>>> [init tag: 29391734] [rwnd: 102400] [OS: 16] [MIS: 16] [init TSN:
>>>> 0]
>>>>>>>>>>>> 11:24:16.262520 IP 110.1.1.1.2905 > 12.1.1.1.2905: sctp (1)
>>>> [ABORT]
>>>>>>>>>>>>
>>>>>>>>>>>> eth2
>>>>>>>>>>>> [root@...alhost ~]# tcpdump -i eth2 -s 0 -nn
>>>>>>>>>>>> tcpdump: verbose output suppressed, use -v or -vv for full
>>>> protocol decode
>>>>>>>>>>>> listening on eth2, link-type EN10MB (Ethernet), capture size
>>>> 65535 bytes
>>>>>>>>>>>>
>>>>>>>>>>>> When starting the application. the packet show as below.
>>>>>>>>>>>>
>>>>>>>>>>>> eth1
>>>>>>>>>>>> 11:26:02.261511 IP 12.1.1.1.2905 > 110.1.1.1.2905: sctp (1) [INIT]
>>>>>>>>>>>> [init tag: 26256828] [rwnd: 102400] [OS: 16] [MIS: 16] [init TSN:
>>>> 0]
>>>>>>>>>>>> 11:26:02.263513 IP 12.1.1.1.2905 > 110.1.1.1.2905: sctp (1)
>>>> [COOKIE ECHO]
>>>>>>>>>>>> 11:26:02.264518 IP 12.1.1.1.2905 > 110.1.1.1.2905: sctp (1) [HB
>>>> REQ]
>>>>>>>>>>>> 11:26:02.563511 IP 12.1.1.1.2905 > 110.1.1.1.2905: sctp (1) [HB
>>>> REQ]
>>>>>>>>>>>>
>>>>>>>>>>>> eth2
>>>>>>>>>>>> 11:26:02.261604 IP 120.1.1.1.2905 > 12.1.1.1.2905: sctp (1) [INIT
>>>> ACK]
>>>>>>>>>>>> [init tag: 3478239387] [rwnd: 131072] [OS: 5] [MIS: 5] [init TSN:
>>>>>>>>>>>> 2330749678]
>>>>>>>>>>>> 11:26:02.263583 IP 120.1.1.1.2905 > 12.1.1.1.2905: sctp (1)
>>>> [COOKIE ACK]
>>>>>>>>>>>> 11:26:02.264548 IP 120.1.1.1.2905 > 12.1.1.1.2905: sctp (1) [HB
>>>> ACK]
>>>>>>>>>>>> 11:26:02.264652 IP 11.1.1.1.2905 > 120.1.1.1.2905: sctp (1) [HB
>>>> REQ]
>>>>>>>>>>>> 11:26:02.264705 IP 120.1.1.1.2905 > 11.1.1.1.2905: sctp (1) [HB
>>>> ACK]
>>>>>>>>>>>> 11:26:02.563543 IP 120.1.1.1.2905 > 12.1.1.1.2905: sctp (1) [HB
>>>> ACK]
>>>>>>>>>>>>
>>>>>>>>>>>> From the above result, you can see that the INIT, COOKIE ECHO and
>>>>>>>>>>>> HB_REQ originated from 12.1.1.1 on eth1, but the ACK (INIT_ACK,
>>>>>>>>>>>> COOKIE_ACK, HB_ACK) are returned on eth2 using source address
>>>>>>>>>>>> 120.1.1.1 instead of 110.1.1.1.
>>>>>>>>>>>>
>>>>>>>>>>>> Why LKSCTP use 120.1.1.1 as source instead of 110.1.1.1?
>>>>>>>>>>>>
>>>>>>>>>>>> For simple ICMP ping test, it is normal, but not for SCTP.
>>>>>>>>>>>>
>>>>>>>>>>>> eth1
>>>>>>>>>>>> 11:30:02.824548 IP 12.1.1.1 > 110.1.1.1: ICMP echo request, id
>>>> 37178,
>>>>>>>>>>>> seq 12, length 64
>>>>>>>>>>>> 11:30:02.824559 IP 110.1.1.1 > 12.1.1.1: ICMP echo reply, id
>>>> 37178,
>>>>>>>>>>>> seq 12, length 64
>>>>>>>>>>>> 11:30:03.825551 IP 12.1.1.1 > 110.1.1.1: ICMP echo request, id
>>>> 37178,
>>>>>>>>>>>> seq 13, length 64
>>>>>>>>>>>> 11:30:03.825561 IP 110.1.1.1 > 12.1.1.1: ICMP echo reply, id
>>>> 37178,
>>>>>>>>>>>> seq 13, length 64
>>>>>>>>>>>>
>>>>>>>>>>>> eth2
>>>>>>>>>>>> 11:30:34.027687 IP 11.1.1.1 > 120.1.1.1: ICMP echo request, id
>>>> 46138,
>>>>>>>>>>>> seq 2, length 64
>>>>>>>>>>>> 11:30:34.027697 IP 120.1.1.1 > 11.1.1.1: ICMP echo reply, id
>>>> 46138,
>>>>>>>>>>>> seq 2, length 64
>>>>>>>>>>>> 11:30:35.027686 IP 11.1.1.1 > 120.1.1.1: ICMP echo request, id
>>>> 46138,
>>>>>>>>>>>> seq 3, length 64
>>>>>>>>>>>> 11:30:35.027694 IP 120.1.1.1 > 11.1.1.1: ICMP echo reply, id
>>>> 46138,
>>>>>>>>>>>> seq 3, length 64
>>>>>>>>>>>>
>>>>>>>>>>>> Below is the route information
>>>>>>>>>>>> #route -n
>>>>>>>>>>>> Kernel IP routing table
>>>>>>>>>>>> Destination     Gateway         Genmask         Flags Metric Ref
>>>>    Use Iface
>>>>>>>>>>>> 110.1.1.0       0.0.0.0         255.255.255.0   U     0      0
>>>>      0 eth1
>>>>>>>>>>>> 120.1.1.0       0.0.0.0         255.255.255.0   U     0      0
>>>>      0 eth2
>>>>>>>>>>>>
>>>>>>>>>>>> # ip route show
>>>>>>>>>>>> 110.1.1.0/24 dev eth1  proto kernel  scope link  src 110.1.1.1
>>>>>>>>>>>> 120.1.1.0/24 dev eth2  proto kernel  scope link  src 120.1.1.1
>>>>>>>>>>>>
>>>>>>>>>>>> Since we are using iproute2, so we will have dedicate routing
>>>> table
>>>>>>>>>>>> per interface
>>>>>>>>>>>>
>>>>>>>>>>>> # ip route show table SCTP1
>>>>>>>>>>>> default via 110.1.1.254 dev eth1
>>>>>>>>>>>>
>>>>>>>>>>>> # ip route show table SCTP2
>>>>>>>>>>>> default via 120.1.1.254 dev eth2
>>>>>>>>>>>>
>>>>>>>>>>>> # ip rule ls
>>>>>>>>>>>> 0: from all lookup local
>>>>>>>>>>>> 101: from 110.1.1.1 lookup SCTP1
>>>>>>>>>>>> 102: from 120.1.1.1 lookup SCTP2
>>>>>>>>>>>> 32766: from all lookup main
>>>>>>>>>>>> 32767: from all lookup default
>>>>>>>>>>>>
>>>>>>>>>>>> How LKSCTP select source address to reply? If we know how it
>>>> works,
>>>>>>>>>>>> then we may know what is going wrong.
>>>>>>>>>>>
>>>>>>>>>>> LKSCTP will prefer the address returned from the routing table as
>>>> long
>>>>>>>>>>> as it is one of the addresses that is bound by the socket and are
>>>> usable
>>>>>>>>>>> by the association.
>>>>>>>>>>>
>>>>>>>>>>> If the address returned from the route lookup is not part of the
>>>>>>>>>>> association, then lksctp attempts to lookup routes using one of the
>>>>>>>>>>> source addresses it has available.  Usually the first lookup
>>>> succeeds
>>>>>>>>>>> due to the host-model implementation in linux.
>>>>>>>>>>>
>>>>>>>>>>> You may want to change your rule set to be destination based.  Then
>>>>>>>>>>> in the table associated with the rule, specify the source address
>>>>>>>>>>> you want to be used.
>>>>>>>>>>>
>>>>>>>>>>> -vlad
>>>>>>>>>>
>>>>>>>>>> I have had similar qualms myself about this behavior, and I honestly
>>>>>>>>>> don't know what the correct answer should be...
>>>>>>>>>>
>>>>>>>>>> In my opinion, shouldn't the source address "just work" for
>>>>>>>>>> acknowledgements? If the spec explicitly states that the ACK should
>>>>>>>>>> have a source address that matches the destination of the chunk
>>>> being
>>>>>>>>>> ACKed, why should someone have to configure this behavior outside of
>>>>>>>>>> the SCTP stack by default? Is it a technical limitation, or is this
>>>>>>>>>> done for a particular reason?  I can understand needing to override
>>>>>>>>>> the behavior, but why isn't the default "sane"?
>>>>>>>>>
>>>>>>>>> I think the results are sane, they simply may not match expectations.
>>>>>>>>> SCTP spec doesn't say anything about source address selection.  It
>>>>>>>>> says that a response should be send back to the source of the
>>>> request.
>>>>>>>>> This is being done in both cases, i.e. the destination address in
>>>>>>>>> INIT-ACK matches the source of the INIT.
>>>>>>>>>
>>>>>>>>> The spec does contain the MAY text that allows finer control of
>>>> source
>>>>>>>>> addresses, but lksctp doesn't seem to implement that.  Whenever we've
>>>>>>>>> tried, we couldn't get the generic mechanism working to please
>>>> everyone,
>>>>>>>>> as everyone had slightly different configurations and expectations.
>>>>  So
>>>>>>>>> we left it to the rules engine.
>>>>>>>>>
>>>>>>>>> In this setup, it just appears that the default routing is not what
>>>> you
>>>>>>>>> expect.  You can easily check this with 'ip route get' command.  If
>>>> it
>>>>>>>>> is not what you want linux allows you to change that via ip rules.
>>>>>>>>>
>>>>>>>>> -vlad
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Karl
>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Nov 27, 2013 at 8:45 PM, Neil Horman <
>>>> nhorman@...driver.com> wrote:
>>>>>>>>>>>>> On Wed, Nov 27, 2013 at 07:10:49AM +0800, Sun Paul wrote:
>>>>>>>>>>>>>> Hi Vlad
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thank for your reply. If it is based on the destination IP to
>>>> find the
>>>>>>>>>>>>>> best route, why the problem didn't happen on single-homing
>>>> sample?
>>>>>>>>>>>>>>
>>>>>>>>>>>>> Because You only ever use one address from NODE A (12.1.1.1)
>>>>>>>>>>>>>
>>>>>>>>>>>>>> In the single-homing sample that provided in the original
>>>> email, both
>>>>>>>>>>>>>> of the interfaces (eth1 and eth2) are presented on NODE-B
>>>> during the
>>>>>>>>>>>>>> test. However, the LKSCTP library know to use the interface
>>>> eth1 to
>>>>>>>>>>>>>> respond to the SCTP request.
>>>>>>>>>>>>>>
>>>>>>>>>>>>> Yes, because it does a route lookup to each of the two ip
>>>> addresses to NODE B,
>>>>>>>>>>>>> and in both lookups, the route indicates that only one source
>>>> address should be
>>>>>>>>>>>>> used (12.1.1.1).  If you issue a ip route show command, you'll
>>>> see that routes
>>>>>>>>>>>>> to both address on NODE B match on a rule that specifies the
>>>> same src address
>>>>>>>>>>>>> and interface be used.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Neil
>>>>>>>>>>>>>
>>>>>>>>>>>>>> - PS
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Nov 27, 2013 at 7:09 AM, Sun Paul <paulrbk@...il.com>
>>>> wrote:
>>>>>>>>>>>>>>> Hi Vlad
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thank for your reply. If it is based on the destination IP to
>>>> find the
>>>>>>>>>>>>>>> best route, why the problem didn't happen on single-homing
>>>> sample?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> In the single-homing sample that provided in the original
>>>> email, both
>>>>>>>>>>>>>>> of the interfaces (eth1 and eth2) are presented on NODE-B
>>>> during the
>>>>>>>>>>>>>>> test. However, the LKSCTP library know to use the interface
>>>> eth1 to
>>>>>>>>>>>>>>> respond to the SCTP request.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> - PS
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Tue, Nov 26, 2013 at 11:19 PM, Vlad Yasevich <
>>>> vyasevich@...il.com> wrote:
>>>>>>>>>>>>>>>> On 11/25/2013 08:03 PM, Sun Paul wrote:
>>>>>>>>>>>>>>>>> Hi
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> we have a problem on using LKSCTP to form a 4 ways
>>>> multi-homing network.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Configuration
>>>>>>>>>>>>>>>>> - Node-A has 2 IP addresses in different subnets, known as
>>>> IP-A (eth1),
>>>>>>>>>>>>>>>>> IP-B (eth2)
>>>>>>>>>>>>>>>>> - Node-B has 2 IP addresses in different subnets, known as
>>>> IP-X (eth1),
>>>>>>>>>>>>>>>>> IP-Y (eth2)
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> First of all, this is not a 4 way multi-homed network.  As
>>>> far as each
>>>>>>>>>>>>>>>> SCTP association is concerned, it has only 2 destinations to
>>>> send to
>>>>>>>>>>>>>>>> so it has only 2 ways to get there.  The fact that you have
>>>> multiple
>>>>>>>>>>>>>>>> local addresses doesn't mean that every local address can and
>>>> should
>>>>>>>>>>>>>>>> be used to connect to the remote.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> the four way paths are shown below.
>>>>>>>>>>>>>>>>> 1. IP-A (11.1.1.1) to IP-X (11.1.1.11)
>>>>>>>>>>>>>>>>> 2. IP-B (12.1.1.1) to IP-Y (12.1.1.11)
>>>>>>>>>>>>>>>>> 3. IP-A (11.1.1.1) to IP-Y (12.1.1.11)
>>>>>>>>>>>>>>>>> 4. IP-B (12.1.1.1) to IP-X (11.1.1.11)
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> No, actually you only have 2 paths:  one to IPX and one to
>>>> IP-Y.
>>>>>>>>>>>>>>>> Which source address you choose is based on routing policy
>>>>>>>>>>>>>>>> decisions and is outside the scope of SCTP.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> the HB/HB_ACK is normal for the paths " IP-A to IP-X" and
>>>> "IP-B to
>>>>>>>>>>>>>>>>> IP-Y", but it is not correct for the rest of two.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Right, because linux is using a host addressing model, not an
>>>> interface
>>>>>>>>>>>>>>>> addressing model.  SCTP stack simply finds the best source
>>>> address
>>>>>>>>>>>>>>>> that can be used to reach IP-X and it happens to be IP-A.  So
>>>> that
>>>>>>>>>>>>>>>> is what it is going to use.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> The above explains why you are seeing what you describe below.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> In the end, linux SCTP implementation determines paths solely
>>>> based
>>>>>>>>>>>>>>>> on the destination address.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> -vlad
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> First of all, we are using iproute2 to form 2 table such
>>>> that when
>>>>>>>>>>>>>>>>> IP-B arrives on IP-X, it will know how to route back to IP-B
>>>> on the
>>>>>>>>>>>>>>>>> same interface, i.e (eth1). Same logic for the path "IP-A to
>>>> IP-X".
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> What we observed here is that when 12.1.1.1 sends INIT to
>>>> 11.1.1.11,
>>>>>>>>>>>>>>>>> LKSCTP will send back the INIT_ACK to 12.1.1.1 using
>>>> 12.1.1.11 but not
>>>>>>>>>>>>>>>>> using the IP 11.1.1.11.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> The above operation makes the subsequence HB/HB_ACK in using
>>>> wrong IP address.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> TCP trace on eth1
>>>>>>>>>>>>>>>>> 18:02:41.058640 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [INIT]
>>>>>>>>>>>>>>>>> [init tag: 19933036] [rwnd: 102400] [OS: 16] [MIS: 16] [init
>>>> TSN: 0]
>>>>>>>>>>>>>>>>> 18:02:41.061634 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [COOKIE ECHO]
>>>>>>>>>>>>>>>>> 18:02:41.062642 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:02:41.062846 IP 11.1.1.11.2905 > 11.1.1.1.2905: sctp (1)
>>>> [HB ACK]
>>>>>>>>>>>>>>>>> 18:02:41.361811 IP 11.1.1.11.2905 > 11.1.1.1.2905: sctp (1)
>>>> [HB ACK]
>>>>>>>>>>>>>>>>> 18:02:41.661791 IP 11.1.1.11.2905 > 11.1.1.1.2905: sctp (1)
>>>> [HB ACK]
>>>>>>>>>>>>>>>>> 18:02:41.961791 IP 11.1.1.11.2905 > 11.1.1.1.2905: sctp (1)
>>>> [HB ACK]
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> TCP trace on eth2
>>>>>>>>>>>>>>>>> 18:02:41.058755 IP 12.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [INIT ACK]
>>>>>>>>>>>>>>>>> [init tag: 424726157] [rwnd: 131072] [OS: 5] [MIS: 5] [init
>>>> TSN:
>>>>>>>>>>>>>>>>> 3340756356]
>>>>>>>>>>>>>>>>> 18:02:41.061696 IP 12.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [COOKIE ACK]
>>>>>>>>>>>>>>>>> 18:02:41.062663 IP 12.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [HB ACK]
>>>>>>>>>>>>>>>>> 18:02:41.062791 IP 11.1.1.1.2905 > 12.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:02:41.361777 IP 11.1.1.1.2905 > 12.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:02:41.661772 IP 11.1.1.1.2905 > 12.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:02:41.961772 IP 11.1.1.1.2905 > 12.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:02:42.161771 IP 11.1.1.1.2905 > 12.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:02:42.461770 IP 11.1.1.1.2905 > 12.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:02:42.675770 IP 11.1.1.1.2905 > 12.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> If we are using single homing, there is no problem on the
>>>> SCTP
>>>>>>>>>>>>>>>>> communication. Below is the TCP trace on eth1 using sctp_test
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> 18:09:55.356727 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [INIT]
>>>>>>>>>>>>>>>>> [init tag: 32516609] [rwnd: 102400] [OS: 16] [MIS: 16] [init
>>>> TSN: 0]
>>>>>>>>>>>>>>>>> 18:09:55.356811 IP 11.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [INIT ACK]
>>>>>>>>>>>>>>>>> [init tag: 3168861995] [rwnd: 131072] [OS: 10] [MIS: 16]
>>>> [init TSN:
>>>>>>>>>>>>>>>>> 1877695021]
>>>>>>>>>>>>>>>>> 18:09:55.357727 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [COOKIE ECHO]
>>>>>>>>>>>>>>>>> 18:09:55.357788 IP 11.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [COOKIE ACK]
>>>>>>>>>>>>>>>>> 18:09:55.358724 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:09:55.358740 IP 11.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [HB ACK]
>>>>>>>>>>>>>>>>> 18:09:55.379715 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [DATA]
>>>>>>>>>>>>>>>>> (B)(E) [TSN: 0] [SID: 0] [SSEQ 0] [PPID 0x3]
>>>>>>>>>>>>>>>>> 18:09:55.379735 IP 11.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [SACK]
>>>>>>>>>>>>>>>>> [cum ack 0] [a_rwnd 131064] [#gap acks 0] [#dup tsns 0]
>>>>>>>>>>>>>>>>> 18:09:55.657716 IP 12.1.1.1.2905 > 11.1.1.11.2905: sctp (1)
>>>> [HB REQ]
>>>>>>>>>>>>>>>>> 18:09:55.657732 IP 11.1.1.11.2905 > 12.1.1.1.2905: sctp (1)
>>>> [HB ACK]
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> From the observations, it seems that the LKSCTP library is
>>>> not able to
>>>>>>>>>>>>>>>>> use the original local address when multi-homing is being
>>>> used. Is
>>>>>>>>>>>>>>>>> there anyway can be resolved it?
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> PS
>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>> linux-sctp" in
>>>>>>>>>>>>>>>>> the body of a message to majordomo@...r.kernel.org
>>>>>>>>>>>>>>>>> More majordomo info at
>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>> linux-sctp" in
>>>>>>>>>>>>>> the body of a message to majordomo@...r.kernel.org
>>>>>>>>>>>>>> More majordomo info at
>>>> http://vger.kernel.org/majordomo-info.html
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> To unsubscribe from this list: send the line "unsubscribe
>>>> linux-sctp" in
>>>>>>>>>>> the body of a message to majordomo@...r.kernel.org
>>>>>>>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>>>>>>>
>>>>>>
>>>>
>>>>
>>>
>>

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists