netdev - Re: LRO/GRO and libpcap packet reordering

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <1363298294.2695.15.camel@bwh-desktop.uk.solarflarecom.com>
Date:	Thu, 14 Mar 2013 21:58:14 +0000
From:	Ben Hutchings <bhutchings@...arflare.com>
To:	Andy Lutomirski <luto@...capital.net>
CC:	Network Development <netdev@...r.kernel.org>
Subject: Re: LRO/GRO and libpcap packet reordering

On Thu, 2013-03-14 at 13:37 -0700, Andy Lutomirski wrote:
> (I'm on Ubuntu's 3.5.0-23, but I haven't seen anything that would
> change this behavior in newer kernels.)
> 
> I have a myri10ge device that's attached to a port mirror.  It runs
> tcpdump.  Most of the traffic I'm capturing has another machine
> attached to this switch as an endpoint.  That machine is considerably
> faster than the machine doing the capturing.
> 
> My captures show nasty artifacts: packets are reodered between a given
> flow and the other direction of the same flow.  The nasty case is when
> an ACK shows up before the packet that it's acking.  This thoroughly
> screws up Wireshark's TCP sequencing analysis.  Turning off LRO and
> GRO fixes it.
> 
> Clearly, since this interface doesn't actually have an IP address,
> there's no good reason to keep GRO and LRO on.  Nonetheless, it would
> be nice if GRO didn't coalesce packets when there's an intervening
> packing in the other direction on the same flow.  Can this be done
> cheaply?

No, it would not be cheap.

You'll probably have to disable GRO, LRO and also RSS (unless you can
configure the RSS hash function to produce the same result for both
directions of a flow).

Ben.

-- 
Ben Hutchings, Staff Engineer, Solarflare
Not speaking for my employer; that's the marketing department's job.
They asked us to note that Solarflare product names are trademarked.

--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html