netdev - Re: RFC: MTU for serving NFS on Infiniband

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20100826165359.3b79b27d@nehalam>
Date:	Thu, 26 Aug 2010 16:53:59 -0700
From:	Stephen Hemminger <shemminger@...tta.com>
To:	Marc Aurele La France <tsi@...berta.ca>
Cc:	Eric Dumazet <eric.dumazet@...il.com>,
	Ben Hutchings <bhutchings@...arflare.com>,
	linux-kernel@...r.kernel.org, netdev@...r.kernel.org,
	"David S. Miller" <davem@...emloft.net>,
	Alexey Kuznetsov <kuznet@....inr.ac.ru>,
	"Pekka Savola (ipv6)" <pekkas@...core.fi>,
	James Morris <jmorris@...ei.org>,
	Hideaki YOSHIFUJI <yoshfuji@...ux-ipv6.org>,
	Patrick McHardy <kaber@...sh.net>
Subject: Re: RFC: MTU for serving NFS on Infiniband

On Thu, 26 Aug 2010 08:43:42 -0600 (Mountain Daylight Time)
Marc Aurele La France <tsi@...berta.ca> wrote:

> On Thu, 26 Aug 2010, Eric Dumazet wrote:
> > Le jeudi 26 août 2010 à 05:40 -0600, Marc Aurele La France a écrit :
> 
> >> Steady now.  There's no need to YELL nor be arrogant.  You and I both know
> >> there's a place for NFS over UDP.  That's not changing any time soon.  While
> >> I'm aware of the issue you brought up, it is separate from the one at hand in
> >> this discussion.
> 
> >> I do want to thank you, however, for reminding me of TCP.  It's something
> >> 20/20 hindsight says I should have checked out before starting this thread.
> >> Logistically, it'll be a few days before I can do so though.  If that allows
> >> me to increase the MTU all the way up to 65520, then this UDP thing will
> >> likely remain unresolved.
> 
> > Unfortunately, your infiniband device lacks NETIF_F_SG support.
> 
> Oh, the device itself probably has something similar, but ipoib 
> (IP-over-Infiniband) doesn't export that capability.
> 
> > MTU a bit larger than PAGE_SIZE-overhead will need high order
> > allocations ?
> 
> Right.  And a 65520 MTU allocates sk_buff's with 128K contiguous payloads.

Infiniband device driver needs to be fixed to do SG and checksum offload.
Otherwise it is insane to try and run large MTU over it. I even wonder if
the dev_change_mtu() function should reject > PAGESIZE mtu for devices
that don't do scatter/gather or at least a raise a warning.
--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html