[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <1363270569.29475.11.camel@edumazet-glaptop>
Date: Thu, 14 Mar 2013 15:16:09 +0100
From: Eric Dumazet <eric.dumazet@...il.com>
To: Pavel Emelyanov <xemul@...allels.com>
Cc: David Miller <davem@...emloft.net>, Mel Gorman <mgorman@...e.de>,
Linux Netdev List <netdev@...r.kernel.org>,
stable@...nel.org, Alexey Kuznetsov <kuznet@....inr.ac.ru>
Subject: Re: [PATCH] skb: Propagate pfmemalloc on skb from head page only
On Thu, 2013-03-14 at 17:29 +0400, Pavel Emelyanov wrote:
> Hi.
>
> I'm trying to send big chunks of memory from application address space via
> TCP socket using vmsplice + splice like this
>
> mem = mmap(128Mb);
> vmsplice(pipe[1], mem); /* splice memory into pipe */
> splice(pipe[0], tcp_socket); /* send it into network */
>
> When I'm lucky and a huge page splices into the pipe and then into the socket
> _and_ client and server ends of the TCP connection are on the same host,
> communicating via lo, the whole connection gets stuck! The sending queue
> becomes full and app stops writing/splicing more into it, but the receiving
> queue remains empty, and that's why.
>
> The __skb_fill_page_desc observes a tail page of a huge page and erroneously
> propagates its page->pfmemalloc value onto socket (the pfmemalloc on tail pages
> contain garbage). Then this skb->pfmemalloc leaks through lo and due to the
>
> tcp_v4_rcv
> sk_filter
> if (skb->pfmemalloc && !sock_flag(sk, SOCK_MEMALLOC)) /* true */
> return -ENOMEM
> goto release_and_discard;
>
> no packets reach the socket. Even TCP re-transmits are dropped by this, as skb
> cloning clones the pfmemalloc flag as well.
>
> That said, here's the proper page->pfmemalloc propagation onto socket: we
> must check the huge-page's head page only, other pages' pfmemalloc and mapping
> values do not contain what is expected in this place. However, I'm not sure
> whether this fix is _complete_, since pfmemalloc propagation via lo also
> oesn't look great.
>
> Both, bit propagation from page to skb and this check in sk_filter, were
> introduced by c48a11c7 (netvm: propagate page->pfmemalloc to skb), in v3.5 so
> Mel and stable@ are in Cc.
>
> Signed-off-by: Pavel Emelyanov <xemul@...allels.com>
>
> ---
>
> diff --git a/include/linux/skbuff.h b/include/linux/skbuff.h
> index eb2106f..4e525eb 100644
> --- a/include/linux/skbuff.h
> +++ b/include/linux/skbuff.h
> @@ -1292,11 +1292,13 @@ static inline void __skb_fill_page_desc(struct sk_buff *skb, int i,
> * do not lose pfmemalloc information as the pages would not be
> * allocated using __GFP_MEMALLOC.
> */
> - if (page->pfmemalloc && !page->mapping)
> - skb->pfmemalloc = true;
> frag->page.p = page;
> frag->page_offset = off;
> skb_frag_size_set(frag, size);
> +
> + page = compound_head(page);
> + if (page->pfmemalloc && !page->mapping)
> + skb->pfmemalloc = true;
> }
>
> /**
> --
This looks a nice finding.
Note this can trigger even without vmsplice() use but regular network
receive.
Acked-by: Eric Dumazet <edumazet@...gle.com>
When I discussed with David on this issue, I said that one possibility
would be to accept a pfmemalloc skb on regular skb if no other packet is
in a receive queue, to get a chance to make progress (and limit memory
consumption to no more than one skb per TCP socket)
--
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Powered by blists - more mailing lists