netdev - Re: [PATCH v2 net-next RFC] Generic XDP

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <1491926733.10587.56.camel@edumazet-glaptop3.roam.corp.google.com>
Date:   Tue, 11 Apr 2017 09:05:33 -0700
From:   Eric Dumazet <eric.dumazet@...il.com>
To:     Andy Gospodarek <andy@...yhouse.net>
Cc:     Daniel Borkmann <daniel@...earbox.net>,
        David Miller <davem@...emloft.net>, netdev@...r.kernel.org,
        xdp-newbies@...r.kernel.org
Subject: Re: [PATCH v2 net-next RFC] Generic XDP

On Mon, 2017-04-10 at 17:41 -0400, Andy Gospodarek wrote:

> Results with bpf_git_enable=1 and gro off, still only 7.5Mpps.

7.5 Mpps is already a nice number.

We all understand that using native XDP in the driver might give some
extra pps, but for the ones that do not want to patch old drivers, it is
probably good enough.

> 
>     26.34%  ksoftirqd/5      [kernel.vmlinux]              [k] memcpy_erms

Can you investigate to see what are the call graphs ?

Is this from copying headers to skb->head from bnxt driver ?

Some kind of copybreak maybe ?

perf record -a -g sleep 5
perf report --stdio

Copybreak is generally not really useful, and can have downsides.

Much better to let upper stacks deciding this.

For example, there is no point doing copy break for TCP ACK packets that
are going to be consumed immediately.

There is also no point doing copy break in case the packet will be
dropped (say by ... XDP ;) )


>     14.79%  ksoftirqd/5      [bnxt_en]                     [k] bnxt_rx_pkt
>     10.11%  ksoftirqd/5      [kernel.vmlinux]              [k] __build_skb
>      5.01%  ksoftirqd/5      [kernel.vmlinux]              [k] page_frag_free
>      4.66%  ksoftirqd/5      [kernel.vmlinux]              [k] kmem_cache_alloc
>      4.19%  ksoftirqd/5      [kernel.vmlinux]              [k] kmem_cache_free
>      3.67%  ksoftirqd/5      [bnxt_en]                     [k] bnxt_poll
>      2.97%  ksoftirqd/5      [kernel.vmlinux]              [k] netif_receive_skb_internal
>      2.24%  ksoftirqd/5      [kernel.vmlinux]              [k] __napi_alloc_skb
>      1.92%  ksoftirqd/5      [kernel.vmlinux]              [k] eth_type_trans
>      1.78%  ksoftirqd/5      [bnxt_en]                     [k] bnxt_rx_xdp
>      1.62%  ksoftirqd/5      [kernel.vmlinux]              [k] net_rx_action