[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <67eed96e15750_15e1b32945a@willemb.c.googlers.com.notmuch>
Date: Thu, 03 Apr 2025 14:54:38 -0400
From: Willem de Bruijn <willemdebruijn.kernel@...il.com>
To: Maciej Żenczykowski <maze@...gle.com>,
Stanislav Fomichev <stfomichev@...il.com>
Cc: Willem de Bruijn <willemdebruijn.kernel@...il.com>,
bpf@...r.kernel.org,
netdev@...r.kernel.org,
ast@...nel.org,
daniel@...earbox.net,
john.fastabend@...il.com,
Willem de Bruijn <willemb@...gle.com>,
Matt Moeller <moeller.matt@...il.com>
Subject: Re: [PATCH bpf 1/2] bpf: support SKF_NET_OFF and SKF_LL_OFF on skb
frags
Maciej Żenczykowski wrote:
> On Thu, Apr 3, 2025 at 10:35 AM Stanislav Fomichev <stfomichev@...il.com> wrote:
> >
> > On 04/03, Willem de Bruijn wrote:
> > > Stanislav Fomichev wrote:
> > > > On 04/03, Willem de Bruijn wrote:
> > > > > From: Willem de Bruijn <willemb@...gle.com>
> > > > >
> > > > > Classic BPF socket filters with SKB_NET_OFF and SKB_LL_OFF fail to
> > > > > read when these offsets extend into frags.
> > > > >
> > > > > This has been observed with iwlwifi and reproduced with tun with
> > > > > IFF_NAPI_FRAGS. The below straightforward socket filter on UDP port,
> > > > > applied to a RAW socket, will silently miss matching packets.
> > > > >
> > > > > const int offset_proto = offsetof(struct ip6_hdr, ip6_nxt);
> > > > > const int offset_dport = sizeof(struct ip6_hdr) + offsetof(struct udphdr, dest);
> > > > > struct sock_filter filter_code[] = {
> > > > > BPF_STMT(BPF_LD + BPF_B + BPF_ABS, SKF_AD_OFF + SKF_AD_PKTTYPE),
> > > > > BPF_JUMP(BPF_JMP + BPF_JEQ + BPF_K, PACKET_HOST, 0, 4),
> > > > > BPF_STMT(BPF_LD + BPF_B + BPF_ABS, SKF_NET_OFF + offset_proto),
> > > > > BPF_JUMP(BPF_JMP + BPF_JEQ + BPF_K, IPPROTO_UDP, 0, 2),
> > > > > BPF_STMT(BPF_LD + BPF_H + BPF_ABS, SKF_NET_OFF + offset_dport),
> > > > >
> > > > > This is unexpected behavior. Socket filter programs should be
> > > > > consistent regardless of environment. Silent misses are
> > > > > particularly concerning as hard to detect.
> > > > >
> > > > > Use skb_copy_bits for offsets outside linear, same as done for
> > > > > non-SKF_(LL|NET) offsets.
> > > > >
> > > > > Offset is always positive after subtracting the reference threshold
> > > > > SKB_(LL|NET)_OFF, so is always >= skb_(mac|network)_offset. The sum of
> > > > > the two is an offset against skb->data, and may be negative, but it
> > > > > cannot point before skb->head, as skb_(mac|network)_offset would too.
> > > > >
> > > > > This appears to go back to when frag support was introduced to
> > > > > sk_run_filter in linux-2.4.4, before the introduction of git.
> > > > >
> > > > > The amount of code change and 8/16/32 bit duplication are unfortunate.
> > > > > But any attempt I made to be smarter saved very few LoC while
> > > > > complicating the code.
> > > > >
> > > > > Fixes: 1da177e4c3f4 ("Linux-2.6.12-rc2")
> > > > > Link: https://lore.kernel.org/netdev/20250122200402.3461154-1-maze@google.com/
> > > > > Link: https://elixir.bootlin.com/linux/2.4.4/source/net/core/filter.c#L244
> > > > > Reported-by: Matt Moeller <moeller.matt@...il.com>
> > > > > Co-developed-by: Maciej Żenczykowski <maze@...gle.com>
> > > > > Signed-off-by: Maciej Żenczykowski <maze@...gle.com>
> > > > > Signed-off-by: Willem de Bruijn <willemb@...gle.com>
> > > > > ---
> > > > > include/linux/filter.h | 3 --
> > > > > kernel/bpf/core.c | 21 ------------
> > > > > net/core/filter.c | 75 +++++++++++++++++++++++-------------------
> > > > > 3 files changed, 42 insertions(+), 57 deletions(-)
> > > > >
> > > > > diff --git a/include/linux/filter.h b/include/linux/filter.h
> > > > > index f5cf4d35d83e..708ac7e0cd36 100644
> > > > > --- a/include/linux/filter.h
> > > > > +++ b/include/linux/filter.h
> > > > > @@ -1496,9 +1496,6 @@ static inline u16 bpf_anc_helper(const struct sock_filter *ftest)
> > > > > }
> > > > > }
> > > > >
> > > > > -void *bpf_internal_load_pointer_neg_helper(const struct sk_buff *skb,
> > > > > - int k, unsigned int size);
> > > > > -
> > > > > static inline int bpf_tell_extensions(void)
> > > > > {
> > > > > return SKF_AD_MAX;
> > > > > diff --git a/kernel/bpf/core.c b/kernel/bpf/core.c
> > > > > index ba6b6118cf50..0e836b5ac9a0 100644
> > > > > --- a/kernel/bpf/core.c
> > > > > +++ b/kernel/bpf/core.c
> > > > > @@ -68,27 +68,6 @@
> > > > > struct bpf_mem_alloc bpf_global_ma;
> > > > > bool bpf_global_ma_set;
> > > > >
> > > > > -/* No hurry in this branch
> > > > > - *
> > > > > - * Exported for the bpf jit load helper.
> > > > > - */
> > > > > -void *bpf_internal_load_pointer_neg_helper(const struct sk_buff *skb, int k, unsigned int size)
> > > > > -{
> > > > > - u8 *ptr = NULL;
> > > > > -
> > > > > - if (k >= SKF_NET_OFF) {
> > > > > - ptr = skb_network_header(skb) + k - SKF_NET_OFF;
> > > > > - } else if (k >= SKF_LL_OFF) {
> > > > > - if (unlikely(!skb_mac_header_was_set(skb)))
> > > > > - return NULL;
> > > > > - ptr = skb_mac_header(skb) + k - SKF_LL_OFF;
> > > > > - }
> > > > > - if (ptr >= skb->head && ptr + size <= skb_tail_pointer(skb))
> > > > > - return ptr;
> > > > > -
> > > > > - return NULL;
> > > > > -}
> > > > > -
> > > > > /* tell bpf programs that include vmlinux.h kernel's PAGE_SIZE */
> > > > > enum page_size_enum {
> > > > > __PAGE_SIZE = PAGE_SIZE
> > > > > diff --git a/net/core/filter.c b/net/core/filter.c
> > > > > index bc6828761a47..b232b70dd10d 100644
> > > > > --- a/net/core/filter.c
> > > > > +++ b/net/core/filter.c
> > > > > @@ -221,21 +221,24 @@ BPF_CALL_3(bpf_skb_get_nlattr_nest, struct sk_buff *, skb, u32, a, u32, x)
> > > > > BPF_CALL_4(bpf_skb_load_helper_8, const struct sk_buff *, skb, const void *,
> > > > > data, int, headlen, int, offset)
> > > > > {
> > > > > - u8 tmp, *ptr;
> > > > > + u8 tmp;
> > > > > const int len = sizeof(tmp);
> > > > >
> > > > > - if (offset >= 0) {
> > > > > - if (headlen - offset >= len)
> > > > > - return *(u8 *)(data + offset);
> > > > > - if (!skb_copy_bits(skb, offset, &tmp, sizeof(tmp)))
> > > > > - return tmp;
> > > > > - } else {
> > > > > - ptr = bpf_internal_load_pointer_neg_helper(skb, offset, len);
> > > > > - if (likely(ptr))
> > > > > - return *(u8 *)ptr;
> > > >
> > > > [..]
> > > >
> > > > > + if (offset < 0) {
> > > > > + if (offset >= SKF_NET_OFF)
> > > > > + offset += skb_network_offset(skb) - SKF_NET_OFF;
> > > > > + else if (offset >= SKF_LL_OFF && skb_mac_header_was_set(skb))
> > > > > + offset += skb_mac_offset(skb) - SKF_LL_OFF;
> > > > > + else
> > > > > + return -EFAULT;
> > > > > }
> > > >
> > > > nit: we now repeat the same logic three times, maybe still worth it to put it
> > > > into a helper? bpf_resolve_classic_offset or something.
> > >
> > > I definitely tried this in various ways. But since the core logic is
> > > only four lines and there is an early return on error, no helper
> > > really simplifies anything. It just adds a layer of indirection and
> > > more code in the end.
> >
> > More code, but at least it de-duplicates the logic of translating
> > SKF_XXX_OFF? Something like the following below, but yeah, a matter
> > of preference, up to you.
I see your point. No strong opinion from me. Will revise,
assuming you don't mind the workaround below:
> > static int bpf_skb_resolve_offset(skb, offset) {
> > if (offset >= 0)
> > return offset;
> >
> > if (offset >= SKF_NET_OFF)
> > offset += skb_network_offset(skb) - SKF_NET_OFF;
> > else if (offset >= SKF_LL_OFF && skb_mac_header_was_set(skb))
> > offset += skb_mac_offset(skb) - SKF_LL_OFF;
> >
> > return -1;
> > }
> >
> > BPF_CALL_4(bpf_skb_load_helper_8, const struct sk_buff *, skb, const void *,
> > data, int, headlen, int, offset)
> > {
> > offset = bpf_skb_resolve_offset(skb, offset);
> > if (offset < 0)
> > return -EFAULT;
>
> this is incorrect, as offset can be legally negative here.
Yeah, this needs a special case like INT_MIN to communicate error,
or pass-by-value. Exactly the kind of workarounds that gave me pause.
Powered by blists - more mailing lists