Message-ID: <CANk7y0hvEu3WkYEJ5oRqRHwKGfDnM+fO0=vDen5=zO8-rCvr9Q@mail.gmail.com>
Date:   Mon, 13 Nov 2023 23:53:52 +0100
From:   Puranjay Mohan <puranjay12@...il.com>
To:     Mark Rutland <mark.rutland@....com>
Cc:     Alexei Starovoitov <ast@...nel.org>,
        Daniel Borkmann <daniel@...earbox.net>,
        Andrii Nakryiko <andrii@...nel.org>,
        Martin KaFai Lau <martin.lau@...ux.dev>,
        Song Liu <song@...nel.org>,
        Yonghong Song <yonghong.song@...ux.dev>,
        John Fastabend <john.fastabend@...il.com>,
        KP Singh <kpsingh@...nel.org>,
        Stanislav Fomichev <sdf@...gle.com>,
        Hao Luo <haoluo@...gle.com>, Jiri Olsa <jolsa@...nel.org>,
        Zi Shen Lim <zlim.lnx@...il.com>,
        Catalin Marinas <catalin.marinas@....com>,
        Will Deacon <will@...nel.org>, bpf@...r.kernel.org,
        linux-arm-kernel@...ts.infradead.org, linux-kernel@...r.kernel.org,
        Kumar Kartikeya Dwivedi <memxor@...il.com>
Subject: Re: [PATCH bpf-next v2 1/1] bpf, arm64: support exceptions

Hi Mark,

On Wed, Nov 8, 2023 at 11:32 AM Mark Rutland <mark.rutland@....com> wrote:
>
> On Mon, Nov 06, 2023 at 10:04:09AM +0100, Puranjay Mohan wrote:
> > Hi Mark,
> >
> > On Thu, Nov 2, 2023 at 5:59 PM Mark Rutland <mark.rutland@....com> wrote:
> > >
> > > On Sun, Sep 17, 2023 at 12:00:45AM +0000, Puranjay Mohan wrote:
> > > > Implement arch_bpf_stack_walk() for the ARM64 JIT. This will be used
> > > > by bpf_throw() to unwind till the program marked as exception boundary and
> > > > run the callback with the stack of the main program.
> > > >
> > > > The prologue generation code has been modified to make the callback
> > > > program use the stack of the program marked as exception boundary where
> > > > callee-saved registers are already pushed.
> > > >
> > > > As the bpf_throw function never returns, if it clobbers any callee-saved
> > > > registers, they would remain clobbered. So, the prologue of the
> > > > exception-boundary program is modified to push R23 and R24 as well,
> > > > which the callback will then recover in its epilogue.
> > > >
> > > > The Procedure Call Standard for the Arm 64-bit Architecture[1] states
> > > > that registers r19 to r28 should be saved by the callee. BPF programs on
> > > > ARM64 already save all callee-saved registers except r23 and r24. This
> > > > patch adds an instruction in prologue of the  program to save these
> > > > two registers and another instruction in the epilogue to recover them.
> > > >
> > > > These extra instructions are only added if bpf_throw() used. Otherwise
> > > > the emitted prologue/epilogue remains unchanged.
> > > >
> > > > [1] https://github.com/ARM-software/abi-aa/blob/main/aapcs64/aapcs64.rst
> > > >
> > > > Signed-off-by: Puranjay Mohan <puranjay12@...il.com>
> > > > ---
> > >
> > > [...]
> > >
> > > > +void arch_bpf_stack_walk(bool (*consume_fn)(void *cookie, u64 ip, u64 sp, u64 bp), void *cookie)
> > > > +{
> > > > +     struct stack_info stacks[] = {
> > > > +             stackinfo_get_task(current),
> > > > +     };
> > >
> > > Can bpf_throw() only be used by BPF programs that run in task context, or is it
> > > possible e.g. for those to run within an IRQ handler (or otherwise on the IRQ
> > > stack)?
> >
> > I will get back on this with more information.
> >
> > >
> > > > +
> > > > +     struct unwind_state state = {
> > > > +             .stacks = stacks,
> > > > +             .nr_stacks = ARRAY_SIZE(stacks),
> > > > +     };
> > > > +     unwind_init_common(&state, current);
> > > > +     state.fp = (unsigned long)__builtin_frame_address(1);
> > > > +     state.pc = (unsigned long)__builtin_return_address(0);
> > > > +
> > > > +     if (unwind_next_frame_record(&state))
> > > > +             return;
> > > > +     while (1) {
> > > > +             /* We only use the fp in the exception callback. Pass 0 for sp as it's unavailable*/
> > > > +             if (!consume_fn(cookie, (u64)state.pc, 0, (u64)state.fp))
> > > > +                     break;
> > > > +             if (unwind_next_frame_record(&state))
> > > > +                     break;
> > > > +     }
> > > > +}
> > >
> > > IIUC you're not using arch_stack_walk() because you need the FP in addition to
> > > the PC.
> >
> > Yes,
> >
> > > Is there any other reason you need to open-code this?
> >
> > No,
> >
> > >
> > > If not, I'd rather rework the common unwinder so that it's possible to get at
> > > the FP. I had patches for that a while back:
> > >
> > >   https://git.kernel.org/pub/scm/linux/kernel/git/mark/linux.git/log/?h=arm64/stacktrace/metadata
> > >
> > > ... and I'm happy to rebase that and pull out the minimum necessary to make
> > > that possible.
> >
> > It would be great if you can rebase and push the code, I can rebase this on
> > your work and not open code this implementation.
>
> I've rebased the core of that atop v6.6, and pushed that out to my
> arm64/stacktrace/kunwind branch:
>
>   https://git.kernel.org/pub/scm/linux/kernel/git/mark/linux.git/log/?h=arm64/stacktrace/kunwind
>
> Once v6.7-rc1 is out, I'll rebase that and post it out (possibly with some of
> the other patches atop).
>
> With that I think you can implement arch_bpf_stack_walk() in stacktrace.c using
> kunwind_stack_walk() in a similar way to how arch_stack_walk() is implemented
> in that branch.
>
> If BPF only needs a single consume_fn, that can probably be even simpler as you
> won't need a struct to hold the consume_fn and cookie value.

Thanks for the help.
I am planning to do something like the following:
let me know if this can be done in a better way:

+struct bpf_unwind_consume_entry_data {
+       bool (*consume_entry)(void *cookie, u64 ip, u64 sp, u64 fp);
+       void *cookie;
+};
+
+static bool
+arch_bpf_unwind_consume_entry (const struct kunwind_state *state, void *cookie)
+{
+       struct bpf_unwind_consume_entry_data *data = cookie;
+       return data->consume_entry(data->cookie, state->common.pc, 0,
state->common.fp);
+}
+
+noinline noinstr void arch_bpf_stack_walk(bool (*consume_entry)(void
*cookie, u64 ip, u64 sp,
+                                         u64 fp), void *cookie)
+{
+       struct bpf_unwind_consume_entry_data data = {
+               .consume_entry = consume_entry,
+               .cookie = cookie,
+       };

I need to get the task and regs here so it can work from all contexts.
How can I do it?

+
+       kunwind_stack_walk(arch_bpf_unwind_consume_entry, &data, task, regs);
+}


>
> Mark.



Thanks,
Puranjay

Powered by blists - more mailing lists