[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-Id: <20220319173036.23352-7-laoar.shao@gmail.com>
Date: Sat, 19 Mar 2022 17:30:28 +0000
From: Yafang Shao <laoar.shao@...il.com>
To: roman.gushchin@...ux.dev, ast@...nel.org, daniel@...earbox.net,
andrii@...nel.org, kafai@...com, songliubraving@...com, yhs@...com,
john.fastabend@...il.com, kpsingh@...nel.org, shuah@...nel.org
Cc: netdev@...r.kernel.org, bpf@...r.kernel.org,
linux-kselftest@...r.kernel.org, Yafang Shao <laoar.shao@...il.com>
Subject: [PATCH 06/14] bpf: Allow no charge for allocation not at map creation time
Below three functions are used for memory allocation which is not at
map creation time,
- bpf_map_kmalloc_node()
- bpf_map_kzalloc()
- bpf_map_alloc_percpu()
For this kind of path, we can get the no charge flag from bpf_map
struct we set before.
Signed-off-by: Yafang Shao <laoar.shao@...il.com>
---
kernel/bpf/syscall.c | 8 +++++---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/kernel/bpf/syscall.c b/kernel/bpf/syscall.c
index add3b4045b4d..e84aeefa05f4 100644
--- a/kernel/bpf/syscall.c
+++ b/kernel/bpf/syscall.c
@@ -434,7 +434,8 @@ void *bpf_map_kmalloc_node(const struct bpf_map *map, size_t size, gfp_t flags,
void *ptr;
old_memcg = set_active_memcg(map->memcg);
- ptr = kmalloc_node(size, flags | __GFP_ACCOUNT, node);
+ ptr = kmalloc_node(size, bpf_flags_no_charge(flags, map->no_charge),
+ node);
set_active_memcg(old_memcg);
return ptr;
@@ -446,7 +447,7 @@ void *bpf_map_kzalloc(const struct bpf_map *map, size_t size, gfp_t flags)
void *ptr;
old_memcg = set_active_memcg(map->memcg);
- ptr = kzalloc(size, flags | __GFP_ACCOUNT);
+ ptr = kzalloc(size, bpf_flags_no_charge(flags, map->no_charge));
set_active_memcg(old_memcg);
return ptr;
@@ -459,7 +460,8 @@ void __percpu *bpf_map_alloc_percpu(const struct bpf_map *map, size_t size,
void __percpu *ptr;
old_memcg = set_active_memcg(map->memcg);
- ptr = __alloc_percpu_gfp(size, align, flags | __GFP_ACCOUNT);
+ ptr = __alloc_percpu_gfp(size, align,
+ bpf_flags_no_charge(flags, map->no_charge));
set_active_memcg(old_memcg);
return ptr;
--
2.17.1
Powered by blists - more mailing lists