bpf: Batch call_rcu callbacks instead of SLAB_TYPESAFE_BY_RCU.
authorAlexei Starovoitov <ast@kernel.org>
Fri, 2 Sep 2022 21:10:51 +0000 (14:10 -0700)
committerDaniel Borkmann <daniel@iogearbox.net>
Mon, 5 Sep 2022 13:33:06 +0000 (15:33 +0200)
commit8d5a8011b35d387c490a5c977b1d9eb4798aa071
tree83f515cd987e8a9209f74a1941cc12df0fa0cb71
parent7c266178aa51dd2d4fda1312c5990a8a82c83d70
bpf: Batch call_rcu callbacks instead of SLAB_TYPESAFE_BY_RCU.

SLAB_TYPESAFE_BY_RCU makes kmem_caches non mergeable and slows down
kmem_cache_destroy. All bpf_mem_cache are safe to share across different maps
and programs. Convert SLAB_TYPESAFE_BY_RCU to batched call_rcu. This change
solves the memory consumption issue, avoids kmem_cache_destroy latency and
keeps bpf hash map performance the same.

Signed-off-by: Alexei Starovoitov <ast@kernel.org>
Signed-off-by: Daniel Borkmann <daniel@iogearbox.net>
Acked-by: Kumar Kartikeya Dwivedi <memxor@gmail.com>
Acked-by: Andrii Nakryiko <andrii@kernel.org>
Link: https://lore.kernel.org/bpf/20220902211058.60789-10-alexei.starovoitov@gmail.com
kernel/bpf/memalloc.c
kernel/bpf/syscall.c