x86/percpu: Introduce %rip-relative addressing to PER_CPU_VAR()
authorUros Bizjak <ubizjak@gmail.com>
Tue, 17 Oct 2023 16:27:34 +0000 (18:27 +0200)
committerIngo Molnar <mingo@kernel.org>
Fri, 20 Oct 2023 10:19:51 +0000 (12:19 +0200)
commit59bec00ace28d565ae0a68b23063ef3b961d82d5
treebfe2316d321a1703e7508c438d5290fd9ab30065
parentaa47f90cd4331e1809d56c72fcbdbbe0a85e5992
x86/percpu: Introduce %rip-relative addressing to PER_CPU_VAR()

Introduce x86_64 %rip-relative addressing to the PER_CPU_VAR() macro.
Instructions using %rip-relative address operand are one byte shorter
than their absolute address counterparts and are also compatible with
position independent executable (-fpie) builds. The patch reduces
code size of a test kernel build by 150 bytes.

The PER_CPU_VAR() macro is intended to be applied to a symbol and should
not be used with register operands. Introduce the new __percpu macro and
use it in cmpxchg{8,16}b_emu.S instead.

Also add a missing function comment to this_cpu_cmpxchg8b_emu().

No functional changes intended.

Signed-off-by: Uros Bizjak <ubizjak@gmail.com>
Signed-off-by: Ingo Molnar <mingo@kernel.org>
Cc: linux-kernel@vger.kernel.org
Cc: Brian Gerst <brgerst@gmail.com>
Cc: H. Peter Anvin <hpa@zytor.com>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Sean Christopherson <seanjc@google.com>
arch/x86/include/asm/percpu.h
arch/x86/lib/cmpxchg16b_emu.S
arch/x86/lib/cmpxchg8b_emu.S