59dc5bfca0
When an interrupt is taken, the SRR registers are set to return to where it left off. Unless they are modified in the meantime, or the return address or MSR are modified, there is no need to reload these registers when returning from interrupt. Introduce per-CPU flags that track the validity of SRR and HSRR registers. These are cleared when returning from interrupt, when using the registers for something else (e.g., OPAL calls), when adjusting the return address or MSR of a context, and when context switching (which changes the return address and MSR). This improves the performance of interrupt returns. Signed-off-by: Nicholas Piggin <npiggin@gmail.com> [mpe: Fold in fixup patch from Nick] Signed-off-by: Michael Ellerman <mpe@ellerman.id.au> Link: https://lore.kernel.org/r/20210617155116.2167984-5-npiggin@gmail.com
17 lines
484 B
C
17 lines
484 B
C
// SPDX-License-Identifier: GPL-2.0+
|
|
|
|
#include <linux/error-injection.h>
|
|
#include <linux/kprobes.h>
|
|
#include <linux/uaccess.h>
|
|
|
|
void override_function_with_return(struct pt_regs *regs)
|
|
{
|
|
/*
|
|
* Emulate 'blr'. 'regs' represents the state on entry of a predefined
|
|
* function in the kernel/module, captured on a kprobe. We don't need
|
|
* to worry about 32-bit userspace on a 64-bit kernel.
|
|
*/
|
|
regs_set_return_ip(regs, regs->link);
|
|
}
|
|
NOKPROBE_SYMBOL(override_function_with_return);
|