iv/linux
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
linux/kernel/sched
History
Chengming Zhou b2788f6d49 sched/cpuacct: Optimize away RCU read lock 
commit dc6e0818bc9a0336d9accf3ea35d146d72aa7a18 upstream.

Since cpuacct_charge() is called from the scheduler update_curr(),
we must already have rq lock held, then the RCU read lock can
be optimized away.

And do the same thing in it's wrapper cgroup_account_cputime(),
but we can't use lockdep_assert_rq_held() there, which defined
in kernel/sched/sched.h.

Suggested-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Signed-off-by: Chengming Zhou <zhouchengming@bytedance.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Link: https://lore.kernel.org/r/20220220051426.5274-2-zhouchengming@bytedance.com
[OP: adjusted lockdep_assert_rq_held() -> lockdep_assert_held()]
Signed-off-by: Ovidiu Panait <ovidiu.panait@windriver.com>
Signed-off-by: Sasha Levin <sashal@kernel.org>
2023-10-10 21:53:33 +02:00
..
autogroup.c
…
autogroup.h
…
clock.c
sched/clock: Use static_branch_likely() with sched_clock_running
2019-11-29 08:10:54 +01:00
completion.c
completion: Use lockdep_assert_RT_in_threaded_ctx() in complete_all()
2020-03-23 18:40:25 +01:00
core.c
cgroup/cpuset: Free DL BW in case can_attach() fails
2023-08-30 16:23:18 +02:00
cpuacct.c
sched/cpuacct: Optimize away RCU read lock
2023-10-10 21:53:33 +02:00
cpudeadline.c
sched/deadline: Implement fallback mechanism for !fit case
2020-06-15 14:10:05 +02:00
cpudeadline.h
…
cpufreq_schedutil.c
cpufreq: schedutil: Use kobject release() method to free sugov_tunables
2021-10-06 15:55:45 +02:00
cpufreq.c
cpufreq: Avoid leaving stale IRQ work items during CPU offline
2019-12-12 17:59:43 +01:00
cpupri.c
sched/rt: cpupri_find: Trigger a full search as fallback
2020-03-20 13:06:20 +01:00
cpupri.h
sched/rt: Optimize cpupri_find() on non-heterogenous systems
2020-03-06 12:57:27 +01:00
cputime.c
cputime, cpuacct: Include guest time in user time in cpuacct.stat
2022-01-27 10:54:25 +01:00
deadline.c
sched/deadline: Create DL BW alloc, free & check overflow interface
2023-08-30 16:23:18 +02:00
debug.c
sched/debug: Remove mpol_get/put and task_lock/unlock from sched_show_numa
2022-04-08 14:40:03 +02:00
fair.c
sched/fair: Don't balance task to its current running CPU
2023-07-27 08:44:37 +02:00
features.h
sched,fair: Alternative sched_slice()
2021-05-11 14:47:31 +02:00
idle.c
sched/idle: Make the idle timer expire in hard interrupt context
2021-09-26 14:09:02 +02:00
isolation.c
isolcpus: Affine unbound kernel threads to housekeeping cpus
2020-06-15 14:10:03 +02:00
loadavg.c
sched: nohz: stop passing around unused "ticks" parameter.
2020-07-22 10:22:04 +02:00
Makefile
kcsan: Improve various small stylistic details
2019-11-20 10:47:23 +01:00
membarrier.c
kernel: delete repeated words in comments
2022-02-01 17:25:45 +01:00
pelt.c
sched: Add a tracepoint to track rq->nr_running
2020-07-08 11:39:02 +02:00
pelt.h
sched/fair: Fix cfs_rq_clock_pelt() for throttled cfs_rq
2022-06-09 10:21:02 +02:00
psi.c
sched/psi: Fix use-after-free in ep_remove_wait_queue()
2023-02-22 12:55:56 +01:00
rt.c
sched/rt: pick_next_rt_entity(): check list_entry
2023-03-11 16:39:16 +01:00
sched-pelt.h
…
sched.h
sched/deadline: Create DL BW alloc, free & check overflow interface
2023-08-30 16:23:18 +02:00
smp.h
sched/headers: Split out open-coded prototypes into kernel/sched/smp.h
2020-05-28 11:03:20 +02:00
stats.c
…
stats.h
psi: Move PF_MEMSTALL out of task->flags
2020-03-20 13:06:19 +01:00
stop_task.c
treewide: Convert macro and uses of __section(foo) to __section("foo")
2020-10-25 14:51:49 -07:00
swait.c
sched/swait: Prepare usage in completions
2020-03-21 16:00:23 +01:00
topology.c
sched/topology: Fix sched_domain_topology_level alloc in sched_init_numa()
2022-03-08 19:09:34 +01:00
wait_bit.c
sched/wait: fix ___wait_var_event(exclusive)
2019-12-17 13:32:50 +01:00
wait.c
wait: add wake_up_pollfree()
2021-12-14 11:32:39 +01:00