iv/linux
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
linux/kernel/sched
History
Chengming Zhou dc86aba751 sched/psi: Cache parent psi_group to speed up group iteration 
We use iterate_groups() to iterate each level psi_group to update
PSI stats, which is a very hot path.

In current code, iterate_groups() have to use multiple branches and
cgroup_parent() to get parent psi_group for each level, which is not
very efficient.

This patch cache parent psi_group in struct psi_group, only need to get
psi_group of task itself first, then just use group->parent to iterate.

Signed-off-by: Chengming Zhou <zhouchengming@bytedance.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Acked-by: Johannes Weiner <hannes@cmpxchg.org>
Link: https://lore.kernel.org/r/20220825164111.29534-10-zhouchengming@bytedance.com
2022-09-09 11:08:33 +02:00
..
autogroup.c
sched/autogroup: Fix sysctl move
2022-05-30 12:36:36 +02:00
autogroup.h
sched/headers: Add header guard to kernel/sched/stats.h and kernel/sched/autogroup.h
2022-02-23 08:22:00 +01:00
build_policy.c
sched: Fix missing prototype warnings
2022-05-01 10:03:43 +02:00
build_utility.c
sched: Fix missing prototype warnings
2022-05-01 10:03:43 +02:00
clock.c
sched/clock: Use try_cmpxchg64 in sched_clock_{local,remote}
2022-05-19 23:46:09 +02:00
completion.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
core_sched.c
sched/core: Fix the bug that task won't enqueue into core tree when update cookie
2022-07-21 10:39:39 +02:00
core.c
sched/psi: Add PSI_IRQ to track IRQ/SOFTIRQ pressure
2022-09-09 11:08:32 +02:00
cpuacct.c
Merge branch 'sched/fast-headers' into sched/core
2022-03-15 09:05:05 +01:00
cpudeadline.c
sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
cpudeadline.h
…
cpufreq_schedutil.c
sched, drivers: Remove max param from effective_cpu_util()/sched_cpu_util()
2022-06-28 09:17:46 +02:00
cpufreq.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
cpupri.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
cpupri.h
sched/cpupri: Add CPUPRI_HIGHER
2020-10-29 11:00:30 +01:00
cputime.c
sched/core: add forced idle accounting for cgroups
2022-07-04 09:23:07 +02:00
deadline.c
This cycle's scheduler updates for v6.0 are:
2022-08-01 11:49:06 -07:00
debug.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
fair.c
sched/fair: fix case with reduced capacity CPU
2022-07-13 11:29:17 +02:00
features.h
sched/fair: Introduce SIS_UTIL to search idle CPU based on sum of util_avg
2022-06-28 09:08:30 +02:00
idle.c
context_tracking: Take idle eqs entrypoints over RCU
2022-07-05 13:32:16 -07:00
isolation.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
loadavg.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
Makefile
sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
membarrier.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
pelt.c
sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
pelt.h
sched/fair: Decay task PELT values during wakeup migration
2022-06-28 09:17:46 +02:00
psi.c
sched/psi: Cache parent psi_group to speed up group iteration
2022-09-09 11:08:33 +02:00
rt.c
nohz/full, sched/rt: Fix missed tick-reenabling bug in dequeue_task_rt()
2022-07-21 10:39:38 +02:00
sched-pelt.h
sched/fair: Fix "runnable_avg_yN_inv" not used warnings
2019-06-17 12:15:58 +02:00
sched.h
Various fixes: a deadline scheduler fix, a migration fix, a Sparse fix and a comment fix.
2022-08-06 17:34:06 -07:00
smp.h
smp: Rename flush_smp_call_function_from_idle()
2022-05-01 10:03:43 +02:00
stats.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
stats.h
sched/psi: Add PSI_IRQ to track IRQ/SOFTIRQ pressure
2022-09-09 11:08:32 +02:00
stop_task.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
swait.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00
topology.c
sched/numa: Adjust imb_numa_nr to a better approximation of memory channels
2022-06-13 10:30:00 +02:00
wait_bit.c
wait_on_bit: add an acquire memory barrier
2022-08-26 09:30:25 -07:00
wait.c
sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there
2022-02-23 10:58:33 +01:00