Paul E. McKenney 3a19b46a5c rcu: Check cond_resched_rcu_qs() state less often to reduce GP overhead
Commit 4a81e8328d37 ("rcu: Reduce overhead of cond_resched() checks
for RCU") moved quiescent-state generation out of cond_resched()
and commit bde6c3aa9930 ("rcu: Provide cond_resched_rcu_qs() to force
quiescent states in long loops") introduced cond_resched_rcu_qs(), and
commit 5cd37193ce85 ("rcu: Make cond_resched_rcu_qs() apply to normal RCU
flavors") introduced the per-CPU rcu_qs_ctr variable, which is frequently
polled by the RCU core state machine.

This frequent polling can increase grace-period rate, which in turn
increases grace-period overhead, which is visible in some benchmarks
(for example, the "open1" benchmark in Anton Blanchard's "will it scale"
suite).  This commit therefore reduces the rate at which rcu_qs_ctr
is polled by moving that polling into the force-quiescent-state (FQS)
machinery, and by further polling it only after the grace period has
been in effect for at least jiffies_till_sched_qs jiffies.

Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
Reviewed-by: Josh Triplett <josh@joshtriplett.org>
2017-01-23 11:44:18 -08:00
..
2016-12-25 17:21:22 +01:00
2016-12-25 17:21:22 +01:00
2016-11-25 16:25:52 -05:00
2016-12-26 17:30:24 -08:00
2016-12-25 17:21:22 +01:00
2016-08-05 09:00:54 -04:00
2016-12-12 18:55:06 -08:00
2016-02-16 13:04:58 -05:00
2016-05-27 15:26:11 -07:00
2016-12-25 17:21:22 +01:00
2016-03-01 20:36:56 +01:00
2016-12-22 22:58:37 -05:00
2016-09-22 20:00:36 -05:00