Donate to e Foundation | Murena handsets with /e/OS | Own a part of Murena! Learn more

Commit dc879175 authored by Lai Jiangshan's avatar Lai Jiangshan Committed by Paul E. McKenney
Browse files

rcu: Improve srcu_readers_active_idx()'s cache locality 



Expand the calls to srcu_readers_active_idx() from srcu_readers_active()
inline.  This change improves cache locality by interating over the CPUs
once rather than twice.

Signed-off-by: default avatarLai Jiangshan <laijs@cn.fujitsu.com>
Signed-off-by: default avatarPaul E. McKenney <paulmck@linux.vnet.ibm.com>
parent 966f58c2

kernel/srcu.c

+8 −1
Original line number Diff line number Diff line
@@ -193,7 +193,14 @@ static bool srcu_readers_active_idx_check(struct srcu_struct *sp, int idx) 
 */

static int srcu_readers_active(struct srcu_struct *sp)

{

	return srcu_readers_active_idx(sp, 0) + srcu_readers_active_idx(sp, 1);

	int cpu;

	unsigned long sum = 0;



	for_each_possible_cpu(cpu) {

		sum += ACCESS_ONCE(per_cpu_ptr(sp->per_cpu_ref, cpu)->c[0]);

		sum += ACCESS_ONCE(per_cpu_ptr(sp->per_cpu_ref, cpu)->c[1]);

	}

	return sum;

}



/**