Thread (1 message) 1 message, 1 author, 2020-12-28

Re: [v2 PATCH 3/9] mm: vmscan: guarantee shrinker_slab_memcg() sees valid shrinker_maps for online memcg

From: Yang Shi <hidden>
Date: 2020-12-28 23:18:11
Also in: linux-fsdevel, lkml

I think Johannes's point makes sense to me. If the shrinker_maps is
not initialized yet it means the memcg is too young to have a number
of reclaimable slab caches. It sounds fine to just skip it.

And, with consolidating shrinker_maps and shrinker_deferred into one
struct, we could just check the pointer of the struct. So, it seems
this patch is not necessary anymore. This patch will be dropped in v3.

On Tue, Dec 15, 2020 at 12:31 PM Yang Shi [off-list ref] wrote:
On Tue, Dec 15, 2020 at 9:16 AM Johannes Weiner [off-list ref] wrote:
quoted
On Mon, Dec 14, 2020 at 02:37:16PM -0800, Yang Shi wrote:
quoted
The shrink_slab_memcg() races with mem_cgroup_css_online(). A visibility of CSS_ONLINE flag
in shrink_slab_memcg()->mem_cgroup_online() does not guarantee that we will see
memcg->nodeinfo[nid]->shrinker_maps != NULL.  This may occur because of processor reordering
on !x86.

This seems like the below case:

           CPU A          CPU B
store shrinker_map      load CSS_ONLINE
store CSS_ONLINE        load shrinker_map
But we have a separate check on shrinker_maps, so it doesn't matter
that it isn't guaranteed, no?
IIUC, yes. Checking shrinker_maps is the alternative way to detect the
reordering to prevent from seeing NULL shrinker_maps per Kirill.

We could check shrinker_deferred too, then just walk away if it is NULL.
quoted
The only downside I can see is when CSS_ONLINE isn't visible yet and
we bail even though we'd be ready to shrink. Although it's probably
unlikely that there would be any objects allocated already...
Yes, it seems so.
quoted
Can somebody remind me why we check mem_cgroup_online() at all?
IIUC it should be mainly used to skip offlined memcgs since there is
nothing on offlined memcgs' LRU because all objects have been
reparented. But shrinker_map won't be freed until .css_free is called.
So the shrinkers might be called in vain.
quoted
If shrinker_map is set, we can shrink: .css_alloc is guaranteed to be
complete, and by using RCU for the shrinker_map pointer, the map is
also guaranteed to be initialized. There is nothing else happening
during onlining that you may depend on.

If shrinker_map isn't set, we cannot iterate the bitmap. It does not
really matter whether CSS_ONLINE is reordered and visible already.
As I mentioned above it should be used to skip offlined memcgs, but it
also opens the race condition due to memory reordering. As Kirill
explained in the earlier email, we could either check the pointer or
use memory barriers.

If the memory barriers seems overkilling, I could definitely switch
back to NULL pointer check approach.
quoted
Agreed with Dave: if we need that synchronization around onlining, it
needs to happen inside the cgroup core. But I wouldn't add that until
somebody actually required it.
  
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help