Thread (23 messages) 23 messages, 3 authors, 2011-08-18

Re: [PATCH RFC] memcg: fix drain_all_stock crash

From: Michal Hocko <hidden>
Date: 2011-08-10 07:30:02
Also in: lkml

On Wed 10-08-11 08:54:37, KAMEZAWA Hiroyuki wrote:
On Tue, 9 Aug 2011 13:46:42 +0200
Michal Hocko [off-list ref] wrote:
quoted
On Tue 09-08-11 19:07:25, KAMEZAWA Hiroyuki wrote:
quoted
On Tue, 9 Aug 2011 12:09:44 +0200
Michal Hocko [off-list ref] wrote:
quoted
On Tue 09-08-11 18:53:13, KAMEZAWA Hiroyuki wrote:
quoted
On Tue, 9 Aug 2011 11:45:03 +0200
Michal Hocko [off-list ref] wrote:
quoted
On Tue 09-08-11 18:32:16, KAMEZAWA Hiroyuki wrote:
quoted
On Tue, 9 Aug 2011 11:31:50 +0200
Michal Hocko [off-list ref] wrote:
quoted
What do you think about the half backed patch bellow? I didn't manage to
test it yet but I guess it should help. I hate asymmetry of drain_lock
locking (it is acquired somewhere else than it is released which is
not). I will think about a nicer way how to do it.
Maybe I should also split the rcu part in a separate patch.

What do you think?

I'd like to revert 8521fc50 first and consider total design change
rather than ad-hoc fix.
Agreed. Revert should go into 3.0 stable as well. Although the global
mutex is buggy we have that behavior for a long time without any reports.
We should address it but it can wait for 3.2.
I will send the revert request to Linus.
quoted
What "buggy" means here ? "problematic" or "cause OOps ?"
I have described that in an earlier email. Consider pathological case
when CPU0 wants to async. drain a memcg which has a lot of cached charges while
CPU1 is already draining so it holds the mutex. CPU0 backs off so it has
to reclaim although we could prevent from it by getting rid of cached
charges. This is not critical though.
That problem should be fixed by background reclaim.
How? Do you plan to rework locking or the charge caching completely?
From your description, the problem is not the lock itself but a task
may go into _unnecessary_ direct-reclaim even if there are remaining
chages on per-cpu stocks, which cause latency.
The problem is partly the lock because it prevents from parallel async
reclaimers. This is too restrictive. If we are going to rely on async
draining we will have to above problem.
In (all) my automatic background reclaim tests, no direct reclaim happens
if background reclaim is enabled. 
Yes, I haven't seen this problem yet but I guess that there is non 0
chance that there is a workload which triggers this.
And as I said before, we may be able to add a flag not to cache
more. It's set by some condition ....as usage is near to the limit.

Thanks,
-Kame
Thanks
-- 
Michal Hocko
SUSE Labs
SUSE LINUX s.r.o.
Lihovarska 1060/12
190 00 Praha 9    
Czech Republic

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help