Thread (71 messages) 71 messages, 13 authors, 2011-05-11

Re: [BUG] fatal hang untarring 90GB file, possibly writeback related.

From: James Bottomley <hidden>
Date: 2011-05-02 20:04:55
Also in: linux-fsdevel, lkml

On Fri, 2011-04-29 at 13:02 -0500, James Bottomley wrote:
On Fri, 2011-04-29 at 11:31 -0500, James Bottomley wrote:
quoted
On Fri, 2011-04-29 at 10:37 -0500, James Bottomley wrote:
quoted
On Fri, 2011-04-29 at 12:23 +0200, Sedat Dilek wrote:
quoted
But as I see these RCU (CPU) stalls, the patch from [1] might be worth a try.
First, I have seen negative effects on my UP-system was when playing
with linux-next [2].
It was not clear what the origin was and the the side-effects were
somehow "bizarre".
The issue could be easily reproduced by tar-ing the kernel build-dir
to an external USB-hdd.
The issue kept RCU and TIP folks really busy.
Before stepping 4 weeks in the dark, give it a try and let me know in
case of success.
Well, it's highly unlikely because that's a 2.6.39 artifact and the bug
showed up in 2.6.38 ... I tried it just in case with no effect, so we
know it isn't the cause.
Actually, I tell a lie: it does't stop kswapd spinning on PREEMPT, but
it does seem to prevent non-PREEMPT from locking up totally (at least it
survives three back to back untar runs).

It's probable it alters the memory pin conditions that cause the spin,
so it's masking the problem rather than fixing it.
Confirmed ... it's just harder to reproduce with the hrtimers init fix.
The problem definitely still exists (I had to load up the system more
before doing the tar).

This time I've caught kswapd in mem_cgroup_shrink_node_zone.  sysrq-w
doesn't complete for an unknown reason
As a follow on to this, there's a shrink_zone(0, ...) in the cgroup
path.  This causes it to scan all memory exhaustively (generating quite
a lot of work).  The comment above it implies it's some type of hack for
cgroup accounting, but reducing it to DEF_PRIORITY makes the hang go
away (verified on both 2.6.39-rc4 and 2.6.38.4).  Note that I still get
soft lockups in kswapd0, but they no longer hang the box.  I'll prepare
a patch for the next round of debate.

James


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help