Thread (7 messages) 7 messages, 3 authors, 2011-03-29

Re: 2.6.37: Multi-second I/O latency while untarring

From: Matt <hidden>
Date: 2011-02-11 15:54:34
Also in: lkml

On Fri, Feb 11, 2011 at 3:08 PM, Andrew Lutomirski [off-list ref] wrote=
:
As I type this, I have an ssh process running that's dumping data int=
o
a fifo at high speed (maybe 500Mbps) and a tar process that's
untarring from the same fifo onto btrfs. =A0The btrfs fs is mounted -=
o
space_cache,compress. =A0This machine has 8GB ram, 8 logical cores, a=
nd
a fast (i7-2600) CPU, so it's not an issue with the machine strugglin=
g
under load.

Every few tens of seconds, my system stalls for several seconds.
These stalls cause keyboard input to be lost, firefox to hang, etc.

Setting tar's ionice priority to best effort / 7 or to idle makes no =
difference.
ionice idle and queue_depth =3D 1 on the disk (a slow 2TB WD) also ma=
kes
no difference.

max_sectors_kb =3D 64 in addition to the above doesn't help either.

latencytop shows regular instances of 2-7 *second* latency, variously
in sync_page, start_transaction, btrfs_start_ordered_extent, and
do_get_write_access (from jbd2 on my ext4 root partition).

echo 3 >drop_caches gave me 7 GB free RAM. =A0I still had stalls when
4-5 GB were still free (so it shouldn't be a problem with important
pages being evicted).

In case it matters, all of my partitions are on LVM on dm-crypt, but
this machine has AES-NI so the overhead from that should be minimal.
In fact, overall CPU usage is only about 10%.

What gives? =A0I thought this stuff was supposed to be better on mode=
rn kernels.
--Andy
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs=
" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at =A0http://vger.kernel.org/majordomo-info.html
Hi Andrew,

you could try the following patch to speed up dm-crypt:

https://patchwork.kernel.org/patch/365542/

I'm using it on top of a highly-patched 2.6.37 kernel

not sure if exactly that version was included in 2.6.38


there are some additional handles to speed up dm:

e.g. PCRYCONFIG_CRYPTO_PCRYPT=3Dy

Regards

Matt
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help