Re: filesystems for large arrays

Dual Athlon 2000MP
3G Memory
FiberChannel qla2100 interface.
Almost 2TB
Running for about a year now with no problems.  Used for data mining development (a fair# of files).

ext3 filesystem on RAID5
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/md6             1949323256 1563695060 366125948  82% /usr6
md6 : active raid5 sdt1[12] sdl1[0] sdk1[11] sdj1[10] sdi1[9] sdh1[8] sdg1[7] sdf1[6] sde1[5] sdd1[4] sda1[3] sdc1[2] sdb1[1]
     1950225024 blocks level 5, 128k chunk, algorithm 2 [12/12] [UUUUUUUUUUUU]

Filesystem            Inodes   IUsed   IFree IUse% Mounted on
/dev/md6             6190080  401503 5788577    7% /usr6

Done 6/21/02 
Linux 2.4.19-pre10 #1 SMP Tue Jun 11 07:04:12 EDT 2002 i686 unknown
tiobench.pl --size 4000
Size is MB, BlkSz is Bytes, Read, Write, and Seeks are MB/secd . -T

         File   Block  Num  Seq Read    Rand Read   Seq Write  Rand Write
  Dir    Size   Size   Thr Rate (CPU%) Rate (CPU%) Rate (CPU%) Rate (CPU%)
------- ------ ------- --- ----------- ----------- ----------- -----------
   .     4000   4096    1  123.2 98.7% 1.090 1.25% 58.23 83.5% 2.755 2.64%
   .     4000   4096    2  116.9 94.4% 1.413 1.85% 57.80 102.% 2.759 3.09%
   .     4000   4096    4  117.3 95.9% 1.749 2.31% 56.49 104.% 2.760 3.53%
   .     4000   4096    8  116.3 96.0% 2.092 2.77% 48.26 91.1% 2.760 3.84%

----- Original Message ----- 
From: "Andy Arvai" <redacted>
To: <redacted>
Sent: Tuesday, February 11, 2003 4:25 AM
Subject: filesystems for large arrays

Hi,

Does anyone have comments about the various filesystems typically used
with large (terabyte) arrays, regarding performance and reliability?

The three most common filesystems seem to be ext3, reiser and xfs. Ext3
and reiser are part of the standard linux kernel (not sure about xfs),
implying that they are fairly robust. I've been using reiser and
haven't had any problems, but I've heard that when the filesystem gets
full there may be problems and it's also optimized for many small files
instead of larger files. Ext3 sounds like it is very robust (since it
is based on ext2), although I've heard the performance is worse than
reiser. I've heard some good things about xfs, but have never used it.

If anyone has any real-world experiences or benchmarks I would be
interested.

Andy


-
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html