Thread (10 messages) 10 messages, 5 authors, 2011-01-10

Re: Considering a complete rework of RAID on my home compute server

From: Mark Knecht <hidden>
Date: 2011-01-06 18:17:28

On Wed, Jan 5, 2011 at 4:03 PM, Leslie Rhorer [off-list ref] wrote:
quoted
1) The Linux/MySQL stuff is a 3 drive RAID1. (sda/sdb/sdc)
       Well, RAID1 certainly offers the most robust solution, especially
with more than 1 mirror.
<SNIP>
quoted
3) There is a second RAID1 (sda/sdb/sdc) used for backups of the
RAID0. The RAID0 is backed up to RAID1 nightly. If the RAID0 fails
then I lose 1 day's work.
       Well, first of all, unless you meant to say sda1/sdb1/sdc1, etc,
then this can't be different from the #1 RAID array above.  Assuming you are
actually using partitions, then I don't really see the value of two separate
arrays.  Why not just one RAID1 array?
Sorry I wasn't very clear.

In #1 the RAID1 is my main Linux system on sda3/sdb3/sdc3.
In #3 the RAID1 is purely for backups on /swa6/sdb6/sdc6 and is used
only for the backup of the RAID0 data. It is not normally mounted
except when doing backups. I wanted the extra protection that if
something went wrong with the basic Linux box the backup partition
would not normally be mounted and the data hopefully a bit safer.

       Also, I personally would reverse the backup strategy.  I would put
the Windows VM on the (single) main RAID array and back up the data to a
single 1T hard drive.
I do this today backing up the existing RAID1 partitions to an
external eSATA 1TB drive.
quoted
   OK - the problems I have with this arrangement are:

1) I used the older v0.9 metadata.
       This may be necessary if you are booting from the array.  The
limitations of the 0.90 superblock may never impact you.  That's a small
system with only a few drives.
quoted
2) The RAIDs are assembled by the kernel automatically. I do not use
an initrd. (Because I don't know how/newer have)
       How is that a problem?  An initrd, or lack thereof, won't prevent
you from disabling the automatic assembly of one or more arrays, unless once
again you boot from the array in question.  Most modern distros default to
using an initrd.  What distro are you using?
The machines are Gentoo and an initrd/initramfs is up to the builder.
The new RAID6/superblock-1.2  boot uses one. The RAID1/superblock-0.9
does not.
quoted
3) I think with 5 disks I could get better performance  than I
currently get , with similar or better safety using maybe RAID5 or
RAID6.
       No, RAID1 is as safe as it gets.  RAID0 allows for better
performance, but if you make the RAID0 into your backup solution, the
performance won't matter much.
If I'm wrong about RAID6 please correct me as this understanding is
why I chose it.

1) A 5-drive RAID6 can survive losing 2 disks and still return good data.

2) A 5-drive RAID6 reads data as nearly fast as a 3-drive RAID0.

If those two aren't true then my choice of RAID6 doesn't improve my
system as I hoped.

3) My current 3-drive RAID1 can lose 2 disks and still return good
data making #1 equivalent to #3

4) #2 would be faster than my current 2-drive RAID0 and wouldn't have
the risk of a single drive loss.

If #3 & #4 aren't correct then maybe RAID6 isn't buying me anything.
       Is performance a really big issue?  Are you having problems with bad
performance?
I think I am. On the current RAID0 side I'm running 4-5 Win XP VMs
doing number crunching. Each is sitting in a 20GB virtual disk which
is just files in VMWare or Virtualbox. Sometimes I run into moderate
periods of time (5-30 seconds) with disk activity lights flashing,
apparent loss of interactivity on the machine (mouse & keyboard not
responding quickly in Linux) even when the RAID1/Linux side isn't
doing anything. No cron jobs or anything like that running, just the
VMs sucking up CPU and disk. Most of the number crunching is reading
larger amounts of data, using the CPU and then writing some smallish
files out.
quoted
   Overall, as I see it, I can suffer no disk loss on the RAID0, and
can handle a 2 disk loss on the RAID1. (Is that correct?) I'm thinking
that with a 5-drive RAID6 I might well get better performance than
either of the current RAIDs and (from reading) more protection during
a rebuild if one of my drives goes bad.
       A single RAID5 or RAID6 solution is certainly simpler, and there is
significant value there.  Read performance should be enhanced, but write
performance will be impacted.  You've also lost your backup solution in this
scenario, though, so you will need to come up with something.
I have a local eSATA in my office and then a second machine in the
house with a 2-drive RAID1. I use them both for backups currently.

<SNIP>
       You might consider an external enclosure.  Enclosures for up to 5
dives are quite economical.
I will give it some thought.

Thanks!

- Mark
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help