Green drives and RAID arrays with partity

Started by Marcin M. Jessa on Sep 25, 2011 · 10 messages from 4 authors · Last reply Sep 26, 2011

open the first message on its own page

Message details and related content
Hi guys.

I was wondering if it's safe to use so called green drives in RAID 5 or RAID 6 with md?
Drive such as Seagate Barracuda® Green 2TB ST2000DL003 or Western Digital Caviar® Green™ 2TB WD20EARX have TLER off and reading misc forums I understand that it would be a good idea to buy drives with that option available.
On the other hand some people claim that Linux/Solaris/BSD based software RAID may be able to work just fine with these drives.



-- 

Marcin M. Jessa
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Message details and related content
On 25 September 2011 12:02, Marcin M. Jessa [off-list ref] wrote:
Hi guys.

I was wondering if it's safe to use so called green drives in RAID 5 or RAID
6 with md?
Drive such as Seagate Barracuda® Green 2TB ST2000DL003 or Western Digital
Caviar® Green™ 2TB WD20EARX have TLER off and reading misc forums I
understand that it would be a good idea to buy drives with that option
available.
On the other hand some people claim that Linux/Solaris/BSD based software
RAID may be able to work just fine with these drives.



--

Marcin M. Jessa
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
My 5x WD20EARS and 2x HD204UI (I think they're called? Samsung 2TB)
are "green drives" and they work fine in a RAID6 setup.

/M
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Message details and related content
On 9/25/2011 6:02 AM, Marcin M. Jessa wrote:
Hi guys.

I was wondering if it's safe to use so called green drives in RAID 5 or
RAID 6 with md?
Drive such as Seagate Barracuda® Green 2TB ST2000DL003 or Western
Digital Caviar® Green™ 2TB WD20EARX have TLER off and reading misc
forums I understand that it would be a good idea to buy drives with that
option available.
On the other hand some people claim that Linux/Solaris/BSD based
software RAID may be able to work just fine with these drives.
That won't make a lick of difference if you attach them to a crappy HBA/RAID card or mobo down chip, and/or with a buggy driver, or plug them into a crappy backplane.  Note the recent discussion of the SuperMicro/Marvell HBA, mvsas driver problems.

When you have a problem such as yours, and you ask for help on this, or any other Linux kernel list, it's a really good idea to post all of the relevant information up front.  Why?  Because most often when drives drop out of arrays it is not because a disk failed or the disk has buggy firmware.  It's most often because of problems elsewhere in the storage stack, either hardware or software.

Crappy HBAs and/or drivers, loose or dislodged cable connectors, and crappy active/passive backplanes are the primary movers when it comes to good drives dropping out of arrays.

That said, assuming you have a good SAS/SATA ASIC/driver combo and stable backplane, etc, I'd say buy the WD RE4 or Seagate Constellation ES as they have 5 year warranties, TLER, all the good stuff for RAID use.  Which is why they are sold as "enterprise" drives and cost more than consumer cheapos like the various Green "drives".  Both the RE4 2TB and Constellation ES 2TB are $200 each at Newegg.  Unless you actually *need* that much total space, I'd go with the 1TB models, paying ~half the cost of the 2TB drives.  The 1TB Constellation ES is $110.  So with 5 drives you'll save almost $500 on drives, with 4TB usable space with RAID5.

Again, I implore you to investigate all other portions of your storage stack before blowing money on drives, which may not be the cause of your problem.

-- 
Stan


--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Message details and related content
On 9/25/11 1:43 PM, Stan Hoeppner wrote:

[...]
When you have a problem such as yours, and you ask for help on this, or
any other Linux kernel list, it's a really good idea to post all of the
relevant information up front. Why? Because most often when drives drop
out of arrays it is not because a disk failed or the disk has buggy
firmware. It's most often because of problems elsewhere in the storage
stack, either hardware or software.
I wasn't sure which information I should attach and I did not want to spam the list. I was hoping someone would tell me if some of the relevant information was missing so I could send it when needed.
Could you please tell me what kind of data was missing?
Crappy HBAs and/or drivers, loose or dislodged cable connectors, and
crappy active/passive backplanes are the primary movers when it comes to
good drives dropping out of arrays.
In my case I don't use any HW Raid.
My motherboard is a MSI 870A-G54 - http://www.msi.com/product/mb/870A-G54.html and I only use SATA and software RAID.
Again, I implore you to investigate all other portions of your storage
stack before blowing money on drives, which may not be the cause of your
problem.
It's really hard to find the source of the failure.
My first assumption was the drives, since I have 5 more (different) HDs connected to the board, two in RAID 1 (ATA drives) and they all work flawlessly.
Reading feedbacks from all the people complaining about the same issue with the SEAGATE drives as I have I automatically assumed there is a problems with these particular disks.


-- 

Marcin M. Jessa
Message details and related content
On 09/25/2011 07:02 AM, Marcin M. Jessa wrote:
Hi guys.

I was wondering if it's safe to use so called green drives in RAID 5 or
RAID 6 with md?
You might need to turn off TLER and their power spin-down features, but in general, they *should* work ok.  Modulo any firmware issues (staring intently at WD).  We don't use Western Digital drives anymore due to ... er ... profound high failure rates we've observed in the field.  These may or may not be connected to "greenness".  They are definitely connected to buggy firmware (this is on enterprise and consumer drives, used across a fairly wide swath of use cases).

Your mileage may vary (e.g. you might have different experiences).  We wouldn't recommend them.
Drive such as Seagate Barracuda® Green 2TB ST2000DL003 or Western
Digital Caviar® Green™ 2TB WD20EARX have TLER off and reading misc
forums I understand that it would be a good idea to buy drives with that
option available.
TLER and the power spindown option are good things to be able to turn off.  Otherwise you need to have a way for the MD device to deal with a spun-down set of drives.  I am not sure support is there for this right now ... I could be wrong, I've just not seen it.

This said, spinning up and down drives is actually more stressful for the electronics and motor.  Better to leave them in one state whenever possible.  I can't remember the study I saw on this, but about a year ago I saw a quietly published correlation between drive failures and number of spinup/spindown cycles.  My memory might be off on it, so feel free to look for yourself (and don't rely upon my likely faulty memory).
On the other hand some people claim that Linux/Solaris/BSD based
software RAID may be able to work just fine with these drives.
If the drives don't try to be "smart" and do "smart things" (powerdown, unlimited Herculean error recovery, massive sector remapping that takes it out of service for more than 60 seconds), yeah, they should "just work".  If you have a barrel full of these drives and need to use them, by all means, just turn off the "smart" features.

OTOH, if you are buying new drives, steer clear of them.


-- 
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: landman@scalableinformatics.com
web  : http://scalableinformatics.com
       http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax  : +1 866 888 3112
cell : +1 734 612 4615
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Message details and related content
On 9/25/2011 9:28 AM, Marcin M. Jessa wrote:
On 9/25/11 1:43 PM, Stan Hoeppner wrote:

[...]
quoted
When you have a problem such as yours, and you ask for help on this, or
any other Linux kernel list, it's a really good idea to post all of the
relevant information up front. Why? Because most often when drives drop
out of arrays it is not because a disk failed or the disk has buggy
firmware. It's most often because of problems elsewhere in the storage
stack, either hardware or software.
I wasn't sure which information I should attach and I did not want to
spam the list. I was hoping someone would tell me if some of the
relevant information was missing so I could send it when needed.
Could you please tell me what kind of data was missing?
quoted
Crappy HBAs and/or drivers, loose or dislodged cable connectors, and
crappy active/passive backplanes are the primary movers when it comes to
good drives dropping out of arrays.
In my case I don't use any HW Raid.
My motherboard is a MSI 870A-G54 -
http://www.msi.com/product/mb/870A-G54.html and I only use SATA and
software RAID.
quoted
Again, I implore you to investigate all other portions of your storage
stack before blowing money on drives, which may not be the cause of your
problem.
It's really hard to find the source of the failure.
My first assumption was the drives, since I have 5 more (different) HDs
connected to the board, two in RAID 1 (ATA drives) and they all work
flawlessly.
Reading feedbacks from all the people complaining about the same issue
with the SEAGATE drives as I have I automatically assumed there is a
problems with these particular disks.
Are the drives screwed into the case's internal drive cage?  Directly connected to the motherboard SATA ports with cables?  Or, do you have the drives mounted in any kind of SATA hot/cold swap cage?  The cheap ones of these are notorious for causing exactly the kind of drop outs you've experienced.  Post a link to your case and any drive related peripherals.

Did you suffer a power event?  I.e. a sag, brown out?  Is the system connected to a good quality working UPS?

Something else you should always mention:  How long did it all "just work" before having problems?  A few hours?  Days?  Weeks?  Months?  Had you made any hardware changes to the system recently before the failure event?  If so what?  Did you upgrade your kernel/drivers recently, or any software in the storage stack?  Is the PSU flaky?  How old is it?  A flaky PSU can drop drives out of arrays like hot potatoes when there is heavy access and thus heavy current draw.

-- 
Stan
Message details and related content
On 9/25/11 4:54 PM, Stan Hoeppner wrote:
Are the drives screwed into the case's internal drive cage?
Yes.
Directly
connected to the motherboard SATA ports with cables?
Yes. I've 6 SATA3 ports on the motherboard and the drives are connected directly.
Or, do you have the
drives mounted in any kind of SATA hot/cold swap cage? The cheap ones of
these are notorious for causing exactly the kind of drop outs you've
experienced. Post a link to your case and any drive related peripherals.
I don't have a hot/cold swap cage. This is my case: http://www.fractal-design.com/?view=product&category=2&prod=54
Did you suffer a power event? I.e. a sag, brown out?
No, nothing like that.
Is the system
connected to a good quality working UPS?
It is connected to an UPS but not an expensive one.
Something else you should always mention: How long did it all "just
work" before having problems? A few hours? Days? Weeks? Months?
Two of the drives were falling out of the array pretty often.
My motherboard has a built in RAID controller which I do not use.
To begin with the BIOS settings were set to recognize drives as IDE resulting in two of the drives connected to SATA 1 and SATA 2 ports were failing and dropping off the array.
They would show as UDMA/100 drives whereas the other drives were showing as
SATA link up 6.0 Gbps (SStatus 133 SControl 300)
ATA-8: ST2000DL003-9VT166, CC32, max UDMA/133
I changed this BIOS setting and all the drives have been recognized as the same with the same speed.
I also bought new SATA cables for the failing drives, specifically for SATA 3. That did not help and the drives kept on failing (maybe once a week?). These 2 drives always failed at about the same time.

Shortly after a 3rd. drive failed leaving me with a broken Raid array.
Had you
made any hardware changes to the system recently before the failure
event?
No, there were no changes.

If so what? Did you upgrade your kernel/drivers recently, or any
software in the storage stack? Is the PSU flaky? How old is it? A flaky
PSU can drop drives out of arrays like hot potatoes when there is heavy
access and thus heavy current draw.
The PSU should be fine. I pulled it off a working server which had been stable for long time.



-- 

Marcin M. Jessa
Message details and related content
On 9/25/2011 7:18 PM, Marcin M. Jessa wrote:
On 9/26/11 2:15 AM, Stan Hoeppner wrote:
quoted
On 9/25/2011 5:21 PM, Marcin M. Jessa wrote:
quoted
My motherboard has a built in RAID controller which I do not use.
What make/model is the mobo?
My motherboard is a MSI 870A-G54 -
http://www.msi.com/product/mb/870A-G54.html
The AMD SB850 is a relatively new Southbridge chip, SATA3 AHCI at that.  Are you using AHCI mode?  I'd take a deep look in demsg output and in /var/log/kern.log for any errors relating to SATA, AHCI, mdraid, etc.

Quite often when drives are kicked offline it is a result of timeouts and/or other errors on the SATA channels.  The log information may help narrow down the cause, whether a Southbridge problem, driver problem, mode setting problem, drive firmware problem, etc.

For instance, the SB850 has 6 SATA3 ports.  If the drives are SATA2, and something is buggy in firmware on either end, there could be a link speed negotiation problem causing problems.  Manually forcing the link speed to SATA2 may help in such a situation.  You may also want to try using native SATA/IDE mode instead of AHCI if you're currently using AHCI.  If not, you may want to try AHCI mode.

Regardless, find the errors in your logs and post them to the linux-ide list for help.

-- 
Stan

Keyboard shortcuts
hback out one level
jnext message in thread / next series-diff position
kprevious message in thread / previous series-diff position
ldrill in
Escclose help / fold thread tree
?toggle this help