Thread (25 messages) 25 messages, 7 authors, 2017-12-14

Re: mdadm stuck at 0% reshape after grow

From: Jeremy Graham <hidden>
Date: 2017-12-07 08:40:32

A huge thank you to all who gave advice!! The issue was the BBL

I decided to just run with a --update=force-no-bbl for a few reasons
* I was sure those bad blocks were read errors generated a long time
ago due to a faulty SATA cable
* Since then I have noted a couple of corrupt files but nothing of
importance and I just generally delete anything corrupt anyway
* Anything irreplaceable on the raid was backed up elsewhere
* I did not trust myself with finding + fixing the bad blocks
manually, and felt it might just get me into more trouble
* Almost anything that touched the raid while active was hanging the
terminal (even a fdisk -l) making trying things painful

So cowboy style I just ran
mdadm --assemble --update=force-no-bbl -v /dev/md0 /dev/sd[fgdecb]1

And Boom! it started doing its thing without a hiccup. About 12h on a
reshape, then 6hr on a resync, after that I did a "fsck.ext4 -f
/dev/md0" with no issues found, so a "resize2fs /dev/md0" and finally
a mount. I have since tested a heap of data and hasn't missed a beat.

mdadm --examine isn't reporting bad blocks anymore, not sure if they
are silently waiting to cause me problems in the future but appears ok
for now.

Thanks again for all the help and advice!

Nice to see my array healthy again :)

$ mdadm --detail /dev/md0
/dev/md0:
        Version : 1.2
  Creation Time : Sun Dec  2 12:04:24 2012
     Raid Level : raid5
     Array Size : 14651317760 (13972.59 GiB 15002.95 GB)
  Used Dev Size : 2930263552 (2794.52 GiB 3000.59 GB)
   Raid Devices : 6
  Total Devices : 6
    Persistence : Superblock is persistent

    Update Time : Thu Dec  7 19:26:53 2017
          State : clean
 Active Devices : 6
Working Devices : 6
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 512K

           Name : homer2:1
           UUID : f39f89d2:1bcd3d55:d173d206:d85b8bbc
         Events : 4835083

    Number   Major   Minor   RaidDevice State
       8       8       81        0      active sync   /dev/sdf1
       6       8       97        1      active sync   /dev/sdg1
       5       8       49        2      active sync   /dev/sdd1
       9       8       65        3      active sync   /dev/sde1
       7       8       33        4      active sync   /dev/sdc1
      10       8       17        5      active sync   /dev/sdb1

$ cat /proc/mdstat
Personalities : [raid6] [raid5] [raid4] [linear] [multipath] [raid0]
[raid1] [raid10]
md0 : active raid5 sdd1[5] sdc1[7] sdb1[10] sde1[9] sdg1[6] sdf1[8]
      14651317760 blocks super 1.2 level 5, 512k chunk, algorithm 2
[6/6] [UUUUUU]

unused devices: <none>

end<div id="DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br />
<table style="border-top: 1px solid #D3D4DE;">
	<tr>
        <td style="width: 55px; padding-top: 13px;"><a
href="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail"
target="_blank"><img
src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-green-avg-v1.png"
alt="" width="46" height="29" style="width: 46px; height: 29px;"
/></a></td>
		<td style="width: 470px; padding-top: 12px; color: #41424e;
font-size: 13px; font-family: Arial, Helvetica, sans-serif;
line-height: 18px;">Virus-free. <a
href="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail"
target="_blank" style="color: #4453ea;">www.avg.com</a>
		</td>
	</tr>
</table><a href="#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1"
height="1"></a></div>
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help