Re: multi-device btrfs with single data mode and disk failure
From: Alexandre Poux <hidden>
Date: 2016-09-20 19:55:02
Le 20/09/2016 à 21:43, Austin S. Hemmelgarn a écrit :
On 2016-09-20 14:53, Alexandre Poux wrote:quoted
Le 20/09/2016 à 20:38, Chris Murphy a écrit :quoted
On Tue, Sep 20, 2016 at 12:19 PM, Alexandre Poux [off-list ref] wrote:quoted
Le 20/09/2016 à 19:54, Chris Murphy a écrit :quoted
On Tue, Sep 20, 2016 at 11:03 AM, Alexandre Poux [off-list ref] wrote:quoted
If I wanted to try to edit my partitions with an hex editor, where would I find infos on how to do that ? I really don't want to go this way, but if this is relatively simple, it may be worth to try.Simple is relative. First you'd need https://btrfs.wiki.kernel.org/index.php/On-disk_Format to get some understanding of where things are to edit, and then btrfs-map-logical to convert btrfs logical addresses to physical device and sector to know what to edit. I'd call it distinctly non-trivial and very tedious.OK, another idea: would it be possible to trick btrfs with a manufactured file that the disk is present while it isn't ? I mean, looking for a few minutes on the hexdump of my trivial test partition, header of members of btrfs array seems very alike. So maybe, I can make a file wich would have enough header to make btrfs believe that this is my device, and then remove it as usual.... looks like a long shot, but it doesn't hurt to ask....There may be another test that applies to single profiles, that disallows dropping a device. I think that's the place to look next. The superblock is easy to copy, but you'll need the device specific UUID which should be locatable with btrfs-show-super -f for each devid. The bigger problem is that Btrfs at mount time doesn't just look at the superblock and then mount. It actually reads parts of each tree, the extent of which I don't know. And it's doing a bunch of sanity tests as it reads those things, including transid (generation). So I'm not sure how easily spoofable a fake device is going to be. As a practical matter, migrate it to a new volume is faster and more reliable. Unfortunately, the inability to mount it read write is going to prevent you from making read only snapshots to use with btrfs send/receive. What might work, is find out what on-disk modification btrfs-tune does to make a device a read-only seed. Again your volume is missing a device so btrfs-tune won't let you modify it. But if you could force that to happen, it's probably a very minor change to metadata on each device, maybe it'll act like a seed device when you next mount it, in which case you'll be able to add a device and remount it read write and then delete the seed causing migration of everything that does remain on the volume over to the new device. I've never tried anything like this so I have no idea if it'll work. And even in the best case I haven't tried a multiple device seed going to a single device sprout (is it even allowed when removing the seed?). So...more questions than answers.Sorry if I wasn't clear, but with the patch mentionned earlyer, I can get a read write mount. What I can't do is remove the device. As for moving data to an another volume, since it's only data and nothing fancy (no subvolume or anything), a simple rsync would do the trick. My problem in this case is that I don't have enough available space elsewhere to move my data. That's why I'm trying this hard to recover the partition...First off, as Chris said, if you can read the data and don't already have a backup, that should be your first priority. This really is an edge case that's not well tested, and the kernel technically doesn't officially support it. Now, beyond that and his suggestions, there's another option, but it's risky, so I wouldn't even think about trying it without a backup (unless of course you can trivially regenerate the data). Multiple devices support and online resizing allows for a rather neat trick to regenerate a filesystem in place. The process is pretty simple: 1. Shrink the existing filesystem down to the minimum size possible. 2. Create a new partition in the free space, and format it as a temporary BTRFS filesystem. Ideally, this FS should be mixed mode, and ideally single profile. If you don't have much free space, you can use a flash drive to start this temporary filesystem instead. 3. Start copying files from the old filesystem to the temporary one. 4. Once the new filesystem is about 95% full, stop copying, shrink the old filesystem again, create a new partition, and add that partition to the temporary filesystem. 5. Repeat steps 3-4 until you have everything off of the old filesystem. 6. Re-format the remaining portion of the old filesystem using the parameters you want for the replacement filesystem. 7. Start copying files from the temporary filesystem to the new filesystem. 8. As you empty out each temporary partition, remove it from the temporary filesystem, delete the partition, and expand the new filesystem. This takes a while, and is only safe if you have reliable hardware, but I've done it before and it works reliably as long as you don't have many big files on the old filesystem (things can get complicated if you do). The other negative aspect is that if you aren't careful, it's possible to get stuck half-way, but in such a case, adding a flash drive to the temporary filesystem can usually give you enough extra space to get things unstuck.
OK, good idea, but to be able to do that, I have to use the patch that allow me to mount the partition in rw, otherwise I won't be able to shrink it I suppose.. And even with the patch I'm not sure that I won't get an IO error the same way I get it when I try to remove the device. I will try it on my virtual machine.