Re: broken fs, "kernel BUG at fs/btrfs/free-space-cache.c:1327"
From: Nico Kruber <hidden>
Date: 2012-01-15 18:00:04
guess that I'm back to normal - btrfs-zero-log did the trick. I read about this tool but didn't try because my error message suggested something else to me than what I read here https://btrfs.wiki.kernel.org/articles/p/r/o/Problem_FAQ_68af.html#I_ca= n.27t_mount_my_filesystem.2C_and_I_get_a_kernel_oops.21 and everywhere else =46or reference, this is what I did: * downloaded the openSUSE 12.1 KDE live (x86_64) * updated package management, afterwards btrfsprogs (uncheck all the other updates) * now there is a btrfs-zero-log which can be run as root Thank you for your help, Hugo Nico PS: If you need anything else to debug this, I'll keep the (corrupt) image around for a bit longer - otherwise I'll delete that. On 15 January 2012 18:45, Nico Kruber [off-list ref] wro= te:
On 15 January 2012 17:17, Hugo Mills [off-list ref] wrote:quoted
On Sun, Jan 15, 2012 at 04:07:10PM +0000, Nico Kruber wrote:quoted
I was using btrfs with openSUSE 12.1 and during the last update (glibc), the system hanged and I had no choice but to reboot. Now I can neither boot my system, nor mount my btrfs partition from=
a
quoted
quoted
live USB, e.g. PartedMagic or the openSUSE 12.1 live CD images. Whenever I try mounting the fs, I get the following kernel oops:=A0 This looks like it's a corrupt log tree. You should be able to f=
ix
quoted
it by running btrfs-zero-log on the filesystem. =A0 I would guess that you have an old kernel that needs updating, because that particular bug was fixed back in 3.0 or so -- if you're using btrfs, you should keep up to date with the latest released kernel (if not the -rc kernels), as there are lots of bugs fixed wit=
h
quoted
each new release. =A0 If you're using a 3.2 kernel and still saw log tree corruption, then we have a previously unknown problem.actually, I was using kernel 3.1, both in opensuse and partedmagic I'll try to grab btrfs-zero-log and report back.quoted
quoted
------------------------------------------ # mount =A0/dev/sda3 /mnt/ # dmesg [ =A0379.420110] Btrfs loaded [ =A0379.420430] device fsid dd1cdd10-6b96-46e9-9214-0e07ca61f6d5 d=
evid
quoted
quoted
1 transid 11562 /dev/loop2 [ =A0379.511476] btrfs: disk space caching is enabled [ =A0382.959164] ------------[ cut here ]------------ [ =A0382.959192] kernel BUG at fs/btrfs/free-space-cache.c:1327! [ =A0382.959219] invalid opcode: 0000 [#1] SMP [ =A0382.959243] CPU 3 [ =A0382.959253] Modules linked in: btrfs ipv6 snd_seq_dummy snd_se=
q_oss
quoted
quoted
snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_mixer_oss bluetooth nfsd exportfs dm_mod fuse vfat fat isofs snd_hda_codec_hd=
mi
quoted
quoted
rt2800pci rt2800lib crc_ccitt snd_hda_codec_realtek rt2x00pci rt2x00lib snd_hda_intel mac80211 pata_acpi radeon snd_hda_codec ttm cfg80211 sg drm_kms_helper snd_hwdep uas rfkill drm firewire_ohci ata_generic joydev hid_logitech usbhid hid usb_storage processor mac_hid thermal_sys snd_pcm firewire_core evdev rtc_cmos ahci snd_timer i2c_algo_bit hwmon eeprom_93cx6 pata_jmicron button libah=
ci
quoted
quoted
snd r8169 i2c_i801 serio_raw uhci_hcd mii soundcore intel_agp intel_gtt agpgart ehci_hcd snd_page_alloc [ =A0382.959665] [ =A0382.959674] Pid: 5910, comm: mount Not tainted 3.1.6-pmagic #2 Gigabyte Technology Co., Ltd. EP45-DS3/EP45-DS3 [ =A0382.959726] RIP: 0010:[<ffffffffa03e7783>] =A0[<ffffffffa03e77=
83>]
quoted
quoted
btrfs_log_new_name+0xd34/0x103b [btrfs] [ =A0382.959778] RSP: 0000:ffff88007eb436b8 =A0EFLAGS: 00010206 [ =A0382.959803] RAX: 0000000000000000 RBX: ffff8800d2fad500 RCX: 0=
000000000002000
quoted
quoted
[ =A0382.959836] RDX: 000000049890e000 RSI: 0000000498872000 RDI: 0=
000000000001300
quoted
quoted
[ =A0382.959868] RBP: ffff88007eb43718 R08: 0000000000006d00 R09: f=
fff8800cecdcda0
quoted
quoted
[ =A0382.959900] R10: ffff88007eb43668 R11: ffff88007eb436a0 R12: f=
fff88007eb89bc0
quoted
quoted
[ =A0382.959932] R13: ffff88007eb43738 R14: ffff88007eb43740 R15: 0=
000000499c00000
quoted
quoted
[ =A0382.959964] FS: =A00000000000000000(0000) GS:ffff88011fd80000(=
0063)
quoted
quoted
knlGS:00000000f763d700 [ =A0382.960002] CS: =A00010 DS: 002b ES: 002b CR0: 000000008005003=
b
quoted
quoted
[ =A0382.960028] CR2: 00000000edec40d8 CR3: 00000000ce49d000 CR4: 0=
0000000000406e0
quoted
quoted
[ =A0382.960060] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0=
000000000000000
quoted
quoted
[ =A0382.960076] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0=
000000000000400
quoted
quoted
[ =A0382.960076] Process mount (pid: 5910, threadinfo ffff88007eb42=
000,
quoted
quoted
task ffff880112422940) [ =A0382.960076] Stack: [ =A0382.960076] =A0ffff88007eb436d0 ffff8800d2faebd0 ffffffff81020=
a70
quoted
quoted
ffff88007eb89be4 [ =A0382.960076] =A00000000000002000 000000049890e000 ffffffff813cc=
a8b
quoted
quoted
ffff8800d2fad500 [ =A0382.960076] =A0ffff88007eb89bc0 0000000000000000 ffff88007fb43=
d00
quoted
quoted
ffff88007eb43738 [ =A0382.960076] Call Trace: [ =A0382.960076] =A0[<ffffffff81020a70>] ? default_spin_lock_flags+=
0x9/0xd
quoted
quoted
[ =A0382.960076] =A0[<ffffffff813cca8b>] ? _raw_spin_unlock_irqrest=
ore+0x1a/0x1d
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03e8c8b>] btrfs_remove_free_space+0x=
267/0x293 [btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03a7775>] ? btrfs_previous_item+0xdb=
/0xbab [btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03af7dd>] btrfs_alloc_logged_file_extent+0x87/0x19c [btrfs] [ =A0382.960076] =A0[<ffffffffa03a24ae>] ? btrfs_free_path+0x2a/0x2=
e [btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03e36e0>] btrfs_find_orphan_item+0x18b6/0x3c75 [btrfs] [ =A0382.960076] =A0[<ffffffff81101c0d>] ? iput+0x1ab/0x1b4 [ =A0382.960076] =A0[<ffffffffa03d5d24>] ? read_extent_buffer+0x97/=
0xeb [btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03e578b>] btrfs_find_orphan_item+0x3961/0x3c75 [btrfs] [ =A0382.960076] =A0[<ffffffffa03e4ead>] btrfs_find_orphan_item+0x3083/0x3c75 [btrfs] [ =A0382.960076] =A0[<ffffffffa03e507f>] btrfs_find_orphan_item+0x3255/0x3c75 [btrfs] [ =A0382.960076] =A0[<ffffffffa03b59ef>] ? btrfs_find_free_ino+0x15=
5/0x1bb2 [btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03e68fb>] btrfs_recover_log_trees+0x=
1ae/0x2c7 [btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03e55e1>] ? btrfs_find_orphan_item+0x37b7/0x3c75 [btrfs] [ =A0382.960076] =A0[<ffffffffa03ba86d>] open_ctree+0x112c/0x2075 [=
btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffffa03a0813>] btrfs_sync_fs+0x4d8/0x739 =
[btrfs]
quoted
quoted
[ =A0382.960076] =A0[<ffffffff810ccb41>] ? pcpu_next_pop+0x3d/0x4a [ =A0382.960076] =A0[<ffffffff810effd2>] mount_fs+0x6e/0x158 [ =A0382.960076] =A0[<ffffffff810cda07>] ? __alloc_percpu+0x10/0x12 [ =A0382.960076] =A0[<ffffffff8110537c>] vfs_kern_mount+0x5c/0x9d [ =A0382.960076] =A0[<ffffffff81105693>] do_kern_mount+0x4d/0xdf [ =A0382.960076] =A0[<ffffffff81106f02>] do_mount+0x686/0x6e9 [ =A0382.960076] =A0[<ffffffff810c9d64>] ? memdup_user+0x44/0x6c [ =A0382.960076] =A0[<ffffffff81127ab1>] compat_sys_mount+0x218/0x2=
52
quoted
quoted
[ =A0382.960076] =A0[<ffffffff813cfdd3>] ia32_do_call+0x13/0x13 [ =A0382.960076] Code: 48 29 c2 49 8b 45 00 48 39 c2 48 0f 46 c2 48=
8d
quoted
quoted
55 c8 48 89 45 c0 e8 74 fe ff ff 85 c0 78 0c 48 8b 55 c8 49 8b 36 4=
8
quoted
quoted
39 f2 74 02 <0f> 0b 48 8b 4b 18 49 8d 47 ff 48 39 ca 76 4b 48 89 d1=
49
quoted
quoted
03 4d [ =A0382.960076] RIP =A0[<ffffffffa03e7783>] btrfs_log_new_name+0xd=
34/0x103b [btrfs]
quoted
quoted
[ =A0382.960076] =A0RSP <ffff88007eb436b8> [ =A0382.971282] ---[ end trace 5d2fc65d77ccbfd6 ]--- ------------------------------------------ It does not matter whether I add the ro, clear_cache or the subvolid=3D** option (can't think of anything else except for nospace_cache, but I do not have a live image with Kernel 3.2 - if =
you
quoted
quoted
know of any, I could try that, too). Is the filesystem ruined or is there still hope, I can recover from=
that?
quoted
quoted
Since YaST makes a snapshot before the update, my original plan was=
to
quoted
quoted
revert to that I tried some subvolid values, btrfsck reported and t=
hey
quoted
quoted
had the same kernel BUG as without one or even 0. Here are some hopefully useful outputs. If you need any more, I mad=
e
quoted
quoted
an image of the partition so I can still debug it even if I re-install. ------------------------------------------ # btrfs filesystem show failed to read /dev/sr0 Label: none =A0uuid: dd1cdd10-6b96-46e9-9214-0e07ca61f6d5 =A0 =A0 =A0 Total devices 1 FS bytes used 20.55GB =A0 =A0 =A0 devid =A0 =A01 size 31.81GB used 31.81GB path /dev/sda3 Btrfs Btrfs v0.19 ------------------------------------------ # btrfsck /media/sdb1/Images/broken-btrfs.img root 5 inode 878157 errors 1000 root 5 inode 878158 errors 1000 root 5 inode 878159 errors 1000 root 5 inode 878413 errors 1000 root 692 inode 679573 errors 1000 root 692 inode 679585 errors 1000 root 692 inode 679586 errors 1000 root 692 inode 679592 errors 1000 root 692 inode 679594 errors 1000 root 692 inode 679595 errors 1000 root 692 inode 679599 errors 1000 root 692 inode 679600 errors 1000 root 692 inode 679601 errors 1000 root 692 inode 679602 errors 1000 root 692 inode 679603 errors 1000 root 692 inode 679604 errors 1000 root 692 inode 679605 errors 1000 root 692 inode 679607 errors 1000 root 692 inode 679608 errors 1000 root 692 inode 679609 errors 1000 root 692 inode 679611 errors 1000 root 692 inode 679613 errors 1000 root 692 inode 679614 errors 1000 root 692 inode 679615 errors 1000 root 692 inode 679616 errors 1000 root 692 inode 679617 errors 1000 root 692 inode 679619 errors 1000 root 692 inode 679620 errors 1000 root 692 inode 679621 errors 1000 root 692 inode 679622 errors 1000 root 692 inode 679626 errors 1000 root 692 inode 679627 errors 1000 root 692 inode 679692 errors 1000 root 692 inode 679698 errors 1000 root 692 inode 684383 errors 1000 root 692 inode 684384 errors 1000 root 692 inode 684388 errors 1000 root 692 inode 684432 errors 1000 root 692 inode 684434 errors 1000 root 692 inode 684440 errors 1000 root 692 inode 684458 errors 1000 root 692 inode 684465 errors 1000 root 692 inode 684467 errors 1000 root 692 inode 684487 errors 1000 root 692 inode 684490 errors 1000 root 692 inode 684495 errors 1000 root 693 inode 679573 errors 1000 root 693 inode 679585 errors 1000 root 693 inode 679586 errors 1000 root 693 inode 679592 errors 1000 root 693 inode 679594 errors 1000 root 693 inode 679595 errors 1000 root 693 inode 679599 errors 1000 root 693 inode 679600 errors 1000 root 693 inode 679601 errors 1000 root 693 inode 679602 errors 1000 root 693 inode 679603 errors 1000 root 693 inode 679604 errors 1000 root 693 inode 679605 errors 1000 root 693 inode 679607 errors 1000 root 693 inode 679608 errors 1000 root 693 inode 679609 errors 1000 root 693 inode 679611 errors 1000 root 693 inode 679613 errors 1000 root 693 inode 679614 errors 1000 root 693 inode 679615 errors 1000 root 693 inode 679616 errors 1000 root 693 inode 679617 errors 1000 root 693 inode 679619 errors 1000 root 693 inode 679620 errors 1000 root 693 inode 679621 errors 1000 root 693 inode 679622 errors 1000 root 693 inode 679626 errors 1000 root 693 inode 679627 errors 1000 root 693 inode 679692 errors 1000 root 693 inode 679698 errors 1000 root 693 inode 684383 errors 1000 root 693 inode 684384 errors 1000 root 693 inode 684388 errors 1000 root 693 inode 684432 errors 1000 root 693 inode 684434 errors 1000 root 693 inode 684440 errors 1000 root 693 inode 684458 errors 1000 root 693 inode 684465 errors 1000 root 693 inode 684467 errors 1000 root 693 inode 684487 errors 1000 root 693 inode 684490 errors 1000 root 693 inode 684495 errors 1000 root 700 inode 679573 errors 1000 root 700 inode 679585 errors 1000 root 700 inode 679586 errors 1000 root 700 inode 679592 errors 1000 root 700 inode 679594 errors 1000 root 700 inode 679595 errors 1000 root 700 inode 679599 errors 1000 root 700 inode 679600 errors 1000 root 700 inode 679601 errors 1000 root 700 inode 679602 errors 1000 root 700 inode 679603 errors 1000 root 700 inode 679604 errors 1000 root 700 inode 679605 errors 1000 root 700 inode 679607 errors 1000 root 700 inode 679608 errors 1000 root 700 inode 679609 errors 1000 root 700 inode 679611 errors 1000 root 700 inode 679613 errors 1000 root 700 inode 679614 errors 1000 root 700 inode 679615 errors 1000 root 700 inode 679616 errors 1000 root 700 inode 679617 errors 1000 root 700 inode 679619 errors 1000 root 700 inode 679620 errors 1000 root 700 inode 679621 errors 1000 root 700 inode 679622 errors 1000 root 700 inode 679626 errors 1000 root 700 inode 679627 errors 1000 root 700 inode 679692 errors 1000 root 700 inode 679698 errors 1000 root 700 inode 684383 errors 1000 root 700 inode 684384 errors 1000 root 700 inode 684388 errors 1000 root 700 inode 684432 errors 1000 root 700 inode 684434 errors 1000 root 700 inode 684440 errors 1000 root 700 inode 684458 errors 1000 root 700 inode 684465 errors 1000 root 700 inode 684467 errors 1000 root 700 inode 684487 errors 1000 root 700 inode 684490 errors 1000 root 700 inode 684495 errors 1000 root 701 inode 679573 errors 1000 root 701 inode 679585 errors 1000 root 701 inode 679586 errors 1000 root 701 inode 679592 errors 1000 root 701 inode 679594 errors 1000 root 701 inode 679595 errors 1000 root 701 inode 679599 errors 1000 root 701 inode 679600 errors 1000 root 701 inode 679601 errors 1000 root 701 inode 679602 errors 1000 root 701 inode 679603 errors 1000 root 701 inode 679604 errors 1000 root 701 inode 679605 errors 1000 root 701 inode 679607 errors 1000 root 701 inode 679608 errors 1000 root 701 inode 679609 errors 1000 root 701 inode 679611 errors 1000 root 701 inode 679613 errors 1000 root 701 inode 679614 errors 1000 root 701 inode 679615 errors 1000 root 701 inode 679616 errors 1000 root 701 inode 679617 errors 1000 root 701 inode 679619 errors 1000 root 701 inode 679620 errors 1000 root 701 inode 679621 errors 1000 root 701 inode 679622 errors 1000 root 701 inode 679626 errors 1000 root 701 inode 679627 errors 1000 root 701 inode 679692 errors 1000 root 701 inode 679698 errors 1000 root 701 inode 684383 errors 1000 root 701 inode 684384 errors 1000 root 701 inode 684388 errors 1000 root 701 inode 684432 errors 1000 root 701 inode 684434 errors 1000 root 701 inode 684440 errors 1000 root 701 inode 684458 errors 1000 root 701 inode 684465 errors 1000 root 701 inode 684467 errors 1000 root 701 inode 684487 errors 1000 root 701 inode 684490 errors 1000 root 701 inode 684495 errors 1000 root 754 inode 834204 errors 1000 root 755 inode 834204 errors 1000 root 756 inode 834204 errors 1000 root 757 inode 834204 errors 1000 root 758 inode 834204 errors 1000 root 759 inode 834204 errors 1000 root 760 inode 834204 errors 1000 root 761 inode 834204 errors 1000 root 762 inode 834204 errors 1000 root 763 inode 834204 errors 1000 root 764 inode 834204 errors 1000 root 765 inode 834204 errors 1000 root 766 inode 834204 errors 1000 root 767 inode 834204 errors 1000 root 768 inode 834204 errors 1000 root 769 inode 834204 errors 1000 root 770 inode 834204 errors 1000 root 771 inode 834204 errors 1000 root 772 inode 834204 errors 1000 root 774 inode 834204 errors 1000 root 775 inode 834204 errors 1000 root 778 inode 834204 errors 1000 root 779 inode 834204 errors 1000 root 780 inode 834204 errors 1000 root 781 inode 834204 errors 1000 root 781 inode 878157 errors 1000 root 781 inode 878158 errors 1000 root 781 inode 878159 errors 1000 root 781 inode 878413 errors 1000 root 782 inode 878157 errors 1000 root 782 inode 878158 errors 1000 root 782 inode 878159 errors 1000 root 782 inode 878413 errors 1000 root 783 inode 878157 errors 1000 root 783 inode 878158 errors 1000 root 783 inode 878159 errors 1000 root 783 inode 878413 errors 1000 root 784 inode 878157 errors 1000 root 784 inode 878158 errors 1000 root 784 inode 878159 errors 1000 root 784 inode 878413 errors 1000 root 785 inode 878157 errors 1000 root 785 inode 878158 errors 1000 root 785 inode 878159 errors 1000 root 785 inode 878413 errors 1000 root 786 inode 878157 errors 1000 root 786 inode 878158 errors 1000 root 786 inode 878159 errors 1000 root 786 inode 878413 errors 1000 root 787 inode 878157 errors 1000 root 787 inode 878158 errors 1000 root 787 inode 878159 errors 1000 root 787 inode 878413 errors 1000 root 788 inode 878157 errors 1000 root 788 inode 878158 errors 1000 root 788 inode 878159 errors 1000 root 788 inode 878413 errors 1000 root 789 inode 878157 errors 1000 root 789 inode 878158 errors 1000 root 789 inode 878159 errors 1000 root 789 inode 878413 errors 1000 root 790 inode 878157 errors 1000 root 790 inode 878158 errors 1000 root 790 inode 878159 errors 1000 root 790 inode 878413 errors 1000 root 791 inode 878157 errors 1000 root 791 inode 878158 errors 1000 root 791 inode 878159 errors 1000 root 791 inode 878413 errors 1000 root 792 inode 878157 errors 1000 root 792 inode 878158 errors 1000 root 792 inode 878159 errors 1000 root 792 inode 878413 errors 1000 root 793 inode 878157 errors 1000 root 793 inode 878158 errors 1000 root 793 inode 878159 errors 1000 root 793 inode 878413 errors 1000 root 794 inode 878157 errors 1000 root 794 inode 878158 errors 1000 root 794 inode 878159 errors 1000 root 794 inode 878413 errors 1000 root 795 inode 878157 errors 1000 root 795 inode 878158 errors 1000 root 795 inode 878159 errors 1000 root 795 inode 878413 errors 1000 root 796 inode 878157 errors 1000 root 796 inode 878158 errors 1000 root 796 inode 878159 errors 1000 root 796 inode 878413 errors 1000 root 797 inode 878157 errors 1000 root 797 inode 878158 errors 1000 root 797 inode 878159 errors 1000 root 797 inode 878413 errors 1000 root 798 inode 878157 errors 1000 root 798 inode 878158 errors 1000 root 798 inode 878159 errors 1000 root 798 inode 878413 errors 1000 root 799 inode 878157 errors 1000 root 799 inode 878158 errors 1000 root 799 inode 878159 errors 1000 root 799 inode 878413 errors 1000 root 800 inode 878157 errors 1000 root 800 inode 878158 errors 1000 root 800 inode 878159 errors 1000 root 800 inode 878413 errors 1000 root 801 inode 878157 errors 1000 root 801 inode 878158 errors 1000 root 801 inode 878159 errors 1000 root 801 inode 878413 errors 1000 root 802 inode 878157 errors 1000 root 802 inode 878158 errors 1000 root 802 inode 878159 errors 1000 root 802 inode 878413 errors 1000 root 803 inode 878157 errors 1000 root 803 inode 878158 errors 1000 root 803 inode 878159 errors 1000 root 803 inode 878413 errors 1000 root 804 inode 878157 errors 1000 root 804 inode 878158 errors 1000 root 804 inode 878159 errors 1000 root 804 inode 878413 errors 1000 root 805 inode 878157 errors 1000 root 805 inode 878158 errors 1000 root 805 inode 878159 errors 1000 root 805 inode 878413 errors 1000 root 806 inode 878157 errors 1000 root 806 inode 878158 errors 1000 root 806 inode 878159 errors 1000 root 806 inode 878413 errors 1000 root 807 inode 878157 errors 1000 root 807 inode 878158 errors 1000 root 807 inode 878159 errors 1000 root 807 inode 878413 errors 1000 found 22063673411 bytes used err is 1 total csum bytes: 19134188 total tree bytes: 2288513024 total fs tree bytes: 2131046400 btree space waste bytes: 623403397 file data blocks allocated: 93240000512 =A0referenced 79978369024 Btrfs Btrfs v0.19 ------------------------------------------ Regards, Nico-- =3D=3D=3D Hugo Mills: hugo@... carfax.org.uk | darksatanic.net | lug=
=2Eorg.uk =3D=3D=3D
quoted
=A0PGP key: 515C238D from wwwkeys.eu.pgp.net or http://www.carfax.or=
g.uk
quoted
=A0 =A0--- "What are we going to do tonight?" "The same thing we do =
---
quoted
=A0 =A0 =A0 =A0 =A0 =A0every night, Pinky. =A0Try to take over the w=
orld!" -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" = in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html