linux-kernel - Re: 3.10-rc3 xfs mount/recovery failure & ext fsck hang.

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20130528220409.GD29338@dastard>
Date:	Wed, 29 May 2013 08:04:09 +1000
From:	Dave Chinner <david@...morbit.com>
To:	Dave Jones <davej@...hat.com>, xfs@....sgi.com,
	Linux Kernel <linux-kernel@...r.kernel.org>
Subject: Re: 3.10-rc3 xfs mount/recovery failure & ext fsck hang.

On Tue, May 28, 2013 at 05:41:37PM -0400, Dave Jones wrote:
> On Wed, May 29, 2013 at 07:32:48AM +1000, Dave Chinner wrote:
>  > On Tue, May 28, 2013 at 05:15:44PM -0400, Dave Jones wrote:
>  > > On Wed, May 29, 2013 at 07:10:12AM +1000, Dave Chinner wrote:
>  > >  > On Tue, May 28, 2013 at 12:12:30PM -0400, Dave Jones wrote:
>  > >  > > box crashed, and needed rebooting. On next bootup, when it found the dirty partition,
>  > >  > > xfs chose to spew and then hang instead of replaying the journal and mounting :(
>  > >  > > 
>  > >  > > [   14.694731] SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, debug enabled
>  > >  > > [   14.722328] XFS (sda2): Mounting Filesystem
>  > >  > > [   14.757801] XFS (sda2): Starting recovery (logdev: internal)
>  > >  > > [   14.782049] XFS: Assertion failed: fs_is_ok, file: fs/xfs/xfs_dir2_data.c, line: 169
>  > >  > 
>  > >  > A directory block has an entry that is not in the hash index.
>  > >  > Either there's an underlying corruption on disk, or there's an
>  > >  > inconsistency in what has been logged and so an entire change has
>  > >  > not been replayed. Hence the post recovery verification has thrown a
>  > >  > corruption error....
>  > >  > 
>  > >  > If you haven't already repaired the filesystem, can you send me a
>  > >  > metadump of the filesystem in question?
>  > > 
>  > > Sorry, too late. If I can repro, I'll do so next time.
>  > > FYI, I ran xfs_repair and it just hung. Wouldn't even answer ctrl-c.
>  > > Rebooted, and then it mounted and recovered just fine!
>  > 
>  > Strange. I can't think of any reason outside a kernel problem for
>  > xfs_repair going into an uninterruptible sleep. Did it happen after
>  > the repair completed (i.e. after phase 7)? If so, then closing the
>  > block device might have tripped the same problem that fsck.ext2
>  > hit....
> 
> didn't even get that far. It opened the block dev, and then just sat there.
> I left it for a few minutes before deciding it was hung.
> And of course, this is an SSD, so there was no way I could tell if there
> was any IO going on by sound/feel/lights.

OK. Normally when it hangs you can kill it or ctrl-c out because it
gets stuck on a futex. You can then run xfs_repair -P to turn off
threading (and speed :() to avoid such hangs. but given that you
couldn't kill it, it doesn't sound like that sort of problem....

Cheers,

Dave.
-- 
Dave Chinner
david@...morbit.com
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/