linux-ext4 - Re: fsck performance.

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite for Android: free password hash cracker in your pocket

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20110220170931.GB3017@thunk.org>
Date:	Sun, 20 Feb 2011 12:09:31 -0500
From:	Ted Ts'o <tytso@....edu>
To:	Rogier Wolff <R.E.Wolff@...Wizard.nl>
Cc:	linux-ext4@...r.kernel.org
Subject: Re: fsck performance.

On Sun, Feb 20, 2011 at 10:06:56AM +0100, Rogier Wolff wrote:
> Debian apparently recently pointed that to the new release squeeze, so
> I got upgraded. I went from kernel 2.6.26 to 2.6.32. After about a day
> my system rebooted without my consent. So now it's running 2.6.32.
> 
> Since then I'm getting kernel-oops-lookalikes that start with:
> [71664.306573] swapper: page allocation failure. order:5, mode:0x4020

That's a warning which has been suppressed in newer kernels.  Ext4
falls back to vmalloc() if kmalloc() fails, and sometime in the early
2.6.3x kernels the kernel started warning on huge kmalloc failures,
without having a way of suppressing those errors.  That's a cosmetic
issue which has been fixed.  (It should only be happening at when an
ext4 file system is being mounted, right?)

> Anyway, upon boot into the new kernel ext3 printed abunch of these: 
> [    5.212119] ext3_orphan_cleanup: deleting unreferenced inode 1335743

That's normal if you didn't cleanly umount the file system before
reporting, and there were files that were still open, but deleted at
the time of the crash.

> A few hours later, my storage partition was marked read-only and the
> backups started failing.
> 
> kern.log.1.gz:Feb 18 05:39:53 driepoot kernel: [10328.424778] 
>   EXT3-fs error (device md3): ext3_lookup: deleted inode referenced: 277447722

That's not normal.  :-)

> fcntl64(6, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=164, len=1}) = 0
> fcntl64(6, F_SETLKW, {type=F_UNLCK, whence=SEEK_SET, start=164, len=1}) = 0
>
> So, my question is: Are these fcntl calls neccesary? 
> As far as I know locking is neccesary if another process might be 
> handling the same data. Here is is doing this with the cache 
> files: 
> 
> lrwx------ 1 root root 64 Feb 20 09:28 5 -> 
>        /var/cache/e2fsck/123a1cfe-2455-4646-aa32-87492ed1ac97-icount-ayxVou
> lrwx------ 1 root root 64 Feb 20 09:28 6 -> 
>        /var/cache/e2fsck/123a1cfe-2455-4646-aa32-87492ed1ac97-dirinfo-rBBTtb

Ah, you're using tdb.  Tdb can be really slow.  It's been on my todo
list to replace tdb with something else, but I haven't gotten around
to it.

No, it shouldn't be necessary given that e2fsck is the only user of
the tdb files.  I'll need to look at trying to remove them, but I'm
not sure that would really improve the speed.

						- Ted
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html