linux-ext4 - Re: Memory allocation failed, e2fsck: aborted

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Message-ID: <20100819005404.GO21182@thunk.org>
Date:	Wed, 18 Aug 2010 20:54:04 -0400
From:	Ted Ts'o <tytso@....edu>
To:	Andreas Dilger <adilger@...ger.ca>
Cc:	Andre Noll <maan@...temlinux.org>,
	linux-ext4 <linux-ext4@...r.kernel.org>,
	Marcus Hartmann <marcus.hartmann@...bingen.mpg.de>
Subject: Re: Memory allocation failed, e2fsck: aborted

On Wed, Aug 18, 2010 at 02:20:13PM -0600, Andreas Dilger wrote:
> 
> Ah, that is also a major user of memory, and not necessarily one
> that optimizing the internal bitmap will help significantly.  It may
> well be that your swap cannot be used if a single allocation is in
> the same neighbourhood as the total RAM size.

Something which *might* help (but will take a long time) is to add to
your /etc/e2fsck.conf (if you have one; if not create one wiht these
contents):

[scratch_files]
    directory = /var/cache/fsck

(And then make sure /var/cache/fsck exists.)

Unfortunately, as it turns out tdb (from Samba) doesn't scale as much
as I would have liked, so it's on my todo to replace this with
something else.  The problem with that berk_db has non-standard
interfaces and varies from version to version.  So I've avoided using
it up until now.

But try it, and see if this will help....  it may still be way too
slow.

A related blog entry:

http://thunk.org/tytso/blog/2009/01/12/wanted-incremental-backup-solutions-that-use-a-database/

					- Ted

P.S.  I recently was told about a new backup system that meets the
requirements detailed in my post:

    http://sites.google.com/site/hashbackup/home/features

I haven't tried it yet, but it looks interesting.  Let me know if you
do try it and what you think of it.
--
To unsubscribe from this list: send the line "unsubscribe linux-ext4" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html