linux-kernel - Very slow header cache in mutt if the maildir is on ext3

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-ID: <20081217001625.GA3250@x61>
Date:	Wed, 17 Dec 2008 01:16:25 +0100
From:	Tino Keitel <tino.keitel@....de>
To:	linux-kernel@...r.kernel.org
Subject: Very slow header cache in mutt if the maildir is on ext3

Hi,

I suffered from very long delays (like one minute) when opening
maildirs with a few thousand mails on my laptop.  I did some testing on
my desktop in a very similar environment (LVM, dm-crypt, 2,5" hard
disk, identical mutt configuration), which worked as quick as expected. 
However, I tested with the maildir on XFS.  When I switched to ext3,
things got slow again.  Then I discovered that the mutt header cache
file is the culprit.  I already made a backup and restore, so the file
system is in a fresh state.  I also removed the old header cache before
testing.

In strace, I see that during the delay read() and lseek() were called
to read the header cache.  If I flush all caches, and then read only
the header cache back into the cache using dd, it works as quick as
expected (only a few seconds).

The strange thing is that in both cases (maildir on ext3 and maildir on
XFS), the header cache file is stored on a separate file system on a
different hard disk on an XFS file system.  I don't get the point why
reading the header cache from this XFS file system is so slow when the
maildir is on ext3, and fast when the maildir is on XFS.

Here are strace excerpts for XFS and ext3, taken with "strace -f -s0
-tt" after doing "echo 7 > /proc/sys/vm/drop_caches":

http://tikei.de/mutt_hcache_xfs.txt
http://tikei.de/mutt_hcache_ext3.txt

Note the start and end times. The ext3 case took nearly 18 seconds, the
XFS case took 3 seconds.

Regards,
Tino
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/