linux-kernel - Re: How to flush the disk write cache from userspace

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Date:	Thu, 18 Jan 2007 18:35:08 -0600
From:	Robert Hancock <hancockr@...w.ca>
To:	Ricardo Correia <rcorreia@...y.org>,
	linux-kernel <linux-kernel@...r.kernel.org>
Cc:	Jens Axboe <jens.axboe@...cle.com>
Subject: Re: How to flush the disk write cache from userspace

Ricardo Correia wrote:
> On Tuesday 16 January 2007 00:38, you wrote:
>> As always with these things, the devil is in the details. It requires
>> the device to support a ->prepare_flush() queue hook, and not all
>> devices do that. It will work for IDE/SATA/SCSI, though. In some devices
>> you don't want/need to do a real disk flush, it depends on the write
>> cache settings, battery backing, etc.
> 
> Is there any chance that someone could implement this (I don't have the 
> skills, unfortunately)? Maybe add a new ioctl() to block devices, so that it 
> doesn't break any existing code?

I think we really should have support for doing cache flushes 
automatically on fsync, etc. User space code should not have to worry 
about this problem, it's pretty silly that for example MySQL has to 
advise people to use hdparm -W 0 to disable the write cache on their IDE 
drives in order to get proper data integrity guarantees - and disabling 
the cache on IDE without command queueing really slaughters the 
performance, unnecessarily in this case.

There may be some cases where the controller provides a battery-backed 
cache and thus we don't want to actually force the controller to flush 
everything out to the drive on fsync, so we may need to be able to 
disable this, but these controllers may ignore flushes anyway. I know 
IBM ServeRAID appears to fail requests for write cache info and so the 
kernel assumes drive cache: write through and doesn't do any flushes.

> 
> I believe it's a very useful (and relatively simple) feature that increases 
> data integrity and reliability for applications that need this functionality.
> 
> I think it must be considered that most people have disk write caches enabled 
> and are using IDE, SATA or SCSI disks.
> 
> I also think there's no point in disabling disks' write caches, since it slows 
> writes and decreases disks' lifetime, and because there's a better solution.

Yes, ideally doing all writes to the drive with write cache enabled and 
then flushing them out afterwards would be much more efficient (at least 
  when no command queueing is involved) since the drive can choose what 
order to complete the writes in.

> 
> Personally, I'm not really interested in specific filesystem behaviour, since 
> my application uses block devices directly (it's a filesystem itself). 
> Although I think all filesystems should guarantee data integrity in the face 
> of fsync() or metadata modifications, even if it costs a little performance.

-- 
Robert Hancock      Saskatoon, SK, Canada
To email, remove "nospam" from hancockr@...pamshaw.ca
Home Page: http://www.roberthancock.com/

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/