linux-kernel - Re: io-controller: file system meta data operations

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [day] [month] [year] [list]

Message-ID: <20090916173020.GD5221@redhat.com>
Date:	Wed, 16 Sep 2009 13:30:20 -0400
From:	Vivek Goyal <vgoyal@...hat.com>
To:	Tobias Oetiker <tobi@...iker.ch>
Cc:	linux-kernel@...r.kernel.org, Jens Axboe <jens.axboe@...cle.com>,
	Peter Staubach <staubach@...hat.com>
Subject: Re: io-controller: file system meta data operations

On Wed, Sep 16, 2009 at 05:03:11PM +0200, Tobias Oetiker wrote:
> Hi Vivek,
> 
> Today Vivek Goyal wrote:
> 
> > On Wed, Sep 16, 2009 at 02:58:52PM +0200, Tobias Oetiker wrote:
> > > Hi Vivek,
> > >
> > > I am trying to optimize user-experience on a busy NFS server.
> > >
> > > I think much could be achieved if the following was true.
> > >
> > >   get a response to file system meta data operations (opendir,
> > >   readdir, stat, mkdir, unlink) within 200 ms even under heavy
> > >   read/write strain ...
> > >
> >
> > Hi tobi,
> >
> > Is it better with vanilla CFQ (without io controller). I see that CFQ
> > preempts the ongoing process if it receives a meta data request and that
> > way it provides faster response.
> >
> > If yes, then similar thing should work for IO controller also. Wait there
> > is one issue though. If a file system request gets backlogged in a group
> > while a different group was being served, then preemption will not happen
> > and that's probably the reason you are not seeing better latencies.
> 
> I only looked at io-controller once I did not get ahead with
> vanilla cfq ( and the other schedulers for that matter).

Thinking more about it. You need to first identify where the latency is
coming from. io controller can help you in providing better latencies if
latencies are coming from other processes competing for the disk and delay
is coming from the fact that metadata request from nfs thread is blocked
behind other requests.

I see that CFQ preempts a current queue if it is not doing metadata
operation. That means CFQ is providing immediate access to disk(apart from
requests in dispatch queue or in hardware). 

So I am not even sure where the delay is coming from. Once we figure that
out, I can tell whether io controller will help you or not. In general, io
controller will be able to help you if delay is coming from the IO
scheduler because you are queued behind other requests. But in case of
CFQ, that does not seem to be the case.

Can you do some blktraces and figure out where the delay is coming from?

Thanks
Vivek
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/