lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <20120130140109.GA15682@localhost>
Date:	Mon, 30 Jan 2012 22:01:09 +0800
From:	Wu Fengguang <wfg@...ux.intel.com>
To:	Eric Dumazet <eric.dumazet@...il.com>
Cc:	Andrew Morton <akpm@...ux-foundation.org>,
	LKML <linux-kernel@...r.kernel.org>,
	Jens Axboe <axboe@...nel.dk>, Tejun Heo <tj@...nel.org>,
	Li Shaohua <shaohua.li@...el.com>,
	Herbert Poetzl <herbert@...hfloor.at>
Subject: Re: Bad SSD performance with recent kernels

On Mon, Jan 30, 2012 at 01:34:56PM +0100, Eric Dumazet wrote:
> Le lundi 30 janvier 2012 à 19:18 +0800, Wu Fengguang a écrit :
> 
> > I agree with Shaohua that there may be timing/plug issues. There
> > happen to be some plug patches and (maybe correlated) big performance
> > drop between 2.6.38 and 2.6.39. The obvious way to move forward is to
> > get some blktrace data on simple dd + new buggy kernel and let's check
> > what's exactly going on.
> > 
> > # start a background dd read
> > blktrace /dev/sda -w 10
> > blkparse -t sda
> > 
> 
> (Another machine here at office, hence /dev/sdb)
> 
> echo 3 >/proc/sys/vm/drop_caches ;dd if=/dev/sdb of=/dev/null bs=2M
> count=2048
> 2048+0 enregistrements lus
> 2048+0 enregistrements écrits
> 4294967296 octets (4,3 GB) copiés, 26,0278 s, 165 MB/s
> 
> # blktrace /dev/sdb -w 10
> === sdb ===
>   CPU  0:                44766 events,     2099 KiB data
>   CPU  1:               828895 events,    38855 KiB data
>   Total:                873661 events (dropped 0),    40953 KiB data
> 
> blkparse result is huge (55Mo)
> 
> # blkparse -t sdb | tail -n 1000 

Thanks for the data!

It shows that

- IO size is 256KB (which is not a problem in itself)

- The dispatch/complete pattern is

        submit IO for range 1
        complete IO for range 1
        <dd busy, disk idle>
        submit IO for range 2
        complete IO for range 2

  So we have periods that no IO is in flight at all, which leads to
  under-utilized disk (which should show up in iostat as <100% disk util)

# grep '[DC]' blktrace

  8,16   1   770606     9.990039807  4580  D   R 4379392 + 512 (   14826) [dd]
  8,16   1   770607     9.991083069     0  C   R 4379392 + 512 ( 1043262) [0]

  8,16   1   770739     9.991647434  4580  D   R 4379904 + 512 (   14433) [dd]
  8,16   1   770740     9.992693317     0  C   R 4379904 + 512 ( 1045883) [0]

  8,16   1   770872     9.993256451  4580  D   R 4380416 + 512 (   14539) [dd]
  8,16   1   770873     9.994299156     0  C   R 4380416 + 512 ( 1042705) [0]

  8,16   1   771005     9.994863680  4580  D   R 4380928 + 512 (   14344) [dd]
  8,16   1   771006     9.995909291     0  C   R 4380928 + 512 ( 1045611) [0]

  8,16   1   771138     9.996470460  4580  D   R 4381440 + 512 (   14043) [dd]
  8,16   1   771139     9.997514205     0  C   R 4381440 + 512 ( 1043745) [0]

  8,16   1   771271     9.998077269  4580  D   R 4381952 + 512 (   14928) [dd]
  8,16   1   771272     9.999120396     0  C   R 4381952 + 512 ( 1043127) [0]

Thanks,
Fengguang

>   8,16   1   770475     9.989714963  4580  Q   R 4379392 + 8 [dd]
>   8,16   1   770476     9.989721470  4580  G   R 4379392 + 8 [dd]
>   8,16   1   770477     9.989723546  4580  P   N [dd]
>   8,16   1   770478     9.989726994  4580  Q   R 4379400 + 8 [dd]
>   8,16   1   770479     9.989728858  4580  M   R 4379400 + 8 [dd]
>   8,16   1   770480     9.989731893  4580  Q   R 4379408 + 8 [dd]
>   8,16   1   770481     9.989732467  4580  M   R 4379408 + 8 [dd]
>   8,16   1   770482     9.989734574  4580  Q   R 4379416 + 8 [dd]
>   8,16   1   770483     9.989735108  4580  M   R 4379416 + 8 [dd]
>   8,16   1   770484     9.989737220  4580  Q   R 4379424 + 8 [dd]
>   8,16   1   770485     9.989737721  4580  M   R 4379424 + 8 [dd]
>   8,16   1   770486     9.989739953  4580  Q   R 4379432 + 8 [dd]
>   8,16   1   770487     9.989740450  4580  M   R 4379432 + 8 [dd]
>   8,16   1   770488     9.989742577  4580  Q   R 4379440 + 8 [dd]
>   8,16   1   770489     9.989743078  4580  M   R 4379440 + 8 [dd]
>   8,16   1   770490     9.989745241  4580  Q   R 4379448 + 8 [dd]
>   8,16   1   770491     9.989745742  4580  M   R 4379448 + 8 [dd]
>   8,16   1   770492     9.989747953  4580  Q   R 4379456 + 8 [dd]
>   8,16   1   770493     9.989748485  4580  M   R 4379456 + 8 [dd]
>   8,16   1   770494     9.989750726  4580  Q   R 4379464 + 8 [dd]
>   8,16   1   770495     9.989751225  4580  M   R 4379464 + 8 [dd]
>   8,16   1   770496     9.989753390  4580  Q   R 4379472 + 8 [dd]
>   8,16   1   770497     9.989753891  4580  M   R 4379472 + 8 [dd]
>   8,16   1   770498     9.989755928  4580  Q   R 4379480 + 8 [dd]
>   8,16   1   770499     9.989756429  4580  M   R 4379480 + 8 [dd]
>   8,16   1   770500     9.989758470  4580  Q   R 4379488 + 8 [dd]
>   8,16   1   770501     9.989758975  4580  M   R 4379488 + 8 [dd]
>   8,16   1   770502     9.989765725  4580  Q   R 4379496 + 8 [dd]
>   8,16   1   770503     9.989766222  4580  M   R 4379496 + 8 [dd]
>   8,16   1   770504     9.989768362  4580  Q   R 4379504 + 8 [dd]
>   8,16   1   770505     9.989768864  4580  M   R 4379504 + 8 [dd]
>   8,16   1   770506     9.989771157  4580  Q   R 4379512 + 8 [dd]
>   8,16   1   770507     9.989771662  4580  M   R 4379512 + 8 [dd]
>   8,16   1   770508     9.989775151  4580  Q   R 4379520 + 8 [dd]
>   8,16   1   770509     9.989775649  4580  M   R 4379520 + 8 [dd]
>   8,16   1   770510     9.989781743  4580  Q   R 4379528 + 8 [dd]
>   8,16   1   770511     9.989782248  4580  M   R 4379528 + 8 [dd]
>   8,16   1   770512     9.989784532  4580  Q   R 4379536 + 8 [dd]
>   8,16   1   770513     9.989785033  4580  M   R 4379536 + 8 [dd]
>   8,16   1   770514     9.989787291  4580  Q   R 4379544 + 8 [dd]
>   8,16   1   770515     9.989787792  4580  M   R 4379544 + 8 [dd]
>   8,16   1   770516     9.989790041  4580  Q   R 4379552 + 8 [dd]
>   8,16   1   770517     9.989790540  4580  M   R 4379552 + 8 [dd]
>   8,16   1   770518     9.989792607  4580  Q   R 4379560 + 8 [dd]
>   8,16   1   770519     9.989793104  4580  M   R 4379560 + 8 [dd]
>   8,16   1   770520     9.989795693  4580  Q   R 4379568 + 8 [dd]
>   8,16   1   770521     9.989796191  4580  M   R 4379568 + 8 [dd]
>   8,16   1   770522     9.989798349  4580  Q   R 4379576 + 8 [dd]
>   8,16   1   770523     9.989798847  4580  M   R 4379576 + 8 [dd]
>   8,16   1   770524     9.989800877  4580  Q   R 4379584 + 8 [dd]
>   8,16   1   770525     9.989801581  4580  M   R 4379584 + 8 [dd]
>   8,16   1   770526     9.989803693  4580  Q   R 4379592 + 8 [dd]
>   8,16   1   770527     9.989804221  4580  M   R 4379592 + 8 [dd]
>   8,16   1   770528     9.989806399  4580  Q   R 4379600 + 8 [dd]
>   8,16   1   770529     9.989806901  4580  M   R 4379600 + 8 [dd]
>   8,16   1   770530     9.989812437  4580  Q   R 4379608 + 8 [dd]
>   8,16   1   770531     9.989812938  4580  M   R 4379608 + 8 [dd]
>   8,16   1   770532     9.989814981  4580  Q   R 4379616 + 8 [dd]
>   8,16   1   770533     9.989815482  4580  M   R 4379616 + 8 [dd]
>   8,16   1   770534     9.989818053  4580  Q   R 4379624 + 8 [dd]
>   8,16   1   770535     9.989818551  4580  M   R 4379624 + 8 [dd]
>   8,16   1   770536     9.989820795  4580  Q   R 4379632 + 8 [dd]
>   8,16   1   770537     9.989821296  4580  M   R 4379632 + 8 [dd]
>   8,16   1   770538     9.989823436  4580  Q   R 4379640 + 8 [dd]
>   8,16   1   770539     9.989823937  4580  M   R 4379640 + 8 [dd]
>   8,16   1   770540     9.989929502  4580  Q   R 4379648 + 8 [dd]
>   8,16   1   770541     9.989930247  4580  M   R 4379648 + 8 [dd]
>   8,16   1   770542     9.989933189  4580  Q   R 4379656 + 8 [dd]
>   8,16   1   770543     9.989933705  4580  M   R 4379656 + 8 [dd]
>   8,16   1   770544     9.989935909  4580  Q   R 4379664 + 8 [dd]
>   8,16   1   770545     9.989936411  4580  M   R 4379664 + 8 [dd]
>   8,16   1   770546     9.989938572  4580  Q   R 4379672 + 8 [dd]
>   8,16   1   770547     9.989939072  4580  M   R 4379672 + 8 [dd]
>   8,16   1   770548     9.989941272  4580  Q   R 4379680 + 8 [dd]
>   8,16   1   770549     9.989941770  4580  M   R 4379680 + 8 [dd]
>   8,16   1   770550     9.989943952  4580  Q   R 4379688 + 8 [dd]
>   8,16   1   770551     9.989944450  4580  M   R 4379688 + 8 [dd]
>   8,16   1   770552     9.989946991  4580  Q   R 4379696 + 8 [dd]
>   8,16   1   770553     9.989947492  4580  M   R 4379696 + 8 [dd]
>   8,16   1   770554     9.989949671  4580  Q   R 4379704 + 8 [dd]
>   8,16   1   770555     9.989950172  4580  M   R 4379704 + 8 [dd]
>   8,16   1   770556     9.989952330  4580  Q   R 4379712 + 8 [dd]
>   8,16   1   770557     9.989952832  4580  M   R 4379712 + 8 [dd]
>   8,16   1   770558     9.989958393  4580  Q   R 4379720 + 8 [dd]
>   8,16   1   770559     9.989958891  4580  M   R 4379720 + 8 [dd]
>   8,16   1   770560     9.989961097  4580  Q   R 4379728 + 8 [dd]
>   8,16   1   770561     9.989961598  4580  M   R 4379728 + 8 [dd]
>   8,16   1   770562     9.989963825  4580  Q   R 4379736 + 8 [dd]
>   8,16   1   770563     9.989964331  4580  M   R 4379736 + 8 [dd]
>   8,16   1   770564     9.989966623  4580  Q   R 4379744 + 8 [dd]
>   8,16   1   770565     9.989967122  4580  M   R 4379744 + 8 [dd]
>   8,16   1   770566     9.989969303  4580  Q   R 4379752 + 8 [dd]
>   8,16   1   770567     9.989969800  4580  M   R 4379752 + 8 [dd]
>   8,16   1   770568     9.989971886  4580  Q   R 4379760 + 8 [dd]
>   8,16   1   770569     9.989972388  4580  M   R 4379760 + 8 [dd]
>   8,16   1   770570     9.989974789  4580  Q   R 4379768 + 8 [dd]
>   8,16   1   770571     9.989975290  4580  M   R 4379768 + 8 [dd]
>   8,16   1   770572     9.989977480  4580  Q   R 4379776 + 8 [dd]
>   8,16   1   770573     9.989977981  4580  M   R 4379776 + 8 [dd]
>   8,16   1   770574     9.989981251  4580  Q   R 4379784 + 8 [dd]
>   8,16   1   770575     9.989981749  4580  M   R 4379784 + 8 [dd]
>   8,16   1   770576     9.989984018  4580  Q   R 4379792 + 8 [dd]
>   8,16   1   770577     9.989984519  4580  M   R 4379792 + 8 [dd]
>   8,16   1   770578     9.989986711  4580  Q   R 4379800 + 8 [dd]
>   8,16   1   770579     9.989987222  4580  M   R 4379800 + 8 [dd]
>   8,16   1   770580     9.989989414  4580  Q   R 4379808 + 8 [dd]
>   8,16   1   770581     9.989989915  4580  M   R 4379808 + 8 [dd]
>   8,16   1   770582     9.989992107  4580  Q   R 4379816 + 8 [dd]
>   8,16   1   770583     9.989992617  4580  M   R 4379816 + 8 [dd]
>   8,16   1   770584     9.989994776  4580  Q   R 4379824 + 8 [dd]
>   8,16   1   770585     9.989995276  4580  M   R 4379824 + 8 [dd]
>   8,16   1   770586     9.990000570  4580  Q   R 4379832 + 8 [dd]
>   8,16   1   770587     9.990001076  4580  M   R 4379832 + 8 [dd]
>   8,16   1   770588     9.990003264  4580  Q   R 4379840 + 8 [dd]
>   8,16   1   770589     9.990003785  4580  M   R 4379840 + 8 [dd]
>   8,16   1   770590     9.990005849  4580  Q   R 4379848 + 8 [dd]
>   8,16   1   770591     9.990006354  4580  M   R 4379848 + 8 [dd]
>   8,16   1   770592     9.990008472  4580  Q   R 4379856 + 8 [dd]
>   8,16   1   770593     9.990008986  4580  M   R 4379856 + 8 [dd]
>   8,16   1   770594     9.990011382  4580  Q   R 4379864 + 8 [dd]
>   8,16   1   770595     9.990011884  4580  M   R 4379864 + 8 [dd]
>   8,16   1   770596     9.990014066  4580  Q   R 4379872 + 8 [dd]
>   8,16   1   770597     9.990014568  4580  M   R 4379872 + 8 [dd]
>   8,16   1   770598     9.990016740  4580  Q   R 4379880 + 8 [dd]
>   8,16   1   770599     9.990017237  4580  M   R 4379880 + 8 [dd]
>   8,16   1   770600     9.990019491  4580  Q   R 4379888 + 8 [dd]
>   8,16   1   770601     9.990020001  4580  M   R 4379888 + 8 [dd]
>   8,16   1   770602     9.990022222  4580  Q   R 4379896 + 8 [dd]
>   8,16   1   770603     9.990022723  4580  M   R 4379896 + 8 [dd]
>   8,16   1   770604     9.990024981  4580  I   R 4379392 + 512 (  303511) [dd]
>   8,16   1        0     9.990027734     0  m   N cfq4580S / insert_request
>   8,16   1   770605     9.990031216  4580  U   N [dd] 1
>   8,16   1        0     9.990033792     0  m   N cfq4580S / dispatch_insert
>   8,16   1        0     9.990037429     0  m   N cfq4580S / dispatched a request
>   8,16   1        0     9.990039146     0  m   N cfq4580S / activate rq, drv=1
>   8,16   1   770606     9.990039807  4580  D   R 4379392 + 512 (   14826) [dd]
>   8,16   1   770607     9.991083069     0  C   R 4379392 + 512 ( 1043262) [0]
>   8,16   1        0     9.991155388     0  m   N cfq4580S / complete rqnoidle 0
>   8,16   1        0     9.991158292     0  m   N cfq schedule dispatch
>   8,16   1   770608     9.991321889  4580  Q   R 4379904 + 8 [dd]
>   8,16   1   770609     9.991328302  4580  G   R 4379904 + 8 [dd]
>   8,16   1   770610     9.991330287  4580  P   N [dd]
>   8,16   1   770611     9.991333624  4580  Q   R 4379912 + 8 [dd]
>   8,16   1   770612     9.991335576  4580  M   R 4379912 + 8 [dd]
>   8,16   1   770613     9.991338586  4580  Q   R 4379920 + 8 [dd]
>   8,16   1   770614     9.991339095  4580  M   R 4379920 + 8 [dd]
>   8,16   1   770615     9.991341209  4580  Q   R 4379928 + 8 [dd]
>   8,16   1   770616     9.991341909  4580  M   R 4379928 + 8 [dd]
>   8,16   1   770617     9.991344208  4580  Q   R 4379936 + 8 [dd]
>   8,16   1   770618     9.991344707  4580  M   R 4379936 + 8 [dd]
>   8,16   1   770619     9.991351891  4580  Q   R 4379944 + 8 [dd]
>   8,16   1   770620     9.991352393  4580  M   R 4379944 + 8 [dd]
>   8,16   1   770621     9.991354635  4580  Q   R 4379952 + 8 [dd]
>   8,16   1   770622     9.991355134  4580  M   R 4379952 + 8 [dd]
>   8,16   1   770623     9.991357304  4580  Q   R 4379960 + 8 [dd]
>   8,16   1   770624     9.991357809  4580  M   R 4379960 + 8 [dd]
>   8,16   1   770625     9.991359960  4580  Q   R 4379968 + 8 [dd]
>   8,16   1   770626     9.991360458  4580  M   R 4379968 + 8 [dd]
>   8,16   1   770627     9.991362540  4580  Q   R 4379976 + 8 [dd]
>   8,16   1   770628     9.991363044  4580  M   R 4379976 + 8 [dd]
>   8,16   1   770629     9.991366526  4580  Q   R 4379984 + 8 [dd]
>   8,16   1   770630     9.991367025  4580  M   R 4379984 + 8 [dd]
>   8,16   1   770631     9.991369183  4580  Q   R 4379992 + 8 [dd]
>   8,16   1   770632     9.991369681  4580  M   R 4379992 + 8 [dd]
>   8,16   1   770633     9.991371837  4580  Q   R 4380000 + 8 [dd]
>   8,16   1   770634     9.991372336  4580  M   R 4380000 + 8 [dd]
>   8,16   1   770635     9.991374518  4580  Q   R 4380008 + 8 [dd]
>   8,16   1   770636     9.991375031  4580  M   R 4380008 + 8 [dd]
>   8,16   1   770637     9.991377249  4580  Q   R 4380016 + 8 [dd]
>   8,16   1   770638     9.991377748  4580  M   R 4380016 + 8 [dd]
>   8,16   1   770639     9.991379891  4580  Q   R 4380024 + 8 [dd]
>   8,16   1   770640     9.991380390  4580  M   R 4380024 + 8 [dd]
>   8,16   1   770641     9.991382585  4580  Q   R 4380032 + 8 [dd]
>   8,16   1   770642     9.991383084  4580  M   R 4380032 + 8 [dd]
>   8,16   1   770643     9.991385207  4580  Q   R 4380040 + 8 [dd]
>   8,16   1   770644     9.991385704  4580  M   R 4380040 + 8 [dd]
>   8,16   1   770645     9.991387897  4580  Q   R 4380048 + 8 [dd]
>   8,16   1   770646     9.991388396  4580  M   R 4380048 + 8 [dd]
>   8,16   1   770647     9.991393804  4580  Q   R 4380056 + 8 [dd]
>   8,16   1   770648     9.991394303  4580  M   R 4380056 + 8 [dd]
>   8,16   1   770649     9.991396440  4580  Q   R 4380064 + 8 [dd]
>   8,16   1   770650     9.991396938  4580  M   R 4380064 + 8 [dd]
>   8,16   1   770651     9.991398996  4580  Q   R 4380072 + 8 [dd]
>   8,16   1   770652     9.991399500  4580  M   R 4380072 + 8 [dd]
>   8,16   1   770653     9.991401608  4580  Q   R 4380080 + 8 [dd]
>   8,16   1   770654     9.991402107  4580  M   R 4380080 + 8 [dd]
>   8,16   1   770655     9.991404535  4580  Q   R 4380088 + 8 [dd]
>   8,16   1   770656     9.991405034  4580  M   R 4380088 + 8 [dd]
>   8,16   1   770657     9.991407171  4580  Q   R 4380096 + 8 [dd]
>   8,16   1   770658     9.991407671  4580  M   R 4380096 + 8 [dd]
>   8,16   1   770659     9.991409829  4580  Q   R 4380104 + 8 [dd]
>   8,16   1   770660     9.991410339  4580  M   R 4380104 + 8 [dd]
>   8,16   1   770661     9.991416346  4580  Q   R 4380112 + 8 [dd]
>   8,16   1   770662     9.991416853  4580  M   R 4380112 + 8 [dd]
>   8,16   1   770663     9.991419016  4580  Q   R 4380120 + 8 [dd]
>   8,16   1   770664     9.991419515  4580  M   R 4380120 + 8 [dd]
>   8,16   1   770665     9.991421984  4580  Q   R 4380128 + 8 [dd]
>   8,16   1   770666     9.991422483  4580  M   R 4380128 + 8 [dd]
>   8,16   1   770667     9.991424780  4580  Q   R 4380136 + 8 [dd]
>   8,16   1   770668     9.991425284  4580  M   R 4380136 + 8 [dd]
>   8,16   1   770669     9.991427479  4580  Q   R 4380144 + 8 [dd]
>   8,16   1   770670     9.991427978  4580  M   R 4380144 + 8 [dd]
>   8,16   1   770671     9.991430076  4580  Q   R 4380152 + 8 [dd]
>   8,16   1   770672     9.991430575  4580  M   R 4380152 + 8 [dd]
>   8,16   1   770673     9.991536122  4580  Q   R 4380160 + 8 [dd]
>   8,16   1   770674     9.991536827  4580  M   R 4380160 + 8 [dd]
>   8,16   1   770675     9.991543663  4580  Q   R 4380168 + 8 [dd]
>   8,16   1   770676     9.991544181  4580  M   R 4380168 + 8 [dd]
>   8,16   1   770677     9.991546458  4580  Q   R 4380176 + 8 [dd]
>   8,16   1   770678     9.991546957  4580  M   R 4380176 + 8 [dd]
>   8,16   1   770679     9.991549153  4580  Q   R 4380184 + 8 [dd]
>   8,16   1   770680     9.991549652  4580  M   R 4380184 + 8 [dd]
>   8,16   1   770681     9.991551902  4580  Q   R 4380192 + 8 [dd]
>   8,16   1   770682     9.991552400  4580  M   R 4380192 + 8 [dd]
>   8,16   1   770683     9.991554621  4580  Q   R 4380200 + 8 [dd]
>   8,16   1   770684     9.991555113  4580  M   R 4380200 + 8 [dd]
>   8,16   1   770685     9.991557325  4580  Q   R 4380208 + 8 [dd]
>   8,16   1   770686     9.991557824  4580  M   R 4380208 + 8 [dd]
>   8,16   1   770687     9.991560192  4580  Q   R 4380216 + 8 [dd]
>   8,16   1   770688     9.991560732  4580  M   R 4380216 + 8 [dd]
>   8,16   1   770689     9.991562806  4580  Q   R 4380224 + 8 [dd]
>   8,16   1   770690     9.991563305  4580  M   R 4380224 + 8 [dd]
>   8,16   1   770691     9.991565370  4580  Q   R 4380232 + 8 [dd]
>   8,16   1   770692     9.991565874  4580  M   R 4380232 + 8 [dd]
>   8,16   1   770693     9.991567969  4580  Q   R 4380240 + 8 [dd]
>   8,16   1   770694     9.991568468  4580  M   R 4380240 + 8 [dd]
>   8,16   1   770695     9.991570671  4580  Q   R 4380248 + 8 [dd]
>   8,16   1   770696     9.991571170  4580  M   R 4380248 + 8 [dd]
>   8,16   1   770697     9.991573285  4580  Q   R 4380256 + 8 [dd]
>   8,16   1   770698     9.991573783  4580  M   R 4380256 + 8 [dd]
>   8,16   1   770699     9.991575855  4580  Q   R 4380264 + 8 [dd]
>   8,16   1   770700     9.991576358  4580  M   R 4380264 + 8 [dd]
>   8,16   1   770701     9.991578551  4580  Q   R 4380272 + 8 [dd]
>   8,16   1   770702     9.991579050  4580  M   R 4380272 + 8 [dd]
>   8,16   1   770703     9.991584418  4580  Q   R 4380280 + 8 [dd]
>   8,16   1   770704     9.991584916  4580  M   R 4380280 + 8 [dd]
>   8,16   1   770705     9.991587004  4580  Q   R 4380288 + 8 [dd]
>   8,16   1   770706     9.991587503  4580  M   R 4380288 + 8 [dd]
>   8,16   1   770707     9.991589615  4580  Q   R 4380296 + 8 [dd]
>   8,16   1   770708     9.991590128  4580  M   R 4380296 + 8 [dd]
>   8,16   1   770709     9.991592390  4580  Q   R 4380304 + 8 [dd]
>   8,16   1   770710     9.991592907  4580  M   R 4380304 + 8 [dd]
>   8,16   1   770711     9.991594957  4580  Q   R 4380312 + 8 [dd]
>   8,16   1   770712     9.991595456  4580  M   R 4380312 + 8 [dd]
>   8,16   1   770713     9.991597599  4580  Q   R 4380320 + 8 [dd]
>   8,16   1   770714     9.991598098  4580  M   R 4380320 + 8 [dd]
>   8,16   1   770715     9.991600165  4580  Q   R 4380328 + 8 [dd]
>   8,16   1   770716     9.991600669  4580  M   R 4380328 + 8 [dd]
>   8,16   1   770717     9.991602915  4580  Q   R 4380336 + 8 [dd]
>   8,16   1   770718     9.991603413  4580  M   R 4380336 + 8 [dd]
>   8,16   1   770719     9.991605563  4580  Q   R 4380344 + 8 [dd]
>   8,16   1   770720     9.991606061  4580  M   R 4380344 + 8 [dd]
>   8,16   1   770721     9.991608110  4580  Q   R 4380352 + 8 [dd]
>   8,16   1   770722     9.991608609  4580  M   R 4380352 + 8 [dd]
>   8,16   1   770723     9.991610674  4580  Q   R 4380360 + 8 [dd]
>   8,16   1   770724     9.991611178  4580  M   R 4380360 + 8 [dd]
>   8,16   1   770725     9.991613249  4580  Q   R 4380368 + 8 [dd]
>   8,16   1   770726     9.991613748  4580  M   R 4380368 + 8 [dd]
>   8,16   1   770727     9.991616309  4580  Q   R 4380376 + 8 [dd]
>   8,16   1   770728     9.991616808  4580  M   R 4380376 + 8 [dd]
>   8,16   1   770729     9.991619009  4580  Q   R 4380384 + 8 [dd]
>   8,16   1   770730     9.991619507  4580  M   R 4380384 + 8 [dd]
>   8,16   1   770731     9.991624896  4580  Q   R 4380392 + 8 [dd]
>   8,16   1   770732     9.991625401  4580  M   R 4380392 + 8 [dd]
>   8,16   1   770733     9.991627620  4580  Q   R 4380400 + 8 [dd]
>   8,16   1   770734     9.991628119  4580  M   R 4380400 + 8 [dd]
>   8,16   1   770735     9.991630192  4580  Q   R 4380408 + 8 [dd]
>   8,16   1   770736     9.991630690  4580  M   R 4380408 + 8 [dd]
>   8,16   1   770737     9.991633001  4580  I   R 4379904 + 512 (  304699) [dd]
>   8,16   1        0     9.991635738     0  m   N cfq4580S / insert_request
>   8,16   1   770738     9.991638988  4580  U   N [dd] 1
>   8,16   1        0     9.991641665     0  m   N cfq4580S / dispatch_insert
>   8,16   1        0     9.991645149     0  m   N cfq4580S / dispatched a request
>   8,16   1        0     9.991646825     0  m   N cfq4580S / activate rq, drv=1
>   8,16   1   770739     9.991647434  4580  D   R 4379904 + 512 (   14433) [dd]
>   8,16   1   770740     9.992693317     0  C   R 4379904 + 512 ( 1045883) [0]
>   8,16   1        0     9.992766012     0  m   N cfq4580S / complete rqnoidle 0
>   8,16   1        0     9.992768895     0  m   N cfq schedule dispatch
>   8,16   1   770741     9.992932816  4580  Q   R 4380416 + 8 [dd]
>   8,16   1   770742     9.992939152  4580  G   R 4380416 + 8 [dd]
>   8,16   1   770743     9.992941241  4580  P   N [dd]
>   8,16   1   770744     9.992944673  4580  Q   R 4380424 + 8 [dd]
>   8,16   1   770745     9.992946529  4580  M   R 4380424 + 8 [dd]
>   8,16   1   770746     9.992949525  4580  Q   R 4380432 + 8 [dd]
>   8,16   1   770747     9.992950035  4580  M   R 4380432 + 8 [dd]
>   8,16   1   770748     9.992952218  4580  Q   R 4380440 + 8 [dd]
>   8,16   1   770749     9.992952765  4580  M   R 4380440 + 8 [dd]
>   8,16   1   770750     9.992954867  4580  Q   R 4380448 + 8 [dd]
>   8,16   1   770751     9.992955366  4580  M   R 4380448 + 8 [dd]
>   8,16   1   770752     9.992957451  4580  Q   R 4380456 + 8 [dd]
>   8,16   1   770753     9.992957956  4580  M   R 4380456 + 8 [dd]
>   8,16   1   770754     9.992960073  4580  Q   R 4380464 + 8 [dd]
>   8,16   1   770755     9.992960572  4580  M   R 4380464 + 8 [dd]
>   8,16   1   770756     9.992962600  4580  Q   R 4380472 + 8 [dd]
>   8,16   1   770757     9.992963104  4580  M   R 4380472 + 8 [dd]
>   8,16   1   770758     9.992965247  4580  Q   R 4380480 + 8 [dd]
>   8,16   1   770759     9.992965753  4580  M   R 4380480 + 8 [dd]
>   8,16   1   770760     9.992967787  4580  Q   R 4380488 + 8 [dd]
>   8,16   1   770761     9.992968284  4580  M   R 4380488 + 8 [dd]
>   8,16   1   770762     9.992970602  4580  Q   R 4380496 + 8 [dd]
>   8,16   1   770763     9.992971101  4580  M   R 4380496 + 8 [dd]
>   8,16   1   770764     9.992978036  4580  Q   R 4380504 + 8 [dd]
>   8,16   1   770765     9.992978575  4580  M   R 4380504 + 8 [dd]
>   8,16   1   770766     9.992980800  4580  Q   R 4380512 + 8 [dd]
>   8,16   1   770767     9.992981312  4580  M   R 4380512 + 8 [dd]
>   8,16   1   770768     9.992983463  4580  Q   R 4380520 + 8 [dd]
>   8,16   1   770769     9.992983976  4580  M   R 4380520 + 8 [dd]
>   8,16   1   770770     9.992986141  4580  Q   R 4380528 + 8 [dd]
>   8,16   1   770771     9.992986652  4580  M   R 4380528 + 8 [dd]
>   8,16   1   770772     9.992988835  4580  Q   R 4380536 + 8 [dd]
>   8,16   1   770773     9.992989338  4580  M   R 4380536 + 8 [dd]
>   8,16   1   770774     9.992991462  4580  Q   R 4380544 + 8 [dd]
>   8,16   1   770775     9.992991961  4580  M   R 4380544 + 8 [dd]
>   8,16   1   770776     9.992994020  4580  Q   R 4380552 + 8 [dd]
>   8,16   1   770777     9.992994519  4580  M   R 4380552 + 8 [dd]
>   8,16   1   770778     9.992996632  4580  Q   R 4380560 + 8 [dd]
>   8,16   1   770779     9.992997135  4580  M   R 4380560 + 8 [dd]
>   8,16   1   770780     9.992999236  4580  Q   R 4380568 + 8 [dd]
>   8,16   1   770781     9.992999742  4580  M   R 4380568 + 8 [dd]
>   8,16   1   770782     9.993001890  4580  Q   R 4380576 + 8 [dd]
>   8,16   1   770783     9.993002389  4580  M   R 4380576 + 8 [dd]
>   8,16   1   770784     9.993004438  4580  Q   R 4380584 + 8 [dd]
>   8,16   1   770785     9.993004937  4580  M   R 4380584 + 8 [dd]
>   8,16   1   770786     9.993007255  4580  Q   R 4380592 + 8 [dd]
>   8,16   1   770787     9.993007754  4580  M   R 4380592 + 8 [dd]
>   8,16   1   770788     9.993009828  4580  Q   R 4380600 + 8 [dd]
>   8,16   1   770789     9.993010351  4580  M   R 4380600 + 8 [dd]
>   8,16   1   770790     9.993012459  4580  Q   R 4380608 + 8 [dd]
>   8,16   1   770791     9.993012958  4580  M   R 4380608 + 8 [dd]
>   8,16   1   770792     9.993019700  4580  Q   R 4380616 + 8 [dd]
>   8,16   1   770793     9.993020199  4580  M   R 4380616 + 8 [dd]
>   8,16   1   770794     9.993022401  4580  Q   R 4380624 + 8 [dd]
>   8,16   1   770795     9.993022909  4580  M   R 4380624 + 8 [dd]
>   8,16   1   770796     9.993024945  4580  Q   R 4380632 + 8 [dd]
>   8,16   1   770797     9.993025449  4580  M   R 4380632 + 8 [dd]
>   8,16   1   770798     9.993027501  4580  Q   R 4380640 + 8 [dd]
>   8,16   1   770799     9.993027999  4580  M   R 4380640 + 8 [dd]
>   8,16   1   770800     9.993030163  4580  Q   R 4380648 + 8 [dd]
>   8,16   1   770801     9.993030666  4580  M   R 4380648 + 8 [dd]
>   8,16   1   770802     9.993033040  4580  Q   R 4380656 + 8 [dd]
>   8,16   1   770803     9.993033538  4580  M   R 4380656 + 8 [dd]
>   8,16   1   770804     9.993035704  4580  Q   R 4380664 + 8 [dd]
>   8,16   1   770805     9.993036205  4580  M   R 4380664 + 8 [dd]
>   8,16   1   770806     9.993143012  4580  Q   R 4380672 + 8 [dd]
>   8,16   1   770807     9.993143745  4580  M   R 4380672 + 8 [dd]
>   8,16   1   770808     9.993147049  4580  Q   R 4380680 + 8 [dd]
>   8,16   1   770809     9.993147550  4580  M   R 4380680 + 8 [dd]
>   8,16   1   770810     9.993149983  4580  Q   R 4380688 + 8 [dd]
>   8,16   1   770811     9.993150482  4580  M   R 4380688 + 8 [dd]
>   8,16   1   770812     9.993156384  4580  Q   R 4380696 + 8 [dd]
>   8,16   1   770813     9.993156894  4580  M   R 4380696 + 8 [dd]
>   8,16   1   770814     9.993159096  4580  Q   R 4380704 + 8 [dd]
>   8,16   1   770815     9.993159606  4580  M   R 4380704 + 8 [dd]
>   8,16   1   770816     9.993161853  4580  Q   R 4380712 + 8 [dd]
>   8,16   1   770817     9.993162351  4580  M   R 4380712 + 8 [dd]
>   8,16   1   770818     9.993164628  4580  Q   R 4380720 + 8 [dd]
>   8,16   1   770819     9.993165127  4580  M   R 4380720 + 8 [dd]
>   8,16   1   770820     9.993170698  4580  Q   R 4380728 + 8 [dd]
>   8,16   1   770821     9.993171200  4580  M   R 4380728 + 8 [dd]
>   8,16   1   770822     9.993173392  4580  Q   R 4380736 + 8 [dd]
>   8,16   1   770823     9.993173894  4580  M   R 4380736 + 8 [dd]
>   8,16   1   770824     9.993176081  4580  Q   R 4380744 + 8 [dd]
>   8,16   1   770825     9.993176579  4580  M   R 4380744 + 8 [dd]
>   8,16   1   770826     9.993178841  4580  Q   R 4380752 + 8 [dd]
>   8,16   1   770827     9.993179340  4580  M   R 4380752 + 8 [dd]
>   8,16   1   770828     9.993181445  4580  Q   R 4380760 + 8 [dd]
>   8,16   1   770829     9.993181949  4580  M   R 4380760 + 8 [dd]
>   8,16   1   770830     9.993184121  4580  Q   R 4380768 + 8 [dd]
>   8,16   1   770831     9.993184619  4580  M   R 4380768 + 8 [dd]
>   8,16   1   770832     9.993186741  4580  Q   R 4380776 + 8 [dd]
>   8,16   1   770833     9.993187239  4580  M   R 4380776 + 8 [dd]
>   8,16   1   770834     9.993189324  4580  Q   R 4380784 + 8 [dd]
>   8,16   1   770835     9.993189822  4580  M   R 4380784 + 8 [dd]
>   8,16   1   770836     9.993191998  4580  Q   R 4380792 + 8 [dd]
>   8,16   1   770837     9.993192502  4580  M   R 4380792 + 8 [dd]
>   8,16   1   770838     9.993194798  4580  Q   R 4380800 + 8 [dd]
>   8,16   1   770839     9.993195297  4580  M   R 4380800 + 8 [dd]
>   8,16   1   770840     9.993197858  4580  Q   R 4380808 + 8 [dd]
>   8,16   1   770841     9.993198358  4580  M   R 4380808 + 8 [dd]
>   8,16   1   770842     9.993201427  4580  Q   R 4380816 + 8 [dd]
>   8,16   1   770843     9.993201926  4580  M   R 4380816 + 8 [dd]
>   8,16   1   770844     9.993204159  4580  Q   R 4380824 + 8 [dd]
>   8,16   1   770845     9.993204658  4580  M   R 4380824 + 8 [dd]
>   8,16   1   770846     9.993206840  4580  Q   R 4380832 + 8 [dd]
>   8,16   1   770847     9.993207338  4580  M   R 4380832 + 8 [dd]
>   8,16   1   770848     9.993212789  4580  Q   R 4380840 + 8 [dd]
>   8,16   1   770849     9.993213321  4580  M   R 4380840 + 8 [dd]
>   8,16   1   770850     9.993215482  4580  Q   R 4380848 + 8 [dd]
>   8,16   1   770851     9.993215986  4580  M   R 4380848 + 8 [dd]
>   8,16   1   770852     9.993218173  4580  Q   R 4380856 + 8 [dd]
>   8,16   1   770853     9.993218673  4580  M   R 4380856 + 8 [dd]
>   8,16   1   770854     9.993220839  4580  Q   R 4380864 + 8 [dd]
>   8,16   1   770855     9.993221338  4580  M   R 4380864 + 8 [dd]
>   8,16   1   770856     9.993223551  4580  Q   R 4380872 + 8 [dd]
>   8,16   1   770857     9.993224051  4580  M   R 4380872 + 8 [dd]
>   8,16   1   770858     9.993226133  4580  Q   R 4380880 + 8 [dd]
>   8,16   1   770859     9.993226632  4580  M   R 4380880 + 8 [dd]
>   8,16   1   770860     9.993228840  4580  Q   R 4380888 + 8 [dd]
>   8,16   1   770861     9.993229342  4580  M   R 4380888 + 8 [dd]
>   8,16   1   770862     9.993231460  4580  Q   R 4380896 + 8 [dd]
>   8,16   1   770863     9.993231958  4580  M   R 4380896 + 8 [dd]
>   8,16   1   770864     9.993234011  4580  Q   R 4380904 + 8 [dd]
>   8,16   1   770865     9.993234513  4580  M   R 4380904 + 8 [dd]
>   8,16   1   770866     9.993236661  4580  Q   R 4380912 + 8 [dd]
>   8,16   1   770867     9.993237160  4580  M   R 4380912 + 8 [dd]
>   8,16   1   770868     9.993239233  4580  Q   R 4380920 + 8 [dd]
>   8,16   1   770869     9.993239736  4580  M   R 4380920 + 8 [dd]
>   8,16   1   770870     9.993241912  4580  I   R 4380416 + 512 (  302760) [dd]
>   8,16   1        0     9.993244448     0  m   N cfq4580S / insert_request
>   8,16   1   770871     9.993247771  4580  U   N [dd] 1
>   8,16   1        0     9.993250443     0  m   N cfq4580S / dispatch_insert
>   8,16   1        0     9.993254093     0  m   N cfq4580S / dispatched a request
>   8,16   1        0     9.993255838     0  m   N cfq4580S / activate rq, drv=1
>   8,16   1   770872     9.993256451  4580  D   R 4380416 + 512 (   14539) [dd]
>   8,16   1   770873     9.994299156     0  C   R 4380416 + 512 ( 1042705) [0]
>   8,16   1        0     9.994371989     0  m   N cfq4580S / complete rqnoidle 0
>   8,16   1        0     9.994375064     0  m   N cfq schedule dispatch
>   8,16   1   770874     9.994536199  4580  Q   R 4380928 + 8 [dd]
>   8,16   1   770875     9.994542473  4580  G   R 4380928 + 8 [dd]
>   8,16   1   770876     9.994544517  4580  P   N [dd]
>   8,16   1   770877     9.994548013  4580  Q   R 4380936 + 8 [dd]
>   8,16   1   770878     9.994550069  4580  M   R 4380936 + 8 [dd]
>   8,16   1   770879     9.994553102  4580  Q   R 4380944 + 8 [dd]
>   8,16   1   770880     9.994553612  4580  M   R 4380944 + 8 [dd]
>   8,16   1   770881     9.994560750  4580  Q   R 4380952 + 8 [dd]
>   8,16   1   770882     9.994561294  4580  M   R 4380952 + 8 [dd]
>   8,16   1   770883     9.994563660  4580  Q   R 4380960 + 8 [dd]
>   8,16   1   770884     9.994564176  4580  M   R 4380960 + 8 [dd]
>   8,16   1   770885     9.994566309  4580  Q   R 4380968 + 8 [dd]
>   8,16   1   770886     9.994566819  4580  M   R 4380968 + 8 [dd]
>   8,16   1   770887     9.994568963  4580  Q   R 4380976 + 8 [dd]
>   8,16   1   770888     9.994569474  4580  M   R 4380976 + 8 [dd]
>   8,16   1   770889     9.994571592  4580  Q   R 4380984 + 8 [dd]
>   8,16   1   770890     9.994572104  4580  M   R 4380984 + 8 [dd]
>   8,16   1   770891     9.994574265  4580  Q   R 4380992 + 8 [dd]
>   8,16   1   770892     9.994574776  4580  M   R 4380992 + 8 [dd]
>   8,16   1   770893     9.994576861  4580  Q   R 4381000 + 8 [dd]
>   8,16   1   770894     9.994577360  4580  M   R 4381000 + 8 [dd]
>   8,16   1   770895     9.994579582  4580  Q   R 4381008 + 8 [dd]
>   8,16   1   770896     9.994580081  4580  M   R 4381008 + 8 [dd]
>   8,16   1   770897     9.994582161  4580  Q   R 4381016 + 8 [dd]
>   8,16   1   770898     9.994582661  4580  M   R 4381016 + 8 [dd]
>   8,16   1   770899     9.994584717  4580  Q   R 4381024 + 8 [dd]
>   8,16   1   770900     9.994585216  4580  M   R 4381024 + 8 [dd]
>   8,16   1   770901     9.994587324  4580  Q   R 4381032 + 8 [dd]
>   8,16   1   770902     9.994587822  4580  M   R 4381032 + 8 [dd]
>   8,16   1   770903     9.994589915  4580  Q   R 4381040 + 8 [dd]
>   8,16   1   770904     9.994590414  4580  M   R 4381040 + 8 [dd]
>   8,16   1   770905     9.994594071  4580  Q   R 4381048 + 8 [dd]
>   8,16   1   770906     9.994594575  4580  M   R 4381048 + 8 [dd]
>   8,16   1   770907     9.994596896  4580  Q   R 4381056 + 8 [dd]
>   8,16   1   770908     9.994597407  4580  M   R 4381056 + 8 [dd]
>   8,16   1   770909     9.994602878  4580  Q   R 4381064 + 8 [dd]
>   8,16   1   770910     9.994603394  4580  M   R 4381064 + 8 [dd]
>   8,16   1   770911     9.994605653  4580  Q   R 4381072 + 8 [dd]
>   8,16   1   770912     9.994606164  4580  M   R 4381072 + 8 [dd]
>   8,16   1   770913     9.994608528  4580  Q   R 4381080 + 8 [dd]
>   8,16   1   770914     9.994609040  4580  M   R 4381080 + 8 [dd]
>   8,16   1   770915     9.994611239  4580  Q   R 4381088 + 8 [dd]
>   8,16   1   770916     9.994611751  4580  M   R 4381088 + 8 [dd]
>   8,16   1   770917     9.994613936  4580  Q   R 4381096 + 8 [dd]
>   8,16   1   770918     9.994614447  4580  M   R 4381096 + 8 [dd]
>   8,16   1   770919     9.994616718  4580  Q   R 4381104 + 8 [dd]
>   8,16   1   770920     9.994617229  4580  M   R 4381104 + 8 [dd]
>   8,16   1   770921     9.994619394  4580  Q   R 4381112 + 8 [dd]
>   8,16   1   770922     9.994619905  4580  M   R 4381112 + 8 [dd]
>   8,16   1   770923     9.994622152  4580  Q   R 4381120 + 8 [dd]
>   8,16   1   770924     9.994622663  4580  M   R 4381120 + 8 [dd]
>   8,16   1   770925     9.994624765  4580  Q   R 4381128 + 8 [dd]
>   8,16   1   770926     9.994625294  4580  M   R 4381128 + 8 [dd]
>   8,16   1   770927     9.994627643  4580  Q   R 4381136 + 8 [dd]
>   8,16   1   770928     9.994628172  4580  M   R 4381136 + 8 [dd]
>   8,16   1   770929     9.994630638  4580  Q   R 4381144 + 8 [dd]
>   8,16   1   770930     9.994631141  4580  M   R 4381144 + 8 [dd]
>   8,16   1   770931     9.994633374  4580  Q   R 4381152 + 8 [dd]
>   8,16   1   770932     9.994633885  4580  M   R 4381152 + 8 [dd]
>   8,16   1   770933     9.994636086  4580  Q   R 4381160 + 8 [dd]
>   8,16   1   770934     9.994636592  4580  M   R 4381160 + 8 [dd]
>   8,16   1   770935     9.994638779  4580  Q   R 4381168 + 8 [dd]
>   8,16   1   770936     9.994639291  4580  M   R 4381168 + 8 [dd]
>   8,16   1   770937     9.994644640  4580  Q   R 4381176 + 8 [dd]
>   8,16   1   770938     9.994645153  4580  M   R 4381176 + 8 [dd]
>   8,16   1   770939     9.994750984  4580  Q   R 4381184 + 8 [dd]
>   8,16   1   770940     9.994751713  4580  M   R 4381184 + 8 [dd]
>   8,16   1   770941     9.994754423  4580  Q   R 4381192 + 8 [dd]
>   8,16   1   770942     9.994754936  4580  M   R 4381192 + 8 [dd]
>   8,16   1   770943     9.994757220  4580  Q   R 4381200 + 8 [dd]
>   8,16   1   770944     9.994757719  4580  M   R 4381200 + 8 [dd]
>   8,16   1   770945     9.994759967  4580  Q   R 4381208 + 8 [dd]
>   8,16   1   770946     9.994760506  4580  M   R 4381208 + 8 [dd]
>   8,16   1   770947     9.994762743  4580  Q   R 4381216 + 8 [dd]
>   8,16   1   770948     9.994763242  4580  M   R 4381216 + 8 [dd]
>   8,16   1   770949     9.994765425  4580  Q   R 4381224 + 8 [dd]
>   8,16   1   770950     9.994765922  4580  M   R 4381224 + 8 [dd]
>   8,16   1   770951     9.994768201  4580  Q   R 4381232 + 8 [dd]
>   8,16   1   770952     9.994768700  4580  M   R 4381232 + 8 [dd]
>   8,16   1   770953     9.994770798  4580  Q   R 4381240 + 8 [dd]
>   8,16   1   770954     9.994771298  4580  M   R 4381240 + 8 [dd]
>   8,16   1   770955     9.994773393  4580  Q   R 4381248 + 8 [dd]
>   8,16   1   770956     9.994773892  4580  M   R 4381248 + 8 [dd]
>   8,16   1   770957     9.994776015  4580  Q   R 4381256 + 8 [dd]
>   8,16   1   770958     9.994776513  4580  M   R 4381256 + 8 [dd]
>   8,16   1   770959     9.994778608  4580  Q   R 4381264 + 8 [dd]
>   8,16   1   770960     9.994779107  4580  M   R 4381264 + 8 [dd]
>   8,16   1   770961     9.994781210  4580  Q   R 4381272 + 8 [dd]
>   8,16   1   770962     9.994781710  4580  M   R 4381272 + 8 [dd]
>   8,16   1   770963     9.994787731  4580  Q   R 4381280 + 8 [dd]
>   8,16   1   770964     9.994788230  4580  M   R 4381280 + 8 [dd]
>   8,16   1   770965     9.994793675  4580  Q   R 4381288 + 8 [dd]
>   8,16   1   770966     9.994794174  4580  M   R 4381288 + 8 [dd]
>   8,16   1   770967     9.994796307  4580  Q   R 4381296 + 8 [dd]
>   8,16   1   770968     9.994796806  4580  M   R 4381296 + 8 [dd]
>   8,16   1   770969     9.994799419  4580  Q   R 4381304 + 8 [dd]
>   8,16   1   770970     9.994799919  4580  M   R 4381304 + 8 [dd]
>   8,16   1   770971     9.994802209  4580  Q   R 4381312 + 8 [dd]
>   8,16   1   770972     9.994802707  4580  M   R 4381312 + 8 [dd]
>   8,16   1   770973     9.994805174  4580  Q   R 4381320 + 8 [dd]
>   8,16   1   770974     9.994805672  4580  M   R 4381320 + 8 [dd]
>   8,16   1   770975     9.994807936  4580  Q   R 4381328 + 8 [dd]
>   8,16   1   770976     9.994808440  4580  M   R 4381328 + 8 [dd]
>   8,16   1   770977     9.994810715  4580  Q   R 4381336 + 8 [dd]
>   8,16   1   770978     9.994811242  4580  M   R 4381336 + 8 [dd]
>   8,16   1   770979     9.994813464  4580  Q   R 4381344 + 8 [dd]
>   8,16   1   770980     9.994813963  4580  M   R 4381344 + 8 [dd]
>   8,16   1   770981     9.994816205  4580  Q   R 4381352 + 8 [dd]
>   8,16   1   770982     9.994816776  4580  M   R 4381352 + 8 [dd]
>   8,16   1   770983     9.994819127  4580  Q   R 4381360 + 8 [dd]
>   8,16   1   770984     9.994819628  4580  M   R 4381360 + 8 [dd]
>   8,16   1   770985     9.994821810  4580  Q   R 4381368 + 8 [dd]
>   8,16   1   770986     9.994822315  4580  M   R 4381368 + 8 [dd]
>   8,16   1   770987     9.994824377  4580  Q   R 4381376 + 8 [dd]
>   8,16   1   770988     9.994824876  4580  M   R 4381376 + 8 [dd]
>   8,16   1   770989     9.994827067  4580  Q   R 4381384 + 8 [dd]
>   8,16   1   770990     9.994827565  4580  M   R 4381384 + 8 [dd]
>   8,16   1   770991     9.994829760  4580  Q   R 4381392 + 8 [dd]
>   8,16   1   770992     9.994830259  4580  M   R 4381392 + 8 [dd]
>   8,16   1   770993     9.994835522  4580  Q   R 4381400 + 8 [dd]
>   8,16   1   770994     9.994836021  4580  M   R 4381400 + 8 [dd]
>   8,16   1   770995     9.994838181  4580  Q   R 4381408 + 8 [dd]
>   8,16   1   770996     9.994838680  4580  M   R 4381408 + 8 [dd]
>   8,16   1   770997     9.994840857  4580  Q   R 4381416 + 8 [dd]
>   8,16   1   770998     9.994841369  4580  M   R 4381416 + 8 [dd]
>   8,16   1   770999     9.994843455  4580  Q   R 4381424 + 8 [dd]
>   8,16   1   771000     9.994843954  4580  M   R 4381424 + 8 [dd]
>   8,16   1   771001     9.994846149  4580  Q   R 4381432 + 8 [dd]
>   8,16   1   771002     9.994846662  4580  M   R 4381432 + 8 [dd]
>   8,16   1   771003     9.994849336  4580  I   R 4380928 + 512 (  306863) [dd]
>   8,16   1        0     9.994852010     0  m   N cfq4580S / insert_request
>   8,16   1   771004     9.994855251  4580  U   N [dd] 1
>   8,16   1        0     9.994857783     0  m   N cfq4580S / dispatch_insert
>   8,16   1        0     9.994861277     0  m   N cfq4580S / dispatched a request
>   8,16   1        0     9.994863066     0  m   N cfq4580S / activate rq, drv=1
>   8,16   1   771005     9.994863680  4580  D   R 4380928 + 512 (   14344) [dd]
>   8,16   1   771006     9.995909291     0  C   R 4380928 + 512 ( 1045611) [0]
>   8,16   1        0     9.995983219     0  m   N cfq4580S / complete rqnoidle 0
>   8,16   1        0     9.995986144     0  m   N cfq schedule dispatch
>   8,16   1   771007     9.996149764  4580  Q   R 4381440 + 8 [dd]
>   8,16   1   771008     9.996155872  4580  G   R 4381440 + 8 [dd]
>   8,16   1   771009     9.996157994  4580  P   N [dd]
>   8,16   1   771010     9.996161548  4580  Q   R 4381448 + 8 [dd]
>   8,16   1   771011     9.996163428  4580  M   R 4381448 + 8 [dd]
>   8,16   1   771012     9.996166608  4580  Q   R 4381456 + 8 [dd]
>   8,16   1   771013     9.996167115  4580  M   R 4381456 + 8 [dd]
>   8,16   1   771014     9.996169178  4580  Q   R 4381464 + 8 [dd]
>   8,16   1   771015     9.996169681  4580  M   R 4381464 + 8 [dd]
>   8,16   1   771016     9.996171779  4580  Q   R 4381472 + 8 [dd]
>   8,16   1   771017     9.996172277  4580  M   R 4381472 + 8 [dd]
>   8,16   1   771018     9.996174323  4580  Q   R 4381480 + 8 [dd]
>   8,16   1   771019     9.996174822  4580  M   R 4381480 + 8 [dd]
>   8,16   1   771020     9.996176942  4580  Q   R 4381488 + 8 [dd]
>   8,16   1   771021     9.996177446  4580  M   R 4381488 + 8 [dd]
>   8,16   1   771022     9.996179520  4580  Q   R 4381496 + 8 [dd]
>   8,16   1   771023     9.996180022  4580  M   R 4381496 + 8 [dd]
>   8,16   1   771024     9.996182075  4580  Q   R 4381504 + 8 [dd]
>   8,16   1   771025     9.996182574  4580  M   R 4381504 + 8 [dd]
>   8,16   1   771026     9.996189624  4580  Q   R 4381512 + 8 [dd]
>   8,16   1   771027     9.996190124  4580  M   R 4381512 + 8 [dd]
>   8,16   1   771028     9.996192318  4580  Q   R 4381520 + 8 [dd]
>   8,16   1   771029     9.996192819  4580  M   R 4381520 + 8 [dd]
>   8,16   1   771030     9.996194916  4580  Q   R 4381528 + 8 [dd]
>   8,16   1   771031     9.996195415  4580  M   R 4381528 + 8 [dd]
>   8,16   1   771032     9.996197792  4580  Q   R 4381536 + 8 [dd]
>   8,16   1   771033     9.996198291  4580  M   R 4381536 + 8 [dd]
>   8,16   1   771034     9.996200401  4580  Q   R 4381544 + 8 [dd]
>   8,16   1   771035     9.996200899  4580  M   R 4381544 + 8 [dd]
>   8,16   1   771036     9.996202991  4580  Q   R 4381552 + 8 [dd]
>   8,16   1   771037     9.996203495  4580  M   R 4381552 + 8 [dd]
>   8,16   1   771038     9.996205593  4580  Q   R 4381560 + 8 [dd]
>   8,16   1   771039     9.996206095  4580  M   R 4381560 + 8 [dd]
>   8,16   1   771040     9.996208179  4580  Q   R 4381568 + 8 [dd]
>   8,16   1   771041     9.996208678  4580  M   R 4381568 + 8 [dd]
>   8,16   1   771042     9.996210778  4580  Q   R 4381576 + 8 [dd]
>   8,16   1   771043     9.996211285  4580  M   R 4381576 + 8 [dd]
>   8,16   1   771044     9.996213428  4580  Q   R 4381584 + 8 [dd]
>   8,16   1   771045     9.996213932  4580  M   R 4381584 + 8 [dd]
>   8,16   1   771046     9.996217450  4580  Q   R 4381592 + 8 [dd]
>   8,16   1   771047     9.996217952  4580  M   R 4381592 + 8 [dd]
>   8,16   1   771048     9.996220131  4580  Q   R 4381600 + 8 [dd]
>   8,16   1   771049     9.996220644  4580  M   R 4381600 + 8 [dd]
>   8,16   1   771050     9.996222799  4580  Q   R 4381608 + 8 [dd]
>   8,16   1   771051     9.996223302  4580  M   R 4381608 + 8 [dd]
>   8,16   1   771052     9.996225537  4580  Q   R 4381616 + 8 [dd]
>   8,16   1   771053     9.996226039  4580  M   R 4381616 + 8 [dd]
>   8,16   1   771054     9.996231412  4580  Q   R 4381624 + 8 [dd]
>   8,16   1   771055     9.996231912  4580  M   R 4381624 + 8 [dd]
>   8,16   1   771056     9.996234006  4580  Q   R 4381632 + 8 [dd]
>   8,16   1   771057     9.996234505  4580  M   R 4381632 + 8 [dd]
>   8,16   1   771058     9.996236661  4580  Q   R 4381640 + 8 [dd]
>   8,16   1   771059     9.996237160  4580  M   R 4381640 + 8 [dd]
>   8,16   1   771060     9.996239325  4580  Q   R 4381648 + 8 [dd]
>   8,16   1   771061     9.996239829  4580  M   R 4381648 + 8 [dd]
>   8,16   1   771062     9.996242197  4580  Q   R 4381656 + 8 [dd]
>   8,16   1   771063     9.996242700  4580  M   R 4381656 + 8 [dd]
>   8,16   1   771064     9.996244888  4580  Q   R 4381664 + 8 [dd]
>   8,16   1   771065     9.996245388  4580  M   R 4381664 + 8 [dd]
>   8,16   1   771066     9.996247580  4580  Q   R 4381672 + 8 [dd]
>   8,16   1   771067     9.996248079  4580  M   R 4381672 + 8 [dd]
>   8,16   1   771068     9.996250234  4580  Q   R 4381680 + 8 [dd]
>   8,16   1   771069     9.996250735  4580  M   R 4381680 + 8 [dd]
>   8,16   1   771070     9.996252898  4580  Q   R 4381688 + 8 [dd]
>   8,16   1   771071     9.996253388  4580  M   R 4381688 + 8 [dd]
>   8,16   1   771072     9.996357598  4580  Q   R 4381696 + 8 [dd]
>   8,16   1   771073     9.996358355  4580  M   R 4381696 + 8 [dd]
>   8,16   1   771074     9.996360935  4580  Q   R 4381704 + 8 [dd]
>   8,16   1   771075     9.996361434  4580  M   R 4381704 + 8 [dd]
>   8,16   1   771076     9.996363662  4580  Q   R 4381712 + 8 [dd]
>   8,16   1   771077     9.996364166  4580  M   R 4381712 + 8 [dd]
>   8,16   1   771078     9.996366220  4580  Q   R 4381720 + 8 [dd]
>   8,16   1   771079     9.996366731  4580  M   R 4381720 + 8 [dd]
>   8,16   1   771080     9.996368930  4580  Q   R 4381728 + 8 [dd]
>   8,16   1   771081     9.996369429  4580  M   R 4381728 + 8 [dd]
>   8,16   1   771082     9.996375003  4580  Q   R 4381736 + 8 [dd]
>   8,16   1   771083     9.996375513  4580  M   R 4381736 + 8 [dd]
>   8,16   1   771084     9.996377664  4580  Q   R 4381744 + 8 [dd]
>   8,16   1   771085     9.996378380  4580  M   R 4381744 + 8 [dd]
>   8,16   1   771086     9.996380579  4580  Q   R 4381752 + 8 [dd]
>   8,16   1   771087     9.996381098  4580  M   R 4381752 + 8 [dd]
>   8,16   1   771088     9.996383260  4580  Q   R 4381760 + 8 [dd]
>   8,16   1   771089     9.996383759  4580  M   R 4381760 + 8 [dd]
>   8,16   1   771090     9.996385969  4580  Q   R 4381768 + 8 [dd]
>   8,16   1   771091     9.996386469  4580  M   R 4381768 + 8 [dd]
>   8,16   1   771092     9.996388658  4580  Q   R 4381776 + 8 [dd]
>   8,16   1   771093     9.996389162  4580  M   R 4381776 + 8 [dd]
>   8,16   1   771094     9.996391335  4580  Q   R 4381784 + 8 [dd]
>   8,16   1   771095     9.996391837  4580  M   R 4381784 + 8 [dd]
>   8,16   1   771096     9.996393920  4580  Q   R 4381792 + 8 [dd]
>   8,16   1   771097     9.996394419  4580  M   R 4381792 + 8 [dd]
>   8,16   1   771098     9.996396469  4580  Q   R 4381800 + 8 [dd]
>   8,16   1   771099     9.996396967  4580  M   R 4381800 + 8 [dd]
>   8,16   1   771100     9.996399181  4580  Q   R 4381808 + 8 [dd]
>   8,16   1   771101     9.996399684  4580  M   R 4381808 + 8 [dd]
>   8,16   1   771102     9.996402243  4580  Q   R 4381816 + 8 [dd]
>   8,16   1   771103     9.996402751  4580  M   R 4381816 + 8 [dd]
>   8,16   1   771104     9.996404942  4580  Q   R 4381824 + 8 [dd]
>   8,16   1   771105     9.996405441  4580  M   R 4381824 + 8 [dd]
>   8,16   1   771106     9.996407662  4580  Q   R 4381832 + 8 [dd]
>   8,16   1   771107     9.996408160  4580  M   R 4381832 + 8 [dd]
>   8,16   1   771108     9.996410409  4580  Q   R 4381840 + 8 [dd]
>   8,16   1   771109     9.996410910  4580  M   R 4381840 + 8 [dd]
>   8,16   1   771110     9.996416841  4580  Q   R 4381848 + 8 [dd]
>   8,16   1   771111     9.996417341  4580  M   R 4381848 + 8 [dd]
>   8,16   1   771112     9.996419551  4580  Q   R 4381856 + 8 [dd]
>   8,16   1   771113     9.996420050  4580  M   R 4381856 + 8 [dd]
>   8,16   1   771114     9.996425832  4580  Q   R 4381864 + 8 [dd]
>   8,16   1   771115     9.996426331  4580  M   R 4381864 + 8 [dd]
>   8,16   1   771116     9.996428600  4580  Q   R 4381872 + 8 [dd]
>   8,16   1   771117     9.996429101  4580  M   R 4381872 + 8 [dd]
>   8,16   1   771118     9.996431277  4580  Q   R 4381880 + 8 [dd]
>   8,16   1   771119     9.996431779  4580  M   R 4381880 + 8 [dd]
>   8,16   1   771120     9.996434026  4580  Q   R 4381888 + 8 [dd]
>   8,16   1   771121     9.996434525  4580  M   R 4381888 + 8 [dd]
>   8,16   1   771122     9.996436615  4580  Q   R 4381896 + 8 [dd]
>   8,16   1   771123     9.996437114  4580  M   R 4381896 + 8 [dd]
>   8,16   1   771124     9.996439353  4580  Q   R 4381904 + 8 [dd]
>   8,16   1   771125     9.996439864  4580  M   R 4381904 + 8 [dd]
>   8,16   1   771126     9.996441959  4580  Q   R 4381912 + 8 [dd]
>   8,16   1   771127     9.996442460  4580  M   R 4381912 + 8 [dd]
>   8,16   1   771128     9.996445027  4580  Q   R 4381920 + 8 [dd]
>   8,16   1   771129     9.996445526  4580  M   R 4381920 + 8 [dd]
>   8,16   1   771130     9.996447737  4580  Q   R 4381928 + 8 [dd]
>   8,16   1   771131     9.996448252  4580  M   R 4381928 + 8 [dd]
>   8,16   1   771132     9.996450536  4580  Q   R 4381936 + 8 [dd]
>   8,16   1   771133     9.996451040  4580  M   R 4381936 + 8 [dd]
>   8,16   1   771134     9.996453308  4580  Q   R 4381944 + 8 [dd]
>   8,16   1   771135     9.996453811  4580  M   R 4381944 + 8 [dd]
>   8,16   1   771136     9.996456417  4580  I   R 4381440 + 512 (  300545) [dd]
>   8,16   1        0     9.996458987     0  m   N cfq4580S / insert_request
>   8,16   1   771137     9.996462198  4580  U   N [dd] 1
>   8,16   1        0     9.996464756     0  m   N cfq4580S / dispatch_insert
>   8,16   1        0     9.996468170     0  m   N cfq4580S / dispatched a request
>   8,16   1        0     9.996469836     0  m   N cfq4580S / activate rq, drv=1
>   8,16   1   771138     9.996470460  4580  D   R 4381440 + 512 (   14043) [dd]
>   8,16   1   771139     9.997514205     0  C   R 4381440 + 512 ( 1043745) [0]
>   8,16   1        0     9.997587102     0  m   N cfq4580S / complete rqnoidle 0
>   8,16   1        0     9.997589870     0  m   N cfq schedule dispatch
>   8,16   1   771140     9.997751496  4580  Q   R 4381952 + 8 [dd]
>   8,16   1   771141     9.997758630  4580  G   R 4381952 + 8 [dd]
>   8,16   1   771142     9.997760814  4580  P   N [dd]
>   8,16   1   771143     9.997769413  4580  Q   R 4381960 + 8 [dd]
>   8,16   1   771144     9.997771473  4580  M   R 4381960 + 8 [dd]
>   8,16   1   771145     9.997774552  4580  Q   R 4381968 + 8 [dd]
>   8,16   1   771146     9.997775056  4580  M   R 4381968 + 8 [dd]
>   8,16   1   771147     9.997777142  4580  Q   R 4381976 + 8 [dd]
>   8,16   1   771148     9.997777717  4580  M   R 4381976 + 8 [dd]
>   8,16   1   771149     9.997779832  4580  Q   R 4381984 + 8 [dd]
>   8,16   1   771150     9.997780366  4580  M   R 4381984 + 8 [dd]
>   8,16   1   771151     9.997782454  4580  Q   R 4381992 + 8 [dd]
>   8,16   1   771152     9.997782953  4580  M   R 4381992 + 8 [dd]
>   8,16   1   771153     9.997785271  4580  Q   R 4382000 + 8 [dd]
>   8,16   1   771154     9.997785779  4580  M   R 4382000 + 8 [dd]
>   8,16   1   771155     9.997787937  4580  Q   R 4382008 + 8 [dd]
>   8,16   1   771156     9.997788434  4580  M   R 4382008 + 8 [dd]
>   8,16   1   771157     9.997790588  4580  Q   R 4382016 + 8 [dd]
>   8,16   1   771158     9.997791085  4580  M   R 4382016 + 8 [dd]
>   8,16   1   771159     9.997793251  4580  Q   R 4382024 + 8 [dd]
>   8,16   1   771160     9.997793954  4580  M   R 4382024 + 8 [dd]
>   8,16   1   771161     9.997796144  4580  Q   R 4382032 + 8 [dd]
>   8,16   1   771162     9.997796672  4580  M   R 4382032 + 8 [dd]
>   8,16   1   771163     9.997798737  4580  Q   R 4382040 + 8 [dd]
>   8,16   1   771164     9.997799238  4580  M   R 4382040 + 8 [dd]
>   8,16   1   771165     9.997801277  4580  Q   R 4382048 + 8 [dd]
>   8,16   1   771166     9.997801788  4580  M   R 4382048 + 8 [dd]
>   8,16   1   771167     9.997803925  4580  Q   R 4382056 + 8 [dd]
>   8,16   1   771168     9.997804439  4580  M   R 4382056 + 8 [dd]
>   8,16   1   771169     9.997806598  4580  Q   R 4382064 + 8 [dd]
>   8,16   1   771170     9.997807095  4580  M   R 4382064 + 8 [dd]
>   8,16   1   771171     9.997812761  4580  Q   R 4382072 + 8 [dd]
>   8,16   1   771172     9.997813262  4580  M   R 4382072 + 8 [dd]
>   8,16   1   771173     9.997815335  4580  Q   R 4382080 + 8 [dd]
>   8,16   1   771174     9.997815836  4580  M   R 4382080 + 8 [dd]
>   8,16   1   771175     9.997817949  4580  Q   R 4382088 + 8 [dd]
>   8,16   1   771176     9.997818448  4580  M   R 4382088 + 8 [dd]
>   8,16   1   771177     9.997820558  4580  Q   R 4382096 + 8 [dd]
>   8,16   1   771178     9.997821057  4580  M   R 4382096 + 8 [dd]
>   8,16   1   771179     9.997824698  4580  Q   R 4382104 + 8 [dd]
>   8,16   1   771180     9.997825197  4580  M   R 4382104 + 8 [dd]
>   8,16   1   771181     9.997827376  4580  Q   R 4382112 + 8 [dd]
>   8,16   1   771182     9.997827874  4580  M   R 4382112 + 8 [dd]
>   8,16   1   771183     9.997830036  4580  Q   R 4382120 + 8 [dd]
>   8,16   1   771184     9.997830538  4580  M   R 4382120 + 8 [dd]
>   8,16   1   771185     9.997832781  4580  Q   R 4382128 + 8 [dd]
>   8,16   1   771186     9.997833278  4580  M   R 4382128 + 8 [dd]
>   8,16   1   771187     9.997835542  4580  Q   R 4382136 + 8 [dd]
>   8,16   1   771188     9.997836044  4580  M   R 4382136 + 8 [dd]
>   8,16   1   771189     9.997838090  4580  Q   R 4382144 + 8 [dd]
>   8,16   1   771190     9.997838591  4580  M   R 4382144 + 8 [dd]
>   8,16   1   771191     9.997840646  4580  Q   R 4382152 + 8 [dd]
>   8,16   1   771192     9.997841147  4580  M   R 4382152 + 8 [dd]
>   8,16   1   771193     9.997843299  4580  Q   R 4382160 + 8 [dd]
>   8,16   1   771194     9.997843797  4580  M   R 4382160 + 8 [dd]
>   8,16   1   771195     9.997845909  4580  Q   R 4382168 + 8 [dd]
>   8,16   1   771196     9.997846408  4580  M   R 4382168 + 8 [dd]
>   8,16   1   771197     9.997848578  4580  Q   R 4382176 + 8 [dd]
>   8,16   1   771198     9.997849082  4580  M   R 4382176 + 8 [dd]
>   8,16   1   771199     9.997854848  4580  Q   R 4382184 + 8 [dd]
>   8,16   1   771200     9.997855350  4580  M   R 4382184 + 8 [dd]
>   8,16   1   771201     9.997857436  4580  Q   R 4382192 + 8 [dd]
>   8,16   1   771202     9.997857934  4580  M   R 4382192 + 8 [dd]
>   8,16   1   771203     9.997860278  4580  Q   R 4382200 + 8 [dd]
>   8,16   1   771204     9.997860779  4580  M   R 4382200 + 8 [dd]
>   8,16   1   771205     9.997964321  4580  Q   R 4382208 + 8 [dd]
>   8,16   1   771206     9.997965007  4580  M   R 4382208 + 8 [dd]
>   8,16   1   771207     9.997967619  4580  Q   R 4382216 + 8 [dd]
>   8,16   1   771208     9.997968161  4580  M   R 4382216 + 8 [dd]
>   8,16   1   771209     9.997970459  4580  Q   R 4382224 + 8 [dd]
>   8,16   1   771210     9.997970963  4580  M   R 4382224 + 8 [dd]
>   8,16   1   771211     9.997973081  4580  Q   R 4382232 + 8 [dd]
>   8,16   1   771212     9.997973580  4580  M   R 4382232 + 8 [dd]
>   8,16   1   771213     9.997975787  4580  Q   R 4382240 + 8 [dd]
>   8,16   1   771214     9.997976285  4580  M   R 4382240 + 8 [dd]
>   8,16   1   771215     9.997978452  4580  Q   R 4382248 + 8 [dd]
>   8,16   1   771216     9.997978953  4580  M   R 4382248 + 8 [dd]
>   8,16   1   771217     9.997981249  4580  Q   R 4382256 + 8 [dd]
>   8,16   1   771218     9.997981751  4580  M   R 4382256 + 8 [dd]
>   8,16   1   771219     9.997983917  4580  Q   R 4382264 + 8 [dd]
>   8,16   1   771220     9.997984418  4580  M   R 4382264 + 8 [dd]
>   8,16   1   771221     9.997986611  4580  Q   R 4382272 + 8 [dd]
>   8,16   1   771222     9.997987121  4580  M   R 4382272 + 8 [dd]
>   8,16   1   771223     9.997989204  4580  Q   R 4382280 + 8 [dd]
>   8,16   1   771224     9.997989705  4580  M   R 4382280 + 8 [dd]
>   8,16   1   771225     9.997991904  4580  Q   R 4382288 + 8 [dd]
>   8,16   1   771226     9.997992402  4580  M   R 4382288 + 8 [dd]
>   8,16   1   771227     9.997998036  4580  Q   R 4382296 + 8 [dd]
>   8,16   1   771228     9.997998579  4580  M   R 4382296 + 8 [dd]
>   8,16   1   771229     9.998000634  4580  Q   R 4382304 + 8 [dd]
>   8,16   1   771230     9.998001136  4580  M   R 4382304 + 8 [dd]
>   8,16   1   771231     9.998003255  4580  Q   R 4382312 + 8 [dd]
>   8,16   1   771232     9.998003774  4580  M   R 4382312 + 8 [dd]
>   8,16   1   771233     9.998005975  4580  Q   R 4382320 + 8 [dd]
>   8,16   1   771234     9.998006476  4580  M   R 4382320 + 8 [dd]
>   8,16   1   771235     9.998008972  4580  Q   R 4382328 + 8 [dd]
>   8,16   1   771236     9.998009529  4580  M   R 4382328 + 8 [dd]
>   8,16   1   771237     9.998011779  4580  Q   R 4382336 + 8 [dd]
>   8,16   1   771238     9.998012277  4580  M   R 4382336 + 8 [dd]
>   8,16   1   771239     9.998014476  4580  Q   R 4382344 + 8 [dd]
>   8,16   1   771240     9.998014974  4580  M   R 4382344 + 8 [dd]
>   8,16   1   771241     9.998017401  4580  Q   R 4382352 + 8 [dd]
>   8,16   1   771242     9.998017899  4580  M   R 4382352 + 8 [dd]
>   8,16   1   771243     9.998020091  4580  Q   R 4382360 + 8 [dd]
>   8,16   1   771244     9.998020588  4580  M   R 4382360 + 8 [dd]
>   8,16   1   771245     9.998022782  4580  Q   R 4382368 + 8 [dd]
>   8,16   1   771246     9.998023389  4580  M   R 4382368 + 8 [dd]
>   8,16   1   771247     9.998025647  4580  Q   R 4382376 + 8 [dd]
>   8,16   1   771248     9.998026180  4580  M   R 4382376 + 8 [dd]
>   8,16   1   771249     9.998028480  4580  Q   R 4382384 + 8 [dd]
>   8,16   1   771250     9.998029020  4580  M   R 4382384 + 8 [dd]
>   8,16   1   771251     9.998031205  4580  Q   R 4382392 + 8 [dd]
>   8,16   1   771252     9.998031706  4580  M   R 4382392 + 8 [dd]
>   8,16   1   771253     9.998033865  4580  Q   R 4382400 + 8 [dd]
>   8,16   1   771254     9.998034366  4580  M   R 4382400 + 8 [dd]
>   8,16   1   771255     9.998040073  4580  Q   R 4382408 + 8 [dd]
>   8,16   1   771256     9.998040571  4580  M   R 4382408 + 8 [dd]
>   8,16   1   771257     9.998042647  4580  Q   R 4382416 + 8 [dd]
>   8,16   1   771258     9.998043150  4580  M   R 4382416 + 8 [dd]
>   8,16   1   771259     9.998045325  4580  Q   R 4382424 + 8 [dd]
>   8,16   1   771260     9.998045826  4580  M   R 4382424 + 8 [dd]
>   8,16   1   771261     9.998047931  4580  Q   R 4382432 + 8 [dd]
>   8,16   1   771262     9.998048432  4580  M   R 4382432 + 8 [dd]
>   8,16   1   771263     9.998050535  4580  Q   R 4382440 + 8 [dd]
>   8,16   1   771264     9.998051038  4580  M   R 4382440 + 8 [dd]
>   8,16   1   771265     9.998056985  4580  Q   R 4382448 + 8 [dd]
>   8,16   1   771266     9.998057500  4580  M   R 4382448 + 8 [dd]
>   8,16   1   771267     9.998059576  4580  Q   R 4382456 + 8 [dd]
>   8,16   1   771268     9.998060077  4580  M   R 4382456 + 8 [dd]
>   8,16   1   771269     9.998062341  4580  I   R 4381952 + 512 (  303711) [dd]
>   8,16   1        0     9.998064881     0  m   N cfq4580S / insert_request
>   8,16   1   771270     9.998068490  4580  U   N [dd] 1
>   8,16   1        0     9.998071031     0  m   N cfq4580S / dispatch_insert
>   8,16   1        0     9.998074991     0  m   N cfq4580S / dispatched a request
>   8,16   1        0     9.998076645     0  m   N cfq4580S / activate rq, drv=1
>   8,16   1   771271     9.998077269  4580  D   R 4381952 + 512 (   14928) [dd]
>   8,16   1   771272     9.999120396     0  C   R 4381952 + 512 ( 1043127) [0]
>   8,16   1        0     9.999192302     0  m   N cfq4580S / complete rqnoidle 0
>   8,16   1        0     9.999195361     0  m   N cfq schedule dispatch
>   8,16   1   771273     9.999356099  4580  Q   R 4382464 + 8 [dd]
>   8,16   1   771274     9.999362719  4580  G   R 4382464 + 8 [dd]
>   8,16   1   771275     9.999364795  4580  P   N [dd]
>   8,16   1   771276     9.999368199  4580  Q   R 4382472 + 8 [dd]
>   8,16   1   771277     9.999370072  4580  M   R 4382472 + 8 [dd]
>   8,16   1   771278     9.999373166  4580  Q   R 4382480 + 8 [dd]
>   8,16   1   771279     9.999373710  4580  M   R 4382480 + 8 [dd]
>   8,16   1   771280     9.999375830  4580  Q   R 4382488 + 8 [dd]
>   8,16   1   771281     9.999376334  4580  M   R 4382488 + 8 [dd]
>   8,16   1   771282     9.999378433  4580  Q   R 4382496 + 8 [dd]
>   8,16   1   771283     9.999378932  4580  M   R 4382496 + 8 [dd]
>   8,16   1   771284     9.999380973  4580  Q   R 4382504 + 8 [dd]
>   8,16   1   771285     9.999381477  4580  M   R 4382504 + 8 [dd]
>   8,16   1   771286     9.999383602  4580  Q   R 4382512 + 8 [dd]
>   8,16   1   771287     9.999384101  4580  M   R 4382512 + 8 [dd]
>   8,16   1   771288     9.999391190  4580  Q   R 4382520 + 8 [dd]
>   8,16   1   771289     9.999391690  4580  M   R 4382520 + 8 [dd]
>   8,16   1   771290     9.999393850  4580  Q   R 4382528 + 8 [dd]
>   8,16   1   771291     9.999394351  4580  M   R 4382528 + 8 [dd]
>   8,16   1   771292     9.999396618  4580  Q   R 4382536 + 8 [dd]
>   8,16   1   771293     9.999397190  4580  M   R 4382536 + 8 [dd]
>   8,16   1   771294     9.999399323  4580  Q   R 4382544 + 8 [dd]
>   8,16   1   771295     9.999399864  4580  M   R 4382544 + 8 [dd]
>   8,16   1   771296     9.999401953  4580  Q   R 4382552 + 8 [dd]
>   8,16   1   771297     9.999402472  4580  M   R 4382552 + 8 [dd]
>   8,16   1   771298     9.999404563  4580  Q   R 4382560 + 8 [dd]
>   8,16   1   771299     9.999405057  4580  M   R 4382560 + 8 [dd]
>   8,16   1   771300     9.999407109  4580  Q   R 4382568 + 8 [dd]
>   8,16   1   771301     9.999407611  4580  M   R 4382568 + 8 [dd]
>   8,16   1   771302     9.999409677  4580  Q   R 4382576 + 8 [dd]
>   8,16   1   771303     9.999410176  4580  M   R 4382576 + 8 [dd]
>   8,16   1   771304     9.999412226  4580  Q   R 4382584 + 8 [dd]
>   8,16   1   771305     9.999412734  4580  M   R 4382584 + 8 [dd]
>   8,16   1   771306     9.999416340  4580  Q   R 4382592 + 8 [dd]
>   8,16   1   771307     9.999416862  4580  M   R 4382592 + 8 [dd]
>   8,16   1   771308     9.999419187  4580  Q   R 4382600 + 8 [dd]
>   8,16   1   771309     9.999419706  4580  M   R 4382600 + 8 [dd]
>   8,16   1   771310     9.999421977  4580  Q   R 4382608 + 8 [dd]
>   8,16   1   771311     9.999422503  4580  M   R 4382608 + 8 [dd]
>   8,16   1   771312     9.999424582  4580  Q   R 4382616 + 8 [dd]
>   8,16   1   771313     9.999425120  4580  M   R 4382616 + 8 [dd]
>   8,16   1   771314     9.999427292  4580  Q   R 4382624 + 8 [dd]
>   8,16   1   771315     9.999427805  4580  M   R 4382624 + 8 [dd]
>   8,16   1   771316     9.999433255  4580  Q   R 4382632 + 8 [dd]
>   8,16   1   771317     9.999433766  4580  M   R 4382632 + 8 [dd]
>   8,16   1   771318     9.999435901  4580  Q   R 4382640 + 8 [dd]
>   8,16   1   771319     9.999436412  4580  M   R 4382640 + 8 [dd]
>   8,16   1   771320     9.999438504  4580  Q   R 4382648 + 8 [dd]
>   8,16   1   771321     9.999439243  4580  M   R 4382648 + 8 [dd]
>   8,16   1   771322     9.999441418  4580  Q   R 4382656 + 8 [dd]
>   8,16   1   771323     9.999441949  4580  M   R 4382656 + 8 [dd]
>   8,16   1   771324     9.999444183  4580  Q   R 4382664 + 8 [dd]
>   8,16   1   771325     9.999444698  4580  M   R 4382664 + 8 [dd]
>   8,16   1   771326     9.999446894  4580  Q   R 4382672 + 8 [dd]
>   8,16   1   771327     9.999447411  4580  M   R 4382672 + 8 [dd]
>   8,16   1   771328     9.999449485  4580  Q   R 4382680 + 8 [dd]
>   8,16   1   771329     9.999449997  4580  M   R 4382680 + 8 [dd]
>   8,16   1   771330     9.999452055  4580  Q   R 4382688 + 8 [dd]
>   8,16   1   771331     9.999452566  4580  M   R 4382688 + 8 [dd]
>   8,16   1   771332     9.999454606  4580  Q   R 4382696 + 8 [dd]
>   8,16   1   771333     9.999455154  4580  M   R 4382696 + 8 [dd]
>   8,16   1   771334     9.999457363  4580  Q   R 4382704 + 8 [dd]
>   8,16   1   771335     9.999457875  4580  M   R 4382704 + 8 [dd]
>   8,16   1   771336     9.999460045  4580  Q   R 4382712 + 8 [dd]
>   8,16   1   771337     9.999460561  4580  M   R 4382712 + 8 [dd]
>   8,16   1   771338     9.999564615  4580  Q   R 4382720 + 8 [dd]
>   8,16   1   771339     9.999565347  4580  M   R 4382720 + 8 [dd]
>   8,16   1   771340     9.999568401  4580  Q   R 4382728 + 8 [dd]
>   8,16   1   771341     9.999568908  4580  M   R 4382728 + 8 [dd]
>   8,16   1   771342     9.999571276  4580  Q   R 4382736 + 8 [dd]
>   8,16   1   771343     9.999571792  4580  M   R 4382736 + 8 [dd]
>   8,16   1   771344     9.999577396  4580  Q   R 4382744 + 8 [dd]
>   8,16   1   771345     9.999578003  4580  M   R 4382744 + 8 [dd]
>   8,16   1   771346     9.999580231  4580  Q   R 4382752 + 8 [dd]
>   8,16   1   771347     9.999580749  4580  M   R 4382752 + 8 [dd]
>   8,16   1   771348     9.999583114  4580  Q   R 4382760 + 8 [dd]
>   8,16   1   771349     9.999583625  4580  M   R 4382760 + 8 [dd]
>   8,16   1   771350     9.999585875  4580  Q   R 4382768 + 8 [dd]
>   8,16   1   771351     9.999586374  4580  M   R 4382768 + 8 [dd]
>   8,16   1   771352     9.999588531  4580  Q   R 4382776 + 8 [dd]
>   8,16   1   771353     9.999589032  4580  M   R 4382776 + 8 [dd]
>   8,16   1   771354     9.999591214  4580  Q   R 4382784 + 8 [dd]
>   8,16   1   771355     9.999591714  4580  M   R 4382784 + 8 [dd]
>   8,16   1   771356     9.999593930  4580  Q   R 4382792 + 8 [dd]
>   8,16   1   771357     9.999594442  4580  M   R 4382792 + 8 [dd]
>   8,16   1   771358     9.999596696  4580  Q   R 4382800 + 8 [dd]
>   8,16   1   771359     9.999597190  4580  M   R 4382800 + 8 [dd]
>   8,16   1   771360     9.999599406  4580  Q   R 4382808 + 8 [dd]
>   8,16   1   771361     9.999599907  4580  M   R 4382808 + 8 [dd]
>   8,16   1   771362     9.999602166  4580  Q   R 4382816 + 8 [dd]
>   8,16   1   771363     9.999602667  4580  M   R 4382816 + 8 [dd]
>   8,16   1   771364     9.999604755  4580  Q   R 4382824 + 8 [dd]
>   8,16   1   771365     9.999605259  4580  M   R 4382824 + 8 [dd]
>   8,16   1   771366     9.999607486  4580  Q   R 4382832 + 8 [dd]
>   8,16   1   771367     9.999607978  4580  M   R 4382832 + 8 [dd]
>   8,16   1   771368     9.999610062  4580  Q   R 4382840 + 8 [dd]
>   8,16   1   771369     9.999610564  4580  M   R 4382840 + 8 [dd]
>   8,16   1   771370     9.999612914  4580  Q   R 4382848 + 8 [dd]
>   8,16   1   771371     9.999613418  4580  M   R 4382848 + 8 [dd]
>   8,16   1   771372     9.999618806  4580  Q   R 4382856 + 8 [dd]
>   8,16   1   771373     9.999619308  4580  M   R 4382856 + 8 [dd]
>   8,16   1   771374     9.999621579  4580  Q   R 4382864 + 8 [dd]
>   8,16   1   771375     9.999622092  4580  M   R 4382864 + 8 [dd]
>   8,16   1   771376     9.999624260  4580  Q   R 4382872 + 8 [dd]
>   8,16   1   771377     9.999624779  4580  M   R 4382872 + 8 [dd]
>   8,16   1   771378     9.999627506  4580  Q   R 4382880 + 8 [dd]
>   8,16   1   771379     9.999628012  4580  M   R 4382880 + 8 [dd]
>   8,16   1   771380     9.999630135  4580  Q   R 4382888 + 8 [dd]
>   8,16   1   771381     9.999630635  4580  M   R 4382888 + 8 [dd]
>   8,16   1   771382     9.999632876  4580  Q   R 4382896 + 8 [dd]
>   8,16   1   771383     9.999633378  4580  M   R 4382896 + 8 [dd]
>   8,16   1   771384     9.999635541  4580  Q   R 4382904 + 8 [dd]
>   8,16   1   771385     9.999636043  4580  M   R 4382904 + 8 [dd]
>   8,16   1   771386     9.999638232  4580  Q   R 4382912 + 8 [dd]
>   8,16   1   771387     9.999638736  4580  M   R 4382912 + 8 [dd]
>   8,16   1   771388     9.999640940  4580  Q   R 4382920 + 8 [dd]
>   8,16   1   771389     9.999641440  4580  M   R 4382920 + 8 [dd]
>   8,16   1   771390     9.999643644  4580  Q   R 4382928 + 8 [dd]
>   8,16   1   771391     9.999644157  4580  M   R 4382928 + 8 [dd]
>   8,16   1   771392     9.999646440  4580  Q   R 4382936 + 8 [dd]
>   8,16   1   771393     9.999646960  4580  M   R 4382936 + 8 [dd]
>   8,16   1   771394     9.999649193  4580  Q   R 4382944 + 8 [dd]
>   8,16   1   771395     9.999649697  4580  M   R 4382944 + 8 [dd]
>   8,16   1   771396     9.999651771  4580  Q   R 4382952 + 8 [dd]
>   8,16   1   771397     9.999652272  4580  M   R 4382952 + 8 [dd]
>   8,16   1   771398     9.999654476  4580  Q   R 4382960 + 8 [dd]
>   8,16   1   771399     9.999654975  4580  M   R 4382960 + 8 [dd]
>   8,16   1   771400     9.999660256  4580  Q   R 4382968 + 8 [dd]
>   8,16   1   771401     9.999660760  4580  M   R 4382968 + 8 [dd]
>   8,16   1   771402     9.999663197  4580  I   R 4382464 + 512 (  300478) [dd]
>   8,16   1        0     9.999665743     0  m   N cfq4580S / insert_request
>   8,16   1   771403     9.999669190  4580  U   N [dd] 1
>   8,16   1        0     9.999672048     0  m   N cfq4580S / dispatch_insert
>   8,16   1        0     9.999675568     0  m   N cfq4580S / dispatched a request
>   8,16   1        0     9.999677281     0  m   N cfq4580S / activate rq, drv=1
>   8,16   1   771404     9.999677892  4580  D   R 4382464 + 512 (   14695) [dd]
> CPU0 (sdb):
>  Reads Queued:       20608,    82432KiB	 Writes Queued:           0,        0KiB
>  Read Dispatches:      322,    82432KiB	 Write Dispatches:        0,        0KiB
>  Reads Requeued:         0		 Writes Requeued:         0
>  Reads Completed:       22,     5632KiB	 Writes Completed:        0,        0KiB
>  Read Merges:        20286,    81144KiB	 Write Merges:            0,        0KiB
>  Read depth:             1        	 Write depth:             0
>  IO unplugs:           322        	 Timer unplugs:           0
> CPU1 (sdb):
>  Reads Queued:      371058,     1484MiB	 Writes Queued:           0,        0KiB
>  Read Dispatches:     5798,     1484MiB	 Write Dispatches:        0,        0KiB
>  Reads Requeued:         0		 Writes Requeued:         0
>  Reads Completed:     6097,     1560MiB	 Writes Completed:        0,        0KiB
>  Read Merges:       365261,     1461MiB	 Write Merges:            0,        0KiB
>  Read depth:             1        	 Write depth:             0
>  IO unplugs:          5798        	 Timer unplugs:           0
> 
> Total (sdb):
>  Reads Queued:      391666,     1566MiB	 Writes Queued:           0,        0KiB
>  Read Dispatches:     6120,     1566MiB	 Write Dispatches:        0,        0KiB
>  Reads Requeued:         0		 Writes Requeued:         0
>  Reads Completed:     6119,     1566MiB	 Writes Completed:        0,        0KiB
>  Read Merges:       385547,     1542MiB	 Write Merges:            0,        0KiB
>  IO unplugs:          6120        	 Timer unplugs:           0
> 
> Throughput (R/W): 156662KiB/s / 0KiB/s
> Events (sdb): 851428 entries
> Skips: 0 forward (0 -   0.0%)
> Input file sdb.blktrace.0 added
> Input file sdb.blktrace.1 added
> 
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ