lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <20121212195019.GB9453@blackbox.djwong.org>
Date:	Wed, 12 Dec 2012 11:50:20 -0800
From:	"Darrick J. Wong" <darrick.wong@...cle.com>
To:	Zhi Yong Wu <zwu.kernel@...il.com>
Cc:	wuzhy@...ux.vnet.ibm.com, linux-fsdevel@...r.kernel.org,
	linux-kernel@...r.kernel.org, viro@...iv.linux.org.uk,
	linuxram@...ux.vnet.ibm.com, david@...morbit.com,
	swhiteho@...hat.com, dave@...os.cz, andi@...stfloor.org,
	northrup.james@...il.com
Subject: Re: [PATCH v1 resend hot_track 00/16] vfs: hot data tracking

On Mon, Dec 10, 2012 at 11:30:03AM +0800, Zhi Yong Wu wrote:
> HI, all guys.
> 
> any comments or suggestions?

Why did ffsb drop from 924 transactions/sec to 322?

--D
> 
> On Thu, Dec 6, 2012 at 11:28 AM, Zhi Yong Wu <wuzhy@...ux.vnet.ibm.com> wrote:
> > HI, guys
> >
> > THe perf testing is done separately with fs_mark, fio, ffsb and
> > compilebench in one kvm guest.
> >
> > Below is the performance testing report for hot tracking, and no obvious
> > perf downgrade is found.
> >
> > Note: original kernel means its source code is not changed;
> >       kernel with enabled hot tracking means its source code is with hot
> > tracking patchset.
> >
> > The test env is set up as below:
> >
> > root@...ian-i386:/home/zwu# uname -a
> > Linux debian-i386 3.7.0-rc8+ #266 SMP Tue Dec 4 12:17:55 CST 2012 x86_64
> > GNU/Linux
> >
> > root@...ian-i386:/home/zwu# mkfs.xfs -f -l
> > size=1310b,sunit=8 /home/zwu/bdev.img
> > meta-data=/home/zwu/bdev.img     isize=256    agcount=4, agsize=128000
> > blks
> >          =                       sectsz=512   attr=2, projid32bit=0
> > data     =                       bsize=4096   blocks=512000, imaxpct=25
> >          =                       sunit=0      swidth=0 blks
> > naming   =version 2              bsize=4096   ascii-ci=0
> > log      =internal log           bsize=4096   blocks=1310, version=2
> >          =                       sectsz=512   sunit=1 blks, lazy-count=1
> > realtime =none                   extsz=4096   blocks=0, rtextents=0
> >
> > 1.) original kernel
> >
> > root@...ian-i386:/home/zwu# mount -o
> > loop,logbsize=256k /home/zwu/bdev.img /mnt/scratch
> > [ 1197.421616] XFS (loop0): Mounting Filesystem
> > [ 1197.567399] XFS (loop0): Ending clean mount
> > root@...ian-i386:/home/zwu# mount
> > /dev/sda1 on / type ext3 (rw,errors=remount-ro)
> > tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
> > proc on /proc type proc (rw,noexec,nosuid,nodev)
> > sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
> > udev on /dev type tmpfs (rw,mode=0755)
> > tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
> > devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
> > none on /selinux type selinuxfs (rw,relatime)
> > debugfs on /sys/kernel/debug type debugfs (rw)
> > binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc
> > (rw,noexec,nosuid,nodev)
> > /dev/loop0 on /mnt/scratch type xfs (rw,logbsize=256k)
> > root@...ian-i386:/home/zwu# free -m
> >              total       used       free     shared    buffers
> > cached
> > Mem:           112        109          2          0          4
> > 53
> > -/+ buffers/cache:         51         60
> > Swap:          713         29        684
> >
> > 2.) kernel with enabled hot tracking
> >
> > root@...ian-i386:/home/zwu# mount -o
> > hot_track,loop,logbsize=256k /home/zwu/bdev.img /mnt/scratch
> > [  364.648470] XFS (loop0): Mounting Filesystem
> > [  364.910035] XFS (loop0): Ending clean mount
> > [  364.921063] VFS: Turning on hot data tracking
> > root@...ian-i386:/home/zwu# mount
> > /dev/sda1 on / type ext3 (rw,errors=remount-ro)
> > tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
> > proc on /proc type proc (rw,noexec,nosuid,nodev)
> > sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
> > udev on /dev type tmpfs (rw,mode=0755)
> > tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
> > devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
> > none on /selinux type selinuxfs (rw,relatime)
> > binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc
> > (rw,noexec,nosuid,nodev)
> > /dev/loop0 on /mnt/scratch type xfs (rw,hot_track,logbsize=256k)
> > root@...ian-i386:/home/zwu# free -m
> >              total       used       free     shared    buffers
> > cached
> > Mem:           112        107          4          0          2
> > 34
> > -/+ buffers/cache:         70         41
> > Swap:          713          2        711
> >
> > 1. fs_mark test
> >
> > 1.) orginal kernel
> >
> > #  ./fs_mark  -D  100  -S0  -n  1000  -s  1  -L  30  -d  /mnt/scratch/0
> > -d  /mnt/scratch/1  -d  /mnt/scratch/2  -d  /mnt/scratch/3
> > -d  /mnt/scratch/4  -d  /mnt/scratch/5  -d  /mnt/scratch/6
> > -d  /mnt/scratch/7
> > #       Version 3.3, 8 thread(s) starting at Wed Dec  5 03:20:58 2012
> > #       Sync method: NO SYNC: Test does not issue sync() or fsync() calls.
> > #       Directories:  Time based hash between directories across 100
> > subdirectories with 180 seconds per subdirectory.
> > #       File names: 40 bytes long, (16 initial bytes of time stamp with 24
> > random bytes at end of name)
> > #       Files info: size 1 bytes, written with an IO size of 16384 bytes per
> > write
> > #       App overhead is time in microseconds spent in the test not doing file
> > writing related system calls.
> >
> > FSUse%        Count         Size    Files/sec     App Overhead
> >      2         8000            1        375.6         27175895
> >      3        16000            1        375.6         27478079
> >      4        24000            1        346.0         27819607
> >      4        32000            1        316.9         25863385
> >      5        40000            1        335.2         25460605
> >      6        48000            1        312.3         25889196
> >      7        56000            1        327.3         25000611
> >      8        64000            1        304.4         28126698
> >      9        72000            1        361.7         26652172
> >      9        80000            1        370.1         27075875
> >     10        88000            1        347.8         31093106
> >     11        96000            1        387.1         26877324
> >     12       104000            1        352.3         26635853
> >     13       112000            1        379.3         26400198
> >     14       120000            1        367.4         27228178
> >     14       128000            1        359.2         27627871
> >     15       136000            1        358.4         27089821
> >     16       144000            1        385.5         27804852
> >     17       152000            1        322.9         26221907
> >     18       160000            1        393.2         26760040
> >     18       168000            1        351.9         29210327
> >     20       176000            1        395.2         24610548
> >     20       184000            1        376.7         27518650
> >     21       192000            1        340.1         27512874
> >     22       200000            1        389.0         27109104
> >     23       208000            1        389.7         29288594
> >     24       216000            1        352.6         29948820
> >     25       224000            1        380.4         26370958
> >     26       232000            1        332.9         27770518
> >     26       240000            1        333.6         25176691
> >
> > 2.) kernel with enabled hot tracking
> >
> > #  ./fs_mark  -D  100  -S0  -n  1000  -s  1  -L  30  -d  /mnt/scratch/0
> > -d  /mnt/scratch/1  -d  /mnt/scratch/2  -d  /mnt/scratch/3
> > -d  /mnt/scratch/4  -d  /mnt/scratch/5  -d  /mnt/scratch/6
> > -d  /mnt/scratch/7
> > #       Version 3.3, 8 thread(s) starting at Tue Dec  4 04:28:48 2012
> > #       Sync method: NO SYNC: Test does not issue sync() or fsync() calls.
> > #       Directories:  Time based hash between directories across 100
> > subdirectories with 180 seconds per subdirectory.
> > #       File names: 40 bytes long, (16 initial bytes of time stamp with 24
> > random bytes at end of name)
> > #       Files info: size 1 bytes, written with an IO size of 16384 bytes per
> > write
> > #       App overhead is time in microseconds spent in the test not doing file
> > writing related system calls.
> >
> > FSUse%        Count         Size    Files/sec     App Overhead
> >      4         8000            1        323.0         25104879
> >      6        16000            1        351.4         25372919
> >      8        24000            1        345.9         24107987
> >      9        32000            1        313.2         26249533
> >     10        40000            1        323.0         20312267
> >     12        48000            1        303.2         22178040
> >     14        56000            1        307.6         22775058
> >     15        64000            1        317.9         25178845
> >     17        72000            1        351.8         22020260
> >     19        80000            1        369.3         23546708
> >     21        88000            1        324.1         29068297
> >     22        96000            1        355.3         25212333
> >     24       104000            1        346.4         26622613
> >     26       112000            1        360.4         25477193
> >     28       120000            1        362.9         21774508
> >     29       128000            1        329.0         25760109
> >     31       136000            1        369.5         24540577
> >     32       144000            1        330.2         26013559
> >     34       152000            1        365.5         25643279
> >     36       160000            1        366.2         24393130
> >     38       168000            1        348.3         25248940
> >     39       176000            1        357.3         24080574
> >     40       184000            1        316.8         23011921
> >     43       192000            1        351.7         27468060
> >     44       200000            1        362.2         27540349
> >     46       208000            1        340.9         26135445
> >     48       216000            1        339.2         20926743
> >     50       224000            1        316.5         21399871
> >     52       232000            1        346.3         24669604
> >     53       240000            1        320.5         22204449
> >
> >
> > 2. FFSB test
> >
> > 1.) original kernel
> >
> > FFSB version 6.0-RC2 started
> >
> > benchmark time = 10
> > ThreadGroup 0
> > ================
> >          num_threads      = 4
> >
> >          read_random      = off
> >          read_size        = 40960       (40KB)
> >          read_blocksize   = 4096        (4KB)
> >          read_skip        = off
> >          read_skipsize    = 0   (0B)
> >
> >          write_random     = off
> >          write_size       = 40960       (40KB)
> >          fsync_file       = 0
> >          write_blocksize  = 4096        (4KB)
> >          wait time        = 0
> >
> >          op weights
> >                          read = 0 (0.00%)
> >                       readall = 1 (10.00%)
> >                         write = 0 (0.00%)
> >                        create = 1 (10.00%)
> >                        append = 1 (10.00%)
> >                        delete = 1 (10.00%)
> >                        metaop = 0 (0.00%)
> >                     createdir = 0 (0.00%)
> >                          stat = 1 (10.00%)
> >                      writeall = 1 (10.00%)
> >                writeall_fsync = 1 (10.00%)
> >                    open_close = 1 (10.00%)
> >                   write_fsync = 0 (0.00%)
> >                  create_fsync = 1 (10.00%)
> >                  append_fsync = 1 (10.00%)
> >
> > FileSystem /mnt/scratch/test1
> > ==========
> >          num_dirs         = 100
> >          starting files   = 0
> >
> >          Fileset weight:
> >                      33554432 (  32MB) -> 1 (1.00%)
> >                       8388608 (   8MB) -> 2 (2.00%)
> >                        524288 ( 512KB) -> 3 (3.00%)
> >                        262144 ( 256KB) -> 4 (4.00%)
> >                        131072 ( 128KB) -> 5 (5.00%)
> >                         65536 (  64KB) -> 8 (8.00%)
> >                         32768 (  32KB) -> 10 (10.00%)
> >                         16384 (  16KB) -> 13 (13.00%)
> >                          8192 (   8KB) -> 21 (21.00%)
> >                          4096 (   4KB) -> 33 (33.00%)
> >          directio         = off
> >          alignedio        = off
> >          bufferedio       = off
> >
> >          aging is off
> >          current utilization = 26.19%
> >
> > creating new fileset /mnt/scratch/test1
> > fs setup took 87 secs
> > Syncing()...1 sec
> > Starting Actual Benchmark At: Wed Dec  5 03:38:06 2012
> >
> > Syncing()...0 sec
> > FFSB benchmark finished   at: Wed Dec  5 03:38:18 2012
> >
> > Results:
> > Benchmark took 11.44 sec
> >
> > Total Results
> > ===============
> >              Op Name   Transactions      Trans/sec      % Trans     % Op Weight
> > Throughput
> >              =======   ============      =========      =======     ===========
> > ==========
> >              readall :           93           8.13       0.880%         21.053%
> > 32.5KB/sec
> >               create :           20           1.75       0.189%          5.263%
> > 6.99KB/sec
> >               append :           10           0.87       0.095%          2.632%
> > 3.5KB/sec
> >               delete :            4           0.35       0.038%         10.526%
> > NA
> >                 stat :            3           0.26       0.028%          7.895%
> > NA
> >             writeall :         2178         190.39      20.600%         10.526%
> > 762KB/sec
> >       writeall_fsync :            5           0.44       0.047%          5.263%
> > 1.75KB/sec
> >           open_close :            6           0.52       0.057%         15.789%
> > NA
> >         create_fsync :         8234         719.78      77.878%         15.789%
> > 2.81MB/sec
> >         append_fsync :           20           1.75       0.189%          5.263%
> > 6.99KB/sec
> > -
> > 924.24 Transactions per Second
> >
> > Throughput Results
> > ===================
> > Read Throughput: 32.5KB/sec
> > Write Throughput: 3.57MB/sec
> >
> > System Call Latency statistics in millisecs
> > =====
> >                 Min             Avg             Max             Total Calls
> >                 ========        ========        ========        ============
> > [   open]       0.050000        3.980161        41.840000                 31
> >    -
> > [   read]       0.017000        71.442215       1286.122000               93
> >    -
> > [  write]       0.052000        1.034817        2201.956000            10467
> >    -
> > [ unlink]       1.118000        185.398750      730.807000                 4
> >    -
> > [  close]       0.019000        1.968968        39.679000                 31
> >    -
> > [   stat]       0.043000        2.173667        6.428000                   3
> >    -
> >
> > 0.8% User   Time
> > 9.2% System Time
> > 10.0% CPU Utilization
> >
> > 2.) kernel with enabled hot tracking
> >
> > FFSB version 6.0-RC2 started
> >
> > benchmark time = 10
> > ThreadGroup 0
> > ================
> >          num_threads      = 4
> >
> >          read_random      = off
> >          read_size        = 40960       (40KB)
> >          read_blocksize   = 4096        (4KB)
> >          read_skip        = off
> >          read_skipsize    = 0   (0B)
> >
> >          write_random     = off
> >          write_size       = 40960       (40KB)
> >          fsync_file       = 0
> >          write_blocksize  = 4096        (4KB)
> >          wait time        = 0
> >
> >          op weights
> >                          read = 0 (0.00%)
> >                       readall = 1 (10.00%)
> >                         write = 0 (0.00%)
> >                        create = 1 (10.00%)
> >                        append = 1 (10.00%)
> >                        delete = 1 (10.00%)
> >                        metaop = 0 (0.00%)
> >                     createdir = 0 (0.00%)
> >                          stat = 1 (10.00%)
> >                      writeall = 1 (10.00%)
> >                writeall_fsync = 1 (10.00%)
> >                    open_close = 1 (10.00%)
> >                   write_fsync = 0 (0.00%)
> >                  create_fsync = 1 (10.00%)
> >                  append_fsync = 1 (10.00%)
> >
> > FileSystem /mnt/scratch/test1
> > ==========
> >          num_dirs         = 100
> >          starting files   = 0
> >
> >          Fileset weight:
> >                      33554432 (  32MB) -> 1 (1.00%)
> >                       8388608 (   8MB) -> 2 (2.00%)
> >                        524288 ( 512KB) -> 3 (3.00%)
> >                        262144 ( 256KB) -> 4 (4.00%)
> >                        131072 ( 128KB) -> 5 (5.00%)
> >                         65536 (  64KB) -> 8 (8.00%)
> >                         32768 (  32KB) -> 10 (10.00%)
> >                         16384 (  16KB) -> 13 (13.00%)
> >                          8192 (   8KB) -> 21 (21.00%)
> >                          4096 (   4KB) -> 33 (33.00%)
> >          directio         = off
> >          alignedio        = off
> >          bufferedio       = off
> >
> >          aging is off
> >          current utilization = 52.46%
> >
> > creating new fileset /mnt/scratch/test1
> > fs setup took 42 secs
> > Syncing()...1 sec
> > Starting Actual Benchmark At: Tue Dec  4 06:41:54 2012
> >
> > Syncing()...0 sec
> > FFSB benchmark finished   at: Tue Dec  4 06:42:53 2012
> >
> > Results:
> > Benchmark took 59.42 sec
> >
> > Total Results
> > ===============
> >              Op Name   Transactions      Trans/sec      % Trans     % Op Weight
> > Throughput
> >              =======   ============      =========      =======     ===========
> > ==========
> >              readall :        10510         176.87      54.808%         10.959%
> > 707KB/sec
> >               create :           48           0.81       0.250%          9.589%
> > 3.23KB/sec
> >               append :          100           1.68       0.521%         13.699%
> > 6.73KB/sec
> >               delete :            5           0.08       0.026%          6.849%
> > NA
> >                 stat :            5           0.08       0.026%          6.849%
> > NA
> >             writeall :          130           2.19       0.678%         12.329%
> > 8.75KB/sec
> >       writeall_fsync :           19           0.32       0.099%          8.219%
> > 1.28KB/sec
> >           open_close :            9           0.15       0.047%         12.329%
> > NA
> >         create_fsync :         8300         139.67      43.283%         12.329%
> > 559KB/sec
> >         append_fsync :           50           0.84       0.261%          6.849%
> > 3.37KB/sec
> > -
> > 322.70 Transactions per Second
> >
> > Throughput Results
> > ===================
> > Read Throughput: 707KB/sec
> > Write Throughput: 582KB/sec
> >
> > System Call Latency statistics in millisecs
> > =====
> >                 Min             Avg             Max             Total Calls
> >                 ========        ========        ========        ============
> > [   open]       0.061000        0.750540        10.721000                 63
> >    -
> > [   read]       0.017000        11.058425       28555.394000           10510
> >    -
> > [  write]       0.034000        6.705286        26812.076000            8647
> >    -
> > [ unlink]       0.922000        7.679800        25.364000                  5
> >    -
> > [  close]       0.019000        0.996635        34.723000                 63
> >    -
> > [   stat]       0.046000        0.942800        4.489000                   5
> >    -
> >
> > 0.2% User   Time
> > 2.6% System Time
> > 2.8% CPU Utilization
> >
> >
> > 3. fio test
> >
> > 1.) original kernel
> >
> > seq-read: (g=0): rw=read, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > ...
> > seq-read: (g=0): rw=read, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > seq-write: (g=1): rw=write, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > ...
> > seq-write: (g=1): rw=write, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > rnd-read: (g=2): rw=randread, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > ...
> > rnd-read: (g=2): rw=randread, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > rnd-write: (g=3): rw=randwrite, bs=8K-8K/8K-8K, ioengine=libaio,
> > iodepth=8
> > ...
> > rnd-write: (g=3): rw=randwrite, bs=8K-8K/8K-8K, ioengine=libaio,
> > iodepth=8
> > Starting 16 threads
> >
> > seq-read: (groupid=0, jobs=4): err= 0: pid=1646
> >   read : io=2,835MB, bw=24,192KB/s, iops=3,023, runt=120021msec
> >     slat (usec): min=0, max=999K, avg=1202.67, stdev=3145.84
> >     clat (usec): min=0, max=1,536K, avg=9186.07, stdev=11344.56
> >     bw (KB/s) : min=   39, max=21301, per=26.11%, avg=6315.41,
> > stdev=1082.63
> >   cpu          : usr=10.89%, sys=33.14%, ctx=1488108, majf=13, minf=2238
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=362940/0, short=0/0
> >      lat (usec): 2=3.53%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%
> >      lat (usec): 750=0.03%, 1000=0.03%
> >      lat (msec): 2=1.75%, 4=1.08%, 10=68.93%, 20=22.39%, 50=2.02%
> >      lat (msec): 100=0.16%, 250=0.04%, 1000=0.01%, 2000=0.03%
> > seq-write: (groupid=1, jobs=4): err= 0: pid=1646
> >   write: io=1,721MB, bw=14,652KB/s, iops=1,831, runt=120277msec
> >     slat (usec): min=0, max=1,004K, avg=1744.41, stdev=3144.06
> >     clat (usec): min=0, max=1,014K, avg=15699.65, stdev=19751.69
> >     bw (KB/s) : min=  285, max=18032, per=26.41%, avg=3869.67,
> > stdev=762.96
> >   cpu          : usr=6.29%, sys=22.61%, ctx=880380, majf=36, minf=3222
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=0/220282, short=0/0
> >      lat (usec): 2=2.43%, 500=0.01%, 750=0.12%, 1000=0.14%
> >      lat (msec): 2=0.86%, 4=1.72%, 10=39.03%, 20=42.20%, 50=11.87%
> >      lat (msec): 100=1.15%, 250=0.17%, 500=0.06%, 750=0.14%, 1000=0.09%
> >      lat (msec): 2000=0.02%
> > rnd-read: (groupid=2, jobs=4): err= 0: pid=1646
> >   read : io=65,128KB, bw=541KB/s, iops=67, runt=120381msec
> >     slat (usec): min=48, max=55,230, avg=167.95, stdev=248.50
> >     clat (msec): min=74, max=4,229, avg=472.23, stdev=129.50
> >     bw (KB/s) : min=    0, max=  203, per=25.34%, avg=137.08,
> > stdev=21.73
> >   cpu          : usr=0.85%, sys=2.19%, ctx=44001, majf=30, minf=3726
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.2%, 8=99.7%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=8141/0, short=0/0
> >
> >      lat (msec): 100=0.04%, 250=0.09%, 500=81.72%, 750=13.09%,
> > 1000=2.97%
> >      lat (msec): 2000=1.50%, >=2000=0.59%
> > rnd-write: (groupid=3, jobs=4): err= 0: pid=1646
> >   write: io=200MB, bw=1,698KB/s, iops=212, runt=120331msec
> >     slat (usec): min=48, max=215K, avg=2272.24, stdev=2283.09
> >     clat (usec): min=762, max=14,617K, avg=147521.66, stdev=444146.36
> >     bw (KB/s) : min=    1, max= 3960, per=56.86%, avg=964.90,
> > stdev=514.63
> >   cpu          : usr=1.25%, sys=4.20%, ctx=135229, majf=0, minf=10194
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=99.9%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=0/25536, short=0/0
> >      lat (usec): 1000=0.26%
> >      lat (msec): 2=0.13%, 4=2.01%, 10=3.77%, 20=42.78%, 50=20.95%
> >      lat (msec): 100=12.83%, 250=12.50%, 500=2.49%, 750=0.33%,
> > 1000=0.12%
> >      lat (msec): 2000=0.53%, >=2000=1.30%
> >
> > Run status group 0 (all jobs):
> >    READ: io=2,835MB, aggrb=24,191KB/s, minb=24,772KB/s, maxb=24,772KB/s,
> > mint=120021msec, maxt=120021msec
> >
> > Run status group 1 (all jobs):
> >   WRITE: io=1,721MB, aggrb=14,651KB/s, minb=15,003KB/s, maxb=15,003KB/s,
> > mint=120277msec, maxt=120277msec
> >
> > Run status group 2 (all jobs):
> >    READ: io=65,128KB, aggrb=541KB/s, minb=553KB/s, maxb=553KB/s,
> > mint=120381msec, maxt=120381msec
> >
> > Run status group 3 (all jobs):
> >   WRITE: io=200MB, aggrb=1,697KB/s, minb=1,738KB/s, maxb=1,738KB/s,
> > mint=120331msec, maxt=120331msec
> >
> > Disk stats (read/write):
> >   loop0: ios=0/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
> >
> > 2.) kernel with enabled hot tracking
> >
> > seq-read: (g=0): rw=read, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > ...
> > seq-read: (g=0): rw=read, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > seq-write: (g=1): rw=write, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > ...
> > seq-write: (g=1): rw=write, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > rnd-read: (g=2): rw=randread, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > ...
> > rnd-read: (g=2): rw=randread, bs=8K-8K/8K-8K, ioengine=libaio, iodepth=8
> > rnd-write: (g=3): rw=randwrite, bs=8K-8K/8K-8K, ioengine=libaio,
> > iodepth=8
> > ...
> > rnd-write: (g=3): rw=randwrite, bs=8K-8K/8K-8K, ioengine=libaio,
> > iodepth=8
> > Starting 16 threads
> >
> > seq-read: (groupid=0, jobs=4): err= 0: pid=2163
> >   read : io=3,047MB, bw=26,001KB/s, iops=3,250, runt=120003msec
> >     slat (usec): min=0, max=1,000K, avg=1141.34, stdev=2175.25
> >     clat (usec): min=0, max=1,002K, avg=8610.96, stdev=6184.67
> >     bw (KB/s) : min=   12, max=18896, per=25.28%, avg=6572.50,
> > stdev=713.22
> >   cpu          : usr=10.38%, sys=35.02%, ctx=1601418, majf=12, minf=2235
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=390029/0, short=0/0
> >      lat (usec): 2=1.49%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%
> >      lat (usec): 750=0.01%, 1000=0.02%
> >      lat (msec): 2=1.53%, 4=0.86%, 10=79.60%, 20=14.93%, 50=1.43%
> >      lat (msec): 100=0.09%, 250=0.02%, 500=0.01%, 1000=0.01%, 2000=0.01%
> > seq-write: (groupid=1, jobs=4): err= 0: pid=2163
> >   write: io=1,752MB, bw=14,950KB/s, iops=1,868, runt=120003msec
> >     slat (usec): min=0, max=1,002K, avg=1697.47, stdev=3568.70
> >     clat (usec): min=0, max=1,019K, avg=15630.94, stdev=21109.46
> >     bw (KB/s) : min=  123, max=14693, per=26.31%, avg=3933.46,
> > stdev=779.57
> >   cpu          : usr=6.31%, sys=21.85%, ctx=894177, majf=4, minf=3407
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=0/224253, short=0/0
> >      lat (usec): 2=2.44%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.06%
> >      lat (usec): 1000=0.23%
> >      lat (msec): 2=0.73%, 4=2.00%, 10=40.15%, 20=42.68%, 50=10.25%
> >      lat (msec): 100=0.95%, 250=0.14%, 500=0.10%, 750=0.12%, 1000=0.11%
> >      lat (msec): 2000=0.03%
> > rnd-read: (groupid=2, jobs=4): err= 0: pid=2163
> >   read : io=85,208KB, bw=709KB/s, iops=88, runt=120252msec
> >     slat (usec): min=52, max=48,325, avg=204.43, stdev=596.50
> >     clat (msec): min=1, max=2,754, avg=359.99, stdev=78.96
> >     bw (KB/s) : min=    0, max=  249, per=25.17%, avg=178.20,
> > stdev=23.79
> >   cpu          : usr=1.00%, sys=2.64%, ctx=55704, majf=28, minf=2971
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.2%, 8=99.7%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=10651/0, short=0/0
> >
> >      lat (msec): 2=0.01%, 50=0.02%, 100=0.04%, 250=1.61%, 500=92.60%
> >      lat (msec): 750=4.24%, 1000=0.68%, 2000=0.59%, >=2000=0.22%
> > rnd-write: (groupid=3, jobs=4): err= 0: pid=2163
> >   write: io=247MB, bw=2,019KB/s, iops=252, runt=125287msec
> >     slat (usec): min=51, max=286K, avg=2576.23, stdev=2882.30
> >     clat (usec): min=698, max=8,156K, avg=123274.05, stdev=355311.20
> >     bw (KB/s) : min=    1, max= 4848, per=57.62%, avg=1162.77,
> > stdev=560.79
> >   cpu          : usr=1.33%, sys=4.24%, ctx=163334, majf=0, minf=8588
> >   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=99.9%, 16=0.0%, 32=0.0%,
> >>=64=0.0%
> >      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      complete  : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%,
> >>=64=0.0%
> >      issued r/w: total=0/31616, short=0/0
> >      lat (usec): 750=0.03%, 1000=0.15%
> >      lat (msec): 2=0.06%, 4=2.15%, 10=3.57%, 20=48.23%, 50=22.43%
> >      lat (msec): 100=11.48%, 250=9.14%, 500=1.04%, 750=0.16%, 1000=0.05%
> >      lat (msec): 2000=0.09%, >=2000=1.42%
> >
> > Run status group 0 (all jobs):
> >    READ: io=3,047MB, aggrb=26,001KB/s, minb=26,625KB/s, maxb=26,625KB/s,
> > mint=120003msec, maxt=120003msec
> >
> > Run status group 1 (all jobs):
> >   WRITE: io=1,752MB, aggrb=14,949KB/s, minb=15,308KB/s, maxb=15,308KB/s,
> > mint=120003msec, maxt=120003msec
> >
> > Run status group 2 (all jobs):
> >    READ: io=85,208KB, aggrb=708KB/s, minb=725KB/s, maxb=725KB/s,
> > mint=120252msec, maxt=120252msec
> >
> > Run status group 3 (all jobs):
> >   WRITE: io=247MB, aggrb=2,018KB/s, minb=2,067KB/s, maxb=2,067KB/s,
> > mint=125287msec, maxt=125287msec
> >
> > Disk stats (read/write):
> >   loop0: ios=0/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
> >
> >
> > 4. compilebench test
> >
> > 1.) original kernel
> >
> > using working directory /mnt/scratch/, 30 intial dirs 100 runs
> >
> > native unpatched native-0 222MB in 87.48 seconds (2.54 MB/s)
> > native patched native-0 109MB in 24.89 seconds (4.41 MB/s)
> > native patched compiled native-0 691MB in 35.54 seconds (19.46 MB/s)
> > create dir kernel-0 222MB in 91.22 seconds (2.44 MB/s)
> > create dir kernel-1 222MB in 91.55 seconds (2.43 MB/s)
> > create dir kernel-2 222MB in 97.00 seconds (2.29 MB/s)
> > create dir kernel-3 222MB in 87.64 seconds (2.54 MB/s)
> > create dir kernel-4 222MB in 86.18 seconds (2.58 MB/s)
> > create dir kernel-5 222MB in 84.68 seconds (2.63 MB/s)
> > create dir kernel-6 222MB in 85.02 seconds (2.62 MB/s)
> > create dir kernel-7 222MB in 87.74 seconds (2.53 MB/s)
> > create dir kernel-8 222MB in 86.79 seconds (2.56 MB/s)
> > create dir kernel-9 222MB in 87.85 seconds (2.53 MB/s)
> > create dir kernel-10 222MB in 86.88 seconds (2.56 MB/s)
> > create dir kernel-11 222MB in 86.47 seconds (2.57 MB/s)
> > create dir kernel-12 222MB in 84.26 seconds (2.64 MB/s)
> > create dir kernel-13 222MB in 87.40 seconds (2.54 MB/s)
> > create dir kernel-14 222MB in 85.44 seconds (2.60 MB/s)
> > create dir kernel-15 222MB in 86.80 seconds (2.56 MB/s)
> > create dir kernel-16 222MB in 88.57 seconds (2.51 MB/s)
> > create dir kernel-17 222MB in 85.66 seconds (2.60 MB/s)
> > create dir kernel-18 222MB in 87.40 seconds (2.54 MB/s)
> > create dir kernel-19 222MB in 85.47 seconds (2.60 MB/s)
> > create dir kernel-20 222MB in 89.29 seconds (2.49 MB/s)
> > create dir kernel-21 222MB in 88.53 seconds (2.51 MB/s)
> > create dir kernel-22 222MB in 86.25 seconds (2.58 MB/s)
> > create dir kernel-23 222MB in 85.34 seconds (2.61 MB/s)
> > create dir kernel-24 222MB in 84.61 seconds (2.63 MB/s)
> > create dir kernel-25 222MB in 88.13 seconds (2.52 MB/s)
> > create dir kernel-26 222MB in 85.57 seconds (2.60 MB/s)
> > create dir kernel-27 222MB in 87.26 seconds (2.55 MB/s)
> > create dir kernel-28 222MB in 83.68 seconds (2.66 MB/s)
> > create dir kernel-29 222MB in 86.33 seconds (2.58 MB/s)
> > === sdb ===
> >   CPU  0:              9366376 events,   439049 KiB data
> >   Total:               9366376 events (dropped 0),   439049 KiB data
> > patch dir kernel-7 109MB in 55.00 seconds (1.99 MB/s)
> > compile dir kernel-7 691MB in 37.15 seconds (18.62 MB/s)
> > compile dir kernel-14 680MB in 38.48 seconds (17.69 MB/s)
> > patch dir kernel-14 691MB in 93.31 seconds (7.41 MB/s)
> > read dir kernel-7 in 93.36 9.85 MB/s
> > read dir kernel-10 in 58.25 3.82 MB/s
> > create dir kernel-3116 222MB in 91.96 seconds (2.42 MB/s)
> > clean kernel-7 691MB in 5.16 seconds (134.03 MB/s)
> > read dir kernel-6 in 56.98 3.90 MB/s
> > stat dir kernel-2 in 19.42 seconds
> > compile dir kernel-2 680MB in 43.11 seconds (15.79 MB/s)
> > clean kernel-14 691MB in 6.27 seconds (110.30 MB/s)
> > clean kernel-2 680MB in 5.79 seconds (117.55 MB/s)
> > patch dir kernel-2 109MB in 71.22 seconds (1.54 MB/s)
> > stat dir kernel-2 in 16.06 seconds
> > create dir kernel-6231 222MB in 96.20 seconds (2.31 MB/s)
> > delete kernel-8 in 45.20 seconds
> > compile dir kernel-2 691MB in 38.58 seconds (17.93 MB/s)
> > create dir kernel-70151 222MB in 93.41 seconds (2.38 MB/s)
> > clean kernel-2 691MB in 5.09 seconds (135.87 MB/s)
> > create dir kernel-78184 222MB in 86.04 seconds (2.58 MB/s)
> > compile dir kernel-7 691MB in 37.60 seconds (18.39 MB/s)
> > create dir kernel-64250 222MB in 80.33 seconds (2.77 MB/s)
> > delete kernel-12 in 43.00 seconds
> > stat dir kernel-2 in 16.43 seconds
> > patch dir kernel-70151 109MB in 77.42 seconds (1.42 MB/s)
> > stat dir kernel-7 in 18.48 seconds
> > stat dir kernel-78184 in 18.62 seconds
> > compile dir kernel-2 691MB in 43.31 seconds (15.97 MB/s)
> > compile dir kernel-26 680MB in 50.37 seconds (13.51 MB/s)
> > stat dir kernel-7 in 21.52 seconds
> > create dir kernel-2717 222MB in 89.86 seconds (2.47 MB/s)
> > delete kernel-26 in 47.81 seconds
> > stat dir kernel-2 in 18.61 seconds
> > compile dir kernel-14 691MB in 46.66 seconds (14.82 MB/s)
> > compile dir kernel-70151 691MB in 39.19 seconds (17.65 MB/s)
> > create dir kernel-55376 222MB in 88.91 seconds (2.50 MB/s)
> > stat dir kernel-22 in 18.66 seconds
> > delete kernel-55376 in 37.71 seconds
> > patch dir kernel-27 109MB in 74.82 seconds (1.47 MB/s)
> > patch dir kernel-64250 109MB in 81.08 seconds (1.35 MB/s)
> > read dir kernel-6231 in 82.15 2.71 MB/s
> > patch dir kernel-9 109MB in 96.02 seconds (1.14 MB/s)
> > stat dir kernel-14 in 22.46 seconds
> > read dir kernel-29 in 58.10 3.83 MB/s
> > create dir kernel-57327 222MB in 93.92 seconds (2.37 MB/s)
> > stat dir kernel-14 in 21.92 seconds
> > compile dir kernel-27 691MB in 41.43 seconds (16.69 MB/s)
> > create dir kernel-64334 222MB in 89.31 seconds (2.49 MB/s)
> > patch dir kernel-1 109MB in 84.37 seconds (1.30 MB/s)
> > create dir kernel-16056 222MB in 94.93 seconds (2.34 MB/s)
> > clean kernel-7 691MB in 7.27 seconds (95.13 MB/s)
> > delete kernel-27 in 46.32 seconds
> > create dir kernel-51614 222MB in 88.91 seconds (2.50 MB/s)
> > clean kernel-14 691MB in 6.71 seconds (103.07 MB/s)
> > delete kernel-64250 in 43.60 seconds
> > stat dir kernel-2 in 24.25 seconds
> > clean kernel-70151 691MB in 6.20 seconds (111.55 MB/s)
> > delete kernel-14 in 40.74 seconds
> > read dir kernel-2 in 118.45 7.76 MB/s
> > create dir kernel-24150 222MB in 88.99 seconds (2.50 MB/s)
> > read dir kernel-9 in 83.70 2.73 MB/s
> > patch dir kernel-19 109MB in 76.06 seconds (1.44 MB/s)
> > clean kernel-2 691MB in 6.64 seconds (104.16 MB/s)
> > compile dir kernel-18 680MB in 47.33 seconds (14.38 MB/s)
> > compile dir kernel-2 691MB in 44.63 seconds (15.50 MB/s)
> > delete kernel-2 in 51.03 seconds
> > delete kernel-70151 in 45.96 seconds
> > stat dir kernel-1 in 17.56 seconds
> > read dir kernel-18 in 121.08 7.46 MB/s
> > clean kernel-18 680MB in 6.47 seconds (105.20 MB/s)
> > compile dir kernel-17 680MB in 52.10 seconds (13.06 MB/s)
> > read dir kernel-17 in 114.66 7.88 MB/s
> > stat dir kernel-18 in 30.36 seconds
> > stat dir kernel-64334 in 44.78 seconds
> > delete kernel-24150 in 44.79 seconds
> > delete kernel-17 in 47.64 seconds
> > stat dir kernel-1 in 19.87 seconds
> > compile dir kernel-7 691MB in 47.65 seconds (14.51 MB/s)
> > patch dir kernel-16 109MB in 100.96 seconds (1.09 MB/s)
> > stat dir kernel-7 in 21.35 seconds
> > create dir kernel-82195 222MB in 111.17 seconds (2.00 MB/s)
> > delete kernel-82195 in 40.79 seconds
> > stat dir kernel-3 in 19.51 seconds
> > patch dir kernel-2717 109MB in 94.55 seconds (1.16 MB/s)
> > patch dir kernel-5 109MB in 60.21 seconds (1.82 MB/s)
> > read dir kernel-2717 in 94.85 2.41 MB/s
> > delete kernel-29 in 40.51 seconds
> > clean kernel-7 691MB in 5.84 seconds (118.42 MB/s)
> > read dir kernel-4 in 57.91 3.84 MB/s
> > stat dir kernel-78184 in 19.65 seconds
> > patch dir kernel-0 109MB in 90.61 seconds (1.21 MB/s)
> > patch dir kernel-3 109MB in 75.67 seconds (1.45 MB/s)
> > create dir kernel-30226 222MB in 106.72 seconds (2.08 MB/s)
> > read dir kernel-19 in 83.79 2.72 MB/s
> > read dir kernel-9 in 82.64 2.76 MB/s
> > delete kernel-5 in 38.89 seconds
> > read dir kernel-7 in 59.70 3.82 MB/s
> > patch dir kernel-57327 109MB in 101.71 seconds (1.08 MB/s)
> > read dir kernel-11 in 59.83 3.72 MB/s
> >
> > run complete:
> > ==========================================================================
> > intial create total runs 30 avg 2.55 MB/s (user 13.94s sys 34.07s)
> > create total runs 14 avg 2.41 MB/s (user 13.83s sys 34.39s)
> > patch total runs 15 avg 1.79 MB/s (user 6.55s sys 34.71s)
> > compile total runs 14 avg 16.04 MB/s (user 2.65s sys 16.88s)
> > clean total runs 10 avg 113.53 MB/s (user 0.46s sys 3.14s)
> > read tree total runs 11 avg 3.30 MB/s (user 11.68s sys 24.50s)
> > read compiled tree total runs 4 avg 8.24 MB/s (user 13.67s sys 35.85s)
> > delete tree total runs 10 avg 42.12 seconds (user 6.76s sys 24.50s)
> > delete compiled tree total runs 4 avg 48.20 seconds (user 7.65s sys
> > 28.60s)
> > stat tree total runs 11 avg 21.90 seconds (user 6.87s sys 6.34s)
> > stat compiled tree total runs 7 avg 21.23 seconds (user 7.65s sys 7.15s)
> >
> > 2.) kernel with enabled hot tracking
> >
> > using working directory /mnt/scratch/, 30 intial dirs 100 runs
> > native unpatched native-0 222MB in 112.82 seconds (1.97 MB/s)
> > native patched native-0 109MB in 27.38 seconds (4.01 MB/s)
> > native patched compiled native-0 691MB in 40.42 seconds (17.11 MB/s)
> > create dir kernel-0 222MB in 92.88 seconds (2.39 MB/s)
> > create dir kernel-1 222MB in 98.56 seconds (2.26 MB/s)
> > create dir kernel-2 222MB in 107.27 seconds (2.07 MB/s)
> > create dir kernel-3 222MB in 92.81 seconds (2.40 MB/s)
> > create dir kernel-4 222MB in 90.30 seconds (2.46 MB/s)
> > create dir kernel-5 222MB in 91.57 seconds (2.43 MB/s)
> > create dir kernel-6 222MB in 91.92 seconds (2.42 MB/s)
> > create dir kernel-7 222MB in 90.16 seconds (2.47 MB/s)
> > create dir kernel-8 222MB in 94.71 seconds (2.35 MB/s)
> > create dir kernel-9 222MB in 91.79 seconds (2.42 MB/s)
> > create dir kernel-10 222MB in 92.14 seconds (2.41 MB/s)
> > create dir kernel-11 222MB in 88.59 seconds (2.51 MB/s)
> > create dir kernel-12 222MB in 92.15 seconds (2.41 MB/s)
> > create dir kernel-13 222MB in 91.54 seconds (2.43 MB/s)
> > create dir kernel-14 222MB in 91.15 seconds (2.44 MB/s)
> > create dir kernel-15 222MB in 90.54 seconds (2.46 MB/s)
> > create dir kernel-16 222MB in 92.23 seconds (2.41 MB/s)
> > create dir kernel-17 222MB in 89.88 seconds (2.47 MB/s)
> > create dir kernel-18 222MB in 94.65 seconds (2.35 MB/s)
> > create dir kernel-19 222MB in 89.99 seconds (2.47 MB/s)
> > create dir kernel-20 222MB in 90.35 seconds (2.46 MB/s)
> > create dir kernel-21 222MB in 90.92 seconds (2.45 MB/s)
> > create dir kernel-22 222MB in 90.76 seconds (2.45 MB/s)
> > create dir kernel-23 222MB in 90.04 seconds (2.47 MB/s)
> > create dir kernel-24 222MB in 89.60 seconds (2.48 MB/s)
> > create dir kernel-25 222MB in 91.52 seconds (2.43 MB/s)
> > create dir kernel-26 222MB in 90.45 seconds (2.46 MB/s)
> > create dir kernel-27 222MB in 92.72 seconds (2.40 MB/s)
> > create dir kernel-28 222MB in 90.37 seconds (2.46 MB/s)
> > create dir kernel-29 222MB in 89.60 seconds (2.48 MB/s)
> > === sdb ===
> >   CPU  0:              8878754 events,   416192 KiB data
> >   Total:               8878754 events (dropped 0),   416192 KiB data
> > patch dir kernel-7 109MB in 61.00 seconds (1.80 MB/s)
> > compile dir kernel-7 691MB in 40.21 seconds (17.20 MB/s)
> > compile dir kernel-14 680MB in 45.97 seconds (14.81 MB/s)
> > patch dir kernel-14 691MB in 83.73 seconds (8.26 MB/s)
> > read dir kernel-7 in 88.66 10.37 MB/s
> > read dir kernel-10 in 56.44 3.94 MB/s
> > create dir kernel-3116 222MB in 91.58 seconds (2.43 MB/s)
> > clean kernel-7 691MB in 6.69 seconds (103.38 MB/s)
> > read dir kernel-6 in 61.07 3.64 MB/s
> > stat dir kernel-2 in 21.42 seconds
> > compile dir kernel-2 680MB in 44.55 seconds (15.28 MB/s)
> > clean kernel-14 691MB in 6.98 seconds (99.08 MB/s)
> > clean kernel-2 680MB in 6.12 seconds (111.21 MB/s)
> > patch dir kernel-2 109MB in 73.95 seconds (1.48 MB/s)
> > stat dir kernel-2 in 18.61 seconds
> > create dir kernel-6231 222MB in 100.84 seconds (2.21 MB/s)
> > delete kernel-8 in 40.38 seconds
> > compile dir kernel-2 691MB in 42.18 seconds (16.40 MB/s)
> > create dir kernel-70151 222MB in 96.34 seconds (2.31 MB/s)
> > clean kernel-2 691MB in 4.54 seconds (152.33 MB/s)
> > create dir kernel-78184 222MB in 94.71 seconds (2.35 MB/s)
> > compile dir kernel-7 691MB in 43.64 seconds (15.85 MB/s)
> > create dir kernel-64250 222MB in 87.65 seconds (2.54 MB/s)
> > delete kernel-12 in 38.58 seconds
> > stat dir kernel-2 in 17.48 seconds
> > patch dir kernel-70151 109MB in 79.82 seconds (1.37 MB/s)
> > stat dir kernel-7 in 25.76 seconds
> > stat dir kernel-78184 in 20.30 seconds
> > compile dir kernel-2 691MB in 40.93 seconds (16.90 MB/s)
> > compile dir kernel-26 680MB in 48.86 seconds (13.93 MB/s)
> > stat dir kernel-7 in 23.87 seconds
> > create dir kernel-2717 222MB in 98.71 seconds (2.25 MB/s)
> > delete kernel-26 in 45.60 seconds
> > stat dir kernel-2 in 22.62 seconds
> > compile dir kernel-14 691MB in 51.12 seconds (13.53 MB/s)
> > compile dir kernel-70151 691MB in 41.40 seconds (16.71 MB/s)
> > create dir kernel-55376 222MB in 94.61 seconds (2.35 MB/s)
> > stat dir kernel-22 in 22.11 seconds
> > delete kernel-55376 in 36.47 seconds
> > patch dir kernel-27 109MB in 76.74 seconds (1.43 MB/s)
> > patch dir kernel-64250 109MB in 86.43 seconds (1.27 MB/s)
> > read dir kernel-6231 in 85.10 2.61 MB/s
> > patch dir kernel-9 109MB in 97.67 seconds (1.12 MB/s)
> > stat dir kernel-14 in 24.80 seconds
> > read dir kernel-29 in 61.00 3.65 MB/s
> > create dir kernel-57327 222MB in 101.42 seconds (2.19 MB/s)
> > stat dir kernel-14 in 22.45 seconds
> > compile dir kernel-27 691MB in 48.19 seconds (14.35 MB/s)
> > create dir kernel-64334 222MB in 96.65 seconds (2.30 MB/s)
> > patch dir kernel-1 109MB in 88.32 seconds (1.24 MB/s)
> > create dir kernel-16056 222MB in 100.60 seconds (2.21 MB/s)
> > clean kernel-7 691MB in 8.20 seconds (84.34 MB/s)
> > delete kernel-27 in 48.53 seconds
> > create dir kernel-51614 222MB in 98.07 seconds (2.27 MB/s)
> > clean kernel-14 691MB in 6.82 seconds (101.41 MB/s)
> > delete kernel-64250 in 44.01 seconds
> > stat dir kernel-2 in 26.37 seconds
> > clean kernel-70151 691MB in 6.21 seconds (111.37 MB/s)
> > delete kernel-14 in 41.74 seconds
> > read dir kernel-2 in 122.71 7.50 MB/s
> > create dir kernel-24150 222MB in 99.01 seconds (2.25 MB/s)
> > read dir kernel-9 in 78.29 2.91 MB/s
> > patch dir kernel-19 109MB in 77.45 seconds (1.42 MB/s)
> > clean kernel-2 691MB in 5.94 seconds (116.43 MB/s)
> > compile dir kernel-18 680MB in 49.17 seconds (13.84 MB/s)
> > compile dir kernel-2 691MB in 47.20 seconds (14.65 MB/s)
> > delete kernel-2 in 48.01 seconds
> > delete kernel-70151 in 47.60 seconds
> > stat dir kernel-1 in 21.80 seconds
> > read dir kernel-18 in 109.98 8.21 MB/s
> > clean kernel-18 680MB in 7.78 seconds (87.49 MB/s)
> > compile dir kernel-17 680MB in 54.39 seconds (12.51 MB/s)
> > read dir kernel-17 in 108.52 8.32 MB/s
> > stat dir kernel-18 in 19.48 seconds
> > stat dir kernel-64334 in 22.04 seconds
> > delete kernel-24150 in 44.36 seconds
> > delete kernel-17 in 49.09 seconds
> > stat dir kernel-1 in 18.16 seconds
> > compile dir kernel-7 691MB in 48.90 seconds (14.14 MB/s)
> > patch dir kernel-16 109MB in 103.71 seconds (1.06 MB/s)
> > stat dir kernel-7 in 21.94 seconds
> > create dir kernel-82195 222MB in 110.82 seconds (2.01 MB/s)
> > delete kernel-82195 in 38.64 seconds
> > stat dir kernel-3 in 22.88 seconds
> > patch dir kernel-2717 109MB in 92.23 seconds (1.19 MB/s)
> > patch dir kernel-5 109MB in 64.95 seconds (1.69 MB/s)
> > read dir kernel-2717 in 97.88 2.33 MB/s
> > delete kernel-29 in 40.59 seconds
> > clean kernel-7 691MB in 5.09 seconds (135.87 MB/s)
> > read dir kernel-4 in 59.42 3.74 MB/s
> > stat dir kernel-78184 in 20.24 seconds
> > patch dir kernel-0 109MB in 95.95 seconds (1.14 MB/s)
> > patch dir kernel-3 109MB in 62.86 seconds (1.74 MB/s)
> > create dir kernel-30226 222MB in 106.81 seconds (2.08 MB/s)
> > read dir kernel-19 in 81.32 2.81 MB/s
> > read dir kernel-9 in 74.65 3.06 MB/s
> > delete kernel-5 in 42.04 seconds
> > read dir kernel-7 in 61.95 3.68 MB/s
> > patch dir kernel-57327 109MB in 97.85 seconds (1.12 MB/s)
> > read dir kernel-11 in 58.85 3.78 MB/s
> >
> > run complete:
> > ==========================================================================
> > intial create total runs 30 avg 2.42 MB/s (user 13.60s sys 36.18s)
> > create total runs 14 avg 2.27 MB/s (user 13.66s sys 36.94s)
> > patch total runs 15 avg 1.82 MB/s (user 6.62s sys 36.93s)
> > compile total runs 14 avg 15.01 MB/s (user 2.76s sys 18.29s)
> > clean total runs 10 avg 110.29 MB/s (user 0.46s sys 3.21s)
> > read tree total runs 11 avg 3.29 MB/s (user 11.04s sys 28.65s)
> > read compiled tree total runs 4 avg 8.60 MB/s (user 13.16s sys 41.32s)
> > delete tree total runs 10 avg 41.44 seconds (user 6.43s sys 25.19s)
> > delete compiled tree total runs 4 avg 47.81 seconds (user 7.18s sys
> > 29.27s)
> > stat tree total runs 11 avg 20.41 seconds (user 6.39s sys 7.45s)
> > stat compiled tree total runs 7 avg 23.97 seconds (user 7.24s sys 8.74s)
> >
> > On Fri, 2012-11-16 at 17:51 +0800, zwu.kernel@...il.com wrote:
> >> From: Zhi Yong Wu <wuzhy@...ux.vnet.ibm.com>
> >>
> >> HI, guys,
> >>
> >>   Any comments or ideas are appreciated, thanks.
> >>
> >> NOTE:
> >>
> >>   The patchset can be obtained via my kernel dev git on github:
> >> git://github.com/wuzhy/kernel.git hot_tracking
> >>   If you're interested, you can also review them via
> >> https://github.com/wuzhy/kernel/commits/hot_tracking
> >>
> >>   For more info, please check hot_tracking.txt in Documentation
> >>
> >> TODO List:
> >>
> >>  1.) Need to do scalability or performance tests. - Required
> >>  2.) Need one simpler but efficient temp calculation function
> >>  3.) How to save the file temperature among the umount to be able to
> >>      preserve the file tempreture after reboot - Optional
> >>
> >> Changelog:
> >>
> >>  - Solved 64 bits inode number issue. [David Sterba]
> >>  - Embed struct hot_type in struct file_system_type [Darrick J. Wong]
> >>  - Cleanup Some issues [David Sterba]
> >>  - Use a static hot debugfs root [Greg KH]
> >>  - Rewritten debugfs support based on seq_file operation. [Dave Chinner]
> >>  - Refactored workqueue support. [Dave Chinner]
> >>  - Turn some Micro into be tunable   [Zhiyong, Zheng Liu]
> >>        TIME_TO_KICK, and HEAT_UPDATE_DELAY
> >>  - Introduce hot func registering framework [Zhiyong]
> >>  - Remove global variable for hot tracking [Zhiyong]
> >>  - Add xfs hot tracking support [Dave Chinner]
> >>  - Add ext4 hot tracking support [Zheng Liu]
> >>  - Cleanedup a lot of other issues [Dave Chinner]
> >>  - Added memory shrinker [Dave Chinner]
> >>  - Converted to one workqueue to update map info periodically [Dave Chinner]
> >>  - Cleanedup a lot of other issues [Dave Chinner]
> >>  - Reduce new files and put all in fs/hot_tracking.[ch] [Dave Chinner]
> >>  - Add btrfs hot tracking support [Zhiyong]
> >>  - The first three patches can probably just be flattened into one.
> >>                                         [Marco Stornelli , Dave Chinner]
> >>
> >> Zhi Yong Wu (16):
> >>   vfs: introduce some data structures
> >>   vfs: add init and cleanup functions
> >>   vfs: add I/O frequency update function
> >>   vfs: add two map arrays
> >>   vfs: add hooks to enable hot tracking
> >>   vfs: add temp calculation function
> >>   vfs: add map info update function
> >>   vfs: add aging function
> >>   vfs: add one work queue
> >>   vfs: add FS hot type support
> >>   vfs: register one shrinker
> >>   vfs: add one ioctl interface
> >>   vfs: add debugfs support
> >>   proc: add two hot_track proc files
> >>   btrfs: add hot tracking support
> >>   vfs: add documentation
> >>
> >>  Documentation/filesystems/00-INDEX         |    2 +
> >>  Documentation/filesystems/hot_tracking.txt |  263 ++++++
> >>  fs/Makefile                                |    2 +-
> >>  fs/btrfs/ctree.h                           |    1 +
> >>  fs/btrfs/super.c                           |   22 +-
> >>  fs/compat_ioctl.c                          |    5 +
> >>  fs/dcache.c                                |    2 +
> >>  fs/direct-io.c                             |    6 +
> >>  fs/hot_tracking.c                          | 1306 ++++++++++++++++++++++++++++
> >>  fs/hot_tracking.h                          |   52 ++
> >>  fs/ioctl.c                                 |   74 ++
> >>  include/linux/fs.h                         |    5 +
> >>  include/linux/hot_tracking.h               |  152 ++++
> >>  kernel/sysctl.c                            |   14 +
> >>  mm/filemap.c                               |    6 +
> >>  mm/page-writeback.c                        |   12 +
> >>  mm/readahead.c                             |    7 +
> >>  17 files changed, 1929 insertions(+), 2 deletions(-)
> >>  create mode 100644 Documentation/filesystems/hot_tracking.txt
> >>  create mode 100644 fs/hot_tracking.c
> >>  create mode 100644 fs/hot_tracking.h
> >>  create mode 100644 include/linux/hot_tracking.h
> >>
> >
> > --
> > Regards,
> >
> > Zhi Yong Wu
> >
> 
> 
> 
> -- 
> Regards,
> 
> Zhi Yong Wu
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ