lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-Id: <200704261312.25571.mgd@technosis.de>
Date:	Thu, 26 Apr 2007 13:12:12 +0200
From:	Michael Gerdau <mgd@...hnosis.de>
To:	linux-kernel@...r.kernel.org
Cc:	Ingo Molnar <mingo@...e.hu>,
	Linus Torvalds <torvalds@...ux-foundation.org>,
	Nick Piggin <npiggin@...e.de>,
	Gene Heskett <gene.heskett@...il.com>,
	Juliusz Chroboczek <jch@....jussieu.fr>,
	Mike Galbraith <efault@....de>,
	Peter Williams <pwil3058@...pond.net.au>,
	ck list <ck@....kolivas.org>,
	Thomas Gleixner <tglx@...utronix.de>,
	William Lee Irwin III <wli@...omorphy.com>,
	Andrew Morton <akpm@...ux-foundation.org>,
	Bill Davidsen <davidsen@....com>, Willy Tarreau <w@....eu>,
	Arjan van de Ven <arjan@...radead.org>
Subject: [REPORT] cfs-v6-rc2 vs sd-0.46 vs 2.6.21-rc7

Hi list,

find below a test comparing
    2.6.21-rc7 (mainline)
    2.6.21-rc7-sd046
    2.6.21-rc7-cfs-v6-rc2(*) (X @ nice 0)
    2.6.21-rc7-cfs-v6-rc2(*) (X @ nice -10)
running on a dualcore x86_64.

(*) At the time I started the tests, 2.6.21-rc7-cfs-v6 was not yet
available. I don't know whether the changes from -v6-rc2 would
have had an impact on the results.


The 3 tasks perform extensive computations on some data that is
initially loaded from disk. Each completed run (1711 per task in
total) in saved in a PostgreSQL DB running on the same machine

I do provide actual start and end timestamp of each task.
Each task is run via 'time'; those figures are provided as well.
Last not least the timevalues given from "within" the perl script
are provided by calling the perl builtin function "times" which
(hopefully) gives user time (among other things).

Note that both mainline and cfs did finish the jobs in the order
LTMM, LTMB, LTBM while sd had them finished in the order LTMM,
LTBM, LTMB. Also sd had the shortest time to have all three
finished while cfs was the first to finish LTMM (the fastest of
the three jobs).

I don't really know the reason for these differences:
LTMM, LTMB and LTBM all do similar things though there are differences.
LTMM is indeed the job that involves the least computations but I have
not yet tried to find out in what order of magnitude. I could if that
would be of interest though it would involve extensive analysis and
partly depends on the data processed and I'm not keen to do that.

I have not extensively checked how stable these figures are w/r to
repeated reruns as a single run takes roughly 3h, but I have repeated
one run and that produced basically the same timing.

One remark regarding cfs with X niced to -10 and 0:
I have not really seen much difference in terms of usage experience
between the two. If at all I have the impression that at nice -10
under KDE some apps (namely kontact and the helper it is using) have
a higher probability to actually "take over" the desktop but so far
this is just a vague impression (read: have not been able to reproduce).
On the other hand I have not seen degradations with nice 0 either and
thus my gut feeling prefers cfs nice 0. Thanks to the bootparam
privileged_nice_level=0 this is easy to achieve.

When comparing cfs nice 0 and sd I have not been able to see any
real difference w/r to desktop responsiveness. But then I have not
tried to stresstest the desktop while running the above benchmarks
either.

Anyway, here are the numbers. Feel free to ask whenever something
is unclear. GC2 is the name of the dataset processed.


2.6.21-rc7-cfs-v6-rc2 (X @ nice -10)
====================================
/proc/sys/kernel/sched_granularity_ns=6000000

Start of all 3 jobs: 10:03:01.933

Job LTMM End: 12:25:57.214
GC2 20070101 LTMM Thu Apr 26 12:25:20.844 2007: 142.42 Min.,  4.9942 sec/run (1711 runs)
Ranking-3.pl fertig nach 5484.580s(CPU) und 8574 Sek.
times:                   bewerteUmgeb #        1 Su    0.79 ~  0.7900
times:                      evalMarkt #     1711 Su 5469.91 ~  3.1969
times:                        writeDB #     1711 Su    0.26 ~  0.0002
real	142m56.806s
user	91m24.871s
sys	0m13.257s


Job LTMB End: 12:57:14.624
GC2 20070101 LTMB Thu Apr 26 12:56:52.295 2007: 173.90 Min.,  6.0982 sec/run (1711 runs)
Ranking-3.pl fertig nach 7544.170s(CPU) und 10449 Sek.
times:                   bewerteUmgeb #        1 Su    1.37 ~  1.3700
times:                      evalMarkt #     1711 Su 7529.12 ~  4.4004
times:                        writeDB #     1711 Su    0.27 ~  0.0002
real	174m10.404s
user	125m44.484s
sys	0m15.293s


Job LTBM End: 12:59:47.879
GC2 20070101 LTBM Thu Apr 26 12:59:30.257 2007: 176.55 Min.,  6.1911 sec/run (1711 runs)
Ranking-3.pl fertig nach 7584.040s(CPU) und 10607 Sek.
times:                   bewerteUmgeb #        1 Su    0.82 ~  0.8200
times:                      evalMarkt #     1711 Su 7569.56 ~  4.4241
times:                        writeDB #     1711 Su    0.25 ~  0.0001
real	176m50.446s
user	126m24.490s
sys	0m15.689s


From fairly early during the job:
top - 10:07:02 up  1:07,  9 users,  load average: 3.18, 1.83, 0.84
Tasks:   3 total,   3 running,   0 sleeping,   0 stopped,   0 zombie
Cpu(s): 99.3%us,  0.2%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.2%hi,  0.3%si,  0.0%st
Mem:   3348632k total,  1377624k used,  1971008k free,    51748k buffers
Swap:  2097144k total,        0k used,  2097144k free,   674288k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
13938 mgd       20   0 92780  17m 3668 R  100  0.5   2:31.04 perl
13937 mgd       20   0 93884  18m 3672 R   50  0.6   2:51.31 perl
13940 mgd       20   0 93864  18m 3668 R   50  0.6   2:28.69 perl


procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 3  0      0 1954320  52516 688484    0    0     0    71  430  927 100  0  0  0
 4  0      0 1954412  52532 688496    0    0     0    49  433  942 100  0  0  0
 3  0      0 1954012  52556 688492    0    0     0   159  452 1203 100  0  0  0
 3  0      0 1953924  52584 688476    0    0     0   141  444  961 100  0  0  0
 3  0      0 1953964  52584 688512    0    0     0     0  470 1170 100  0  0  0
 3  0      0 1953980  52600 688516    0    0     0    83  490 1144 100  0  0  0
 3  0      0 1953948  52600 688524    0    0     0     0  503 1303 100  0  0  0
 3  0      0 1953852  52624 688524    0    0     0    97  503 1394 100  0  0  0
 4  0      0 1953852  52640 688512    0    0     0    96  496 1474 100  0  0  0
 3  0      0 1953332  52656 688524    0    0     3    93  487 1556 100  0  0  0
 5  0      0 1953272  52672 688536    0    0     0    65  494 1483 100  0  0  0
 3  0      0 1953264  52684 688548    0    0     0    39  486 1452 100  0  0  0
 3  0      0 1953216  52692 688576    0    0     3    44  436  983 100  0  0  0
 5  0      0 1953264  52708 688564    0    0     0    61  437  911 100  0  0  0
 3  0      0 1953264  52708 688580    0    0     0     0  420  896 100  0  0  0
 3  0      0 1953172  52732 688584    0    0     0    67  437  913 100  0  0  0
 5  0      0 1952948  52740 688584    0    0     0    73  466 1720 99  1  0  0
 3  0      0 1952996  52772 688572    0    0     1   109  470 1173 99  0  1  0
 3  0      0 1952996  52788 688580    0    0     0    47  479 1491 89 10  1  0
 3  0      0 1952996  52796 688588    0    0     0    19  464 1101 95  5  0  0
 3  0      0 1952964  52836 688584    0    0     0   179  461 1072 100  0  0  0



2.6.21-rc7-cfs-v6-rc2 (X @ nice 0)
==================================
/proc/sys/kernel/sched_granularity_ns=6000000

Start of all 3 jobs: 15:13:57.802

Job LTMM End: 17:19:53.494
GC2 20070101 LTMM Wed Apr 25 17:19:18.802 2007: 125.45 Min.,  4.3992 sec/run (1711 runs)
Ranking-3.pl finished after 5472.800s(CPU) and 7555 Sec.
times:                   bewerteUmgeb #        1 Su    0.79 ~  0.7900
times:                      evalMarkt #     1711 Su 5458.31 ~  3.1901
times:                        writeDB #     1711 Su    0.25 ~  0.0001
real	125m58.235s
user	91m13.034s
sys	0m15.925s


Job LTMB End: 18:04:45.556
GC2 20070101 LTMB Wed Apr 25 18:04:22.411 2007: 170.47 Min.,  5.9778 sec/run (1711 runs)
Ranking-3.pl finished after 7646.700s(CPU) and 10243 Sec.
times:                   bewerteUmgeb #        1 Su    0.98 ~  0.9800
times:                      evalMarkt #     1711 Su 7632.08 ~  4.4606
times:                        writeDB #     1711 Su    0.19 ~  0.0001
real	170m48.445s
user	127m26.950s
sys	0m13.705s


Job LTBM End: 18:13:45.927
GC2 20070101 LTBM Wed Apr 25 18:13:27.382 2007: 179.57 Min.,  6.2969 sec/run (1711 runs)
Ranking-3.pl finished after 7623.300s(CPU) and 10789 Sec.
times:                   bewerteUmgeb #        1 Su    0.85 ~  0.8500
times:                      evalMarkt #     1711 Su 7607.95 ~  4.4465
times:                        writeDB #     1711 Su    0.26 ~  0.0002
real	179m51.230s
user	127m3.580s
sys	0m10.769s


From fairly early during the job:
top - 15:17:43 up 21 min,  9 users,  load average: 3.35, 2.58, 2.10
Tasks:   3 total,   3 running,   0 sleeping,   0 stopped,   0 zombie
Cpu(s): 99.8%us,  0.0%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.2%si,  0.0%st
Mem:   3348632k total,  1624044k used,  1724588k free,    64272k buffers
Swap:  2097144k total,        0k used,  2097144k free,   940176k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
30042 mgd       20   0 92752  17m 3668 R  100  0.5   2:51.25 perl
30038 mgd       20   0 93884  18m 3668 R   50  0.6   1:59.39 perl
30040 mgd       20   0 93624  18m 3668 R   50  0.6   2:32.13 perl


procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 4  0      0 1720424  65132 940632    0    0     0     1  424  963 100  0  0  0
 6  0      0 1720448  65152 940612    0    0     0    79  441 1030 100  0  0  0
 7  0      0 1720448  65152 940636    0    0     0    45  442 1003 100  0  0  0
 3  0      0 1720424  65168 940620    0    0     0    76  451 1130 100  0  0  0
 5  0      0 1720384  65168 940640    0    0     0     0  431  913 100  0  0  0
 3  0      0 1720880  65200 940644    0    0     0   105  455 1080 100  0  0  0
 3  0      0 1719936  65208 940656    0    0     0    87  442 1302 100  0  0  0
 3  0      0 1720060  65216 940660    0    0     0    81  438  973 100  0  0  0
 3  0      0 1720560  65244 940644    0    0     0    88  437  998 100  0  0  0
 3  0      0 1720548  65252 940664    0    0     0    59  435  955 100  0  0  0
 3  0      0 1720548  65260 940664    0    0     0    39  429  918 100  0  0  0
 3  0      0 1720572  65268 940688    0    0     3    33  434  935 100  0  0  0
 3  0      0 1720572  65276 940696    0    0     0    31  433  969 100  0  0  0
 3  0      0 1719928  65296 940700    0    0     0   155  453 1362 99  1  0  0
 3  0      0 1719944  65316 940680    0    0     0    69  436 1025 100  0  0  0
 4  0      0 1719772  65372 940712    0    0     1   277  460 1207 100  0  0  0
 3  0      0 1719756  65380 940704    0    0     0    44  441 1142 100  0  0  0
 3  0      0 1719756  65388 940720    0    0     0    47  436 1094 100  0  0  0
 3  0      0 1719780  65396 940736    0    0     3    35  439 1043 100  0  0  0
 3  0      0 1719400  65412 940736    0    0     0    87  616 1306 100  1  0  0
 3  0      0 1719400  65420 940736    0    0     0    51  440 1033 100  0  0  0



2.6.21-rc7-sd046
================
/proc/sys/kernel/rr_interval=16

Start of all 3 jobs: 11:39:54.650

Job LTMM End: 14:00:07.868
GC2 20070101 LTMM Wed Apr 25 13:59:32.209 2007: 139.73 Min.,  4.9001 sec/run (1711 runs)
Ranking-3.pl finished after 5448.340s(CPU) and 8413 Sec.
times:                   bewerteUmgeb #        1 Su    0.38 ~  0.3800
times:                      evalMarkt #     1711 Su 5434.63 ~  3.1763
times:                        writeDB #     1711 Su    0.21 ~  0.0001
real	140m16.127s
user	90m48.597s
sys	0m12.389s


Job LTBM End: 14:32:40.408
GC2 20070101 LTBM Wed Apr 25 14:32:19.259 2007: 172.48 Min.,  6.0485 sec/run (1711 runs)
Ranking-3.pl finished after 7555.780s(CPU) and 10365 Sec.
times:                   bewerteUmgeb #        1 Su    0.39 ~  0.3900
times:                      evalMarkt #     1711 Su 7541.47 ~  4.4076
times:                        writeDB #     1711 Su    0.18 ~  0.0001
real	172m48.009s
user	125m56.188s
sys	0m16.689s


Job LTMB End: 14:35:07.261
GC2 20070101 LTMB Wed Apr 25 14:34:50.896 2007: 175.02 Min.,  6.1373 sec/run (1711 runs)
Ranking-3.pl finished after 7612.750s(CPU) and 10514 Sec.
times:                   bewerteUmgeb #        1 Su    0.33 ~  0.3300
times:                      evalMarkt #     1711 Su 7599.43 ~  4.4415
times:                        writeDB #     1711 Su    0.29 ~  0.0002
real	175m17.481s
user	126m53.160s
sys	0m16.437s


From fairly early during the job:
top - 11:43:24 up  1:43,  9 users,  load average: 3.86, 2.35, 1.21
Tasks:   3 total,   3 running,   0 sleeping,   0 stopped,   0 zombie
Cpu(s): 99.5%us,  0.2%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.3%si,  0.0%st
Mem:   3348628k total,  3212640k used,   135988k free,   435744k buffers
Swap:  2097144k total,        0k used,  2097144k free,  1089812k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
17563 mgd       11   0 92872  17m 3668 R  100  0.5   2:43.97 perl
17568 mgd       33   0 93932  18m 3668 R   50  0.6   1:48.49 perl
17570 mgd       31   0 93652  18m 3668 R   50  0.6   2:14.16 perl


procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 4  0      0 125052 436832 1093420    0    0     0    87  932 1464 99  1  0  0
 7  0      0 125060 436832 1093428    0    0     0     0  933 1306 99  1  0  0
 3  0      0 125256 436852 1093408    0    0     0   120  831 1336 99  1  0  0
 3  0      0 124804 436864 1093440    0    0     0   165  443 1374 99  1  0  0
 3  0      0 124804 436864 1093440    0    0     0     0  421  955 100  0  0  0
 4  0      0 124812 436884 1093440    0    0     0   113  440  989 100  0  0  0
 4  0      0 124812 436884 1093440    0    0     0    63  436  936 100  0  0  0
 3  0      0 124804 436900 1093448    0    0     0    64  485 1142 100  0  0  0
 3  0      0 124804 436912 1093436    0    0     0    47  434  992 100  0  0  0
 3  0      0 124804 436920 1093448    0    0     0    24  448  978 100  0  0  0
 3  0      0 124656 436932 1093448    0    0     0   120  443 1850 99  1  0  0
 3  0      0 124648 436932 1093464    0    0     0     0  441 1081 99  1  0  0
 8  0      0 124688 436952 1093464    0    0     0   156  432  924 100  0  0  0
 4  0      0 124976 436960 1093472    0    0     0    43  439 1028 100  0  0  0
 3  0      0 125100 436968 1093472    0    0     0    27  426  961 100  0  0  0
10  0      0 125132 436976 1093480    0    0     0    43  427  876 100  0  0  0
 6  0      0 125132 436984 1093480    0    0     0    28  440 1087 100  0  0  0
 3  0      0 124868 437000 1093484    0    0     0   133  445 1629 100  0  0  0
 3  0      0 124392 437056 1093456    0    0     0   356  483 1072 99  1  0  0
 3  0      0 124400 437056 1093496    0    0     0     0  429 1069 100  0  0  0
 3  0      0 124400 437072 1093488    0    0     0    80  441 1000 100  0  0  0



2.6.21-rc7
==========
Start of all 3 jobs: 20:11:45.971

Job LTMM End: 22:25:33.108
GC2 20070101 LTMM Wed Apr 25 22:25:07.427 2007: 133.45 Min.,  4.6797 sec/run (1711 runs)
Ranking-3.pl finished after 5462.240s(CPU) and 8026 Sek.
times:                   bewerteUmgeb #        1 Su    0.77 ~  0.7700
times:                      evalMarkt #     1711 Su 5447.89 ~  3.1840
times:                        writeDB #     1711 Su    0.29 ~  0.0002
real	133m50.274s
user	91m2.485s
sys	0m10.801s


Job LTMB End: 23:01:54.763
GC2 20070101 LTMB Wed Apr 25 23:01:35.274 2007: 169.88 Min.,  5.9573 sec/run (1711 runs)
Ranking-3.pl finished after 7452.300s(CPU) and 10208 Sek.
times:                   bewerteUmgeb #        1 Su    0.76 ~  0.7600
times:                      evalMarkt #     1711 Su 7438.33 ~  4.3474
times:                        writeDB #     1711 Su    0.25 ~  0.0001
real	170m12.885s
user	124m12.562s
sys	0m14.705s


Job LTBM End: 23:09:16.506
GC2 20070101 LTBM Wed Apr 25 23:08:59.376 2007: 177.28 Min.,  6.2168 sec/run (1711 runs)
Ranking-3.pl finished after 7673.940s(CPU) and 10652 Sek.
times:                   bewerteUmgeb #        1 Su    0.78 ~  0.7800
times:                      evalMarkt #     1711 Su 7659.10 ~  4.4764
times:                        writeDB #     1711 Su    0.30 ~  0.0002
real	177m35.890s
user	127m54.376s
sys	0m9.873s


From fairly early during the job:
top - 20:15:13 up 12 min,  9 users,  load average: 3.89, 2.61, 1.52
Tasks:   3 total,   3 running,   0 sleeping,   0 stopped,   0 zombie
Cpu(s): 99.8%us,  0.0%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.2%si,  0.0%st
Mem:   3348628k total,  1109020k used,  2239608k free,    28820k buffers
Swap:  2097144k total,        0k used,  2097144k free,   511352k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 6389 mgd       25   0 92776  17m 3668 R  100  0.5   2:50.23 perl
 6390 mgd       25   0 93932  18m 3668 R   53  0.6   2:08.47 perl
 6393 mgd       25   0 93880  18m 3668 R   47  0.6   1:42.53 perl


procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 6  0      0 2211984  30780 525612    0    0     0     0  490 1318 100  0  0  0
 4  0      0 2211460  30872 525576    0    0     8   795  489 1052 100  0  0  0
 3  0      0 2211736  30896 525620    0    0     0   129  467 1003 99  1  0  0
 7  0      0 2211024  30896 525624    0    0     0    97  469 1234 100  0  0  0
 4  0      0 2211080  30924 525624    0    0     0   147  472 1117 100  0  0  0
 4  0      0 2211008  30936 525616    0    0     0    35  467 1086 100  0  0  0
 5  0      0 2210792  30976 525632    0    0     0   144  480 1120 100  0  0  0
 5  0      0 2210932  30992 525620    0    0     0    47  462 1099 99  1  0  0
 3  0      0 2210948  31000 525644    0    0     0    40  460 1087 100  0  0  0
 4  0      0 2210980  31016 525648    0    0     0    41  453  898 100  0  0  0
 4  0      0 2210716  31036 525648    0    0     1    99  471 1322 100  0  0  0
 4  0      0 2210748  31052 525648    0    0     0    60  454 1085 100  0  0  0
 5  0      0 2210764  31080 525652    0    0     0    68  463 1007 100  0  0  0
 5  0      0 2210796  31080 525656    0    0     0    68  462  962 100  0  0  0
 5  0      0 2210812  31104 525664    0    0     0    97  470 1193 100  0  0  0
 5  0      0 2210812  31104 525664    0    0     0     0  451  911 100  0  0  0
 4  0      0 2210812  31128 525672    0    0     0    69  465 1100 100  0  0  0
 3  0      0 2210300  31152 525660    0    0     0   143  466 1350 99  1  0  0
 4  0      0 2210292  31152 525676    0    0     3     9  513 2025 100  0  0  0
 6  0      0 2210624  31196 525700    0    0     3   133  492 1207 100  0  0  0
 4  0      0 2210460  31196 525720    0    0     0     0  458 1086 100  0  0  0

Best,
Michael
-- 
 Technosis GmbH, Geschäftsführer: Michael Gerdau, Tobias Dittmar
 Sitz Hamburg; HRB 89145 Amtsgericht Hamburg
 Vote against SPAM - see http://www.politik-digital.de/spam/
 Michael Gerdau       email: mgd@...hnosis.de
 GPG-keys available on request or at public keyserver

Content of type "application/pgp-signature" skipped

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ