| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <1359184867.5835.85.camel@marge.simpson.net>
Date: Sat, 26 Jan 2013 08:21:07 +0100
From: Mike Galbraith <bitbucket@...ine.de>
To: Rik van Riel <riel@...hat.com>
Cc: linux-kernel@...r.kernel.org, aquini@...hat.com, walken@...gle.com,
eric.dumazet@...il.com, lwoodman@...hat.com, knoel@...hat.com,
chegu_vinod@...com, raghavendra.kt@...ux.vnet.ibm.com,
mingo@...hat.com
Subject: Re: [PATCH -v4 0/5] x86,smp: make ticket spinlock proportional
backoff w/ auto tuning
On Fri, 2013-01-25 at 14:05 -0500, Rik van Riel wrote:
> The performance issue observed with AIM7 is still a mystery.
Hm. AIM7 mystery _may_ be the same crud I see on a 4 node 40 core box.
Stock scheduler knobs are too preempt happy, produce unstable results.
I twiddle them as below to stabilize results.
I'm testing a load balancing series from Alex Shi with AIM7 and whatnot,
added your series on top of it and retested. What I see is
improvement.
Oodles of numbers follow. Sorry that your numbers are mixed in with my
numbers, but this is just an excerpt from my test log, and I'm too lazy
to reformat and filter. You can save wear and tear on your eyeballs by
just poking 'D'. There does appear to be evidence that your patch set
improved this load though, so in case you want to see numbers, here come
a bunch, a quick scroll-by may be worth it.
The very heavy load end did not improve, which seems odd, but whatever.
Numbers...
sched_latency_ns = 24ms
sched_min_granularity_ns = 8ms
sched_wakeup_granularity_ns = 10ms
aim7 compute
3.8.0-performance 3.8.0-balance 3.8.0-powersaving
Tasks jobs/min jti jobs/min/task real cpu jobs/min jti jobs/min/task real cpu jobs/min jti jobs/min/task real cpu
1 432.86 100 432.8571 14.00 3.99 433.48 100 433.4764 13.98 3.97 433.17 100 433.1665 13.99 3.98
1 437.23 100 437.2294 13.86 3.85 436.60 100 436.5994 13.88 3.86 435.66 100 435.6578 13.91 3.90
1 434.10 100 434.0974 13.96 3.95 436.29 100 436.2851 13.89 3.89 436.29 100 436.2851 13.89 3.87
5 2400.95 99 480.1902 12.62 12.49 2554.81 98 510.9612 11.86 7.55 2487.68 98 497.5369 12.18 8.22
5 2341.58 99 468.3153 12.94 13.95 2578.72 99 515.7447 11.75 7.25 2527.11 99 505.4212 11.99 7.90
5 2350.66 99 470.1319 12.89 13.66 2600.86 99 520.1717 11.65 7.09 2508.28 98 501.6556 12.08 8.24
10 4291.78 99 429.1785 14.12 40.14 5334.51 99 533.4507 11.36 11.13 5183.92 98 518.3918 11.69 12.15
10 4334.76 99 433.4764 13.98 38.70 5311.13 99 531.1131 11.41 11.23 5215.15 99 521.5146 11.62 12.53
10 4273.62 99 427.3625 14.18 40.29 5287.96 99 528.7958 11.46 11.46 5144.31 98 514.4312 11.78 12.32
20 8487.39 94 424.3697 14.28 63.14 10594.41 99 529.7203 11.44 23.72 10575.92 99 528.7958 11.46 22.08
20 8387.54 97 419.3772 14.45 77.01 10575.92 98 528.7958 11.46 23.41 10520.83 99 526.0417 11.52 21.88
20 8713.16 95 435.6578 13.91 55.10 10659.63 99 532.9815 11.37 24.17 10539.13 99 526.9565 11.50 22.13
40 16786.70 99 419.6676 14.44 170.08 19469.88 98 486.7470 12.45 60.78 19967.05 98 499.1763 12.14 51.40
40 16728.78 99 418.2195 14.49 172.96 19627.53 98 490.6883 12.35 65.26 20386.88 98 509.6720 11.89 46.91
40 16763.49 99 419.0871 14.46 171.42 20033.06 98 500.8264 12.10 51.44 20682.59 98 517.0648 11.72 42.45
80 33024.52 98 412.8065 14.68 355.10 33205.48 98 415.0685 14.60 336.90 33690.06 97 421.1258 14.39 248.91
80 33002.04 99 412.5255 14.69 356.27 33949.58 96 424.3697 14.28 283.87 33160.05 97 414.5007 14.62 264.85
80 33047.03 99 413.0879 14.67 355.22 33137.39 98 414.2174 14.63 338.92 33526.97 97 419.0871 14.46 257.31
160 64254.47 98 401.5905 15.09 391.30 64000.00 98 400.0000 15.15 396.87 65073.83 97 406.7114 14.90 371.09
160 64468.09 98 402.9255 15.04 390.28 64553.93 98 403.4621 15.02 389.49 64640.00 98 404.0000 15.00 379.82
160 64297.08 98 401.8568 15.08 389.45 64856.19 98 405.3512 14.95 383.64 64683.12 98 404.2695 14.99 379.43
320 121579.94 98 379.9373 15.95 466.15 122039.02 98 381.3719 15.89 456.17 122811.91 97 383.7872 15.79 445.16
320 121427.68 98 379.4615 15.97 466.68 121885.61 98 380.8925 15.91 462.30 122734.18 97 383.5443 15.80 447.03
320 121200.00 98 378.7500 16.00 465.58 121048.69 97 378.2772 16.02 470.41 122501.58 97 382.8174 15.83 447.74
640 215466.67 95 336.6667 18.00 624.64 211703.06 96 330.7860 18.32 654.19 216066.85 96 337.6045 17.95 620.45
640 216066.85 95 337.6045 17.95 623.32 210097.51 96 328.2774 18.46 664.05 214394.69 96 334.9917 18.09 634.61
640 213568.28 96 333.7004 18.16 641.45 214039.74 96 334.4371 18.12 638.48 215227.52 96 336.2930 18.02 630.19
1280 320528.93 92 250.4132 24.20 1120.46 327015.18 91 255.4806 23.72 1084.29 326464.65 91 255.0505 23.76 1087.39
1280 324552.30 92 253.5565 23.90 1098.43 323739.57 92 252.9215 23.96 1104.09 325232.70 92 254.0881 23.85 1095.50
1280 327153.10 91 255.5884 23.71 1084.75 326190.08 91 254.8360 23.78 1086.72 325232.70 92 254.0881 23.85 1093.32
2560 418946.80 86 163.6511 37.03 2140.41 418720.65 88 163.5628 37.05 2146.30 419626.72 87 163.9167 36.97 2139.74
2560 418607.66 88 163.5186 37.06 2144.50 419059.97 89 163.6953 37.02 2143.47 419059.97 87 163.6953 37.02 2140.70
2560 418607.66 84 163.5186 37.06 2138.81 419513.25 84 163.8724 36.98 2139.09 419286.49 87 163.7838 37.00 2140.60
/me adds spinlock series to take it for a spin, repeats test series...
3.8.0-performance 3.8.0-balance 3.8.0-powersaving
Tasks jobs/min jti jobs/min/task real cpu jobs/min jti jobs/min/task real cpu jobs/min jti jobs/min/task real cpu
1 436.91 100 436.9142 13.87 3.69 433.17 100 433.1665 13.99 3.98 434.72 100 434.7202 13.94 3.93
1 440.41 100 440.4070 13.76 3.74 437.86 100 437.8613 13.84 3.83 435.97 100 435.9712 13.90 3.89
1 441.69 100 441.6910 13.72 3.71 435.66 100 435.6578 13.91 3.88 438.49 100 438.4949 13.82 3.81
5 2267.96 98 453.5928 13.36 15.72 2580.92 99 516.1840 11.74 7.22 2535.56 99 507.1130 11.95 8.04
5 2295.45 99 459.0909 13.20 15.32 2578.72 98 515.7447 11.75 7.22 2516.61 98 503.3223 12.04 8.24
5 2279.91 98 455.9819 13.29 15.49 2600.86 99 520.1717 11.65 7.19 2514.52 98 502.9046 12.05 8.49
10 4391.30 99 439.1304 13.80 36.83 5315.79 99 531.5789 11.40 11.21 5210.66 98 521.0662 11.63 12.41
10 4375.45 99 437.5451 13.85 37.28 5201.72 99 520.1717 11.65 12.92 5242.21 99 524.2215 11.56 12.29
10 4413.69 99 441.3693 13.73 36.15 5311.13 99 531.1131 11.41 11.11 5219.64 98 521.9638 11.61 12.25
20 8801.74 97 440.0871 13.77 64.53 10725.66 99 536.2832 11.30 22.84 10511.71 99 525.5854 11.53 21.72
20 8931.47 97 446.5733 13.57 58.68 10640.91 99 532.0457 11.39 23.95 10575.92 98 528.7958 11.46 21.53
20 9004.46 96 450.2229 13.46 50.98 10669.01 99 533.4507 11.36 24.06 10557.49 99 527.8746 11.48 22.00
40 17758.24 99 443.9560 13.65 135.44 20682.59 98 517.0648 11.72 43.25 20369.75 98 509.2437 11.90 47.04
40 17667.64 99 441.6910 13.72 142.15 20860.59 98 521.5146 11.62 41.30 20250.63 98 506.2657 11.97 46.28
40 17745.24 98 443.6310 13.66 137.20 20507.61 98 512.6904 11.82 44.98 20421.23 98 510.5307 11.87 44.25
80 35725.87 99 446.5733 13.57 266.54 35438.60 98 442.9825 13.68 262.32 35028.90 97 437.8613 13.84 216.09
80 35778.60 99 447.2325 13.55 266.69 35464.52 98 443.3065 13.67 256.49 35386.86 97 442.3358 13.70 210.93
80 35805.02 99 447.5628 13.54 263.42 35542.52 98 444.2815 13.64 254.81 36098.29 97 451.2286 13.43 181.01
160 68378.00 98 427.3625 14.18 316.02 68522.97 98 428.2686 14.15 321.43 69059.83 98 431.6239 14.04 298.16
160 68522.97 98 428.2686 14.15 318.01 69257.14 97 432.8571 14.00 293.77 68765.96 98 429.7872 14.10 303.93
160 68474.58 98 427.9661 14.16 320.64 68185.65 98 426.1603 14.22 324.11 68474.58 98 427.9661 14.16 311.32
320 126910.99 97 396.5969 15.28 409.53 127244.09 98 397.6378 15.24 408.56 127831.25 98 399.4726 15.17 399.66
320 127747.04 98 399.2095 15.18 403.06 127244.09 98 397.6378 15.24 404.61 127327.64 98 397.8989 15.23 406.47
320 127662.94 98 398.9467 15.19 402.52 127411.30 98 398.1603 15.22 406.13 128423.84 98 401.3245 15.10 390.71
640 220865.60 95 345.1025 17.56 591.17 222130.58 95 347.0790 17.46 586.26 216307.86 96 337.9810 17.93 615.63
640 219118.64 96 342.3729 17.70 603.53 222768.52 95 348.0758 17.41 581.76 216549.41 95 338.3585 17.91 616.81
640 217765.30 96 340.2583 17.81 611.16 218624.58 96 341.6009 17.74 607.05 220739.90 96 344.9061 17.57 590.80
1280 323065.39 92 252.3948 24.01 1104.10 326602.11 92 255.1579 23.75 1088.87 324416.56 91 253.4504 23.91 1100.05
1280 326877.37 93 255.3729 23.73 1082.77 326327.30 93 254.9432 23.77 1087.10 322662.23 92 252.0799 24.04 1103.16
1280 327291.14 92 255.6962 23.70 1081.55 324280.94 93 253.3445 23.92 1098.44 326877.37 92 255.3729 23.73 1084.82
2560 419173.20 87 163.7395 37.01 2139.19 419513.25 85 163.8724 36.98 2136.87 418946.80 86 163.6511 37.03 2138.73
2560 418720.65 87 163.5628 37.05 2142.92 419399.84 86 163.8281 36.99 2143.80 418607.66 86 163.5186 37.06 2141.70
2560 419399.84 87 163.8281 36.99 2140.22 419853.86 85 164.0054 36.95 2137.59 419967.51 86 164.0498 36.94 2139.05
Virgin source reference runs.
3.8.0-virgin 3.8.0-virgin select_idle_sibling() disabled
Tasks jobs/min jti jobs/min/task real cpu jobs/min jti jobs/min/task real cpu
1 435.97 100 435.9712 13.90 3.74 435.66 100 435.6578 13.91 3.90
1 440.41 100 440.4070 13.76 3.73 434.72 100 434.7202 13.94 3.93
1 440.73 100 440.7273 13.75 3.73 435.66 100 435.6578 13.91 3.91
5 2376.47 99 475.2941 12.75 13.07 2267.96 99 453.5928 13.36 16.12
5 2374.61 98 474.9216 12.76 12.84 2363.49 98 472.6989 12.82 13.02
5 2271.36 99 454.2729 13.34 15.91 2305.94 98 461.1872 13.14 14.63
10 4577.04 99 457.7039 13.24 31.53 4337.87 98 433.7867 13.97 37.78
10 4246.67 99 424.6671 14.27 41.33 4331.67 98 433.1665 13.99 37.29
10 4741.78 99 474.1784 12.78 25.74 4264.60 99 426.4602 14.21 38.81
20 8991.10 93 449.5549 13.48 49.67 8381.74 97 419.0871 14.46 77.22
20 9209.73 95 460.4863 13.16 45.81 8553.28 95 427.6641 14.17 62.19
20 8808.14 96 440.4070 13.76 57.42 8547.25 95 427.3625 14.18 61.43
40 16625.51 98 415.6379 14.58 169.95 16717.24 98 417.9310 14.50 166.00
40 16694.21 98 417.3554 14.52 171.03 16682.73 98 417.0681 14.53 161.04
40 16367.32 98 409.1830 14.81 170.28 16763.49 97 419.0871 14.46 159.94
80 33114.75 99 413.9344 14.64 350.04 33228.24 97 415.3530 14.59 325.12
80 33092.15 99 413.6519 14.65 352.77 33228.24 97 415.3530 14.59 326.98
80 33092.15 99 413.6519 14.65 352.02 33228.24 97 415.3530 14.59 332.65
160 63789.47 98 398.6842 15.20 394.70 64683.12 97 404.2695 14.99 373.11
160 64169.42 98 401.0589 15.11 389.92 64856.19 97 405.3512 14.95 367.61
160 64382.47 98 402.3904 15.06 392.40 64510.98 97 403.1936 15.03 378.98
320 121200.00 97 378.7500 16.00 466.96 122115.87 97 381.6121 15.88 450.06
320 120447.20 98 376.3975 16.10 469.83 121732.58 97 380.4143 15.93 464.31
320 121809.05 97 380.6533 15.92 464.26 121200.00 98 378.7500 16.00 469.79
640 210897.23 96 329.5269 18.39 658.28 211703.06 95 330.7860 18.32 645.51
640 213450.74 95 333.5168 18.17 643.07 215108.15 95 336.1065 18.03 618.47
640 215946.55 96 337.4165 17.96 626.89 217521.03 95 339.8766 17.83 606.25
1280 323200.00 92 252.5000 24.00 1105.69 323469.56 91 252.7106 23.98 1092.70
1280 325096.40 91 253.9816 23.86 1095.47 324145.42 92 253.2386 23.93 1091.97
1280 322930.89 93 252.2898 24.02 1105.80 321858.92 93 251.4523 24.10 1102.40
2560 418269.08 88 163.3864 37.09 2142.88 418156.33 87 163.3423 37.10 2139.12
2560 418946.80 88 163.6511 37.03 2141.52 417931.03 86 163.2543 37.12 2142.56
2560 418494.74 88 163.4745 37.07 2147.66 418720.65 88 163.5628 37.05 2137.14
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Powered by blists - more mailing lists