linux-kernel - Re: Poor PostgreSQL scaling on Linux 2.6.25-rc5 (vs 2.6.22)

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [day] [month] [year] [list]

Date:	Mon, 17 Mar 2008 11:16:12 +0100
From:	Ingo Molnar <mingo@...e.hu>
To:	Peter Zijlstra <peterz@...radead.org>
Cc:	Nick Piggin <nickpiggin@...oo.com.au>, Willy Tarreau <w@....eu>,
	Ray Lee <ray-lk@...rabbit.org>,
	"LKML," <linux-kernel@...r.kernel.org>,
	Mike Galbraith <efault@....de>
Subject: Re: Poor PostgreSQL scaling on Linux 2.6.25-rc5 (vs 2.6.22)


* Peter Zijlstra <peterz@...radead.org> wrote:

> The latest sched code contains a few patches in this direction 
> (.25-rc6), and they seem to have the desired effect on 1 socket single 
> and dual core and 8 socket single core and dual core. On quad core we 
> seem to have some load balance problems that destroy the workload in 
> other interresting ways - looking into that now.

here's a performance comparison between 2.6.21 and -rc6, on a 
8-socket/16-core system:

   http://redhat.com/~mingo/misc/sysbench-rc6.jpg

                      [transactions/sec, higher is better]

              2.6.21         2.6.25-rc5         2.6.25-rc6
   -------------------------------------------------------
      1:      383.26             270.47             269.69
      2:      741.02             527.67             560.52
      4:     1880.79            1049.59            1184.44
      8:     3815.59            2901.07            3881.78
     16:     8944.81            8993.24            9000.81
     32:     8647.19            8568.66            8638.64
     64:     8058.10            7624.46            8212.92
    128:     6500.06            5804.75            8182.71
    256:     5625.27            3656.52            7661.02

  [ Postgresql 8.3, default scheduler parameters, sysbench parameters: 
    --test=oltp --db-driver=psql --max-time=60 --max-requests=0 
    --oltp-read-only=on. Ask if you need more info about the test. ]

as you can see near and after the saturation point .25 not only has 
fixed any regression but rules the picture and is 35%+ faster at 256 
clients and shows no breakdown at all at high client counts.

( i also have to observe that while running with 256 clients overload, 
  the 2.6.25 system was totally serviceable, while 2.6.21 showed bad 
  lags. )

The "early rampup" phase [less than 25% utilized] is still not as good 
as we'd like it to be - our idle balancing force is still a tad too 
strong for this workload. (But that is relatively easy to solve in 
general and we are working on those bits.)

in any case, we welcome any help from you with these tuning efforts. 
It's certainly fun :)

	Ingo
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/