lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <86802c440804300926s42d0da4fs34a9a95d6d466cbe@mail.gmail.com>
Date:	Wed, 30 Apr 2008 09:26:19 -0700
From:	"Yinghai Lu" <yhlu.kernel@...il.com>
To:	"Gabriel C" <nix.or.die@...glemail.com>
Cc:	"Andrew Morton" <akpm@...ux-foundation.org>,
	"Ingo Molnar" <mingo@...e.hu>, "H. Peter Anvin" <hpa@...or.com>,
	"Thomas Gleixner" <tglx@...utronix.de>,
	"Mika Fischer" <mika.fischer@...pnet.de>,
	"linux-kernel@...r.kernel.org" <linux-kernel@...r.kernel.org>
Subject: Re: [PATCH 1/2] x86: mtrr cleanup for converting continuous to discrete layout v7

On Wed, Apr 30, 2008 at 5:04 AM, Gabriel C <nix.or.die@...glemail.com> wrote:
>
> Yinghai Lu wrote:
>  > On Tue, Apr 29, 2008 at 9:12 PM, Gabriel C <nix.or.die@...glemail.com> wrote:
>  >> Yinghai Lu wrote:
>  >>  > please try the patches
>  >>  >
>  >>  > from
>  >>  > http://lkml.org/lkml/2008/4/29/754
>  >>  > http://lkml.org/lkml/2008/4/29/753
>  >>  >
>  >>  > in addtion to
>  >>  >
>  >>  > http://people.redhat.com/mingo/x86.git/README
>  >>  > ( it has v8 already)
>  >>  >
>  >>  > and try with mtrr_gran_size=128m
>  >>
>  >>  Without any value I get :
>  >>
>  >>  ...
>  >>
>  >>  [    0.000000] Linux version 2.6.25-x86-latest.git-06598-g6a2c2ff-dirty (crazy@...r) (gcc version 4.3.0 (Frugalware Linux) ) #1 SMP PREEMPT Wed Apr 30 05:51:39 CEST 2008
>  >>
>  >>
>  >> [    0.000000] Command line: root=/dev/sdb1 ro debug vga=0x317
>  >>  [    0.000000] BIOS-provided physical RAM map:
>  >>  [    0.000000]  BIOS-e820: 0000000000000000 - 000000000009cc00 (usable)
>  >>  [    0.000000]  BIOS-e820: 000000000009cc00 - 00000000000a0000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 0000000000100000 - 00000000cf550000 (usable)
>  >>  [    0.000000]  BIOS-e820: 00000000cf550000 - 00000000cf55e000 (ACPI data)
>  >>  [    0.000000]  BIOS-e820: 00000000cf55e000 - 00000000cf5e0000 (ACPI NVS)
>  >>  [    0.000000]  BIOS-e820: 00000000cf5e0000 - 00000000cf600000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 0000000100000000 - 000000012c000000 (usable)
>  >>  [    0.000000] Entering add_active_range(0, 0, 156) 0 entries of 256 used
>  >>  [    0.000000] Entering add_active_range(0, 256, 849232) 1 entries of 256 used
>  >>  [    0.000000] Entering add_active_range(0, 1048576, 1228800) 2 entries of 256 used
>  >>  [    0.000000] max_pfn_mapped = 1228800
>  >>  [    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
>  >>  [    0.000000] After WB checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 000000000012c000
>  >>  [    0.000000] After UC checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000cf600
>  >>  [    0.000000] MTRR MAP PFN: 0000000000100000 - 000000000012c000
>  >>  [    0.000000] MTRR MAP PFN: 00000000000cf800 - 00000000000d0000
>  >>  [    0.000000] After sorting
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000cf600
>  >>  [    0.000000] MTRR MAP PFN: 00000000000cf800 - 00000000000d0000
>  >>  [    0.000000] MTRR MAP PFN: 0000000000100000 - 000000000012c000
>  >>  [    0.000000] range0: 0000000000000000 - 00000000c0000000
>  >>  [    0.000000] Setting variable MTRR 0, base: 0MB, range: 2048MB, type WB
>  >>  [    0.000000] Setting variable MTRR 1, base: 2048MB, range: 1024MB, type WB
>  >>  [    0.000000] range: 00000000c0000000 - 00000000cf600000
>  >>
>  >> [    0.000000] Setting variable MTRR 2, base: 3072MB, range: 128MB, type WB
>  >>  [    0.000000] Setting variable MTRR 3, base: 3200MB, range: 64MB, type WB
>  >>  [    0.000000] Setting variable MTRR 4, base: 3264MB, range: 32MB, type WB
>  >>  [    0.000000] Setting variable MTRR 5, base: 3296MB, range: 16MB, type WB
>  >>  [    0.000000] Setting variable MTRR 6, base: 3312MB, range: 4MB, type WB
>  >>  [    0.000000] Setting variable MTRR 7, base: 3316MB, range: 2MB, type WB
>  >>  [    0.000000] range0: 00000000cf800000 - 00000000df800000
>  >>  [    0.000000] range: 00000000df800000 - 00000000d0000000
>  >>
>  >> [    0.000000] DONE variable MTRRs
>  >>  [    0.000000] x86 PAT enabled: cpu 0, old 0x7010600070106, new 0x7010600070106
>  >>  [    0.000000] After WB checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000cf600
>  >>
>  >> [    0.000000] After UC checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000cf600
>  >>
>  >> [    0.000000] After sorting
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000cf600
>  >>  [    0.000000] WARNING: BIOS bug: CPU MTRRs don't cover all of memory, losing 704MB of RAM.
>  >>
>  >> [    0.000000] update e820 for mtrr
>  >>
>  >> [    0.000000] modified physical RAM map:
>  >>  [    0.000000]  modified: 0000000000000000 - 000000000009cc00 (usable)
>  >>  [    0.000000]  modified: 000000000009cc00 - 00000000000a0000 (reserved)
>  >>  [    0.000000]  modified: 00000000000e4000 - 0000000000100000 (reserved)
>  >>  [    0.000000]  modified: 0000000000100000 - 00000000cf550000 (usable)
>  >>  [    0.000000]  modified: 00000000cf550000 - 00000000cf55e000 (ACPI data)
>  >>  [    0.000000]  modified: 00000000cf55e000 - 00000000cf5e0000 (ACPI NVS)
>  >>  [    0.000000]  modified: 00000000cf5e0000 - 00000000cf600000 (reserved)
>  >>  [    0.000000]  modified: 00000000fee00000 - 00000000fee01000 (reserved)
>  >>
>  >> [    0.000000]  modified: 00000000ffc00000 - 000000012c000000 (reserved)
>  >>  [    0.000000] Entering add_active_range(0, 0, 156) 3 entries of 256 used
>  >>  [    0.000000] Entering add_active_range(0, 256, 849232) 3 entries of 256 used
>  >>
>  >> [    0.000000] max_pfn_mapped = 1228800
>  >>  [    0.000000] init_memory_mapping
>  >>
>  >>  ...
>  >>
>  >>  [   20.984343] [drm] Initialized i915 1.6.0 20060119 on minor 0
>  >>  [   21.450368] mtrr: no more MTRRs available
>  >>
>  >>  ...
>  >>
>  >>  with mtrr_gran_size=128m I get :
>  >>
>  >>  ...
>  >>
>  >>  [    0.000000] Linux version 2.6.25-x86-latest.git-06598-g6a2c2ff-dirty (crazy@...r) (gcc version 4.3.0 (Frugalware Linux) ) #1 SMP PREEMPT Wed Apr 30 05:51:39 CEST 2008
>  >>  [    0.000000] Command line: root=/dev/sdb1 ro debug vga=0x317 mtrr_gran_size=128m
>  >>
>  >>
>  >> [    0.000000] BIOS-provided physical RAM map:
>  >>  [    0.000000]  BIOS-e820: 0000000000000000 - 000000000009cc00 (usable)
>  >>  [    0.000000]  BIOS-e820: 000000000009cc00 - 00000000000a0000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 0000000000100000 - 00000000cf550000 (usable)
>  >>  [    0.000000]  BIOS-e820: 00000000cf550000 - 00000000cf55e000 (ACPI data)
>  >>  [    0.000000]  BIOS-e820: 00000000cf55e000 - 00000000cf5e0000 (ACPI NVS)
>  >>  [    0.000000]  BIOS-e820: 00000000cf5e0000 - 00000000cf600000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved)
>  >>  [    0.000000]  BIOS-e820: 0000000100000000 - 000000012c000000 (usable)
>  >>  [    0.000000] Entering add_active_range(0, 0, 156) 0 entries of 256 used
>  >>  [    0.000000] Entering add_active_range(0, 256, 849232) 1 entries of 256 used
>  >>  [    0.000000] Entering add_active_range(0, 1048576, 1228800) 2 entries of 256 used
>  >>  [    0.000000] max_pfn_mapped = 1228800
>  >>  [    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
>  >>  [    0.000000] After WB checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 000000000012c000
>  >>  [    0.000000] After UC checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000cf600
>  >>  [    0.000000] MTRR MAP PFN: 0000000000100000 - 000000000012c000
>  >>  [    0.000000] MTRR MAP PFN: 00000000000cf800 - 00000000000d0000
>  >>  [    0.000000] After sorting
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000cf600
>  >>  [    0.000000] MTRR MAP PFN: 00000000000cf800 - 00000000000d0000
>  >>  [    0.000000] MTRR MAP PFN: 0000000000100000 - 000000000012c000
>  >>  [    0.000000] range0: 0000000000000000 - 00000000c0000000
>  >>  [    0.000000] Setting variable MTRR 0, base: 0MB, range: 2048MB, type WB
>  >>  [    0.000000] Setting variable MTRR 1, base: 2048MB, range: 1024MB, type WB
>  >>  [    0.000000] range: 00000000c0000000 - 00000000c8000000
>  >>  [    0.000000] Setting variable MTRR 2, base: 3072MB, range: 128MB, type WB
>  >>  [    0.000000] rangeX: 00000000d0000000 - 00000000d0000000
>  >>  [    0.000000] range0: 0000000100000000 - 0000000120000000
>  >>  [    0.000000] Setting variable MTRR 3, base: 4096MB, range: 512MB, type WB
>  >>  [    0.000000] range: 0000000120000000 - 0000000128000000
>  >>  [    0.000000] Setting variable MTRR 4, base: 4608MB, range: 128MB, type WB
>  >>  [    0.000000] DONE variable MTRRs
>  >>  [    0.000000] x86 PAT enabled: cpu 0, old 0x7010600070106, new 0x7010600070106
>  >>  [    0.000000] After WB checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000c8000
>  >>  [    0.000000] MTRR MAP PFN: 0000000000100000 - 0000000000128000
>  >>  [    0.000000] After UC checking
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000c8000
>  >>  [    0.000000] MTRR MAP PFN: 0000000000100000 - 0000000000128000
>  >>  [    0.000000] After sorting
>  >>  [    0.000000] MTRR MAP PFN: 0000000000000000 - 00000000000c8000
>  >>  [    0.000000] MTRR MAP PFN: 0000000000100000 - 0000000000128000
>  >>  [    0.000000] WARNING: BIOS bug: CPU MTRRs don't cover all of memory, losing 181MB of RAM.
>  >>
>  >> [    0.000000] update e820 for mtrr
>  >>
>  >> [    0.000000] modified physical RAM map:
>  >>  [    0.000000]  modified: 0000000000000000 - 000000000009cc00 (usable)
>  >>  [    0.000000]  modified: 000000000009cc00 - 00000000000a0000 (reserved)
>  >>  [    0.000000]  modified: 00000000000e4000 - 0000000000100000 (reserved)
>  >>  [    0.000000]  modified: 0000000000100000 - 00000000c8000000 (usable)
>  >>  [    0.000000]  modified: 00000000c8000000 - 00000000cf550000 (reserved)
>  >>  [    0.000000]  modified: 00000000cf550000 - 00000000cf55e000 (ACPI data)
>  >>  [    0.000000]  modified: 00000000cf55e000 - 00000000cf5e0000 (ACPI NVS)
>  >>  [    0.000000]  modified: 00000000cf5e0000 - 00000000cf600000 (reserved)
>  >>  [    0.000000]  modified: 00000000fee00000 - 00000000fee01000 (reserved)
>  >>
>  >> [    0.000000]  modified: 00000000ffc00000 - 0000000100000000 (reserved)
>  >>  [    0.000000]  modified: 0000000100000000 - 0000000128000000 (usable)
>  >>  [    0.000000]  modified: 0000000128000000 - 000000012c000000 (reserved)
>  >>
>  >> [    0.000000] Entering add_active_range(0, 0, 156) 3 entries of 256 used
>  >>  [    0.000000] Entering add_active_range(0, 256, 819200) 3 entries of 256 used
>  >>  [    0.000000] Entering add_active_range(0, 1048576, 1212416) 3 entries of 256 used
>  >>
>  >> [    0.000000] max_pfn_mapped = 1228800
>  >>  [    0.000000] init_memory_mapping
>  >>
>  >>  ...
>  >>
>  >>  I will try tomorrow some more boot options but now I need some sleep ;)
>  >
>  > thanks.  let's try different mtrr_chunk_size/mtrr_gran_size to get
>  > back more ram.
>  > under mtrr_gran_size=128m, does the your X server work well..., fast or slow?
>
>  Yes X is fine and fast , it is even fine ( slower from my felling ) when I lose the 704MB.
>  In general with x86-latest.git tree things seems faster on that box , maybe there are some other bug fixes too.
>
>  I've tested some mtrr_chunk_size/mtrr_gran_size combos, dmesg's are uploaded there :
>
>  http://frugalware.org/~crazy/dmesg/mtrr/
>
>  Also setting lower values on mtrr_gran_size seems to give more RAM back ,
>  mtrr_chunk_size 256/512 eats 704 MB and 128 doesn't seems to do something ?
>
>  Other things I noticed ( probably you could add a note about in kernel-parameter.txt or some doc file ):
>
>  Setting mtrr_gran_size to high , on my box >=512m hangs the box on boot ,
>  setting it to low , on my box <=8m , will cause X to die with such a message :
>
>  xf86MapVidMem: Could not mmap framebuffer (0xd0000000,0x10000000) (Invalid argument)
>
>  If you want I can test such values for mtrr_chunk_size too , just let me know.
>
>  To be honest I'm even fine when losing 700 - 800 MB as long X and everything else does work.
>  The other alternative for me for that problem without your patches will be to buy new ram ( 2 x 1G )
>  and then I lose near 2,3G compared to now or live with broken X until xorg-server will support and
>  *work fine* with PAT ( most probably not that soon ).

great.  I am still working on
1. auto detect optimal chunk_size, gran_size
2. get back all RAM, at least only lose 1 or 2 M

YH
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ