linux-kernel - [RFC][PATCH 0/5] memcg : some patches related to swap.

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-Id: <20081031115057.6da3dafd.kamezawa.hiroyu@jp.fujitsu.com>
Date:	Fri, 31 Oct 2008 11:50:57 +0900
From:	KAMEZAWA Hiroyuki <kamezawa.hiroyu@...fujitsu.com>
To:	"linux-mm@...ck.org" <linux-mm@...ck.org>
Cc:	"linux-kernel@...r.kernel.org" <linux-kernel@...r.kernel.org>,
	"balbir@...ux.vnet.ibm.com" <balbir@...ux.vnet.ibm.com>,
	"nishimura@....nes.nec.co.jp" <nishimura@....nes.nec.co.jp>,
	hugh@...itas.com, taka@...inux.co.jp
Subject: [RFC][PATCH 0/5] memcg : some patches related to swap.

This patch is memcg update set. (the last post was 23/Oct)

This patch is agaisnt 2.6.28-rc2-mm1. (mmotm at 30/Oct)

Major changes from previous one.
 - dropped lazy_lru related patches. It's complicated and I'd like to
   design it again. (Nishimura-san reported a bug to me.)
   Fortunately, no big Hunk.

 - added a patch for swap_cache. (cut out from mem+swap controller.)
   IMHO, this is necessary to do. But previous trial (in summer) caused tons of
   troubles. I think currrent memcg's code is better than old ones and I hope
   this trial will be much easier.
 
and fixed typos and logics.

brief patch description is here. I'd like to send [1/5] in the next week.
Review and test is welcome. [2-5/5] of patches should be tested more.
And I'd like to clean up them before sending...

[1/5] change force_empty to do move account.
  - current force_empty just drops page_cgroup reference. But this means
    leak of accounting. After this patch, remaining pages at rmdir() will be
    moved to parent group.

[2/5] account swap cache
  - when processes exceed limit of memory, swap-cache can be created.
    Now, swap-cache is not accounted and can be spread over hundreds of mega
    bytes. I don't think this is sane. This patch makes swap_cache to be accounted.

[3/5] mem+swap controller config.
  - add Kconfig for mem+swap controller.

[4/5] swap_cgroup
  - create a buffer to remember account information of swap.
    Because my x86-32 test environment is poor, x86-32 test report is welcome.
    This patch uses HIGHMEM to rememver information.

[5/5]
  - mem+swap controller.
  After this patch, a page swapped-in will be accounted against an original group
  which allocated memory swapped-out.
  This is not swap controller but mem+swap controller. This limits sum of
  pages + swaps_on_disk. By this,
  - global LRU's swap-out will not hit the limit. (page is converted to swap.)
  - a group of processes leaking memory will be effectively blocked.

TODO list:
 - more optimization
 - add "shrink_usage" file
 - remove mem_cgroup_per_zone->lock and use zone->lru_lock ?
 - consider behavior of oom-kill again.
 - need some notifier to tell memory shortage as mem_notity ?
 - dirty page accountng and throttle.
 - we have to decied how to handle HUGE_PAGE
 - kernel support for hierarchy ?
 - help bio_cgroup people.

Oh, too long ;)

Thanks,
-Kame  




  




--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/