Message-ID: <20241001191425.588219-1-sj@kernel.org>
Date: Tue,  1 Oct 2024 12:14:24 -0700
From: SeongJae Park <sj@...nel.org>
To: 
Cc: SeongJae Park <sj@...nel.org>,
	damon@...ts.linux.dev,
	linux-mm@...ck.org,
	linux-kernel@...r.kernel.org
Subject: DAMON Quaterly News Letter (2024 Q3)

Hello DAMON community,


Three more months have passed since the last DAMON quaterly news letter[0].
Let's look back what happened in the last three months.

Highlights of Highlights
========================

- New features.  DAMON-based CXL memory tiering patchset has merged[1] into the
  mainline.
- More users.  DAMON usages from AWS Aurora Serverless v2 has unveiled[6].
  CONFIG_DAMON has enabled[9] on Debian kernels.  Six more academic papers that
  exploring and/or utilizing DAMON has published or archived on OSDI[2,3],
  ATC[4,5], VLDB[6], and ArXiv[7].  Monthly PyPI downloads of DAMON user-space
  tool (DAMO) has significantly increase.
- Re:org.  DAMON github repos have moved[8] from awslabs org to damonitor org. 
- Conferences:   Detailed DAMON usages from products and labs have presented on
  OSS EU[10] and the VLDB paper[6].  Long-term DAMON plans for kernel that
  extensible and just works have shared and discussed[11] on LPC.

More detailed list of news per each month follows.

July 2024
=========

A couple of OSDI'24 papers[2,3] for memory tiering that references and
exploring DAMON as a part of them are published.

ATC'24 also published two DAMON-citing papers at the same time. The first
one[4] proposes a way to improve monitoring accuracy of DAMON, while the second
one[5] mentions DAMON can be useful for extensible memory management.

VLDB paper about Aurora Serverless V2, which reveals their usage of DAMON on
the product, is uploaded[6].

Memory Management subsystem pull request for Linux v6.11-rc1 with DAMON changes
for CXL memory tiering has merged[1].

August 2024
===========

GitHub repos for non-kernel parts of DAMON project including 'damo',
'damon-tests' and 'damoos' have announced[8] to be moved from awslabs org to
damonitor org.  As of this writing, the reorganization is completed.

September 2024
==============

CONFIG_DAMON is enabled[9] on Debian kernels.

An academic paper preprint that optimizes THP using DAMON and BPF has
uploaded[7] to ArXiv.

DAMON usages from labs and real-world products for profiling-guided
optimizations, proactive reclamation (Auroa Serverless v2), and CXL memory
tiering (SK hynix HMSDK) have shared[10] on Linux Conference at OSSummit EU'24.

DAMON long-term plans for making kernel extensible and just works have shared
and discussed on Kernel Memory Management Micro-Conference[11] at LPC'24.

Monthly PyPI downloads of DAMON user-space tool (DAMO) surpassed 4,000.  It
took about 7 months since the record of 2,000 (2024-02), which took about 18
months from the beginning.  The speed is apparently growing.

Previous quaterly news letters
==============================

- 2024 Q2: https://lore.kernel.org/20240701212244.52288-1-sj@kernel.org
- 2024 Q1: https://lore.kernel.org/20240402191224.92305-1-sj@kernel.org

More Past DAMON News
====================

If you're interested in a humblie list of more DAMON events that happened in
past and curated by DAMON maintainer, please reach out to the project site's
news page [12].

References
==========

[0] "DAMON Quaterly News Letter (2024 Q3)",
    https://lore.kernel.org/20240701212244.52288-1-sj@kernel.org
[1] "MM updates for 6.11-rc1",
    https://lore.kernel.org/20240721145415.fbeb01a853962ef91334f3d1@linux-foundation.org
[2] "Nomad: Non-Exclusive Memory Tiering via Transactional Page Migration",
    https://www.usenix.org/conference/osdi24/presentation/xiang
[3] "Managing Memory Tiers with CXL in Virtualized Environments",
    https://www.usenix.org/conference/osdi24/presentation/zhong-yuhong
[4] "Telescope: Telemetry for Gargantuan Memory Footprint Applications",
    https://www.usenix.org/conference/atc24/presentation/nair
[5] "FBMM: Making Memory Management Extensible With Filesystems",
    https://www.usenix.org/conference/atc24/presentation/tabatabai
[6] "Resource management in Aurora Serverless",
    https://www.amazon.science/publications/resource-management-in-aurora-serverless
[7] "eBPF-mm: Userspace-guided memory management in Linux with eBPF",
    https://arxiv.org/pdf/2409.11220
[8] https://lore.kernel.org/all/20240813232158.83903-1-sj@kernel.org/
[9] https://salsa.debian.org/kernel-team/linux/-/merge_requests/1172
[10] "DAMON Recipes: Ways to Save Memory Using a Linux Kernel Subsystem in the Real World",
     https://sched.co/1ej2S
[11] "DAMON: Long-term Plans for Kernel That {Just Works,Extensible}",
     https://lpc.events/event/18/contributions/1768/
[12] https://sjp38.github.io/post/damon_news/

Wrapup
======

So, those were yet another grateful three months.  Looking forward to get more
news!  If you have any question regarding DAMON, please feel free to reach out
to the community and/or me.


Thanks,
SJ

Powered by blists - more mailing lists