[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <87344ig974.fsf@DESKTOP-5N7EMDA>
Date: Tue, 06 Jan 2026 21:30:23 +0800
From: "Huang, Ying" <ying.huang@...ux.alibaba.com>
To: Catalin Marinas <catalin.marinas@....com>
Cc: Jianpeng Chang <jianpeng.chang.cn@...driver.com>, will@...nel.org,
ardb@...nel.org, anshuman.khandual@....com,
linux-arm-kernel@...ts.infradead.org, linux-kernel@...r.kernel.org
Subject: Re: [v3 PATCH] arm64: mm: Fix kexec failure after
pte_mkwrite_novma() change
Hi, Catalin,
Sorry for late reply.
Catalin Marinas <catalin.marinas@....com> writes:
> On Thu, Dec 04, 2025 at 02:27:22PM +0800, Jianpeng Chang wrote:
>> Commit 143937ca51cc ("arm64, mm: avoid always making PTE dirty in
>> pte_mkwrite()") modified pte_mkwrite_novma() to only clear PTE_RDONLY
>> when the page is already dirty (PTE_DIRTY is set). While this optimization
>> prevents unnecessary dirty page marking in normal memory management paths,
>> it breaks kexec on some platforms like NXP LS1043.
>>
>> The issue occurs in the kexec code path:
>> 1. machine_kexec_post_load() calls trans_pgd_create_copy() to create a
>> writable copy of the linear mapping
>> 2. _copy_pte() calls pte_mkwrite_novma() to ensure all pages in the copy
>> are writable for the new kernel image copying
>> 3. With the new logic, clean pages (without PTE_DIRTY) remain read-only
>> 4. When kexec tries to copy the new kernel image through the linear
>> mapping, it fails on read-only pages, causing the system to hang
>> after "Bye!"
>>
>> The same issue affects hibernation which uses the same trans_pgd code path.
>>
>> Fix this by marking pages dirty with pte_mkdirty() in _copy_pte(), which
>> ensures pte_mkwrite_novma() clears PTE_RDONLY for both kexec and
>> hibernation, making all pages in the temporary mapping writable regardless
>> of their dirty state. This preserves the original commit's optimization
>> for normal memory management while fixing the kexec/hibernation regression.
>>
>> Using pte_mkdirty() causes redundant bit operations when the page is
>> already writable (redundant PTE_RDONLY clearing), but this is acceptable
>> since it's not a hot path and only affects kexec/hibernation scenarios.
>>
>> Fixes: 143937ca51cc ("arm64, mm: avoid always making PTE dirty in pte_mkwrite()")
>> Signed-off-by: Jianpeng Chang <jianpeng.chang.cn@...driver.com>
>> Reviewed-by: Huang Ying <ying.huang@...ux.alibaba.com>
>> ---
>> v3:
>> - Add the description about pte_mkdirty in commit message
>> - Note that the redundant bit operations in commit message
>> - Fix the comments following the suggestions
>> v2: https://lore.kernel.org/all/20251202022707.2720933-1-jianpeng.chang.cn@windriver.com/
>> - Use pte_mkwrite_novma(pte_mkdirty(pte)) instead of manual bit manipulation
>> - Updated comments to clarify pte_mkwrite_novma() alone cannot be used
>> v1: https://lore.kernel.org/all/20251127034350.3600454-1-jianpeng.chang.cn@windriver.com/
>>
>> arch/arm64/mm/trans_pgd.c | 17 +++++++++++++++--
>> 1 file changed, 15 insertions(+), 2 deletions(-)
>>
>> diff --git a/arch/arm64/mm/trans_pgd.c b/arch/arm64/mm/trans_pgd.c
>> index 18543b603c77..766883780d2a 100644
>> --- a/arch/arm64/mm/trans_pgd.c
>> +++ b/arch/arm64/mm/trans_pgd.c
>> @@ -40,8 +40,14 @@ static void _copy_pte(pte_t *dst_ptep, pte_t *src_ptep, unsigned long addr)
>> * Resume will overwrite areas that may be marked
>> * read only (code, rodata). Clear the RDONLY bit from
>> * the temporary mappings we use during restore.
>> + *
>> + * For both kexec and hibernation, writable accesses are required
>> + * for all pages in the linear map to copy over new kernel image.
>> + * Hence mark these pages dirty first via pte_mkdirty() to ensure
>> + * pte_mkwrite_novma() subsequently clears PTE_RDONLY - providing
>> + * required write access for the pages.
>> */
>> - __set_pte(dst_ptep, pte_mkwrite_novma(pte));
>> + __set_pte(dst_ptep, pte_mkwrite_novma(pte_mkdirty(pte)));
>> } else if (!pte_none(pte)) {
>> /*
>> * debug_pagealloc will removed the PTE_VALID bit if
>> @@ -57,7 +63,14 @@ static void _copy_pte(pte_t *dst_ptep, pte_t *src_ptep, unsigned long addr)
>> */
>> BUG_ON(!pfn_valid(pte_pfn(pte)));
>>
>> - __set_pte(dst_ptep, pte_mkvalid(pte_mkwrite_novma(pte)));
>> + /*
>> + * For both kexec and hibernation, writable accesses are required
>> + * for all pages in the linear map to copy over new kernel image.
>> + * Hence mark these pages dirty first via pte_mkdirty() to ensure
>> + * pte_mkwrite_novma() subsequently clears PTE_RDONLY - providing
>> + * required write access for the pages.
>> + */
>> + __set_pte(dst_ptep, pte_mkvalid(pte_mkwrite_novma(pte_mkdirty(pte))));
>> }
>> }
>
> Looking through the history, in 4.16 commit 41acec624087 ("arm64: kpti:
> Make use of nG dependent on arm64_kernel_unmapped_at_el0()") simplified
> PAGE_KERNEL to only depend on PROT_NORMAL. All correct so far with
> PAGE_KERNEL still having PTE_DIRTY.
>
> Later on in 5.4, commit aa57157be69f ("arm64: Ensure VM_WRITE|VM_SHARED
> ptes are clean by default") dropped PTE_DIRTY from PROT_NORMAL. This
> wasn't an issue even with DBM disabled as we don't set PTE_RDONLY, so
> it's considered pte_hw_dirty() anyway.
Regardless of the kexec issue, I think that it's reasonable to set
PTE_DIRTY if PTE_WRITE and !PTE_RDONLY. It's more consistent.
> Huang's commit you mentioned changed the assumptions above, so
> pte_mkwrite() no longer makes a read-only (kernel) pte fully writeable.
> This is fine for user mappings (either trap or DBM will make it fully
> writeable) but not for kernel mappings.
>
> Your commit above should work but I wonder whether it's better to go
> back to having the kernel mappings marked dirty irrespective of their
> permission:
>
> --------------8<---------------------------
>
> diff --git a/arch/arm64/include/asm/pgtable-prot.h b/arch/arm64/include/asm/pgtable-prot.h
> index 161e8660eddd..113c257d19c4 100644
> --- a/arch/arm64/include/asm/pgtable-prot.h
> +++ b/arch/arm64/include/asm/pgtable-prot.h
> @@ -50,11 +50,11 @@
>
> #define _PAGE_DEFAULT (_PROT_DEFAULT | PTE_ATTRINDX(MT_NORMAL))
>
> -#define _PAGE_KERNEL (PROT_NORMAL)
> -#define _PAGE_KERNEL_RO ((PROT_NORMAL & ~PTE_WRITE) | PTE_RDONLY)
> -#define _PAGE_KERNEL_ROX ((PROT_NORMAL & ~(PTE_WRITE | PTE_PXN)) | PTE_RDONLY)
> -#define _PAGE_KERNEL_EXEC (PROT_NORMAL & ~PTE_PXN)
> -#define _PAGE_KERNEL_EXEC_CONT ((PROT_NORMAL & ~PTE_PXN) | PTE_CONT)
> +#define _PAGE_KERNEL (PROT_NORMAL | PTE_DIRTY)
> +#define _PAGE_KERNEL_RO ((PROT_NORMAL & ~PTE_WRITE) | PTE_RDONLY | PTE_DIRTY)
> +#define _PAGE_KERNEL_ROX ((PROT_NORMAL & ~(PTE_WRITE | PTE_PXN)) | PTE_RDONLY | PTE_DIRTY)
IMHO, it appears not absolutely natural to make read-only kernel mapping
dirty unconditionally. However it should work. I have no strong
opinions here too.
> +#define _PAGE_KERNEL_EXEC ((PROT_NORMAL & ~PTE_PXN) | PTE_DIRTY)
> +#define _PAGE_KERNEL_EXEC_CONT ((PROT_NORMAL & ~PTE_PXN) | PTE_CONT | PTE_DIRTY)
>
> #define _PAGE_SHARED (_PAGE_DEFAULT | PTE_USER | PTE_RDONLY | PTE_NG | PTE_PXN | PTE_UXN | PTE_WRITE)
> #define _PAGE_SHARED_EXEC (_PAGE_DEFAULT | PTE_USER | PTE_RDONLY | PTE_NG | PTE_PXN | PTE_WRITE)
> --------------8<---------------------------
---
Best Regards,
Huang, Ying
Powered by blists - more mailing lists