[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <2a620925-1715-5fc6-86bb-783cf3cb6ebf@huaweicloud.com>
Date: Mon, 18 Nov 2024 09:14:17 +0800
From: Yu Kuai <yukuai1@...weicloud.com>
To: Genes Lists <lists@...ience.com>, song@...nel.org,
linux-raid@...r.kernel.org, linux-kernel@...r.kernel.org, tytso@....edu,
adilger.kernel@...ger.ca
Cc: linux@...mhuis.info, "yukuai (C)" <yukuai3@...wei.com>,
yi.zhang@...wei.com, "libaokun (A)" <libaokun1@...wei.com>, tytso@....edu,
linux-ext4@...r.kernel.org
Subject: Re: md-raid 6.11.8 page fault oops
+CC ext4
在 2024/11/18 1:23, Genes Lists 写道:
> On Fri, 2024-11-15 at 07:12 -0500, Genes Lists wrote:
>>
>>
> Another page fault oops this time when 6.11.8 was shutting to boot
> 6.11.9.
>
> This one is in ext4 -> rbtree and I don't see raid at all this time.
> (Soadding ext4 maintainers)
>
> The previous oops occurred in clone_endio from dm_mod.
>
> I note that 9 hours before the oops there was a an ext4 error - in case
> it's relevant.
>
> This oops occurred in rb_first+0x13 invoked from
> ext4_discard_preallocations+0xc3.
>
> journal summary below and full log attached.
>
> gene
>
> # --- line numbers -----
>
> rbtree line:
> (gdb) list *(rb_first+0x13)
> 0xffffffff81de1af3 is in rb_first (lib/rbtree.c:473).
> 468 struct rb_node *n;
> 469
> 470 n = root->rb_node;
> 471 if (!n)
> 472 return NULL;
> 473 while (n->rb_left)
> 474 n = n->rb_left;
> 475 return n;
> 476 }
> 477 EXPORT_SYMBOL(rb_first);
>
> ext4 line:
> (gdb) list *(ext4_discard_preallocations+0xc3)
> 0x372f3 is in ext4_discard_preallocations (fs/ext4/mballoc.c:5539).
> 5534 atomic_read(&ei->i_prealloc_active));
> 5535
> 5536 repeat:
> 5537 /* first, collect all pa's in the inode */
> 5538 write_lock(&ei->i_prealloc_lock);
> 5539 for (iter = rb_first(&ei->i_prealloc_node); iter;
> 5540 iter = rb_next(iter)) {
> 5541 pa = rb_entry(iter, struct ext4_prealloc_space,
> 5542 pa_node.inode_node);
> 5543 BUG_ON(pa->pa_node_lock.inode_lock != &ei-
>> i_prealloc_lock);
>
>
> # ----------- journal -------
>
> # This is 9 hours prior to oops
> [161780.846149] EXT4-fs (dm-3): error count since last fsck: 2
> [161780.847081] EXT4-fs (dm-3): initial error at time 1731742618:
> ext4_lookup:1813: inode 126161478
> [161780.847214] EXT4-fs (dm-3): last error at time 1731742618:
> ext4_lookup:1813: inode 126161478
>
>
> [191322.007026] EXT4-fs (sdg5): unmounting filesystem 3e25ed0e-ff2b-
> 4ad1-8227-6dc838055384.
> [191322.007093] EXT4-fs (sdg4): unmounting filesystem 1b631410-216a-
> 4909-a02e-0362da57d241.
> [191322.011010] EXT4-fs (nvme0n1p5): unmounting filesystem f6f66f4e-
> 1ed8-47fd-ac65-b91acd278d89.
> [191322.016010] EXT4-fs (nvme0n1p2): unmounting filesystem bd94c712-
> f5f3-4f18-b1ed-b77ee42d4e0b.
> [191322.261047] EXT4-fs (sdg2): unmounting filesystem 8f93166e-b18c-
> 4522-af8c-21fdc12ef3e2.
> [191331.777986] BUG: unable to handle page fault for address:
> 0000000000200010
> [191331.778187] #PF: supervisor read access in kernel mode
> [191331.781901] #PF: error_code(0x0000) - not-present page
> [191331.781956] PGD 0 P4D 0
> [191331.782037] Oops: Oops: 0000 [#1] PREEMPT SMP PTI
> [191331.782075] CPU: 1 UID: 0 PID: 37604 Comm: umount Not tainted
> 6.11.8-stable-1 #21 1400000003000000474e5500ae13c727d476f9ab
> [191331.782093] Hardware name: To Be Filled By O.E.M. To Be Filled By
> O.E.M./Z370 Extreme4, BIOS P4.20 10/31/2019
> [191331.782105] RIP: 0010:rb_first+0x13/0x30
> [191331.782120] Code: 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90
> 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 07 48 85 c0 74 18 0f 1f 40 00 48
> 89 c2 <48> 8b 40 10 48 85 c0 75 f4 48 89 d0 c3 cc cc cc cc 31 d2 eb f4
> 0f
> [191331.782135] RSP: 0018:ffffa95621d3f8d8 EFLAGS: 00010206
> [191331.782146] RAX: 0000000000200000 RBX: ffffa95621d3f8f8 RCX:
> 0000000000000000
> [191331.782162] RDX: 0000000000200000 RSI: 0000000000000000 RDI:
> ffff8f299ec75708
> [191331.782176] RBP: ffffa95621d3f908 R08: 0000000000000001 R09:
> 000000000066001a
> [191331.782189] R10: 000000000066001a R11: 0000000000000000 R12:
> ffff8f2585b77800
> [191331.782200] R13: ffff8f299ec75468 R14: ffff8f299ec75710 R15:
> ffff8f297376c688
> [191331.782211] FS: 00007f30f4a6db80(0000) GS:ffff8f2d1ec80000(0000)
> knlGS:0000000000000000
> [191331.782222] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [191331.782234] CR2: 0000000000200010 CR3: 000000011c868003 CR4:
> 00000000003706f0
> [191331.782252] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [191331.782283] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000400
> [191331.782294] Call Trace:
> [191331.782308] <TASK>
> [191331.782320] ? __die_body.cold+0x19/0x27
> [191331.782333] ? page_fault_oops+0x15a/0x2d0
> [191331.782346] ? exc_page_fault+0x7e/0x180
> [191331.782362] ? asm_exc_page_fault+0x26/0x30
> [191331.782374] ? rb_first+0x13/0x30
> [191331.782385] ext4_discard_preallocations+0xc3/0x460 [ext4
> 1400000003000000474e5500fcb7142b958415b3]
> [191331.782401] ext4_clear_inode+0x2a/0xb0 [ext4
> 1400000003000000474e5500fcb7142b958415b3]
> [191331.782414] ext4_evict_inode+0xa1/0x6b0 [ext4
> 1400000003000000474e5500fcb7142b958415b3]
> [191331.782432] evict+0x111/0x2c0
> [191331.782460] ? fsnotify_destroy_marks+0x2a/0x1b0
> [191331.782470] ? __call_rcu_common+0xc2/0x710
> [191331.782480] evict_inodes+0x226/0x240
> [191331.782723] generic_shutdown_super+0x3d/0x170
> [191331.782739] kill_block_super+0x1a/0x40
> [191331.782753] ext4_kill_sb+0x22/0x40 [ext4
> 1400000003000000474e5500fcb7142b958415b3]
> [191331.782766] deactivate_locked_super+0x30/0xb0
> [191331.782776] cleanup_mnt+0xba/0x150
> [191331.782786] task_work_run+0x59/0x90
> [191331.782794] syscall_exit_to_user_mode+0x1f4/0x200
> [191331.782805] do_syscall_64+0x8e/0x160
> [191331.782815] ? vfs_statx+0x8d/0x100
> [191331.782830] ? vfs_fstatat+0x8a/0xb0
> [191331.782848] ? __do_sys_newfstatat+0x3c/0x80
> [191331.782861] ? syscall_exit_to_user_mode+0x10/0x200
> [191331.782805] do_syscall_64+0x8e/0x160
> [191331.782815] ? vfs_statx+0x8d/0x100
> [191331.782830] ? vfs_fstatat+0x8a/0xb0
> [191331.782848] ? __do_sys_newfstatat+0x3c/0x80
> [191331.782861] ? syscall_exit_to_user_mode+0x10/0x200
> [191331.782871] ? do_syscall_64+0x8e/0x160
> [191331.782884] ? generic_permission+0x39/0x220
> [191331.782895] ? mntput_no_expire+0x4a/0x260
> [191331.782907] ? do_faccessat+0x1e1/0x2e0
> [191331.782916] ? syscall_exit_to_user_mode+0x10/0x200
> [191331.782926] ? do_syscall_64+0x8e/0x160
> [191331.782936] ? do_user_addr_fault+0x36c/0x620
> [191331.782947] ? exc_page_fault+0x7e/0x180
> [191331.782956] entry_SYSCALL_64_after_hwframe+0x76/0x7e
> [191331.782969] RIP: 0033:0x7f30f4bc21cb
> [191331.782981] Code: c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 f3
> 0f 1e fa 31 f6 e9 05 00 00 00 0f 1f 44 00 00 f3 0f 1e fa b8 a6 00 00 00
> 0f 05 <48> 3d 00 f0 ff ff 77 05 c3 0f 1f 40 00 48 8b 15 11 cb 0c 00 f7
> d8
> [191331.782995] RSP: 002b:00007fff6233d1e8 EFLAGS: 00000246 ORIG_RAX:
> 00000000000000a6
> [191331.783039] RAX: 0000000000000000 RBX: 0000561542af84e0 RCX:
> 00007f30f4bc21cb
> [191331.783053] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> 0000561542af9180
> [191331.783099] RBP: 00007fff6233d2c0 R08: 0000561542af6010 R09:
> 0000000000000007
> [191331.783115] R10: 0000000000000000 R11: 0000000000000246 R12:
> 0000561542af85e8
> [191331.783126] R13: 0000000000000000 R14: 0000561542af9180 R15:
> 0000561542af9570
> [191331.783143] </TASK>
> [191331.783158] Modules linked in: algif_hash af_alg nft_nat
> nft_chain_nat nf_nat nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4
> nf_tables rpcrdma rdma_cm iw_cm ib_cm wireguard curve25519_x86_64
> libchacha20poly1305 ib_core chacha_x86_64 poly1305_x86_64
> libcurve25519_generic libchacha ip6_udp_tunnel udp_tunnel nct6775
> nct6775_core hwmon_vid snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic snd_hda_scodec_component dm_cache_smq dm_cache
> dm_persistent_data dm_bio_prison dm_bufio nls_iso8859_1 vfat fat
> intel_rapl_msr intel_rapl_common intel_uncore_frequency
> intel_uncore_frequency_common raid456 intel_tcc_cooling
> async_raid6_recov async_memcpy x86_pkg_temp_thermal async_pq
> snd_soc_avs async_xor intel_powerclamp async_tx snd_soc_hda_codec xor
> joydev coretemp snd_hda_ext_core raid6_pq libcrc32c snd_soc_core
> kvm_intel snd_compress i915 ac97_bus snd_pcm_dmaengine snd_hda_intel
> kvm snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec snd_hda_core
> snd_hwdep rapl drm_buddy snd_pcm mei_hdcp mei_pxp i2c_algo_bit ee1004
> [191331.783217] intel_cstate snd_timer ttm i2c_i801
> drm_display_helper snd mei_me i2c_smbus intel_uncore usbhid
> intel_wmi_thunderbolt pcspkr e1000e mxm_wmi i2c_mux soundcore cec mei
> intel_gtt intel_pmc_core intel_vsec md_mod pmt_telemetry pmt_class
> cfg80211 acpi_pad mac_hid rfkill nfsd auth_rpcgss nfs_acl lockd grace
> tcp_bbr loop dm_mod fuse sunrpc nfnetlink ip_tables x_tables ext4
> crc32c_generic crc16 mbcache jbd2 crct10dif_pclmul crc32_pclmul
> crc32c_intel polyval_clmulni polyval_generic ghash_clmulni_intel
> sha512_ssse3 sha256_ssse3 sha1_ssse3 nvme aesni_intel gf128mul
> crypto_simd cryptd xhci_pci nvme_core xhci_pci_renesas video wmi
> usbip_host usbip_core pkcs8_key_parser sg crypto_user
> [191331.783245] CR2: 0000000000200010
> [191331.783259] ---[ end trace 0000000000000000 ]---
> [191331.783277] RIP: 0010:rb_first+0x13/0x30
> [191331.783289] Code: 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90
> 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 07 48 85 c0 74 18 0f 1f 40 00 48
> 89 c2 <48> 8b 40 10 48 85 c0 75 f4 48 89 d0 c3 cc cc cc cc 31 d2 eb f4
> 0f
> [191331.783299] RSP: 0018:ffffa95621d3f8d8 EFLAGS: 00010206
> [191331.783311] RAX: 0000000000200000 RBX: ffffa95621d3f8f8 RCX:
> 0000000000000000
> [191331.783322] RDX: 0000000000200000 RSI: 0000000000000000 RDI:
> ffff8f299ec75708
> [191331.783334] RBP: ffffa95621d3f908 R08: 0000000000000001 R09:
> 000000000066001a
> [191331.783344] R10: 000000000066001a R11: 0000000000000000 R12:
> ffff8f2585b77800
> [191331.783357] R13: ffff8f299ec75468 R14: ffff8f299ec75710 R15:
> ffff8f297376c688
> [191331.783369] FS: 00007f30f4a6db80(0000) GS:ffff8f2d1ec80000(0000)
> knlGS:0000000000000000
> [191331.783379] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [191331.783389] CR2: 0000000000200010 CR3: 000000011c868003 CR4:
> 00000000003706f0
> [191331.783399] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [191331.783407] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000400
> [191331.783417] note: umount[37604] exited with irqs disabled
> [191331.783430] note: umount[37604] exited with preempt_count 1
> [191332.973053] systemd-shutdown[1]: Syncing filesystems and block
> devices.
> [191362.979489] systemd-shutdown[1]: Syncing filesystems and block
> devices - timed out, issuing SIGKILL to PID 37638.
> [191362.979558] systemd-shutdown[1]: Sending SIGTERM to remaining
> processes...
>
>
Powered by blists - more mailing lists