linux-kernel - Re: kernel panic after suspend/resume (was: Linux 3.4-rc3)

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <CA+55aFxhb6hriqHHwVtNeYHmtcy5JCEJX-zABBcG2Zjw_gawPw@mail.gmail.com>
Date:	Tue, 17 Apr 2012 09:00:48 -0700
From:	Linus Torvalds <torvalds@...ux-foundation.org>
To:	Sven Joachim <svenjoac@....de>, Ingo Molnar <mingo@...nel.org>,
	Thomas Gleixner <tglx@...utronix.de>,
	"Rafael J. Wysocki" <rjw@...k.pl>
Cc:	Linux Kernel Mailing List <linux-kernel@...r.kernel.org>
Subject: Re: kernel panic after suspend/resume (was: Linux 3.4-rc3)

On Tue, Apr 17, 2012 at 8:24 AM, Sven Joachim <svenjoac@....de> wrote:
>
> With Linux 3.4-rc3, I'm experiencing crashes after resuming from
> suspend, not immediately but after a few minutes.  This has happened
> three times so far, note that 3.4-rc2 worked fine.

Hmm. Looks like "global_clock_event->event_handler" is NULL. Which
doesn't make any sense what-so-ever, but clearly it is.

 Added Ingo and Thomas to the cc, since that's a very x86
timer-looking thing. And Rafael since it's about suspend/resume. I do
wonder if it's some odd memory corruption due to a wild pointer. Of
course, if it's somewhat repeatable, that's some *seriously* odd
corruption, though. So that sounds unlikely too - but that
global_clock_event thing looks odd.

Oh: guys, one thing to look at is that "lapic_cal_handler" thing.
Weren't there some changes to timer calibration wrt SMP lately? Not in
-rc3, but we had some calibrate_delay() changes - skipping them on
other CPU's when the TSC was reliable, and irq disable things.

Maybe the calibration at resume now does something different?

Two questions:

 - if it is reasonably repeatable, can you try to bisect it? There's
just under 400 commits in between rc2 and rc3, and you don't really
need to do a full bisect, but if you do just four bisections, it
should narrow it down to just 25 commits or so.

 - how sure are you that rc2 is fine? I don't see anything suspicious
in this area since rc2, so I would ask you to really test it very well
to make sure it really was introduced after rc2.

Thomas, Ingo, Rafael - any ideas?

                     Linus

---
> [29747.810224] BUG: unable to handle kernel NULL pointer dereference at           (null)
> [29747.810359] IP: [<          (null)>]           (null)
> [29747.810359] PGD c71d9067 PUD c7217067 PMD 0
> [29747.810359] Oops: 0010 [#1] SMP
> [29747.810359] CPU 0
> [29747.810359] Modules linked in: netconsole ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack ip_tables x_tables nfsd exportfs nfs_acl auth_rpcgss lockd sunrpc binfmt_misc aes_generic ipv6 cryptomgr aead arc4 crypto_algapi rt73usb rt2x00usb rt2x00lib mac80211 cfg80211 crc_itu_t snd_hda_codec_realtek snd_hda_intel snd_hda_codec snd_pcm_oss snd_mixer_oss snd_pcm snd_page_alloc snd_seq_oss snd_seq_midi_event 8250_pnp snd_seq coretemp pcspkr snd_seq_device snd_timer 8250 serial_core parport_pc acpi_cpufreq i2c_i801 mperf parport intel_agp snd evdev intel_gtt processor microcode soundcore nouveau uhci_hcd video mxm_wmi fan thermal button sr_mod cdrom ehci_hcd wmi hwmon drm_kms_helper ttm drm sky2 usbcore usb_common [last unloaded: netconsole]
> [29747.810359]
> [29747.810359] Pid: 0, comm: swapper/0 Not tainted 3.4.0-rc3-nouveau #1 . ./I-45C(Intel i945GC-ICH7)
> [29747.810359] RIP: 0010:[<0000000000000000>]  [<          (null)>]           (null)
> [29747.810359] RSP: 0018:ffff8800cfc03ee0  EFLAGS: 00010046
> [29747.810359] RAX: ffffffff813a6780 RBX: ffffffff813a2600 RCX: ffffffffffffffcf
> [29747.810359] RDX: 0000000000000066 RSI: 0000000000000000 RDI: ffffffff813a6780
> [29747.810359] RBP: ffff8800cf006080 R08: ffff8800cf006080 R09: 0000000000000002
> [29747.810359] R10: 000000000000000c R11: ffff8800caf0d790 R12: 0000000000000000
> [29747.810359] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
> [29747.810359] FS:  0000000000000000(0000) GS:ffff8800cfc00000(0000) knlGS:0000000000000000
> [29747.810359] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [29747.810359] CR2: 0000000000000000 CR3: 00000000c7308000 CR4: 00000000000007f0
> [29747.810359] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [29747.810359] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [29747.810359] Process swapper/0 (pid: 0, threadinfo ffffffff8138e000, task ffffffff813a1020)
> [29747.810359] Stack:
> [29747.810359]  ffffffff81003951 ffffffff81019593 ffffffff8106a8c7 ffff8800cf006080
> [29747.810359]  ffff8800cf006080 ffff8800cf00610c 0000000000000000 ffffffff8138fed8
> [29747.810359]  0000000000000000 0000000000000000 ffffffff8106a9eb ffffffffffffffcf
> [29747.810359] Call Trace:
> [29747.810359]  <IRQ>
> [29747.810359]  [<ffffffff81003951>] ? timer_interrupt+0xd/0x14
> [29747.810359]  [<ffffffff81019593>] ? default_inquire_remote_apic+0xf/0xf
> [29747.810359]  [<ffffffff8106a8c7>] ? handle_irq_event_percpu+0x24/0x11a
> [29747.810359]  [<ffffffff8106a9eb>] ? handle_irq_event+0x2e/0x4f
> [29747.810359]  [<ffffffff8106cd39>] ? handle_edge_irq+0xbb/0xdc
> [29747.810359]  [<ffffffff81003356>] ? handle_irq+0x1a/0x1e
> [29747.810359]  [<ffffffff8100308d>] ? do_IRQ+0x42/0xa7
> [29747.810359]  [<ffffffff8128eb27>] ? common_interrupt+0x67/0x67
> [29747.810359]  <EOI>
> [29747.810359]  [<ffffffff8100838b>] ? mwait_idle+0x5a/0x5d
> [29747.810359]  [<ffffffff81008b15>] ? cpu_idle+0x55/0x8f
> [29747.810359]  [<ffffffff813e3a74>] ? start_kernel+0x32f/0x33a
> [29747.810359]  [<ffffffff813e348f>] ? loglevel+0x34/0x34
> [29747.810359] Code:  Bad RIP value.
> [29747.810359] RIP  [<          (null)>]           (null)
> [29747.810359]  RSP <ffff8800cfc03ee0>
> [29747.810359] CR2: 0000000000000000
> [29747.810359] ---[ end trace ed1a30f4a6c65235 ]---
> [29747.810359] Kernel panic - not syncing: Fatal exception in interrupt
> [29747.810359] panic occurred, switching back to text console
>
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/