Message-Id: <201208042024.GFG34353.OFtFVQJMLOHFSO@I-love.SAKURA.ne.jp>
Date:	Sat, 4 Aug 2012 20:24:06 +0900
From:	Tetsuo Handa <penguin-kernel@...ove.SAKURA.ne.jp>
To:	linux-kernel@...r.kernel.org
Cc:	mingo@...hat.com, peterz@...radead.org, tglx@...utronix.de
Subject: Re: [3.6-rc1] sched: clock counts too quickly

Hello.

Tetsuo Handa wrote:
> Under unknown condition, clock starts counting up too quickly which is enough
> to confuse hangcheck timer to print stall warning.
I wrote a test program.

---------- test program start ----------
#include <string.h>
#include <sys/timex.h>
#include <unistd.h>

int main(int argc, char *argv[])
{
        while (1) {
                struct timeval tv;
                struct timezone tz;
                struct timex buf;
                gettimeofday(&tv, &tz);
                settimeofday(&tv, &tz);
                memset(&buf, 0, sizeof(buf));
                buf.modes = 0x100;
                adjtimex(&buf);
        }
        return 0;
}
---------- test program end ----------

Running this program as root user on 3.6-rc1 causes clock jumping.

buf.modes = 0x100 is just a random choice because I don't know what arguments
are appropriate for adjtimex(). But I guess this is a regression because
I didn't trigger this problem until 3.5 and I can always trigger this problem
in 3.6-rc1. Maybe something is wrong with per-cpu clock management?

Example log 1:

[  109.311730] EXT4-fs (ram0): mounting ext2 file system using the ext4 subsystem
[  109.322127] EXT4-fs (ram0): mounted filesystem without journal. Opts: (null)
[ 1293.082319] [sched_delayed] sched: RT throttling activated
[ 7890.377400] BUG: soft lockup - CPU#0 stuck for 1024s! [a.out:3819]
[ 7890.377400] Modules linked in: ipv6 binfmt_misc
[ 8989.892529] irq event stamp: 86970
[ 8989.892529] hardirqs last  enabled at (86969): [<c1070bf5>] do_settimeofday+0x105/0x130
[ 8989.892529] hardirqs last disabled at (86970): [<c13ed980>] apic_timer_interrupt+0x28/0x34
[ 8989.892529] softirqs last  enabled at (84344): [<c103a7a2>] __do_softirq+0xf2/0x160
[ 8989.892529] softirqs last disabled at (84339): [<c1004d07>] do_softirq+0x87/0xd0
[ 8989.892529] Pid: 3819, comm: a.out Not tainted 3.6.0-rc1-dirty #36 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform
[ 8989.892529] EIP: 0060:[<c1070bf9>] EFLAGS: 00000293 CPU: 0
[ 8989.892529] EIP is at do_settimeofday+0x109/0x130
[ 8989.892529] EAX: da2f2160 EBX: ddcaff90 ECX: 00000000 EDX: 00000001
[ 8989.892529] ESI: 167a5ee1 EDI: 00000000 EBP: ddcaff64 ESP: ddcaff44
[ 8989.892529]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[ 8989.892529] CR0: 8005003b CR2: bfeddfdc CR3: 1a10f000 CR4: 000006d0
[ 8989.892529] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 8989.892529] DR6: ffff0ff0 DR7: 00000400
[ 8989.892529] Process a.out (pid: 3819, ti=ddcae000 task=da2f2160 task.ti=ddcae000)
[ 8989.892529] Stack:
[ 8989.892529]  167a5ee1 00000000 00000293 afe30360 167a5ee1 ddcaff90 00000000 00000000
[ 8989.892529]  ddcaff80 c1039b8b bfa25ca4 bfa25c9c bfa25ca4 bfa25c9c ddcaff88 ddcaffac
[ 8989.892529]  c1039c1e fffffde4 00000000 501d1b72 00000bb8 501d1b72 00000003 bfa25ca4
[ 8989.892529] Call Trace:
[ 8989.892529]  [<c1039b8b>] do_sys_settimeofday+0x7b/0xe0
[ 8989.892529]  [<c1039c1e>] sys_settimeofday+0x2e/0x90
[ 8989.892529]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[ 8989.892529] Code: 2f 78 c1 e8 8a e6 ff ff b8 90 2f 78 c1 83 05 8c 2f 78 c1 01 e8 d9 c9 37 00 f7 45 e8 00 02 00 00 74 20 e8 db a5 00 00 ff 75 e8 9d <e8> 72 61 fe ff 8b 5d f4 31 c0 8b 75 f8 8b 7d fc 89 ec 5d c3 8d
[ 8989.892529] Kernel panic - not syncing: softlockup: hung tasks
[ 8989.892529] Pid: 3819, comm: a.out Not tainted 3.6.0-rc1-dirty #36
[ 8989.892529] Call Trace:
[ 8989.892529]  [<c13e9c5c>] panic+0x87/0x196
[ 8989.892529]  [<c1098281>] watchdog_timer_fn+0x171/0x180
[ 8989.892529]  [<c10568b8>] hrtimer_run_queues+0xb8/0x270
[ 8989.892529]  [<c1098110>] ? touch_softlockup_watchdog_sync+0x30/0x30
[ 8989.892529]  [<c1040978>] run_local_timers+0x8/0x20
[ 8989.892529]  [<c10409bf>] update_process_times+0x2f/0x70
[ 8989.892529]  [<c1075625>] tick_periodic+0x25/0x80
[ 8989.892529]  [<c1075699>] tick_handle_periodic+0x19/0x80
[ 8989.892529]  [<c1022bcf>] smp_apic_timer_interrupt+0x4f/0x90
[ 8989.892529]  [<c11e35a4>] ? trace_hardirqs_off_thunk+0xc/0x18
[ 8989.892529]  [<c13ed987>] apic_timer_interrupt+0x2f/0x34
[ 8989.892529]  [<c1070bf9>] ? do_settimeofday+0x109/0x130
[ 8989.892529]  [<c1039b8b>] do_sys_settimeofday+0x7b/0xe0
[ 8989.892529]  [<c1039c1e>] sys_settimeofday+0x2e/0x90
[ 8989.892529]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[ 8989.892529] ------------[ cut here ]------------
[ 8989.892529] WARNING: at kernel/lockdep.c:2592 trace_hardirqs_on_caller+0x15d/0x1c0()
[ 8989.892529] Hardware name: VMware Virtual Platform
[ 8989.892529] Modules linked in: ipv6 binfmt_misc
[ 8989.892529] Pid: 3819, comm: a.out Not tainted 3.6.0-rc1-dirty #36
[ 8989.892529] Call Trace:
[ 8989.892529]  [<c103215d>] warn_slowpath_common+0x6d/0xa0
[ 8989.892529]  [<c107b16d>] ? trace_hardirqs_on_caller+0x15d/0x1c0
[ 8989.892529]  [<c107b16d>] ? trace_hardirqs_on_caller+0x15d/0x1c0
[ 8989.892529]  [<c13e9d2c>] ? panic+0x157/0x196
[ 8989.892529]  [<c10321ad>] warn_slowpath_null+0x1d/0x20
[ 8989.892529]  [<c107b16d>] trace_hardirqs_on_caller+0x15d/0x1c0
[ 8989.892529]  [<c107b1db>] trace_hardirqs_on+0xb/0x10
[ 8989.892529]  [<c13e9d2c>] panic+0x157/0x196
[ 8989.892529]  [<c1098281>] watchdog_timer_fn+0x171/0x180
[ 8989.892529]  [<c10568b8>] hrtimer_run_queues+0xb8/0x270
[ 8989.892529]  [<c1098110>] ? touch_softlockup_watchdog_sync+0x30/0x30
[ 8989.892529]  [<c1040978>] run_local_timers+0x8/0x20
[ 8989.892529]  [<c10409bf>] update_process_times+0x2f/0x70
[ 8989.892529]  [<c1075625>] tick_periodic+0x25/0x80
[ 8989.892529]  [<c1075699>] tick_handle_periodic+0x19/0x80
[ 8989.892529]  [<c1022bcf>] smp_apic_timer_interrupt+0x4f/0x90
[ 8989.892529]  [<c11e35a4>] ? trace_hardirqs_off_thunk+0xc/0x18
[ 8989.892529]  [<c13ed987>] apic_timer_interrupt+0x2f/0x34
[ 8989.892529]  [<c1070bf9>] ? do_settimeofday+0x109/0x130
[ 8989.892529]  [<c1039b8b>] do_sys_settimeofday+0x7b/0xe0
[ 8989.892529]  [<c1039c1e>] sys_settimeofday+0x2e/0x90
[ 8989.892529]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[ 8989.892529] ---[ end trace 2cc59ba688ae11e6 ]---

Example log 2:

[   32.966527] CPA self-test:
[   32.968959]  4k 131072 large 0 gb 0 x 131072[c0000000-dffff000] miss 0
[   32.981918]  4k 131072 large 0 gb 0 x 131072[c0000000-dffff000] miss 0
[   32.994237]  4k 131072 large 0 gb 0 x 131072[c0000000-dffff000] miss 0
[   32.996998] ok.
[ 1144.112407] [sched_delayed] sched: RT throttling activated
[ 2247.683216] BUG: soft lockup - CPU#0 stuck for 1024s! [smbd:3530]
[ 2247.683216] Modules linked in: ipv6 binfmt_misc
[ 2247.683216] irq event stamp: 45100
[ 2247.683216] hardirqs last  enabled at (45099): [<c10b3f95>] get_page_from_freelist+0x355/0x580
[ 2247.683216] hardirqs last disabled at (45100): [<c13ed980>] apic_timer_interrupt+0x28/0x34
[ 2247.683216] softirqs last  enabled at (43784): [<c103a7a2>] __do_softirq+0xf2/0x160
[ 2247.683216] softirqs last disabled at (43771): [74781.658009] BUG: soft lockup - CPU#1 stuck for 66529s! [a.out:3581]
[74781.658022] Modules linked in: ipv6 binfmt_misc
[74781.658038] irq event stamp: 28028
[74781.658038] hardirqs last  enabled at (28027): [<c1070ac7>] timekeeping_inject_offset+0xc7/0xf0
[74781.658038] hardirqs last disabled at (28028): [<c13ed980>] apic_timer_interrupt+0x28/0x34
[74781.658038] softirqs last  enabled at (27372): [<c103a7a2>] __do_softirq+0xf2/0x160
[74781.658038] softirqs last disabled at (27369): [<c1004d07>] do_softirq+0x87/0xd0
[74781.658038] Pid: 3581, comm: a.out Not tainted 3.6.0-rc1-dirty #36 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform
[74781.658038] EIP: 0060:[<c1070ac9>] EFLAGS: 00000293 CPU: 1
[74781.658038] EIP is at timekeeping_inject_offset+0xc9/0xf0
[74781.658038] EAX: da2ae760 EBX: 00000293 ECX: 00000000 EDX: 00000001
[74781.658038] ESI: 00000000 EDI: da339f20 EBP: da339edc ESP: da339ec4
[74781.658038]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[74781.658038] CR0: 8005003b CR2: b773a070 CR3: 1e0f5000 CR4: 000006d0
[74781.658038] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[74781.658038] DR6: ffff0ff0 DR7: 00000400
[74781.658038] Process a.out (pid: 3581, ti=da338000 task=da2ae760 task.ti=da338000)
[74781.658038] Stack:
[74781.658038]  078ac4bb 00000000 afe2ff10 078ac4bb da339f20 bf8f2088 da339f18 c1071299
[74781.658038]  da339f20 da339f04 c10c6d00 00000001 00000002 00000000 00000000 00000080
[74781.658038]  da339f18 c11e38a4 da339f20 bf8f2088 bf8f2000 da339fac c103a05f 00000100
[74781.658038] Call Trace:
[74781.658038]  [<c1071299>] do_adjtimex+0x509/0x5e0
[74781.658038]  [<c10c6d00>] ? might_fault+0x90/0xa0
[74781.658038]  [<c11e38a4>] ? _copy_from_user+0x34/0x80
[74781.658038]  [<c103a05f>] sys_adjtimex+0x4f/0x80
[74781.658038]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[74781.658038] Code: 64 2f 78 c1 b8 01 00 00 00 e8 b4 e7 ff ff b8 90 2f 78 c1 83 05 8c 2f 78 c1 01 e8 03 cb 37 00 f6 c7 02 74 16 e8 09 a7 00 00 53 9d <e8> a2 62 fe ff 31 c0 83 c4 10 5b 5e 5d c3 90 53 9d e8 91 6d 00
[74781.658038] Kernel panic - not syncing: softlockup: hung tasks
[74781.658038] Pid: 3581, comm: a.out Not tainted 3.6.0-rc1-dirty #36
[74781.658038] Call Trace:
[74781.658038]  [<c13e9c5c>] panic+0x87/0x196
[74781.658038]  [<c1098281>] watchdog_timer_fn+0x171/0x180
[74781.658038]  [<c10568b8>] hrtimer_run_queues+0xb8/0x270
[74781.658038]  [<c1062552>] ? sched_clock_local+0xb2/0x190
[74781.658038]  [<c1098110>] ? touch_softlockup_watchdog_sync+0x30/0x30
[74781.658038]  [<c1040978>] run_local_timers+0x8/0x20
[74781.658038]  [<c10409bf>] update_process_times+0x2f/0x70
[74781.658038]  [<c1075625>] tick_periodic+0x25/0x80
[74781.658038]  [<c1075699>] tick_handle_periodic+0x19/0x80
[74781.658038]  [<c1022bcf>] smp_apic_timer_interrupt+0x4f/0x90
[74781.658038]  [<c11e35a4>] ? trace_hardirqs_off_thunk+0xc/0x18
[74781.658038]  [<c13ed987>] apic_timer_interrupt+0x2f/0x34
[74781.658038]  [<c1070ac9>] ? timekeeping_inject_offset+0xc9/0xf0
[74781.658038]  [<c1071299>] do_adjtimex+0x509/0x5e0
[74781.658038]  [<c10c6d00>] ? might_fault+0x90/0xa0
[74781.658038]  [<c11e38a4>] ? _copy_from_user+0x34/0x80
[74781.658038]  [<c103a05f>] sys_adjtimex+0x4f/0x80
[74781.658038]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[ 2247.683216] [<c1004d07>] do_softirq+0x87/0xd0
[ 2247.683216] Pid: 3530, comm: smbd Not tainted 3.6.0-rc1-dirty #36 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform
[ 2247.683216] EIP: 0060:[<c102cb93>] EFLAGS: 00000202 CPU: 0
[ 2247.683216] EIP is at kernel_map_pages+0xa3/0x100
[ 2247.683216] EAX: 000006d0 EBX: dfb11b9c ECX: 00000650 EDX: 00000202
[ 2247.683216] ESI: 00000001 EDI: d756fd20 EBP: d756fd30 ESP: d756fcf8
[ 2247.683216]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[ 2247.683216] CR0: 8005003b CR2: b70e7320 CR3: 175dc000 CR4: 000006d0
[ 2247.683216] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 2247.683216] DR6: ffff0ff0 DR7: 00000400
[ 2247.683216] Process smbd (pid: 3530, ti=d756e000 task=de2b0520 task.ti=d756e000)
[ 2247.683216] Stack:
[ 2247.683216]  00000001 d756fd20 00000003 00000000 00000001 00000001 00019b6f 00000000
[ 2247.683216]  00000000 00000000 d9b70000 00000001 00000001 00000000 d756fd9c c10b3e58
[ 2247.683216]  00000001 00000041 ffffffff 00000001 001974cc 00000000 ffffffff 00000000
[ 2247.683216] Call Trace:
[ 2247.683216]  [<c10b3e58>] get_page_from_freelist+0x218/0x580
[ 2247.683216]  [<c10b42b6>] __alloc_pages_nodemask+0xf6/0x650
[ 2247.683216]  [<c10db7e2>] cache_alloc_refill+0x3d2/0x800
[ 2247.683216]  [<c10d0340>] ? anon_vma_fork+0x50/0xd0
[ 2247.683216]  [<c10db3ca>] kmem_cache_alloc+0x12a/0x170
[ 2247.683216]  [<c10d0340>] anon_vma_fork+0x50/0xd0
[ 2247.683216]  [<c1030572>] dup_mm+0x1a2/0x3c0
[ 2247.683216]  [<c1030f97>] copy_process+0x727/0xf30
[ 2247.683216]  [<c1031893>] do_fork+0x53/0x280
[ 2247.683216]  [<c10c6cb6>] ? might_fault+0x46/0xa0
[ 2247.683216]  [<c10c6d00>] ? might_fault+0x90/0xa0
[ 2247.683216]  [<c10c6cb6>] ? might_fault+0x46/0xa0
[ 2247.683216]  [<c11e3923>] ? copy_to_user+0x33/0x70
[ 2247.683216]  [<c100a17f>] sys_clone+0x2f/0x40
[ 2247.683216]  [<c13edf0d>] ptregs_clone+0x15/0x28
[ 2247.683216]  [<c13eddcc>] ? sysenter_do_call+0x12/0x32
[ 2247.683216] Code: 20 75 15 0f 20 d8 0f 22 d8 8b 5d f4 8b 75 f8 8b 7d fc 89 ec 5d c3 66 90 9c 5a fa 0f 20 e0 89 c1 80 e1 7f 0f 22 e1 0f 22 e0 52 9d <8b> 5d f4 8b 75 f8 8b 7d fc 89 ec 5d c3 83 3d 9c 80 ca c1 02 74

Example log 3:

[   33.144462] CPA self-test:
[   33.147052]  4k 131072 large 0 gb 0 x 131072[c0000000-dffff000] miss 0
[   33.159948]  4k 131072 large 0 gb 0 x 131072[c0000000-dffff000] miss 0
[   33.170339]  4k 131072 large 0 gb 0 x 131072[c0000000-dffff000] miss 0
[   33.173502] ok.
[ 9935.135720] [sched_delayed] sched: RT throttling activated
[11034.133140] BUG: soft lockup - CPU#0 stuck for 1024s! [a.out:3585]
[11034.133140] Modules linked in: ipv6 binfmt_misc
[11034.133140] irq event stamp: 14150
[11034.133140] hardirqs last  enabled at (14149): [<c1070bf5>] do_settimeofday+0x105/0x130
[11034.133140] hardirqs last disabled at (14150): [<c13ed980>] apic_timer_interrupt+0x28/0x34
[11034.133140] softirqs last  enabled at (12282): [<c103a7a2>] __do_softirq+0xf2/0x160
[11034.133140] softirqs last disabled at (12267): [<c1004d07>] do_softirq+0x87/0xd0
[11034.133140] Pid: 3585, comm: a.out Not tainted 3.6.0-rc1-dirty #36 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform
[11034.133140] EIP: 0060:[<c1070bf9>] EFLAGS: 00000293 CPU: 0
[11034.133140] EIP is at do_settimeofday+0x109/0x130
[11034.133140] EAX: d9a52260 EBX: ddca9f90 ECX: 00000000 EDX: 00000001
[11034.133140] ESI: 2564b881 EDI: 00000000 EBP: ddca9f64 ESP: ddca9f44
[11034.133140]  DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068
[11034.133140] CR0: 8005003b CR2: b77b2000 CR3: 1e4f0000 CR4: 000006d0
[11034.133140] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[11034.133140] DR6: ffff0ff0 DR7: 00000400
[11034.133140] Process a.out (pid: 3585, ti=ddca8000 task=d9a52260 task.ti=ddca8000)
[11034.133140] Stack:
[11034.133140]  2564b881 00000000 00000293 afe2fc28 2564b881 ddca9f90 00000000 00000000
[11034.133140]  ddca9f80 c1039b8b bf9ceaa8 bf9ceaa0 bf9ceaa8 bf9ceaa0 ddca9f88 ddca9fac
[11034.133140]  c1039c1e fffffde4 00000000 501d2ef1 00009088 501d2ef1 00000025 bf9ceaa8
[11034.133140] Call Trace:
[11034.133140]  [<c1039b8b>] do_sys_settimeofday+0x7b/0xe0
[11034.133140]  [<c1039c1e>] sys_settimeofday+0x2e/0x90
[11034.133140]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[11034.133140] Code: 2f 78 c1 e8 8a e6 ff ff b8 90 2f 78 c1 83 05 8c 2f 78 c1 01 e8 d9 c9 37 00 f7 45 e8 00 02 00 00 74 20 e8 db a5 00 00 ff 75 e8 9d <e8> 72 61 fe ff 8b 5d f4 31 c0 8b 75 f8 8b 7d fc 89 ec 5d c3 8d
[11034.133140] Kernel panic - not syncing: softlockup: hung tasks
[11034.133140] Pid: 3585, comm: a.out Not tainted 3.6.0-rc1-dirty #36
[11034.133140] Call Trace:
[11034.133140]  [<c13e9c5c>] panic+0x87/0x196
[11034.133140]  [<c1098281>] watchdog_timer_fn+0x171/0x180
[11034.133140]  [<c10568b8>] hrtimer_run_queues+0xb8/0x270
[11034.133140]  [<c1098110>] ? touch_softlockup_watchdog_sync+0x30/0x30
[12133.210650]  [<c1040978>] run_local_timers+0x8/0x20
[12133.210650]  [<c10409bf>] update_process_times+0x2f/0x70
[12133.210650]  [<c1075625>] tick_periodic+0x25/0x80
[12133.210650]  [<c1075699>] tick_handle_periodic+0x19/0x80
[12133.210650]  [<c1022bcf>] smp_apic_timer_interrupt+0x4f/0x90
[12133.210650]  [<c11e35a4>] ? trace_hardirqs_off_thunk+0xc/0x18
[12133.210650]  [<c13ed987>] apic_timer_interrupt+0x2f/0x34
[12133.210650]  [<c1070bf9>] ? do_settimeofday+0x109/0x130
[12133.210650]  [<c1039b8b>] do_sys_settimeofday+0x7b/0xe0
[12133.210650]  [<c1039c1e>] sys_settimeofday+0x2e/0x90
[12133.210650]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[12133.210650] ------------[ cut here ]------------
[12133.210650] WARNING: at kernel/lockdep.c:2592 trace_hardirqs_on_caller+0x15d/0x1c0()
[12133.210650] Hardware name: VMware Virtual Platform
[12133.210650] Modules linked in: ipv6 binfmt_misc
[12133.210650] Pid: 3585, comm: a.out Not tainted 3.6.0-rc1-dirty #36
[12133.210650] Call Trace:
[12133.210650]  [<c103215d>] warn_slowpath_common+0x6d/0xa0
[12133.210650]  [<c107b16d>] ? trace_hardirqs_on_caller+0x15d/0x1c0
[12133.210650]  [<c107b16d>] ? trace_hardirqs_on_caller+0x15d/0x1c0
[12133.210650]  [<c13e9d2c>] ? panic+0x157/0x196
[12133.210650]  [<c10321ad>] warn_slowpath_null+0x1d/0x20
[12133.210650]  [<c107b16d>] trace_hardirqs_on_caller+0x15d/0x1c0
[12133.210650]  [<c107b1db>] trace_hardirqs_on+0xb/0x10
[12133.210650]  [<c13e9d2c>] panic+0x157/0x196
[12133.210650]  [<c1098281>] watchdog_timer_fn+0x171/0x180
[12133.210650]  [<c10568b8>] hrtimer_run_queues+0xb8/0x270
[12133.210650]  [<c1098110>] ? touch_softlockup_watchdog_sync+0x30/0x30
[12133.210650]  [<c1040978>] run_local_timers+0x8/0x20
[12133.210650]  [<c10409bf>] update_process_times+0x2f/0x70
[12133.210650]  [<c1075625>] tick_periodic+0x25/0x80
[12133.210650]  [<c1075699>] tick_handle_periodic+0x19/0x80
[12133.210650]  [<c1022bcf>] smp_apic_timer_interrupt+0x4f/0x90
[12133.210650]  [<c11e35a4>] ? trace_hardirqs_off_thunk+0xc/0x18
[12133.210650]  [<c13ed987>] apic_timer_interrupt+0x2f/0x34
[12133.210650]  [<c1070bf9>] ? do_settimeofday+0x109/0x130
[12133.210650]  [<c1039b8b>] do_sys_settimeofday+0x7b/0xe0
[12133.210650]  [<c1039c1e>] sys_settimeofday+0x2e/0x90
[12133.210650]  [<c13eddcc>] sysenter_do_call+0x12/0x32
[12133.210650] ---[ end trace 70fa0f99035de9f7 ]---

Regards.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists