linux-kernel - [PATCH v2 2/2] tracepoint: Prevent false-positive lockdep warnings

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]

Date:   Thu, 15 Mar 2018 13:44:01 -0700
From:   Joel Fernandes <joelaf@...gle.com>
To:     linux-kernel@...r.kernel.org
Cc:     Joel Fernandes <joelaf@...gle.com>,
        Steven Rostedt <rostedt@...dmis.org>,
        Peter Zilstra <peterz@...radead.org>,
        Ingo Molnar <mingo@...hat.com>,
        Mathieu Desnoyers <mathieu.desnoyers@...icios.com>,
        Tom Zanussi <tom.zanussi@...ux.intel.com>,
        Namhyung Kim <namhyung@...nel.org>, kernel-team@...roid.com
Subject: [PATCH v2 2/2] tracepoint: Prevent false-positive lockdep warnings

Since the last patch, lockdep hooks for irqs on/off will use the
tracepoint infrastructure. This can however cause false lockdep
warnings triggered by RCU code that does lockdep asserts.

There are 2 cases:
1) trace_hardirqs_off calls the lockdep_hardirqs_off hook, however
this call happens only after rcu_irq_enter_irqsoff. Due to this,
the lockdep assert that happens in the RCU path will think that
IRQs are kept on and will print a warning.

[    0.001000] ------------[ cut here ]------------
[    0.001000] IRQs not disabled as expected
[    0.001000] WARNING: CPU: 0 PID: 0 at kernel/rcu/tree.c:1039
				rcu_irq_enter+0x56/0x5d
[    0.001000] Call Trace:
[    0.001000]  rcu_irq_enter_irqson+0x21/0x47
[    0.001000]  trace_hardirqs_off+0x53/0xcc
[    0.001000]  __down_trylock_console_sem+0x27/0x9d
[    0.001000]  console_trylock+0x10/0x50
[    0.001000]  vprintk_emit+0x2a8/0x400
[    0.001000]  printk+0x43/0x4b
[    0.001000]  lockdep_init+0x38/0xe3
[    0.001000]  start_kernel+0x326/0x446
[    0.001000]  secondary_startup_64+0xa5/0xb0

2) trace_hardirqs_on calls the lockdep_hardirqs_on hook, however
interrupts are enabled only after trace_hardirqs_on. In the meanwhile
lockdep falsely sets its state to hardirqs are enabled. For this reason,
rcu_irq_enter_irqson prints the following false warning claiming IRQs
are not disabled:

[    0.001000] ------------[ cut here ]------------
[    0.001000] IRQs not disabled as expected
[    0.001000] WARNING: CPU: 0 PID: 0 at kernel/rcu/tree.c:886
rcu_irq_exit+0x56/0x5d
[    0.001000] Call Trace:
[    0.001000]  rcu_irq_exit_irqson+0x21/0x47
[    0.001000]  trace_hardirqs_on+0xb9/0xd7
[    0.001000]  vprintk_emit+0x287/0x400
[    0.001000]  printk+0x43/0x4b
[    0.001000]  lockdep_init+0x38/0xe3
[    0.001000]  start_kernel+0x326/0x446
[    0.001000]  secondary_startup_64+0xa5/0xb0

To fix it, just disable lockdep checks before and enable it after
rcu_irq_exit_irqson.

Cc: Steven Rostedt <rostedt@...dmis.org>
Cc: Peter Zilstra <peterz@...radead.org>
Cc: Ingo Molnar <mingo@...hat.com>
Cc: Mathieu Desnoyers <mathieu.desnoyers@...icios.com>
Cc: Tom Zanussi <tom.zanussi@...ux.intel.com>
Cc: Namhyung Kim <namhyung@...nel.org>
Cc: kernel-team@...roid.com
Signed-off-by: Joel Fernandes <joelaf@...gle.com>
---
 include/linux/tracepoint.h | 23 +++++++++++++++++++++--
 1 file changed, 21 insertions(+), 2 deletions(-)

diff --git a/include/linux/tracepoint.h b/include/linux/tracepoint.h
index c94f466d57ef..81eac3562787 100644
--- a/include/linux/tracepoint.h
+++ b/include/linux/tracepoint.h
@@ -137,8 +137,17 @@ extern void syscall_unregfunc(void);
 									\
 		if (!(cond))						\
 			return;						\
-		if (rcucheck)						\
+									\
+		/*							\
+		 * lockdep hook for irqsoff may run only after		\
+		 * rcu_irq_enter_irqson so in the meanwhile don't do	\
+		 * lockdep checks to prevent false lockdep warnings	\
+		 */							\
+		if (rcucheck) {						\
+			lockdep_off();					\
 			rcu_irq_enter_irqson();				\
+			lockdep_on();					\
+		}							\
 		rcu_read_lock_sched_notrace();				\
 		it_func_ptr = rcu_dereference_sched((tp)->funcs);	\
 		if (it_func_ptr) {					\
@@ -149,8 +158,18 @@ extern void syscall_unregfunc(void);
 			} while ((++it_func_ptr)->func);		\
 		}							\
 		rcu_read_unlock_sched_notrace();			\
-		if (rcucheck)						\
+									\
+		/*							\
+		 * Turn off lockdep before calling rcu_irq_exit_irqson  \
+		 * since the lockdep irqson hook may have just run	\
+		 * but irqs are only after trace_hardirqs_off returns.  \
+		 * This can cause false lockdep warnings.		\
+		 */							\
+		if (rcucheck) {						\
+			lockdep_off();					\
 			rcu_irq_exit_irqson();				\
+			lockdep_on();					\
+		}							\
 	} while (0)
 
 #ifndef MODULE
-- 
2.16.2.804.g6dcf76e118-goog