| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Date: Sat, 11 Mar 2017 16:34:53 +0800
From: kernel test robot <fengguang.wu@...el.com>
To: Chris Wilson <chris@...is-wilson.co.uk>
Cc: LKP <lkp@...org>, linux-kernel@...r.kernel.org,
"Peter Zijlstra (Intel)" <peterz@...radead.org>,
Ingo Molnar <mingo@...nel.org>, wfg@...ux.intel.com
Subject: [locking/ww_mutex] 2a0c112828: WARNING: CPU: 1 PID: 44 at
kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
commit 2a0c11282881875dc44f166a20eedf0d866dd0ef
Author: Chris Wilson <chris@...is-wilson.co.uk>
AuthorDate: Thu Dec 1 11:47:10 2016 +0000
Commit: Ingo Molnar <mingo@...nel.org>
CommitDate: Sat Jan 14 11:37:17 2017 +0100
locking/ww_mutex: Add kselftests for ww_mutex stress
Signed-off-by: Chris Wilson <chris@...is-wilson.co.uk>
Signed-off-by: Peter Zijlstra (Intel) <peterz@...radead.org>
Cc: Andrew Morton <akpm@...ux-foundation.org>
Cc: Linus Torvalds <torvalds@...ux-foundation.org>
Cc: Maarten Lankhorst <dev@...ankhorst.nl>
Cc: Nicolai Hähnle <nhaehnle@...il.com>
Cc: Paul E. McKenney <paulmck@...ux.vnet.ibm.com>
Cc: Peter Zijlstra <peterz@...radead.org>
Cc: Thomas Gleixner <tglx@...utronix.de>
Link: http://lkml.kernel.org/r/20161201114711.28697-8-chris@chris-wilson.co.uk
Signed-off-by: Ingo Molnar <mingo@...nel.org>
d1b42b800e locking/ww_mutex: Add kselftests for resolving ww_mutex cyclic deadlocks
2a0c112828 locking/ww_mutex: Add kselftests for ww_mutex stress
24c534bb16 Merge tag 'ceph-for-4.11-rc2' of git://github.com/ceph/ceph-client
5be4921c99 Add linux-next specific files for 20170310
+-----------------------------------------------------------------------+------------+------------+------------+---------------+
| | d1b42b800e | 2a0c112828 | 24c534bb16 | next-20170310 |
+-----------------------------------------------------------------------+------------+------------+------------+---------------+
| boot_successes | 49 | 0 | 2 | 0 |
| boot_failures | 9 | 20 | 18 | 18 |
| WARNING:at_kernel/locking/mutex.c:#__ww_mutex_wakeup_for_backoff | 6 | 17 | | |
| INFO:rcu_sched_self-detected_stall_on_CPU | 3 | 1 | | |
| INFO:task_blocked_for_more_than#seconds | 3 | 1 | 18 | 18 |
| Kernel_panic-not_syncing:hung_task:blocked_tasks | 3 | 1 | 18 | 18 |
| WARNING:CPU:#PID:#at_kernel/locking/mutex.c | 0 | 2 | | |
| WARNING:CPU:#PID:#at_kernel/locking/mutex.c:#__ww_mutex_wakeup_for_ba | 0 | 1 | | |
| BUG:workqueue_lockup-pool | 0 | 2 | | |
| calltrace:debug_show_all_locks | 0 | 0 | 18 | 17 |
| calltrace:stress_inorder_work | 0 | 0 | 7 | 8 |
| calltrace:stress_reorder_work | 0 | 0 | 2 | 4 |
+-----------------------------------------------------------------------+------------+------------+------------+---------------+
[ 3.800983] spin_lock-torture: lock_torture_writer task started
[ 3.801869] spin_lock-torture: Creating lock_torture_stats task
[ 3.801882] spin_lock-torture: lock_torture_writer task started
[ 3.802838] spin_lock-torture: lock_torture_stats task started
[ 4.330411] ------------[ cut here ]------------
[ 4.331126] WARNING: CPU: 1 PID: 44 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.332752] CPU: 1 PID: 44 Comm: kworker/u4:2 Not tainted 4.10.0-rc3-00155-g2a0c112 #1
[ 4.333878] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.335319] Workqueue: test-ww_mutex stress_inorder_work
[ 4.336081] Call Trace:
[ 4.336440] dump_stack+0x85/0xae
[ 4.336927] __warn+0xb3/0xce
[ 4.337357] warn_slowpath_null+0x18/0x1a
[ 4.337942] __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.338653] __ww_mutex_lock+0x50d/0x1025
[ 4.339369] ? ww_mutex_unlock+0x7a/0x82
[ 4.339934] ? stress_inorder_work+0x103/0x291
[ 4.340560] ? __mutex_unlock_slowpath+0x3e/0x2f2
[ 4.341228] ww_mutex_lock+0x45/0x49
[ 4.341748] ? ww_mutex_lock+0x45/0x49
[ 4.342285] stress_inorder_work+0x103/0x291
[ 4.342904] ? lock_acquire+0x6b/0x9a
[ 4.343427] process_one_work+0x204/0x3a1
[ 4.344002] ? process_one_work+0x1a2/0x3a1
[ 4.344595] worker_thread+0x24a/0x386
[ 4.345136] ? process_scheduled_works+0x2e/0x2e
[ 4.345800] kthread+0x121/0x129
[ 4.346264] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.346963] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.347665] ret_from_fork+0x25/0x30
[ 4.348192] ---[ end trace c1ce5e58ef1c8f5f ]---
[ 4.348866] ------------[ cut here ]------------
[ 4.348866] ------------[ cut here ]------------
[ 4.349527] WARNING: CPU: 1 PID: 44 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.351142] CPU: 1 PID: 44 Comm: kworker/u4:2 Tainted: G W 4.10.0-rc3-00155-g2a0c112 #1
[ 4.352427] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.353861] Workqueue: test-ww_mutex stress_inorder_work
[ 4.354612] Call Trace:
[ 4.354979] dump_stack+0x85/0xae
[ 4.355464] __warn+0xb3/0xce
[ 4.355902] warn_slowpath_null+0x18/0x1a
[ 4.356476] __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.357188] __ww_mutex_lock+0x50d/0x1025
[ 4.357916] ? ww_mutex_unlock+0x7a/0x82
[ 4.358477] ? stress_inorder_work+0x103/0x291
[ 4.359114] ? __mutex_unlock_slowpath+0x3e/0x2f2
[ 4.359790] ww_mutex_lock+0x45/0x49
[ 4.360302] ? ww_mutex_lock+0x45/0x49
[ 4.360846] stress_inorder_work+0x103/0x291
[ 4.361455] ? lock_acquire+0x6b/0x9a
[ 4.361986] process_one_work+0x204/0x3a1
[ 4.362561] ? process_one_work+0x1a2/0x3a1
[ 4.363164] worker_thread+0x24a/0x386
[ 4.363706] ? process_scheduled_works+0x2e/0x2e
[ 4.364359] kthread+0x121/0x129
[ 4.364830] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.365521] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.366209] ret_from_fork+0x25/0x30
[ 4.366721] ---[ end trace c1ce5e58ef1c8f60 ]---
[ 4.370392] ------------[ cut here ]------------
[ 4.370392] ------------[ cut here ]------------
[ 4.371067] WARNING: CPU: 1 PID: 44 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.372670] CPU: 1 PID: 44 Comm: kworker/u4:2 Tainted: G W 4.10.0-rc3-00155-g2a0c112 #1
[ 4.373939] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.375349] Workqueue: test-ww_mutex stress_inorder_work
[ 4.376100] Call Trace:
[ 4.376454] dump_stack+0x85/0xae
[ 4.376932] __warn+0xb3/0xce
[ 4.377355] warn_slowpath_null+0x18/0x1a
[ 4.377933] __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.378639] __ww_mutex_lock+0x50d/0x1025
[ 4.379347] ? stress_inorder_work+0x103/0x291
[ 4.379979] ? wake_up_q+0x32/0x4f
[ 4.380461] ? __mutex_unlock_slowpath+0x2e3/0x2f2
[ 4.381140] ww_mutex_lock+0x45/0x49
[ 4.381655] ? ww_mutex_lock+0x45/0x49
[ 4.382185] stress_inorder_work+0x103/0x291
[ 4.382794] ? lock_acquire+0x6b/0x9a
[ 4.383312] process_one_work+0x204/0x3a1
[ 4.383881] ? process_one_work+0x1a2/0x3a1
[ 4.384468] worker_thread+0x24a/0x386
[ 4.385004] ? process_scheduled_works+0x2e/0x2e
[ 4.385656] kthread+0x121/0x129
[ 4.386117] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.386807] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.387491] ret_from_fork+0x25/0x30
[ 4.388002] ---[ end trace c1ce5e58ef1c8f61 ]---
[ 4.388675] ------------[ cut here ]------------
[ 4.388675] ------------[ cut here ]------------
[ 4.389330] WARNING: CPU: 1 PID: 44 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.390923] CPU: 1 PID: 44 Comm: kworker/u4:2 Tainted: G W 4.10.0-rc3-00155-g2a0c112 #1
[ 4.392190] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.393595] Workqueue: test-ww_mutex stress_inorder_work
[ 4.394346] Call Trace:
[ 4.394709] dump_stack+0x85/0xae
[ 4.395179] __warn+0xb3/0xce
[ 4.395606] warn_slowpath_null+0x18/0x1a
[ 4.396171] __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.396874] __ww_mutex_lock+0x6bf/0x1025
[ 4.397588] ? stress_inorder_work+0x103/0x291
[ 4.398223] ? wake_up_q+0x32/0x4f
[ 4.398714] ? __mutex_unlock_slowpath+0x2e3/0x2f2
[ 4.399386] ww_mutex_lock+0x45/0x49
[ 4.399900] ? ww_mutex_lock+0x45/0x49
[ 4.400427] stress_inorder_work+0x103/0x291
[ 4.401034] ? lock_acquire+0x6b/0x9a
[ 4.401551] process_one_work+0x204/0x3a1
[ 4.402122] ? process_one_work+0x1a2/0x3a1
[ 4.402728] worker_thread+0x24a/0x386
[ 4.403259] ? process_scheduled_works+0x2e/0x2e
[ 4.403916] kthread+0x121/0x129
[ 4.404376] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.405068] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.405761] ret_from_fork+0x25/0x30
[ 4.406268] ---[ end trace c1ce5e58ef1c8f62 ]---
[ 4.413455] ------------[ cut here ]------------
[ 4.413455] ------------[ cut here ]------------
[ 4.414263] WARNING: CPU: 0 PID: 43 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.416193] CPU: 0 PID: 43 Comm: kworker/u4:1 Tainted: G W 4.10.0-rc3-00155-g2a0c112 #1
[ 4.417707] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.419417] Workqueue: test-ww_mutex stress_inorder_work
[ 4.420320] Call Trace:
[ 4.420782] dump_stack+0x85/0xae
[ 4.421360] __warn+0xb3/0xce
[ 4.421862] warn_slowpath_null+0x18/0x1a
[ 4.422546] __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.423397] __ww_mutex_lock+0x50d/0x1025
[ 4.424228] ? ww_mutex_unlock+0x7a/0x82
[ 4.424908] ? stress_inorder_work+0x103/0x291
[ 4.425671] ? __mutex_unlock_slowpath+0x3e/0x2f2
[ 4.426441] ww_mutex_lock+0x45/0x49
[ 4.427070] ? ww_mutex_lock+0x45/0x49
[ 4.427725] stress_inorder_work+0x103/0x291
[ 4.428449] ? lock_acquire+0x6b/0x9a
[ 4.429067] process_one_work+0x204/0x3a1
[ 4.429721] ? process_one_work+0x1a2/0x3a1
[ 4.430178] worker_thread+0x24a/0x386
[ 4.430564] ? process_scheduled_works+0x2e/0x2e
[ 4.431040] kthread+0x121/0x129
[ 4.431555] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.432516] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.433320] ret_from_fork+0x25/0x30
[ 4.433822] ---[ end trace c1ce5e58ef1c8f63 ]---
[ 4.450368] ------------[ cut here ]------------
[ 4.450368] ------------[ cut here ]------------
[ 4.451122] WARNING: CPU: 1 PID: 44 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.453135] CPU: 1 PID: 44 Comm: kworker/u4:2 Tainted: G W 4.10.0-rc3-00155-g2a0c112 #1
[ 4.454070] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.455130] Workqueue: test-ww_mutex stress_inorder_work
[ 4.455679] Call Trace:
[ 4.455935] dump_stack+0x85/0xae
[ 4.456275] __warn+0xb3/0xce
[ 4.456720] warn_slowpath_null+0x18/0x1a
[ 4.457416] __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.457993] __ww_mutex_lock+0x50d/0x1025
[ 4.458680] ? stress_inorder_work+0x103/0x291
[ 4.459141] ? wake_up_q+0x32/0x4f
[ 4.459488] ? __mutex_unlock_slowpath+0x2e3/0x2f2
[ 4.460015] ww_mutex_lock+0x45/0x49
[ 4.460391] ? ww_mutex_lock+0x45/0x49
[ 4.460783] stress_inorder_work+0x103/0x291
[ 4.461427] ? lock_acquire+0x6b/0x9a
[ 4.461839] process_one_work+0x204/0x3a1
[ 4.462544] ? process_one_work+0x1a2/0x3a1
[ 4.463179] worker_thread+0x24a/0x386
[ 4.463569] ? process_scheduled_works+0x2e/0x2e
[ 4.464040] kthread+0x121/0x129
[ 4.464372] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.464873] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.465591] ret_from_fork+0x25/0x30
[ 4.466242] ---[ end trace c1ce5e58ef1c8f64 ]---
[ 4.473420] ------------[ cut here ]------------
[ 4.473420] ------------[ cut here ]------------
[ 4.473934] WARNING: CPU: 0 PID: 43 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.475458] CPU: 0 PID: 43 Comm: kworker/u4:1 Tainted: G W 4.10.0-rc3-00155-g2a0c112 #1
[ 4.476458] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.478007] Workqueue: test-ww_mutex stress_inorder_work
[ 4.478783] Call Trace:
[ 4.479046] dump_stack+0x85/0xae
[ 4.479422] __warn+0xb3/0xce
[ 4.479763] warn_slowpath_null+0x18/0x1a
[ 4.480180] __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.480731] __ww_mutex_lock+0x50d/0x1025
[ 4.481297] ? ww_mutex_unlock+0x7a/0x82
[ 4.481732] ? stress_inorder_work+0x103/0x291
[ 4.482303] ? __mutex_unlock_slowpath+0x3e/0x2f2
[ 4.483042] ww_mutex_lock+0x45/0x49
[ 4.483417] ? ww_mutex_lock+0x45/0x49
[ 4.483858] stress_inorder_work+0x103/0x291
[ 4.484596] ? lock_acquire+0x6b/0x9a
[ 4.485270] process_one_work+0x204/0x3a1
[ 4.486037] ? process_one_work+0x1a2/0x3a1
[ 4.486744] worker_thread+0x24a/0x386
[ 4.487381] ? process_scheduled_works+0x2e/0x2e
[ 4.488166] kthread+0x121/0x129
[ 4.488720] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.489560] ? __kthread_create_on_node+0x1b8/0x1b8
[ 4.490373] ret_from_fork+0x25/0x30
[ 4.490983] ---[ end trace c1ce5e58ef1c8f65 ]---
[ 4.500338] ------------[ cut here ]------------
[ 4.500338] ------------[ cut here ]------------
[ 4.501153] WARNING: CPU: 1 PID: 44 at kernel/locking/mutex.c:305 __ww_mutex_wakeup_for_backoff+0x39/0x8e
[ 4.503077] CPU: 1 PID: 44 Comm: kworker/u4:2 Tainted: G W 4.10.0-rc3-00155-g2a0c112 #1
[ 4.504609] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.9.3-20161025_171302-gandalf 04/01/2014
[ 4.506305] Workqueue: test-ww_mutex stress_inorder_work
[ 4.507204] Call Trace:
[ 4.507638] dump_stack+0x85/0xae
[ 4.508204] __warn+0xb3/0xce
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start c1ae3cfa0e89fa1a7ecc4c99031f5e9ae99d9201 v4.10 --
git bisect bad af8999f672421776417977101c3e1f334414c065 # 12:16 B 1 1 1 1 Merge tag 'armsoc-fixes-nc' of git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc
git bisect bad b8989bccd6a0ad49db4795afca56a733e1c19099 # 12:32 B 0 1 11 0 Merge branch 'stable-4.11' of git://git.infradead.org/users/pcmoore/audit
git bisect bad c945d0227d86ddc3485290fa5da1a7d2c9b759de # 12:53 B 0 6 16 0 Merge branch 'x86-platform-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 60c906bab124a0627fba04c9ca5e61bba4747c0c # 13:04 G 18 0 0 0 Merge branch 'ras-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 292d38674301c6fbee3965e446bd1c8a6672a400 # 13:27 B 0 1 11 0 Merge branch 'x86-boot-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 42e1b14b6e1455ece2ccbe474c25388d0230a590 # 13:45 B 0 4 14 0 Merge branch 'locking-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 828cad8ea05d194d8a9452e0793261c2024c23a2 # 14:08 G 17 0 2 2 Merge branch 'sched-core-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good f2a5fec17395f259d54daa8833d81b00cceb15c3 # 14:23 G 18 0 1 1 locking/ww_mutex: Begin kselftests for ww_mutex
git bisect bad 85b36c931ff328297572a3e6136fac573795ad79 # 14:42 B 0 15 25 0 jump_labels: Move header guard #endif down where it belongs
git bisect bad 1e24edca0557dba6486d39d3c24c288475432bcf # 14:56 B 0 4 14 0 locking/atomic, kref: Add KREF_INIT()
git bisect good d1b42b800e5d09dcee52812b4396aca3a3696ba9 # 15:12 G 17 0 3 3 locking/ww_mutex: Add kselftests for resolving ww_mutex cyclic deadlocks
git bisect bad 2b0b211134a65401ed874ce0d5d48844f4f6f341 # 15:22 B 0 8 18 0 locking/ww_mutex: Add ww_mutex to tools/testing/selftests
git bisect bad 2a0c11282881875dc44f166a20eedf0d866dd0ef # 15:31 B 0 4 15 1 locking/ww_mutex: Add kselftests for ww_mutex stress
# first bad commit: [2a0c11282881875dc44f166a20eedf0d866dd0ef] locking/ww_mutex: Add kselftests for ww_mutex stress
git bisect good d1b42b800e5d09dcee52812b4396aca3a3696ba9 # 15:37 G 54 0 5 9 locking/ww_mutex: Add kselftests for resolving ww_mutex cyclic deadlocks
# extra tests with CONFIG_DEBUG_INFO_REDUCED
git bisect bad 2a0c11282881875dc44f166a20eedf0d866dd0ef # 15:50 B 0 5 15 0 locking/ww_mutex: Add kselftests for ww_mutex stress
# extra tests on HEAD of linux-devel/devel-catchup-201703100151
git bisect bad b6d4603bfdc9c6ba2ef56c0c13349e09c0b5ad53 # 15:50 B 0 6 27 8 0day head guard for 'devel-catchup-201703100151'
# extra tests on tree/branch linus/master
git bisect bad 24c534bb161b8c95f261b34cbe44bbd043e829fc # 16:07 B 3 1 3 3 Merge tag 'ceph-for-4.11-rc2' of git://github.com/ceph/ceph-client
# extra tests on tree/branch linux-next/master
git bisect bad 5be4921c9958ec02a67506bd6f7a52fce663c201 # 16:29 B 2 1 2 2 Add linux-next specific files for 20170310
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
Download attachment "dmesg-quantal-ivb41-55:20170311153101:x86_64-randconfig-s1-03100132:4.10.0-rc3-00155-g2a0c112:1.gz" of type "application/gzip" (147514 bytes)
Download attachment "dmesg-quantal-ivb41-103:20170311153527:x86_64-randconfig-s1-03100132:4.10.0-rc3-00154-gd1b42b8:1.gz" of type "application/gzip" (21075 bytes)
View attachment "reproduce-quantal-ivb41-55:20170311153101:x86_64-randconfig-s1-03100132:4.10.0-rc3-00155-g2a0c112:1" of type "text/plain" (888 bytes)
View attachment "config-4.10.0-rc3-00155-g2a0c112" of type "text/plain" (107447 bytes)
Powered by blists - more mailing lists