lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Date:	Sat, 9 Feb 2013 18:10:29 +0400
From:	Alexey Vlasov <renton@...ton.name>
To:	linux-kernel@...r.kernel.org
Subject: BUG: soft lockup on all kernels after 2.6.3x

Hello.

I used 2.6.2x kernel for a long time on my shared hosting and I didn't
have any problems. Kernels worked well and server uptime was about 2-3
years.

But investigating some strange hangings of my clients' sites I came to
this:
http://bugs.mysql.com/bug.php?id=50399
from this bug it is clear that on kernels younger than 2.6.32 (
unfortunately I can't remember if it is true with 2.6.30-31) happens
mysql client hanging.

It is not clear whether it is a bug of kernel or libc or mysql-client, I
didn't manage to find it out. I decided to do simpler (as it seemed to
me at that moment) to start using 2.6.3x kernels. And that caused
greater problems. By trying to use new kernels on my working servers
with peak load I got an uptime from an hour to 1-3 months.

I even got some statistics for how long can every kernel from version
2.6.32 work in peak load situations. It sounds funny but my clients are
not happy with all these reboots.

>From all the variety of servers from 2.6.32 to 3.7.4 I can say that
2.6.35 is the most stabil, I got about 30 servers on it. But they hang
usually once in 1-3 months.

Returning to the problem of kernels >= 2.6.32, as I have noticed they
hang totally alike, giving the console:

...
Feb  8 10:27:45 10.2.0.7 [470393.417168] BUG: soft lockup - CPU#2 stuck for 61s! [vsftpd:29013]
...
[see the attachment]

it doesn't happen on an empty server, only on loaded ones. Unfortunately
I don't know how to provoke such hanging artificially.

I' ve given a trace attached. In fact I don't know what to do with all
these bugs, I can't use 2.6.2x because of MySQL hanging and = >2.6.3
start hanging themselves.

-- 
BRGDS. Alexey Vlasov.

Download attachment "bug_spinlock.txt.gz" of type "application/octet-stream" (247926 bytes)

Powered by blists - more mailing lists