linux-kernel - sym53c8xx kernel panic in Qemu VMs with Ceph/RBD

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [day] [month] [year] [list]

Message-ID: <20150107205525.GC14792@schottelius.org>
Date:	Wed, 7 Jan 2015 21:55:25 +0100
From:	Nico Schottelius <nico-kernel-20150107@...ottelius.org>
To:	LKML <linux-kernel@...r.kernel.org>
Cc:	Nico Schottelius <nico-kernel-20150107@...ottelius.org>
Subject: sym53c8xx kernel panic in Qemu VMs with Ceph/RBD

Hello LKML,

for some time we experience kernel panics in VMs running 
on Qemu with RBD devices in the sym53c8xx driver (see attachements).

We see at least the following kernels affected:

    3.2.0-4-amd64 (Debian stable)
    3.16.0-4-amd64 (Debian Jessie)
    3.16.0-0.bpo.4-amd64 (Debian backports)

We experience this problem mostly when having high i/o in the VM
and/or load due to rebalancing data.

I was wondering if this can be fixed in the kernel or if it needs to be
addressed differently by changing qemu/ceph parameters.

Our qemu parameters (coming from opennebula) are

    qemu-system-x86_64 -enable-kvm -name one-204 -S -machine pc-i440fx-trusty,accel=kvm,usb=off -m 512 -realtime mlock=off -smp 2,sockets=2,cores=1,threads=1 -uuid d7c3374e-349e-4db6-8f54-f3c607f93101 -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/one-204.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device lsi,id=scsi0,bus=pci.0,addr=0x4 -drive file=rbd:one/one-53-204-0:id=libvirt:key=...:auth_supported=cephx\;none:mon_host=kaffee.private.ungleich.ch\;wein.private.ungleich.ch\;tee.private.ungleich.ch,if=none,id=drive-scsi0-0-0,format=raw,cache=none -device scsi-hd,bus=scsi0.0,scsi-id=0,drive=drive-scsi0-0-0,id=scsi0-0-0,bootindex=1 -drive file=/var/lib/one//datastores/0/204/disk.1,if=none,id=drive-ide0-0-0,readonly=on,format=raw -device ide-cd,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0 -netdev tap,fd=24,id=hostnet0 -device rtl8139,netdev=hostnet0,id=net0,mac=02:00:4d:6d:96:ae,bus=pci.0,addr=0x3 -vnc 0.0.0.0:204 -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5

where

    -device lsi,id=scsi0,bus=pci.0,addr=0x4

is probably the relevant parameter.

Cheers,

Nico

-- 
New PGP key: 659B 0D91 E86E 7E24 FD15  69D0 C729 21A1 293F 2D24

Download attachment "ceph-debian-crash-20141227.png" of type "image/png" (110632 bytes)

Download attachment "ceph-kernel-panic-20150106.png" of type "image/png" (129961 bytes)

Download attachment "ceph-redmine-20141227.png" of type "image/png" (115036 bytes)