lists.openwall.net   lists  /  announce  owl-users  owl-dev  john-users  john-dev  passwdqc-users  yescrypt  popa3d-users  /  oss-security  kernel-hardening  musl  sabotage  tlsify  passwords  /  crypt-dev  xvendor  /  Bugtraq  Full-Disclosure  linux-kernel  linux-netdev  linux-ext4  linux-hardening  linux-cve-announce  PHC 
Open Source and information security mailing list archives
 
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [day] [month] [year] [list]
Message-ID: <2282318.Znj0vdeLmO@pawels>
Date:	Tue, 30 Aug 2011 11:17:07 +0200
From:	Pawel Sikora <pluto@...k.net>
To:	linux-kernel@...r.kernel.org
Cc:	arekm@...-linux.org, gregkh@...e.de
Subject: [3.0.2-stable] BUG: soft lockup - CPU#13 stuck for 22s! [kswapd2:1092]

Hi,

during copying (cp -ar) ~100GB files from ext2(md1/raid0) to ext4(md2/raid0)
i've noticed a problem in kernel log:

(...)
[ 5721.376582] BUG: soft lockup - CPU#13 stuck for 22s! [kswapd2:1092]
[ 5721.376586] Modules linked in: ext4 jbd2 crc16 nfs fscache binfmt_misc nfsd lockd exportfs nfs_acl auth_rpcgss sunrpc ipmi_si ipmi_devintf ipmi_msghandler sch_sfq iptable_nat 
nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_filter xt_TCPMSS xt_tcpudp iptable_mangle ip_tables ip6table_filter ip6_tables x_tables ext2 raid0 dm_mod autofs4 
dummy usbhid hid ide_cd_mod cdrom ata_generic pata_acpi pata_atiixp sp5100_tco ide_pci_generic ohci_hcd ssb pcmcia igb i2c_piix4 ghes pcmcia_core i2c_core atiixp k10temp 
ehci_hcd hwmon button hed processor ide_core sg usbcore dca mmc_core amd64_edac_mod edac_core pcspkr edac_mce_amd evdev sd_mod crc_t10dif raid1 md_mod ext3 jbd mbcache ahci 
libahci libata scsi_mod [last unloaded: scsi_wait_scan]
[ 5721.376644] CPU 13 
[ 5721.376646] Modules linked in: ext4 jbd2 crc16 nfs fscache binfmt_misc nfsd lockd exportfs nfs_acl auth_rpcgss sunrpc ipmi_si ipmi_devintf ipmi_msghandler sch_sfq iptable_nat 
nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_filter xt_TCPMSS xt_tcpudp iptable_mangle ip_tables ip6table_filter ip6_tables x_tables ext2 raid0 dm_mod autofs4 
dummy usbhid hid ide_cd_mod cdrom ata_generic pata_acpi pata_atiixp sp5100_tco ide_pci_generic ohci_hcd ssb pcmcia igb i2c_piix4 ghes pcmcia_core i2c_core atiixp k10temp 
ehci_hcd hwmon button hed processor ide_core sg usbcore dca mmc_core amd64_edac_mod edac_core pcspkr edac_mce_amd evdev sd_mod crc_t10dif raid1 md_mod ext3 jbd mbcache ahci 
libahci libata scsi_mod [last unloaded: scsi_wait_scan]
[ 5721.376685] 
[ 5721.376688] Pid: 1092, comm: kswapd2 Not tainted 3.0.2 #4 Supermicro H8DGU/H8DGU
[ 5721.376692] RIP: 0010:[<ffffffff810ded2e>]  [<ffffffff810ded2e>] find_get_pages+0x4e/0x130
[ 5721.376702] RSP: 0018:ffff8804074fdb30  EFLAGS: 00000246
[ 5721.376705] RAX: ffff8800645ada78 RBX: 0000000000000000 RCX: 0000000000000000
[ 5721.376707] RDX: ffff8804074fdbd0 RSI: 000000000000000e RDI: ffffea000db458f8
[ 5721.376709] RBP: ffff8804074fdb80 R08: 0000000000000000 R09: 0000000000000000
[ 5721.376711] R10: ffffea000db45900 R11: ffff880353cc5178 R12: ffffffff8142194e
[ 5721.376713] R13: ffff880322e92420 R14: 000000000000000e R15: ffffffff811626dc
[ 5721.376716] FS:  00007f9576703700(0000) GS:ffff880c1fc40000(0000) knlGS:00000000ee14bb70
[ 5721.376718] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 5721.376721] CR2: 00007f9576839000 CR3: 0000000001803000 CR4: 00000000000006e0
[ 5721.376723] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 5721.376725] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 5721.376727] Process kswapd2 (pid: 1092, threadinfo ffff8804074fc000, task ffff880407ae2a00)
[ 5721.376729] Stack:
[ 5721.376825]  ffff880c1fc4d8e0 0000000000000005 ffff8803b9175a68 ffffea000db45888
[ 5721.376833]  ffff8804074fdb80 ffff8804074fdbc0 000000000000010c ffffffffffffffff
[ 5721.376837]  ffff8803b9175a68 ffffea000db45888 ffff8804074fdba0 ffffffff810e7aed
[ 5721.376841] Call Trace:
[ 5721.376935]  [<ffffffff810e7aed>] pagevec_lookup+0x1d/0x30
[ 5721.376939]  [<ffffffff810e9abf>] invalidate_mapping_pages+0x5f/0x180
[ 5721.376945]  [<ffffffff81150185>] shrink_icache_memory+0x2d5/0x320
[ 5721.376950]  [<ffffffff810ec97d>] shrink_slab+0x11d/0x190
[ 5721.376954]  [<ffffffff810f00fa>] balance_pgdat+0x51a/0x6e0
[ 5721.376958]  [<ffffffff810f03c2>] kswapd+0x102/0x3e0
[ 5721.376963]  [<ffffffff81068610>] ? abort_exclusive_wait+0xb0/0xb0
[ 5721.376966]  [<ffffffff810f02c0>] ? balance_pgdat+0x6e0/0x6e0
[ 5721.376970]  [<ffffffff81067d87>] kthread+0x87/0x90
[ 5721.376976]  [<ffffffff81422094>] kernel_thread_helper+0x4/0x10
[ 5721.376979]  [<ffffffff81067d00>] ? kthread_worker_fn+0x190/0x190
[ 5721.376983]  [<ffffffff81422090>] ? gs_change+0xb/0xb
[ 5721.376985] Code: f1 4c 89 e2 4c 89 ef e8 a1 fe 13 00 85 c0 89 c6 0f 84 c7 00 00 00 48 89 da 31 c9 45 31 ff 0f 1f 80 00 00 00 00 48 8b 02 48 8b 38 
[ 5721.379415]  85 ff 74 3e 40 f6 c7 01 75 5f 44 8b 47 08 45 85 c0 74 ec 45 
[ 5721.379432] Call Trace:
[ 5721.379432]  [<ffffffff810e7aed>] pagevec_lookup+0x1d/0x30
[ 5721.379432]  [<ffffffff810e9abf>] invalidate_mapping_pages+0x5f/0x180
[ 5721.379432]  [<ffffffff81150185>] shrink_icache_memory+0x2d5/0x320
[ 5721.379432]  [<ffffffff810ec97d>] shrink_slab+0x11d/0x190
[ 5721.379432]  [<ffffffff810f00fa>] balance_pgdat+0x51a/0x6e0
[ 5721.379432]  [<ffffffff810f03c2>] kswapd+0x102/0x3e0
[ 5721.379432]  [<ffffffff81068610>] ? abort_exclusive_wait+0xb0/0xb0
[ 5721.379432]  [<ffffffff810f02c0>] ? balance_pgdat+0x6e0/0x6e0
[ 5721.379432]  [<ffffffff81067d87>] kthread+0x87/0x90
[ 5721.379432]  [<ffffffff81422094>] kernel_thread_helper+0x4/0x10
[ 5721.379432]  [<ffffffff81067d00>] ? kthread_worker_fn+0x190/0x190
[ 5721.379432]  [<ffffffff81422090>] ? gs_change+0xb/0xb
[ 5749.376580] BUG: soft lockup - CPU#13 stuck for 22s! [kswapd2:1092]
[ 5749.376583] Modules linked in: ext4 jbd2 crc16 nfs fscache binfmt_misc nfsd lockd exportfs nfs_acl auth_rpcgss sunrpc ipmi_si ipmi_devintf ipmi_msghandler sch_sfq iptable_nat 
nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_filter xt_TCPMSS xt_tcpudp iptable_mangle ip_tables ip6table_filter ip6_tables x_tables ext2 raid0 dm_mod autofs4 
dummy usbhid hid ide_cd_mod cdrom ata_generic pata_acpi pata_atiixp sp5100_tco ide_pci_generic ohci_hcd ssb pcmcia igb i2c_piix4 ghes pcmcia_core i2c_core atiixp k10temp 
ehci_hcd hwmon button hed processor ide_core sg usbcore dca mmc_core amd64_edac_mod edac_core pcspkr edac_mce_amd evdev sd_mod crc_t10dif raid1 md_mod ext3 jbd mbcache ahci 
libahci libata scsi_mod [last unloaded: scsi_wait_scan]
[ 5749.376627] CPU 13
[ 5749.376628] Modules linked in: ext4 jbd2 crc16 nfs fscache binfmt_misc nfsd lockd exportfs nfs_acl auth_rpcgss sunrpc ipmi_si ipmi_devintf ipmi_msghandler sch_sfq iptable_nat 
nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_filter xt_TCPMSS xt_tcpudp iptable_mangle ip_tables ip6table_filter ip6_tables x_tables ext2 raid0 dm_mod autofs4 
dummy usbhid hid ide_cd_mod cdrom ata_generic pata_acpi pata_atiixp sp5100_tco ide_pci_generic ohci_hcd ssb pcmcia igb i2c_piix4 ghes pcmcia_core i2c_core atiixp k10temp 
ehci_hcd hwmon button hed processor ide_core sg usbcore dca mmc_core amd64_edac_mod edac_core pcspkr edac_mce_amd evdev sd_mod crc_t10dif raid1 md_mod ext3 jbd mbcache ahci 
libahci libata scsi_mod [last unloaded: scsi_wait_scan]
[ 5749.376665]
[ 5749.376668] Pid: 1092, comm: kswapd2 Not tainted 3.0.2 #4 Supermicro H8DGU/H8DGU
[ 5749.376671] RIP: 0010:[<ffffffff810ded31>]  [<ffffffff810ded31>] find_get_pages+0x51/0x130
[ 5749.376678] RSP: 0018:ffff8804074fdb30  EFLAGS: 00000282
[ 5749.376680] RAX: ffff8800645ada78 RBX: 0000000000000000 RCX: 0000000000000000
[ 5749.376682] RDX: ffff8804074fdbd0 RSI: 000000000000000e RDI: ffffea000db458f8
[ 5749.376684] RBP: ffff8804074fdb80 R08: 0000000000000000 R09: 0000000000000000
[ 5749.376686] R10: ffffea000db45900 R11: ffff880353cc5178 R12: ffffffff8142194e
[ 5749.376688] R13: ffff880322e92420 R14: 000000000000000e R15: ffffffff811626dc
[ 5749.376691] FS:  00007f9576703700(0000) GS:ffff880c1fc40000(0000) knlGS:00000000ee14bb70
[ 5749.376693] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 5749.376696] CR2: 00007f9576839000 CR3: 0000000001803000 CR4: 00000000000006e0
[ 5749.376698] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 5749.376700] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 5749.376702] Process kswapd2 (pid: 1092, threadinfo ffff8804074fc000, task ffff880407ae2a00)
[ 5749.376704] Stack:
[ 5749.376800]  ffff880c1fc4d8e0 0000000000000005 ffff8803b9175a68 ffffea000db45888
[ 5749.376806]  ffff8804074fdb80 ffff8804074fdbc0 000000000000010c ffffffffffffffff
[ 5749.376811]  ffff8803b9175a68 ffffea000db45888 ffff8804074fdba0 ffffffff810e7aed
[ 5749.376815] Call Trace:
[ 5749.376915]  [<ffffffff810e7aed>] pagevec_lookup+0x1d/0x30
[ 5749.376919]  [<ffffffff810e9abf>] invalidate_mapping_pages+0x5f/0x180
[ 5749.376923]  [<ffffffff81150185>] shrink_icache_memory+0x2d5/0x320
[ 5749.376927]  [<ffffffff810ec97d>] shrink_slab+0x11d/0x190
[ 5749.376931]  [<ffffffff810f00fa>] balance_pgdat+0x51a/0x6e0
[ 5749.376935]  [<ffffffff810f03c2>] kswapd+0x102/0x3e0
[ 5749.376939]  [<ffffffff81068610>] ? abort_exclusive_wait+0xb0/0xb0
[ 5749.376942]  [<ffffffff810f02c0>] ? balance_pgdat+0x6e0/0x6e0
[ 5749.376945]  [<ffffffff81067d87>] kthread+0x87/0x90
[ 5749.376950]  [<ffffffff81422094>] kernel_thread_helper+0x4/0x10
[ 5749.376953]  [<ffffffff81067d00>] ? kthread_worker_fn+0x190/0x190
[ 5749.376957]  [<ffffffff81422090>] ? gs_change+0xb/0xb
[ 5749.376958] Code: e2 4c 89 ef e8 a1 fe 13 00 85 c0 89 c6 0f 84 c7 00 00 00 48 89 da 31 c9 45 31 ff 0f 1f 80 00 00 00 00 48 8b 02 48 8b 38 48 85 ff
[ 5749.379426]  3e 40 f6 c7 01 75 5f 44 8b 47 08 45 85 c0 74 ec 45 8d 48 01
[ 5749.379426] Call Trace:
[ 5749.379426]  [<ffffffff810e7aed>] pagevec_lookup+0x1d/0x30
[ 5749.379426]  [<ffffffff810e9abf>] invalidate_mapping_pages+0x5f/0x180
[ 5749.379426]  [<ffffffff81150185>] shrink_icache_memory+0x2d5/0x320
[ 5749.379426]  [<ffffffff810ec97d>] shrink_slab+0x11d/0x190
[ 5749.379426]  [<ffffffff810f00fa>] balance_pgdat+0x51a/0x6e0
[ 5749.379426]  [<ffffffff810f03c2>] kswapd+0x102/0x3e0
[ 5749.379426]  [<ffffffff81068610>] ? abort_exclusive_wait+0xb0/0xb0
[ 5749.379426]  [<ffffffff810f02c0>] ? balance_pgdat+0x6e0/0x6e0
[ 5749.379426]  [<ffffffff81067d87>] kthread+0x87/0x90
[ 5749.379426]  [<ffffffff81422094>] kernel_thread_helper+0x4/0x10
[ 5749.379426]  [<ffffffff81067d00>] ? kthread_worker_fn+0x190/0x190
[ 5749.379426]  [<ffffffff81422090>] ? gs_change+0xb/0xb

machine desc: 2x opteron 6128, 64GB ecc ram, 4x sata 500GB.

BR,
Paweł.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Powered by blists - more mailing lists

Powered by Openwall GNU/*/Linux Powered by OpenVZ