Message-Id: <5FF6AF4E-EB99-4111-BBB2-FE09FFBEF5C4@lca.pw>
Date:   Fri, 20 Mar 2020 09:49:03 -0400
From:   Qian Cai <cai@....pw>
To:     Sean Christopherson <sean.j.christopherson@...el.com>
Cc:     Paolo Bonzini <pbonzini@...hat.com>, kvm@...r.kernel.org,
        LKML <linux-kernel@...r.kernel.org>,
        Peter Xu <peterx@...hat.com>, Marc Zyngier <maz@...nel.org>,
        Christoffer Dall <christoffer.dall@....com>
Subject: Re: slab-out-of-bounds due to "KVM: Dynamically size memslot array
 based on number of used slots"



> On Mar 20, 2020, at 12:34 AM, Sean Christopherson <sean.j.christopherson@...el.com> wrote:
> 
> On Thu, Mar 19, 2020 at 11:59:23PM -0400, Qian Cai wrote:
>> Reverted the linux-next commit 36947254e5f98 (“KVM: Dynamically size memslot array based on number of used slots”)
>> fixed illegal slab object redzone accesses.
>> 
>> [6727.939776][ T1818] BUG: KASAN: slab-out-of-bounds in gfn_to_hva+0xc1/0x2b0 [kvm]
>> search_memslots at include/linux/kvm_host.h:1035
> 
> Drat.  I'm guessing lru_slot is out of range after a memslot is deleted.
> This should fix the issue, though it may not be the most proper fix, e.g.
> it might be better to reset lru_slot when deleting a memslot.  I'll try and
> reproduce tomorrow, unless you can confirm this does the trick.

It works fine.

> 
> diff --git a/include/linux/kvm_host.h b/include/linux/kvm_host.h
> index e9a7d3476a12..b8f5d3b2fe5c 100644
> --- a/include/linux/kvm_host.h
> +++ b/include/linux/kvm_host.h
> @@ -1021,6 +1021,12 @@ search_memslots(struct kvm_memslots *slots, gfn_t gfn)
>        int slot = atomic_read(&slots->lru_slot);
>        struct kvm_memory_slot *memslots = slots->memslots;
> 
> +       if (!slots->used_slots)
> +               return NULL;
> +
> +       if (slot >= slots->used_slots)
> +               slot = 0;
> +
>        if (gfn >= memslots[slot].base_gfn &&
>            gfn < memslots[slot].base_gfn + memslots[slot].npages)
>                return &memslots[slot];
> 
> 
> 
>> (inlined by) __gfn_to_memslot at include/linux/kvm_host.h:1060
>> (inlined by) gfn_to_memslot at virt/kvm/kvm_main.c:1594
>> (inlined by) gfn_to_hva at virt/kvm/kvm_main.c:1674
>> [ 6727.975376][ T1818] Read of size 8 at addr ffff8885351c4c10 by task qemu-system-x86/1818
>> [ 6728.012769][ T1818] 
>> [ 6728.022690][ T1818] CPU: 11 PID: 1818 Comm: qemu-system-x86 Not tainted 5.6.0-rc6-next-20200319+ #5
>> [ 6728.069063][ T1818] Hardware name: HP Synergy 480 Gen9/Synergy 480 Gen9 Compute Module, BIOS I37 10/21/2019
>> [ 6728.117009][ T1818] Call Trace:
>> [ 6728.131504][ T1818]  dump_stack+0xa1/0xea
>> [ 6728.149757][ T1818]  print_address_description.constprop.0+0x33/0x270
>> [ 6728.179315][ T1818]  __kasan_report.cold+0x78/0xd0
>> [ 6728.201386][ T1818]  ? kvm_mmu_notifier_invalidate_range_start+0x50/0x150 [kvm]
>> [ 6728.235146][ T1818]  ? gfn_to_hva+0xc1/0x2b0 [kvm]
>> [ 6728.256942][ T1818]  kasan_report+0x41/0x60
>> [ 6728.276172][ T1818]  ? gfn_to_hva+0xc1/0x2b0 [kvm]
>> [ 6728.298089][ T1818]  __asan_load8+0x86/0xa0
>> [ 6728.317366][ T1818]  gfn_to_hva+0xc1/0x2b0 [kvm]
>> [ 6728.338687][ T1818]  kvm_arch_mmu_notifier_invalidate_range+0x21/0x50 [kvm]
>> [ 6728.370595][ T1818]  kvm_mmu_notifier_invalidate_range_start+0xfd/0x150 [kvm]
>> [ 6728.402904][ T1818]  mn_hlist_invalidate_range_start+0x109/0x2b0
>> [ 6728.430526][ T1818]  ? kvm_flush_remote_tlbs+0x170/0x170 [kvm]
>> [ 6728.457312][ T1818]  __mmu_notifier_invalidate_range_start+0x74/0x80
>> [ 6728.486687][ T1818]  wp_page_copy+0xd9f/0x12e0
>> [ 6728.506872][ T1818]  ? __lock_release+0x14d/0x2b0
>> [ 6728.528484][ T1818]  ? follow_pfn+0x160/0x160
>> [ 6728.548555][ T1818]  ? __kasan_check_read+0x11/0x20
>> [ 6728.573773][ T1818]  ? check_chain_key+0x1d3/0x2c0
>> [ 6728.599226][ T1818]  ? __kasan_check_read+0x11/0x20
>> [ 6728.622648][ T1818]  ? do_raw_spin_unlock+0x98/0xf0
>> [ 6728.644878][ T1818]  do_wp_page+0x37d/0xac0
>> [ 6728.664110][ T1818]  ? wp_page_shared+0x4e0/0x4e0
>> [ 6728.685702][ T1818]  handle_pte_fault+0x3b0/0x3e0
>> [ 6728.707315][ T1818]  __handle_mm_fault+0x5e7/0xaf0
>> [ 6728.729495][ T1818]  ? apply_to_existing_page_range+0x20/0x20
>> [ 6728.755780][ T1818]  handle_mm_fault+0x10b/0x320
>> [ 6728.776840][ T1818]  do_user_addr_fault+0x22c/0x5a0
>> [ 6728.799089][ T1818]  do_page_fault+0x9d/0x421
>> [ 6728.818910][ T1818]  page_fault+0x34/0x40
>> [ 6728.837424][ T1818] RIP: 0033:0x55cc277d6cc4
>> [ 6728.856867][ T1818] Code: 00 00 00 53 48 89 f3 48 83 ec 08 e8 a6 37 e1 ff 48 8b 15 27 a8 70 00 48 89 68 10 48 89 58 18 48 c7 00 00 00 00 00 48 89 50 08 <48> 89 02 48 89 05 0a a8 70 00 48 83 c4 08 5b 5d c3 66 66 2e 0f 1f
>> [ 6728.946881][ T1818] RSP: 002b:00007ffe79363de0 EFLAGS: 00010206
>> [ 6728.973883][ T1818] RAX: 000055cc29963830 RBX: 0000000000000000 RCX: 0000000000000030
>> [ 6729.009698][ T1818] RDX: 000055cc27ee14d0 RSI: 0000000000000020 RDI: 000055cc29963830
>> [ 6729.045698][ T1818] RBP: 000055cc277534b0 R08: 000055cc29963830 R09: 00007fc044602a40
>> [ 6729.084027][ T1818] R10: 000055cc29963880 R11: 0000000000000000 R12: 0000000000000001
>> [ 6729.125556][ T1818] R13: 000055cc29965180 R14: 0000000000000001 R15: 0000000000000001
>> [ 6729.160970][ T1818] 
>> [ 6729.170932][ T1818] Allocated by task 1818:
>> [ 6729.190130][ T1818]  save_stack+0x23/0x50
>> [ 6729.208517][ T1818]  __kasan_kmalloc.constprop.0+0xcf/0xe0
>> [ 6729.233816][ T1818]  kasan_kmalloc+0x9/0x10
>> [ 6729.252852][ T1818]  __kmalloc_node+0x1c3/0x410
>> [ 6729.273517][ T1818]  kvmalloc_node+0x7b/0x90
>> [ 6729.293002][ T1818]  kvm_create_vm+0x264/0x810 [kvm]
>> kvmalloc at include/linux/mm.h:759
>> (inlined by) kvzalloc at include/linux/mm.h:767
>> (inlined by) kvm_alloc_memslots at virt/kvm/kvm_main.c:562
>> (inlined by) kvm_create_vm at virt/kvm/kvm_main.c:697
>> [ 6729.315774][ T1818]  kvm_dev_ioctl_create_vm+0x14/0xf0 [kvm]
>> [ 6729.341840][ T1818]  kvm_dev_ioctl+0x6b/0x90 [kvm]
>> [ 6729.363821][ T1818]  ksys_ioctl+0xa3/0xc0
>> [ 6729.382166][ T1818]  __x64_sys_ioctl+0x43/0x4c
>> [ 6729.403174][ T1818]  do_syscall_64+0x69/0xf4
>> [ 6729.423242][ T1818]  entry_SYSCALL_64_after_hwframe+0x49/0xb3
>> [ 6729.449985][ T1818] 
>> [ 6729.459896][ T1818] Freed by task 0:
>> [ 6729.476312][ T1818] (stack is not available)
>> [ 6729.495726][ T1818] 
>> [ 6729.505710][ T1818] The buggy address belongs to the object at ffff8885351c4800
>> [ 6729.505710][ T1818]  which belongs to the cache kmalloc-2k(976:session-c1.scope) of size 2048
>> [ 6729.579319][ T1818] The buggy address is located 1040 bytes inside of
>> [ 6729.579319][ T1818]  2048-byte region [ffff8885351c4800, ffff8885351c5000)
>> [ 6729.647086][ T1818] The buggy address belongs to the page:
>> [ 6729.671752][ T1818] page:ffffea0014d47100 refcount:1 mapcount:0 mapping:00000000b234685e index:0x0 head:ffffea0014d47100 order:1 compound_mapcount:0
>> [ 6729.734134][ T1818] flags: 0x5fffe000010200(slab|head)
>> [ 6729.757725][ T1818] raw: 005fffe000010200 ffffea0019590308 ffffea0013df5508 ffff888f05490ac0
>> [ 6729.796528][ T1818] raw: 0000000000000000 0000000000010001 00000001ffffffff 0000000000000000
>> [ 6729.835200][ T1818] page dumped because: kasan: bad access detected
>> [ 6729.864026][ T1818] page_owner tracks the page as allocated
>> [ 6729.889565][ T1818] page last allocated via order 1, migratetype Unmovable, gfp_mask 0x52cc0(GFP_KERNEL|__GFP_NOWARN|__GFP_NORETRY|__GFP_COMP)
>> [ 6729.948959][ T1818]  prep_new_page+0x23e/0x270
>> [ 6729.969540][ T1818]  get_page_from_freelist+0x4f7/0x580
>> [ 6729.993824][ T1818]  __alloc_pages_nodemask+0x2de/0x780
>> [ 6730.017658][ T1818]  alloc_pages_current+0x9e/0x170
>> [ 6730.039922][ T1818]  alloc_slab_page+0x321/0x580
>> [ 6730.061106][ T1818]  allocate_slab+0x7f/0x3c0
>> [ 6730.081229][ T1818]  new_slab+0x4a/0x70
>> [ 6730.100073][ T1818]  ___slab_alloc+0x294/0x380
>> [ 6730.122658][ T1818]  __kmalloc_node+0x227/0x410
>> [ 6730.146452][ T1818]  kvmalloc_node+0x7b/0x90
>> [ 6730.166644][ T1818]  kvm_create_vm+0x264/0x810 [kvm]
>> [ 6730.189396][ T1818]  kvm_dev_ioctl_create_vm+0x14/0xf0 [kvm]
>> [ 6730.215647][ T1818]  kvm_dev_ioctl+0x6b/0x90 [kvm]
>> [ 6730.237526][ T1818]  ksys_ioctl+0xa3/0xc0
>> [ 6730.255755][ T1818]  __x64_sys_ioctl+0x43/0x4c
>> [ 6730.276150][ T1818]  do_syscall_64+0x69/0xf4
>> [ 6730.295871][ T1818] page last free stack trace:
>> [ 6730.316511][ T1818]  __free_pages_ok+0x678/0x760
>> [ 6730.337440][ T1818]  __free_pages+0xa2/0xe0
>> [ 6730.356259][ T1818]  free_pages+0x53/0x70
>> [ 6730.374572][ T1818]  stack_depot_save+0x9f/0x213
>> [ 6730.395761][ T1818]  save_stack+0x42/0x50
>> [ 6730.414042][ T1818]  __kasan_kmalloc.constprop.0+0xcf/0xe0
>> [ 6730.439088][ T1818]  kasan_slab_alloc+0xe/0x10
>> [ 6730.459349][ T1818]  kmem_cache_alloc+0x136/0x470
>> [ 6730.481158][ T1818]  mem_pool_alloc+0x38/0x170
>> [ 6730.501470][ T1818]  create_object.isra.0+0x27/0x430
>> [ 6730.524151][ T1818]  kmemleak_alloc_percpu+0xbb/0x150
>> [ 6730.547342][ T1818]  pcpu_alloc+0x537/0xad0
>> [ 6730.566651][ T1818]  __alloc_percpu+0x15/0x20
>> [ 6730.588291][ T1818]  init_srcu_struct_fields+0x208/0x220
>> [ 6730.612543][ T1818]  __init_srcu_struct+0x5c/0x70
>> [ 6730.636590][ T1818]  kvm_create_vm+0x20d/0x810 [kvm]
>> [ 6730.662421][ T1818] 
>> [ 6730.672838][ T1818] Memory state around the buggy address:
>> [ 6730.697743][ T1818]  ffff8885351c4b00: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>> [ 6730.734279][ T1818]  ffff8885351c4b80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>> [ 6730.770594][ T1818] >ffff8885351c4c00: 00 00 fc fc fc fc fc fc fc fc fc fc fc fc fc fc
>> [ 6730.806845][ T1818]                          ^
>> [ 6730.827097][ T1818]  ffff8885351c4c80: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc
>> [ 6730.863311][ T1818]  ffff8885351c4d00: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc
>> [ 6730.899350][ T1818] ==================================================================
>> [ 6730.935728][ T1818] Disabling lock debugging due to kernel taint

Powered by blists - more mailing lists