[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <20080919004431.GS25711@one.firstfloor.org>
Date: Fri, 19 Sep 2008 02:44:31 +0200
From: Andi Kleen <andi@...stfloor.org>
To: FUJITA Tomonori <fujita.tomonori@....ntt.co.jp>
Cc: andi@...stfloor.org, mingo@...e.hu, joerg.roedel@....com,
linux-kernel@...r.kernel.org
Subject: Re: [PATCH 0/3] fix GART to respect device's dma_mask about virtual mappings
On Fri, Sep 19, 2008 at 07:15:59AM +0900, FUJITA Tomonori wrote:
> On Thu, 18 Sep 2008 20:20:29 +0200
> Andi Kleen <andi@...stfloor.org> wrote:
>
> > > The falling back mechanism was moved to pci-nommu from the common code
> > > since it doesn't work for other IOMMUs that always need virtual
> >
> > There's no fallback for _map_sg/_map_single. All the fallback to GFP
> > only works for coherent allocations, but not for streaming mappings.
>
> Yeah, so the falling back mechanism was moved to pci-nommu's
> alloc_coherent.
Sure, but that doesn't help for map_single/map_sg. The two cases are
quite different.
> > To make this "fully robust" for masks < 32bit you would need to implement
> > a new swiotlb that uses GFP_DMA allocations as fallback (or use the DMA
> > allocator's swiotlb which can actually handle this)
>
> Do you mean if GART's alloc_coherent can't find a virtual address that
> a device can access to, it should try GFP_DMA allocations as fallback?
It used to at least, that is how I wrote it. That is it did all GFP_DMA,
GFP_DMA32, swiotlb, ZONE_NORMAL based on a fallback scheme.
>
> GART could but why GART should do? If full IOMMUs' alloc_coherent
The GART is somewhere in the 4GB range so you cannot use it to
map anything < 4GB.
Also GART is pretty small (and it's not a isolating) IOMMU so
if you can get direct memory allocation that fits you should
definitely do that.
> can't find a virtual address that a device can access to, it's
> failure. No fallback is for them. Why can't GART use the same logic?
GART uses the same logic, but only for alloc_cohernet, not for
map_sg/map_single and masks < 4GB.
> Yeah, GART is not a full IOMMU, so it can have a fallback for this
> case. But why can't GART work in the same way other IOMMUs?
Because GART cannot remap to addresses < 4GB reliably.
The big difference to the other IOMMUs is that it's only a tiny memory
hole somewhere near the 4GB boundary, not a full remapper of the full
4GB space.
>
> > So you're right now basically checking for something that you cannot
> > fix. And also you try to check for (but not handle) something that even
> > 32bit x86 doesn't handle. So if some driver relied on you checking
> > for it on 64bit it wouldn't work on 32bit x86 which would be a bad
> > thing.
>
> What does '32bit x86 doesn't handle' mean? pci-nommu's alloc_coherent
> can handle < 32bit bit mask in the fallback path.
Yes it does, just map_sg/map_single doesn't. And your patch changed
that in GART and that is what I objected too.
>
> Or you are talking about '_map_sg/_map_single'? If so, as we
> discussed, < 32bit bit mask can be handled in else where. The patch
I don't hink it can, unless you want to write another swiotlb using
GFP_DMA (or use the dma allocator). That is because the swiotlb
has the same limitation as GART. It cannot reliably remap to < 4GB.
-Andi
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@...r.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Powered by blists - more mailing lists