[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Message-ID: <69db9205-cb9a-425a-a48e-6d68d1f900f1@arm.com>
Date: Tue, 28 Nov 2023 16:02:42 +0000
From: Robin Murphy <robin.murphy@....com>
To: Jason Gunthorpe <jgg@...pe.ca>
Cc: joro@...tes.org, kevin.tian@...el.com, will@...nel.org,
iommu@...ts.linux.dev, linux-kernel@...r.kernel.org
Subject: Re: [PATCH 1/2] iommufd/selftest: Use a fwnode to distinguish devices
On 28/11/2023 2:43 pm, Jason Gunthorpe wrote:
> On Tue, Nov 28, 2023 at 10:42:11AM +0000, Robin Murphy wrote:
>> With bus ops gone, the trick of registering against a specific bus no
>> longer really works, and we start getting given devices from other buses
>> to probe,
>
> Make sense
>
>> which leads to spurious groups for devices with no IOMMU on
>> arm64,
>
> I'm not sure I'm fully understanding what this means?
It means on my arm64 ACPI system, random platform devices which are
created after iommufd_test_init() has run get successfully probed by the
mock driver, unexpectedly:
root@...zy-taxi:~# ls /sys/kernel/iommu_groups/*/devices
/sys/kernel/iommu_groups/0/devices:
0000:07:00.0
/sys/kernel/iommu_groups/1/devices:
'Fixed MDIO bus.0'
/sys/kernel/iommu_groups/10/devices:
0001:00:00.0
/sys/kernel/iommu_groups/2/devices:
0000:04:05.0
/sys/kernel/iommu_groups/3/devices:
0000:08:00.0
/sys/kernel/iommu_groups/4/devices:
0000:09:00.0
/sys/kernel/iommu_groups/5/devices:
0001:01:00.0
/sys/kernel/iommu_groups/6/devices:
alarmtimer.2.auto
/sys/kernel/iommu_groups/7/devices:
psci-cpuidle
/sys/kernel/iommu_groups/8/devices:
snd-soc-dummy
/sys/kernel/iommu_groups/9/devices:
0000:00:00.0 0000:01:00.0 0000:02:08.0 0000:02:10.0 0000:02:11.0
0000:02:12.0 0000:02:13.0 0000:02:14.0 0000:03:00.0
root@...zy-taxi:~# cat /sys/kernel/iommu_groups/*/type
DMA
blocked
DMA
DMA
DMA
DMA
DMA
blocked
blocked
blocked
DMA
> I guess that the mock driver is matching random things once it starts
> being called all the time because this is missing:
>
> static struct iommu_device *mock_probe_device(struct device *dev)
> {
> + if (dev->bus != &iommufd_mock_bus_type)
> + return -ENODEV;
> return &mock_iommu_device;
> }
>
> Is that sufficient to solve the problem?
Unfortunately not...
>> but may inadvertently steal devices from the real IOMMU on Intel,
>> AMD or S390.
>
> AMD/Intel/S390 drivers already reject bus's they don't understand.
>
> Intel's device_to_iommu() will fail because
> for_each_active_dev_scope() will never match the mock device.
>
> amd fails because check_device() -> get_device_sbdf_id() fails due to
> no PCI and not get_acpihid_device_id().
>
> s390 fails because !dev_is_pci(dev).
Indeed, but then when such probes do fail, they've failed for good. We
don't have any way to somehow dig up the mock driver's ops and try
again, so the selftest ends up broken (i.e. the real driver "steals" the
mock devices, in the inverse of the case I was concerned about if the
mock driver somehow manages to register first).
The assumption was as commented in the code, that there would only ever
be one driver per system *not* using fwnodes, but as I say I missed the
mock driver when considering that. To be fair, I'm not sure it even
existed when I *first* wrote that code :)
I did intend coexistence to work on x86 too, where the "other" driver
would be virtio-iommu using fwnodes, so aligning the mock driver that
way seemed far neater than any more special-case hacks in core code.
> The fwspec drivers should all fail if they don't have a fwspec, and
> they shouldn't for mock bus devices since it doesn't implement
> dma_configure.
Right, the selftests still work fine on my arm64 system (and the
spurious groups happen to be benign since those aren't real DMA-capable
device anyway), but I expect they're busted on x86/s390 with today's -next.
Thanks,
Robin.
Powered by blists - more mailing lists