Re: [PATCH 1/3] Device isolation group infrastructure (v3)
From: David Gibson <hidden>
Date: 2012-02-09 03:34:47
Also in:
linux-iommu, lkml, qemu-devel
On Wed, Feb 08, 2012 at 04:27:48PM +0100, Joerg Roedel wrote:
On Wed, Feb 01, 2012 at 03:46:52PM +1100, David Gibson wrote:quoted
In order to safely drive a device with a userspace driver, or to pass it through to a guest system, we must first make sure that the device is isolated in such a way that it cannot interfere with other devices on the system. This isolation is only available on some systems and will generally require an iommu, and might require other support in bridges or other system hardware. Often, it's not possible to isolate every device from every other device in the system. For example, certain PCI/PCIe bridge configurations mean that an iommu cannot reliably distinguish which device behind the bridge initiated a DMA transaction. Similarly some buggy PCI multifunction devices initiate all DMAs as function 0, so the functions cannot be isolated from each other, even if the IOMMU normally allows this. Therefore, the user, and code to allow userspace drivers or guest passthrough, needs a way to determine which devices can be isolated from which others. This patch adds infrastructure to handle this by introducing the concept of a "device isolation group" - a group of devices which can, as a unit, be safely isolated from the rest of the system and therefore can be, as a unit, safely assigned to an unprivileged used or guest. That is, the groups represent the minimum granularity with which devices may be assigned to untrusted components. This code manages groups, but does not create them or allow use of grouped devices by a guest. Creating groups would be done by iommu or bridge drivers, using the interface this patch provides. It's expected that the groups will be used in future by the in-kernel iommu interface, and would also be used by VFIO or other subsystems to allow safe passthrough of devices to userspace or guests. Signed-off-by: Alexey Kardashevskiy <redacted> Signed-off-by: David Gibson <redacted> --- drivers/base/Kconfig | 3 + drivers/base/Makefile | 1 + drivers/base/base.h | 3 + drivers/base/core.c | 6 ++ drivers/base/device_isolation.c | 184 ++++++++++++++++++++++++++++++++++++++ drivers/base/init.c | 2 + include/linux/device.h | 5 + include/linux/device_isolation.h | 100 +++++++++++++++++++++Again, device grouping is done by the IOMMU drivers, so this all belongs into the generic iommu-code rather than the driver core. I think it makes sense to introduce a device->iommu pointer which depends on CONFIG_IOMMU_API and put the group information into it. This also has the benefit that we can consolidate all the device->arch.iommu pointers into device->iommu as well.
Well, not quite. In the two example setups in the subsequent patches the grouping is done by the bridge driver, which in these cases is not IOMMU_API aware. They probably should become so, but that's another project - and relies on the IOMMU_API becoming group aware. Note that although iommus are the main source of group constraints, they're not necessarily the only one. Bridge error isolation semantics may also play a part, for one. -- David Gibson | I'll have my music baroque, and my code david AT gibson.dropbear.id.au | minimalist, thank you. NOT _the_ _other_ | _way_ _around_! http://www.ozlabs.org/~dgibson