[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

STALE5500d

12 messages, 3 authors, 2011-09-01 · open the first message on its own page

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: Ohad Ben-Cohen <hidden>
Date: 2011-08-31 10:52:08 

On Mon, Aug 29, 2011 at 10:36 PM, Ohad Ben-Cohen [off-list ref] wrote:
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is not
page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
I'm having second thoughts about this.

Obviously it works for omap3isp and its users because the buffer gets
mapped and everyone is happy.

But I'm not sure this is a valid IOMMU interface that the kernel
should have, because effectively we're now mapping physical memory
which nobody asked us to, and which might contain sensitive stuff we
don't want to give the device (e.g. a remote processor which might be
running rogue code) access to.

Thoughts ?
quoted hunk
Signed-off-by: Laurent Pinchart <laurent.pinchart@ideasonboard.com>
Acked-by: Hiroshi DOYU <redacted>
[ohad at wizery.com: slightly edited the commit log]
Signed-off-by: Ohad Ben-Cohen <redacted>
---
A fix by Laurent that was waiting until omap's iommu lands in drivers/.

Generally we're not extending omap-iovmm anymore, but this fixes a real
breakage for omap3isp users, so there's no point in delaying it until
the generic DMA API is ready and we've migrated.

Thanks Laurent!

?drivers/iommu/omap-iovmm.c | ? 32 ++++++++++++++++++++++++--------
?1 files changed, 24 insertions(+), 8 deletions(-)

diff --git a/drivers/iommu/omap-iovmm.c b/drivers/iommu/omap-iovmm.c
index 5e7f97d..d28a256 100644
--- a/drivers/iommu/omap-iovmm.c
+++ b/drivers/iommu/omap-iovmm.c
@@ -27,6 +27,15 @@

?static struct kmem_cache *iovm_area_cachep;

+/* return the offset of the first scatterlist entry in a sg table */
+static unsigned int sgtable_offset(const struct sg_table *sgt)
+{
+ ? ? ? if (!sgt || !sgt->nents)
+ ? ? ? ? ? ? ? return 0;
+
+ ? ? ? return sgt->sgl->offset;
+}
+
?/* return total bytes of sg buffers */
?static size_t sgtable_len(const struct sg_table *sgt)
?{
@@ -39,11 +48,17 @@ static size_t sgtable_len(const struct sg_table *sgt)
? ? ? ?for_each_sg(sgt->sgl, sg, sgt->nents, i) {
? ? ? ? ? ? ? ?size_t bytes;

- ? ? ? ? ? ? ? bytes = sg->length;
+ ? ? ? ? ? ? ? bytes = sg->length + sg->offset;

? ? ? ? ? ? ? ?if (!iopgsz_ok(bytes)) {
- ? ? ? ? ? ? ? ? ? ? ? pr_err("%s: sg[%d] not iommu pagesize(%x)\n",
- ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?__func__, i, bytes);
+ ? ? ? ? ? ? ? ? ? ? ? pr_err("%s: sg[%d] not iommu pagesize(%u %u)\n",
+ ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?__func__, i, bytes, sg->offset);
+ ? ? ? ? ? ? ? ? ? ? ? return 0;
+ ? ? ? ? ? ? ? }
+
+ ? ? ? ? ? ? ? if (i && sg->offset) {
+ ? ? ? ? ? ? ? ? ? ? ? pr_err("%s: sg[%d] offset not allowed in internal "
+ ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? "entries\n", __func__, i);
? ? ? ? ? ? ? ? ? ? ? ?return 0;
? ? ? ? ? ? ? ?}

@@ -164,8 +179,8 @@ static void *vmap_sg(const struct sg_table *sgt)
? ? ? ? ? ? ? ?u32 pa;
? ? ? ? ? ? ? ?int err;

- ? ? ? ? ? ? ? pa = sg_phys(sg);
- ? ? ? ? ? ? ? bytes = sg->length;
+ ? ? ? ? ? ? ? pa = sg_phys(sg) - sg->offset;
+ ? ? ? ? ? ? ? bytes = sg->length + sg->offset;

? ? ? ? ? ? ? ?BUG_ON(bytes != PAGE_SIZE);

@@ -405,8 +420,8 @@ static int map_iovm_area(struct iommu_domain *domain, struct iovm_struct *new,
? ? ? ? ? ? ? ?u32 pa;
? ? ? ? ? ? ? ?size_t bytes;

- ? ? ? ? ? ? ? pa = sg_phys(sg);
- ? ? ? ? ? ? ? bytes = sg->length;
+ ? ? ? ? ? ? ? pa = sg_phys(sg) - sg->offset;
+ ? ? ? ? ? ? ? bytes = sg->length + sg->offset;

? ? ? ? ? ? ? ?flags &= ~IOVMF_PGSZ_MASK;

@@ -600,7 +615,7 @@ u32 omap_iommu_vmap(struct iommu_domain *domain, struct omap_iommu *obj, u32 da,
? ? ? ?if (IS_ERR_VALUE(da))
? ? ? ? ? ? ? ?vunmap_sg(va);

- ? ? ? return da;
+ ? ? ? return da + sgtable_offset(sgt);
?}
?EXPORT_SYMBOL_GPL(omap_iommu_vmap);

@@ -620,6 +635,7 @@ omap_iommu_vunmap(struct iommu_domain *domain, struct omap_iommu *obj, u32 da)
? ? ? ? * 'sgt' is allocated before 'omap_iommu_vmalloc()' is called.
? ? ? ? * Just returns 'sgt' to the caller to free
? ? ? ? */
+ ? ? ? da &= PAGE_MASK;
? ? ? ?sgt = unmap_vm_area(domain, obj, da, vunmap_sg,
? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?IOVMF_DISCONT | IOVMF_MMIO);
? ? ? ?if (!sgt)
--
1.7.4.1

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: laurent.pinchart@ideasonboard.com (Laurent Pinchart)
Date: 2011-08-31 11:27:27 

Hi Ohad,

On Wednesday 31 August 2011 12:52:08 Ohad Ben-Cohen wrote:
On Mon, Aug 29, 2011 at 10:36 PM, Ohad Ben-Cohen [off-list ref] wrote:
quoted
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is not
page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
I'm having second thoughts about this.

Obviously it works for omap3isp and its users because the buffer gets
mapped and everyone is happy.

But I'm not sure this is a valid IOMMU interface that the kernel
should have, because effectively we're now mapping physical memory
which nobody asked us to, and which might contain sensitive stuff we
don't want to give the device (e.g. a remote processor which might be
running rogue code) access to.

Thoughts ?
That can indeed be an issue, depending on whether we consider the device as 
trusted or not. This decision can't obviously be taken by the IOMMU layer.

Do you think it would be better to move this code to the OMAP3 ISP driver ?

-- 
Regards,

Laurent Pinchart

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: Roedel, Joerg <hidden>
Date: 2011-08-31 13:06:42 

On Wed, Aug 31, 2011 at 06:52:08AM -0400, Ohad Ben-Cohen wrote:
On Mon, Aug 29, 2011 at 10:36 PM, Ohad Ben-Cohen [off-list ref] wrote:
quoted
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is not
page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
I'm having second thoughts about this.

Obviously it works for omap3isp and its users because the buffer gets
mapped and everyone is happy.

But I'm not sure this is a valid IOMMU interface that the kernel
should have, because effectively we're now mapping physical memory
which nobody asked us to, and which might contain sensitive stuff we
don't want to give the device (e.g. a remote processor which might be
running rogue code) access to.

Thoughts ?
Do you mean the parts of the pages you map to the device that are not in
the requested range (basically everything before offset and all after
size)?
This issue exists in other iommu drivers as well. It is inherent to how
the dma-api is defined and how the iommu hardware works.
The dma-api can work on byte granularity while the hardware usually only
works on page granularity.

	Joerg

-- 
AMD Operating System Research Center

Advanced Micro Devices GmbH Einsteinring 24 85609 Dornach
General Managers: Alberto Bozzo, Andrew Bowd
Registration: Dornach, Landkr. Muenchen; Registerger. Muenchen, HRB Nr. 43632

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: laurent.pinchart@ideasonboard.com (Laurent Pinchart)
Date: 2011-08-31 16:56:26 

Hi Joerg,

On Wednesday 31 August 2011 15:06:42 Roedel, Joerg wrote:
On Wed, Aug 31, 2011 at 06:52:08AM -0400, Ohad Ben-Cohen wrote:
quoted
On Mon, Aug 29, 2011 at 10:36 PM, Ohad Ben-Cohen [off-list ref] wrote:
quoted
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is
not page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
I'm having second thoughts about this.

Obviously it works for omap3isp and its users because the buffer gets
mapped and everyone is happy.

But I'm not sure this is a valid IOMMU interface that the kernel
should have, because effectively we're now mapping physical memory
which nobody asked us to, and which might contain sensitive stuff we
don't want to give the device (e.g. a remote processor which might be
running rogue code) access to.

Thoughts ?
Do you mean the parts of the pages you map to the device that are not in
the requested range (basically everything before offset and all after
size)?
This issue exists in other iommu drivers as well. It is inherent to how
the dma-api is defined and how the iommu hardware works.
The dma-api can work on byte granularity while the hardware usually only
works on page granularity.
True, but if we implement address rounding transparently in the IOMMU layer 
Ohad's concern can be valid, depending on whether the device is trusted. If we 
decide to push address rounding to the drivers that decision can be made on a 
per-device basis. However, drivers are usually not aware of what granularity 
the IOMMU works on, so that wouldn't be straightforward and clean.

-- 
Regards,

Laurent Pinchart

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: Ohad Ben-Cohen <hidden>
Date: 2011-08-31 17:16:18 

Hi Laurent, Joerg,

On Wed, Aug 31, 2011 at 7:56 PM, Laurent Pinchart
[off-list ref] wrote:
On Wednesday 31 August 2011 15:06:42 Roedel, Joerg wrote:
quoted
Do you mean the parts of the pages you map to the device that are not in
the requested range (basically everything before offset and all after
size)?
This issue exists in other iommu drivers as well. It is inherent to how
the dma-api is defined and how the iommu hardware works.
The dma-api can work on byte granularity while the hardware usually only
works on page granularity.
True, but if we implement address rounding transparently in the IOMMU layer
Ohad's concern can be valid, depending on whether the device is trusted. If we
decide to push address rounding to the drivers that decision can be made on a
per-device basis. However, drivers are usually not aware of what granularity
the IOMMU works on, so that wouldn't be straightforward and clean.
I think the confusion lies in the fact that omap's iovmm should be
treated as the DMA-API (which will soon replace it altogether anyway)
and not as an IOMMU driver, and in that sense, Laurent's patch does
sound reasonable.

However, one needs to keep this in mind (e.g. map only page-aligned
buffers ?) when using the upcoming iommu-based DMA-API with untrusted
devices (such as remote processors running arbitrary code). It is
completely wrong to allow these devices access to random physical
memory regions. We might want to come up with a way to prevent this
from happening...

Thanks,
Ohad.

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: Roedel, Joerg <hidden>
Date: 2011-09-01 09:35:18 

On Wed, Aug 31, 2011 at 12:56:26PM -0400, Laurent Pinchart wrote:
True, but if we implement address rounding transparently in the IOMMU layer 
Ohad's concern can be valid, depending on whether the device is trusted. If we 
decide to push address rounding to the drivers that decision can be made on a 
per-device basis. However, drivers are usually not aware of what granularity 
the IOMMU works on, so that wouldn't be straightforward and clean.
Drivers usually just use the DMA-API, so they can not assume at all that
any protection happens. The problem also can't be really solved without
changing/breaking the DMA-API. It is defined to work on byte granularity
while the hardware only works with pages.

The only way to work around this it to implement the driver in a way so
that they only map page-aligned buffers where the size is also a
multiple of a page-size.

In this case you can assume the page-size you are working on because you
already assume in the driver that an iommu is in use.

	Joerg

-- 
AMD Operating System Research Center

Advanced Micro Devices GmbH Einsteinring 24 85609 Dornach
General Managers: Alberto Bozzo, Andrew Bowd
Registration: Dornach, Landkr. Muenchen; Registerger. Muenchen, HRB Nr. 43632

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: Ohad Ben-Cohen <hidden>
Date: 2011-09-01 11:47:26 

On Wed, Aug 31, 2011 at 1:52 PM, Ohad Ben-Cohen [off-list ref] wrote:
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is not
page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
Seems like the unmap paths were skipped (need to adjust the sizes in
the unmap path too).

Laurent, if it looks good to you, I'll just squash it to the original
patch and repost:

diff --git a/drivers/iommu/omap-iovmm.c b/drivers/iommu/omap-iovmm.c
index d28a256..39bdb92 100644
--- a/drivers/iommu/omap-iovmm.c
+++ b/drivers/iommu/omap-iovmm.c
@@ -447,7 +447,7 @@ err_out:
        for_each_sg(sgt->sgl, sg, i, j) {
                size_t bytes;

-               bytes = sg->length;
+               bytes = sg->length + sg->offset;
                order = get_order(bytes);

                /* ignore failures.. we're already handling one */
@@ -476,7 +476,7 @@ static void unmap_iovm_area(struct iommu_domain *domain, str
                size_t bytes;
                int order;

-               bytes = sg->length;
+               bytes = sg->length + sg->offset;
                order = get_order(bytes);

                err = iommu_unmap(domain, start, order);

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: laurent.pinchart@ideasonboard.com (Laurent Pinchart)
Date: 2011-09-01 13:31:13 

Hi Ohad,

On Thursday 01 September 2011 13:47:26 Ohad Ben-Cohen wrote:
On Wed, Aug 31, 2011 at 1:52 PM, Ohad Ben-Cohen [off-list ref] wrote:
quoted
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is not
page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
Seems like the unmap paths were skipped (need to adjust the sizes in
the unmap path too).

Laurent, if it looks good to you, I'll just squash it to the original
patch and repost:
Do you have a tree where the current code base can be found ?
quoted hunk
diff --git a/drivers/iommu/omap-iovmm.c b/drivers/iommu/omap-iovmm.c
index d28a256..39bdb92 100644
--- a/drivers/iommu/omap-iovmm.c
+++ b/drivers/iommu/omap-iovmm.c
@@ -447,7 +447,7 @@ err_out:
        for_each_sg(sgt->sgl, sg, i, j) {
                size_t bytes;

-               bytes = sg->length;
+               bytes = sg->length + sg->offset;
                order = get_order(bytes);

                /* ignore failures.. we're already handling one */
@@ -476,7 +476,7 @@ static void unmap_iovm_area(struct iommu_domain
*domain, str size_t bytes;
                int order;

-               bytes = sg->length;
+               bytes = sg->length + sg->offset;
                order = get_order(bytes);

                err = iommu_unmap(domain, start, order);
-- 
Regards,

Laurent Pinchart

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: Roedel, Joerg <hidden>
Date: 2011-09-01 13:42:09 

On Thu, Sep 01, 2011 at 09:31:13AM -0400, Laurent Pinchart wrote:
Hi Ohad,

On Thursday 01 September 2011 13:47:26 Ohad Ben-Cohen wrote:
quoted
On Wed, Aug 31, 2011 at 1:52 PM, Ohad Ben-Cohen [off-list ref] wrote:
quoted
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is not
page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
Seems like the unmap paths were skipped (need to adjust the sizes in
the unmap path too).

Laurent, if it looks good to you, I'll just squash it to the original
patch and repost:
Do you have a tree where the current code base can be found ?
Please base your upstream-patches against

	git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu.git arm/omap

Thanks,

	Joerg


-- 
AMD Operating System Research Center

Advanced Micro Devices GmbH Einsteinring 24 85609 Dornach
General Managers: Alberto Bozzo, Andrew Bowd
Registration: Dornach, Landkr. Muenchen; Registerger. Muenchen, HRB Nr. 43632

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: laurent.pinchart@ideasonboard.com (Laurent Pinchart)
Date: 2011-09-01 13:59:33 

Hi Ohad,

On Thursday 01 September 2011 13:47:26 Ohad Ben-Cohen wrote:
On Wed, Aug 31, 2011 at 1:52 PM, Ohad Ben-Cohen [off-list ref] wrote:
quoted
From: Laurent Pinchart <laurent.pinchart@ideasonboard.com>

omap_iovmm requires page-aligned buffers, and that sometimes causes
omap3isp failures (i.e. whenever the buffer passed from userspace is not
page-aligned).

Remove this limitation by rounding the address of the first page entry
down, and adding the offset back to the device address.
Seems like the unmap paths were skipped (need to adjust the sizes in
the unmap path too).

Laurent, if it looks good to you, I'll just squash it to the original
patch and repost:
It looks good to me. I haven't tested it though.
quoted hunk
diff --git a/drivers/iommu/omap-iovmm.c b/drivers/iommu/omap-iovmm.c
index d28a256..39bdb92 100644
--- a/drivers/iommu/omap-iovmm.c
+++ b/drivers/iommu/omap-iovmm.c
@@ -447,7 +447,7 @@ err_out:
        for_each_sg(sgt->sgl, sg, i, j) {
                size_t bytes;

-               bytes = sg->length;
+               bytes = sg->length + sg->offset;
                order = get_order(bytes);

                /* ignore failures.. we're already handling one */
@@ -476,7 +476,7 @@ static void unmap_iovm_area(struct iommu_domain
*domain, str size_t bytes;
                int order;

-               bytes = sg->length;
+               bytes = sg->length + sg->offset;
                order = get_order(bytes);

                err = iommu_unmap(domain, start, order);
-- 
Regards,

Laurent Pinchart

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: Ohad Ben-Cohen <hidden>
Date: 2011-09-01 14:02:35 

On Thu, Sep 1, 2011 at 4:59 PM, Laurent Pinchart
[off-list ref] wrote:
It looks good to me.
Thanks.

I haven't tested it though.
I did, but I always get aligned buffers so my testing is a bit moot. I
can't see how unmap could work without this patch, though, so I'll
squash this and re-post.

[PATCH] iommu: omap_iovmm: support non page-aligned buffers in iommu_vmap

From: laurent.pinchart@ideasonboard.com (Laurent Pinchart)
Date: 2011-09-01 14:15:48 

On Thursday 01 September 2011 16:02:35 Ohad Ben-Cohen wrote:
On Thu, Sep 1, 2011 at 4:59 PM, Laurent Pinchart

[off-list ref] wrote:
quoted
It looks good to me.
Thanks.
quoted
I haven't tested it though.
I did, but I always get aligned buffers so my testing is a bit moot. I
can't see how unmap could work without this patch, though, so I'll
squash this and re-post.
You can allocate a page-aligned buffer with posix_memalign() and add an offset 
(64 should do the job, smaller values can get rejected by the OMAP3 ISP 
driver).

-- 
Regards,

Laurent Pinchart
Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help