Thread (24 messages) 24 messages, 7 authors, 2021-05-25

Re: [PATCH 00/23] media: imx: imx7-mipi-csis: Add i.MX8MM support / imx8mq support

From: Martin Kepplinger <hidden>
Date: 2021-05-20 10:57:01
Also in: linux-media

Am Mittwoch, dem 19.05.2021 um 18:46 +0300 schrieb Laurent Pinchart:
Hi Martin,

On Wed, May 19, 2021 at 05:21:11PM +0200, Martin Kepplinger wrote:
quoted
Am Mittwoch, dem 19.05.2021 um 04:14 +0300 schrieb Laurent
Pinchart:
quoted
On Tue, May 18, 2021 at 04:39:00PM +0200, Martin Kepplinger
wrote:
quoted
Am Sonntag, dem 16.05.2021 um 01:55 +0300 schrieb Laurent
Pinchart:
quoted
On Tue, May 04, 2021 at 05:59:39PM +0200, Martin Kepplinger
wrote:
quoted
hi Laurent, again thanks a lot for posting this series! I
can't fully test
it, but base my work for imx8mq on it now. imx8mq includes
yet another mipi phy version than this and below is some
very rough testing
code. it's not at all something I sign-off on but my
following
problem is based on it.
Unless I'm mistaken, the CSI-2 receiver in the i.MX8MQ is a
completely
different device. I wouldn't try to support it in the imx7-
mipi-csis
driver, but in a separate driver.
quoted
 * configured to use both staging csi drivers
 * the csi bridge driver at least streams frames together
with the
nxp "yav" mipi driver

media-ctl -p now says the output below, so one link from
mipi to
csi is missing.

Note that

media-ctl --set-v4l2 "'csi':0 [fmt:SBGGR10/640x480]"
works in that it changes the configured format below, but

media-ctl -l "'imx7-mipi-csis.0':1" -> "'csi':0[1]"
doesn't create said missing link.
media-ctl can't create links, it can only enable or disable
them. Link
creation is the prerogative of drivers.
quoted
Do I maybe use that wrongly? If now, does anything come to
mind that would
be missing specifically?
The link should be created by the call to
media_create_pad_link() in
imx_media_capture_device_register(). You'll need to figure
out if the
function is called and returns an error early, or if it
doesn't get
called at all, and why.
quoted
When trying to stream anyway (if that makes sense), I get
the
following:

[ 2008.377470] capture_start_streaming: starting
[ 2008.381883] capture_find_format: calling
imx_media_find_mbus_format with code 0x2006
[ 2008.389671] imx7-csi 30a90000.csi1_bridge:
capture_validate_fmt: capture_find_format err
[ 2008.397794] imx7-csi 30a90000.csi1_bridge:
capture_validate_fmt: capture_find_format found colorspace
0x1 != 0x0
[ 2008.407999] imx7-csi 30a90000.csi1_bridge: capture
format not valid: -32

and if I ignore that (because I'm not yet sure whether that
is specific to
platforms including an IPU), I get a WARN_ON from
vb2_start_streaming()
That I have a fix for, I'll post it as part of an imx7-media-
csi
series.
Hi Laurent,

You haven't posted that fix you're talking about, right?
Correct. It's now fixed (see "[PATCH] media: imx: imx7-media-csi:
Fix
buffer return upon stream start failure", I've CC'ed you).
quoted
The below
driver (attached; I'll send it as patches after I successfully
tested
myself, and cleanup and fixes obviously)
Don't forget the DT bindings at that point :-)
quoted
results in the same situation I described above:

* missing link from mipi (entity 10) -> csi (entity 1):
The link is supposed to be created by
v4l2_create_fwnode_links_to_pad(),
called from imx7_csi_notify_bound(). Could you trace the calls
and
figure out what goes wrong ?
that bound callback imx7_csi_notify_bound() is called only once
during
probe: v4l2_create_fwnode_links_to_pad() returns 0 and
imx7_csi_async_register() returns success too.
What subdev is it called for (I assume the imx8mq-mipi-csis.0) ? Have
you traced inside the function to see why it doesn't create links ?
I fixed mipi -> csi link. I had the DT port descriptions for mipi csi
wrong.

now, just because I think it makes sense, I do:

media-ctl --set-v4l2 "'csi':0 [fmt:SGBRG10/640x480 colorspace:raw]"

which now prints:

Device topology
- entity 1: csi (2 pads, 2 links)
            type V4L2 subdev subtype Unknown flags 0
            device node name /dev/v4l-subdev0
	pad0: Sink
		[fmt:SGBRG10_1X10/640x480 field:none colorspace:raw
xfer:none ycbcr:601 quantization:full-range]
		<- "imx8mq-mipi-csis.0":1 [ENABLED,IMMUTABLE]
	pad1: Source
		[fmt:SGBRG10_1X10/640x480 field:none colorspace:raw
xfer:none ycbcr:601 quantization:full-range]
		-> "csi capture":0 [ENABLED,IMMUTABLE]

- entity 4: csi capture (1 pad, 1 link)
            type Node subtype V4L flags 0
            device node name /dev/video1
	pad0: Sink
		<- "csi":1 [ENABLED,IMMUTABLE]

- entity 10: imx8mq-mipi-csis.0 (2 pads, 2 links)
             type V4L2 subdev subtype Unknown flags 0
             device node name /dev/v4l-subdev1
	pad0: Sink
		<- "hi846 2-0020":0 []
	pad1: Source
		-> "csi":0 [ENABLED,IMMUTABLE]

- entity 15: hi846 2-0020 (1 pad, 1 link)
             type V4L2 subdev subtype Sensor flags 0
             device node name /dev/v4l-subdev2
	pad0: Source
		[fmt:SGBRG10_1X10/640x480 field:none colorspace:raw]
		-> "imx8mq-mipi-csis.0":0 []
quoted
btw, my test is:

v4l2-ctl -d "/dev/v4l/by-path/platform-30a90000.csi1_bridge-video-
index0" --set-fmt-video=width=640,height=480 --stream-mmap --
stream-
to=test.raw --stream-count=1

and that (probably because of the missing link) fails with

VIDIOC_STREAMON returned -1 (No such device)

which is in the kernel:

imx7-csi 30a90000.csi1_bridge: pipeline start failed with -19
Let's fix the missing link first.
But now when trying to stream a frame, the error is:

Because of:

media bus code not compatible with the pixel format set on the video
node: 1 != 0

I get :

imx7-csi 30a90000.csi1_bridge: capture format not valid

which becomes for userspace:

VIDIOC_STREAMON returned -1 (Broken pipe)

Could that be a "user-problem" because "fmt" is not exactly the same
everywhere? Also, the sensor entity pad is not yet ENABLED...

(media-ctl is still very new to me, sorry if that's dumb questions now)

                          martin

Keyboard shortcuts
hback out one level
jnext message in thread
kprevious message in thread
ldrill in
Escclose help / fold thread tree
?toggle this help