Re: [PATCH 00/23] media: imx: imx7-mipi-csis: Add i.MX8MM support / imx8mq support
From: Martin Kepplinger <hidden>
Date: 2021-05-20 10:57:01
Also in:
linux-media
Am Mittwoch, dem 19.05.2021 um 18:46 +0300 schrieb Laurent Pinchart:
Hi Martin, On Wed, May 19, 2021 at 05:21:11PM +0200, Martin Kepplinger wrote:quoted
Am Mittwoch, dem 19.05.2021 um 04:14 +0300 schrieb Laurent Pinchart:quoted
On Tue, May 18, 2021 at 04:39:00PM +0200, Martin Kepplinger wrote:quoted
Am Sonntag, dem 16.05.2021 um 01:55 +0300 schrieb Laurent Pinchart:quoted
On Tue, May 04, 2021 at 05:59:39PM +0200, Martin Kepplinger wrote:quoted
hi Laurent, again thanks a lot for posting this series! I can't fully test it, but base my work for imx8mq on it now. imx8mq includes yet another mipi phy version than this and below is some very rough testing code. it's not at all something I sign-off on but my following problem is based on it.Unless I'm mistaken, the CSI-2 receiver in the i.MX8MQ is a completely different device. I wouldn't try to support it in the imx7- mipi-csis driver, but in a separate driver.quoted
* configured to use both staging csi drivers * the csi bridge driver at least streams frames together with the nxp "yav" mipi driver media-ctl -p now says the output below, so one link from mipi to csi is missing. Note that media-ctl --set-v4l2 "'csi':0 [fmt:SBGGR10/640x480]" works in that it changes the configured format below, but media-ctl -l "'imx7-mipi-csis.0':1" -> "'csi':0[1]" doesn't create said missing link.media-ctl can't create links, it can only enable or disable them. Link creation is the prerogative of drivers.quoted
Do I maybe use that wrongly? If now, does anything come to mind that would be missing specifically?The link should be created by the call to media_create_pad_link() in imx_media_capture_device_register(). You'll need to figure out if the function is called and returns an error early, or if it doesn't get called at all, and why.quoted
When trying to stream anyway (if that makes sense), I get the following: [ 2008.377470] capture_start_streaming: starting [ 2008.381883] capture_find_format: calling imx_media_find_mbus_format with code 0x2006 [ 2008.389671] imx7-csi 30a90000.csi1_bridge: capture_validate_fmt: capture_find_format err [ 2008.397794] imx7-csi 30a90000.csi1_bridge: capture_validate_fmt: capture_find_format found colorspace 0x1 != 0x0 [ 2008.407999] imx7-csi 30a90000.csi1_bridge: capture format not valid: -32 and if I ignore that (because I'm not yet sure whether that is specific to platforms including an IPU), I get a WARN_ON from vb2_start_streaming()That I have a fix for, I'll post it as part of an imx7-media- csi series.Hi Laurent, You haven't posted that fix you're talking about, right?Correct. It's now fixed (see "[PATCH] media: imx: imx7-media-csi: Fix buffer return upon stream start failure", I've CC'ed you).quoted
The below driver (attached; I'll send it as patches after I successfully tested myself, and cleanup and fixes obviously)Don't forget the DT bindings at that point :-)quoted
results in the same situation I described above: * missing link from mipi (entity 10) -> csi (entity 1):The link is supposed to be created by v4l2_create_fwnode_links_to_pad(), called from imx7_csi_notify_bound(). Could you trace the calls and figure out what goes wrong ?that bound callback imx7_csi_notify_bound() is called only once during probe: v4l2_create_fwnode_links_to_pad() returns 0 and imx7_csi_async_register() returns success too.What subdev is it called for (I assume the imx8mq-mipi-csis.0) ? Have you traced inside the function to see why it doesn't create links ?
I fixed mipi -> csi link. I had the DT port descriptions for mipi csi
wrong.
now, just because I think it makes sense, I do:
media-ctl --set-v4l2 "'csi':0 [fmt:SGBRG10/640x480 colorspace:raw]"
which now prints:
Device topology
- entity 1: csi (2 pads, 2 links)
type V4L2 subdev subtype Unknown flags 0
device node name /dev/v4l-subdev0
pad0: Sink
[fmt:SGBRG10_1X10/640x480 field:none colorspace:raw
xfer:none ycbcr:601 quantization:full-range]
<- "imx8mq-mipi-csis.0":1 [ENABLED,IMMUTABLE]
pad1: Source
[fmt:SGBRG10_1X10/640x480 field:none colorspace:raw
xfer:none ycbcr:601 quantization:full-range]
-> "csi capture":0 [ENABLED,IMMUTABLE]
- entity 4: csi capture (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video1
pad0: Sink
<- "csi":1 [ENABLED,IMMUTABLE]
- entity 10: imx8mq-mipi-csis.0 (2 pads, 2 links)
type V4L2 subdev subtype Unknown flags 0
device node name /dev/v4l-subdev1
pad0: Sink
<- "hi846 2-0020":0 []
pad1: Source
-> "csi":0 [ENABLED,IMMUTABLE]
- entity 15: hi846 2-0020 (1 pad, 1 link)
type V4L2 subdev subtype Sensor flags 0
device node name /dev/v4l-subdev2
pad0: Source
[fmt:SGBRG10_1X10/640x480 field:none colorspace:raw]
-> "imx8mq-mipi-csis.0":0 []
quoted
btw, my test is: v4l2-ctl -d "/dev/v4l/by-path/platform-30a90000.csi1_bridge-video- index0" --set-fmt-video=width=640,height=480 --stream-mmap -- stream- to=test.raw --stream-count=1 and that (probably because of the missing link) fails with VIDIOC_STREAMON returned -1 (No such device) which is in the kernel: imx7-csi 30a90000.csi1_bridge: pipeline start failed with -19Let's fix the missing link first.
But now when trying to stream a frame, the error is:
Because of:
media bus code not compatible with the pixel format set on the video
node: 1 != 0
I get :
imx7-csi 30a90000.csi1_bridge: capture format not valid
which becomes for userspace:
VIDIOC_STREAMON returned -1 (Broken pipe)
Could that be a "user-problem" because "fmt" is not exactly the same
everywhere? Also, the sensor entity pad is not yet ENABLED...
(media-ctl is still very new to me, sorry if that's dumb questions now)
martin