| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-ID: <0803d197-4485-59cc-71c6-0aa804283647@xs4all.nl>
Date: Fri, 2 Oct 2020 16:52:21 +0200
From: Hans Verkuil <hverkuil-cisco@...all.nl>
To: Guillaume Tucker <guillaume.tucker@...labora.com>,
Dafna Hirschfeld <dafna.hirschfeld@...labora.com>,
Mauro Carvalho Chehab <mchehab+huawei@...nel.org>
Cc: linux-kernel@...r.kernel.org, linux-media@...r.kernel.org,
kernelci-results@...ups.io, kernelci@...ups.io
Subject: Re: media/master bisection:
v4l2-compliance-vivid.Format-ioctls-Input-3.VIDIOC_TRY_FMT on
qemu_arm-virt-gicv3
On 02/10/2020 16:37, Guillaume Tucker wrote:
> On 30/09/2020 09:05, Guillaume Tucker wrote:
>> Please see the bisection report below about a regression in
>> v4l2-compliance on vivid.
>>
>> Reports aren't automatically sent to the public while we're
>> trialing new bisection features on kernelci.org but this one
>> looks valid.
>>
>>
>> The full results for v4l2-compliance on vivid for
>> v5.9-rc4-471-gc0c8db7bc953 show 22 individual test case
>> regressions which might all be due to a single issue:
>>
>> https://kernelci.org/test/plan/id/5f728c108b008d61f4bf9db7/
>>
>> For comparison, this is the results from the previous revision in
>> the media tree:
>>
>> https://kernelci.org/test/plan/id/5f6b44ddea4abb1888bf9db4/
>>
>> Also worth noting is that the v4l2-compliance test suite was
>> updated on Friday 25th, in-between the revisions mentioned above.
>> So the issue might have been present earlier but not detected.
>
> Turns out, it needed yet another update. The failures were all
> due to the fact that the v4l2-compliance version being used on
> kernelci.org was lagging by a few days behind the media/master
> branch.
>
> It's a pretty rare issue, but it would be nice to have a way to
> avoid that. On the KernelCI side of things, we should start
> monitoring tests and rebuild them automatically rather than on a
> fixed weekly basis. On the kernel side of things, it would help
> if the tests were updated _before_ the changes were applied to
> the branch as otherwise there would still be a window for this
> kind of issue to occur.
Typically v4l-utils can't be updated until the kernel changes
are merged in the media_tree master. Usually I update v4l-utils
right after the kernel patches are merged, but occasionally I am
late. Although looking at when the patches were merged, there was
only 2 hours between the CSC kernel patches and the CSC v4l-utils
patches.
Note that my daily build and regression test always updates v4l-utils
before starting the regression tests.
>
> Generally speaking, what do you think would be the best way to
> fit the KernelCI v4l2-compliance test cycles into the media
> subsystem workflow?
Perhaps kernelci should also trigger when v4l2-compliance was changed
in the v4l-utils repository? You might still have some tests failing
between merging the kernel patches and merging the corresponding v4l2-compliance
patches, but at least it should automatically fix itself once it detects
that v4l2-compliance was updated.
Regards,
Hans
>
> Best wishes,
> Guillaume
>
>
>> On 29/09/2020 07:30, KernelCI bot wrote:
>>> * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
>>> * This automated bisection report was sent to you on the basis *
>>> * that you may be involved with the breaking commit it has *
>>> * found. No manual investigation has been done to verify it, *
>>> * and the root cause of the problem may be somewhere else. *
>>> * *
>>> * If you do send a fix, please include this trailer: *
>>> * Reported-by: "kernelci.org bot" <bot@...nelci.org> *
>>> * *
>>> * Hope this helps! *
>>> * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
>>>
>>> media/master bisection: v4l2-compliance-vivid.Format-ioctls-Input-3.VIDIOC_TRY_FMT on qemu_arm-virt-gicv3
>>>
>>> Summary:
>>> Start: c0c8db7bc953 media: MAINTAINERS: remove Maxime Jourdan as maintainer of Amlogic VDEC
>>> Plain log: https://storage.kernelci.org/media/master/v5.9-rc4-471-gc0c8db7bc953/arm/multi_v7_defconfig+virtualvideo/gcc-8/lab-collabora/v4l2-compliance-vivid-qemu_arm-virt-gicv3.txt
>>> HTML log: https://storage.kernelci.org/media/master/v5.9-rc4-471-gc0c8db7bc953/arm/multi_v7_defconfig+virtualvideo/gcc-8/lab-collabora/v4l2-compliance-vivid-qemu_arm-virt-gicv3.html
>>> Result: 2f491463497a media: vivid: Add support to the CSC API
>>>
>>> Checks:
>>> revert: PASS
>>> verify: PASS
>>>
>>> Parameters:
>>> Tree: media
>>> URL: https://git.linuxtv.org/media_tree.git
>>> Branch: master
>>> Target: qemu_arm-virt-gicv3
>>> CPU arch: arm
>>> Lab: lab-collabora
>>> Compiler: gcc-8
>>> Config: multi_v7_defconfig+virtualvideo
>>> Test case: v4l2-compliance-vivid.Format-ioctls-Input-3.VIDIOC_TRY_FMT
>>>
>>> Breaking commit found:
>>>
>>> -------------------------------------------------------------------------------
>>> commit 2f491463497ad43bc06968a334747c6b6b20fc74
>>> Author: Dafna Hirschfeld <dafna.hirschfeld@...labora.com>
>>> Date: Thu Aug 27 21:46:09 2020 +0200
>>>
>>> media: vivid: Add support to the CSC API
>>>
>>> The CSC API (Colorspace conversion) allows userspace to try
>>> to configure the colorspace, transfer function, Y'CbCr/HSV encoding
>>> and the quantization for capture devices. This patch adds support
>>> to the CSC API in vivid.
>>> Using the CSC API, userspace is allowed to do the following:
>>>
>>> - Set the colorspace.
>>> - Set the xfer_func.
>>> - Set the ycbcr_enc function for YUV formats.
>>> - Set the hsv_enc function for HSV formats
>>> - Set the quantization for YUV and RGB formats.
>>>
>>> Signed-off-by: Dafna Hirschfeld <dafna.hirschfeld@...labora.com>
>>> Signed-off-by: Hans Verkuil <hverkuil-cisco@...all.nl>
>>> Signed-off-by: Mauro Carvalho Chehab <mchehab+huawei@...nel.org>
>>>
>>> diff --git a/drivers/media/test-drivers/vivid/vivid-vid-cap.c b/drivers/media/test-drivers/vivid/vivid-vid-cap.c
>>> index e94beef008c8..eadf28ab1e39 100644
>>> --- a/drivers/media/test-drivers/vivid/vivid-vid-cap.c
>>> +++ b/drivers/media/test-drivers/vivid/vivid-vid-cap.c
>>> @@ -560,6 +560,7 @@ int vivid_try_fmt_vid_cap(struct file *file, void *priv,
>>> unsigned factor = 1;
>>> unsigned w, h;
>>> unsigned p;
>>> + bool user_set_csc = !!(mp->flags & V4L2_PIX_FMT_FLAG_SET_CSC);
>>>
>>> fmt = vivid_get_format(dev, mp->pixelformat);
>>> if (!fmt) {
>>> @@ -633,13 +634,30 @@ int vivid_try_fmt_vid_cap(struct file *file, void *priv,
>>> (fmt->bit_depth[p] / fmt->vdownsampling[p])) /
>>> (fmt->bit_depth[0] / fmt->vdownsampling[0]);
>>>
>>> - mp->colorspace = vivid_colorspace_cap(dev);
>>> - if (fmt->color_enc == TGP_COLOR_ENC_HSV)
>>> - mp->hsv_enc = vivid_hsv_enc_cap(dev);
>>> - else
>>> + if (!user_set_csc || !v4l2_is_colorspace_valid(mp->colorspace))
>>> + mp->colorspace = vivid_colorspace_cap(dev);
>>> +
>>> + if (!user_set_csc || !v4l2_is_xfer_func_valid(mp->xfer_func))
>>> + mp->xfer_func = vivid_xfer_func_cap(dev);
>>> +
>>> + if (fmt->color_enc == TGP_COLOR_ENC_HSV) {
>>> + if (!user_set_csc || !v4l2_is_hsv_enc_valid(mp->hsv_enc))
>>> + mp->hsv_enc = vivid_hsv_enc_cap(dev);
>>> + } else if (fmt->color_enc == TGP_COLOR_ENC_YCBCR) {
>>> + if (!user_set_csc || !v4l2_is_ycbcr_enc_valid(mp->ycbcr_enc))
>>> + mp->ycbcr_enc = vivid_ycbcr_enc_cap(dev);
>>> + } else {
>>> mp->ycbcr_enc = vivid_ycbcr_enc_cap(dev);
>>> - mp->xfer_func = vivid_xfer_func_cap(dev);
>>> - mp->quantization = vivid_quantization_cap(dev);
>>> + }
>>> +
>>> + if (fmt->color_enc == TGP_COLOR_ENC_YCBCR ||
>>> + fmt->color_enc == TGP_COLOR_ENC_RGB) {
>>> + if (!user_set_csc || !v4l2_is_quant_valid(mp->quantization))
>>> + mp->quantization = vivid_quantization_cap(dev);
>>> + } else {
>>> + mp->quantization = vivid_quantization_cap(dev);
>>> + }
>>> +
>>> memset(mp->reserved, 0, sizeof(mp->reserved));
>>> return 0;
>>> }
>>> @@ -769,6 +787,14 @@ int vivid_s_fmt_vid_cap(struct file *file, void *priv,
>>> if (vivid_is_sdtv_cap(dev))
>>> dev->tv_field_cap = mp->field;
>>> tpg_update_mv_step(&dev->tpg);
>>> + dev->tpg.colorspace = mp->colorspace;
>>> + dev->tpg.xfer_func = mp->xfer_func;
>>> + if (dev->fmt_cap->color_enc == TGP_COLOR_ENC_YCBCR)
>>> + dev->tpg.ycbcr_enc = mp->ycbcr_enc;
>>> + else
>>> + dev->tpg.hsv_enc = mp->hsv_enc;
>>> + dev->tpg.quantization = mp->quantization;
>>> +
>>> return 0;
>>> }
>>>
>>> diff --git a/drivers/media/test-drivers/vivid/vivid-vid-common.c b/drivers/media/test-drivers/vivid/vivid-vid-common.c
>>> index 76b0be670ebb..19701fe72030 100644
>>> --- a/drivers/media/test-drivers/vivid/vivid-vid-common.c
>>> +++ b/drivers/media/test-drivers/vivid/vivid-vid-common.c
>>> @@ -920,6 +920,31 @@ int vivid_enum_fmt_vid(struct file *file, void *priv,
>>> fmt = &vivid_formats[f->index];
>>>
>>> f->pixelformat = fmt->fourcc;
>>> +
>>> + if (f->type != V4L2_BUF_TYPE_VIDEO_CAPTURE &&
>>> + f->type != V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE)
>>> + return 0;
>>> + /*
>>> + * For capture devices, we support the CSC API.
>>> + * We allow userspace to:
>>> + * 1. set the colorspace
>>> + * 2. set the xfer_func
>>> + * 3. set the ycbcr_enc on YUV formats
>>> + * 4. set the hsv_enc on HSV formats
>>> + * 5. set the quantization on YUV and RGB formats
>>> + */
>>> + f->flags |= V4L2_FMT_FLAG_CSC_COLORSPACE;
>>> + f->flags |= V4L2_FMT_FLAG_CSC_XFER_FUNC;
>>> +
>>> + if (fmt->color_enc == TGP_COLOR_ENC_YCBCR) {
>>> + f->flags |= V4L2_FMT_FLAG_CSC_YCBCR_ENC;
>>> + f->flags |= V4L2_FMT_FLAG_CSC_QUANTIZATION;
>>> + } else if (fmt->color_enc == TGP_COLOR_ENC_HSV) {
>>> + f->flags |= V4L2_FMT_FLAG_CSC_HSV_ENC;
>>> + } else if (fmt->color_enc == TGP_COLOR_ENC_RGB) {
>>> + f->flags |= V4L2_FMT_FLAG_CSC_QUANTIZATION;
>>> + }
>>> +
>>> return 0;
>>> }
>>>
>>> diff --git a/include/media/v4l2-common.h b/include/media/v4l2-common.h
>>> index 150ee16ebd81..a3083529b698 100644
>>> --- a/include/media/v4l2-common.h
>>> +++ b/include/media/v4l2-common.h
>>> @@ -539,4 +539,33 @@ static inline void v4l2_buffer_set_timestamp(struct v4l2_buffer *buf,
>>> buf->timestamp.tv_usec = ts.tv_nsec / NSEC_PER_USEC;
>>> }
>>>
>>> +static inline bool v4l2_is_colorspace_valid(__u32 colorspace)
>>> +{
>>> + return colorspace > V4L2_COLORSPACE_DEFAULT &&
>>> + colorspace <= V4L2_COLORSPACE_DCI_P3;
>>> +}
>>> +
>>> +static inline bool v4l2_is_xfer_func_valid(__u32 xfer_func)
>>> +{
>>> + return xfer_func > V4L2_XFER_FUNC_DEFAULT &&
>>> + xfer_func <= V4L2_XFER_FUNC_SMPTE2084;
>>> +}
>>> +
>>> +static inline bool v4l2_is_ycbcr_enc_valid(__u8 ycbcr_enc)
>>> +{
>>> + return ycbcr_enc > V4L2_YCBCR_ENC_DEFAULT &&
>>> + ycbcr_enc <= V4L2_YCBCR_ENC_SMPTE240M;
>>> +}
>>> +
>>> +static inline bool v4l2_is_hsv_enc_valid(__u8 hsv_enc)
>>> +{
>>> + return hsv_enc == V4L2_HSV_ENC_180 || hsv_enc == V4L2_HSV_ENC_256;
>>> +}
>>> +
>>> +static inline bool v4l2_is_quant_valid(__u8 quantization)
>>> +{
>>> + return quantization == V4L2_QUANTIZATION_FULL_RANGE ||
>>> + quantization == V4L2_QUANTIZATION_LIM_RANGE;
>>> +}
>>> +
>>> #endif /* V4L2_COMMON_H_ */
>>> -------------------------------------------------------------------------------
>>>
>>>
>>> Git bisection log:
>>>
>>> -------------------------------------------------------------------------------
>>> git bisect start
>>> # good: [01cc2ec6ea044731e939e5e47f7e115b86f49465] media: atomisp: cleanup __printf() atributes on printk messages
>>> git bisect good 01cc2ec6ea044731e939e5e47f7e115b86f49465
>>> # bad: [c0c8db7bc95397f32fe60ff8b07c746a69fb22de] media: MAINTAINERS: remove Maxime Jourdan as maintainer of Amlogic VDEC
>>> git bisect bad c0c8db7bc95397f32fe60ff8b07c746a69fb22de
>>> # bad: [aaffa0126a111d65f4028c503c76192d4cc93277] media: rcar-vin: Fix a reference count leak.
>>> git bisect bad aaffa0126a111d65f4028c503c76192d4cc93277
>>> # bad: [25d8cf786d34b5167f2c01e092eeedcb0ae58628] media: staging: rkisp1: rsz: set flags to 0 in enum_mbus_code cb
>>> git bisect bad 25d8cf786d34b5167f2c01e092eeedcb0ae58628
>>> # good: [327296920f9dedfc6ba4ef8f5a686c9667c65f38] media: mtk-vcodec: venc: set OUTPUT buffers field to V4L2_FIELD_NONE
>>> git bisect good 327296920f9dedfc6ba4ef8f5a686c9667c65f38
>>> # good: [21d387b8d372f859d9e87fdcc7c3b4a432737f4d] media: mx2_emmaprp: Fix memleak in emmaprp_probe
>>> git bisect good 21d387b8d372f859d9e87fdcc7c3b4a432737f4d
>>> # good: [b38c73ca1c213bbf8a872b334a6bb835becfaba5] media: v4l2: add support for colorspace conversion API (CSC) for video capture
>>> git bisect good b38c73ca1c213bbf8a872b334a6bb835becfaba5
>>> # bad: [62aacfa9bf93f94f6949338e0c7a2ed4c4bd2c2a] media: v4l2: extend the CSC API to subdevice.
>>> git bisect bad 62aacfa9bf93f94f6949338e0c7a2ed4c4bd2c2a
>>> # bad: [2f491463497ad43bc06968a334747c6b6b20fc74] media: vivid: Add support to the CSC API
>>> git bisect bad 2f491463497ad43bc06968a334747c6b6b20fc74
>>> # first bad commit: [2f491463497ad43bc06968a334747c6b6b20fc74] media: vivid: Add support to the CSC API
>>> -------------------------------------------------------------------------------
>>>
>>>
>>> -=-=-=-=-=-=-=-=-=-=-=-
>>> Groups.io Links: You receive all messages sent to this group.
>>> View/Reply Online (#1739): https://groups.io/g/kernelci-results/message/1739
>>> Mute This Topic: https://groups.io/mt/77191137/924702
>>> Group Owner: kernelci-results+owner@...ups.io
>>> Unsubscribe: https://groups.io/g/kernelci-results/unsub [guillaume.tucker@...labora.com]
>>> -=-=-=-=-=-=-=-=-=-=-=-
>>>
>>>
>>
>
Powered by blists - more mailing lists