| lists.openwall.net | lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC | |
|
Open Source and information security mailing list archives
| ||
|
Message-Id: <20211106183802.893285-1-aford173@gmail.com>
Date: Sat, 6 Nov 2021 13:37:56 -0500
From: Adam Ford <aford173@...il.com>
To: linux-media@...r.kernel.org
Cc: tharvey@...eworks.com, frieder.schrempf@...tron.de,
marek.vasut@...il.com, jagan@...rulasolutions.com,
aford@...conembedded.com, cstevens@...conembedded.com,
Adam Ford <aford173@...il.com>,
Ezequiel Garcia <ezequiel@...guardiasur.com.ar>,
Philipp Zabel <p.zabel@...gutronix.de>,
Mauro Carvalho Chehab <mchehab@...nel.org>,
Rob Herring <robh+dt@...nel.org>,
Shawn Guo <shawnguo@...nel.org>,
Sascha Hauer <s.hauer@...gutronix.de>,
Pengutronix Kernel Team <kernel@...gutronix.de>,
Fabio Estevam <festevam@...il.com>,
NXP Linux Team <linux-imx@....com>,
Greg Kroah-Hartman <gregkh@...uxfoundation.org>,
Heiko Stuebner <heiko@...ech.de>,
Lucas Stach <l.stach@...gutronix.de>,
Joakim Zhang <qiangqing.zhang@....com>,
Alice Guo <alice.guo@....com>, Peng Fan <peng.fan@....com>,
linux-rockchip@...ts.infradead.org (open list:HANTRO VPU CODEC DRIVER),
devicetree@...r.kernel.org (open list:OPEN FIRMWARE AND FLATTENED
DEVICE TREE BINDINGS),
linux-arm-kernel@...ts.infradead.org (moderated list:ARM/FREESCALE IMX
/ MXC ARM ARCHITECTURE), linux-kernel@...r.kernel.org (open list),
linux-staging@...ts.linux.dev (open list:STAGING SUBSYSTEM)
Subject: [RFC 0/5] arm64: imx8mm: Enable Hantro VPUs
The i.MX8M has two Hantro video decoders, called G1 and G2 which appear
to be related to the video decoders used on the i.MX8MQ, but because of
how the Mini handles the power domains, the VPU driver does not need to
handle all the functions, so a new compatible flag is required.
The i.MX8MM also has a Hantro video encoder which appears to be similar
to what's already supported in some Rockchip devices. As part of the
series, some of the video format names are re-named to be more generic.
The VPUs appear as media devices:
Media device information
------------------------
driver hantro-vpu
model hantro-vpu
serial
bus info platform: hantro-vpu
hw revision 0x0
driver version 5.15.0
Device topology
- entity 1: nxp,imx8mm-vpu-dec-source (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video1
pad0: Source
-> "nxp,imx8mm-vpu-dec-proc":0 [ENABLED,IMMUTABLE]
- entity 3: nxp,imx8mm-vpu-dec-proc (2 pads, 2 links)
type Node subtype Unknown flags 0
pad0: Sink
<- "nxp,imx8mm-vpu-dec-source":0 [ENABLED,IMMUTABLE]
pad1: Source
-> "nxp,imx8mm-vpu-dec-sink":0 [ENABLED,IMMUTABLE]
- entity 6: nxp,imx8mm-vpu-dec-sink (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video1
pad0: Sink
<- "nxp,imx8mm-vpu-dec-proc":1 [ENABLED,IMMUTABLE]
Media device information
------------------------
driver hantro-vpu
model hantro-vpu
serial
bus info platform: hantro-vpu
hw revision 0x0
driver version 5.15.0
Device topology
- entity 1: nxp,imx8mm-vpu-g2-dec-source (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video2
pad0: Source
-> "nxp,imx8mm-vpu-g2-dec-proc":0 [ENABLED,IMMUTABLE]
- entity 3: nxp,imx8mm-vpu-g2-dec-proc (2 pads, 2 links)
type Node subtype Unknown flags 0
pad0: Sink
<- "nxp,imx8mm-vpu-g2-dec-source":0 [ENABLED,IMMUTABLE]
pad1: Source
-> "nxp,imx8mm-vpu-g2-dec-sink":0 [ENABLED,IMMUTABLE]
- entity 6: nxp,imx8mm-vpu-g2-dec-sink (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video2
pad0: Sink
<- "nxp,imx8mm-vpu-g2-dec-proc":1 [ENABLED,IMMUTABLE]
Media device information
------------------------
driver hantro-vpu
model hantro-vpu
serial
bus info platform: hantro-vpu
hw revision 0x0
driver version 5.15.0
Device topology
- entity 1: nxp,imx8mm-vpu-h1-enc-source (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video3
pad0: Source
-> "nxp,imx8mm-vpu-h1-enc-proc":0 [ENABLED,IMMUTABLE]
- entity 3: nxp,imx8mm-vpu-h1-enc-proc (2 pads, 2 links)
type Node subtype Unknown flags 0
pad0: Sink
<- "nxp,imx8mm-vpu-h1-enc-source":0 [ENABLED,IMMUTABLE]
pad1: Source
-> "nxp,imx8mm-vpu-h1-enc-sink":0 [ENABLED,IMMUTABLE]
- entity 6: nxp,imx8mm-vpu-h1-enc-sink (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video3
pad0: Sink
<- "nxp,imx8mm-vpu-h1-enc-proc":1 [ENABLED,IMMUTABLE]
This is an RFC because I don't have functional video on my system yet,
and I'm hoping there might be people who do and can help test this.
I have only tested this far enough to see they enumerate and appear
as /dev/videoX and /dev/mediaX devices.
I am also curious to know if/what gstreamer plugins are necessary. In
NXP's custom kernel, there are IMX-specific plugins, and I was hoping there
would be more generic plugins that I can use to test. I am hoping some
of the linux-media experts might chime in on how to best test.
Lastly, I didn't update any device tree binding YAML files, because
I know there have been some discussions about the power domains on the
imx8mq, and I wasn't sure if the imx8mm should get a separate YAML file
or if the existing one for te imx8mq should just be modified.
This will likely require the following series in order to apply correctly:
https://patchwork.kernel.org/project/linux-arm-kernel/list/?series=576407
Adam Ford (5):
media: hantro: Add support for i.MX8M Mini
arm64: dts: imx8mm: Enable VPU-G1 and VPU-G2
media: hantro: Rename ROCKCHIP_VPU_ENC_FMT to HANTRO_VPU_ENC_FMT
media: hantro: Add H1 encoder support on i.MX8M Mini
arm64: dts: imx8mm: Enable Hantro H1 Encoder
arch/arm64/boot/dts/freescale/imx8mm.dtsi | 61 ++++++++
drivers/staging/media/hantro/hantro_drv.c | 3 +
drivers/staging/media/hantro/hantro_hw.h | 19 ++-
drivers/staging/media/hantro/imx8m_vpu_hw.c | 143 ++++++++++++++++++
.../staging/media/hantro/rockchip_vpu_hw.c | 26 ++--
5 files changed, 231 insertions(+), 21 deletions(-)
--
2.32.0
Powered by blists - more mailing lists