linux-kernel - [PATCH 0/3] DT validation time improvements

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-Id: <20200814173417.2322509-1-robh@kernel.org>
Date:   Fri, 14 Aug 2020 11:34:14 -0600
From:   Rob Herring <robh@...nel.org>
To:     devicetree@...r.kernel.org
Cc:     linux-kernel@...r.kernel.org,
        Andrei Ziureaev <andrei.ziureaev@....com>,
        Masahiro Yamada <masahiroy@...nel.org>
Subject: [PATCH 0/3] DT validation time improvements

The time to run dt_binding_check and dtbs_check has gotten
significantly slower as the number of schemas has increased. There's 2 
main factors causing validation time on each file to be slow. 

The first is python start-up time. This is a common problem for python 
without much of a solution other than minimizing module imports. 
Eliminating some imports was possible for dt-extract-example, but not 
the other tools. Validating multiple files in a single call is the 
simplest solution. The downside of processing multiple files in one call 
is losing make dependency handling. This is not too important for 
dt-doc-validate as the validation time is <10 sec. 

The 2nd factor is processed-schema*.yaml is now ~2MB and around 2 sec to 
parse (which is done for every .dts and example). Switching 
processed-schema*.yaml to JSON is much faster to parse 

The overall result of these changes is a 2x improvement to dtbs_check 
and a 4-5x improvement to dt_binding_check.

Rob

Andrei Ziureaev (1):
  dt-bindings: Use json for processed-schema*

Rob Herring (2):
  dt-bindings: Bump minimum version of dtschema to 2020.8
  dt-bindings: Validate DT binding schema in a single call

 Documentation/devicetree/bindings/.gitignore |  1 +
 Documentation/devicetree/bindings/Makefile   | 45 ++++++++++++--------
 scripts/Makefile.lib                         |  2 +-
 3 files changed, 29 insertions(+), 19 deletions(-)

-- 
2.25.1