linux-kernel - [PATCH v2 0/8] vt: more Unicode handling changes

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives

Hash Suite: Windows password security audit tool. GUI, reports in PDF.

[<prev] [next>] [thread-next>] [day] [month] [year] [list]

Message-ID: <20250507141535.40655-1-nico@fluxnic.net>
Date: Wed,  7 May 2025 10:13:15 -0400
From: Nicolas Pitre <nico@...xnic.net>
To: Greg Kroah-Hartman <gregkh@...uxfoundation.org>,
	Jiri Slaby <jirislaby@...nel.org>
Cc: Nicolas Pitre <npitre@...libre.com>,
	linux-serial@...r.kernel.org,
	linux-kernel@...r.kernel.org
Subject: [PATCH v2 0/8] vt: more Unicode handling changes

The Linux VT console has many problems with regards to proper Unicode
handling. A first set of patches was submitted here:

https://lore.kernel.org/all/20250417184849.475581-1-nico@fluxnic.net/

Those patches are currently in Greg's tty-next branch.

The first 2 patches in the following series contain fixes for those
already-applied patches.

Remaining patches introduce tables that map complex Unicode characters
to simpler fallback characters for terminal display when corresponding
glyphs are unavailable. Only the subset of Unicode that can reasonably
be substituted by ASCII/Latin-1 characters is covered. Substitution may
not be as good as the actual glyphs but still way more helpful than squared
question marks.

This applies on top of tty-next currently at commit 5ee558c5d9e9.

Changes from v1 (https://lore.kernel.org/all/20250505170021.29944-1-nico@fluxnic.net/):

- Reworked the gen_ucs_fallback_table.py script to be based on unidecode.
  This creates a much more comprehensive fallback table with a much smaller
  script.

- Changed the fallback table encoding to be more space efficient.

- Addressed style comments from Jiri.

diffstat:
 drivers/tty/vt/.gitignore                   |    1 +
 drivers/tty/vt/Makefile                     |    8 +-
 drivers/tty/vt/gen_ucs_fallback_table.py    |  360 +++
 drivers/tty/vt/ucs.c                        |  102 +-
 drivers/tty/vt/ucs_fallback_table.h_shipped | 3346 +++++++++++++++++++++
 drivers/tty/vt/vt.c                         |   93 +-
 include/linux/consolemap.h                  |    6 +
 7 files changed, 3875 insertions(+), 41 deletions(-)