linux-kernel - Re: [PATCH v3 6/6] drm/ci: update xfails for the new testlist

lists.openwall.net		lists / announce owl-users owl-dev john-users john-dev passwdqc-users yescrypt popa3d-users / oss-security kernel-hardening musl sabotage tlsify passwords / crypt-dev xvendor / Bugtraq Full-Disclosure linux-kernel linux-netdev linux-ext4 linux-hardening linux-cve-announce PHC
Open Source and information security mailing list archives
Hash Suite: Windows password security audit tool. GUI, reports in PDF.
[<prev] [next>] [<thread-prev] [thread-next>] [day] [month] [year] [list]
Date: Wed, 29 May 2024 15:19:43 +0530
From: Vignesh Raman <vignesh.raman@...labora.com>
To: Dmitry Baryshkov <dmitry.baryshkov@...aro.org>
Cc: dri-devel@...ts.freedesktop.org, daniels@...labora.com,
 helen.koike@...labora.com, airlied@...il.com, daniel@...ll.ch,
 robdclark@...il.com, david.heidelberg@...labora.com,
 guilherme.gallo@...labora.com, sergi.blanch.torne@...labora.com,
 mcanal@...lia.com, linux-mediatek@...ts.infradead.org,
 linux-amlogic@...ts.infradead.org, linux-rockchip@...ts.infradead.org,
 amd-gfx@...ts.freedesktop.org, linux-arm-msm@...r.kernel.org,
 intel-gfx@...ts.freedesktop.org, virtualization@...ts.linux-foundation.org,
 linux-kernel@...r.kernel.org
Subject: Re: [PATCH v3 6/6] drm/ci: update xfails for the new testlist

Hi Dmitry,

On 29/05/24 13:30, Dmitry Baryshkov wrote:
> On Wed, May 29, 2024 at 08:10:49AM +0530, Vignesh Raman wrote:
>> Now the testlist is used from IGT build, so update
>> xfails with the new testlist.
>>
>> Set the timeout of all i915 jobs to 1h30m since some jobs
>> takes more than 1 hour to complete.
>>
>> Reviewed-by: Dmitry Baryshkov <dmitry.baryshkov@...aro.org>
> 
> This had an explicit '# msm testlist' at the end. Please don't drop
> important parts of tags. I didn't review fails/flakes for other
> platforms.

Sorry I missed it. Will ask Helen to add the tag back when she merges this.

Regards,
Vignesh

> 
>> Signed-off-by: Vignesh Raman <vignesh.raman@...labora.com>
>> ---
>>
>> v2:
>>    - Set the timeout of all i915 jobs to 1h30m and updated expectations file.
>>
>> v3:
>>    - Add a link to the email reporting the flaky tests to the maintainers.
>>
>> ---
>>   drivers/gpu/drm/ci/test.yml                   |   6 +-
>>   .../gpu/drm/ci/xfails/amdgpu-stoney-fails.txt |  41 ++--
>>   .../drm/ci/xfails/amdgpu-stoney-flakes.txt    |   7 +
>>   .../gpu/drm/ci/xfails/amdgpu-stoney-skips.txt |  18 ++
>>   drivers/gpu/drm/ci/xfails/i915-amly-fails.txt |  31 ++++
>>   .../gpu/drm/ci/xfails/i915-amly-flakes.txt    |   9 +
>>   drivers/gpu/drm/ci/xfails/i915-amly-skips.txt |  11 ++
>>   drivers/gpu/drm/ci/xfails/i915-apl-fails.txt  |  46 +++--
>>   drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt |   6 +
>>   drivers/gpu/drm/ci/xfails/i915-apl-skips.txt  |  15 ++
>>   drivers/gpu/drm/ci/xfails/i915-cml-fails.txt  |  38 ++++
>>   drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt |   6 +
>>   drivers/gpu/drm/ci/xfails/i915-cml-skips.txt  |  14 ++
>>   drivers/gpu/drm/ci/xfails/i915-glk-fails.txt  |  41 +++-
>>   drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt |   7 +
>>   drivers/gpu/drm/ci/xfails/i915-glk-skips.txt  |  15 ++
>>   drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt  |  42 ++---
>>   drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt |   7 +-
>>   drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt  |  25 +++
>>   drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt  |  77 ++++----
>>   drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt  |  17 ++
>>   drivers/gpu/drm/ci/xfails/i915-whl-fails.txt  |  63 ++++---
>>   drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt |   6 +
>>   drivers/gpu/drm/ci/xfails/i915-whl-skips.txt  |  11 ++
>>   .../drm/ci/xfails/mediatek-mt8173-fails.txt   |  30 ++-
>>   .../drm/ci/xfails/mediatek-mt8173-flakes.txt  |  11 ++
>>   .../drm/ci/xfails/mediatek-mt8173-skips.txt   |   4 +
>>   .../drm/ci/xfails/mediatek-mt8183-fails.txt   |  21 +--
>>   .../drm/ci/xfails/mediatek-mt8183-skips.txt   |   4 +
>>   .../gpu/drm/ci/xfails/meson-g12b-fails.txt    |  24 +--
>>   .../gpu/drm/ci/xfails/meson-g12b-skips.txt    |   4 +
>>   .../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |  12 +-
>>   .../gpu/drm/ci/xfails/msm-apq8016-skips.txt   |   4 +
>>   .../gpu/drm/ci/xfails/msm-apq8096-fails.txt   |   7 +
>>   .../gpu/drm/ci/xfails/msm-apq8096-flakes.txt  |   6 +
>>   .../gpu/drm/ci/xfails/msm-apq8096-skips.txt   |  12 ++
>>   .../msm-sc7180-trogdor-kingoftown-fails.txt   | 175 +++++++++++++++++-
>>   .../msm-sc7180-trogdor-kingoftown-flakes.txt  |   8 +
>>   .../msm-sc7180-trogdor-kingoftown-skips.txt   |   7 +
>>   ...sm-sc7180-trogdor-lazor-limozeen-fails.txt | 175 +++++++++++++++++-
>>   ...m-sc7180-trogdor-lazor-limozeen-flakes.txt |   6 +
>>   ...sm-sc7180-trogdor-lazor-limozeen-skips.txt |   4 +
>>   .../gpu/drm/ci/xfails/msm-sdm845-fails.txt    |  38 +---
>>   .../gpu/drm/ci/xfails/msm-sdm845-flakes.txt   |  25 ++-
>>   .../gpu/drm/ci/xfails/msm-sdm845-skips.txt    |   7 +
>>   .../drm/ci/xfails/rockchip-rk3288-fails.txt   |  62 +------
>>   .../drm/ci/xfails/rockchip-rk3288-skips.txt   |   4 +
>>   .../drm/ci/xfails/rockchip-rk3399-fails.txt   |  83 +--------
>>   .../drm/ci/xfails/rockchip-rk3399-flakes.txt  |  13 +-
>>   .../drm/ci/xfails/rockchip-rk3399-skips.txt   |   4 +
>>   drivers/gpu/drm/ci/xfails/update-xfails.py    |   4 +-
>>   .../drm/ci/xfails/virtio_gpu-none-fails.txt   |  94 +++++++---
>>   .../drm/ci/xfails/virtio_gpu-none-skips.txt   |   4 +
>>   53 files changed, 1023 insertions(+), 388 deletions(-)
>>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
>>   create mode 100644 drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
>>
>> diff --git a/drivers/gpu/drm/ci/test.yml b/drivers/gpu/drm/ci/test.yml
>> index 2615f67f6aa3..322cce714657 100644
>> --- a/drivers/gpu/drm/ci/test.yml
>> +++ b/drivers/gpu/drm/ci/test.yml
>> @@ -191,6 +191,7 @@ rockchip:rk3399:
>>     extends:
>>       - .lava-igt:x86_64
>>     stage: i915
>> +  timeout: "1h30m"
>>     variables:
>>       DRIVER_NAME: i915
>>       DTB: ""
>> @@ -201,7 +202,6 @@ i915:apl:
>>     extends:
>>       - .i915
>>     parallel: 3
>> -  timeout: "1h30m"
>>     variables:
>>       DEVICE_TYPE: asus-C523NA-A20057-coral
>>       GPU_VERSION: apl
>> @@ -211,7 +211,6 @@ i915:glk:
>>     extends:
>>       - .i915
>>     parallel: 2
>> -  timeout: "1h30m"
>>     variables:
>>       DEVICE_TYPE: hp-x360-12b-ca0010nr-n4020-octopus
>>       GPU_VERSION: glk
>> @@ -221,7 +220,6 @@ i915:amly:
>>     extends:
>>       - .i915
>>     parallel: 2
>> -  timeout: "1h30m"
>>     variables:
>>       DEVICE_TYPE: asus-C433TA-AJ0005-rammus
>>       GPU_VERSION: amly
>> @@ -240,7 +238,6 @@ i915:whl:
>>     extends:
>>       - .i915
>>     parallel: 2
>> -  timeout: "1h30m"
>>     variables:
>>       DEVICE_TYPE: dell-latitude-5400-8665U-sarien
>>       GPU_VERSION: whl
>> @@ -250,7 +247,6 @@ i915:cml:
>>     extends:
>>       - .i915
>>     parallel: 2
>> -  timeout: "1h30m"
>>     variables:
>>       DEVICE_TYPE: asus-C436FA-Flip-hatch
>>       GPU_VERSION: cml
>> diff --git a/drivers/gpu/drm/ci/xfails/amdgpu-stoney-fails.txt b/drivers/gpu/drm/ci/xfails/amdgpu-stoney-fails.txt
>> index ea87dc46bc2b..e8c2f4044a92 100644
>> --- a/drivers/gpu/drm/ci/xfails/amdgpu-stoney-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/amdgpu-stoney-fails.txt
>> @@ -1,27 +1,40 @@
>> +amdgpu/amd_abm@..._enabled,Fail
>> +amdgpu/amd_abm@..._gradual,Fail
>> +amdgpu/amd_abm@...klight_monotonic_abm,Fail
>> +amdgpu/amd_abm@...klight_monotonic_basic,Fail
>> +amdgpu/amd_assr@...r-links,Fail
>> +amdgpu/amd_assr@...r-links-dpms,Fail
>> +amdgpu/amd_mall@...tic-screen,Crash
>> +amdgpu/amd_mode_switch@...e-switch-first-last-pipe-2,Crash
>> +amdgpu/amd_plane@...-pan-nv12,Fail
>> +amdgpu/amd_plane@...-pan-p010,Fail
>> +amdgpu/amd_plane@...-pan-rgb,Crash
>> +amdgpu/amd_plane@...-scale-nv12,Fail
>> +amdgpu/amd_plane@...-scale-p010,Fail
>> +amdgpu/amd_plane@...-scale-rgb,Crash
>> +amdgpu/amd_plane@...-swizzle-toggle,Fail
>> +amdgpu/amd_uvd_dec@...gpu_uvd_decode,Fail
>> +dumb_buffer@...alid-bpp,Fail
>>   kms_addfb_basic@...-pitch-65536,Fail
>>   kms_addfb_basic@...too-small,Fail
>>   kms_addfb_basic@...-high,Fail
>> -kms_async_flips@...nc-flip-with-page-flip-events,Fail
>> -kms_async_flips@crc,Fail
>> -kms_async_flips@...alid-async-flip,Fail
>>   kms_atomic_transition@...ne-all-modeset-transition-internal-panels,Fail
>>   kms_atomic_transition@...ne-all-transition,Fail
>>   kms_atomic_transition@...ne-all-transition-nonblocking,Fail
>>   kms_atomic_transition@...ne-toggle-modeset-transition,Fail
>>   kms_atomic_transition@...ne-use-after-nonblocking-unbind,Fail
>> -kms_bw@...ear-tiling-1-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-1-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-3-displays-1920x1080p,Fail
>> -kms_color@...amma,Fail
>> +kms_cursor_crc@...sor-onscreen-64x21,Fail
>> +kms_cursor_crc@...sor-onscreen-64x64,Fail
>> +kms_cursor_crc@...sor-random-64x21,Fail
>> +kms_cursor_crc@...sor-random-64x64,Fail
>>   kms_cursor_crc@...sor-size-change,Fail
>> -kms_cursor_crc@...e-A-cursor-size-change,Fail
>> -kms_cursor_crc@...e-B-cursor-size-change,Fail
>> +kms_cursor_crc@...sor-sliding-64x21,Fail
>> +kms_cursor_crc@...sor-sliding-64x64,Fail
>>   kms_flip@...p-vs-modeset-vs-hang,Fail
>>   kms_flip@...p-vs-panning-vs-hang,Fail
>> -kms_hdr@...-switch,Fail
>> -kms_hdr@...-switch-dpms,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_plane@...el-format,Fail
>> -kms_plane_multiple@...mic-pipe-A-tiling-none,Fail
>> -kms_rmfb@...se-fd,Fail
>> +kms_plane_cursor@...mary,Fail
>>   kms_rotation_crc@...mary-rotation-180,Fail
>> +perf@...5-ref-count,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/amdgpu-stoney-flakes.txt b/drivers/gpu/drm/ci/xfails/amdgpu-stoney-flakes.txt
>> index 6faf75e667d3..ea512ff8c352 100644
>> --- a/drivers/gpu/drm/ci/xfails/amdgpu-stoney-flakes.txt
>> +++ b/drivers/gpu/drm/ci/xfails/amdgpu-stoney-flakes.txt
>> @@ -1 +1,8 @@
>> +# Board Name: hp-11A-G6-EE-grunt
>> +# Bug Report: https://lore.kernel.org/amd-gfx/3542730f-b8d7-404d-a947-b7a5e95d661c@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>>   kms_async_flips@...nc-flip-with-page-flip-events
>> +kms_async_flips@crc
>> +kms_plane@...el-format-source-clamping
>> diff --git a/drivers/gpu/drm/ci/xfails/amdgpu-stoney-skips.txt b/drivers/gpu/drm/ci/xfails/amdgpu-stoney-skips.txt
>> index 21d26d5e67c2..3a2ce45d3cb9 100644
>> --- a/drivers/gpu/drm/ci/xfails/amdgpu-stoney-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/amdgpu-stoney-skips.txt
>> @@ -13,3 +13,21 @@ panfrost_.*
>>   gem_.*
>>   i915_.*
>>   xe_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +amdgpu/amd_module_load@...oad
>> +core_hotunplug.*
>> +
>> +# GPU reset seen and it hangs the machine
>> +amdgpu/amd_deadlock@...gpu-deadlock-sdma
>> +amdgpu/amd_deadlock@...gpu-gfx-illegal-reg-access
>> +amdgpu/amd_dispatch@...gpu-reset-test-gfx-with-IP-GFX-and-COMPUTE
>> +
>> +# Hangs the machine and timeout occurs
>> +amdgpu/amd_pci_unplug@...gpu_hotunplug_simple
>> +amdgpu/amd_pci_unplug@...gpu_hotunplug_with_cs
>> +amdgpu/amd_pci_unplug@...gpu_hotunplug_with_exported_bo
>> +amdgpu/amd_pci_unplug@...gpu_hotunplug_with_exported_fence
>> +amdgpu/amd_vrr_range@...esync-parsing
>> +device_reset.*
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-amly-fails.txt b/drivers/gpu/drm/ci/xfails/i915-amly-fails.txt
>> index 59438e4df86e..6641520ac587 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-amly-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-amly-fails.txt
>> @@ -1,3 +1,16 @@
>> +core_setmaster@...ter-drop-set-user,Fail
>> +core_setmaster_vs_auth,Fail
>> +i915_module_load@...d,Fail
>> +i915_module_load@...oad,Fail
>> +i915_module_load@...oad-no-display,Fail
>> +i915_module_load@...ize-bar,Fail
>> +i915_pm_rpm@...-execbuf-stress,Timeout
>> +i915_pm_rpm@...ule-reload,Fail
>> +kms_async_flips@...alid-async-flip,Timeout
>> +kms_atomic_transition@...eset-transition-fencing,Timeout
>> +kms_ccs@...-primary-rotation-180-yf-tiled-ccs,Timeout
>> +kms_fb_coherency@...set-crc,Crash
>> +kms_flip@...p-vs-dpms-off-vs-modeset,Timeout
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-upscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-downscaling,Fail
>> @@ -20,7 +33,25 @@ kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-downscaling,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_plane_alpha_blend@...ha-basic,Fail
>>   kms_plane_alpha_blend@...ha-opaque-fb,Fail
>>   kms_plane_alpha_blend@...ha-transparent-fb,Fail
>>   kms_plane_alpha_blend@...stant-alpha-max,Fail
>> +kms_plane_scaling@...ne-scaler-with-clipping-clamping-rotation,Timeout
>> +kms_pm_rpm@...eset-lpsp-stress,Timeout
>> +kms_pm_rpm@...eset-stress-extra-wait,Timeout
>> +kms_pm_rpm@...versal-planes,Timeout
>> +kms_pm_rpm@...versal-planes-dpms,Timeout
>> +perf@...5-ref-count,Fail
>> +perf_pmu@...ule-unload,Fail
>> +perf_pmu@rc6,Crash
>> +sysfs_heartbeat_interval@...g,Timeout
>> +sysfs_heartbeat_interval@off,Timeout
>> +sysfs_preempt_timeout@off,Timeout
>> +sysfs_timeslice_duration@off,Timeout
>> +xe_module_load@...ce-load,Fail
>> +xe_module_load@...d,Fail
>> +xe_module_load@...y-reload,Fail
>> +xe_module_load@...oad,Fail
>> +xe_module_load@...oad-no-display,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt b/drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
>> new file mode 100644
>> index 000000000000..0a76547a103d
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/i915-amly-flakes.txt
>> @@ -0,0 +1,9 @@
>> +# Board Name: asus-C433TA-AJ0005-rammus
>> +# Bug Report: https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +i915_hangman@...ine-engine-error
>> +i915_hangman@...engine-hang
>> +kms_async_flips@crc
>> +kms_universal_plane@...sor-fb-leak
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-amly-skips.txt b/drivers/gpu/drm/ci/xfails/i915-amly-skips.txt
>> index 1e80987cf584..5663ed0420a7 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-amly-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-amly-skips.txt
>> @@ -11,3 +11,14 @@ panfrost_.*
>>   ^v3d.*
>>   ^vc4.*
>>   ^vmwgfx*
>> +
>> +# GEM tests takes ~1000 hours, so skip it
>> +gem_.*
>> +
>> +# Hangs the machine and timeout occurs
>> +i915_pm_rc6_residency.*
>> +i915_suspend.*
>> +kms_scaling_modes.*
>> +
>> +# Kernel panic
>> +drm_fdinfo.*
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-apl-fails.txt b/drivers/gpu/drm/ci/xfails/i915-apl-fails.txt
>> index 2e3b7c5dac3c..e612281149aa 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-apl-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-apl-fails.txt
>> @@ -1,13 +1,7 @@
>> -kms_3d,Timeout
>> -kms_bw@...ear-tiling-2-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-2-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-3-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-3-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-3-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-4-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-4-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-4-displays-3840x2160p,Fail
>> +i915_module_load@...d,Fail
>> +i915_module_load@...oad,Fail
>> +i915_module_load@...oad-no-display,Fail
>> +i915_module_load@...ize-bar,Fail
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-upscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-downscaling,Fail
>> @@ -30,18 +24,30 @@ kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-upscaling,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_plane_alpha_blend@...ha-basic,Fail
>>   kms_plane_alpha_blend@...ha-opaque-fb,Fail
>>   kms_plane_alpha_blend@...ha-transparent-fb,Fail
>>   kms_plane_alpha_blend@...stant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-A-alpha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...e-A-alpha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...e-A-constant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-B-alpha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...e-B-alpha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...e-B-constant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-C-alpha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...e-C-alpha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...e-C-constant-alpha-max,Fail
>> +kms_pm_backlight@...ic-brightness,Fail
>> +kms_pm_backlight@...e,Fail
>> +kms_pm_backlight@...e-with-dpms,Fail
>> +kms_pm_rpm@...acy-planes,Timeout
>> +kms_pm_rpm@...acy-planes-dpms,Timeout
>> +kms_pm_rpm@...eset-stress-extra-wait,Timeout
>> +kms_pm_rpm@...versal-planes,Timeout
>> +kms_pm_rpm@...versal-planes-dpms,Timeout
>>   kms_sysfs_edid_timing,Fail
>> +perf@...5-ref-count,Fail
>> +perf@...-zero-reason,Timeout
>> +perf_pmu@...ule-unload,Fail
>> +perf_pmu@rc6,Crash
>> +sysfs_heartbeat_interval@...g,Timeout
>> +sysfs_heartbeat_interval@off,Timeout
>> +sysfs_preempt_timeout@off,Timeout
>> +sysfs_timeslice_duration@off,Timeout
>> +xe_module_load@...ce-load,Fail
>> +xe_module_load@...d,Fail
>> +xe_module_load@...y-reload,Fail
>> +xe_module_load@...oad,Fail
>> +xe_module_load@...oad-no-display,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt b/drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt
>> new file mode 100644
>> index 000000000000..cb010c153a6a
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/i915-apl-flakes.txt
>> @@ -0,0 +1,6 @@
>> +# Board Name: asus-C523NA-A20057-coral
>> +# Bug Report: https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +kms_fb_coherency@...set-crc
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-apl-skips.txt b/drivers/gpu/drm/ci/xfails/i915-apl-skips.txt
>> index 0104f2ffa8ba..ab588e7a447c 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-apl-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-apl-skips.txt
>> @@ -13,3 +13,18 @@ panfrost_.*
>>   ^v3d.*
>>   ^vc4.*
>>   ^vmwgfx*
>> +
>> +# GEM tests takes ~1000 hours, so skip it
>> +gem_.*
>> +
>> +# Hangs the machine and timeout occurs
>> +i915_pm_rc6_residency.*
>> +i915_suspend.*
>> +i915_pm_rpm.*
>> +device_reset.*
>> +api_intel_allocator.*
>> +kms_frontbuffer_tracking.*
>> +kms_ccs.*
>> +
>> +# Kernel panic
>> +drm_fdinfo.*
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-cml-fails.txt b/drivers/gpu/drm/ci/xfails/i915-cml-fails.txt
>> index 240ef8467c26..26cd62bbf30a 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-cml-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-cml-fails.txt
>> @@ -1,3 +1,19 @@
>> +core_setmaster@...ter-drop-set-user,Fail
>> +core_setmaster_vs_auth,Fail
>> +i915_module_load@...d,Fail
>> +i915_module_load@...oad,Fail
>> +i915_module_load@...oad-no-display,Fail
>> +i915_module_load@...ize-bar,Fail
>> +i915_pipe_stress@...ess-xrgb8888-untiled,Fail
>> +i915_pipe_stress@...ess-xrgb8888-ytiled,Fail
>> +i915_pm_rpm@...-execbuf-stress,Timeout
>> +i915_pm_rpm@...ule-reload,Fail
>> +i915_pm_rpm@...tem-suspend-execbuf,Timeout
>> +kms_async_flips@...alid-async-flip,Timeout
>> +kms_atomic_transition@...eset-transition-fencing,Timeout
>> +kms_ccs@...-primary-rotation-180-yf-tiled-ccs,Timeout
>> +kms_fb_coherency@...set-crc,Crash
>> +kms_flip@...p-vs-dpms-off-vs-modeset,Timeout
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-upscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-downscaling,Fail
>> @@ -20,11 +36,33 @@ kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-downscaling,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_plane_alpha_blend@...ha-basic,Fail
>>   kms_plane_alpha_blend@...ha-opaque-fb,Fail
>>   kms_plane_alpha_blend@...ha-transparent-fb,Fail
>>   kms_plane_alpha_blend@...stant-alpha-max,Fail
>>   kms_plane_alpha_blend@...stant-alpha-min,Fail
>> +kms_plane_scaling@...ne-scaler-with-clipping-clamping-rotation,Timeout
>> +kms_pm_rpm@...eset-stress-extra-wait,Timeout
>> +kms_pm_rpm@...versal-planes,Timeout
>> +kms_pm_rpm@...versal-planes-dpms,Timeout
>> +kms_psr2_sf@...-plane-move-sf-dmg-area,Timeout
>> +kms_psr2_sf@...rlay-plane-update-continuous-sf,Fail
>> +kms_psr2_sf@...rlay-plane-update-sf-dmg-area,Fail
>> +kms_psr2_sf@...mary-plane-update-sf-dmg-area,Fail
>> +kms_psr2_sf@...mary-plane-update-sf-dmg-area-big-fb,Fail
>>   kms_psr2_su@...e_flip-NV12,Fail
>>   kms_psr2_su@...e_flip-P010,Fail
>> +kms_psr@...-sprite-render,Timeout
>>   kms_setmode@...ic,Fail
>> +perf@...5-ref-count,Fail
>> +perf_pmu@...ule-unload,Fail
>> +perf_pmu@rc6,Crash
>> +perf_pmu@...-suspend,Crash
>> +sysfs_heartbeat_interval@...g,Timeout
>> +sysfs_heartbeat_interval@off,Timeout
>> +sysfs_preempt_timeout@off,Timeout
>> +sysfs_timeslice_duration@off,Timeout
>> +xe_module_load@...ce-load,Fail
>> +xe_module_load@...d,Fail
>> +xe_module_load@...y-reload,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt b/drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt
>> new file mode 100644
>> index 000000000000..bb560ff1e2cd
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/i915-cml-flakes.txt
>> @@ -0,0 +1,6 @@
>> +# Board Name: asus-C436FA-Flip-hatch
>> +# Bug Report: https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +kms_plane_alpha_blend@...stant-alpha-min
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-cml-skips.txt b/drivers/gpu/drm/ci/xfails/i915-cml-skips.txt
>> index 398ebe163ad0..93b7736fffbb 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-cml-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-cml-skips.txt
>> @@ -9,3 +9,17 @@ panfrost_.*
>>   ^v3d.*
>>   ^vc4.*
>>   ^vmwgfx*
>> +
>> +# GEM tests takes ~1000 hours, so skip it
>> +gem_.*
>> +
>> +# Hangs the machine and timeout occurs
>> +i915_pm_rc6_residency.*
>> +i915_suspend.*
>> +xe_module_load.*
>> +api_intel_allocator.*
>> +kms_cursor_legacy.*
>> +
>> +# Kernel panic
>> +drm_fdinfo.*
>> +kms_frontbuffer_tracking.*
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-glk-fails.txt b/drivers/gpu/drm/ci/xfails/i915-glk-fails.txt
>> index 4596055d7e5e..fca15b487929 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-glk-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-glk-fails.txt
>> @@ -1,5 +1,20 @@
>> -kms_fbcon_fbt@fbc,Fail
>> -kms_flip@...cking-wf_vblank,Fail
>> +core_setmaster@...ter-drop-set-user,Fail
>> +i915_module_load@...d,Fail
>> +i915_module_load@...oad,Fail
>> +i915_module_load@...oad-no-display,Fail
>> +i915_module_load@...ize-bar,Fail
>> +kms_async_flips@...alid-async-flip,Timeout
>> +kms_atomic_transition@...eset-transition-fencing,Timeout
>> +kms_big_fb@...ear-16bpp-rotate-0,Fail
>> +kms_big_fb@...ear-16bpp-rotate-180,Fail
>> +kms_big_fb@...ear-32bpp-rotate-0,Fail
>> +kms_big_fb@...ear-32bpp-rotate-180,Fail
>> +kms_big_fb@...ear-8bpp-rotate-0,Fail
>> +kms_big_fb@...ear-8bpp-rotate-180,Fail
>> +kms_big_fb@...ear-max-hw-stride-32bpp-rotate-0,Fail
>> +kms_dirtyfb@...ault-dirtyfb-ioctl,Fail
>> +kms_draw_crc@...w-method-render,Fail
>> +kms_flip@...p-vs-dpms-off-vs-modeset,Timeout
>>   kms_flip@...vblank-ts-check,Fail
>>   kms_flip@...vblank-ts-check-interruptible,Fail
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-downscaling,Fail
>> @@ -11,7 +26,6 @@ kms_flip_scaled_crc@...p-32bpp-ytile-to-64bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-ytileccs-to-64bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-ytileccs-to-64bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-xtile-to-16bpp-xtile-downscaling,Fail
>> @@ -26,11 +40,24 @@ kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-downscaling,Fail
>>   kms_frontbuffer_tracking@...-tiling-linear,Fail
>>   kms_frontbuffer_tracking@...drrs-tiling-linear,Fail
>> -kms_plane_alpha_blend@...ha-basic,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_plane_alpha_blend@...ha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...ha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...stant-alpha-max,Fail
>> +kms_plane_scaling@...ne-scaler-with-clipping-clamping-rotation,Timeout
>> +kms_pm_rpm@...acy-planes,Timeout
>> +kms_pm_rpm@...acy-planes-dpms,Timeout
>> +kms_pm_rpm@...eset-stress-extra-wait,Timeout
>> +kms_pm_rpm@...versal-planes,Timeout
>> +kms_pm_rpm@...versal-planes-dpms,Timeout
>>   kms_rotation_crc@...tiplane-rotation,Fail
>>   kms_rotation_crc@...tiplane-rotation-cropping-bottom,Fail
>>   kms_rotation_crc@...tiplane-rotation-cropping-top,Fail
>> -kms_setmode@...ic,Fail
>> +perf@...-zero-reason,Timeout
>> +sysfs_heartbeat_interval@...g,Timeout
>> +sysfs_heartbeat_interval@off,Timeout
>> +sysfs_preempt_timeout@off,Timeout
>> +sysfs_timeslice_duration@off,Timeout
>> +xe_module_load@...ce-load,Fail
>> +xe_module_load@...d,Fail
>> +xe_module_load@...y-reload,Fail
>> +xe_module_load@...oad,Fail
>> +xe_module_load@...oad-no-display,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt b/drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt
>> new file mode 100644
>> index 000000000000..58fc424f8a42
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/i915-glk-flakes.txt
>> @@ -0,0 +1,7 @@
>> +# Board Name: hp-x360-12b-ca0010nr-n4020-octopus
>> +# Bug Report: https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +core_hotunplug@...lug-rescan
>> +kms_fb_coherency@...set-crc
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-glk-skips.txt b/drivers/gpu/drm/ci/xfails/i915-glk-skips.txt
>> index 4f5419d62170..b3226b2d9ba1 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-glk-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-glk-skips.txt
>> @@ -12,3 +12,18 @@ panfrost_.*
>>   ^v3d.*
>>   ^vc4.*
>>   ^vmwgfx*
>> +
>> +# GEM tests takes ~1000 hours, so skip it
>> +gem_.*
>> +
>> +# Hangs the machine and timeout occurs
>> +i915_pm_rc6_residency.*
>> +i915_suspend.*
>> +i915_pm_rpm.*
>> +kms_ccs.*
>> +kms_plane_multiple.*
>> +perf.*
>> +
>> +# Kernel panic
>> +drm_fdinfo.*
>> +kms_plane_alpha_blend.*
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt b/drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt
>> index dab202716909..d4fba4f55ec1 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-kbl-fails.txt
>> @@ -1,32 +1,28 @@
>> -kms_bw@...ear-tiling-2-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-4-displays-2560x1440p,Fail
>> -kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-downscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-upscaling,Fail
>> +i915_module_load@...d,Fail
>> +i915_module_load@...oad,Fail
>> +i915_module_load@...oad-no-display,Fail
>> +i915_module_load@...ize-bar,Fail
>> +i915_pm_rpm@...-execbuf-stress,Timeout
>>   kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-ytile-to-64bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-ytile-to-64bpp-ytile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-ytileccs-to-64bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-ytileccs-to-64bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-xtile-to-16bpp-xtile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-xtile-to-16bpp-xtile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-xtile-to-32bpp-xtile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-xtile-to-32bpp-xtile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-16bpp-ytile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-16bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-upscaling,Fail
>> -kms_plane_alpha_blend@...ha-basic,Fail
>> -kms_plane_alpha_blend@...ha-opaque-fb,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_plane_alpha_blend@...ha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...stant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-A-constant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-B-alpha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...e-C-constant-alpha-max,Fail
>> +perf@...5-ref-count,Fail
>> +perf_pmu@...y-accuracy-50,Fail
>> +perf_pmu@...ule-unload,Fail
>> +perf_pmu@rc6,Crash
>> +sysfs_heartbeat_interval@...g,Timeout
>> +sysfs_heartbeat_interval@off,Timeout
>> +sysfs_preempt_timeout@off,Timeout
>> +sysfs_timeslice_duration@off,Timeout
>> +xe_module_load@...ce-load,Fail
>> +xe_module_load@...d,Fail
>> +xe_module_load@...y-reload,Fail
>> +xe_module_load@...oad,Fail
>> +xe_module_load@...oad-no-display,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt b/drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt
>> index a12f888530dd..6cf1fed2e575 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-kbl-flakes.txt
>> @@ -1 +1,6 @@
>> -kms_async_flips@crc
>> +# Board Name: hp-x360-14-G1-sona
>> +# Bug Report: https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +prime_busy@...g
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt b/drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt
>> index 4f5419d62170..f0cf8a6dda25 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-kbl-skips.txt
>> @@ -12,3 +12,28 @@ panfrost_.*
>>   ^v3d.*
>>   ^vc4.*
>>   ^vmwgfx*
>> +
>> +# GEM tests takes ~1000 hours, so skip it
>> +gem_.*
>> +
>> +# Hangs the machine and timeout occurs
>> +i915_.*
>> +api_intel_bb.*
>> +
>> +# Kernel panic
>> +drm_fdinfo.*
>> +kms_.*
>> +prime_mmap_coherency.*
>> +perf.*
>> +drm_read.*
>> +api_intel_allocator.*
>> +sysfs_preempt_timeout.*
>> +dumb_buffer.*
>> +gen9_exec_parse.*
>> +debugfs_test.*
>> +core_hotunplug.*
>> +tools_test.*
>> +
>> +# GPU hang
>> +sysfs_timeslice_.*
>> +sysfs_heartbeat_.*
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt b/drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt
>> index 27bfca1c6f2c..9a50e894c3e7 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-tgl-fails.txt
>> @@ -1,36 +1,43 @@
>> -kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-3-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-3-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-3-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-4-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-4-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-4-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-5-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-5-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-5-displays-3840x2160p,Fail
>> -kms_flip@...p-vs-panning-vs-hang,Timeout
>> -kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-downscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-upscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-ytile-to-64bpp-ytile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-32bpp-ytile-to-64bpp-ytile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-xtile-to-16bpp-xtile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-xtile-to-16bpp-xtile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-xtile-to-32bpp-xtile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-xtile-to-32bpp-xtile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-16bpp-ytile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-16bpp-ytile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-upscaling,Fail
>> -kms_rotation_crc@...-pixel-format,Fail
>> +api_intel_bb@...t-noreloc-keep-cache,Timeout
>> +api_intel_bb@...set-control,Timeout
>> +api_intel_bb@...der-ccs,Timeout
>> +core_getclient,Timeout
>> +core_hotunplug@...replug-lateclose,Timeout
>> +drm_read@...rt-buffer-block,Timeout
>> +drm_read@...rt-buffer-nonblock,Timeout
>> +dumb_buffer@...-uaf,Timeout
>> +gen3_render_tiledx_blits,Timeout
>> +gen7_exec_parse@...ic-allocation,Timeout
>> +gen7_exec_parse@...ch-without-end,Timeout
>> +gen9_exec_parse@...ch-invalid-length,Timeout
>> +gen9_exec_parse@...secure,Timeout
>> +i915_module_load@...d,Fail
>> +i915_module_load@...oad,Fail
>> +i915_module_load@...oad-no-display,Fail
>> +i915_module_load@...ize-bar,Fail
>> +i915_pciid,Timeout
>> +i915_query@...ine-info,Timeout
>> +kms_lease@...se-uevent,Fail
>>   kms_rotation_crc@...tiplane-rotation,Fail
>> -kms_rotation_crc@...tiplane-rotation-cropping-bottom,Fail
>> -kms_rotation_crc@...tiplane-rotation-cropping-top,Fail
>> +perf@...5-ref-count,Fail
>> +perf_pmu@...y,Timeout
>> +perf_pmu@...ble-race,Timeout
>> +perf_pmu@...nt-wait,Timeout
>> +perf_pmu@...awake,Timeout
>> +perf_pmu@...ule-unload,Fail
>> +perf_pmu@rc6,Crash
>> +prime_mmap@...t_map_unmap,Timeout
>> +prime_self_import@...ic-with_one_bo,Timeout
>> +syncobj_basic@...-destroy,Timeout
>> +syncobj_eventfd@...alid-bad-pad,Timeout
>> +syncobj_wait@...alid-multi-wait-unsubmitted-signaled,Timeout
>> +syncobj_wait@...alid-signal-illegal-handle,Timeout
>> +syncobj_wait@...alid-single-wait-all-unsubmitted,Timeout
>> +syncobj_wait@...ti-wait-all-submitted,Timeout
>> +syncobj_wait@...ti-wait-for-submit-submitted-signaled,Timeout
>> +syncobj_wait@...t-any-complex,Timeout
>> +syncobj_wait@...t-delayed-signal,Timeout
>> +xe_module_load@...ce-load,Fail
>> +xe_module_load@...d,Fail
>> +xe_module_load@...oad,Fail
>> +xe_module_load@...oad-no-display,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt b/drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt
>> index b0372c239b93..e600782ef96a 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-tgl-skips.txt
>> @@ -18,3 +18,20 @@ panfrost_.*
>>   ^v3d.*
>>   ^vc4.*
>>   ^vmwgfx*
>> +
>> +# GEM tests takes ~1000 hours, so skip it
>> +gem_.*
>> +
>> +# Kernel panic
>> +drm_fdinfo.*
>> +
>> +# Hangs the machine and timeout occurs
>> +i915_pm_rc6_residency.*
>> +i915_suspend.*
>> +sysfs_heartbeat_interval.*
>> +syncobj_timeline.*
>> +sysfs_timeslice_duration.*
>> +syncobj_wait.*
>> +
>> +# Kernel panic and test hangs with multiple kms tests
>> +kms_.*
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-whl-fails.txt b/drivers/gpu/drm/ci/xfails/i915-whl-fails.txt
>> index 967327ddc1ac..7582d313dd9b 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-whl-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-whl-fails.txt
>> @@ -1,14 +1,25 @@
>> -kms_bw@...ear-tiling-2-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-2-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-3-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-3-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-3-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-4-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-4-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-4-displays-3840x2160p,Fail
>> -kms_fbcon_fbt@fbc,Fail
>> -kms_fbcon_fbt@...-suspend,Fail
>> +core_setmaster@...ter-drop-set-user,Fail
>> +core_setmaster_vs_auth,Fail
>> +i915_module_load@...d,Fail
>> +i915_module_load@...oad,Fail
>> +i915_module_load@...oad-no-display,Fail
>> +i915_module_load@...ize-bar,Fail
>> +i915_pm_rpm@...-execbuf-stress,Timeout
>> +i915_pm_rpm@...ule-reload,Fail
>> +i915_pm_rpm@...tem-suspend-execbuf,Timeout
>> +kms_async_flips@...alid-async-flip,Timeout
>> +kms_atomic_transition@...eset-transition-fencing,Timeout
>> +kms_big_fb@...ear-16bpp-rotate-0,Fail
>> +kms_big_fb@...ear-16bpp-rotate-180,Fail
>> +kms_big_fb@...ear-32bpp-rotate-0,Fail
>> +kms_big_fb@...ear-32bpp-rotate-180,Fail
>> +kms_big_fb@...ear-8bpp-rotate-0,Fail
>> +kms_big_fb@...ear-8bpp-rotate-180,Fail
>> +kms_big_fb@...ear-max-hw-stride-32bpp-rotate-0,Fail
>> +kms_ccs@...-primary-rotation-180-yf-tiled-ccs,Timeout
>> +kms_dirtyfb@...ault-dirtyfb-ioctl,Fail
>> +kms_draw_crc@...w-method-render,Fail
>> +kms_fb_coherency@...set-crc,Crash
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-linear-to-64bpp-linear-upscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-xtile-to-64bpp-xtile-downscaling,Fail
>> @@ -18,8 +29,6 @@ kms_flip_scaled_crc@...p-32bpp-ytile-to-64bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-ytileccs-to-64bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-32bpp-ytileccs-to-64bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-16bpp-linear-upscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-linear-to-32bpp-linear-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-xtile-to-16bpp-xtile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-xtile-to-16bpp-xtile-upscaling,Fail
>> @@ -31,18 +40,26 @@ kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-downscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytile-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling,Fail
>>   kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-downscaling,Fail
>> -kms_flip_scaled_crc@...p-64bpp-ytile-to-32bpp-ytilercccs-upscaling,Fail
>>   kms_frontbuffer_tracking@...-tiling-linear,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_plane_alpha_blend@...ha-basic,Fail
>>   kms_plane_alpha_blend@...ha-opaque-fb,Fail
>>   kms_plane_alpha_blend@...ha-transparent-fb,Fail
>>   kms_plane_alpha_blend@...stant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-A-alpha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...e-A-alpha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...e-A-constant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-B-alpha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...e-B-alpha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...e-B-constant-alpha-max,Fail
>> -kms_plane_alpha_blend@...e-C-alpha-opaque-fb,Fail
>> -kms_plane_alpha_blend@...e-C-alpha-transparent-fb,Fail
>> -kms_plane_alpha_blend@...e-C-constant-alpha-max,Fail
>> +kms_plane_scaling@...ne-scaler-with-clipping-clamping-rotation,Timeout
>> +kms_pm_rpm@...eset-stress-extra-wait,Timeout
>> +kms_pm_rpm@...versal-planes,Timeout
>> +kms_pm_rpm@...versal-planes-dpms,Timeout
>> +perf@...5-ref-count,Fail
>> +perf_pmu@...ule-unload,Fail
>> +perf_pmu@rc6,Crash
>> +perf_pmu@...-suspend,Crash
>> +sysfs_heartbeat_interval@...g,Timeout
>> +sysfs_heartbeat_interval@off,Timeout
>> +sysfs_preempt_timeout@off,Timeout
>> +sysfs_timeslice_duration@off,Timeout
>> +xe_module_load@...ce-load,Fail
>> +xe_module_load@...d,Fail
>> +xe_module_load@...y-reload,Fail
>> +xe_module_load@...oad,Fail
>> +xe_module_load@...oad-no-display,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt b/drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt
>> new file mode 100644
>> index 000000000000..1167a58c7dd1
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/i915-whl-flakes.txt
>> @@ -0,0 +1,6 @@
>> +# Board Name: dell-latitude-5400-8665U-sarien
>> +# Bug Report: https://lore.kernel.org/intel-gfx/af4ca4df-a3ef-4943-bdbf-4c3af2c333af@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +kms_pm_rpm@...eset-lpsp-stress
>> diff --git a/drivers/gpu/drm/ci/xfails/i915-whl-skips.txt b/drivers/gpu/drm/ci/xfails/i915-whl-skips.txt
>> index 398ebe163ad0..20bd91525f45 100644
>> --- a/drivers/gpu/drm/ci/xfails/i915-whl-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/i915-whl-skips.txt
>> @@ -9,3 +9,14 @@ panfrost_.*
>>   ^v3d.*
>>   ^vc4.*
>>   ^vmwgfx*
>> +
>> +# GEM tests takes ~1000 hours, so skip it
>> +gem_.*
>> +
>> +# Hangs the machine and timeout occurs
>> +i915_pm_rc6_residency.*
>> +i915_suspend.*
>> +kms_flip.*
>> +
>> +# Kernel panic
>> +drm_fdinfo.*
>> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
>> index ef0cb7c3698c..cc5e9c1c2d57 100644
>> --- a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
>> @@ -1,36 +1,30 @@
>> +device_reset@...d-reset-bound,Fail
>> +device_reset@...et-bound,Fail
>> +device_reset@...ind-cold-reset-rebind,Fail
>> +device_reset@...ind-reset-rebind,Fail
>> +dumb_buffer@...alid-bpp,Fail
>> +fbdev@eof,Fail
>> +fbdev@...d,Fail
>> +fbdev@...ligned-write,Fail
>>   kms_3d,Fail
>>   kms_bw@...ear-tiling-1-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-1-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-1-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-1-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-2-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-2-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-2-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-3-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-3-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-3-displays-3840x2160p,Fail
>>   kms_color@...alid-gamma-lut-sizes,Fail
>> -kms_color@...e-A-invalid-gamma-lut-sizes,Fail
>> -kms_color@...e-B-invalid-gamma-lut-sizes,Fail
>>   kms_cursor_legacy@...sor-vs-flip-atomic,Fail
>>   kms_cursor_legacy@...sor-vs-flip-legacy,Fail
>>   kms_flip@...p-vs-modeset-vs-hang,Fail
>>   kms_flip@...p-vs-panning-vs-hang,Fail
>>   kms_flip@...p-vs-suspend,Fail
>>   kms_flip@...p-vs-suspend-interruptible,Fail
>> -kms_force_connector_basic@...ce-edid,Fail
>> -kms_force_connector_basic@...ce-load-detect,Fail
>> -kms_force_connector_basic@...ne-stale-modes,Fail
>> -kms_hdmi_inject@...ect-4k,Fail
>> -kms_plane_scaling@...nes-upscale-20x20,Fail
>> -kms_plane_scaling@...nes-upscale-20x20-downscale-factor-0-25,Fail
>> -kms_plane_scaling@...nes-upscale-20x20-downscale-factor-0-5,Fail
>> -kms_plane_scaling@...nes-upscale-20x20-downscale-factor-0-75,Fail
>> -kms_plane_scaling@...cale-with-modifier-20x20,Fail
>> -kms_plane_scaling@...cale-with-pixel-format-20x20,Fail
>> -kms_plane_scaling@...cale-with-rotation-20x20,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_properties@..._properties-sanity-atomic,Fail
>>   kms_properties@...ne-properties-atomic,Fail
>>   kms_properties@...ne-properties-legacy,Fail
>>   kms_rmfb@...se-fd,Fail
>> -kms_selftest@..._format,Timeout
>> -kms_selftest@..._format_helper,Timeout
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
>> new file mode 100644
>> index 000000000000..395ac0463404
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
>> @@ -0,0 +1,11 @@
>> +# Board Name: mt8173-elm-hana
>> +# Bug Report: https://lore.kernel.org/linux-mediatek/0b2a1899-15dd-42fa-8f63-ea0ca28dbb17@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +core_setmaster_vs_auth
>> +dumb_buffer@...ate-clear
>> +fbdev@...ligned-write
>> +fbdev@...te
>> +kms_cursor_legacy@...sor-vs-flip-atomic-transitions
>> +kms_prop_blob@...alid-set-prop
>> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-skips.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-skips.txt
>> index db0c9dbbeb61..0c6108392140 100644
>> --- a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-skips.txt
>> @@ -10,3 +10,7 @@ panfrost_.*
>>   # Skip intel specific tests
>>   gem_.*
>>   i915_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8183-fails.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8183-fails.txt
>> index 67d690fc4037..9ef460646d76 100644
>> --- a/drivers/gpu/drm/ci/xfails/mediatek-mt8183-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8183-fails.txt
>> @@ -1,13 +1,8 @@
>> -kms_addfb_basic@...fb25-bad-modifier,Fail
>> -kms_bw@...ear-tiling-1-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-2-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-2-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-3-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-3-displays-3840x2160p,Fail
>> -kms_color@...e-A-invalid-gamma-lut-sizes,Fail
>> -kms_plane_cursor@...rlay,Fail
>> -kms_plane_cursor@...mary,Fail
>> -kms_plane_cursor@...wport,Fail
>> -kms_plane_scaling@...cale-with-rotation-20x20,Fail
>> -kms_rmfb@...se-fd,Fail
>> +dumb_buffer@...ate-clear,Fail
>> +dumb_buffer@...ate-valid-dumb,Fail
>> +dumb_buffer@...alid-bpp,Fail
>> +dumb_buffer@...-invalid-size,Fail
>> +dumb_buffer@...-uaf,Fail
>> +dumb_buffer@...-valid,Fail
>> +panfrost_prime@...-prime-import,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8183-skips.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8183-skips.txt
>> index 7a1c8be89e5b..715b9a8f4997 100644
>> --- a/drivers/gpu/drm/ci/xfails/mediatek-mt8183-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8183-skips.txt
>> @@ -12,3 +12,7 @@ i915_.*
>>   
>>   # Panfrost is not a KMS driver, so skip the KMS tests
>>   kms_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> diff --git a/drivers/gpu/drm/ci/xfails/meson-g12b-fails.txt b/drivers/gpu/drm/ci/xfails/meson-g12b-fails.txt
>> index 56a2ae7047b4..9ef460646d76 100644
>> --- a/drivers/gpu/drm/ci/xfails/meson-g12b-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/meson-g12b-fails.txt
>> @@ -1,16 +1,8 @@
>> -kms_3d,Fail
>> -kms_cursor_legacy@...ked-bo,Fail
>> -kms_cursor_legacy@...ked-move,Fail
>> -kms_cursor_legacy@...gle-bo,Fail
>> -kms_cursor_legacy@...gle-move,Fail
>> -kms_cursor_legacy@...ture-bo,Fail
>> -kms_cursor_legacy@...ture-move,Fail
>> -kms_force_connector_basic@...ce-edid,Fail
>> -kms_hdmi_inject@...ect-4k,Fail
>> -kms_plane_cursor@...rlay,Fail
>> -kms_plane_cursor@...mary,Fail
>> -kms_plane_cursor@...wport,Fail
>> -kms_properties@...nector-properties-atomic,Fail
>> -kms_properties@...nector-properties-legacy,Fail
>> -kms_properties@..._properties-sanity-atomic,Fail
>> -kms_properties@..._properties-sanity-non-atomic,Fail
>> +dumb_buffer@...ate-clear,Fail
>> +dumb_buffer@...ate-valid-dumb,Fail
>> +dumb_buffer@...alid-bpp,Fail
>> +dumb_buffer@...-invalid-size,Fail
>> +dumb_buffer@...-uaf,Fail
>> +dumb_buffer@...-valid,Fail
>> +panfrost_prime@...-prime-import,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/meson-g12b-skips.txt b/drivers/gpu/drm/ci/xfails/meson-g12b-skips.txt
>> index 7a1c8be89e5b..715b9a8f4997 100644
>> --- a/drivers/gpu/drm/ci/xfails/meson-g12b-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/meson-g12b-skips.txt
>> @@ -12,3 +12,7 @@ i915_.*
>>   
>>   # Panfrost is not a KMS driver, so skip the KMS tests
>>   kms_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
>> index b14d4e884971..3dfbabdf905e 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
>> @@ -1,8 +1,16 @@
>> +device_reset@...d-reset-bound,Fail
>> +device_reset@...et-bound,Fail
>> +device_reset@...ind-cold-reset-rebind,Fail
>> +device_reset@...ind-reset-rebind,Fail
>> +dumb_buffer@...alid-bpp,Fail
>>   kms_3d,Fail
>>   kms_addfb_basic@...fb25-bad-modifier,Fail
>> +kms_cursor_legacy@...ked-move,Fail
>> +kms_cursor_legacy@...gle-bo,Fail
>>   kms_cursor_legacy@...ture-bo,Fail
>> +kms_cursor_legacy@...ture-move,Fail
>>   kms_force_connector_basic@...ce-edid,Fail
>>   kms_hdmi_inject@...ect-4k,Fail
>> -kms_selftest@..._format,Timeout
>> -kms_selftest@..._format_helper,Timeout
>> +kms_lease@...se-uevent,Fail
>>   msm_mapping@...g,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8016-skips.txt b/drivers/gpu/drm/ci/xfails/msm-apq8016-skips.txt
>> index 7fea49ec6b8f..ff12202abb6e 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-apq8016-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-apq8016-skips.txt
>> @@ -9,3 +9,7 @@ panfrost_.*
>>   # Skip intel specific tests
>>   gem_.*
>>   i915_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8096-fails.txt b/drivers/gpu/drm/ci/xfails/msm-apq8096-fails.txt
>> index 88a1fc0a3b0d..23a5f6f9097f 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-apq8096-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-apq8096-fails.txt
>> @@ -1,2 +1,9 @@
>> +device_reset@...d-reset-bound,Fail
>> +device_reset@...et-bound,Fail
>> +device_reset@...ind-cold-reset-rebind,Fail
>> +device_reset@...ind-reset-rebind,Fail
>> +dumb_buffer@...alid-bpp,Fail
>>   kms_3d,Fail
>>   kms_addfb_basic@...fb25-bad-modifier,Fail
>> +kms_lease@...se-uevent,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt b/drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
>> new file mode 100644
>> index 000000000000..a275584c8bbb
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
>> @@ -0,0 +1,6 @@
>> +# Board Name: apq8096-db820c
>> +# Bug Report: https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +dumb_buffer@...ate-clear
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8096-skips.txt b/drivers/gpu/drm/ci/xfails/msm-apq8096-skips.txt
>> index 9ab2177df1ab..1c45fc6c512d 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-apq8096-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-apq8096-skips.txt
>> @@ -12,3 +12,15 @@ panfrost_.*
>>   # Skip intel specific tests
>>   gem_.*
>>   i915_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> +
>> +# gpu fault
>> +# [IGT] msm_mapping: executing
>> +# [IGT] msm_mapping: starting subtest shadow
>> +# *** gpu fault: ttbr0=00000001030ea000 iova=0000000001074000 dir=WRITE type=PERMISSION source=1f030000 (0,0,0,0)
>> +# msm_mdp 901000.display-controller: RBBM | ME master split | status=0x701000B0
>> +# watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [kworker/u16:3:46]
>> +msm_mapping@...dow
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-fails.txt b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-fails.txt
>> index f0576aa629e8..eb7a3886d397 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-fails.txt
>> @@ -1,18 +1,191 @@
>> +device_reset@...d-reset-bound,Fail
>> +device_reset@...et-bound,Fail
>> +device_reset@...ind-cold-reset-rebind,Fail
>> +device_reset@...ind-reset-rebind,Fail
>> +dumb_buffer@...alid-bpp,Fail
>> +kms_atomic_transition@...ne-primary-toggle-with-vblank-wait,Fail
>>   kms_color@...-0-25,Fail
>>   kms_color@...-0-50,Fail
>>   kms_color@...-0-75,Fail
>>   kms_color@...-blue-to-red,Fail
>>   kms_color@...-green-to-red,Fail
>> +kms_color@...-max,Fail
>>   kms_color@...-negative,Fail
>>   kms_color@...-red-to-blue,Fail
>>   kms_color@...-signed,Fail
>> +kms_content_protection@...mic,Crash
>> +kms_content_protection@...mic-dpms,Crash
>> +kms_content_protection@...tent-type-change,Crash
>> +kms_content_protection@...-type-0,Crash
>> +kms_content_protection@...-type-1,Crash
>> +kms_content_protection@srm,Crash
>> +kms_content_protection@...e1,Crash
>> +kms_content_protection@...ent,Crash
>> +kms_cursor_crc@...sor-alpha-opaque,Fail
>> +kms_cursor_crc@...sor-alpha-transparent,Fail
>> +kms_cursor_crc@...sor-dpms,Fail
>> +kms_cursor_crc@...sor-offscreen-128x128,Fail
>> +kms_cursor_crc@...sor-offscreen-128x42,Fail
>> +kms_cursor_crc@...sor-offscreen-256x256,Fail
>> +kms_cursor_crc@...sor-offscreen-256x85,Fail
>> +kms_cursor_crc@...sor-offscreen-32x10,Fail
>> +kms_cursor_crc@...sor-offscreen-32x32,Fail
>> +kms_cursor_crc@...sor-offscreen-512x170,Fail
>> +kms_cursor_crc@...sor-offscreen-512x512,Fail
>> +kms_cursor_crc@...sor-offscreen-64x21,Fail
>> +kms_cursor_crc@...sor-offscreen-64x64,Fail
>> +kms_cursor_crc@...sor-onscreen-128x128,Fail
>> +kms_cursor_crc@...sor-onscreen-128x42,Fail
>> +kms_cursor_crc@...sor-onscreen-256x256,Fail
>> +kms_cursor_crc@...sor-onscreen-256x85,Fail
>> +kms_cursor_crc@...sor-onscreen-32x10,Fail
>> +kms_cursor_crc@...sor-onscreen-32x32,Fail
>> +kms_cursor_crc@...sor-onscreen-512x170,Fail
>> +kms_cursor_crc@...sor-onscreen-512x512,Fail
>> +kms_cursor_crc@...sor-onscreen-64x21,Fail
>> +kms_cursor_crc@...sor-onscreen-64x64,Fail
>> +kms_cursor_crc@...sor-random-128x128,Fail
>> +kms_cursor_crc@...sor-random-128x42,Fail
>> +kms_cursor_crc@...sor-random-256x256,Fail
>> +kms_cursor_crc@...sor-random-256x85,Fail
>> +kms_cursor_crc@...sor-random-32x10,Fail
>> +kms_cursor_crc@...sor-random-32x32,Fail
>> +kms_cursor_crc@...sor-random-512x170,Fail
>> +kms_cursor_crc@...sor-random-512x512,Fail
>> +kms_cursor_crc@...sor-random-64x21,Fail
>> +kms_cursor_crc@...sor-random-64x64,Fail
>> +kms_cursor_crc@...sor-rapid-movement-128x128,Fail
>> +kms_cursor_crc@...sor-rapid-movement-128x42,Fail
>> +kms_cursor_crc@...sor-rapid-movement-256x256,Fail
>> +kms_cursor_crc@...sor-rapid-movement-256x85,Fail
>> +kms_cursor_crc@...sor-rapid-movement-32x10,Fail
>> +kms_cursor_crc@...sor-rapid-movement-32x32,Fail
>> +kms_cursor_crc@...sor-rapid-movement-512x170,Fail
>> +kms_cursor_crc@...sor-rapid-movement-512x512,Fail
>> +kms_cursor_crc@...sor-rapid-movement-64x21,Fail
>> +kms_cursor_crc@...sor-rapid-movement-64x64,Fail
>> +kms_cursor_crc@...sor-size-change,Fail
>> +kms_cursor_crc@...sor-sliding-128x128,Fail
>> +kms_cursor_crc@...sor-sliding-128x42,Fail
>> +kms_cursor_crc@...sor-sliding-256x256,Fail
>> +kms_cursor_crc@...sor-sliding-256x85,Fail
>> +kms_cursor_crc@...sor-sliding-32x10,Fail
>> +kms_cursor_crc@...sor-sliding-32x32,Fail
>> +kms_cursor_crc@...sor-sliding-512x170,Fail
>> +kms_cursor_crc@...sor-sliding-512x512,Fail
>> +kms_cursor_crc@...sor-sliding-64x21,Fail
>> +kms_cursor_crc@...sor-sliding-64x64,Fail
>> +kms_cursor_edge_walk@...x128-left-edge,Fail
>> +kms_cursor_edge_walk@...x128-right-edge,Fail
>> +kms_cursor_edge_walk@...x128-top-bottom,Fail
>> +kms_cursor_edge_walk@...x128-top-edge,Fail
>> +kms_cursor_edge_walk@...x256-left-edge,Fail
>> +kms_cursor_edge_walk@...x256-right-edge,Fail
>> +kms_cursor_edge_walk@...x256-top-bottom,Fail
>> +kms_cursor_edge_walk@...x256-top-edge,Fail
>> +kms_cursor_edge_walk@...64-left-edge,Fail
>> +kms_cursor_edge_walk@...64-right-edge,Fail
>> +kms_cursor_edge_walk@...64-top-bottom,Fail
>> +kms_cursor_edge_walk@...64-top-edge,Fail
>> +kms_cursor_legacy@...cursor-vs-flip-atomic,Fail
>> +kms_cursor_legacy@...cursor-vs-flip-legacy,Fail
>> +kms_cursor_legacy@...flip-vs-cursor-atomic,Fail
>> +kms_cursor_legacy@...flip-vs-cursor-legacy,Fail
>> +kms_cursor_legacy@...long-cursor-vs-flip-atomic,Fail
>> +kms_cursor_legacy@...long-cursor-vs-flip-legacy,Fail
>> +kms_cursor_legacy@...long-flip-vs-cursor-atomic,Fail
>> +kms_cursor_legacy@...long-flip-vs-cursor-legacy,Fail
>>   kms_cursor_legacy@...sor-vs-flip-toggle,Fail
>>   kms_cursor_legacy@...sor-vs-flip-varying-size,Fail
>> +kms_display_modes@...ended-mode-basic,Fail
>> +kms_flip@...flip-vs-modeset-vs-hang,Fail
>> +kms_flip@...flip-vs-panning-vs-hang,Fail
>> +kms_flip@...olute-wf_vblank,Fail
>> +kms_flip@...olute-wf_vblank-interruptible,Fail
>> +kms_flip@...ic-flip-vs-wf_vblank,Fail
>> +kms_flip@...ic-plain-flip,Fail
>> +kms_flip@...cking-absolute-wf_vblank,Fail
>> +kms_flip@...cking-absolute-wf_vblank-interruptible,Fail
>> +kms_flip@...cking-wf_vblank,Fail
>> +kms_flip@...y-flip,Fail
>> +kms_flip@...s-off-confusion,Fail
>> +kms_flip@...s-off-confusion-interruptible,Fail
>> +kms_flip@...s-vs-vblank-race,Fail
>> +kms_flip@...s-vs-vblank-race-interruptible,Fail
>> +kms_flip@...p-vs-absolute-wf_vblank,Fail
>> +kms_flip@...p-vs-absolute-wf_vblank-interruptible,Fail
>> +kms_flip@...p-vs-blocking-wf-vblank,Fail
>> +kms_flip@...p-vs-expired-vblank,Fail
>> +kms_flip@...p-vs-expired-vblank-interruptible,Fail
>>   kms_flip@...p-vs-modeset-vs-hang,Fail
>> +kms_flip@...p-vs-panning,Fail
>> +kms_flip@...p-vs-panning-interruptible,Fail
>>   kms_flip@...p-vs-panning-vs-hang,Fail
>> +kms_flip@...p-vs-rmfb,Fail
>> +kms_flip@...p-vs-rmfb-interruptible,Fail
>> +kms_flip@...p-vs-wf_vblank-interruptible,Fail
>> +kms_flip@...eset-vs-vblank-race,Fail
>> +kms_flip@...eset-vs-vblank-race-interruptible,Fail
>> +kms_flip@...in-flip-fb-recreate,Fail
>> +kms_flip@...in-flip-fb-recreate-interruptible,Fail
>> +kms_flip@...in-flip-interruptible,Fail
>> +kms_flip@...in-flip-ts-check,Fail
>> +kms_flip@...in-flip-ts-check-interruptible,Fail
>> +kms_flip@...vblank-ts-check,Fail
>> +kms_flip@...vblank-ts-check-interruptible,Fail
>> +kms_lease@...sor-implicit-plane,Fail
>> +kms_lease@...se-uevent,Fail
>> +kms_lease@...e-flip-implicit-plane,Fail
>> +kms_lease@...crtc-implicit-plane,Fail
>> +kms_lease@...ple-lease,Fail
>> +kms_multipipe_modeset@...ic-max-pipe-crc-check,Fail
>>   kms_pipe_crc_basic@...pare-crc-sanitycheck-nv12,Fail
>> +kms_pipe_crc_basic@...pare-crc-sanitycheck-xr24,Fail
>> +kms_pipe_crc_basic@...able-crc-after-crtc,Fail
>> +kms_pipe_crc_basic@...blocking-crc,Fail
>> +kms_pipe_crc_basic@...blocking-crc-frame-sequence,Fail
>> +kms_pipe_crc_basic@...d-crc,Fail
>> +kms_pipe_crc_basic@...d-crc-frame-sequence,Fail
>> +kms_plane@...el-format,Fail
>> +kms_plane@...el-format-source-clamping,Fail
>> +kms_plane@...ne-panning-bottom-right,Fail
>> +kms_plane@...ne-panning-top-left,Fail
>> +kms_plane@...ne-position-covered,Fail
>> +kms_plane@...ne-position-hole,Fail
>> +kms_plane@...ne-position-hole-dpms,Fail
>>   kms_plane_alpha_blend@...ha-7efc,Fail
>> +kms_plane_alpha_blend@...ha-basic,Fail
>> +kms_plane_alpha_blend@...ha-opaque-fb,Fail
>> +kms_plane_alpha_blend@...ha-transparent-fb,Fail
>> +kms_plane_alpha_blend@...stant-alpha-max,Fail
>> +kms_plane_alpha_blend@...stant-alpha-mid,Fail
>> +kms_plane_alpha_blend@...stant-alpha-min,Fail
>>   kms_plane_alpha_blend@...erage-7efc,Fail
>>   kms_plane_alpha_blend@...erage-vs-premult-vs-constant,Fail
>> +kms_plane_cursor@...mary,Fail
>> +kms_plane_lowres@...ing-none,Fail
>> +kms_plane_multiple@...ing-none,Fail
>>   kms_rmfb@...se-fd,Fail
>> -kms_universal_plane@...versal-plane-sanity,Fail
>> +kms_rotation_crc@...sor-rotation-180,Fail
>> +kms_rotation_crc@...mary-rotation-180,Fail
>> +kms_sequence@...-busy,Fail
>> +kms_sequence@...-forked,Fail
>> +kms_sequence@...-forked-busy,Fail
>> +kms_sequence@...-idle,Fail
>> +kms_sequence@...ue-busy,Fail
>> +kms_sequence@...ue-idle,Fail
>> +kms_vblank@...uracy-idle,Fail
>> +kms_vblank@...c-id,Fail
>> +kms_vblank@...ry-busy,Fail
>> +kms_vblank@...ry-forked,Fail
>> +kms_vblank@...ry-forked-busy,Fail
>> +kms_vblank@...ry-idle,Fail
>> +kms_vblank@...continuation-dpms-rpm,Fail
>> +kms_vblank@...continuation-idle,Fail
>> +kms_vblank@...continuation-modeset,Fail
>> +kms_vblank@...continuation-modeset-rpm,Fail
>> +kms_vblank@...t-busy,Fail
>> +kms_vblank@...t-forked,Fail
>> +kms_vblank@...t-forked-busy,Fail
>> +kms_vblank@...t-idle,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
>> new file mode 100644
>> index 000000000000..6dec63d48cfb
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
>> @@ -0,0 +1,8 @@
>> +# Board Name: sc7180-trogdor-kingoftown
>> +# Bug Report: https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +msm_mapping@...dow
>> +msm_shrink@...y-gpu-oom-32
>> +msm_shrink@...y-gpu-oom-8
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-skips.txt b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-skips.txt
>> index edf64057f866..68c96005ba54 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-skips.txt
>> @@ -12,3 +12,10 @@ panfrost_.*
>>   # Skip intel specific tests
>>   gem_.*
>>   i915_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> +
>> +# Timeout occurs
>> +kms_flip@...wf_vblank-ts-check
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-fails.txt b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-fails.txt
>> index f0576aa629e8..eb7a3886d397 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-fails.txt
>> @@ -1,18 +1,191 @@
>> +device_reset@...d-reset-bound,Fail
>> +device_reset@...et-bound,Fail
>> +device_reset@...ind-cold-reset-rebind,Fail
>> +device_reset@...ind-reset-rebind,Fail
>> +dumb_buffer@...alid-bpp,Fail
>> +kms_atomic_transition@...ne-primary-toggle-with-vblank-wait,Fail
>>   kms_color@...-0-25,Fail
>>   kms_color@...-0-50,Fail
>>   kms_color@...-0-75,Fail
>>   kms_color@...-blue-to-red,Fail
>>   kms_color@...-green-to-red,Fail
>> +kms_color@...-max,Fail
>>   kms_color@...-negative,Fail
>>   kms_color@...-red-to-blue,Fail
>>   kms_color@...-signed,Fail
>> +kms_content_protection@...mic,Crash
>> +kms_content_protection@...mic-dpms,Crash
>> +kms_content_protection@...tent-type-change,Crash
>> +kms_content_protection@...-type-0,Crash
>> +kms_content_protection@...-type-1,Crash
>> +kms_content_protection@srm,Crash
>> +kms_content_protection@...e1,Crash
>> +kms_content_protection@...ent,Crash
>> +kms_cursor_crc@...sor-alpha-opaque,Fail
>> +kms_cursor_crc@...sor-alpha-transparent,Fail
>> +kms_cursor_crc@...sor-dpms,Fail
>> +kms_cursor_crc@...sor-offscreen-128x128,Fail
>> +kms_cursor_crc@...sor-offscreen-128x42,Fail
>> +kms_cursor_crc@...sor-offscreen-256x256,Fail
>> +kms_cursor_crc@...sor-offscreen-256x85,Fail
>> +kms_cursor_crc@...sor-offscreen-32x10,Fail
>> +kms_cursor_crc@...sor-offscreen-32x32,Fail
>> +kms_cursor_crc@...sor-offscreen-512x170,Fail
>> +kms_cursor_crc@...sor-offscreen-512x512,Fail
>> +kms_cursor_crc@...sor-offscreen-64x21,Fail
>> +kms_cursor_crc@...sor-offscreen-64x64,Fail
>> +kms_cursor_crc@...sor-onscreen-128x128,Fail
>> +kms_cursor_crc@...sor-onscreen-128x42,Fail
>> +kms_cursor_crc@...sor-onscreen-256x256,Fail
>> +kms_cursor_crc@...sor-onscreen-256x85,Fail
>> +kms_cursor_crc@...sor-onscreen-32x10,Fail
>> +kms_cursor_crc@...sor-onscreen-32x32,Fail
>> +kms_cursor_crc@...sor-onscreen-512x170,Fail
>> +kms_cursor_crc@...sor-onscreen-512x512,Fail
>> +kms_cursor_crc@...sor-onscreen-64x21,Fail
>> +kms_cursor_crc@...sor-onscreen-64x64,Fail
>> +kms_cursor_crc@...sor-random-128x128,Fail
>> +kms_cursor_crc@...sor-random-128x42,Fail
>> +kms_cursor_crc@...sor-random-256x256,Fail
>> +kms_cursor_crc@...sor-random-256x85,Fail
>> +kms_cursor_crc@...sor-random-32x10,Fail
>> +kms_cursor_crc@...sor-random-32x32,Fail
>> +kms_cursor_crc@...sor-random-512x170,Fail
>> +kms_cursor_crc@...sor-random-512x512,Fail
>> +kms_cursor_crc@...sor-random-64x21,Fail
>> +kms_cursor_crc@...sor-random-64x64,Fail
>> +kms_cursor_crc@...sor-rapid-movement-128x128,Fail
>> +kms_cursor_crc@...sor-rapid-movement-128x42,Fail
>> +kms_cursor_crc@...sor-rapid-movement-256x256,Fail
>> +kms_cursor_crc@...sor-rapid-movement-256x85,Fail
>> +kms_cursor_crc@...sor-rapid-movement-32x10,Fail
>> +kms_cursor_crc@...sor-rapid-movement-32x32,Fail
>> +kms_cursor_crc@...sor-rapid-movement-512x170,Fail
>> +kms_cursor_crc@...sor-rapid-movement-512x512,Fail
>> +kms_cursor_crc@...sor-rapid-movement-64x21,Fail
>> +kms_cursor_crc@...sor-rapid-movement-64x64,Fail
>> +kms_cursor_crc@...sor-size-change,Fail
>> +kms_cursor_crc@...sor-sliding-128x128,Fail
>> +kms_cursor_crc@...sor-sliding-128x42,Fail
>> +kms_cursor_crc@...sor-sliding-256x256,Fail
>> +kms_cursor_crc@...sor-sliding-256x85,Fail
>> +kms_cursor_crc@...sor-sliding-32x10,Fail
>> +kms_cursor_crc@...sor-sliding-32x32,Fail
>> +kms_cursor_crc@...sor-sliding-512x170,Fail
>> +kms_cursor_crc@...sor-sliding-512x512,Fail
>> +kms_cursor_crc@...sor-sliding-64x21,Fail
>> +kms_cursor_crc@...sor-sliding-64x64,Fail
>> +kms_cursor_edge_walk@...x128-left-edge,Fail
>> +kms_cursor_edge_walk@...x128-right-edge,Fail
>> +kms_cursor_edge_walk@...x128-top-bottom,Fail
>> +kms_cursor_edge_walk@...x128-top-edge,Fail
>> +kms_cursor_edge_walk@...x256-left-edge,Fail
>> +kms_cursor_edge_walk@...x256-right-edge,Fail
>> +kms_cursor_edge_walk@...x256-top-bottom,Fail
>> +kms_cursor_edge_walk@...x256-top-edge,Fail
>> +kms_cursor_edge_walk@...64-left-edge,Fail
>> +kms_cursor_edge_walk@...64-right-edge,Fail
>> +kms_cursor_edge_walk@...64-top-bottom,Fail
>> +kms_cursor_edge_walk@...64-top-edge,Fail
>> +kms_cursor_legacy@...cursor-vs-flip-atomic,Fail
>> +kms_cursor_legacy@...cursor-vs-flip-legacy,Fail
>> +kms_cursor_legacy@...flip-vs-cursor-atomic,Fail
>> +kms_cursor_legacy@...flip-vs-cursor-legacy,Fail
>> +kms_cursor_legacy@...long-cursor-vs-flip-atomic,Fail
>> +kms_cursor_legacy@...long-cursor-vs-flip-legacy,Fail
>> +kms_cursor_legacy@...long-flip-vs-cursor-atomic,Fail
>> +kms_cursor_legacy@...long-flip-vs-cursor-legacy,Fail
>>   kms_cursor_legacy@...sor-vs-flip-toggle,Fail
>>   kms_cursor_legacy@...sor-vs-flip-varying-size,Fail
>> +kms_display_modes@...ended-mode-basic,Fail
>> +kms_flip@...flip-vs-modeset-vs-hang,Fail
>> +kms_flip@...flip-vs-panning-vs-hang,Fail
>> +kms_flip@...olute-wf_vblank,Fail
>> +kms_flip@...olute-wf_vblank-interruptible,Fail
>> +kms_flip@...ic-flip-vs-wf_vblank,Fail
>> +kms_flip@...ic-plain-flip,Fail
>> +kms_flip@...cking-absolute-wf_vblank,Fail
>> +kms_flip@...cking-absolute-wf_vblank-interruptible,Fail
>> +kms_flip@...cking-wf_vblank,Fail
>> +kms_flip@...y-flip,Fail
>> +kms_flip@...s-off-confusion,Fail
>> +kms_flip@...s-off-confusion-interruptible,Fail
>> +kms_flip@...s-vs-vblank-race,Fail
>> +kms_flip@...s-vs-vblank-race-interruptible,Fail
>> +kms_flip@...p-vs-absolute-wf_vblank,Fail
>> +kms_flip@...p-vs-absolute-wf_vblank-interruptible,Fail
>> +kms_flip@...p-vs-blocking-wf-vblank,Fail
>> +kms_flip@...p-vs-expired-vblank,Fail
>> +kms_flip@...p-vs-expired-vblank-interruptible,Fail
>>   kms_flip@...p-vs-modeset-vs-hang,Fail
>> +kms_flip@...p-vs-panning,Fail
>> +kms_flip@...p-vs-panning-interruptible,Fail
>>   kms_flip@...p-vs-panning-vs-hang,Fail
>> +kms_flip@...p-vs-rmfb,Fail
>> +kms_flip@...p-vs-rmfb-interruptible,Fail
>> +kms_flip@...p-vs-wf_vblank-interruptible,Fail
>> +kms_flip@...eset-vs-vblank-race,Fail
>> +kms_flip@...eset-vs-vblank-race-interruptible,Fail
>> +kms_flip@...in-flip-fb-recreate,Fail
>> +kms_flip@...in-flip-fb-recreate-interruptible,Fail
>> +kms_flip@...in-flip-interruptible,Fail
>> +kms_flip@...in-flip-ts-check,Fail
>> +kms_flip@...in-flip-ts-check-interruptible,Fail
>> +kms_flip@...vblank-ts-check,Fail
>> +kms_flip@...vblank-ts-check-interruptible,Fail
>> +kms_lease@...sor-implicit-plane,Fail
>> +kms_lease@...se-uevent,Fail
>> +kms_lease@...e-flip-implicit-plane,Fail
>> +kms_lease@...crtc-implicit-plane,Fail
>> +kms_lease@...ple-lease,Fail
>> +kms_multipipe_modeset@...ic-max-pipe-crc-check,Fail
>>   kms_pipe_crc_basic@...pare-crc-sanitycheck-nv12,Fail
>> +kms_pipe_crc_basic@...pare-crc-sanitycheck-xr24,Fail
>> +kms_pipe_crc_basic@...able-crc-after-crtc,Fail
>> +kms_pipe_crc_basic@...blocking-crc,Fail
>> +kms_pipe_crc_basic@...blocking-crc-frame-sequence,Fail
>> +kms_pipe_crc_basic@...d-crc,Fail
>> +kms_pipe_crc_basic@...d-crc-frame-sequence,Fail
>> +kms_plane@...el-format,Fail
>> +kms_plane@...el-format-source-clamping,Fail
>> +kms_plane@...ne-panning-bottom-right,Fail
>> +kms_plane@...ne-panning-top-left,Fail
>> +kms_plane@...ne-position-covered,Fail
>> +kms_plane@...ne-position-hole,Fail
>> +kms_plane@...ne-position-hole-dpms,Fail
>>   kms_plane_alpha_blend@...ha-7efc,Fail
>> +kms_plane_alpha_blend@...ha-basic,Fail
>> +kms_plane_alpha_blend@...ha-opaque-fb,Fail
>> +kms_plane_alpha_blend@...ha-transparent-fb,Fail
>> +kms_plane_alpha_blend@...stant-alpha-max,Fail
>> +kms_plane_alpha_blend@...stant-alpha-mid,Fail
>> +kms_plane_alpha_blend@...stant-alpha-min,Fail
>>   kms_plane_alpha_blend@...erage-7efc,Fail
>>   kms_plane_alpha_blend@...erage-vs-premult-vs-constant,Fail
>> +kms_plane_cursor@...mary,Fail
>> +kms_plane_lowres@...ing-none,Fail
>> +kms_plane_multiple@...ing-none,Fail
>>   kms_rmfb@...se-fd,Fail
>> -kms_universal_plane@...versal-plane-sanity,Fail
>> +kms_rotation_crc@...sor-rotation-180,Fail
>> +kms_rotation_crc@...mary-rotation-180,Fail
>> +kms_sequence@...-busy,Fail
>> +kms_sequence@...-forked,Fail
>> +kms_sequence@...-forked-busy,Fail
>> +kms_sequence@...-idle,Fail
>> +kms_sequence@...ue-busy,Fail
>> +kms_sequence@...ue-idle,Fail
>> +kms_vblank@...uracy-idle,Fail
>> +kms_vblank@...c-id,Fail
>> +kms_vblank@...ry-busy,Fail
>> +kms_vblank@...ry-forked,Fail
>> +kms_vblank@...ry-forked-busy,Fail
>> +kms_vblank@...ry-idle,Fail
>> +kms_vblank@...continuation-dpms-rpm,Fail
>> +kms_vblank@...continuation-idle,Fail
>> +kms_vblank@...continuation-modeset,Fail
>> +kms_vblank@...continuation-modeset-rpm,Fail
>> +kms_vblank@...t-busy,Fail
>> +kms_vblank@...t-forked,Fail
>> +kms_vblank@...t-forked-busy,Fail
>> +kms_vblank@...t-idle,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
>> new file mode 100644
>> index 000000000000..dcb24b835dc3
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
>> @@ -0,0 +1,6 @@
>> +# Board Name: sc7180-trogdor-lazor-limozeen-nots-r5
>> +# Bug Report: https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +msm_mapping@...dow
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-skips.txt b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-skips.txt
>> index edf64057f866..1168c53acd2d 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-skips.txt
>> @@ -12,3 +12,7 @@ panfrost_.*
>>   # Skip intel specific tests
>>   gem_.*
>>   i915_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sdm845-fails.txt b/drivers/gpu/drm/ci/xfails/msm-sdm845-fails.txt
>> index e9043a00383e..8f010c8a9c4f 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-sdm845-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sdm845-fails.txt
>> @@ -1,3 +1,8 @@
>> +device_reset@...d-reset-bound,Fail
>> +device_reset@...et-bound,Fail
>> +device_reset@...ind-cold-reset-rebind,Fail
>> +device_reset@...ind-reset-rebind,Fail
>> +dumb_buffer@...alid-bpp,Fail
>>   kms_color@...-0-25,Fail
>>   kms_color@...-0-50,Fail
>>   kms_color@...-0-75,Fail
>> @@ -6,17 +11,6 @@ kms_color@...-green-to-red,Fail
>>   kms_color@...-negative,Fail
>>   kms_color@...-red-to-blue,Fail
>>   kms_color@...-signed,Fail
>> -kms_color@...e-A-ctm-0-25,Fail
>> -kms_color@...e-A-ctm-0-5,Fail
>> -kms_color@...e-A-ctm-0-75,Fail
>> -kms_color@...e-A-ctm-blue-to-red,Fail
>> -kms_color@...e-A-ctm-green-to-red,Fail
>> -kms_color@...e-A-ctm-max,Fail
>> -kms_color@...e-A-ctm-negative,Fail
>> -kms_color@...e-A-ctm-red-to-blue,Fail
>> -kms_color@...e-A-legacy-gamma,Fail
>> -kms_cursor_legacy@...ic-flip-after-cursor-atomic,Fail
>> -kms_cursor_legacy@...ic-flip-after-cursor-varying-size,Fail
>>   kms_cursor_legacy@...ic-flip-before-cursor-atomic,Fail
>>   kms_cursor_legacy@...ic-flip-before-cursor-legacy,Fail
>>   kms_cursor_legacy@...sor-vs-flip-atomic,Fail
>> @@ -31,30 +25,12 @@ kms_cursor_legacy@...p-vs-cursor-crc-legacy,Fail
>>   kms_cursor_legacy@...p-vs-cursor-legacy,Fail
>>   kms_flip@...p-vs-modeset-vs-hang,Fail
>>   kms_flip@...p-vs-panning-vs-hang,Fail
>> +kms_lease@...se-uevent,Fail
>>   kms_pipe_crc_basic@...pare-crc-sanitycheck-nv12,Fail
>>   kms_plane_alpha_blend@...ha-7efc,Fail
>>   kms_plane_alpha_blend@...erage-7efc,Fail
>>   kms_plane_alpha_blend@...erage-vs-premult-vs-constant,Fail
>> -kms_plane_alpha_blend@...e-A-alpha-7efc,Fail
>> -kms_plane_alpha_blend@...e-A-coverage-7efc,Fail
>> -kms_plane_alpha_blend@...e-A-coverage-vs-premult-vs-constant,Fail
>>   kms_plane_cursor@...rlay,Fail
>> -kms_plane_cursor@...e-A-overlay-size-128,Fail
>> -kms_plane_cursor@...e-A-overlay-size-256,Fail
>> -kms_plane_cursor@...e-A-overlay-size-64,Fail
>> -kms_plane_cursor@...e-A-viewport-size-128,Fail
>> -kms_plane_cursor@...e-A-viewport-size-256,Fail
>> -kms_plane_cursor@...e-A-viewport-size-64,Fail
>>   kms_plane_cursor@...wport,Fail
>> -kms_plane_scaling@...nscale-with-pixel-format-factor-0-25,Timeout
>> -kms_plane_scaling@...nscale-with-pixel-format-factor-0-5,Timeout
>> -kms_plane_scaling@...nscale-with-pixel-format-factor-0-75,Timeout
>> -kms_plane_scaling@...ne-downscale-with-pixel-format-factor-0-25,Timeout
>> -kms_plane_scaling@...ne-downscale-with-pixel-format-factor-0-5,Timeout
>> -kms_plane_scaling@...ne-downscale-with-pixel-format-factor-0-75,Timeout
>> -kms_plane_scaling@...ne-scaler-with-clipping-clamping-pixel-formats,Timeout
>> -kms_plane_scaling@...ne-scaler-with-pixel-format-unity-scaling,Timeout
>> -kms_plane_scaling@...nes-downscale-factor-0-25,Fail
>> -kms_plane_scaling@...ler-with-clipping-clamping,Timeout
>> -kms_plane_scaling@...ler-with-pixel-format-unity-scaling,Timeout
>>   kms_rmfb@...se-fd,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt b/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt
>> index 8a492f01eaa4..2c5f62b07632 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt
>> @@ -1,22 +1,19 @@
>> -# Board Name: msm:sdm845
>> -# Bug Report: https://lore.kernel.org/dri-devel/46287831-edfa-78e8-6055-d7a08831c445@collabora.com/T/#u
>> +# Board Name: sdm845-cheza-r3
>> +# Bug Report: https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>>   # Failure Rate: 50
>> -# IGT Version: 1.28-gd2af13d9f
>> -# Linux Version: 6.7.0-rc3
>> -
>> -# Reported by deqp-runner
>> +kms_cursor_legacy@...ic-flip-after-cursor-atomic
>>   kms_cursor_legacy@...ic-flip-after-cursor-legacy
>> -kms_cursor_legacy@...p-vs-cursor-toggle
>> +kms_cursor_legacy@...ic-flip-after-cursor-varying-size
>> +kms_cursor_legacy@...ic-flip-before-cursor-varying-size
>> +kms_cursor_legacy@...p-vs-cursor-atomic-transitions
>> +kms_cursor_legacy@...p-vs-cursor-atomic-transitions-varying-size
>>   kms_cursor_legacy@...p-vs-cursor-varying-size
>> +kms_cursor_legacy@...rt-flip-after-cursor-atomic-transitions
>> +kms_cursor_legacy@...rt-flip-after-cursor-atomic-transitions-varying-size
>>   kms_cursor_legacy@...rt-flip-after-cursor-toggle
>>   kms_cursor_legacy@...rt-flip-before-cursor-atomic-transitions
>>   kms_cursor_legacy@...rt-flip-before-cursor-atomic-transitions-varying-size
>>   msm_shrink@...y-gpu-32
>>   msm_shrink@...y-gpu-oom-32
>> -
>> -# The below test shows inconsistency across multiple runs, giving
>> -# results of Pass and Fail alternately.
>> -kms_cursor_legacy@...ic-flip-before-cursor-varying-size
>> -kms_cursor_legacy@...p-vs-cursor-atomic-transitions
>> -kms_cursor_legacy@...rt-flip-after-cursor-atomic-transitions
>> -kms_cursor_legacy@...rt-flip-after-cursor-atomic-transitions-varying-size
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-sdm845-skips.txt b/drivers/gpu/drm/ci/xfails/msm-sdm845-skips.txt
>> index dd24dc190db0..5185212c8fb2 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-sdm845-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-sdm845-skips.txt
>> @@ -17,3 +17,10 @@ panfrost_.*
>>   # Skip intel specific tests
>>   gem_.*
>>   i915_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> +
>> +# Whole machine hangs
>> +kms_cursor_crc.*
>> diff --git a/drivers/gpu/drm/ci/xfails/rockchip-rk3288-fails.txt b/drivers/gpu/drm/ci/xfails/rockchip-rk3288-fails.txt
>> index 90c63f519e9e..f9b99bf27105 100644
>> --- a/drivers/gpu/drm/ci/xfails/rockchip-rk3288-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/rockchip-rk3288-fails.txt
>> @@ -1,54 +1,8 @@
>> -kms_3d,Crash
>> -kms_bw@...ear-tiling-2-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-2-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>> -kms_bw@...ear-tiling-3-displays-1920x1080p,Fail
>> -kms_bw@...ear-tiling-3-displays-2560x1440p,Fail
>> -kms_bw@...ear-tiling-3-displays-3840x2160p,Fail
>> -kms_flip@...p-vs-modeset-vs-hang,Crash
>> -kms_flip@...p-vs-panning-vs-hang,Crash
>> -kms_force_connector_basic@...ce-load-detect,Fail
>> -kms_invalid_mode@...-max-clock,Crash
>> -kms_pipe_crc_basic@...pare-crc-sanitycheck-nv12,Crash
>> -kms_pipe_crc_basic@...blocking-crc-frame-sequence,Crash
>> -kms_pipe_crc_basic@...d-crc-frame-sequence,Crash
>> -kms_plane@...el-format,Crash
>> -kms_plane@...el-format-source-clamping,Crash
>> -kms_plane@...ne-position-hole,Crash
>> -kms_plane@...ne-position-hole-dpms,Crash
>> -kms_plane_cursor@...rlay,Crash
>> -kms_plane_cursor@...e-A-overlay-size-128,Fail
>> -kms_plane_cursor@...e-A-overlay-size-256,Fail
>> -kms_plane_cursor@...e-A-overlay-size-64,Fail
>> -kms_plane_cursor@...e-A-primary-size-128,Fail
>> -kms_plane_cursor@...e-A-primary-size-256,Fail
>> -kms_plane_cursor@...e-A-primary-size-64,Fail
>> -kms_plane_cursor@...e-A-viewport-size-128,Fail
>> -kms_plane_cursor@...e-A-viewport-size-256,Fail
>> -kms_plane_cursor@...e-A-viewport-size-64,Fail
>> -kms_plane_cursor@...e-B-overlay-size-128,Fail
>> -kms_plane_cursor@...e-B-overlay-size-256,Fail
>> -kms_plane_cursor@...e-B-overlay-size-64,Fail
>> -kms_plane_cursor@...e-B-primary-size-128,Fail
>> -kms_plane_cursor@...e-B-primary-size-256,Fail
>> -kms_plane_cursor@...e-B-primary-size-64,Fail
>> -kms_plane_cursor@...e-B-viewport-size-128,Fail
>> -kms_plane_cursor@...e-B-viewport-size-256,Fail
>> -kms_plane_cursor@...e-B-viewport-size-64,Fail
>> -kms_plane_cursor@...mary,Crash
>> -kms_plane_cursor@...wport,Crash
>> -kms_plane_lowres@...ing-none,Fail
>> -kms_plane_scaling@...nscale-with-modifier-factor-0-25,Fail
>> -kms_plane_scaling@...nscale-with-rotation-factor-0-25,Fail
>> -kms_plane_scaling@...cale-with-modifier-20x20,Fail
>> -kms_plane_scaling@...cale-with-modifier-factor-0-25,Fail
>> -kms_plane_scaling@...cale-with-pixel-format-20x20,Fail
>> -kms_plane_scaling@...cale-with-pixel-format-factor-0-25,Fail
>> -kms_plane_scaling@...cale-with-rotation-20x20,Fail
>> -kms_prime@...ic-crc,Fail
>> -kms_properties@...nector-properties-atomic,Crash
>> -kms_properties@...nector-properties-legacy,Crash
>> -kms_properties@..._properties-sanity-atomic,Crash
>> -kms_properties@..._properties-sanity-non-atomic,Crash
>> -kms_rmfb@...se-fd,Crash
>> -kms_setmode@...alid-clone-single-crtc,Crash
>> +dumb_buffer@...ate-clear,Crash
>> +dumb_buffer@...ate-valid-dumb,Crash
>> +dumb_buffer@...alid-bpp,Crash
>> +dumb_buffer@...-invalid-size,Crash
>> +dumb_buffer@...-uaf,Crash
>> +dumb_buffer@...-valid,Crash
>> +panfrost_prime@...-prime-import,Crash
>> +tools_test@...ls_test,Crash
>> diff --git a/drivers/gpu/drm/ci/xfails/rockchip-rk3288-skips.txt b/drivers/gpu/drm/ci/xfails/rockchip-rk3288-skips.txt
>> index c33dc95b7fc1..6d3757dca83b 100644
>> --- a/drivers/gpu/drm/ci/xfails/rockchip-rk3288-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/rockchip-rk3288-skips.txt
>> @@ -65,3 +65,7 @@ i915_.*
>>   
>>   # Panfrost is not a KMS driver, so skip the KMS tests
>>   kms_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> diff --git a/drivers/gpu/drm/ci/xfails/rockchip-rk3399-fails.txt b/drivers/gpu/drm/ci/xfails/rockchip-rk3399-fails.txt
>> index d516d9c1d546..9ef460646d76 100644
>> --- a/drivers/gpu/drm/ci/xfails/rockchip-rk3399-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/rockchip-rk3399-fails.txt
>> @@ -1,75 +1,8 @@
>> -kms_color@...ma,Fail
>> -kms_color@...acy-gamma,Fail
>> -kms_color@...e-A-legacy-gamma,Fail
>> -kms_color@...e-B-legacy-gamma,Fail
>> -kms_cursor_crc@...sor-alpha-opaque,Fail
>> -kms_cursor_crc@...sor-alpha-transparent,Fail
>> -kms_cursor_crc@...sor-dpms,Fail
>> -kms_cursor_crc@...sor-offscreen-32x10,Fail
>> -kms_cursor_crc@...sor-offscreen-32x32,Fail
>> -kms_cursor_crc@...sor-offscreen-64x64,Fail
>> -kms_cursor_crc@...sor-onscreen-32x10,Fail
>> -kms_cursor_crc@...sor-onscreen-32x32,Fail
>> -kms_cursor_crc@...sor-onscreen-64x21,Fail
>> -kms_cursor_crc@...sor-onscreen-64x64,Fail
>> -kms_cursor_crc@...sor-random-32x10,Fail
>> -kms_cursor_crc@...sor-random-32x32,Fail
>> -kms_cursor_crc@...sor-random-64x21,Fail
>> -kms_cursor_crc@...sor-random-64x64,Fail
>> -kms_cursor_crc@...sor-rapid-movement-32x32,Fail
>> -kms_cursor_crc@...sor-rapid-movement-64x21,Fail
>> -kms_cursor_crc@...sor-rapid-movement-64x64,Fail
>> -kms_cursor_crc@...sor-size-change,Fail
>> -kms_cursor_crc@...sor-sliding-32x10,Fail
>> -kms_cursor_crc@...sor-sliding-32x32,Fail
>> -kms_cursor_crc@...sor-sliding-64x21,Fail
>> -kms_cursor_crc@...sor-sliding-64x64,Fail
>> -kms_flip@...ic-flip-vs-wf_vblank,Fail
>> -kms_flip@...cking-wf_vblank,Fail
>> -kms_flip@...s-vs-vblank-race,Fail
>> -kms_flip@...p-vs-absolute-wf_vblank,Fail
>> -kms_flip@...p-vs-absolute-wf_vblank-interruptible,Fail
>> -kms_flip@...p-vs-blocking-wf-vblank,Fail
>> -kms_flip@...p-vs-modeset-vs-hang,Fail
>> -kms_flip@...p-vs-panning,Fail
>> -kms_flip@...p-vs-panning-interruptible,Fail
>> -kms_flip@...p-vs-panning-vs-hang,Fail
>> -kms_flip@...eset-vs-vblank-race,Fail
>> -kms_flip@...in-flip-fb-recreate,Fail
>> -kms_flip@...in-flip-fb-recreate-interruptible,Fail
>> -kms_flip@...in-flip-ts-check,Fail
>> -kms_flip@...in-flip-ts-check-interruptible,Fail
>> -kms_flip@...vblank-ts-check,Fail
>> -kms_flip@...vblank-ts-check-interruptible,Fail
>> -kms_invalid_mode@...-max-clock,Fail
>> -kms_pipe_crc_basic@...pare-crc-sanitycheck-nv12,Fail
>> -kms_pipe_crc_basic@...pare-crc-sanitycheck-xr24,Fail
>> -kms_pipe_crc_basic@...able-crc-after-crtc,Fail
>> -kms_pipe_crc_basic@...blocking-crc,Fail
>> -kms_pipe_crc_basic@...blocking-crc-frame-sequence,Fail
>> -kms_pipe_crc_basic@...d-crc,Fail
>> -kms_pipe_crc_basic@...d-crc-frame-sequence,Fail
>> -kms_plane@...el-format,Fail
>> -kms_plane@...el-format-source-clamping,Fail
>> -kms_plane@...ne-panning-bottom-right,Fail
>> -kms_plane@...ne-panning-top-left,Fail
>> -kms_plane@...ne-position-covered,Fail
>> -kms_plane@...ne-position-hole,Fail
>> -kms_plane@...ne-position-hole-dpms,Fail
>> -kms_plane_cursor@...rlay,Fail
>> -kms_plane_cursor@...e-B-overlay-size-128,Fail
>> -kms_plane_cursor@...e-B-overlay-size-256,Fail
>> -kms_plane_cursor@...e-B-overlay-size-64,Fail
>> -kms_plane_cursor@...e-B-primary-size-128,Fail
>> -kms_plane_cursor@...e-B-primary-size-256,Fail
>> -kms_plane_cursor@...e-B-primary-size-64,Fail
>> -kms_plane_cursor@...e-B-viewport-size-128,Fail
>> -kms_plane_cursor@...e-B-viewport-size-256,Fail
>> -kms_plane_cursor@...e-B-viewport-size-64,Fail
>> -kms_plane_cursor@...mary,Fail
>> -kms_plane_cursor@...wport,Fail
>> -kms_plane_multiple@...mic-pipe-B-tiling-none,Fail
>> -kms_plane_multiple@...ing-none,Fail
>> -kms_prime@...ic-crc,Fail
>> -kms_rmfb@...se-fd,Fail
>> -kms_universal_plane@...versal-plane-pipe-B-functional,Fail
>> +dumb_buffer@...ate-clear,Fail
>> +dumb_buffer@...ate-valid-dumb,Fail
>> +dumb_buffer@...alid-bpp,Fail
>> +dumb_buffer@...-invalid-size,Fail
>> +dumb_buffer@...-uaf,Fail
>> +dumb_buffer@...-valid,Fail
>> +panfrost_prime@...-prime-import,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/rockchip-rk3399-flakes.txt b/drivers/gpu/drm/ci/xfails/rockchip-rk3399-flakes.txt
>> index c9fdc623ab91..742c27d9a598 100644
>> --- a/drivers/gpu/drm/ci/xfails/rockchip-rk3399-flakes.txt
>> +++ b/drivers/gpu/drm/ci/xfails/rockchip-rk3399-flakes.txt
>> @@ -1,7 +1,6 @@
>> -kms_bw@...ear-tiling-2-displays-1920x1080p
>> -kms_cursor_crc@...sor-offscreen-64x21
>> -kms_flip@...s-vs-vblank-race-interruptible
>> -kms_flip@...p-vs-wf_vblank-interruptible
>> -kms_plane_cursor@...rlay
>> -kms_plane_cursor@...mary
>> -kms_plane_cursor@...wport
>> +# Board Name: rk3399-gru-kevin
>> +# Bug Report: https://lore.kernel.org/dri-devel/5cc34a8b-c1fa-4744-9031-2d33ecf41011@collabora.com/T/#u
>> +# IGT Version: 1.28-g0df7b9b97
>> +# Linux Version: 6.9.0-rc7
>> +# Failure Rate: 50
>> +panfrost_submit@...-unhandled-pagefault
>> diff --git a/drivers/gpu/drm/ci/xfails/rockchip-rk3399-skips.txt b/drivers/gpu/drm/ci/xfails/rockchip-rk3399-skips.txt
>> index 8a7c9464b30d..5c52b25b4213 100644
>> --- a/drivers/gpu/drm/ci/xfails/rockchip-rk3399-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/rockchip-rk3399-skips.txt
>> @@ -18,3 +18,7 @@ i915_.*
>>   
>>   # Panfrost is not a KMS driver, so skip the KMS tests
>>   kms_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> diff --git a/drivers/gpu/drm/ci/xfails/update-xfails.py b/drivers/gpu/drm/ci/xfails/update-xfails.py
>> index e9f0ec7fed8d..a446e98d72a1 100755
>> --- a/drivers/gpu/drm/ci/xfails/update-xfails.py
>> +++ b/drivers/gpu/drm/ci/xfails/update-xfails.py
>> @@ -93,10 +93,10 @@ def add_unit_test_or_update_result_to_fails_if_present(fails_txt, unit_test, fai
>>   def split_unit_test_from_collate(xfails):
>>       for job_name in xfails.keys():
>>           for job_id in xfails[job_name].copy().keys():
>> -            if "not found" in xfails[job_name][job_id]:
>> +            if "not found" in xfails[job_name][job_id].content_as_str:
>>                   del xfails[job_name][job_id]
>>                   continue
>> -            xfails[job_name][job_id] = xfails[job_name][job_id].strip().split("\n")
>> +            xfails[job_name][job_id] = xfails[job_name][job_id].content_as_str.splitlines()
>>   
>>   
>>   def get_xfails_from_pipeline_url(pipeline_url):
>> diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
>> index 007f21e56d89..fdf09fe11566 100644
>> --- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
>> @@ -1,33 +1,72 @@
>> -kms_addfb_basic@...fb25-bad-modifier,Fail
>>   kms_addfb_basic@...-pitch-65536,Fail
>>   kms_addfb_basic@...too-small,Fail
>>   kms_addfb_basic@...e-max,Fail
>>   kms_addfb_basic@...-high,Fail
>>   kms_atomic_transition@...ne-primary-toggle-with-vblank-wait,Fail
>>   kms_bw@...ear-tiling-1-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-1-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-1-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-1-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-10-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-10-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-10-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-10-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-11-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-11-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-11-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-11-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-12-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-12-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-12-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-12-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-13-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-13-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-13-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-13-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-14-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-14-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-14-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-14-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-15-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-15-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-15-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-15-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-16-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-16-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-16-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-16-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-2-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-2-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-2-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-2-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-3-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-3-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-3-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-3-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-4-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-4-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-4-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-4-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-5-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-5-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-5-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-5-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-6-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-6-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-6-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-6-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-7-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-7-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-7-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-7-displays-3840x2160p,Fail
>>   kms_bw@...ear-tiling-8-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-8-displays-2160x1440p,Fail
>>   kms_bw@...ear-tiling-8-displays-2560x1440p,Fail
>>   kms_bw@...ear-tiling-8-displays-3840x2160p,Fail
>> +kms_bw@...ear-tiling-9-displays-1920x1080p,Fail
>> +kms_bw@...ear-tiling-9-displays-2160x1440p,Fail
>> +kms_bw@...ear-tiling-9-displays-2560x1440p,Fail
>> +kms_bw@...ear-tiling-9-displays-3840x2160p,Fail
>>   kms_flip@...olute-wf_vblank,Fail
>>   kms_flip@...olute-wf_vblank-interruptible,Fail
>>   kms_flip@...ic-flip-vs-wf_vblank,Fail
>> @@ -54,31 +93,34 @@ kms_flip@...in-flip-ts-check-interruptible,Fail
>>   kms_flip@...vblank-ts-check,Fail
>>   kms_flip@...vblank-ts-check-interruptible,Fail
>>   kms_invalid_mode@...-max-clock,Fail
>> -kms_plane_scaling@...nscale-with-modifier-factor-0-25,Fail
>> -kms_plane_scaling@...nscale-with-rotation-factor-0-25,Fail
>> -kms_plane_scaling@...nes-upscale-20x20,Fail
>> -kms_plane_scaling@...nes-upscale-20x20-downscale-factor-0-25,Fail
>> -kms_plane_scaling@...nes-upscale-20x20-downscale-factor-0-5,Fail
>> -kms_plane_scaling@...nes-upscale-20x20-downscale-factor-0-75,Fail
>> -kms_plane_scaling@...cale-with-modifier-20x20,Fail
>> -kms_plane_scaling@...cale-with-modifier-factor-0-25,Fail
>> -kms_plane_scaling@...cale-with-pixel-format-20x20,Fail
>> -kms_plane_scaling@...cale-with-pixel-format-factor-0-25,Fail
>> -kms_plane_scaling@...cale-with-rotation-20x20,Fail
>> -kms_selftest@..._format,Timeout
>> -kms_selftest@..._format_helper,Timeout
>> +kms_lease@...sor-implicit-plane,Fail
>> +kms_lease@...se-uevent,Fail
>> +kms_lease@...e-flip-implicit-plane,Fail
>> +kms_lease@...crtc-implicit-plane,Fail
>> +kms_lease@...ple-lease,Fail
>> +kms_sequence@...-busy,Fail
>> +kms_sequence@...-forked,Fail
>> +kms_sequence@...-forked-busy,Fail
>> +kms_sequence@...-idle,Fail
>> +kms_sequence@...ue-busy,Fail
>> +kms_sequence@...ue-idle,Fail
>>   kms_setmode@...ic,Fail
>> +kms_vblank@...uracy-idle,Fail
>>   kms_vblank@...c-id,Fail
>>   kms_vblank@...alid,Fail
>> -kms_vblank@...e-A-accuracy-idle,Fail
>> -kms_vblank@...e-A-query-busy,Fail
>> -kms_vblank@...e-A-query-forked,Fail
>> -kms_vblank@...e-A-query-forked-busy,Fail
>> -kms_vblank@...e-A-query-idle,Fail
>> -kms_vblank@...e-A-ts-continuation-idle,Fail
>> -kms_vblank@...e-A-ts-continuation-modeset,Fail
>> -kms_vblank@...e-A-ts-continuation-suspend,Fail
>> -kms_vblank@...e-A-wait-busy,Fail
>> -kms_vblank@...e-A-wait-forked,Fail
>> -kms_vblank@...e-A-wait-forked-busy,Fail
>> -kms_vblank@...e-A-wait-idle,Fail
>> +kms_vblank@...ry-busy,Fail
>> +kms_vblank@...ry-forked,Fail
>> +kms_vblank@...ry-forked-busy,Fail
>> +kms_vblank@...ry-idle,Fail
>> +kms_vblank@...continuation-dpms-rpm,Fail
>> +kms_vblank@...continuation-dpms-suspend,Fail
>> +kms_vblank@...continuation-idle,Fail
>> +kms_vblank@...continuation-modeset,Fail
>> +kms_vblank@...continuation-modeset-rpm,Fail
>> +kms_vblank@...continuation-suspend,Fail
>> +kms_vblank@...t-busy,Fail
>> +kms_vblank@...t-forked,Fail
>> +kms_vblank@...t-forked-busy,Fail
>> +kms_vblank@...t-idle,Fail
>> +perf@...5-ref-count,Fail
>> +tools_test@...ls_test,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
>> index 59d390d6856f..e0ca4fadb84f 100644
>> --- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
>> @@ -18,3 +18,7 @@ panfrost_.*
>>   gem_.*
>>   i915_.*
>>   xe_.*
>> +
>> +# Currently fails and causes coverage loss for other tests
>> +# since core_getversion also fails.
>> +core_hotunplug.*
>> -- 
>> 2.40.1
>>
>