Use failure name as upload failure can be empty #42
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
For: #40
Compared the output look at the edit of qubesos-bot from 20 hours ago on QubesOS/qubes-core-admin-client#332.
OpenQA test summary
Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025091804-4.3&flavor=pull-requests
Test run included the following:
New failures
Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025081011-4.3&flavor=update
system_tests_network
AssertionError: 1 != 0 : Ping by IP on netvm=something -> netvm=som...
system_tests_backup
TC_00_Backup: test_100_backup_dom0_no_restore (failure)
AssertionError: QubesException during backup_prepare: Can not backu...
TC_00_Backup: test_101_backup_dom0_to_homedir (failure)
AssertionError: QubesException during backup_prepare: Can not backu...
system_tests_pvgrub_salt_storage
qubes.exc.QubesVMShutdownTimeoutError: Domain shutdown timed out: '...
system_tests_usbproxy
AssertionError: 0 == 0 : Device disconnection failed
system_tests_network_ipv6
AssertionError: 1 != 0 : Ping by IP on netvm=something -> netvm=som...
system_tests_qwt_win10_seamless@hw13
# Test died: no candidate needle with tag(s) 'windows-Edge-address-...
system_tests_qwt_win11@hw13
windows_install: wait_serial (wait serial expected)
# wait_serial expected: qr/qDqV_-\d+-/...
windows_install: Failed (test died + timed out)
# Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_extra
~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 0 == 0
system_tests_guivm_vnc_gui_interactive
# Test died: no candidate needle with tag(s) 'qubes-qube-manager' m...
Failed tests
15 failures
system_tests_network
AssertionError: 1 != 0 : Ping by IP on netvm=something -> netvm=som...
system_tests_backup
TC_00_Backup: test_100_backup_dom0_no_restore (failure)
AssertionError: QubesException during backup_prepare: Can not backu...
TC_00_Backup: test_101_backup_dom0_to_homedir (failure)
AssertionError: QubesException during backup_prepare: Can not backu...
system_tests_pvgrub_salt_storage
qubes.exc.QubesVMShutdownTimeoutError: Domain shutdown timed out: '...
system_tests_usbproxy
AssertionError: 0 == 0 : Device disconnection failed
system_tests_network_ipv6
AssertionError: 1 != 0 : Ping by IP on netvm=something -> netvm=som...
system_tests_qwt_win10_seamless@hw13
# Test died: no candidate needle with tag(s) 'windows-Edge-address-...
system_tests_qwt_win11@hw13
windows_install: wait_serial (wait serial expected)
# wait_serial expected: qr/qDqV_-\d+-/...
windows_install: Failed (test died + timed out)
# Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...
system_tests_dispvm_perf@hw7
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
system_tests_extra
TC_00_QVCTest_whonix-gateway-17: test_010_screenshare (failure)
~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 0 == 0
TC_00_QVCTest_whonix-workstation-17: test_010_screenshare (failure)
AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...
system_tests_guivm_vnc_gui_interactive
# Test died: no candidate needle with tag(s) 'qubes-qube-manager' m...
Fixed failures
Compared to: https://openqa.qubes-os.org/tests/149225#dependencies
82 fixed
system_tests_dispvm
system_tests: Fail (unknown)
Tests qubes.tests.integ.dispvm failed (exit code 1), details report...
system_tests: Failed (test died)
# Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
TC_20_DispVM_debian-13-xfce: test_012_preload_low_mem (failure)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1 != 0
TC_20_DispVM_debian-13-xfce: test_013_preload_gui (error)
raise KeyError(key)... KeyError: 'disp3723'
TC_20_DispVM_debian-13-xfce: test_014_preload_nogui (error + cleanup)
raise TimeoutError from exc_val... TimeoutError
TC_20_DispVM_debian-13-xfce: test_015_preload_race_more (error + cleanup)
raise KeyError(key)... KeyError: 'disp1187'
TC_20_DispVM_debian-13-xfce: test_016_preload_race_less (failure + cleanup)
^^^^^^^^^^^^^^^^^^^^^^... AssertionError
TC_20_DispVM_debian-13-xfce: test_017_preload_autostart (error)
raise KeyError(key)... KeyError: 'disp7317'
TC_20_DispVM_debian-13-xfce: test_018_preload_global (error)
raise KeyError(key)... KeyError: 'disp8572'
TC_20_DispVM_debian-13-xfce: test_019_preload_refresh (error)
raise KeyError(key)... KeyError: 'disp6425'
TC_20_DispVM_fedora-42-xfce: test_012_preload_low_mem (failure)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1 != 0
TC_20_DispVM_whonix-workstation-17: test_012_preload_low_mem (failure)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1 != 0
system_tests_kde_gui_interactive
gui_keyboard_layout: wait_serial (wait serial expected)
# wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...
gui_keyboard_layout: Failed (test died)
# Test died: command 'test "$(cd ~user;ls e1*)" = "$(qvm-run -p wor...
system_tests_audio
system_tests: Fail (unknown)
Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
system_tests: Failed (test died)
# Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
TC_20_AudioVM_Pulse_whonix-workstation-17: test_223_audio_play_hvm (error)
qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_20_AudioVM_Pulse_whonix-workstation-17: test_224_audio_rec_muted_hvm (error)
qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_20_AudioVM_Pulse_whonix-workstation-17: test_225_audio_rec_unmuted_hvm (error)
qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_20_AudioVM_Pulse_whonix-workstation-17: test_252_audio_playback_audiovm_switch_hvm (error)
qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
system_tests_audio@hw1
system_tests: Fail (unknown)
Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
system_tests: Failed (test died)
# Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
TC_20_AudioVM_Pulse_whonix-workstation-17: test_223_audio_play_hvm (error)
qubes.exc.QubesVMError: Cannot connect to qrexec agent for 60 secon...
TC_20_AudioVM_Pulse_whonix-workstation-17: test_224_audio_rec_muted_hvm (error)
qubes.exc.QubesVMError: Cannot connect to qrexec agent for 60 secon...
TC_20_AudioVM_Pulse_whonix-workstation-17: test_252_audio_playback_audiovm_switch_hvm (error)
qubes.exc.QubesVMError: Cannot connect to qrexec agent for 60 secon...
system_tests_dispvm_perf@hw7
system_tests: wait_serial (wait serial expected)
# wait_serial expected: qr/D2qNh-\d+-/...
TC_00_DispVMPerf_debian-13-xfce: test_000_dispvm (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_002_dispvm_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_006_dispvm_from_dom0 (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_008_dispvm_from_dom0_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_020_dispvm_preload (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_021_dispvm_preload_gui (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_022_dispvm_preload_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_023_dispvm_preload_gui_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_026_dispvm_from_dom0_preload (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_027_dispvm_from_dom0_preload_gui (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_028_dispvm_from_dom0_preload_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_029_dispvm_from_dom0_preload_gui_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_400_dispvm_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_402_dispvm_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_404_dispvm_preload_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_404_dispvm_preload_less_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_404_dispvm_preload_more_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_405_dispvm_preload_gui_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_406_dispvm_preload_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_407_dispvm_preload_gui_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_900_vm (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_902_vm_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_904_vm_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_debian-13-xfce: test_906_vm_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_020_dispvm_preload (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_021_dispvm_preload_gui (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_022_dispvm_preload_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_023_dispvm_preload_gui_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_026_dispvm_from_dom0_preload (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_027_dispvm_from_dom0_preload_gui (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_028_dispvm_from_dom0_preload_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_029_dispvm_from_dom0_preload_gui_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_404_dispvm_preload_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_404_dispvm_preload_less_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_404_dispvm_preload_more_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_405_dispvm_preload_gui_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_406_dispvm_preload_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_fedora-42-xfce: test_407_dispvm_preload_gui_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_020_dispvm_preload (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_021_dispvm_preload_gui (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_022_dispvm_preload_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_023_dispvm_preload_gui_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_026_dispvm_from_dom0_preload (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_028_dispvm_from_dom0_preload_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_029_dispvm_from_dom0_preload_gui_concurrent (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_404_dispvm_preload_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_404_dispvm_preload_less_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_404_dispvm_preload_more_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_405_dispvm_preload_gui_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_406_dispvm_preload_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
TC_00_DispVMPerf_whonix-workstation-17: test_407_dispvm_preload_gui_concurrent_api (failure)
AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...
system_tests_guivm_gpu_gui_interactive@hw13
guivm_startup: wait_serial (wait serial expected)
# wait_serial expected: qr/lEcbc-\d+-/...
guivm_startup: Failed (test died + timed out)
# Test died: command '! qvm-check sys-whonix || time qvm-start sys-...
system_tests_basic_vm_qrexec_gui_ext4
system_tests: Fail (unknown)
Tests qubes.tests.integ.vm_qrexec_gui failed (exit code 1), details...
system_tests: Failed (test died)
# Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
TC_20_NonAudio_whonix-gateway-17-pool: test_012_qubes_desktop_run (error + cleanup)
raise TimeoutError from exc_val... TimeoutError
Performance Tests
Performance degradation:
12 performance degradations
Remaining performance tests:
161 tests
Would label it with: ['openqa-failed']