Remove the webhooks UI test in favor of upstream testing#20678
Merged
lpramuk merged 1 commit intoSatelliteQE:masterfrom Feb 2, 2026
Merged
Remove the webhooks UI test in favor of upstream testing#20678lpramuk merged 1 commit intoSatelliteQE:masterfrom
lpramuk merged 1 commit intoSatelliteQE:masterfrom
Conversation
I have observed that the webhooks UI test can take up to 10 minutes to execute on local robottelo instance and up to 20+ minutes on PRT testing. This is with applied changes from SatelliteQE/airgun#2256 which update the test to pass after the webhook PF5 update. Without these changes, the test takes even longer. I do not think that this is a reasonable time for what the test does. I have recreated this test in foreman_webhooks: theforeman/foreman_webhooks#94 This test copies the functionality 1:1 and also tests on a live server using the Capybara framework. It takes on average 90 seconds to complete. Due to a sizable difference in a time needed for completion, I propose to replace test_webhook.py with the test in foreman_webhooks and to rely on testing in the foreman_webhooks repository when it comes to UI. This will contribute a tiny bit to reducing strain on our testing infrastructure.
Contributor
Reviewer's guide (collapsed on small PRs)Reviewer's GuideThis PR removes the slow webhooks UI integration test from this repository in favor of running an equivalent UI test upstream in the foreman_webhooks project, and adjusts CODEOWNERS accordingly. File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
adamruzicka
approved these changes
Jan 29, 2026
Contributor
adamruzicka
left a comment
There was a problem hiding this comment.
In the meantime, we merged theforeman/foreman_webhooks#94 making the original test here an unnecessary duplicate. With that being said, let's drop it from here
lpramuk
approved these changes
Feb 2, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem Statement
I have observed that the webhooks UI test can take up to 10 minutes to execute on local robottelo instance and up to 20+ minutes on PRT testing. This is with applied changes from the airgun PR which update the test to pass after the webhook PF5 update. Without these changes, the test takes even longer. I do not think that this is a reasonable time for what the test does.
Solution
I have recreated this test in foreman_webhooks. This test copies the functionality 1:1 and also tests on a live server using the Capybara framework. It takes on average 90 seconds to complete. Due to a sizable difference in a time needed for completion, I propose to replace test_webhook.py with the test in foreman_webhooks and to rely on testing in the foreman_webhooks repository when it comes to UI. This will contribute a tiny bit to reducing strain on our testing infrastructure.
Related Issues
PF 5 webhooks update: (foreman_webhooks): theforeman/foreman_webhooks#89
PF 5 webhooks update: (airgun): SatelliteQE/airgun#2256
Recreation of the test in foreman_webhooks: theforeman/foreman_webhooks#94
Summary by Sourcery
Remove the webhooks UI test and its associated ownership metadata in favor of relying on upstream UI testing in the foreman_webhooks project.
CI:
Tests: