Skip to content

Conversation

krystian-hebel
Copy link
Contributor

@krystian-hebel krystian-hebel commented Jun 16, 2025

Note before merging: CFC001.002 has to be manually removed on server.

@krystian-hebel
Copy link
Contributor Author

krystian-hebel commented Jun 16, 2025

Todos:

  • manual tests - whole suites and specific OSes (Qubes OS, XCP-NG)
  • missing OS names - can be automated
  • AUD - deprecation, unclear
  • CBP - not used in releases, dev-tests?
  • DIO - inconsistent numbering
  • DMI - missing Fedora tests in the database
  • ECR - ID clashes
  • MBO/MNE FUBAR
  • RTD - reset to X instead of reset to default, should be changed on OSFV side?
  • USB - deprecation, unclear
  • UTC - deprecation
  • VBO - multiple tests with the same ID in OSFV (semi-auto)
  • WBS - disable became enable and vice versa, explain

These changes increased number of synchronized cases from 842 to 933. A large part of remaining differences comes from manual tests, and some more from tests without OS in name.

@krystian-hebel krystian-hebel changed the base branch from develop to test_id_ci June 24, 2025 17:03
@krystian-hebel krystian-hebel marked this pull request as ready for review June 24, 2025 17:05
@philipanda philipanda force-pushed the test_id_ci branch 3 times, most recently from 7ce0820 to 407ece9 Compare June 25, 2025 09:59
Test IDs in this suite were changed without keeping the previous IDs,
and without updating the database.

Signed-off-by: Krystian Hebel <[email protected]>
This ID was improperly written in the database, it was imported that
way from the spreadsheet. As it isn't used by any release in the
database, it can be changed with no negative consequences.

Signed-off-by: Krystian Hebel <[email protected]>
It was pointing to itself.

Signed-off-by: Krystian Hebel <[email protected]>
Missing OS name, will be added later in a batch.

Signed-off-by: Krystian Hebel <[email protected]>
Still many manual HDS cases not present in OSFV.

Signed-off-by: Krystian Hebel <[email protected]>
There are multiple MBO cases with MNE names, this needs investigation
and heavy modifications in database, including in existing releases.

Signed-off-by: Krystian Hebel <[email protected]>
It was pointing to non-existing MWL003.301. Neither of those exists in
OSFV repo as a test case, but MWL003.002 exists as a comment.

Signed-off-by: Krystian Hebel <[email protected]>
Signed-off-by: Krystian Hebel <[email protected]>
Shell changed to Boot Maintenance Manager. It really should be assigned
a different ID after such change, but there are already releases that
use it in this form.

Signed-off-by: Krystian Hebel <[email protected]>
Malformed IDs (too many digits) were used in release scopes, those had
to be added to lists of previous IDs. Links were also made in JSON file.

All of Fedora tests pointed to Ubuntu tests as previous IDs, those have
been removed to restore 1-to-1 mapping.

Signed-off-by: Krystian Hebel <[email protected]>
Malformed IDs (too many digits) were used in release scopes, those had
to be added to lists of previous IDs. Links were also made in JSON file.

Signed-off-by: Krystian Hebel <[email protected]>
… issues

Malformed IDs (too many digits) were used in release scopes, those had
to be added to lists of previous IDs. Links were also made in JSON file.

Signed-off-by: Krystian Hebel <[email protected]>
Multiple deprecations to be done in JSON.

Signed-off-by: Krystian Hebel <[email protected]>
…skip

This test wasn't included in a release yet, it is safe to change.
Also drop Ubuntu version from name and add it to JSON.

Signed-off-by: Krystian Hebel <[email protected]>
@macpijan macpijan closed this Jul 3, 2025
@macpijan macpijan deleted the deprecated-ids branch July 3, 2025 13:46
@macpijan macpijan restored the deprecated-ids branch July 3, 2025 14:15
@macpijan macpijan reopened this Jul 3, 2025
@macpijan macpijan changed the title Deprecated ids Draft: Deprecated ids Jul 3, 2025
@macpijan
Copy link
Contributor

macpijan commented Jul 3, 2025

We still wanted to fill in missing OS info here

Base automatically changed from test_id_ci to develop July 10, 2025 10:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants