[RFC] Minimal test of Configuration/PyReleaseValidation/python/relval_steps.py validity

[iarspider]

If I'm reading the code correctly, we construct all possible workflows on the fly. So, if we can change runTheMatrix (relval_steps.py to be excact) to throw an error on this line if constructed value of baseDataSetReleaseBetter[key] is weird - e.g. just 1, then, during PR testing, we could execute runTheMatrix -n (which lists all workflows and takes ~1 minute) and detect that error.

@AdrianoDee do you think it is a reasonable idea?

[cmsbuild]

cms-bot internal usage

[cmsbuild]

A new Issue was created by @iarspider.

@Dr15Jones, @antoniovilela, @makortel, @mandrenguyen, @rappoccio, @sextonkennedy, @smuzaffar can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

[AdrianoDee]

It could work, in principle one could directly check just before the loop if defaultDataSets has any empty ('') value (being initialized here).

My suspect is that there are many of the conditions defined in upgradeWorkflowComponents.py (and below for Run4) for which we don't have a defined input dataset, just because they are not really run regularly for RelVals (e.g. 2022postEE is not there).

[AdrianoDee]

Anyway, I could have a draft implementing something like the check you propose. Most probably it will fail at the beginning. But we could iterate from that. I'll be able to have a look at it not before next week, though.

[makortel]

assign pdmv

[cmsbuild]

New categories assigned: pdmv

@AdrianoDee,@DickyChant,@miquork you have been requested to review this Pull request/Issue and eventually sign? Thanks

[iarspider]

@AdrianoDee any progress with that?

[AdrianoDee]

Hi @iarspider, sorry for the delay. I've proposed a solution in #47377