[BuildRules] cuda/rocm tests and multi-vec env selection

[smuzaffar]

• Use cudaIsEnabled for cuda and alpaka-cuda
• Use rocmIsEnabled for rocm and alpaka-rocm
• Allow USER_SCRAM_TARGET env to set the cpu family for multi-vectorizations IB/releases e.g.
  • USER_SCRAM_TARGET=default cmsenv to select cmssw default i.e. sse3
  • USER_SCRAM_TARGET=haswell cmsenv to select haswell cpu family libraries

[smuzaffar]

test parameters:

• full_cmssw = true

[cmsbuild]

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch IB/CMSSW_13_1_X/master.

@cmsbuild, @smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

[smuzaffar]

please test

[smuzaffar]

please test for el8_ppc64le_gcc11

To test gpu based unit tests

[smuzaffar]

please test

[cmsbuild]

Pull request #8449 was updated.

[smuzaffar]

please test for el8_ppc64le_gcc11

[cmsbuild]

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-685843/32051/summary.html
COMMIT: f8e578b
CMSSW: CMSSW_13_1_X_2023-04-18-2300/el8_ppc64le_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8449/32051/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @consuegs Re-adding cosmic track collection ALCARECOTkAlCosmicsCosmicTF0T cmssw#41369
• @bsunanda Phase2-hgx337A Further attempts to diagnose cassette shift studies for HGCal geometry (relevant for the V18 version) cmssw#41355
• @cms-sw [BuildRules] Rocm/Cuda unit test improvement #8448

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-685843/32051/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-685843/32051/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test testONNXRuntime had ERRORS

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-685843/32050/summary.html
COMMIT: f8e578b
CMSSW: CMSSW_13_1_X_2023-04-19-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8449/32050/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @bsunanda Phase2-hgx337A Further attempts to diagnose cassette shift studies for HGCal geometry (relevant for the V18 version) cmssw#41355
• @cms-sw [BuildRules] Rocm/Cuda unit test improvement #8448

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-685843/32050/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-685843/32050/git-merge-result

Comparison Summary

Summary:

• You potentially removed 180 lines from the logs
• Reco comparison results: 21 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3459877
• DQMHistoTests: Total failures: 98
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3459757
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: no differences found

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_13_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)