[Do not merge] testing root6 PR tests #9842

smuzaffar · 2025-05-09T09:44:46Z

No description provided.

cmsbuild · 2025-05-09T09:45:05Z

A new Pull Request was created by @smuzaffar for branch IB/CMSSW_15_1_X/rootmaster.

@cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2025-05-09T09:45:06Z

cms-bot internal usage

smuzaffar · 2025-05-09T09:46:21Z

test parameters:

addpkg = Alignment,Fireworks,DQMOffline,HeterogeneousCore/CUDATest

smuzaffar · 2025-05-09T09:46:47Z

please test for el8_amd64_gcc12

smuzaffar · 2025-05-09T09:47:32Z

please test for el8_amd64_gcc12

cmsbuild · 2025-05-09T10:35:50Z

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b2ccda/45992/summary.html
COMMIT: ed89127
CMSSW: CMSSW_15_1_ROOT6_X_2025-05-08-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9842/45992/install.sh to create a dev area with all the needed externals and cmssw changes.

Build

I found compilation error when building:

>> Subsystem HLTrigger built
>> Subsystem Utilities built
Copying tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreCudaAsync/libRecoTrackerLSTCoreCudaAsync_nv.a to productstore area:
cp: cannot stat 'tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreCudaAsync/libRecoTrackerLSTCoreCudaAsync_nv.a': No such file or directory
>> Deleted: tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreCudaAsync/libRecoTrackerLSTCoreCudaAsync_nv.a
gmake: *** [config/SCRAM/GMake/Makefile.rules:1918: tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreCudaAsync/libRecoTrackerLSTCoreCudaAsync_nv.a] Error 1
Copying tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreROCmAsync/libRecoTrackerLSTCoreROCmAsync_rocm.a to productstore area:
cp: cannot stat 'tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreROCmAsync/libRecoTrackerLSTCoreROCmAsync_rocm.a': No such file or directory
>> Deleted: tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreROCmAsync/libRecoTrackerLSTCoreROCmAsync_rocm.a
gmake: *** [config/SCRAM/GMake/Makefile.rules:1918: tmp/el8_amd64_gcc12/src/RecoTracker/LSTCore/src/alpaka/RecoTrackerLSTCoreROCmAsync/libRecoTrackerLSTCoreROCmAsync_rocm.a] Error 1
>> Entering Package Fireworks/TableWidget

smuzaffar · 2025-05-09T12:43:56Z

please test with cms-sw/cmssw#48048 for CMSSW_15_1_ROOT6_X/el8_amd64_gcc12

smuzaffar · 2025-05-09T13:18:34Z

test parameters:

addpkg = HeterogeneousCore/CUDATest

smuzaffar · 2025-05-09T14:08:32Z

please test with cms-sw/cmssw#48048 for CMSSW_15_1_ROOT6_X/el8_amd64_gcc12

cmsbuild · 2025-05-09T15:33:38Z

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b2ccda/46003/summary.html
COMMIT: ed89127
CMSSW: CMSSW_15_1_ROOT6_X_2025-05-08-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9842/46003/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b2ccda/46003/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b2ccda/46003/git-merge-result

Unit Tests

I found 22 errors in the following unit tests:

---> test testAccessToEDMInputsOfHLTTests had ERRORS
---> test testAlignmentStats had ERRORS
---> test ApeTest had ERRORS
and more ...

RelVals

136.731

----- Begin Fatal Exception 09-May-2025 16:53:41 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/data/Run2016B/SinglePhoton/RAW/v2/000/274/199/00000/007498A6-8426-E611-8BA8-02163E013754.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/data/Run2016B/SinglePhoton/RAW/v2/000/274/199/00000/007498A6-8426-E611-8BA8-02163E013754.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/data/Run2016B/SinglePhoton/RAW/v2/000/274/199/00000/007498A6-8426-E611-8BA8-02163E013754.root
      [c] Input file root://xrootd-cms.infn.it//store/data/Run2016B/SinglePhoton/RAW/v2/000/274/199/00000/007498A6-8426-E611-8BA8-02163E013754.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/data/Run2016B/SinglePhoton/RAW/v2/000/274/199/00000/007498A6-8426-E611-8BA8-02163E013754.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/data/Run2016B/SinglePhoton/RAW/v2/000/274/199/00000/007498A6-8426-E611-8BA8-02163E013754.root?tried=+1213xrootd-redic.pi.infn.it&xrdcl.requuid=156d5cef-8921-41a4-bbd0-448bdedcad7d
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

145.104

----- Begin Fatal Exception 09-May-2025 16:53:51 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/data/Run2024C/JetMET0/RAW/v1/000/379/454/00000/b1974300-51a3-4a2b-9259-be3274e6b7cf.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/data/Run2024C/JetMET0/RAW/v1/000/379/454/00000/b1974300-51a3-4a2b-9259-be3274e6b7cf.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/data/Run2024C/JetMET0/RAW/v1/000/379/454/00000/b1974300-51a3-4a2b-9259-be3274e6b7cf.root
      [c] Input file root://xrootd-cms.infn.it//store/data/Run2024C/JetMET0/RAW/v1/000/379/454/00000/b1974300-51a3-4a2b-9259-be3274e6b7cf.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/data/Run2024C/JetMET0/RAW/v1/000/379/454/00000/b1974300-51a3-4a2b-9259-be3274e6b7cf.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/data/Run2024C/JetMET0/RAW/v1/000/379/454/00000/b1974300-51a3-4a2b-9259-be3274e6b7cf.root?tried=+1213xrootd-redic.pi.infn.it&xrdcl.requuid=e5adad85-5e91-4f0d-8c19-6bb38b49756f
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

140.56

----- Begin Fatal Exception 09-May-2025 16:53:32 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/hidata/HIRun2018A/HIHardProbes/RAW/v1/000/326/479/00000/0E2CC5D5-9D87-7348-9219-B00CD718C847.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/hidata/HIRun2018A/HIHardProbes/RAW/v1/000/326/479/00000/0E2CC5D5-9D87-7348-9219-B00CD718C847.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/hidata/HIRun2018A/HIHardProbes/RAW/v1/000/326/479/00000/0E2CC5D5-9D87-7348-9219-B00CD718C847.root
      [c] Input file root://xrootd-cms.infn.it//store/hidata/HIRun2018A/HIHardProbes/RAW/v1/000/326/479/00000/0E2CC5D5-9D87-7348-9219-B00CD718C847.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/hidata/HIRun2018A/HIHardProbes/RAW/v1/000/326/479/00000/0E2CC5D5-9D87-7348-9219-B00CD718C847.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/hidata/HIRun2018A/HIHardProbes/RAW/v1/000/326/479/00000/0E2CC5D5-9D87-7348-9219-B00CD718C847.root?tried=+1213llrxrd-redir.in2p3.fr&xrdcl.requuid=70c9dc6d-8a46-4e83-8ecf-55f67d8ba0e8
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

145.604

AddOn Tests

hlt_data_Fake1

----- Begin Fatal Exception 09-May-2025 16:53:42 CEST-----------------------
An exception of category 'FallbackFileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling XrdFile::open()
Exception Message:
Failed to open the file 'root://xrootd-cms.infn.it//store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root'
   Additional Info:
      [a] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://cms-xrd-global.cern.ch//eos/cms/store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root
      [b] Calling RootInputFileSequence::initTheFile(): fail to open the file with name root://eoscms.cern.ch//eos/cms/store/user/cmsbuild/store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root
      [c] Input file root://xrootd-cms.infn.it//store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root could not be opened.
      [d] XrdCl::File::Open(name='root://xrootd-cms.infn.it//store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root', flags=0x10, permissions=0660) => error '[ERROR] Server responded with an error: [3011] No servers are available to read the file.
' (errno=3011, code=400). No additional data servers were found.
      [e] Last URL tried: root://cms-xrd-global.cern.ch:1094//store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root?tried=+1213llrxrd-redir.in2p3.fr&xrdcl.requuid=5200f9f3-0225-4e2d-9c4e-0685b956e100
      [f] Problematic data server: cms-xrd-global.cern.ch:1094
      [g] Disabled source: cms-xrd-global.cern.ch:1094
----- End Fatal Exception -------------------------------------------------

hlt_data_Fake1

----- Begin Fatal Exception 09-May-2025 16:53:47 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling File::sysopen()
Exception Message:
Failed to open the file 'RelVal_Raw_Fake1_DATA.root'
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake1_DATA.root could not be opened.
      [b] open() failed with system error 'No such file or directory' (error code 2)
----- End Fatal Exception -------------------------------------------------

hlt_data_Fake1

----- Begin Fatal Exception 09-May-2025 16:54:04 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   [3] Calling StorageFactory::open()
   [4] Calling File::sysopen()
Exception Message:
Failed to open the file 'RelVal_Raw_Fake1_DATA.root'
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake1_DATA.root could not be opened.
      [b] open() failed with system error 'No such file or directory' (error code 2)
----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

smuzaffar · 2025-05-12T07:20:47Z

please test for el8_amd64_gcc12

cmsbuild · 2025-05-12T12:22:45Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b2ccda/46042/summary.html
COMMIT: ed89127
CMSSW: CMSSW_15_1_ROOT6_X_2025-05-11-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9842/46042/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b2ccda/46042/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b2ccda/46042/git-merge-result

Comparison Summary

Summary:

You potentially added 240 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 734 differences found in the comparisons
DQMHistoTests: Total files compared: 50
DQMHistoTests: Total histograms compared: 4038131
DQMHistoTests: Total failures: 1419
DQMHistoTests: Total nulls: 32
DQMHistoTests: Total successes: 4036660
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 37.904 KiB( 49 files compared)
DQMHistoSizes: changed ( 145.014,... ): 4.246 KiB L1TEMU/L1TdeStage2EMTF
DQMHistoSizes: changed ( 145.014,... ): 0.492 KiB L1T/L1TStage2uGT
Checked 215 log files, 184 edm output root files, 50 DQM output files
TriggerResults: no differences found

[Do not merge] testing root6 PR tests

ed89127

cmsbuild added tests-pending externals-pending pending-signatures orp-pending labels May 9, 2025

cmsbuild added tests-started and removed tests-pending labels May 9, 2025

cmsbuild added tests-rejected and removed tests-started labels May 9, 2025

cmsbuild added requires-external tests-started and removed tests-rejected labels May 9, 2025

cmsbuild added tests-rejected and removed tests-started labels May 9, 2025

cmsbuild added tests-started and removed requires-external tests-rejected labels May 12, 2025

cmsbuild removed the tests-started label May 12, 2025

cmsbuild added the tests-approved label May 12, 2025

smuzaffar closed this May 12, 2025

smuzaffar deleted the smuzaffar-patch-1 branch May 12, 2025 18:39

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Do not merge] testing root6 PR tests #9842

[Do not merge] testing root6 PR tests #9842

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025 •

edited

Loading

Uh oh!

smuzaffar commented May 9, 2025 •

edited

Loading

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

smuzaffar commented May 9, 2025 •

edited

Loading

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025

Uh oh!

smuzaffar commented May 12, 2025 •

edited

Loading

Uh oh!

cmsbuild commented May 12, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

[Do not merge] testing root6 PR tests #9842

[Do not merge] testing root6 PR tests #9842

Uh oh!

Conversation

smuzaffar commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

smuzaffar commented May 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025

Build

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

smuzaffar commented May 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

smuzaffar commented May 9, 2025

Uh oh!

cmsbuild commented May 9, 2025

Unit Tests

RelVals

AddOn Tests

Uh oh!

smuzaffar commented May 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented May 12, 2025

Comparison Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cmsbuild commented May 9, 2025 •

edited

Loading

smuzaffar commented May 9, 2025 •

edited

Loading

smuzaffar commented May 9, 2025 •

edited

Loading

smuzaffar commented May 12, 2025 •

edited

Loading