Refactor PathsAndConsumesOfModules #47937

Dr15Jones · 2025-04-23T19:32:12Z

PR description:

moved complex logic for creating the internal data structures to the class itself
can now ask an ESProducer what is produces
provide a mechanism to get minimal information about what ES products are being consumed

PR validation:

Framework unit tests pass.

- moved complex logic for creating the internal data structures to the class itself - can no ask an ESProducer what is produces - provide a mechanism to get minimal information about what ES products are being consumed

cmsbuild · 2025-04-23T19:32:40Z

cms-bot internal usage

cmsbuild · 2025-04-23T19:33:57Z

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47937/44595

ERROR: Build errors found during clang-tidy run.

  350 |                                module,
--
src/FWCore/Framework/interface/EDConsumerBase.h:349:13: error: invalid use of incomplete type 'ModuleConsumesInfo' [clang-diagnostic-error]
  349 |       iFunc(ModuleConsumesInfo(itInfo->m_type,
      |             ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  350 |                                module,
--
src/FWCore/Framework/interface/EDConsumerBase.h:349:13: error: invalid use of incomplete type 'ModuleConsumesInfo' [clang-diagnostic-error]
  349 |       iFunc(ModuleConsumesInfo(itInfo->m_type,
      |             ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  350 |                                module,
--
src/FWCore/Framework/interface/EDConsumerBase.h:349:13: error: invalid use of incomplete type 'ModuleConsumesInfo' [clang-diagnostic-error]
  349 |       iFunc(ModuleConsumesInfo(itInfo->m_type,
      |             ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  350 |                                module,
--
src/FWCore/Framework/interface/EDConsumerBase.h:349:13: error: invalid use of incomplete type 'ModuleConsumesInfo' [clang-diagnostic-error]
  349 |       iFunc(ModuleConsumesInfo(itInfo->m_type,
      |             ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  350 |                                module,
--
gmake: *** [config/SCRAM/GMake/Makefile.coderules:129: code-checks] Error 2
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 2

cmsbuild · 2025-04-23T19:49:08Z

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47937/44596

There are other open Pull requests which might conflict with changes you have proposed:
- File CondCore/CondHDF5ESSource/plugins/CondHDF5ESSource.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372
- File FWCore/Integration/plugins/ESTestProducers.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372
- File FWCore/Integration/plugins/TestESConcurrentSource.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372
- File FWCore/Integration/plugins/TestESSource.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-checks:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47937/44596/code-checks.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47937/44596/code-checks.patch | patch -p1
You can also run scram build code-checks to apply code checks directly
code-format:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47937/44596/code-format.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47937/44596/code-format.patch | patch -p1
You can also run scram build code-format to apply code format directly

cmsbuild · 2025-04-23T20:03:06Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47937/44597

There are other open Pull requests which might conflict with changes you have proposed:
- File CondCore/CondHDF5ESSource/plugins/CondHDF5ESSource.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372
- File FWCore/Integration/plugins/ESTestProducers.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372
- File FWCore/Integration/plugins/TestESConcurrentSource.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372
- File FWCore/Integration/plugins/TestESSource.cc modified in PR(s): [RFC] descriptions.addDefault -> descriptions.addWithDefaultLabel #44372

cmsbuild · 2025-04-23T20:03:33Z

A new Pull Request was created by @Dr15Jones for master.

It involves the following packages:

CondCore/CondHDF5ESSource (db)
CondCore/ESSources (db, alca)
FWCore/Framework (core)
FWCore/Integration (core)
FWCore/Services (core)
FWCore/TestProcessor (core)
PhysicsTools/CondLiteIO (analysis)

@Dr15Jones, @atpathak, @cmsbuild, @consuegs, @francescobrivio, @makortel, @perrotta, @smuzaffar, @tvami can you please review it and eventually sign? Thanks.
@JanChyczynski, @PonIlya, @fwyzard, @makortel, @missirol, @mmusich, @rsreds, @tocheng, @wddgit, @yuanchao this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

Dr15Jones · 2025-04-23T20:04:08Z

please test

cmsbuild · 2025-04-26T17:03:35Z

-1

Failed Tests: UnitTests
Size: This PR adds an extra 28KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-40a674/45727/summary.html
COMMIT: cbe57e9
CMSSW: CMSSW_15_1_X_2025-04-25-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47937/45727/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 1 errors in the following unit tests:

---> test test_MilleZmm had ERRORS

Comparison Summary

Summary:

You potentially removed 1 lines from the logs
Reco comparison results: 6 differences found in the comparisons
DQMHistoTests: Total files compared: 50
DQMHistoTests: Total histograms compared: 3913297
DQMHistoTests: Total failures: 52
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3913225
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
Checked 215 log files, 184 edm output root files, 50 DQM output files
TriggerResults: no differences found

Dr15Jones · 2025-04-28T16:05:16Z

The failing unit test is failing in the IB so has nothing to do with this PR.

makortel · 2025-04-28T20:34:51Z

+core

makortel · 2025-04-28T20:35:13Z

Comparison differences are related to #47071

makortel · 2025-04-28T20:35:33Z

ignore tests-rejected with ib-failure

tvami · 2025-04-29T01:43:24Z

+1

Dr15Jones · 2025-04-29T11:58:18Z

@cms-sw/alca-l2 @cms-sw/db-l2 ping

perrotta · 2025-04-29T13:26:09Z

+1

cmsbuild · 2025-04-29T13:26:31Z

This pull request is fully signed and it will be integrated in one of the next master IBs (test failures were overridden). This pull request will now be reviewed by the release team before it's merged. @rappoccio, @sextonkennedy, @antoniovilela, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

mandrenguyen · 2025-04-30T05:53:15Z

+1

Dr15Jones added 2 commits April 23, 2025 14:29

Refactor consumes info for PathsAndConsumesOfModules

d834701

- moved complex logic for creating the internal data structures to the class itself - can no ask an ESProducer what is produces - provide a mechanism to get minimal information about what ES products are being consumed

Updated to new ProductResolverProvider interface

bcf17d7

cmsbuild added this to the CMSSW_15_1_X milestone Apr 23, 2025

cmsbuild added core-pending analysis-pending alca-pending db-pending pending-signatures tests-pending orp-pending code-checks-pending labels Apr 23, 2025

cmsbuild added code-checks-rejected code-checks-pending and removed code-checks-pending code-checks-rejected labels Apr 23, 2025

cmsbuild added code-checks-rejected and removed code-checks-pending labels Apr 23, 2025

clang-tidy changes

f1d9dc9

Dr15Jones force-pushed the refactorPathsAndConsumesOfModules branch from 632df35 to f1d9dc9 Compare April 23, 2025 20:00

cmsbuild added code-checks-pending and removed code-checks-rejected labels Apr 23, 2025

cmsbuild added code-checks-approved and removed code-checks-pending labels Apr 23, 2025

cmsbuild removed the tests-pending label Apr 23, 2025

cmsbuild added tests-rejected and removed tests-started labels Apr 26, 2025

cmsbuild added core-approved and removed core-pending labels Apr 28, 2025

cmsbuild added tests-approved tests-ib-failure and removed tests-rejected labels Apr 28, 2025

makortel mentioned this pull request Apr 28, 2025

Extend tests for PathsAndConsumesOfModules cms-sw/framework-team#1371

Open

cmsbuild added analysis-approved and removed analysis-pending labels Apr 29, 2025

cmsbuild added alca-approved fully-signed db-approved and removed alca-pending db-pending pending-signatures labels Apr 29, 2025

cmsbuild added orp-approved and removed orp-pending labels Apr 30, 2025

cmsbuild merged commit 1304d6b into cms-sw:master Apr 30, 2025
10 of 11 checks passed

Dr15Jones deleted the refactorPathsAndConsumesOfModules branch May 9, 2025 18:47

Refactor PathsAndConsumesOfModules #47937

Refactor PathsAndConsumesOfModules #47937

Uh oh!

Conversation

Dr15Jones commented Apr 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR description:

PR validation:

Uh oh!

cmsbuild commented Apr 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Apr 23, 2025

Uh oh!

cmsbuild commented Apr 23, 2025

Uh oh!

cmsbuild commented Apr 23, 2025

Uh oh!

cmsbuild commented Apr 23, 2025

Uh oh!

Dr15Jones commented Apr 23, 2025

Uh oh!

cmsbuild commented Apr 26, 2025

Unit Tests

Comparison Summary

Uh oh!

Dr15Jones commented Apr 28, 2025

Uh oh!

makortel commented Apr 28, 2025

Uh oh!

makortel commented Apr 28, 2025

Uh oh!

makortel commented Apr 28, 2025

Uh oh!

tvami commented Apr 29, 2025

Uh oh!

Dr15Jones commented Apr 29, 2025

Uh oh!

perrotta commented Apr 29, 2025

Uh oh!

cmsbuild commented Apr 29, 2025

Uh oh!

mandrenguyen commented Apr 30, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Dr15Jones commented Apr 23, 2025 •

edited

Loading

cmsbuild commented Apr 23, 2025 •

edited

Loading