Skip to content

Conversation

@patinkaew
Copy link
Contributor

PR description:

This PR supersedes #48984 which was accidentally closed.

Description copied from the previous PR:

This PR adds skipEventsWithoutScoutingByEra for ScoutingNano workflow so that this filter is enabled for 2022-24 and disabled for 2025.

The new function skipEventsWithoutScoutingByEra is used instead for @ScoutMonitor and @ScoutFromMini nanoflavours.

The old function skipEventsWithoutScouting is kept if ones want to force running this with --customise argument with cmsDriver.py.

As requested by @mmusich, era modifiers are renamed from run3_scouting_nanoAOD_XX to a more general run3_scouting_XX so they can be reused in other tasks, e.g. DQM.

Several workflows are added in relval_nano.py mostly for 2022-23 to ensure the filter is working also with the older data.

PR validation:

Validations were done in the previous PR.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

This is not a backport, but a backport to 15_0_X and 15_1_X will follow.

FYI: @silviodonato @mmusich

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2025

cms-bot internal usage

@mmusich
Copy link
Contributor

mmusich commented Oct 7, 2025

enable nano

@mmusich
Copy link
Contributor

mmusich commented Oct 7, 2025

test parameters:

  • workflow = 145.415

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2025

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-49084/46323

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2025

A new Pull Request was created by @patinkaew for master.

It involves the following packages:

  • Configuration/Eras (operations)
  • Configuration/PyReleaseValidation (pdmv, upgrade)
  • PhysicsTools/NanoAOD (xpog)

@AdrianoDee, @DickyChant, @Moanwar, @antoniovagnerini, @cmsbuild, @davidlange6, @fabiocos, @ftenchini, @ftorrresd, @hqucms, @mandrenguyen, @miquork, @srimanob, @subirsarkar can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @gpetruc, @makortel, @slomeo this is something you requested to watch as well.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@mmusich
Copy link
Contributor

mmusich commented Oct 7, 2025

please test

@mmusich
Copy link
Contributor

mmusich commented Oct 7, 2025

@cms-sw/xpog-l2 @cms-sw/pdmv-l2 @cms-sw/upgrade-l2 you signed #48984 that got accidentally closed, can you please sign again here?

@Moanwar
Copy link
Contributor

Moanwar commented Oct 7, 2025

+Upgrade

@AdrianoDee
Copy link
Contributor

+pdmv

@ftorrresd
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2025

+1

Size: This PR adds an extra 28KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-241e15/48523/summary.html
COMMIT: 29d9dfd
CMSSW: CMSSW_16_0_X_2025-10-07-1100/el8_amd64_gcc13
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/49084/48523/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

Nano size comparison Summary:

  • Nano ERROR: Missing ref/2500.1301_ScoutingNANOdata124Xrun3-size.json
  • Nano ERROR: Missing ref/2500.1301_ScoutingNANOdata124Xrun3-size.json
  • Nano ERROR: Missing ref/2500.1302_ScoutingNANOmonitordata124Xrun3-size.json
  • Nano ERROR: Missing ref/2500.1302_ScoutingNANOmonitordata124Xrun3-size.json
  • Nano ERROR: Missing ref/2500.1303_ScoutingNANOdata130Xrun3-size.json
  • Nano ERROR: Missing ref/2500.1303_ScoutingNANOdata130Xrun3-size.json
  • Nano ERROR: Missing ref/2500.1304_ScoutingNANOmonitordata130Xrun3-size.json
  • Nano ERROR: Missing ref/2500.1304_ScoutingNANOmonitordata130Xrun3-size.json
  • Nano ERROR: Missing ref/2500.2308_ScoutingNANOmonitordata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.2308_ScoutingNANOmonitordata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.2309_ScoutingNANOmonitorWithPromptdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.2309_ScoutingNANOmonitorWithPromptdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.2311_L1ScoutingSelectionNANOdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.2311_L1ScoutingSelectionNANOdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.231_L1ScoutingNANOdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.231_L1ScoutingNANOdata140Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3308_ScoutingNANOmonitordata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3308_ScoutingNANOmonitordata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3309_ScoutingNANOmonitorWithPromptdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3309_ScoutingNANOmonitorWithPromptdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.331_BPHNANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.331_BPHNANOdata150Xrun3-size.json
workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.085 3.085 0.000 ( +0.0% ) 3.84 2.99 +28.4% 2.646 2.517
NANOmc106Xul17v2 2500.0002 3.144 3.144 0.000 ( +0.0% ) 3.56 2.81 +26.7% 3.073 2.532
NANOmc106Xul18v2 2500.0003 3.097 3.097 0.000 ( +0.0% ) 3.62 2.83 +27.8% 3.083 2.542
NANOdata106Xul16v2 2500.0101 1.539 1.539 0.000 ( +0.0% ) 6.33 5.00 +26.4% 2.655 2.307
NANOdata106Xul17v2 2500.0102 1.925 1.925 0.000 ( +0.0% ) 4.21 3.36 +25.4% 2.801 2.337
NANOdata106Xul18v2 2500.0103 1.890 1.890 0.000 ( +0.0% ) 5.08 4.01 +26.6% 2.777 2.372
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.65 1.15 +43.6% 2.569 2.134
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.63 1.21 +34.3% 2.562 2.543
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 1.48 0.94 +57.4% 2.524 2.421
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.33 0.93 +43.5% 2.723 2.586
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.34 0.91 +47.3% 2.658 2.556
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.51 1.14 +33.3% 2.596 2.569
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.0% ) 1.29 0.90 +43.0% 2.679 2.232
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.31 0.93 +40.2% 2.653 2.574
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 4.36 3.46 +26.0% 3.014 2.423
NANOdata130Xrun3 2500.1101 1.799 1.799 0.000 ( +0.0% ) 6.46 5.06 +27.7% 2.678 2.575
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 5.62 4.21 +33.5% 2.131 2.157
EGMNANOmc140X 2500.2202 3.876 3.876 0.000 ( +0.0% ) 4.02 2.84 +41.4% 2.423 2.422
BTVNANOmc140X 2500.2203 10.607 10.607 0.000 ( +0.0% ) 2.56 1.93 +32.9% 2.621 2.627
jmeNANOmc140X 2500.2204 6.666 6.666 0.000 ( +0.0% ) 1.15 0.87 +31.6% 2.507 2.510
lepTrackInfoNANOmc140X 2500.2206 3.570 3.570 0.000 ( +0.0% ) 4.05 2.96 +36.9% 2.428 2.413
ScoutingNANOmc140X 2500.2207 1.488 1.488 0.000 ( +0.0% ) 16.37 12.70 +28.9% 1.883 1.934
ScoutingNANOwithPromptmc140X 2500.2208 4.476 4.476 0.000 ( +0.0% ) 3.42 2.66 +28.5% 2.772 2.773
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 7.84 5.65 +38.7% 2.372 2.390
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.79 4.51 +28.3% 2.668 2.708
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.70 2.70 +37.3% 2.854 2.864
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.48 1.13 +31.7% 2.709 2.716
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.77 4.13 +39.9% 2.673 2.688
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 30.26 23.89 +26.7% 1.513 1.481
l1DPGNANO140Xrun3 2500.2401 9.404 9.404 0.000 ( +0.0% ) 7.68 5.52 +39.0% 1.774 1.797
muDPGNANO140Xrun3 2500.2402 10.377 10.377 0.000 ( +0.0% ) 1.63 1.34 +21.5% 1.619 1.656
muDPGNANOBkg140Xrun3 2500.2403 6.401 6.401 0.000 ( +0.0% ) 16.62 14.28 +16.4% 1.176 1.169
hcalDPGNANO140Xrun3 2500.2404 486.015 486.015 0.000 ( +0.0% ) 1.17 1.02 +15.0% 1.569 1.581
hcalDPGCalibNANO140Xrun3 2500.2405 826.418 826.418 0.000 ( +0.0% ) 1.53 1.25 +23.1% 1.573 1.623
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.67 1.44 +15.9% 1.688 1.671
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.0% ) 1.70 1.25 +35.9% 2.718 2.739
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.53 0.94 +61.6% 2.577 2.590
NANOmc150X 2500.3001 3.217 3.217 0.000 ( +0.0% ) 18.95 14.85 +27.6% 2.714 2.634
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 37.79 27.44 +37.7% 2.232 2.232
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 25.70 17.73 +44.9% 2.273 2.295
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 16.39 12.35 +32.7% 2.374 2.394
EGMNANOmc150X 2500.3202 4.111 4.111 0.000 ( +0.0% ) 14.94 11.96 +24.9% 2.448 2.627
BTVNANOmc150X 2500.3203 10.552 10.552 0.000 ( +0.0% ) 5.00 4.01 +24.7% 2.645 2.698
jmeNANOmc150X 2500.3204 6.760 6.760 0.000 ( +0.0% ) 1.37 1.08 +26.8% 2.624 2.663
jmeNANOrePuppimc150X 2500.3205 6.763 6.763 0.000 ( +0.0% ) 1.29 1.03 +25.1% 2.927 2.977
lepTrackInfoNANOmc150X 2500.3206 3.721 3.721 0.000 ( +0.0% ) 15.55 10.68 +45.5% 2.451 2.485
ScoutingNANOmc150X 2500.3207 1.563 1.563 0.000 ( +0.0% ) 19.97 16.07 +24.3% 2.388 2.369
ScoutingNANOwithPromptmc150X 2500.3208 4.775 4.775 0.000 ( +0.0% ) 10.93 8.93 +22.5% 2.753 2.778
BPHNANOmc150X 2500.3209 4.109 4.109 0.000 ( +0.0% ) 18.04 13.83 +30.5% 2.678 2.600
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 27.95 19.78 +41.3% 2.089 2.129
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 24.67 20.07 +22.9% 2.309 2.457
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 5.97 4.51 +32.2% 2.431 2.358
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.67 1.27 +31.5% 2.344 2.337
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.45 1.13 +28.4% 2.281 2.623
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 28.13 16.76 +67.8% 2.264 2.176
ScoutingNANOdata150Xrun3 2500.3307 1.738 1.738 0.000 ( +0.0% ) 32.12 25.99 +23.6% 1.502 1.529
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 32.71 24.09 +35.8% 1.831 1.803
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 31.72 21.61 +46.8% 1.515 1.492
DYToLL_M-50_13TeV_pythia8 2500.9101 15.005 15.005 0.000 ( +0.0% ) 7.07 7.34 -3.7% 1.038 1.032
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.150 0.310 -0.160 ( -51.6% ) 2.94 2.60 +13.2% 0.849 0.848
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 2.24 1.46 +53.8% 0.831 0.842

NANO Comparison Summary

Summary:

  • You potentially removed 295 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 22
  • DQMHistoTests: Total histograms compared: 97920
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 97920
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 21 files compared)
  • Checked 126 log files, 76 edm output root files, 22 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2025

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @mandrenguyen, @ftenchini (and backports should be raised in the release meeting by the corresponding L2)

@ftenchini
Copy link

+1

@cmsbuild cmsbuild merged commit 0c06e43 into cms-sw:master Oct 8, 2025
13 checks passed
cmsbuild added a commit that referenced this pull request Oct 27, 2025
…_1_0_patch1

[15_1_X] Update skipEventsWithoutScoutingByEra for ScoutingNano (backport of #49084)
cmsbuild added a commit that referenced this pull request Oct 28, 2025
…15_0_15_patch4

[15_0_X] ScoutingNano: Rename era modifier to be more generic (partial backport of #49084)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants