Skip to content

Conversation

@winterchristian
Copy link
Contributor

PR description:

This is a backport for #48408. It's similar to the backports #49022 (14_2_X) and #48557 (15_0_X).

PR validation:

Unit tests and release validations (136.901,136.902,136.903,136.904,136.905,136.906) are implemented and tested.

Christian Winter and others added 24 commits October 1, 2025 14:56
(cherry picked from commit a26aa7d)
(cherry picked from commit 1ca62c9)
…cmsDriver HLT step

(cherry picked from commit 96339e1)
(cherry picked from commit b8725c6)
(cherry picked from commit 0b343c5)
(cherry picked from commit 4e25dd6)
* add special tau embedding EventContents

* add NANOAOD to NanoAOD event content name to be handled properly

* adapt eventcontent in cmsDriver commands

---------

Co-authored-by: Christian Winter <[email protected]>
(cherry picked from commit 7650c60)
(cherry picked from commit e673930)
* first try distributing process Modifiers of Cleaning step

* disable finale state radiation for mu->mu embedding

* update center of mass energy for run3

* implement correct ModifierChain for tau embedding process modifiers

* revert some changes

* set all process modifier for tau embeddign cleaning step

* Introduce special cleaning and simulation process modifier

* add process modifiers for sim gen step

* Set process modifiers for reco sim step

* add process modifier for tau embedding merging step
Those "toReplaceWith" modifiers need to be applied as late as possible e.g. in StandardSequences.Reconstruction_Data_cff.
This is to avoid collisions with other modules that are cloned and modified versions from the original modules or "toModify" modifier calls that try to modify the original modules. They throw an exeption if they want to do this on the replaced merger modules.

* add autoNANO option for the tau embedding nanoaod files

* adjust test cmsDriver commands to work with the new process modifiers

---------

Co-authored-by: Christian Winter <[email protected]>
(cherry picked from commit 164e69d)
@civanch
Copy link
Contributor

civanch commented Oct 2, 2025

+1

@ftorrresd
Copy link
Contributor

enable nano

@ftorrresd
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2025

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e7db3c/48521/summary.html
COMMIT: 4ac235d
CMSSW: CMSSW_15_1_X_2025-10-07-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/49039/48521/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 7 differences found in the comparisons
  • DQMHistoTests: Total files compared: 52
  • DQMHistoTests: Total histograms compared: 4355372
  • DQMHistoTests: Total failures: 43
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4355309
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 51 files compared)
  • Checked 223 log files, 194 edm output root files, 52 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.085 3.085 0.000 ( +0.0% ) 2.83 3.31 -14.4% 2.685 2.793
NANOmc106Xul17v2 2500.0002 3.144 3.144 0.000 ( +0.0% ) 2.63 3.09 -15.0% 3.109 3.271
NANOmc106Xul18v2 2500.0003 3.097 3.097 0.000 ( +0.0% ) 2.67 3.15 -15.3% 3.118 3.355
NANOdata106Xul16v2 2500.0101 1.539 1.539 0.000 ( +0.0% ) 4.50 5.34 -15.8% 2.677 2.834
NANOdata106Xul17v2 2500.0102 1.925 1.925 0.000 ( +0.0% ) 3.13 3.66 -14.5% 2.867 3.014
NANOdata106Xul18v2 2500.0103 1.890 1.890 0.000 ( +0.0% ) 3.68 4.36 -15.5% 2.787 2.983
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.18 1.35 -12.6% 2.614 3.002
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.05 1.37 -22.7% 2.587 2.978
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 0.96 1.13 -14.6% 2.546 2.694
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 0.88 1.06 -17.2% 2.747 3.115
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 0.85 1.03 -17.5% 2.661 2.909
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 0.97 1.22 -20.6% 2.597 2.931
NANOdataUL17reMINI 2500.0303 0.037 0.037 -0.000 ( -0.1% ) 0.73 1.02 -28.4% 2.687 2.933
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 0.78 1.04 -25.6% 2.679 2.933
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 3.17 3.78 -16.1% 3.055 3.237
NANOdata130Xrun3 2500.1101 1.799 1.799 0.000 ( +0.0% ) 4.50 5.51 -18.4% 2.718 2.918
ScoutingNANOdata130Xrun3 2500.1301 0.771 0.771 0.000 ( +0.0% ) 23.32 27.88 -16.4% 1.578 1.683
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 3.45 4.36 -20.9% 2.164 2.355
EGMNANOmc140X 2500.2202 3.876 3.876 0.000 ( +0.0% ) 2.42 3.13 -22.6% 2.459 2.725
BTVNANOmc140X 2500.2203 10.607 10.607 0.000 ( +0.0% ) 1.62 2.00 -19.1% 2.641 2.942
jmeNANOmc140X 2500.2204 6.666 6.666 0.000 ( +0.0% ) 0.76 0.95 -19.8% 2.546 2.798
lepTrackInfoNANOmc140X 2500.2206 3.570 3.570 0.000 ( +0.0% ) 2.49 3.17 -21.6% 2.454 2.725
ScoutingNANOmc140X 2500.2207 1.486 1.486 0.000 ( +0.0% ) 10.57 12.82 -17.6% 1.942 2.033
ScoutingNANOwithPromptmc140X 2500.2208 4.474 4.474 0.000 ( +0.0% ) 2.52 2.99 -15.8% 2.811 2.971
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 4.62 6.21 -25.6% 2.383 2.656
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 3.64 4.50 -19.1% 2.730 3.013
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 2.47 2.95 -16.3% 2.860 3.227
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.04 1.26 -17.2% 2.733 3.059
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 3.87 4.60 -16.0% 2.678 3.001
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 21.43 24.72 -13.3% 1.502 1.675
ScoutingNANOwithPromptdata140Xrun3 2500.2308 2.783 2.783 0.000 ( +0.0% ) 3.94 4.62 -14.6% 3.045 3.252
L1ScoutingNANOdata140Xrun3 2500.2309 0.082 0.082 0.000 ( +0.0% ) 2.88 3.36 -14.1% 0.879 0.980
L1ScoutingSelectionNANOdata140Xrun3 2500.231 0.081 0.081 0.000 ( +0.0% ) 25.76 32.11 -19.8% 0.723 0.872
l1DPGNANO140Xrun3 2500.2401 9.404 9.404 0.000 ( +0.0% ) 4.60 5.53 -16.8% 1.798 1.936
muDPGNANO140Xrun3 2500.2402 10.377 10.377 0.000 ( +0.0% ) 1.35 1.38 -2.6% 1.657 1.745
muDPGNANOBkg140Xrun3 2500.2403 6.401 6.401 0.000 ( +0.0% ) 9.09 9.71 -6.4% 1.194 1.258
hcalDPGNANO140Xrun3 2500.2404 486.016 486.016 0.000 ( +0.0% ) 0.86 1.05 -18.1% 1.599 1.724
hcalDPGCalibNANO140Xrun3 2500.2405 826.413 826.413 0.000 ( +0.0% ) 1.15 1.42 -18.7% 1.589 1.704
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.39 1.56 -11.4% 1.679 1.811
NANOmc2024reMINI 2500.2601 0.021 0.021 -0.000 ( -0.4% ) 1.32 1.54 -14.5% 2.715 3.139
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 0.96 1.35 -28.7% 2.589 2.882
NANOmc150X 2500.3001 3.217 3.217 0.000 ( +0.0% ) 13.57 15.65 -13.3% 2.601 2.772
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 25.75 31.55 -18.4% 2.253 2.499
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 16.96 21.70 -21.8% 2.261 2.590
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 10.43 14.97 -30.4% 2.414 2.656
EGMNANOmc150X 2500.3202 4.111 4.111 0.000 ( +0.0% ) 9.06 13.37 -32.2% 2.500 2.759
BTVNANOmc150X 2500.3203 10.552 10.552 0.000 ( +0.0% ) 3.43 4.22 -18.7% 2.725 2.967
jmeNANOmc150X 2500.3204 6.760 6.760 0.000 ( +0.0% ) 1.05 1.17 -10.4% 2.703 2.930
jmeNANOrePuppimc150X 2500.3205 6.763 6.763 0.000 ( +0.0% ) 1.00 1.13 -11.9% 2.937 3.199
lepTrackInfoNANOmc150X 2500.3206 3.721 3.721 0.000 ( +0.0% ) 11.28 13.01 -13.3% 2.482 2.750
ScoutingNANOmc150X 2500.3207 1.562 1.562 0.000 ( +0.0% ) 16.35 17.45 -6.3% 2.371 2.553
ScoutingNANOwithPromptmc150X 2500.3208 4.774 4.774 0.000 ( +0.0% ) 8.91 9.83 -9.4% 2.780 3.000
BPHNANOmc150X 2500.3209 4.109 4.109 0.000 ( +0.0% ) 13.62 15.19 -10.3% 2.647 2.810
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 20.45 18.67 +9.5% 2.154 2.399
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 17.75 20.03 -11.4% 2.221 2.488
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 4.45 5.18 -14.0% 2.375 2.712
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.29 1.50 -14.1% 2.394 2.641
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.16 1.32 -12.3% 2.612 2.929
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 18.09 18.67 -3.1% 2.159 2.486
ScoutingNANOdata150Xrun3 2500.3307 1.737 1.737 0.000 ( +0.0% ) 25.23 28.27 -10.8% 1.515 1.689
ScoutingNANOwithPromptdata150Xrun3 2500.3308 2.601 2.601 0.000 ( +0.0% ) 13.86 16.28 -14.9% 2.549 2.803
BPHNANOdata150Xrun3 2500.3309 2.604 2.604 0.000 ( +0.0% ) 24.90 31.38 -20.7% 2.517 2.537
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 22.20 26.26 -15.5% 1.871 1.939
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 19.88 26.37 -24.6% 1.515 1.584
DYToLL_M-50_13TeV_pythia8 2500.9101 14.345 14.345 0.000 ( +0.0% ) 5.71 7.65 -25.3% 1.106 1.103
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.310 0.240 0.070 ( +29.3% ) 1.86 2.07 -10.3% 0.869 0.853
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 2.06 2.44 -15.5% 0.853 0.856

NANO Comparison Summary

Summary:

@ftorrresd
Copy link
Contributor

+1

@Moanwar
Copy link
Contributor

Moanwar commented Oct 8, 2025

+Upgrade

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 8, 2025

This pull request is fully signed and it will be integrated in one of the next CMSSW_15_1_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_16_0_X is complete. This pull request will now be reviewed by the release team before it's merged. @ftenchini, @sextonkennedy, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 3c72343 into cms-sw:CMSSW_15_1_X Oct 24, 2025
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants