Skip to content

Conversation

@see-saw28
Copy link

@see-saw28 see-saw28 commented Jul 14, 2025

PR description:

  • Remove EGM Scale and Smearing for Run2 reprocessing. The Scale and Smearing will be apply offline on the Ecal-Tracker combined energy (instead of the Ecal energy and redo the combination for electrons) as it is done in Run3.
  • Update EPcombination parameters used for combination when applying S&S on the Ecal energy. Not used anymore (see first bullet) but the wrong set of parameters was used.

PR validation:

Tested using #48176 (comment)

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

This PR is intended to be used for the Run2 reprocessing and therefore will require a backport to 15_0_X.

Paul Gaigne added 2 commits July 10, 2025 12:07
…n the reapplication of the scale and smearing in Mini and Nano)
@cmsbuild
Copy link
Contributor

cmsbuild commented Jul 14, 2025

cms-bot internal usage

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @see-saw28 for master.

It involves the following packages:

  • PhysicsTools/NanoAOD (xpog)
  • RecoEgamma/EgammaTools (reconstruction)

@cmsbuild, @ftorrresd, @hqucms, @jfernan2, @mandrenguyen can you please review it and eventually sign? Thanks.
@Prasant1993, @Sam-Harper, @a-kapoor, @afiqaize, @gpetruc, @jainshilpi, @lgray, @missirol, @ram1123, @sameasy, @sobhatta, @valsdav, @varuns23 this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@jfernan2
Copy link
Contributor

enable nano

@jfernan2
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

+1

Size: This PR adds an extra 36KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-38bc7b/47215/summary.html
COMMIT: 73a5609
CMSSW: CMSSW_15_1_X_2025-07-13-2300/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/48539/47215/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

NANO Comparison Summary

Summary:

  • You potentially added 32 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 370 differences found in the comparisons
  • DQMHistoTests: Total files compared: 22
  • DQMHistoTests: Total histograms compared: 89100
  • DQMHistoTests: Total failures: 513
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 88587
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 21 files compared)
  • Checked 134 log files, 80 edm output root files, 22 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.085 3.118 -0.034 ( -1.1% ) 3.87 3.13 +23.8% 2.789 2.786
NANOmc106Xul17v2 2500.0002 3.144 3.177 -0.033 ( -1.0% ) 3.55 2.91 +21.9% 3.278 3.249
NANOmc106Xul18v2 2500.0003 3.097 3.128 -0.031 ( -1.0% ) 3.60 2.94 +22.7% 3.224 3.234
NANOdata106Xul16v2 2500.0101 1.539 1.560 -0.021 ( -1.3% ) 6.40 4.93 +29.7% 2.848 2.756
NANOdata106Xul17v2 2500.0102 1.925 1.948 -0.023 ( -1.2% ) 4.27 3.42 +24.8% 3.019 2.903
NANOdata106Xul18v2 2500.0103 1.890 1.914 -0.024 ( -1.3% ) 5.12 4.03 +27.0% 2.989 2.857
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.77 1.60 +10.4% 2.991 2.655
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.66 1.47 +12.8% 2.982 2.674
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 1.63 1.47 +11.1% 2.691 2.668
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.30 1.18 +10.8% 3.127 2.801
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.17 1.22 -3.8% 2.911 2.869
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.55 1.40 +10.6% 2.939 2.627
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.0% ) 1.37 1.18 +15.4% 2.936 2.781
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.34 1.18 +13.1% 2.930 2.747
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 4.43 3.53 +25.5% 3.240 3.175
NANOdata130Xrun3 2500.1101 1.799 1.799 0.000 ( +0.0% ) 6.53 5.15 +26.8% 2.830 2.828
ScoutingNANOdata130Xrun3 2500.1301 0.771 0.771 0.000 ( +0.0% ) 34.02 28.62 +18.9% 1.706 1.692
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 5.68 5.20 +9.3% 2.365 2.355
EGMNANOmc140X 2500.2202 3.876 3.876 0.000 ( +0.0% ) 4.09 3.63 +12.8% 2.738 2.710
BTVNANOmc140X 2500.2203 10.607 10.607 0.000 ( +0.0% ) 2.61 2.10 +24.5% 2.942 2.716
jmeNANOmc140X 2500.2204 6.666 6.666 0.000 ( +0.0% ) 1.15 0.89 +30.1% 2.802 2.605
lepTrackInfoNANOmc140X 2500.2206 3.570 3.570 0.000 ( +0.0% ) 4.10 3.37 +21.9% 2.720 2.513
ScoutingNANOmc140X 2500.2207 1.486 1.486 0.000 ( +0.0% ) 15.53 12.74 +21.8% 2.023 2.028
ScoutingNANOwithPromptmc140X 2500.2208 4.474 4.474 0.000 ( +0.0% ) 3.45 2.79 +23.9% 2.984 2.978
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 7.89 5.93 +33.2% 2.676 2.519
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.79 4.32 +34.1% 3.030 2.992
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.75 2.89 +29.5% 3.226 2.971
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.51 1.10 +37.6% 3.052 2.790
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.81 4.43 +31.2% 3.012 3.012
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 29.86 23.34 +27.9% 1.681 1.545
ScoutingNANOwithPromptdata140Xrun3 2500.2308 2.783 2.783 0.000 ( +0.0% ) 5.10 4.22 +20.9% 3.256 3.155
l1DPGNANO140Xrun3 2500.2401 9.404 9.404 0.000 ( +0.0% ) 6.43 4.71 +36.6% 1.940 1.929
muDPGNANO140Xrun3 2500.2402 10.331 10.331 0.000 ( +0.0% ) 1.64 1.33 +22.9% 1.738 1.734
muDPGNANOBkg140Xrun3 2500.2403 2.712 2.712 0.000 ( +0.0% ) 13.27 10.15 +30.7% 1.070 1.065
hcalDPGNANO140Xrun3 2500.2404 486.016 486.016 0.000 ( +0.0% ) 1.14 0.84 +35.8% 1.748 1.727
hcalDPGCalibNANO140Xrun3 2500.2405 826.413 826.413 0.000 ( +0.0% ) 1.55 1.12 +38.6% 1.719 1.727
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.64 1.20 +36.9% 1.821 1.818
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.0% ) 1.42 1.15 +23.4% 3.164 3.152
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.30 0.94 +38.0% 2.916 2.906
NANOmc150X 2500.3001 3.218 3.218 0.000 ( +0.0% ) 18.42 14.48 +27.2% 2.774 2.775
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 35.78 25.65 +39.5% 2.496 2.300
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 24.32 17.59 +38.3% 2.590 2.574
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 15.70 10.51 +49.4% 2.645 2.653
EGMNANOmc150X 2500.3202 4.110 4.110 0.000 ( +0.0% ) 14.41 10.22 +41.0% 2.755 2.751
BTVNANOmc150X 2500.3203 10.551 10.551 0.000 ( +0.0% ) 4.96 3.73 +33.0% 2.964 2.965
jmeNANOmc150X 2500.3204 6.760 6.760 0.000 ( +0.0% ) 1.40 1.14 +23.1% 2.932 2.932
jmeNANOrePuppimc150X 2500.3205 6.762 6.762 0.000 ( +0.0% ) 1.30 1.09 +19.8% 3.203 3.203
lepTrackInfoNANOmc150X 2500.3206 3.720 3.720 0.000 ( +0.0% ) 15.01 12.43 +20.7% 2.753 2.683
ScoutingNANOmc150X 2500.3207 1.562 1.562 0.000 ( +0.0% ) 19.54 17.39 +12.4% 2.567 2.441
ScoutingNANOwithPromptmc150X 2500.3208 4.773 4.773 0.000 ( +0.0% ) 10.75 9.71 +10.7% 2.999 2.815
BPHNANOmc150X 2500.3209 4.108 4.108 0.000 ( +0.0% ) 17.68 15.49 +14.1% 2.817 2.638
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 26.24 20.36 +28.9% 2.402 2.409
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 23.07 16.70 +38.1% 2.497 2.487
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 5.94 4.99 +19.1% 2.720 2.694
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.71 1.50 +14.3% 2.655 2.496
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.47 1.28 +14.7% 2.927 2.822
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 25.14 22.03 +14.1% 2.487 2.162
ScoutingNANOdata150Xrun3 2500.3307 1.737 1.737 0.000 ( +0.0% ) 31.62 27.50 +15.0% 1.702 1.550
ScoutingNANOwithPromptdata150Xrun3 2500.3308 2.601 2.601 0.000 ( +0.0% ) 17.82 15.90 +12.1% 2.815 2.660
BPHNANOdata150Xrun3 2500.3309 2.604 2.604 0.000 ( +0.0% ) 32.71 29.85 +9.6% 2.547 2.401
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 31.07 26.51 +17.2% 1.945 1.940
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 30.31 26.10 +16.1% 1.587 1.585
DYToLL_M-50_13TeV_pythia8 2500.9101 14.345 14.345 0.000 ( +0.0% ) 7.42 7.97 -6.9% 1.104 1.100
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.199 0.199 0.000 ( +0.0% ) 2.69 3.89 -30.9% 0.857 0.852
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 2.55 2.45 +4.2% 0.856 0.857

@jfernan2
Copy link
Contributor

+1

@RSalvatico
Copy link
Contributor

type egamma

@RSalvatico
Copy link
Contributor

Since this is intended for the Run2 re-Nano in v15, @cms-sw/xpog-l2 can let us know if a backport to 150X is needed. I'm not 100% sure which release will be used.

recHitCollectionEE = 'reducedEgamma:reducedEERecHits'
)

# This is now the same configuration as the one used in the Egamma regression v3 in 106XUL
Copy link
Contributor

@hqucms hqucms Jul 14, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems that the change of the default values here will affect the ongoing MINIv6+NANOv15 production for 2024, as we see some changes in wf 2500.2601 and 2500.2701.
If the changes are intended for Run2, then it should be put under an era modifier.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @hqucms these workflows have changes because they are using the --era Run3_2024 --procModifiers run2_miniAOD_UL_preSummer20 modifier. This activates the calibration of patElectron which has been changed (corrected) by the updated configuration. What's the reason for this combination?

Effectively that configuration is trying to calibrate Run3 MC with Run2 scale&smearing, which is wrong. Anyway, the calibrated energy is not replacing the nominal and it is just stored in miniAOD as an additional calibEle* userFloat. In EGM we are not recommending to use calibrated quantity directly in Run3, but to reapply energy calibrations a-posteriori. So, in summary, this is not a problem, but for sure it is kind of ugly.

@ftorrresd
Copy link
Contributor

Since this is intended for the Run2 re-Nano in v15, @cms-sw/xpog-l2 can let us know if a backport to 150X is needed. I'm not 100% sure which release will be used.

A backport to 150 will be needed.

@ftorrresd
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 4, 2025

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-38bc7b/47521/summary.html
COMMIT: 73a5609
CMSSW: CMSSW_15_1_X_2025-08-04-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/48539/47521/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially added 4 lines to the logs
  • Reco comparison results: 211 differences found in the comparisons
  • DQMHistoTests: Total files compared: 50
  • DQMHistoTests: Total histograms compared: 4076122
  • DQMHistoTests: Total failures: 40
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4076062
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
  • Checked 215 log files, 184 edm output root files, 50 DQM output files
  • TriggerResults: no differences found

NANO Comparison Summary

Summary:

  • You potentially added 210 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 370 differences found in the comparisons
  • DQMHistoTests: Total files compared: 22
  • DQMHistoTests: Total histograms compared: 89100
  • DQMHistoTests: Total failures: 513
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 88587
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 21 files compared)
  • Checked 134 log files, 80 edm output root files, 22 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.085 3.118 -0.034 ( -1.1% ) 3.63 3.58 +1.3% 2.790 2.806
NANOmc106Xul17v2 2500.0002 3.144 3.177 -0.033 ( -1.0% ) 3.36 3.30 +1.8% 3.145 3.279
NANOmc106Xul18v2 2500.0003 3.097 3.128 -0.031 ( -1.0% ) 3.44 3.39 +1.6% 3.153 3.261
NANOdata106Xul16v2 2500.0101 1.539 1.560 -0.021 ( -1.3% ) 5.89 5.75 +2.3% 2.742 2.844
NANOdata106Xul17v2 2500.0102 1.925 1.948 -0.023 ( -1.2% ) 3.99 3.90 +2.3% 2.864 3.028
NANOdata106Xul18v2 2500.0103 1.890 1.914 -0.024 ( -1.3% ) 4.70 4.62 +1.7% 2.817 3.016
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.47 1.14 +28.7% 2.630 2.993
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.33 1.59 -16.1% 2.624 2.996
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.2% ) 1.35 1.56 -13.4% 2.585 2.703
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.11 1.28 -13.0% 2.759 3.134
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.10 1.38 -20.5% 2.715 2.929
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.32 1.51 -12.3% 2.642 2.951
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.0% ) 0.99 1.32 -25.0% 2.746 2.948
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.06 1.29 -17.4% 2.729 2.931
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 4.16 4.03 +3.3% 3.177 3.228
NANOdata130Xrun3 2500.1101 1.799 1.799 0.000 ( +0.0% ) 6.07 5.87 +3.4% 2.832 2.837
ScoutingNANOdata130Xrun3 2500.1301 0.771 0.771 0.000 ( +0.0% ) 32.56 33.34 -2.3% 1.673 1.689
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 5.37 5.59 -4.0% 2.355 2.360
EGMNANOmc140X 2500.2202 3.876 3.876 0.000 ( +0.0% ) 3.89 3.96 -1.8% 2.561 2.726
BTVNANOmc140X 2500.2203 10.607 10.607 0.000 ( +0.0% ) 2.45 2.54 -3.3% 2.701 2.941
jmeNANOmc140X 2500.2204 6.666 6.666 0.000 ( +0.0% ) 1.08 1.05 +2.2% 2.554 2.811
lepTrackInfoNANOmc140X 2500.2206 3.570 3.570 0.000 ( +0.0% ) 3.83 3.99 -4.1% 2.447 2.717
ScoutingNANOmc140X 2500.2207 1.486 1.486 0.000 ( +0.0% ) 14.59 15.04 -3.0% 1.959 2.042
ScoutingNANOwithPromptmc140X 2500.2208 4.474 4.474 0.000 ( +0.0% ) 3.25 3.16 +2.9% 2.876 2.951
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 7.39 7.45 -0.8% 2.527 2.666
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.49 5.65 -2.8% 2.987 3.015
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.43 3.59 -4.4% 2.917 3.241
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.37 1.28 +7.2% 2.783 3.053
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.43 5.54 -2.0% 2.939 3.018
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 27.91 26.36 +5.9% 1.538 1.678
ScoutingNANOwithPromptdata140Xrun3 2500.2308 2.783 2.783 0.000 ( +0.0% ) 4.93 4.74 +4.1% 3.153 3.144
l1DPGNANO140Xrun3 2500.2401 9.404 9.404 0.000 ( +0.0% ) 6.88 6.59 +4.4% 1.930 1.939
muDPGNANO140Xrun3 2500.2402 10.331 10.331 0.000 ( +0.0% ) 1.63 1.51 +7.9% 1.737 1.733
muDPGNANOBkg140Xrun3 2500.2403 2.712 2.712 0.000 ( +0.0% ) 13.81 13.99 -1.3% 1.065 1.069
hcalDPGNANO140Xrun3 2500.2404 486.016 486.016 0.000 ( +0.0% ) 1.12 0.93 +20.5% 1.723 1.725
hcalDPGCalibNANO140Xrun3 2500.2405 826.413 826.413 0.000 ( +0.0% ) 1.51 1.18 +27.2% 1.712 1.710
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.64 1.22 +34.3% 1.818 1.815
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.0% ) 1.43 1.10 +29.9% 3.123 3.166
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.20 0.93 +28.5% 2.688 2.913
NANOmc150X 2500.3001 3.217 3.217 0.000 ( +0.0% ) 16.29 16.77 -2.9% 2.768 2.765
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 31.17 27.70 +12.5% 2.257 2.483
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 21.82 17.82 +22.4% 2.580 2.577
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 13.81 14.39 -4.0% 2.468 2.644
EGMNANOmc150X 2500.3202 4.111 4.111 0.000 ( +0.0% ) 10.63 13.05 -18.5% 2.570 2.746
BTVNANOmc150X 2500.3203 10.552 10.552 0.000 ( +0.0% ) 4.67 4.58 +2.0% 2.959 2.966
jmeNANOmc150X 2500.3204 6.760 6.760 0.000 ( +0.0% ) 1.31 1.32 -0.9% 2.678 2.316
jmeNANOrePuppimc150X 2500.3205 6.763 6.763 0.000 ( +0.0% ) 1.25 1.24 +0.4% 3.151 2.579
lepTrackInfoNANOmc150X 2500.3206 3.721 3.721 0.000 ( +0.0% ) 14.23 14.57 -2.4% 2.743 2.742
ScoutingNANOmc150X 2500.3207 1.562 1.562 0.000 ( +0.0% ) 18.71 18.85 -0.7% 2.552 2.527
ScoutingNANOwithPromptmc150X 2500.3208 4.774 4.774 0.000 ( +0.0% ) 10.25 10.47 -2.1% 2.929 2.977
BPHNANOmc150X 2500.3209 4.109 4.109 0.000 ( +0.0% ) 16.52 16.78 -1.6% 2.600 2.803
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 24.66 24.45 +0.8% 2.405 2.402
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 22.29 21.69 +2.8% 2.466 2.488
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 5.61 5.79 -3.1% 2.395 2.717
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.60 1.63 -2.1% 2.381 2.368
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.40 1.44 -2.5% 2.609 2.625
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 22.65 24.40 -7.2% 2.198 2.490
ScoutingNANOdata150Xrun3 2500.3307 1.737 1.737 0.000 ( +0.0% ) 30.29 30.67 -1.2% 1.522 1.678
ScoutingNANOwithPromptdata150Xrun3 2500.3308 2.601 2.601 0.000 ( +0.0% ) 16.79 17.09 -1.7% 2.582 2.689
BPHNANOdata150Xrun3 2500.3309 2.604 2.604 0.000 ( +0.0% ) 32.56 31.54 +3.2% 2.544 2.223
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 27.24 27.81 -2.0% 1.937 1.492
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 28.16 27.48 +2.5% 1.581 1.580
DYToLL_M-50_13TeV_pythia8 2500.9101 14.345 14.345 0.000 ( +0.0% ) 8.53 7.26 +17.5% 1.103 1.102
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.171 0.240 -0.069 ( -28.9% ) 2.51 2.41 +4.3% 0.851 0.849
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 2.59 2.64 -1.7% 0.853 0.854

@valsdav
Copy link
Contributor

valsdav commented Aug 5, 2025

Hi @hqucms, @ftorrresd some Run3 workflows have changes because they are using the --era Run3_2024 --procModifiers run2_miniAOD_UL_preSummer20 modifier. Is this an intended behaviour? Why an era modifier for the Run2UL is used in Run3 workflow? All our changes are attached to the Run2 UL era modifier.

@hqucms
Copy link
Contributor

hqucms commented Aug 5, 2025

Hi @valsdav -- I think the changes are not caused by the (mis)use of --procModifiers run2_miniAOD_UL_preSummer20 in these workflows, but rather because this PR changes the default values of ecalTrkCombinationRegression which then affects all Run2 and Run3 workflows. Could you please clarify a bit more the intention of this change? Is it for Run3, or Run2, or both?

@valsdav
Copy link
Contributor

valsdav commented Aug 6, 2025

Hi @hqucms. Let me summarize our findings.

ecalTrkCombinationRegression is defined in calibratedEgammas_cff which configures some producers which are used to re-calibrated electrons and photons.

The cff is only loaded in a function here: reducedEgammaTools, which is only loaded for this modifier

from RecoEgamma.EgammaPhotonProducers.reducedEgamma_tools import calibrateReducedEgamma
from Configuration.ProcessModifiers.run2_miniAOD_UL_cff import run2_miniAOD_UL
modifyReducedEGammaRun2MiniAOD = (run2_miniAOD_UL).makeProcessModifier(calibrateReducedEgamma)

So we don't understand how this should leak in the Run3 configuration.

On the physics side, this should not be used anywhere in Run3, where the ECAL-trk parameters configuration are defined alongside the regression here, and the re-calibration is not applied neither in Mini or Nano (as intended).
In Run2 we are fixing that for consistency, as the Ecal-trk combination parameters used in the re-application of the calibations were different from the ones used originally in the first calibration (causing issues!). Moreover, with this PR we have removed the re-application of the calibration in Mini Run2, and just keep the calibrated energy without re-applied scale-and-smearining (as they will be applied offline a posteriori as in Run3).

@valsdav
Copy link
Contributor

valsdav commented Aug 6, 2025

cmsDriver of the 2500.271 workflow:

# with command line options: step2 -s PAT,DQM:@miniAODDQM --era **Run3_2024** 
-n 0 --process PAT --conditions auto:run3_data --data --scenario pp --eventcontent MINIAOD,DQM 
--datatier MINIAOD,DQMIO **--procModifiers run2_miniAOD_UL_preSummer20**

from Configuration.Eras.Era_Run3_2024_cff import Run3_2024
from Configuration.ProcessModifiers.run2_miniAOD_UL_preSummer20_cff import run2_miniAOD_UL_preSummer20

@hqucms
Copy link
Contributor

hqucms commented Aug 6, 2025

Hi @hqucms. Let me summarize our findings.

ecalTrkCombinationRegression is defined in calibratedEgammas_cff which configures some producers which are used to re-calibrated electrons and photons.

The cff is only loaded in a function here: reducedEgammaTools, which is only loaded for this modifier

from RecoEgamma.EgammaPhotonProducers.reducedEgamma_tools import calibrateReducedEgamma
from Configuration.ProcessModifiers.run2_miniAOD_UL_cff import run2_miniAOD_UL
modifyReducedEGammaRun2MiniAOD = (run2_miniAOD_UL).makeProcessModifier(calibrateReducedEgamma)

So we don't understand how this should leak in the Run3 configuration.

On the physics side, this should not be used anywhere in Run3, where the ECAL-trk parameters configuration are defined alongside the regression here, and the re-calibration is not applied neither in Mini or Nano (as intended). In Run2 we are fixing that for consistency, as the Ecal-trk combination parameters used in the re-application of the calibations were different from the ones used originally in the first calibration (causing issues!). Moreover, with this PR we have removed the re-application of the calibration in Mini Run2, and just keep the calibrated energy without re-applied scale-and-smearining (as they will be applied offline a posteriori as in Run3).

Hi @valsdav -- thanks a lot for the detailed explanation! Now I understand what is happening, and it's indeed caused by the misuse of the run2_miniAOD_UL_preSummer20 modifier---the good news is that it only exists in the CMSSW relval workflows but not in any actual Run3 productions, so the differences in the PR tests are basically false alarms.

So in principle everything should be fine to proceed with the integration of this PR. I will make another PR to fix the misuse of the run2_miniAOD_UL_preSummer20 modifier.

@hqucms
Copy link
Contributor

hqucms commented Aug 6, 2025

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 6, 2025

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @mandrenguyen, @antoniovilela, @rappoccio, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 90274e0 into cms-sw:master Aug 7, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants