features for UL re-miniAOD in 10_6_X

[slava77]

This is to keep track of features needed for the UL re-miniAOD.
The 2017 will likely happen first.
The target start date is still unclear (it will probably be around October 2019).

As of Aug 7 (after #31072 was merged) the re-miniAOD definitions aiming for UL re-miniAOD should use a run2_miniAOD_UL modifier, if the configuration is to be controlled by a modifier.

[as of Dec 9]

• Disabled PCA inputs for deepTau v2 (10_6_X) #27882 "Disabled PCA inputs for deepTau v2". Target: all re-miniAOD. (merged Sep 19, 2019)
  • the change to deepTau2017v2p1 is already applied in UL 2016 and 2018 by default
  • controlled by run2_miniAOD_devel
• Add customizer for PUPPI tune v13 [10_6_X backport] #28845 "Add customizer for PUPPI tune v13" (merged Feb 27, 2020)
  • this is implemented with a customize method; superseded by v14
• PUPPI tune v14 [10_6_X] #29601 PUPPI tune v14 (merged May 14, 2020)
• Adding parameters needed for PUjetID 94X and 102X (backport to 106X) #29045 Adding parameters needed for PUjetID 94X and 102X (merged Mar 3, 2020)
  • bugfix for run2_miniAOD_devel -based setup in fix miniaod_devel modifier use for pileupJetId.algos #29377 (merged April 2, 2020)
  • controlled by run2_miniAOD_devel
• Fix MET unclustered energy computation [10_6_X] #29330 Fix MET unclustered energy computation (merged April 1, 2020)
  • controlled by run2_miniAOD_devel
• Fix MET Significance, Covariance Matrix and unclustered energy lepton subtraction [10_6_X] #29392 Fix MET Significance, Covariance Matrix and unclustered energy lepton subtraction (merged Apr 21, 2020)
  • controlled by run2_miniAOD_devel
• keeping METsumPtUnclustered (backport of #28370) #29521 Keeping sumPt from MET Significance calculation (merged Apr 21, 2020)
  • enabled, no era modifiers
• [10_6_X] MXNet-based implementation of the ParticleNet tagger #29062 MXNet-based implementation of the ParticleNet tagger (merged Apr 18, 2020)
  • controlled by run2_miniAOD_devel
• Backport of inverse beta variable in pat::Muons for 10_6_X #29324 inverse beta variable in pat::Muons (merged Apr 17, 2020)
  • enabled, no era modifiers
• Update of the lostTrack collection for MUO (back-port of #29389) #29529 Update of the lostTrack collection for MUO (merged Apr 23, 2020)
• Backport of #28753 (fix the sign of pat::Muon dxy to take the one from the track) #29537 fix sign of pat::Muon::dxy (merged May 1, 2020)
• PPS: updates for re-miniAOD (backport of #29770) #29771 PPS rereco-in-miniAOD (merged May 25, 2020)
  • controlled by run2_miniAOD_devel
• Restructured code of againstElectronDeadECAL tauID (10_6_X) #29739 Tau againstElectronDeadECAL (merged May 27, 2020 )
  • controlled by run2_miniAOD_devel
• Fix bug affecting boosted tau isolation (10_6_X) #30066 Fix bug affecting boosted tau isolation (merged June 4, 2020)
• Backport of UL scales and smearings to 106X  #30199 Updates to electron/photon scales and smearings for UL (merged June 19, 2020)
• [10.6] Backport onnxrt 1.3.0 to 10_6 cmsdist#5902 update ONNXRuntime to 1.3.0 (merged June 17, 2020)
• [10_6_X] ONNXRuntime-based implementation of DeepJet, DeepAK8 and DeepDoubleX #30123 ONNXRuntime-based implementation of DeepJet, DeepAK8 and DeepDoubleX (technical; significant speedup) (merged July 2, 2020)
• baseline workflows for UL reminiAOD #30352 define UL re-miniAOD workflows; technical at this point, repeats UL main miniAOD (merged June 26, 2020)
• [10_6_X] feat: Introduce DeepDoubleX V2 #30542 deepDoubleX V2; capability only, plan to enable later (merged July 13, 2020)
• ONNX-based Higgs to bb Interaction Network Tagger [10_6_X] #30584 Hbb Interaction network tagger (merged July 20, 2020)
• 106X backport of #30738 (Use dxy sign of GSF track instead of IPTools for pat::Electron) #30892 Use dxy sign of GSF track instead of IPTools for pat::Electron (merged Aug 4, 2020)
• 106X backport of: Pile-Up ID training and WPs for 2017 UL samples #30935 Pile-Up ID training and WPs for 2017 UL samples (merged Aug 4, 2020)
• migrate from run2_miniAOD_devel to run2_miniAOD_UL for miniAOD setup UL workflows #31072 migrate run2_miniAOD_devel parts suitable for UL re-mini to use run2_miniAOD_UL (merged Aug 7, 2020)
• Fix to enable hpsPFTauDiscriminationByDeadECALElectronRejection in run2 reminiAODs (10_6_X) #31044 fix to enable hpsPFTauDiscriminationByDeadECALElectronRejection in run2 reminiAOD (merged Aug 16, 2020)
• [10_6_X] Use ONNXRuntime for ParticleNet and update the training for UL #31037 updated training for ParticleNet tagger (merged Aug 17, 2020)
• Adapt track-vertex association in PUPPI (v15) [10_6_X] #31214 Adapt track-vertex association in PUPPI (v15) (merged Aug 25, 2020)
• Add DeepMET into NanoAOD for UltraLegacy in 10_6_X (backport of 30291 and 30926) #31120 deepMet for nanoAOD, includes an operational bugfix in DeepMETProducer (merged Aug 25, 2020)
• addition of new MET filter BadPFMuonDzFilter_cfi.py in CMSSW_10_6_X : i.e. backport from 11_1_X of PR 30015 and 30974 #31087 bad PF muon filter (merged Sep 14, 2020)
• Update tau anti electron discriminators in RECO and MiniAOD (10_6_X) #31065 Update tau anti electron discriminators (merged Sep 1, 2020)
• [10_6_X] improving performance of PuppiProducer #31290 improving (computational) performance of PuppiProducer (merged Sep 4, 2020)
• HF Noise Event Filter 106X backport #31413 HF Noise Event Filter (merged Sep 16, 2020)
• HF jet shower shape (106X backport) #31420 HF jet shower shape (merged Sep 18, 2020)
• 10_6_X backport of "HCAL: slimmed collections... for miniAOD" (PR #31375) #31510 HCAL slimmed collections (merged Sep 23, 2020)
• [10_6_X] ParticleNetAK4 jet tagger #31615 ParticleNet AK4 jet tagger (merged Oct 7, 2020)
• [10_6_X] DDXv2 and BTV changes in Nano #31618, #31786 #31847 Activate deepDoubleXV2 (merged Nov 4, 2020)
• [RecoEgamma/EgammaTools] Backport of UL 2018 scale and smearing corrections #31995 Electron Scale and smearing for UL (merged Nov 4, 2020)
• speedup: switch EgammaTools EnergyScaleCorrection scales and smearings to use std::map (backport of #32053) #32055 speedup at job start in EnergyScaleCorrection (merged Nov 10, 2020)
• Expand track information in lostTracks collection (10_6_X) #32303 Expand track information in lostTracks collection, for tau reco-from-mini (merged Nov 30, 2020)
• Pr106 L1T Unprefireable Bit Functionality for miniAOD Reprocessing #31984 "unprefireable bit info" (merged Dec 2, 2020)
• Add low-pT electrons to MINIAOD, update ID, improve end user experience (back port of 31220) #32372 update LowPtElectrons in bParking config and add low-pt electrons in default miniAOD (merged Dec 9, 2020)

The following features were descoped:

• (no 10_6_X PR) LowPtElectrons: final energy regression and ID #32391 energy regression for low-pt electrons, including updated training of IDs (all can be redone from miniAOD, not in LowPtElectrons: final energy regression and ID #32391 as of Dec 8)
• quark gluon likelihood retraining (controlled by GT; possibly descoped features for UL re-miniAOD in 10_6_X #27889 (comment))
• update of the prefiring maps. (will update a file in https://github.com/cms-data/PhysicsTools-PatUtils; possibly descoped features for UL re-miniAOD in 10_6_X #27889 (comment))

A bit outside of re-miniAOD scope (requires fresh MC/rereco)

• Store TrackExtra, TrackingRecHits, and SiPixel/StripClusters for muons in AOD+MINIAOD (10_6_X) #31350 Store TrackExtra, TrackingRecHits, and SiPixel/StripClusters for muons in AOD+MINIAOD

[slava77]

assign reconstruction,xpog,operations

[cmsbuild]

New categories assigned: operations,xpog,reconstruction

@slava77,@fabiocos,@franzoni,@fgolf,@perrotta,@davidlange6,@kpedro88,@peruzzim you have been requested to review this Pull request/Issue and eventually sign? Thanks

[cmsbuild]

A new Issue was created by @slava77 Slava Krutelyov.

@davidlange6, @Dr15Jones, @smuzaffar, @fabiocos, @kpedro88 can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

[slava77]

it sounds like there is still time for deploying the fix in the 2018 UL.
I propose to make run2_tau_ul_2018 and run2_tau_ul_2016 modifiers which can be added to Run2_2018 and Run2_2016 eras.
There is not need to propagate these to the master.

@fabiocos @kpedro88 @srimanob this is as a follow up to the discussion today in the ORP.
Please check if this proposal makes sense to you as well.

[peruzzim]

it sounds like there is still time for deploying the fix in the 2018 UL.
I propose to make run2_tau_ul_2018 and run2_tau_ul_2016 modifiers which can be added to Run2_2018 and Run2_2016 eras.
There is not need to propagate these to the master.

@fabiocos @kpedro88 @srimanob this is as a follow up to the discussion today in the ORP.
Please check if this proposal makes sense to you as well.

I agree with the above, but please let's keep it active also under the generic devel modifier, so we will remember to add it also to 2017 in a future re-miniAOD of that.

[peruzzim]

taking note of #27929 (comment)

[peruzzim]

taking note of #28844