Skip to content

Conversation

@christopheralanwest
Copy link
Contributor

PR description:

This PR is a backport of PR #32421; see the description of that PR for details. The GT diffs in this PR are identical to the corresponding PR to master.

The GT diffs are as follows:

Run 1 design
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun1_design_v3/106X_mcRun1_design_v4

Run 1 realistic
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun1_realistic_v3/106X_mcRun1_realistic_v4

Run 1 heavy ion
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun1_HeavyIon_v3/106X_mcRun1_HeavyIon_v4

Run 1 proton-heavy ion
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun1_pA_v3/106X_mcRun1_pA_v4

Run 2 startup
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2_startup_v4/106X_mcRun2_startup_v5

Run 2 (L1 trigger stage 1)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2_asymptotic_l1stage1_v4/106X_mcRun2_asymptotic_l1stage1_v5

2016 design
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2_design_v7/106X_mcRun2_design_v8

2016 realistic pre-VFP era
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2_asymptotic_preVFP_v9/106X_mcRun2_asymptotic_preVFP_v10

2016 realistic post-VFP era
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2_asymptotic_v15/106X_mcRun2_asymptotic_v16

2016 cosmics (asymptotic conditions)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2cosmics_asymptotic_deco_v2/106X_mcRun2cosmics_asymptotic_deco_v3

Run 2 heavy ion
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2_HeavyIon_v4/106X_mcRun2_HeavyIon_v5

Run 2 proton-lead
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mcRun2_pA_v5/106X_mcRun2_pA_v6

Offline data
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_dataRun2_v32/106X_dataRun2_v33

Offline data relval
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_dataRun2_relval_v30/106X_dataRun2_relval_v31

Prompt-like data (HEM15/15 failure)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_dataRun2_PromptLike_HEfail_v13/106X_dataRun2_PromptLike_HEfail_v14

Prompt-like data
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_dataRun2_PromptLike_v14/106X_dataRun2_PromptLike_v15

Prompt-like HI data
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_dataRun2_PromptLike_HI_v14/106X_dataRun2_PromptLike_HI_v15

2017 design
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mc2017_design_IdealBS_v5/106X_mc2017_design_IdealBS_v6

2017 realistic
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mc2017_realistic_v8/106X_mc2017_realistic_v9

2017 realistic cosmics (tracker deco mode)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mc2017cosmics_realistic_deco_v3/106X_mc2017cosmics_realistic_deco_v4

2017 realistic cosmics (tracker peak mode)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_mc2017cosmics_realistic_peak_v3/106X_mc2017cosmics_realistic_peak_v4

2018 design
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2018_design_v6/106X_upgrade2018_design_v8

2018 realistic
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2018_realistic_v15/106X_upgrade2018_realistic_v16

2018 heavy ion
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2018_realistic_HI_v6/106X_upgrade2018_realistic_HI_v7

2018 realistic (HEM15/16 failure)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2018_realistic_HEfail_v15/106X_upgrade2018_realistic_HEfail_v16

2018 cosmics (tracker deco mode)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2018cosmics_realistic_deco_v12/106X_upgrade2018cosmics_realistic_deco_v13

2018 cosmics (tracker peak mode)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2018cosmics_realistic_peak_v12/106X_upgrade2018cosmics_realistic_peak_v13

2021 design
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2021_design_v5/106X_upgrade2021_design_v6

2021 realistic
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2021_realistic_v11/106X_upgrade2021_realistic_v12

2021 cosmics
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2021cosmics_realistic_deco_v4/106X_upgrade2021cosmics_realistic_deco_v5

2023 realistic
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/106X_upgrade2023_realistic_v5/106X_upgrade2023_realistic_v6

PR validation:

See the description of the original PR #32421 for details. In addition, a technical test was performed:

runTheMatrix.py -l limited,1325.516,7.22,136.8642,10424.0,7.21,11224.0,11024.2,7.4,12024.0,7.23,159.0,12834.0,1325.518,136.88811 --ibeos

This technical test was done without the PR that consumes these conditions, however, as that PR is not yet available.

if this PR is a backport please specify the original PR and why you need to backport that PR:

This PR is a backport of PR #32421. It is needed for an eventual re-miniAOD that includes low pT electrons.

@cmsbuild cmsbuild added this to the CMSSW_10_6_X milestone Dec 10, 2020
@christopheralanwest
Copy link
Contributor Author

test parameters

  • workflow = 1325.516,7.22,136.8642,10424.0,7.21,11224.0,11024.2,7.4,12024.0,7.23,159.0,12834.0,1325.518,136.88811

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @christopheralanwest for CMSSW_10_6_X.

It involves the following packages:

Configuration/AlCa

@cmsbuild, @pohsun, @yuanchao, @christopheralanwest, @tlampen can you please review it and eventually sign? Thanks.
@makortel, @Martin-Grunewald, @mmusich, @fabiocos, @tocheng this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@christopheralanwest
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

-1

CMSSW: CMSSW_10_6_X_2020-12-09-2300/slc7_amd64_gcc700
You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f0b9ed/11483/summary.html

I found follow errors while testing this PR

Failed tests: RelVals

  • RelVals:

When I ran the RelVals I found an error in the following workflows:
136.8642 step1

DAS Error
  • DAS Queries: The DAS query tests failed, see the summary page for details.

@christopheralanwest
Copy link
Contributor Author

please test

I have no problem running the failed DAS query so the problem seems transient.

@cmsbuild
Copy link
Contributor

+1
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f0b9ed/11485/summary.html
CMSSW: CMSSW_10_6_X_2020-12-09-2300/slc7_amd64_gcc700
Additional comment: 'DAS

@cmsbuild
Copy link
Contributor

Comparison results are now available
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f0b9ed/11485/summary.html
CMSSW: CMSSW_10_6_X_2020-12-09-2300/slc7_amd64_gcc700

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/10424.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017Design_GenSimFull+DigiFull_2017Design+RecoFull_2017Design+HARVESTFull_2017Design
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/11024.2_TTbar_13UP18HEfailINPUT+TTbar_13UP18HEfailINPUT+DigiFullHEfail+RecoFullHEfail+HARVESTFullHEfail+NanoFullHEfail
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/11224.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018Design_GenSimFull+DigiFull_2018Design+RecoFull_2018Design+HARVESTFull_2018Design
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/12024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2021Design_GenSimFull+DigiFull_2021Design+RecoFull_2021Design+HARVESTFull_2021Design
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/136.8642_RunJetHT2018BHEfail+RunJetHT2018BHEfail+HLTDR2_2018+RECODR2_2018reHLT_skimJetHT_Prompt_HEfail+HARVEST2018_HEfail
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/7.21_Cosmics_UP17+Cosmics_UP17+DIGICOS_UP17+RECOCOS_UP17+ALCACOS_UP17+HARVESTCOS_UP17
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/7.22_Cosmics_UP16+Cosmics_UP16+DIGICOS_UP16+RECOCOS_UP16+ALCACOS_UP16+HARVESTCOS_UP16
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-f0b9ed/7.23_Cosmics_UP21+Cosmics_UP21+DIGICOS_UP21+RECOCOS_UP21+ALCACOS_UP21+HARVESTCOS_UP21

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 3214712
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3214377
  • DQMHistoTests: Total skipped: 334
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 140 log files, 29 edm output root files, 34 DQM output files

@christopheralanwest
Copy link
Contributor Author

+1

  • backport consistent with the PR to master
  • no changes observed, as expected because backport PR that consumes the new labeled records introduced in this PR have not been made.
  • for several workflows that failed due to DAS errors, I checked in local tests that the workflows run successfully: runTheMatrix.py -l 136.789,136.827,136.841,136.852 --ibeos

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_6_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_11_3_X is complete. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@silviodonato
Copy link
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants