[TEST-ONLY] Turn on concurrentLumis #31699

silviodonato · 2020-10-07T15:36:38Z

PR description:

This PR switches on always concurrentLumis, using nCurrentLumis = 2. Taken from #31369.
It will be used to test #31689 and #31678 with concurrentLumis on.

silviodonato · 2020-10-07T15:37:04Z

please test with #31689, #31678

cmsbuild · 2020-10-07T15:37:07Z

The code-checks are being triggered in jenkins.

cmsbuild · 2020-10-07T15:42:14Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-31699/18859

This PR adds an extra 36KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/Applications/python/ConfigBuilder.py modified in PR(s): Remove legacy dqm #31369

cmsbuild · 2020-10-07T15:44:20Z

The tests are being triggered in jenkins.
Tested with other pull request(s) #31689,#31678

CMSSW_11_2_X_2020-10-07-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/9777/console Started: 2020/10/07 17:46

cmsbuild · 2020-10-07T15:44:24Z

A new Pull Request was created by @silviodonato (Silvio Donato) for master.

It involves the following packages:

Configuration/Applications

@silviodonato, @cmsbuild, @franzoni, @qliphy, @fabiocos, @davidlange6 can you please review it and eventually sign? Thanks.
@makortel, @Martin-Grunewald, @fabiocos this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

jfernan2 · 2020-10-07T15:56:33Z

@silviodonato thanks a lot for this test!
However, is my understanding correct that Jenkins test use a Single Core? So, we will actually see concurrent LS in such scenario?

cmsbuild · 2020-10-07T18:03:06Z

-1

Tested at: f051d65

CMSSW: CMSSW_11_2_X_2020-10-07-1100
SCRAM_ARCH: slc7_amd64_gcc820
You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-60df14/9777/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests

Unit Tests:

I found errors in the following unit tests:

---> test TestDQMOnlineClient-ecal_dqm_sourceclient had ERRORS

cmsbuild · 2020-10-07T18:03:14Z

Comparison job queued.

cmsbuild · 2020-10-07T19:32:34Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-60df14/9777/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 35
DQMHistoTests: Total histograms compared: 2542113
DQMHistoTests: Total failures: 16
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2542075
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -773.364 KiB( 34 files compared)
DQMHistoSizes: changed ( 10024.0,... ): -48.369 KiB L1T/L1TStage2CaloLayer1
DQMHistoSizes: changed ( 136.731 ): -47.829 KiB L1T/L1TStage2CaloLayer1
Checked 149 log files, 22 edm output root files, 35 DQM output files

cmsbuild · 2020-10-15T08:50:51Z

The tests are being triggered in jenkins.
Tested with other pull request(s) #31689

CMSSW_11_2_X_2020-10-15-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/9985/console Started: 2020/10/15 20:36

cmsbuild · 2020-10-19T16:55:58Z

The code-checks are being triggered in jenkins.

silviodonato · 2020-10-19T16:58:19Z

please test with #31689, #31678, #31829

cmsbuild · 2020-10-19T17:02:57Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-31699/19214

This PR adds an extra 40KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/Applications/python/ConfigBuilder.py modified in PR(s): Remove legacy dqm #31369

cmsbuild · 2020-10-19T17:03:29Z

The tests are being triggered in jenkins.
Tested with other pull request(s) #31689,#31678,#31829

CMSSW_11_2_X_2020-10-19-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/10096/console Started: 2020/10/19 19:04

cmsbuild · 2020-10-19T17:03:33Z

Pull request #31699 was updated. @silviodonato, @cmsbuild, @franzoni, @qliphy, @fabiocos, @davidlange6 can you please check and sign again.

cmsbuild · 2020-10-19T19:10:58Z

+1
Tested at: 4229513
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-2a187a/10096/summary.html
CMSSW: CMSSW_11_2_X_2020-10-19-1100
SCRAM_ARCH: slc7_amd64_gcc820

cmsbuild · 2020-10-19T19:11:12Z

Comparison job queued.

cmsbuild · 2020-10-19T20:26:24Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-2a187a/10096/summary.html

Comparison Summary:

You potentially added 4870 lines to the logs
Reco comparison results: 7 differences found in the comparisons
DQMHistoTests: Total files compared: 35
DQMHistoTests: Total histograms compared: 2543640
DQMHistoTests: Total failures: 28
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2543590
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -773.364 KiB( 34 files compared)
DQMHistoSizes: changed ( 10024.0,... ): -48.369 KiB L1T/L1TStage2CaloLayer1
DQMHistoSizes: changed ( 136.731 ): -47.829 KiB L1T/L1TStage2CaloLayer1
Checked 149 log files, 22 edm output root files, 35 DQM output files

turn on concurrentLumis

f051d65

cmsbuild added this to the CMSSW_11_2_X milestone Oct 7, 2020

cmsbuild added code-checks-pending comparison-pending operations-pending orp-pending pending-signatures tests-pending labels Oct 7, 2020

cmsbuild added code-checks-approved and removed code-checks-pending labels Oct 7, 2020

This was referenced Oct 7, 2020

Fix to allow concurrent processing of lumisections with ECAL DQM #31689

Merged

Add new CaloL1 offline DQM module and configuration #31678

Closed

cmsbuild added requires-external tests-started and removed tests-pending labels Oct 7, 2020

cmsbuild added tests-rejected and removed tests-started labels Oct 7, 2020

cmsbuild added comparison-available and removed comparison-pending labels Oct 7, 2020

cmsbuild removed the tests-rejected label Oct 15, 2020

cmsbuild added code-checks-pending comparison-pending tests-pending and removed comparison-notrun requires-external tests-rejected labels Oct 19, 2020

cmsbuild added code-checks-approved and removed code-checks-pending labels Oct 19, 2020

cmsbuild added requires-external tests-started and removed tests-pending labels Oct 19, 2020

cmsbuild added tests-approved and removed tests-started labels Oct 19, 2020

cmsbuild added comparison-available and removed comparison-pending labels Oct 19, 2020

silviodonato marked this pull request as draft October 20, 2020 13:37

silviodonato mentioned this pull request Oct 20, 2020

Remove legacy dqm #31369

Closed

smuzaffar modified the milestones: CMSSW_11_2_X, CMSSW_11_3_X Nov 26, 2020

silviodonato mentioned this pull request Nov 26, 2020

DQMOnlineClient-beam_dqm_sourceclient error #31896

Closed

cmsbuild mentioned this pull request Dec 7, 2020

Enable concurrent lumis by default in cmsDriver.py #32406

Merged

silviodonato closed this Dec 15, 2020

[TEST-ONLY] Turn on concurrentLumis #31699

[TEST-ONLY] Turn on concurrentLumis #31699

Uh oh!

Conversation

silviodonato commented Oct 7, 2020

PR description:

Uh oh!

silviodonato commented Oct 7, 2020

Uh oh!

cmsbuild commented Oct 7, 2020

Uh oh!

cmsbuild commented Oct 7, 2020

Uh oh!

cmsbuild commented Oct 7, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Oct 7, 2020

Uh oh!

jfernan2 commented Oct 7, 2020

Uh oh!

cmsbuild commented Oct 7, 2020

Uh oh!

cmsbuild commented Oct 7, 2020

Uh oh!

cmsbuild commented Oct 7, 2020

Uh oh!

cmsbuild commented Oct 15, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Oct 19, 2020

Uh oh!

silviodonato commented Oct 19, 2020

Uh oh!

cmsbuild commented Oct 19, 2020

Uh oh!

cmsbuild commented Oct 19, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Oct 19, 2020

Uh oh!

cmsbuild commented Oct 19, 2020

Uh oh!

cmsbuild commented Oct 19, 2020

Uh oh!

cmsbuild commented Oct 19, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

cmsbuild commented Oct 7, 2020 •

edited

Loading

cmsbuild commented Oct 15, 2020 •

edited

Loading

cmsbuild commented Oct 19, 2020 •

edited

Loading