Order vectorization and pgo packages #205

smuzaffar · 2024-03-31T10:33:00Z

No description provided.

cmsbuild · 2024-03-31T10:33:20Z

A new Pull Request was created by @smuzaffar for branch V00-34-XX.

@aandvalenzuela, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @sextonkennedy, @rappoccio you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2024-03-31T10:33:21Z

cms-bot internal usage

smuzaffar · 2024-03-31T10:33:58Z

test parameters:

skip_test = static,header

smuzaffar · 2024-03-31T10:34:03Z

please test

cmsbuild · 2024-03-31T10:35:26Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38517/summary.html
COMMIT: da7f64f
CMSSW: CMSSW_14_1_X_2024-03-31-0000/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/pkgtools/205/38517/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

cmsbuild · 2024-03-31T10:38:54Z

Pull request #205 was updated.

smuzaffar · 2024-03-31T10:38:56Z

please test

smuzaffar · 2024-03-31T10:40:55Z

please test for CMSSW_14_1_MULTIARCHS_X

cmsbuild · 2024-03-31T13:47:11Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38518/summary.html
COMMIT: e1e87c6
CMSSW: CMSSW_14_1_X_2024-03-31-0000/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/pkgtools/205/38518/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 150 lines from the logs
Reco comparison results: 43 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3297469
DQMHistoTests: Total failures: 3
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3297446
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 202 log files, 165 edm output root files, 48 DQM output files
TriggerResults: no differences found

cmsbuild · 2024-03-31T23:29:32Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38519/summary.html
COMMIT: e1e87c6
CMSSW: CMSSW_14_1_MULTIARCHS_X_2024-03-28-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/205/38519/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38519/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38519/git-merge-result

Comparison Summary

Summary:

You potentially removed 187 lines from the logs
Reco comparison results: 67995 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3297469
DQMHistoTests: Total failures: 190380
DQMHistoTests: Total nulls: 286
DQMHistoTests: Total successes: 3106783
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -1.397 KiB( 47 files compared)
DQMHistoSizes: changed ( 10224.0 ): -0.713 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 13034.0 ): 1.172 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 140.063 ): -0.004 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 141.042 ): 0.004 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 141.044 ): -0.031 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 141.046 ): -0.012 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 250202.181 ): -0.891 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 25202.0 ): 0.661 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 7.3 ): -1.583 KiB SiStrip/MechanicalView
Checked 202 log files, 165 edm output root files, 48 DQM output files
TriggerResults: found differences in 18 / 46 workflows

cmsbuild · 2024-04-02T04:04:04Z

Pull request #205 was updated.

smuzaffar · 2024-04-02T04:04:06Z

please test

cmsbuild · 2024-04-02T07:22:49Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38530/summary.html
COMMIT: 6744c81
CMSSW: CMSSW_14_1_X_2024-04-01-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/pkgtools/205/38530/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 16 lines from the logs
Reco comparison results: 44 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3297469
DQMHistoTests: Total failures: 9
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3297440
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 202 log files, 165 edm output root files, 48 DQM output files
TriggerResults: no differences found

smuzaffar · 2024-04-02T09:10:06Z

please test for CMSSW_14_1_MULTIARCHS_X

smuzaffar · 2024-04-02T10:06:41Z

please test for CMSSW_14_0_X

cmsbuild · 2024-04-02T15:00:11Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38541/summary.html
COMMIT: 6744c81
CMSSW: CMSSW_14_0_X_2024-04-02-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/pkgtools/205/38541/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 89 lines from the logs
Reco comparison results: 52 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3346148
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3346120
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 205 log files, 166 edm output root files, 49 DQM output files
TriggerResults: no differences found

cmsbuild · 2024-04-02T23:58:22Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38537/summary.html
COMMIT: 6744c81
CMSSW: CMSSW_14_1_MULTIARCHS_X_2024-03-31-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/pkgtools/205/38537/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38537/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20c3a6/38537/git-merge-result

Unit Tests

I found 4 errors in the following unit tests:

---> test test-das-selected-lumis had ERRORS
---> test test_edmPickEvents had ERRORS
---> test SubmitPVsplit had ERRORS
and more ...

Comparison Summary

Summary:

You potentially removed 454 lines from the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 69925 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3297391
DQMHistoTests: Total failures: 197231
DQMHistoTests: Total nulls: 280
DQMHistoTests: Total successes: 3099860
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 3.279 KiB( 47 files compared)
DQMHistoSizes: changed ( 10224.0 ): -1.157 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 11634.0,... ): 0.018 KiB Physics/NanoAODDQM
DQMHistoSizes: changed ( 13034.0 ): -0.108 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 13234.0,... ): 0.012 KiB Physics/NanoAODDQM
DQMHistoSizes: changed ( 140.063 ): -0.004 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 141.042 ): 0.004 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 141.044 ): -0.031 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 141.046 ): -0.012 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 250202.181 ): -0.475 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 25202.0 ): 0.954 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 7.3 ): ...
Checked 202 log files, 165 edm output root files, 48 DQM output files
TriggerResults: found differences in 19 / 46 workflows

smuzaffar · 2024-04-03T11:12:45Z

+externals

looks good, does not trigger rebuilt of packages

cmsbuild · 2024-04-03T11:13:03Z

This pull request is fully signed and it will be integrated in one of the next V00-34-XX IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @sextonkennedy, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

Order vectorization and pgo packages

da7f64f

cmsbuild added orp-pending pending-signatures tests-started externals-pending labels Mar 31, 2024

cmsbuild added tests-rejected and removed tests-started labels Mar 31, 2024

initialize PackageFactory.vpackages

e1e87c6

cmsbuild removed the tests-rejected label Mar 31, 2024

cmsbuild added the tests-pending label Mar 31, 2024

cmsbuild added tests-started and removed tests-pending labels Mar 31, 2024

cmsbuild added tests-approved and removed tests-started labels Mar 31, 2024

remove unused vectorize pack list

6744c81

cmsbuild added tests-pending and removed tests-approved labels Apr 2, 2024

cmsbuild removed the tests-pending label Apr 2, 2024

cmsbuild added the tests-started label Apr 2, 2024

cmsbuild added tests-approved and removed tests-started labels Apr 2, 2024

cmsbuild added tests-started and removed tests-approved labels Apr 2, 2024

cmsbuild added tests-approved and removed tests-started labels Apr 2, 2024

smuzaffar merged commit 73c442c into V00-34-XX Apr 3, 2024

cmsbuild added fully-signed externals-approved and removed pending-signatures externals-pending labels Apr 3, 2024

smuzaffar deleted the order-vec-pgo branch May 30, 2024 11:00

Order vectorization and pgo packages #205

Order vectorization and pgo packages #205

Uh oh!

Conversation

smuzaffar commented Mar 31, 2024

Uh oh!

cmsbuild commented Mar 31, 2024

Uh oh!

cmsbuild commented Mar 31, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

smuzaffar commented Mar 31, 2024

Uh oh!

smuzaffar commented Mar 31, 2024

Uh oh!

cmsbuild commented Mar 31, 2024

External Build

Uh oh!

cmsbuild commented Mar 31, 2024

Uh oh!

smuzaffar commented Mar 31, 2024

Uh oh!

smuzaffar commented Mar 31, 2024

Uh oh!

cmsbuild commented Mar 31, 2024

Comparison Summary

Uh oh!

cmsbuild commented Mar 31, 2024

Comparison Summary

Uh oh!

cmsbuild commented Apr 2, 2024

Uh oh!

smuzaffar commented Apr 2, 2024

Uh oh!

cmsbuild commented Apr 2, 2024

Comparison Summary

Uh oh!

smuzaffar commented Apr 2, 2024

Uh oh!

smuzaffar commented Apr 2, 2024

Uh oh!

cmsbuild commented Apr 2, 2024

Comparison Summary

Uh oh!

cmsbuild commented Apr 2, 2024

Unit Tests

Comparison Summary

Uh oh!

smuzaffar commented Apr 3, 2024

Uh oh!

cmsbuild commented Apr 3, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cmsbuild commented Mar 31, 2024 •

edited

Loading