set ONEDNN_MAX_CPU_ISA=AVX2 when running profiling #2449

gartung · 2025-03-08T01:42:59Z

No description provided.

cmsbuild · 2025-03-08T01:43:25Z

A new Pull Request was created by @gartung for branch master.

@cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2025-03-08T01:43:25Z

cms-bot internal usage

cmsbuild · 2025-03-08T02:06:24Z

Pull request #2449 was updated.

gartung · 2025-03-08T02:06:34Z

enable profiling

cmsbuild · 2025-03-08T10:45:03Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44857/summary.html
COMMIT: 0547eda
CMSSW: CMSSW_15_1_X_2025-03-07-1100/el8_amd64_gcc12
Additional Tests: PROFILING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/2449/44857/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 3 lines from the logs
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3920300
DQMHistoTests: Total failures: 93
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3920187
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 214 log files, 184 edm output root files, 49 DQM output files
TriggerResults: no differences found

gartung · 2025-03-08T23:53:42Z

please test with cms-sw/cmsdist#9739

cmsbuild · 2025-03-09T08:41:53Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44865/summary.html
COMMIT: 0547eda
CMSSW: CMSSW_15_1_X_2025-03-08-1100/el8_amd64_gcc12
Additional Tests: PROFILING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/2449/44865/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 16 lines to the logs
Reco comparison results: 8 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3920300
DQMHistoTests: Total failures: 3
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3920277
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 214 log files, 184 edm output root files, 49 DQM output files
TriggerResults: no differences found

gartung · 2025-03-09T18:02:37Z

please test with cms-sw/cmsdist#9731

cmsbuild · 2025-03-09T22:23:36Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44873/summary.html
COMMIT: 0547eda
CMSSW: CMSSW_15_1_TF_X_2025-03-04-1100/el8_amd64_gcc12
Additional Tests: PROFILING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/2449/44873/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44873/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44873/git-merge-result

Comparison Summary

Summary:

You potentially added 171 lines to the logs
Reco comparison results: 7198 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3920287
DQMHistoTests: Total failures: 34930
DQMHistoTests: Total nulls: 3
DQMHistoTests: Total successes: 3885334
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.12100000000000002 KiB( 48 files compared)
DQMHistoSizes: changed ( 145.014,... ): 0.007 KiB HLT/Filters
DQMHistoSizes: changed ( 145.604 ): 0.051 KiB JetMET/SUSYDQM
Checked 214 log files, 184 edm output root files, 49 DQM output files
TriggerResults: no differences found

cmsbuild · 2025-03-11T02:04:27Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44899/summary.html
COMMIT: 0547eda
CMSSW: CMSSW_15_1_TF_X_2025-03-04-1100/el8_amd64_gcc12
Additional Tests: PROFILING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cms-bot/2449/44899/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44899/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44899/git-merge-result

Comparison Summary

Summary:

You potentially added 169 lines to the logs
Reco comparison results: 7201 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3920287
DQMHistoTests: Total failures: 34928
DQMHistoTests: Total nulls: 3
DQMHistoTests: Total successes: 3885336
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.12100000000000002 KiB( 48 files compared)
DQMHistoSizes: changed ( 145.014,... ): 0.007 KiB HLT/Filters
DQMHistoSizes: changed ( 145.604 ): 0.051 KiB JetMET/SUSYDQM
Checked 214 log files, 184 edm output root files, 49 DQM output files
TriggerResults: no differences found

cmsbuild · 2025-03-11T03:47:53Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-906025/44891/summary.html
COMMIT: 0547eda
CMSSW: CMSSW_15_1_X_2025-03-10-1100/el8_amd64_gcc12
Additional Tests: PROFILING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2449/44891/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 2 lines from the logs
Reco comparison results: 5 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3920300
DQMHistoTests: Total failures: 48
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3920232
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 214 log files, 184 edm output root files, 49 DQM output files
TriggerResults: no differences found

cmsbuild · 2025-03-11T22:57:44Z

Pull request #2449 was updated.

cmsbuild · 2025-03-12T15:53:41Z

Pull request #2449 was updated.

commit 7de194f Author: Patrick Gartung <[email protected]> Date: Wed Mar 12 16:52:59 2025 +0100 Add MALLOC_CONF=zero:true commit 694749d Author: Patrick Gartung <[email protected]> Date: Sat Mar 8 02:42:26 2025 +0100 set ONEDNN_MAX_CPU_ISA=AVX2 when running igprof -pp

cmsbuild · 2025-03-12T15:55:26Z

Pull request #2449 was updated.

cmsbuild · 2025-03-14T14:11:12Z

Pull request #2449 was updated.

cmsbuild added orp-pending pending-signatures externals-pending tests-pending labels Mar 8, 2025

cmsbuild added tests-started and removed tests-pending labels Mar 8, 2025

cmsbuild added tests-pending and removed tests-started labels Mar 8, 2025

cmsbuild added tests-started and removed tests-pending labels Mar 8, 2025

cmsbuild added tests-approved requires-external tests-started tests-pending and removed tests-started tests-approved tests-pending requires-external labels Mar 8, 2025

cmsbuild added the requires-external label Mar 8, 2025

cmsbuild added tests-approved and removed tests-started labels Mar 9, 2025

gartung mentioned this pull request Mar 10, 2025

Update tensorflow 2.17.0 to build OneDNN objects with -fno-omit-frame-pointer cms-sw/cmsdist#9731

Closed

cmsbuild added tests-started and removed tests-approved labels Mar 10, 2025

gartung mentioned this pull request Mar 10, 2025

Update tensorflow v2.12.0 to build OneDNN objects with -fno-omit-frame-pointer cms-sw/cmsdist#9739

Closed

cmsbuild added tests-approved and removed tests-started labels Mar 11, 2025

gartung linked an issue Mar 11, 2025 that may be closed by this pull request

Enable use of Tensorflow 2.17.0 with oneDNN 3.4.3 with memory debugging in profiling jobs cms-sw/framework-team#1300

Closed

gartung changed the title ~~set ONEDNN_MAX_CPU_ISA=AVX2 when running igprof -pp~~ set ONEDNN_MAX_CPU_ISA=AVX2 when running profiling Mar 11, 2025

cmsbuild added tests-pending and removed tests-approved requires-external labels Mar 11, 2025

gartung force-pushed the gartung-igprof branch from 7de194f to db6a2c7 Compare March 12, 2025 15:55

Add profiling to allowed test for CMSSW_15_1_TF queue.

94d1328

gartung closed this Mar 14, 2025

gartung deleted the gartung-igprof branch March 19, 2025 17:46

gartung restored the gartung-igprof branch March 19, 2025 17:47

gartung deleted the gartung-igprof branch March 19, 2025 17:59

set ONEDNN_MAX_CPU_ISA=AVX2 when running profiling #2449

set ONEDNN_MAX_CPU_ISA=AVX2 when running profiling #2449

Uh oh!

Conversation

gartung commented Mar 8, 2025

Uh oh!

cmsbuild commented Mar 8, 2025

Uh oh!

cmsbuild commented Mar 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Mar 8, 2025

Uh oh!

gartung commented Mar 8, 2025

Uh oh!

cmsbuild commented Mar 8, 2025

Comparison Summary

Uh oh!

gartung commented Mar 8, 2025

Uh oh!

cmsbuild commented Mar 9, 2025

Comparison Summary

Uh oh!

gartung commented Mar 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Mar 9, 2025

Comparison Summary

Uh oh!

cmsbuild commented Mar 11, 2025

Comparison Summary

Uh oh!

cmsbuild commented Mar 11, 2025

Comparison Summary

Uh oh!

cmsbuild commented Mar 11, 2025

Uh oh!

cmsbuild commented Mar 12, 2025

Uh oh!

cmsbuild commented Mar 12, 2025

Uh oh!

cmsbuild commented Mar 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

cmsbuild commented Mar 8, 2025 •

edited

Loading

gartung commented Mar 9, 2025 •

edited

Loading