Fix py-tables issue for aarch64/ppc64le by smuzaffar · Pull Request #7774 · cms-sw/cmsdist

smuzaffar · 2022-04-10T05:03:22Z

Build with -pthread to fix unit tests for aarch64 and ppc64le

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File ".../py3-tables/3.6.1-0c82929e2e13ad5ec991d01bb7064d7d/lib/python3.9/site-packages/tables/__init__.py", line 99, in <module>
    from .utilsextension import (
ImportError: .../py3-tables/3.6.1-0c82929e2e13ad5ec991d01bb7064d7d/lib/python3.9/site-packages/tables/utilsextension.cpython-39-powerpc64le-linux-gnu.so: undefined symbol: pthread_atfork

smuzaffar · 2022-04-10T05:03:29Z

please test

cmsbuild · 2022-04-10T05:03:45Z

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch IB/CMSSW_12_4_X/master.

@smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @qliphy you are the release manager for this.
cms-bot commands are listed here

smuzaffar · 2022-04-10T05:03:48Z

please test for slc7_aarch64_gcc11

smuzaffar · 2022-04-10T05:04:05Z

please test for slc7_ppc64le_gcc11

cmsbuild · 2022-04-10T11:09:26Z

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23805/summary.html
COMMIT: 4134d39
CMSSW: CMSSW_12_4_X_2022-04-07-2300/slc7_aarch64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7774/23805/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23805/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23805/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test DRNTest had ERRORS
---> test TestFWCoreServicesDriver had ERRORS
---> test testFWCoreUtilities had ERRORS

RelVals

4.53

----- Begin Fatal Exception 10-Apr-2022 12:23:59 CEST-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 194533 lumi: 329 event: 462355458 stream: 0
   [1] Running path 'dqmofflineOnPAT_1_step'
   [2] Prefetching for module SingleTopTChannelLeptonDQM_miniAOD/'singleTopElectronMediumDQM_miniAOD'
   [3] Prefetching for module PATMuonSlimmer/'slimmedMuons'
   [4] Prefetching for module PATMuonSelector/'selectedPatMuons'
   [5] Prefetching for module PATMuonProducer/'patMuons'
   [6] Prefetching for module MuonProducer/'muons'
   [7] Prefetching for module PFProducer/'particleFlowTmp'
   [8] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [9] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [10] Prefetching for module PFConversionProducer/'pfConversions'
   [11] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

140.56

----- Begin Fatal Exception 10-Apr-2022 12:33:02 CEST-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 326479 lumi: 7 event: 1579493 stream: 0
   [1] Running path 'dqmoffline_8_step'
   [2] Prefetching for module SMPDQM/'SMPDQM'
   [3] Prefetching for module MuonProducer/'muons'
   [4] Prefetching for module PFProducer/'particleFlowTmp'
   [5] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [6] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [7] Prefetching for module PFConversionProducer/'pfConversions'
   [8] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

136.874

----- Begin Fatal Exception 10-Apr-2022 12:39:31 CEST-----------------------
An exception of category 'Vertex' occurred while
   [0] Processing  Event run: 319450 lumi: 76 event: 106007323 stream: 0
   [1] Running path 'dqmoffline_10_step'
   [2] Prefetching for module SMPDQM/'SMPDQM'
   [3] Prefetching for module MuonProducer/'muons'
   [4] Prefetching for module PFProducer/'particleFlowTmp'
   [5] Prefetching for module PFBlockProducer/'particleFlowBlock'
   [6] Prefetching for module PFElecTkProducer/'pfTrackElec'
   [7] Prefetching for module PFConversionProducer/'pfConversions'
   [8] Calling method for module ConversionProducer/'allConversions'
Exception Message:
Refitted track not found in list
----- End Fatal Exception -------------------------------------------------

cmsbuild · 2022-04-10T13:42:41Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23804/summary.html
COMMIT: 4134d39
CMSSW: CMSSW_12_4_X_2022-04-09-1100/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7774/23804/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@cms-sw Update cuDNN to v8.3.3.40 for CUDA 11.5 #7749

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23804/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23804/git-merge-result

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3593039
DQMHistoTests: Total failures: 7
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 3593009
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.004 KiB( 47 files compared)
DQMHistoSizes: changed ( 312.0 ): -0.004 KiB MessageLogger/Warnings
Checked 200 log files, 45 edm output root files, 48 DQM output files
TriggerResults: no differences found

smuzaffar · 2022-04-10T14:48:36Z

+externals

cmsbuild · 2022-04-10T14:48:53Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_12_4_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild · 2022-04-10T15:53:39Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23806/summary.html
COMMIT: 4134d39
CMSSW: CMSSW_12_4_X_2022-04-07-2300/slc7_ppc64le_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7774/23806/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23806/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f64187/23806/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test DRNTest had ERRORS
---> test testFWCoreUtilities had ERRORS

Fix py-tables issue for aarch64/ppc64le

4134d39

cmsbuild added externals-pending orp-pending pending-signatures tests-started labels Apr 10, 2022

cmsbuild added tests-approved and removed tests-started labels Apr 10, 2022

smuzaffar merged commit 93dada1 into IB/CMSSW_12_4_X/master Apr 10, 2022

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Apr 10, 2022

smuzaffar deleted the smuzaffar-patch-5 branch April 15, 2022 16:28

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix py-tables issue for aarch64/ppc64le#7774

Fix py-tables issue for aarch64/ppc64le#7774
smuzaffar merged 1 commit intoIB/CMSSW_12_4_X/masterfrom
smuzaffar-patch-5

smuzaffar commented Apr 10, 2022

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

smuzaffar commented Apr 10, 2022

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Unit Tests

RelVals

Uh oh!

cmsbuild commented Apr 10, 2022

Comparison Summary

Uh oh!

smuzaffar commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Uh oh!

cmsbuild commented Apr 10, 2022

Unit Tests

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants