Skip to content

Conversation

@akritkbehera
Copy link
Contributor

No description provided.

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @akritkbehera for branch IB/CMSSW_16_0_X/g14.

@akritkbehera, @cmsbuild, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 15, 2025

cms-bot internal usage

@fwyzard
Copy link
Contributor

fwyzard commented Dec 15, 2025

Why do we need python to build OpenMPI ?

@akritkbehera
Copy link
Contributor Author

It's mentioned over here
4.3.1.1. Perl and Pythonhere that
Open MPI requires Perl 5 and Python >= 3.6 while building.
While building Open MPI locally I am seeing the following logs

make[4]: Entering directory '/home/akbehera/Desktop/CERN/sw/BUILD/el9_amd64_gcc14/external/openmpi/5.0.9-c03fed2f6dada3c7a2b8d56b917192ec/openmpi-5.0.9/3
rd-party/openpmix/src/include'
/usr/bin/python ../../contrib/construct_dictionary.py
Could not find platform independent libraries <prefix>
Could not find platform dependent libraries <exec_prefix>
Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]
Python path configuration:
  PYTHONHOME = (not set)
  PYTHONPATH = (not set)
  program name = '/usr/bin/python'
  isolated = 0
  environment = 1
  user site = 1
  import site = 1
  sys._base_executable = '/usr/bin/python'
  sys.base_prefix = '/data/cmsbld/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/e8140d4e2d056c19e6592107d9b23ea1/opt/cmssw/el9_amd64_gcc14/external/python3/3.9.14-e8140d4e2d056c19e6592107d9b23ea1'
  sys.base_exec_prefix = '/data/cmsbld/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/e8140d4e2d056c19e6592107d9b23ea1/opt/cmssw/el9_amd64_gcc14/external/python3/3.9.14-e8140d4e2d056c19e6592107d9b23ea1'
  sys.platlibdir = 'lib'
  sys.executable = '/usr/bin/python'
  sys.prefix = '/data/cmsbld/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/e8140d4e2d056c19e6592107d9b23ea1/opt/cmssw/el9_amd64_gcc14/external/python3/3.9.14-e8140d4e2d056c19e6592107d9b23ea1'
  sys.exec_prefix = '/data/cmsbld/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/e8140d4e2d056c19e6592107d9b23ea1/opt/cmssw/el9_amd64_gcc14/external/python3/3.9.14-e8140d4e2d056c19e6592107d9b23ea1'
  sys.path = [
    '/data/cmsbld/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/e8140d4e2d056c19e6592107d9b23ea1/opt/cmssw/el9_amd64_gcc14/external/python3/3.9.14-e8140d4e2d056c19e6592107d9b23ea1/lib/python39.zip',
    '/data/cmsbld/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/e8140d4e2d056c19e6592107d9b23ea1/opt/cmssw/el9_amd64_gcc14/external/python3/3.9.14-e8140d4e2d056c19e6592107d9b23ea1/lib/python3.9',
    '/data/cmsbld/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/e8140d4e2d056c19e6592107d9b23ea1/opt/cmssw/el9_amd64_gcc14/external/python3/3.9.14-e8140d4e2d056c19e6592107d9b23ea1/lib/lib-dynload',
  ]
Fatal Python error: init_fs_encoding: failed to get the Python codec of the filesystem encoding
Python runtime state: core initialized
ModuleNotFoundError: No module named 'encodings'

@akritkbehera akritkbehera force-pushed the Openmpi_python_encodings_missing branch from 62c83e1 to 6a4bd52 Compare December 15, 2025 13:28
@cmsbuild
Copy link
Contributor

Pull request #10253 was updated.

@akritkbehera
Copy link
Contributor Author

test parameters:

  • full_cmssw = true

@akritkbehera
Copy link
Contributor Author

please test for CMSSW_16_0_X/el9_amd64_gcc14

@fwyzard
Copy link
Contributor

fwyzard commented Dec 15, 2025

I see... OK, thanks.

@smuzaffar
Copy link
Contributor

+externals

This just makes sure that we use CMS distributed python while building OpenMPI. OpenMPI build system just used python to run few scripts. It is not used at runtime.

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_16_0_X/g14 IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @ftenchini, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

@smuzaffar
Copy link
Contributor

+externals

good to go in. This just fixes the proper use of our python

@smuzaffar smuzaffar merged commit 403973d into cms-sw:IB/CMSSW_16_0_X/g14 Dec 16, 2025
8 of 9 checks passed
@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-1f1482/49977/summary.html
COMMIT: 6a4bd52
CMSSW: CMSSW_16_0_X_2025-12-11-1100/el9_amd64_gcc14
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10253/49977/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-1f1482/49977/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-1f1482/49977/git-merge-result

Comparison Summary

Summary:

  • You potentially added 37 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 86748 differences found in the comparisons
  • Reco comparison had 4 failed jobs
  • DQMHistoTests: Total files compared: 53
  • DQMHistoTests: Total histograms compared: 4271963
  • DQMHistoTests: Total failures: 380911
  • DQMHistoTests: Total nulls: 442
  • DQMHistoTests: Total successes: 3890590
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 42699.280000000006 KiB( 52 files compared)
  • DQMHistoSizes: changed ( 10224.0,... ): 6.566 KiB Vertexing/PrimaryVertexV
  • DQMHistoSizes: changed ( 10224.0 ): 0.598 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 13034.0 ): 0.762 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 16834.0,... ): 5613.913 KiB HLT/Vertexing
  • DQMHistoSizes: changed ( 16834.0,... ): 0.004 KiB MessageLogger/Errors
  • DQMHistoSizes: changed ( 16834.0,... ): 0.004 KiB MessageLogger/Warnings
  • DQMHistoSizes: changed ( 17034.0 ): 3.862 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 18634.0 ): 0.498 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 2024.0040001 ): 0.043 KiB JetMET/SUSYDQM
  • DQMHistoSizes: changed ( 250202.181 ): 0.453 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 25202.0 ): ...
  • Checked 227 log files, 198 edm output root files, 53 DQM output files

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants