Skip to content

Conversation

@smuzaffar
Copy link
Contributor

CentOS7 has OpenSSL 1.0.2 and python 3.12 SSL module requires OpenSSL 1.1.1. This causes xrootd python binding to fail with error [a]. This PR proposes to disable Xrootd python bindings for slc7

WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Processing ./bindings/python
  Installing build dependencies: started
  Installing build dependencies: finished with status 'error'
  error: subprocess-exited-with-error
  
  pip subprocess to install build dependencies did not run successfully.
   exit code: 1
   [11 lines of output]
      WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
      WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/setuptools/
      WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/setuptools/
      WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/setuptools/
      WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/setuptools/
      WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError("Can't connect to HTTPS URL because the SSL module is not available.")': /simple/setuptools/
      Could not fetch URL https://pypi.org/simple/setuptools/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/setuptools/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping
      ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 (from versions: none)
      ERROR: No matching distribution found for setuptools>=40.8.0
      WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
      Could not fetch URL https://pypi.org/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/pip/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @smuzaffar for branch IB/CMSSW_14_2_X/py312.

@aandvalenzuela, @cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 19, 2024

cms-bot internal usage

@smuzaffar
Copy link
Contributor Author

please test for el8_amd64_gcc12

@smuzaffar smuzaffar changed the title [xrootd] disable python binding for slc7 due to openssl version 1.0.2 [py312][xrootd] disable python binding for slc7 due to openssl version 1.0.2 Sep 19, 2024
@cmsbuild
Copy link
Contributor

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd70e4/41625/summary.html
COMMIT: b4f99c2
CMSSW: CMSSW_14_2_PY312_X_2024-09-18-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9416/41625/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation error when building:

File "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc12/external/py3-tensorflow/2.16.1-399c67eb1856dccaa37442a4b880ab87/lib/python3.12/site-packages/tensorflow/lite/python/authoring/authoring.py", line 43, in 
from tensorflow.lite.python import convert
File "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc12/external/py3-tensorflow/2.16.1-399c67eb1856dccaa37442a4b880ab87/lib/python3.12/site-packages/tensorflow/lite/python/convert.py", line 25, in 
import shutils
ModuleNotFoundError: No module named 'shutils'
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.AoC4zc (%build)


RPM build errors:
line 42: It's not recommended to have unversioned Obsoletes: Obsoletes: external+tfaot-model-test-simple+1.0.1-11a5d461eb4e3edb83239d47867a964f
Macro expanded in comment on line 393: %{aot_config}, pointing to the aot config file of the model to compile (required)


@smuzaffar
Copy link
Contributor Author

Please test for el8_amd64_gcc12

@smuzaffar smuzaffar merged commit 5e891c2 into IB/CMSSW_14_2_X/py312 Sep 19, 2024
@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd70e4/41651/summary.html
COMMIT: b4f99c2
CMSSW: CMSSW_14_2_PY312_X_2024-09-18-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9416/41651/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd70e4/41651/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-dd70e4/41651/git-merge-result

Unit Tests

I found 4 errors in the following unit tests:

---> test dxr-build had ERRORS
---> test import-histbook had ERRORS
---> test TestDQMOnlineClient-hcal_dqm_sourceclient had ERRORS
and more ...

Comparison Summary

Summary:

@smuzaffar smuzaffar deleted the xrd-disable-py-slc7 branch October 8, 2024 08:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants