Further cleaning of python2 packages

[davidlange6]

For DEVEL.
note - this removes the python dependencies of triton-interface-server - the comments suggest the python interface has been removed

[cmsbuild]

A new Pull Request was created by @davidlange6 (David Lange) for branch IB/CMSSW_12_0_X/devel.

@cmsbuild, @smuzaffar, @mrodozov, @iarspider can you please review it and eventually sign? Thanks.
cms-bot commands are listed here

[cmsbuild]

Pull request #7010 was updated.

[cmsbuild]

Pull request #7010 was updated.

[smuzaffar]

please test

[makortel]

note - this removes the python dependencies of triton-interface-server - the comments suggest the python interface has been removed

FYI @kpedro88

[kpedro88]

We're not currently setting up the Triton python client library, but those dependencies may be needed for other parts of the installation. I guess we'll see if it breaks in the test.

[smuzaffar]

while test are still running, let get it in DEVEL IB to run full tests

[cmsbuild]

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ed7e67/15875/summary.html
COMMIT: 396ccc1
CMSSW: CMSSW_12_0_DEVEL_X_2021-06-09-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• Oracle: update instantclient 19.11 #6986 @cms-sw: Oracle: update instantclient 19.11
• Bring the -mcpu=power8 flag #7002 @cms-sw: Bring the -mcpu=power8 flag
• Update pillow to 8.2.0 to fix the security issue reported by GH #7005 @cms-sw: Update pillow to 8.2.0 to fix the security issue reported by GH
• [DXR] Py3 updates needed to avoid creashes with multi-threading #7004 @cms-sw: [DXR] Py3 updates needed to avoid creashes with multi-threading
• [DXR] Added deps on py3-Pygments which is required at runtime by dxr #7007 @cms-sw: [DXR] Added deps on py3-Pygments which is required at runtime by dxr
• [BuildRules] Fix issue with generating rootmap files during PR tests #7006 @cms-sw: [BuildRules] Fix issue with generating rootmap files during PR tests

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ed7e67/15875/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ed7e67/15875/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test test_MpsWorkFlow had ERRORS
---> test testAlignmentOfflineValidation had ERRORS
---> test TestFWCorePythonFrameworkDriver had ERRORS
---> test import-backports_abc had ERRORS
and more ...

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 5161 differences found in the comparisons
• DQMHistoTests: Total files compared: 38
• DQMHistoTests: Total histograms compared: 2862520
• DQMHistoTests: Total failures: 12
• DQMHistoTests: Total nulls: 1
• DQMHistoTests: Total successes: 2862485
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.004 KiB( 37 files compared)
• DQMHistoSizes: changed ( 312.0 ): 0.004 KiB MessageLogger/Warnings
• Checked 160 log files, 37 edm output root files, 38 DQM output files
• TriggerResults: no differences found

[smuzaffar]

@davidlange6 , we need to slow down this migration :-) we need to fix cms-bot scripts to somehow switch python versions based on release. we have started dropping py2 packages which were needed by bot scripts e.g. psutils, yaml, requests.

[kpedro88]

While checking the test logs, I noticed something else that should probably be fixed for the python3 migration:

/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:155: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if not path is '':
/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:174: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if outputModule is not '':
/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:263: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if not path is '':
/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:276: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if outputModule is not '':
/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:414: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if outputModule is not '':
/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:530: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if outputModule is not '':
/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:742: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if outputModule is not '':

[davidlange6]

The issue has already been reported in an issue (its not a python3 issue just python3 is smart enough to report it)

…

On Jun 11, 2021, at 3:49 PM, Kevin Pedro ***@***.***> wrote: While checking the test logs, I noticed something else that should probably be fixed for the python3 migration: /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:155: SyntaxWarning: "is not" with a literal. Did you mean "!="? if not path is '': /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:174: SyntaxWarning: "is not" with a literal. Did you mean "!="? if outputModule is not '': /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:263: SyntaxWarning: "is not" with a literal. Did you mean "!="? if not path is '': /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:276: SyntaxWarning: "is not" with a literal. Did you mean "!="? if outputModule is not '': /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:414: SyntaxWarning: "is not" with a literal. Did you mean "!="? if outputModule is not '': /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:530: SyntaxWarning: "is not" with a literal. Did you mean "!="? if outputModule is not '': /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7010/15875/CMSSW_12_0_DEVEL_X_2021-06-09-2300/python/PhysicsTools/PatAlgos/tools/trigTools.py:742: SyntaxWarning: "is not" with a literal. Did you mean "!="? if outputModule is not '': — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.