Skip to content

Conversation

@VourMa
Copy link
Contributor

@VourMa VourMa commented Apr 16, 2025

This PR introduces the new configuration described in the title. The configuration looks like this:
image

The implementation utilizes already available procModifiers, and can be run with the procModifier sequence alpaka,singleIterPatatrack,trackingLST,seedingLST. Workflow 0.757 is being introduced to monitor this configuration.

It should be noted that this PR also updates the single iteration configuration to use Patatrack pixel tracks without triplets.

As part of the validation, the procModifiers mentioned above have been tested separately and in their "allowed" combinations, and seem to be giving expected results. In any case, it would be good to test the following, previously introduced workflows:

  • 0.75
  • 0.751
  • 0.753
  • 0.754
  • 0.755

Slides on this were presented at the HLT Upgrade meeting of April 22nd.

FYI @slava77

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 16, 2025

cms-bot internal usage

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47891/44536

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @VourMa for master.

It involves the following packages:

  • Configuration/PyReleaseValidation (upgrade, pdmv)
  • HLTrigger/Configuration (hlt)

@AdrianoDee, @Martin-Grunewald, @Moanwar, @cmsbuild, @DickyChant, @miquork, @mmusich, @srimanob, @subirsarkar can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @SohamBhattacharya, @fabiocos, @makortel, @missirol, @mmusich, @rovere, @slomeo this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@mmusich
Copy link
Contributor

mmusich commented Apr 16, 2025

test parameters:

  • relvals_opt = --what upgrade
  • workflows = 29634.75, 29634.751, 29634.753, 29634.754, 29634.755, 29634.756
  • enable = hlt_p2_integration, hlt_p2_timing

@mmusich
Copy link
Contributor

mmusich commented Apr 16, 2025

please test

@cmsbuild
Copy link
Contributor

+1

Size: This PR adds an extra 72KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-587186/45594/summary.html
COMMIT: 20ef9bf
CMSSW: CMSSW_15_1_X_2025-04-16-1100/el8_amd64_gcc12
Additional Tests: HLT_P2_INTEGRATION,HLT_P2_TIMING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/47891/45594/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 10 differences found in the comparisons
  • DQMHistoTests: Total files compared: 50
  • DQMHistoTests: Total histograms compared: 3916361
  • DQMHistoTests: Total failures: 44
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3916297
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
  • Checked 215 log files, 184 edm output root files, 50 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor

mmusich commented Apr 17, 2025

A presentation at an HLT Upgrade meeting and at a TRK POG meeting will be arranged to discuss more details.

OK, let's wait for the presentation before the review.

OriginTransverseErrorMultiplier = cms.double(1),
MinOneOverPtError = cms.double(1),
magneticField = cms.string(''),
TTRHBuilder = cms.string('WithTrackAngle'),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just a curiosity.
Can one use here hltESPTTRHBuilderWithTrackAngle instead?
I think we have a proliferation of ESProducers doing the same thing in the menu.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, should be possible (my oversight not using the proper HLT one). Let me do it in one go after the presentation, together with any potential feedback I get there.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should be fixed in 1281d72.

@mmusich
Copy link
Contributor

mmusich commented Apr 24, 2025

test parameters:

  • relvals_opt = --what upgrade
  • workflows = 29634.75, 29634.751, 29634.753, 29634.754, 29634.755, 29634.756, 29634.757
  • enable = hlt_p2_integration, hlt_p2_timing

@mmusich
Copy link
Contributor

mmusich commented Apr 24, 2025

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Size: This PR adds an extra 68KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-587186/45700/summary.html
COMMIT: 1281d72
CMSSW: CMSSW_15_1_X_2025-04-24-1100/el8_amd64_gcc12
Additional Tests: HLT_P2_INTEGRATION,HLT_P2_TIMING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/47891/45700/install.sh to create a dev area with all the needed externals and cmssw changes.

  • DAS Queries: The DAS query tests failed, see the summary page for details.

  • HLT P2 Timing: chart

Comparison Summary

Summary:

  • You potentially removed 2 lines from the logs
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 55
  • DQMHistoTests: Total histograms compared: 3948478
  • DQMHistoTests: Total failures: 3222
  • DQMHistoTests: Total nulls: 10
  • DQMHistoTests: Total successes: 3945226
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 54 files compared)
  • Checked 230 log files, 194 edm output root files, 55 DQM output files
  • TriggerResults: found differences in 2 / 53 workflows

@mmusich
Copy link
Contributor

mmusich commented Apr 25, 2025

There are differences in:

In general tracking efficiency w.r.t. TPs goes down. Is this understood?

@VourMa
Copy link
Contributor Author

VourMa commented Apr 25, 2025

There are differences in:

In general tracking efficiency w.r.t. TPs goes down. Is this understood?

This should be a purely technical PR for those configurations, so I can check again whether something is changed by mistake for them.

@VourMa
Copy link
Contributor Author

VourMa commented Apr 25, 2025

This should be a purely technical PR for those configurations, so I can check again whether something is changed by mistake for them.

Nevermind, a physics change is expected for those two workflows specifically from the fact that the single iteration configuration is now switched to use only 4-hit or longer tracks only (i.e. removing the triplets from the Patatrack seeds), as was advertized in the presented slides.

This can be seen from the number of layers with measurement for pixel tracks:
image
and also explains why the pixel efficiency is lower for pixel tracks but then the LST T5 efficiency goes up to compensate, leading to similar general tracks efficiency:
image

I think that we want to switch to configurations without Patatracks triplets, and the benefits/drawbacks of this change can be seen, for the configuration similar to .753, when comparing red vs. black in the presented slides. Personally, I think that this is the direction we want to move towards. That said, I will also let @rovere comment whether we want this change now.

_hltPhase2PixelTracksSoASingleIterPatatrack = hltPhase2PixelTracksSoA.clone( minHitsPerNtuplet = 3 )

from Configuration.ProcessModifiers.singleIterPatatrack_cff import singleIterPatatrack
singleIterPatatrack.toReplaceWith(hltPhase2PixelTracksSoA, _hltPhase2PixelTracksSoASingleIterPatatrack)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for future record, this is responsible of the changes discussed at #47891 (comment)

@mmusich
Copy link
Contributor

mmusich commented Apr 25, 2025

Personally, I think that this is the direction we want to move towards.

this is indeed the direction that I think we agreed we should take (together with the OT extension of the CA algorithm for pixel tracks). Thanks for clarifying this is proposed already in this PR.

@mmusich
Copy link
Contributor

mmusich commented Apr 25, 2025

+hlt

@Moanwar
Copy link
Contributor

Moanwar commented Apr 25, 2025

+Upgrade

@VourMa
Copy link
Contributor Author

VourMa commented Apr 28, 2025

@cms-sw/pdmv-l2 Is there anything from your side that you would like me to follow up on this PR? Thank you in advance!

@AdrianoDee
Copy link
Contributor

+pdmv

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @mandrenguyen, @rappoccio, @sextonkennedy, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit faf816f into cms-sw:master Apr 30, 2025
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants