Update the PbPb skims for 2024 data taking #46447

flodamas · 2024-10-18T18:21:27Z

PR description:

Update of the configuration of the PbPb skims in view of the 2024 HI run. The ZMM skim is replaced by the ZMu skimming code to avoid duplicates such that a unique skimmed dataset can be used for both Z boson physics analyses and muon tag-and-probe.

PR validation:

Unit tests passed successfully.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

To be backported to 14_1_X for the HI run.

cmsbuild · 2024-10-18T18:21:50Z

@flodamas, CMSSW_14_2_X branch is closed for direct updates. cms-bot is going to move this PR to master branch.
In future, please use cmssw master branch to submit your changes.

cmsbuild · 2024-10-18T18:22:08Z

cms-bot internal usage

cmsbuild · 2024-10-18T18:24:29Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46447/42307

There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/Skimming/python/autoSkim.py modified in PR(s): Add UPC monopole skim for 2024 PbPb #46434

cmsbuild · 2024-10-18T18:24:52Z

A new Pull Request was created by @flodamas for master.

It involves the following packages:

Configuration/Skimming (pdmv)

@AdrianoDee, @cmsbuild, @kskovpen, @miquork, @sunilUIET can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @missirol, @youyingli this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

mandrenguyen · 2024-10-20T09:19:31Z

please test

cmsbuild · 2024-10-20T14:37:01Z

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-799846/42313/summary.html
COMMIT: 7ded028
CMSSW: CMSSW_14_2_X_2024-10-20-0000/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46447/42313/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 2 lines to the logs
Reco comparison results: 9 differences found in the comparisons
DQMHistoTests: Total files compared: 46
DQMHistoTests: Total histograms compared: 3566331
DQMHistoTests: Total failures: 453
DQMHistoTests: Total nulls: 2
DQMHistoTests: Total successes: 3565856
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.02 KiB( 45 files compared)
DQMHistoSizes: changed ( 140.56 ): -0.012 KiB MessageLogger/Errors
DQMHistoSizes: changed ( 140.56 ): -0.008 KiB MessageLogger/Warnings
Checked 201 log files, 171 edm output root files, 46 DQM output files
TriggerResults: no differences found

youyingli · 2024-10-24T15:16:32Z

Hi, I would like to make sure if the update is also available to ReReco 2023 Heavy ion data even in the future.

mandrenguyen · 2024-10-24T15:33:02Z

Hi, I would like to make sure if the update is also available to ReReco 2023 Heavy ion data even in the future.

Hi @youyingli I'm not sure I understand the comment. These are prompt skims, we would not run them in a reprocessing.

youyingli · 2024-10-24T15:43:13Z

Hi, I would like to make sure if the update is also available to ReReco 2023 Heavy ion data even in the future.

Hi @youyingli I'm not sure I understand the comment. These are prompt skims, we would not run them in a reprocessing.

OK, thanks. Just make sure if these skims will also join 2023 Heavy ion data reprocessing in the future. Now I understand.

@cms-sw/pdmv-l2, could you please sign it?

… Run 3

cmsbuild · 2024-10-30T21:24:05Z

This pull request is fully signed and it will be integrated in one of the next master IBs (test failures were overridden). This pull request will now be reviewed by the release team before it's merged. @rappoccio, @mandrenguyen, @sextonkennedy, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

AdrianoDee · 2024-10-30T21:24:21Z

(signed anyway, will sign again after the conflicts are solved)

cmsbuild · 2024-10-31T15:23:38Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46447/42457

cmsbuild · 2024-10-31T15:23:58Z

Pull request #46447 was updated. @cmsbuild can you please check and sign again.

mandrenguyen · 2024-10-31T15:24:36Z

please test

cmsbuild · 2024-10-31T18:07:32Z

-1

Failed Tests: RelVals RelVals-INPUT
Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-799846/42514/summary.html
COMMIT: 1153f7c
CMSSW: CMSSW_14_2_X_2024-10-30-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-799846/42514/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-799846/42514/git-merge-result

RelVals

140.023

----- Begin Fatal Exception 31-Oct-2024 17:50:37 CET-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step3_RAW2DIGI_L1Reco_RECO_PAT_NANO_DQM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file PhysicsTools/NanoAOD/data/el_BDTG_2022.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/external/el8_amd64_gcc12/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/external/el8_amd64_gcc12/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/140.023_RunZeroBias2022B


At:
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Types.py(1001): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Mixins.py(397): insertContentsInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Mixins.py(532): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Modules.py(161): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Config.py(1217): _insertManyInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Config.py(1490): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

140.043

----- Begin Fatal Exception 31-Oct-2024 17:50:40 CET-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step3_RAW2DIGI_L1Reco_RECO_PAT_NANO_DQM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file PhysicsTools/NanoAOD/data/el_BDTG_2022.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/external/el8_amd64_gcc12/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/external/el8_amd64_gcc12/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/140.043_RunZeroBias2022C


At:
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Types.py(1001): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Mixins.py(397): insertContentsInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Mixins.py(532): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Modules.py(161): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Config.py(1217): _insertManyInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Config.py(1490): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

140.063

----- Begin Fatal Exception 31-Oct-2024 17:50:46 CET-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step3_RAW2DIGI_L1Reco_RECO_PAT_NANO_DQM.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file PhysicsTools/NanoAOD/data/el_BDTG_2022.weights.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46447/42514/CMSSW_14_2_X_2024-10-30-2300/external/el8_amd64_gcc12/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/external/el8_amd64_gcc12/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/140.063_RunZeroBias2022D


At:
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Types.py(1001): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Mixins.py(397): insertContentsInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Mixins.py(532): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Modules.py(161): insertInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Config.py(1217): _insertManyInto
  /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02861/el8_amd64_gcc12/cms/cmssw/CMSSW_14_2_X_2024-10-30-2300/src/FWCore/ParameterSet/python/Config.py(1490): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

RelVals-INPUT

2500.0022500.002_NANOmc106Xul17v2/step2_NANOmc106Xul17v2.log
2500.0012500.001_NANOmc106Xul16v2/step2_NANOmc106Xul16v2.log
2500.0032500.003_NANOmc106Xul18v2/step2_NANOmc106Xul18v2.log

Expand to see more relval errors ...

mandrenguyen · 2024-10-31T20:47:43Z

ignore tests-rejected with ib-failure
errors clearly unrelated to this PR

mandrenguyen · 2024-10-31T20:48:23Z

+1

Update the PbPb skims for 2024 data taking

7ded028

cmsbuild changed the base branch from CMSSW_14_2_X to master October 18, 2024 18:21

cmsbuild added this to the CMSSW_14_2_X milestone Oct 18, 2024

cmsbuild added pending-signatures tests-pending orp-pending pdmv-pending code-checks-pending labels Oct 18, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Oct 18, 2024

cmsbuild added tests-started and removed tests-pending labels Oct 20, 2024

cmsbuild added tests-approved and removed tests-started labels Oct 20, 2024

flodamas mentioned this pull request Oct 21, 2024

[14_1_X] Update the PbPb skims for 2024 data taking #46458

Merged

cmsbuild mentioned this pull request Oct 23, 2024

Add UPC monopole skim for 2024 PbPb #46434

Merged

youyingli mentioned this pull request Oct 25, 2024

Add PbPbHighPtJets skim for 2024 PbPb #46499

Merged

filter on L2 or L3 SingleMu triggers for easier skim maintenance over…

575b2cb

… Run 3

cmsbuild added tests-pending and removed tests-approved code-checks-approved labels Oct 25, 2024

cmsbuild added fully-signed pdmv-approved and removed pdmv-pending labels Oct 30, 2024

Merge branch 'master' into PbPbSkims2024_142X

1153f7c

cmsbuild added tests-pending code-checks-pending and removed tests-approved code-checks-approved tests-ib-failure labels Oct 31, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Oct 31, 2024

cmsbuild added tests-started and removed tests-pending labels Oct 31, 2024

cmsbuild added tests-rejected and removed tests-started labels Oct 31, 2024

cmsbuild added tests-approved tests-ib-failure and removed tests-rejected labels Oct 31, 2024

cmsbuild added orp-approved and removed orp-pending labels Oct 31, 2024

cmsbuild merged commit e5f980b into cms-sw:master Oct 31, 2024
9 of 11 checks passed

flodamas deleted the PbPbSkims2024_142X branch November 2, 2024 20:47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update the PbPb skims for 2024 data taking #46447

Update the PbPb skims for 2024 data taking #46447

flodamas commented Oct 18, 2024

cmsbuild commented Oct 18, 2024

cmsbuild commented Oct 18, 2024 •

edited

Loading

cmsbuild commented Oct 18, 2024

cmsbuild commented Oct 18, 2024

mandrenguyen commented Oct 20, 2024

cmsbuild commented Oct 20, 2024

youyingli commented Oct 24, 2024

mandrenguyen commented Oct 24, 2024

youyingli commented Oct 24, 2024

cmsbuild commented Oct 30, 2024

AdrianoDee commented Oct 30, 2024

cmsbuild commented Oct 31, 2024

cmsbuild commented Oct 31, 2024

mandrenguyen commented Oct 31, 2024

cmsbuild commented Oct 31, 2024

mandrenguyen commented Oct 31, 2024

mandrenguyen commented Oct 31, 2024

Update the PbPb skims for 2024 data taking #46447

Update the PbPb skims for 2024 data taking #46447

Conversation

flodamas commented Oct 18, 2024

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

cmsbuild commented Oct 18, 2024

cmsbuild commented Oct 18, 2024 • edited Loading

cmsbuild commented Oct 18, 2024

cmsbuild commented Oct 18, 2024

mandrenguyen commented Oct 20, 2024

cmsbuild commented Oct 20, 2024

Comparison Summary

youyingli commented Oct 24, 2024

mandrenguyen commented Oct 24, 2024

youyingli commented Oct 24, 2024

cmsbuild commented Oct 30, 2024

AdrianoDee commented Oct 30, 2024

cmsbuild commented Oct 31, 2024

cmsbuild commented Oct 31, 2024

mandrenguyen commented Oct 31, 2024

cmsbuild commented Oct 31, 2024

RelVals

RelVals-INPUT

mandrenguyen commented Oct 31, 2024

mandrenguyen commented Oct 31, 2024

cmsbuild commented Oct 18, 2024 •

edited

Loading