Update Run3 CSC conditions in 2022, 2023, 2024 realistic MC GTs and offline data GT #43900

saumyaphor4252 · 2024-02-07T17:33:50Z

PR description:

This PR updates the Run3 CSC conditions in the following GTs:

2022, 2023, 2024 realistic MC GTs
Run3 offline data GT for future ReReco

requested in [1] and [2] respectively. More details and internal validations can be found in [3]. The tag updates are as follows:

For MC GTs:

Rcd	Label	Tag
CSCDBGainsRcd	-	CSCDBGains_Dec_2023_v1
CSCDBPedestalsRcd	-	CSCDBPedestals_Dec_2023_v1
CSCDBCrosstalkRcd	-	CSCDBCrosstalk_Dec_2023_v1

For Run3 Offline Data GT :

Rcd	Label	Tag
CSCDBGainsRcd	-	CSCDBGains_v3_offline
CSCDBPedestalsRcd	-	CSCDBPedestals_v3_offline
CSCDBCrosstalkRcd	-	CSCDBCrosstalk_v4_offline

the new conditions are effective from Run 347687 (2022-02-15)

[1] https://cms-talk.web.cern.ch/t/mc-gt-update-csc-conditions-for-run3-mc-gts/33583
[2] https://cms-talk.web.cern.ch/t/full-track-validation-hlt-express-prompt-offline-csc-run3-condition-updates-for-2024-data-taking/33776
[3] https://indico.cern.ch/event/1358549/#9-csc-conditions-update-for-20

GT Differences with the last ones are here:

Run3 data Offline:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_dataRun3_v1/140X_dataRun3_v3
Phase1 2022 realistic:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2022_realistic_v1/140X_mcRun3_2022_realistic_v3
Phase1 2022 realistic postEE:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2022_realistic_postEE_v1/140X_mcRun3_2022_realistic_postEE_v3
Phase1 2022 cosmics realistic:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2022cosmics_realistic_deco_v1/140X_mcRun3_2022cosmics_realistic_deco_v3
Phase1 2022 realistic hi:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2022_realistic_HI_v1/140X_mcRun3_2022_realistic_HI_v3
Phase1 2023 realistic:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2023_realistic_v1/140X_mcRun3_2023_realistic_v3
Phase1 2023 realistic postBPix:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2023_realistic_postBPix_v1/140X_mcRun3_2023_realistic_postBPix_v3
Phase1 2023 cosmics reaslistic:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2023cosmics_realistic_deco_v1/140X_mcRun3_2023cosmics_realistic_deco_v3
Phase1 2023 cosmics reaslistic postBPix:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2023cosmics_realistic_postBPix_deco_v1/140X_mcRun3_2023cosmics_realistic_postBPix_deco_v3
Phase1 2023 realistic hi:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2023_realistic_HI_v1/140X_mcRun3_2023_realistic_HI_v3
Phase1 2024 realistic:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2024_realistic_v1/140X_mcRun3_2024_realistic_v3
Phase1 2024 cosmics realistic:
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/140X_mcRun3_2024cosmics_realistic_deco_v1/140X_mcRun3_2024cosmics_realistic_deco_v3

PR validation:

Tested successfully with

runTheMatrix.py -l 7.23,141.001,141.044,140.022,140.069,159.1,160.1,312.0,12834.0, -j 8 --ibeos
runTheMatrix.py -l 12401.0,12404.0,12412.0,12423.0,12425.0,12430.0,12431.0,12444.0,12447.0,12450.0,12504.0,12634.586,12650.0,12737.0, --what upgrade -j 8 --ibeos

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Not a backport. But backport will be followed up for 140X (considering the Full 2022+2023 ReReco campaign)

cmsbuild · 2024-02-07T17:34:14Z

cms-bot internal usage

cmsbuild · 2024-02-07T17:40:05Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-43900/38750

This PR adds an extra 12KB to repository

cmsbuild · 2024-02-07T17:40:25Z

A new Pull Request was created by @saumyaphor4252 (Saumya Phor) for master.

It involves the following packages:

Configuration/AlCa (alca)

@consuegs, @perrotta, @cmsbuild, @saumyaphor4252 can you please review it and eventually sign? Thanks.
@missirol, @Martin-Grunewald, @fabiocos, @rsreds, @tocheng, @mmusich, @yuanchao this is something you requested to watch as well.
@antoniovilela, @sextonkennedy, @rappoccio you are the release manager for this.

cms-bot commands are listed here

saumyaphor4252 · 2024-02-07T17:51:36Z

test parameters:

workflows = 140.022,140.069,159.1,160.1,312.0,12834.0,12401.0,12404.0,12412.0,12423.0,12425.0,12430.0,12431.0,12444.0,12447.0,12450.0,12504.0,12634.586,12650.0,12737.0
relvals_opt = --what upgrade,standard

saumyaphor4252 · 2024-02-07T17:52:14Z

@cmsbuild please test

cmsbuild · 2024-02-07T19:34:10Z

-1

Failed Tests: RelVals RelVals-INPUT AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-854324/37286/summary.html
COMMIT: b5c20f8
CMSSW: CMSSW_14_1_X_2024-02-07-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/43900/37286/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

RelVals

ValueError: Undefined workflows: 312.0

12634.0

----- Begin Fatal Exception 07-Feb-2024 19:46:21 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 0
   [1] Running path 'HLTAnalyzerEndpath'
   [2] Prefetching for module L1TRawToDigi/'hltGtStage2Digis'
   [3] Prefetching for module RawDataCollectorByLabel/'rawDataCollector'
   [4] Prefetching for module CSCDigiToRawModule/'cscpacker'
   [5] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      14.5542           0           0           0           0           0           0           0
             0     14.5542           0           0           0           0           0           0
             0           0      13.839      11.933      11.208           0           0           0
             0           0      11.933      13.942       11.93      11.288           0           0
             0           0      11.208       11.93       13.91      11.968      11.331           0
             0           0           0      11.288      11.968      13.985      12.084           0
             0           0           0           0      11.331      12.084      14.062           0
             0           0           0           0           0           0           0     14.5542 ]
----- End Fatal Exception -------------------------------------------------

14234.0

----- Begin Fatal Exception 07-Feb-2024 19:49:55 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 8 stream: 0
   [1] Running path 'dqmofflineOnPAT_1_step'
   [2] Prefetching for module SingleTopTChannelLeptonDQM_miniAOD/'singleTopElectronMediumDQM_miniAOD'
   [3] Prefetching for module PATMuonSlimmer/'slimmedMuons'
   [4] Prefetching for module PATMuonSelector/'selectedPatMuons'
   [5] Prefetching for module PATMuonProducer/'patMuons'
   [6] Prefetching for module MuonProducer/'muons'
   [7] Prefetching for module MuonIdProducer/'muons1stStep'
   [8] Prefetching for module CSCSegmentProducer/'cscSegments'
   [9] Prefetching for module CSCRecHitDProducer/'csc2DRecHits'
   [10] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      3.18266           0           0           0           0           0           0           0
             0     3.18266           0           0           0           0           0           0
             0           0       0.667       0.333           0           0           0           0
             0           0       0.333       0.222       -0.11       0.111           0           0
             0           0           0       -0.11       0.222       0.111      -0.332           0
             0           0           0       0.111       0.111       0.222           0           0
             0           0           0           0      -0.332           0       0.667           0
             0           0           0           0           0           0           0     3.18266 ]
----- End Fatal Exception -------------------------------------------------

RelVals-INPUT

11846.1911846.19_ZEE_14+2021PU_ecalDeepSC/step2_ZEE_14+2021PU_ecalDeepSC.log
11846.011846.0_ZEE_14+2021PU/step2_ZEE_14+2021PU.log
13034.013034.0_TTbar_14TeV+2024PU/step2_TTbar_14TeV+2024PU.log

Expand to see more relval errors ...

AddOn Tests

hlt_mc_GRun

----- Begin Fatal Exception 07-Feb-2024 19:24:31 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Prefetching for module L1TMuonOverlapPhase1TrackProducer/'simOmtfDigis'
   [6] Prefetching for module CSCTriggerPrimitivesProducer/'simCscTriggerPrimitiveDigis'
   [7] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      1.60782           0           0           0           0           0           0           0
             0     1.60782           0           0           0           0           0           0
             0           0       0.688       0.188      -0.499           0           0           0
             0           0       0.188       0.188           0       0.313           0           0
             0           0      -0.499           0         0.5      -0.499      -0.499           0
             0           0           0       0.313      -0.499       1.188      -0.249           0
             0           0           0           0      -0.499      -0.249         1.5           0
             0           0           0           0           0           0           0     1.60782 ]
----- End Fatal Exception -------------------------------------------------

hlt_mc_HIon

----- Begin Fatal Exception 07-Feb-2024 19:23:52 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Prefetching for module L1TMuonOverlapPhase1TrackProducer/'simOmtfDigis'
   [6] Prefetching for module CSCTriggerPrimitivesProducer/'simCscTriggerPrimitiveDigis'
   [7] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      1.60782           0           0           0           0           0           0           0
             0     1.60782           0           0           0           0           0           0
             0           0       0.688       0.188      -0.499           0           0           0
             0           0       0.188       0.188           0       0.313           0           0
             0           0      -0.499           0         0.5      -0.499      -0.499           0
             0           0           0       0.313      -0.499       1.188      -0.249           0
             0           0           0           0      -0.499      -0.249         1.5           0
             0           0           0           0           0           0           0     1.60782 ]
----- End Fatal Exception -------------------------------------------------

hlt_mc_PIon

----- Begin Fatal Exception 07-Feb-2024 19:24:31 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Prefetching for module L1TMuonOverlapPhase1TrackProducer/'simOmtfDigis'
   [6] Prefetching for module CSCTriggerPrimitivesProducer/'simCscTriggerPrimitiveDigis'
   [7] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      1.60782           0           0           0           0           0           0           0
             0     1.60782           0           0           0           0           0           0
             0           0       0.688       0.188      -0.499           0           0           0
             0           0       0.188       0.188           0       0.313           0           0
             0           0      -0.499           0         0.5      -0.499      -0.499           0
             0           0           0       0.313      -0.499       1.188      -0.249           0
             0           0           0           0      -0.499      -0.249         1.5           0
             0           0           0           0           0           0           0     1.60782 ]
----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

saumyaphor4252 · 2024-02-08T05:57:13Z

test parameters:

workflows = 140.022,140.069,159.1,160.1,312.0,12834.0,12401.0,12404.0,12412.0,12423.0,12425.0,12430.0,12431.0,12444.0,12447.0,12450.0,12504.0,12634.586,12650.0,12737.0
relvals_opt = --what upgrade,standard,pileup

saumyaphor4252 · 2024-02-08T07:00:58Z

ValueError: Undefined workflows: 312.0

#43900 (comment) should fix it. (Tested locally with runTheMatrix.py -nel 312.0 --what upgrade,standard,pileup)

12634.0
14234.0

I am unable to reproduce the issue locally with runTheMatrix.py -l 12634.0,14234.0 --what upgrade,standard,pileup -j 10 --ibeos.

Let's test again with the updated test parameters to see if the errors still show-up.

saumyaphor4252 · 2024-02-08T07:01:33Z

please test

perrotta · 2024-02-08T07:48:36Z

I am unable to reproduce the issue locally with runTheMatrix.py -l 12634.0,14234.0 --what upgrade,standard,pileup -j 10 --ibeos.

I rerun the two workflow with the same architecture as in the PR tests (el8_amd64_gcc12) and the error does reproduce: it happens in a few events only, and different architectures may not hit it in the 10 events tested in the wfs.

So definitely there is a problem with the MC payloads.
@cms-sw/csc-dpg-l2 this is something to be investigated

cmsbuild · 2024-02-08T15:11:03Z

-1

Failed Tests: RelVals RelVals-INPUT AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-854324/37294/summary.html
COMMIT: b5c20f8
CMSSW: CMSSW_14_1_X_2024-02-07-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/43900/37294/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

RelVals

12634.0

----- Begin Fatal Exception 08-Feb-2024 10:54:06 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 0
   [1] Running path 'HLTAnalyzerEndpath'
   [2] Prefetching for module L1TRawToDigi/'hltGtStage2Digis'
   [3] Prefetching for module RawDataCollectorByLabel/'rawDataCollector'
   [4] Prefetching for module CSCDigiToRawModule/'cscpacker'
   [5] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      14.5542           0           0           0           0           0           0           0
             0     14.5542           0           0           0           0           0           0
             0           0      13.839      11.933      11.208           0           0           0
             0           0      11.933      13.942       11.93      11.288           0           0
             0           0      11.208       11.93       13.91      11.968      11.331           0
             0           0           0      11.288      11.968      13.985      12.084           0
             0           0           0           0      11.331      12.084      14.062           0
             0           0           0           0           0           0           0     14.5542 ]
----- End Fatal Exception -------------------------------------------------

14234.0

----- Begin Fatal Exception 08-Feb-2024 10:57:35 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 8 stream: 0
   [1] Running path 'dqmofflineOnPAT_1_step'
   [2] Prefetching for module SingleTopTChannelLeptonDQM_miniAOD/'singleTopElectronMediumDQM_miniAOD'
   [3] Prefetching for module PATMuonSlimmer/'slimmedMuons'
   [4] Prefetching for module PATMuonSelector/'selectedPatMuons'
   [5] Prefetching for module PATMuonProducer/'patMuons'
   [6] Prefetching for module MuonProducer/'muons'
   [7] Prefetching for module MuonIdProducer/'muons1stStep'
   [8] Prefetching for module CSCSegmentProducer/'cscSegments'
   [9] Prefetching for module CSCRecHitDProducer/'csc2DRecHits'
   [10] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      3.18266           0           0           0           0           0           0           0
             0     3.18266           0           0           0           0           0           0
             0           0       0.667       0.333           0           0           0           0
             0           0       0.333       0.222       -0.11       0.111           0           0
             0           0           0       -0.11       0.222       0.111      -0.332           0
             0           0           0       0.111       0.111       0.222           0           0
             0           0           0           0      -0.332           0       0.667           0
             0           0           0           0           0           0           0     3.18266 ]
----- End Fatal Exception -------------------------------------------------

160.1

----- Begin Fatal Exception 08-Feb-2024 11:30:19 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 9 stream: 0
   [1] Running path 'HLTAnalyzerEndpath'
   [2] Prefetching for module L1TRawToDigi/'hltGtStage2Digis'
   [3] Prefetching for module RawDataCollectorByLabel/'rawDataCollector'
   [4] Prefetching for module CSCDigiToRawModule/'cscpacker'
   [5] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      1.33865           0           0           0           0           0           0           0
             0     1.33865           0           0           0           0           0           0
             0           0       1.179        0.77       0.706           0           0           0
             0           0        0.77       1.177       0.772       0.702           0           0
             0           0       0.706       0.772       1.166       0.764       0.717           0
             0           0           0       0.702       0.764       1.163       0.762           0
             0           0           0           0       0.717       0.762       1.175           0
             0           0           0           0           0           0           0     1.33865 ]
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

RelVals-INPUT

11846.1911846.19_ZEE_14+2021PU_ecalDeepSC/step2_ZEE_14+2021PU_ecalDeepSC.log
11846.011846.0_ZEE_14+2021PU/step2_ZEE_14+2021PU.log
13034.013034.0_TTbar_14TeV+2024PU/step2_TTbar_14TeV+2024PU.log

Expand to see more relval errors ...

AddOn Tests

hlt_mc_GRun

----- Begin Fatal Exception 08-Feb-2024 10:30:32 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Prefetching for module L1TMuonOverlapPhase1TrackProducer/'simOmtfDigis'
   [6] Prefetching for module CSCTriggerPrimitivesProducer/'simCscTriggerPrimitiveDigis'
   [7] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      1.60782           0           0           0           0           0           0           0
             0     1.60782           0           0           0           0           0           0
             0           0       0.688       0.188      -0.499           0           0           0
             0           0       0.188       0.188           0       0.313           0           0
             0           0      -0.499           0         0.5      -0.499      -0.499           0
             0           0           0       0.313      -0.499       1.188      -0.249           0
             0           0           0           0      -0.499      -0.249         1.5           0
             0           0           0           0           0           0           0     1.60782 ]
----- End Fatal Exception -------------------------------------------------

hlt_mc_HIon

----- Begin Fatal Exception 08-Feb-2024 10:29:43 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Prefetching for module L1TMuonOverlapPhase1TrackProducer/'simOmtfDigis'
   [6] Prefetching for module CSCTriggerPrimitivesProducer/'simCscTriggerPrimitiveDigis'
   [7] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      1.60782           0           0           0           0           0           0           0
             0     1.60782           0           0           0           0           0           0
             0           0       0.688       0.188      -0.499           0           0           0
             0           0       0.188       0.188           0       0.313           0           0
             0           0      -0.499           0         0.5      -0.499      -0.499           0
             0           0           0       0.313      -0.499       1.188      -0.249           0
             0           0           0           0      -0.499      -0.249         1.5           0
             0           0           0           0           0           0           0     1.60782 ]
----- End Fatal Exception -------------------------------------------------

hlt_mc_PIon

----- Begin Fatal Exception 08-Feb-2024 10:30:25 CET-----------------------
An exception of category 'CorrelatedNoisifier' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 5 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Prefetching for module L1TMuonOverlapPhase1TrackProducer/'simOmtfDigis'
   [6] Prefetching for module CSCTriggerPrimitivesProducer/'simCscTriggerPrimitiveDigis'
   [7] Calling method for module CSCDigiProducer/'simMuonCSCDigis'
Exception Message:
Bad covariance matrix. [      1.60782           0           0           0           0           0           0           0
             0     1.60782           0           0           0           0           0           0
             0           0       0.688       0.188      -0.499           0           0           0
             0           0       0.188       0.188           0       0.313           0           0
             0           0      -0.499           0         0.5      -0.499      -0.499           0
             0           0           0       0.313      -0.499       1.188      -0.249           0
             0           0           0           0      -0.499      -0.249         1.5           0
             0           0           0           0           0           0           0     1.60782 ]
----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

ptcox · 2024-02-08T15:43:54Z

It's clear from the exception messages that there is something wrong with some of the NoiseMatrix conditions data. Israr is investigating and will have to produce new payloads. (These NoiseMatrix values are used only in simulation, and not in local reco, so the real data tests were unaffected.)

perrotta · 2024-02-08T15:56:02Z

(These NoiseMatrix values are used only in simulation, and not in local reco, so the real data tests were unaffected.)

Thank you Tim, and Israr!
This explains also why only MC workflows are affected, and why it wasn't catched by the Full Track Validation made on data

cmsbuild · 2024-02-13T02:01:44Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-43900/38818

This PR adds an extra 12KB to repository

cmsbuild · 2024-02-13T02:02:06Z

Pull request #43900 was updated. @perrotta, @cmsbuild, @consuegs, @saumyaphor4252 can you please check and sign again.

saumyaphor4252 · 2024-02-13T02:02:25Z

PR updated to revert the NoiseMatrix tag update in the GTs and proceed with the other 3 tags, following discussions in https://cms-talk.web.cern.ch/t/mc-gt-update-csc-conditions-for-run3-mc-gts/33583/10

saumyaphor4252 · 2024-02-13T02:02:33Z

please test

cmsbuild · 2024-02-13T11:13:44Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-854324/37397/summary.html
COMMIT: b33deac
CMSSW: CMSSW_14_1_X_2024-02-12-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/43900/37397/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

Comparison Summary

Summary:

You potentially removed 9 lines from the logs
Reco comparison results: 9937 differences found in the comparisons
DQMHistoTests: Total files compared: 67
DQMHistoTests: Total histograms compared: 5846987
DQMHistoTests: Total failures: 24410
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 5822554
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.016 KiB( 66 files compared)
DQMHistoSizes: changed ( 140.069 ): -0.016 KiB JetMET/SUSYDQM
Checked 288 log files, 252 edm output root files, 67 DQM output files
TriggerResults: found differences in 9 / 65 workflows

perrotta · 2024-02-13T14:09:25Z

+1

Once the tag for the updated noise matris had been taken out, this PR succeeds also in MC tests, and it is therefore good to go

cmsbuild · 2024-02-13T14:09:48Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @antoniovilela, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

antoniovilela · 2024-02-14T11:59:27Z

+1

cmsbuild added this to the CMSSW_14_1_X milestone Feb 7, 2024

cmsbuild added alca-pending pending-signatures tests-pending orp-pending code-checks-pending labels Feb 7, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Feb 7, 2024

cmsbuild added tests-started and removed tests-pending labels Feb 7, 2024

saumyaphor4252 mentioned this pull request Feb 7, 2024

[14.0.X] Update Run3 CSC conditions in 2022, 2023, 2024 realistic MC GTs and offline data GT #43901

Merged

cmsbuild added tests-rejected and removed tests-started labels Feb 7, 2024

cmsbuild added tests-started and removed tests-rejected labels Feb 8, 2024

cmsbuild added tests-rejected and removed tests-started labels Feb 8, 2024

cmsbuild added tests-pending code-checks-pending and removed tests-rejected code-checks-approved labels Feb 13, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Feb 13, 2024

cmsbuild added tests-started and removed tests-pending labels Feb 13, 2024

cmsbuild added tests-approved and removed tests-started labels Feb 13, 2024

cmsbuild added alca-approved fully-signed and removed alca-pending pending-signatures labels Feb 13, 2024

cmsbuild added orp-approved and removed orp-pending labels Feb 14, 2024

cmsbuild merged commit 74821ae into cms-sw:master Feb 14, 2024
12 checks passed

saumyaphor4252 deleted the alca-Update_Run3_CSC_conditions branch November 1, 2024 12:53

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update Run3 CSC conditions in 2022, 2023, 2024 realistic MC GTs and offline data GT #43900

Update Run3 CSC conditions in 2022, 2023, 2024 realistic MC GTs and offline data GT #43900

saumyaphor4252 commented Feb 7, 2024 •

edited

Loading

cmsbuild commented Feb 7, 2024 •

edited

Loading

cmsbuild commented Feb 7, 2024

cmsbuild commented Feb 7, 2024

saumyaphor4252 commented Feb 7, 2024

saumyaphor4252 commented Feb 7, 2024

cmsbuild commented Feb 7, 2024

saumyaphor4252 commented Feb 8, 2024

saumyaphor4252 commented Feb 8, 2024 •

edited

Loading

saumyaphor4252 commented Feb 8, 2024

perrotta commented Feb 8, 2024 •

edited

Loading

cmsbuild commented Feb 8, 2024

ptcox commented Feb 8, 2024

perrotta commented Feb 8, 2024

cmsbuild commented Feb 13, 2024

cmsbuild commented Feb 13, 2024

saumyaphor4252 commented Feb 13, 2024

saumyaphor4252 commented Feb 13, 2024

cmsbuild commented Feb 13, 2024

perrotta commented Feb 13, 2024

cmsbuild commented Feb 13, 2024

antoniovilela commented Feb 14, 2024

Update Run3 CSC conditions in 2022, 2023, 2024 realistic MC GTs and offline data GT #43900

Update Run3 CSC conditions in 2022, 2023, 2024 realistic MC GTs and offline data GT #43900

Conversation

saumyaphor4252 commented Feb 7, 2024 • edited Loading

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

cmsbuild commented Feb 7, 2024 • edited Loading

cmsbuild commented Feb 7, 2024

cmsbuild commented Feb 7, 2024

saumyaphor4252 commented Feb 7, 2024

saumyaphor4252 commented Feb 7, 2024

cmsbuild commented Feb 7, 2024

RelVals

RelVals-INPUT

AddOn Tests

saumyaphor4252 commented Feb 8, 2024

saumyaphor4252 commented Feb 8, 2024 • edited Loading

saumyaphor4252 commented Feb 8, 2024

perrotta commented Feb 8, 2024 • edited Loading

cmsbuild commented Feb 8, 2024

RelVals

RelVals-INPUT

AddOn Tests

ptcox commented Feb 8, 2024

perrotta commented Feb 8, 2024

cmsbuild commented Feb 13, 2024

cmsbuild commented Feb 13, 2024

saumyaphor4252 commented Feb 13, 2024

saumyaphor4252 commented Feb 13, 2024

cmsbuild commented Feb 13, 2024

Comparison Summary

perrotta commented Feb 13, 2024

cmsbuild commented Feb 13, 2024

antoniovilela commented Feb 14, 2024

saumyaphor4252 commented Feb 7, 2024 •

edited

Loading

cmsbuild commented Feb 7, 2024 •

edited

Loading

saumyaphor4252 commented Feb 8, 2024 •

edited

Loading

perrotta commented Feb 8, 2024 •

edited

Loading