CMS - HI collision data recovery

[katilp]

To get the information necessary for the reprocessing of the deleted HI collision data:

Query for parent of:

/PPPhoton/Run2013A-PromptReco-v1/RECO 
/PPMuon/Run2013A-PromptReco-v1/RECO
/PPMinBias/Run2013A-PromptReco-v1/RECO 
/PPJet/Run2013A-PromptReco-v1/RECO 
/PPFSQ/Run2013A-PromptReco-v1/RECO 

/PAMuon/HIRun2013-PromptReco-v1/RECO 
/PAMinBiasUPC/HIRun2013-PromptReco-v1/RECO
/PAMinBias2/HIRun2013-PromptReco-v1/RECO
/PAMinBias1/HIRun2013-PromptReco-v1/RECO
/PAHighPt/HIRun2013-PromptReco-v1/RECO

(e.g. dasgoclient -query="parent dataset=/PAMuon/HIRun2013-PromptReco-v1/RECO")

Record also the runs

(e.g. dasgoclient -query="run dataset=/PAMuon/HIRun2013-PromptReco-v1/RECO")

Get RAW.

Query config for RAW

(e.g. dasgoclient --json -query="config dataset=/PAHighPt/HIRun2013-v1/RAW")

Find configs that in ids_map do not have "DQMConfigCacheID but ConfigCacheID

Find out the differences in configs

If no differences, get the request name of one of the entries.

(e.g. franzoni_pApartialSep28_538HIp2HI_130928_174454_4973)

O&C should be able to start the processing with the information available in ReqMgr

(e.g. https://cmsweb.cern.ch/reqmgr2/data/request?name=franzoni_pApartialSep28_538HIp2HI_130928_174454_4973)

Take note of the runs listed in RunWhitelist: of the ReqMgr query result. If it does not include all those that were queried from DAS above, make note of it when passing the information for reprocessing.

[danaalsharif]

dataset 1 /PPPhoton/Run2013A-PromptReco-v1/RECO
"name": "franzoni_2013APPPhoton_5323_141216_145600_1972"
Runs in DAS and RunWhitelist are different

dataset 2 /PPMuon/Run2013A-PromptReco-v1/RECO
"name": "franzoni_2013APPMuon_5323_141216_145629_8587"
Runs are different

dataset 3 /PPMinBias/Run2013A-PromptReco-v1/RECO
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/eeafcd4106404a9d2098eebe72613f4d/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/499e067670bb6ac99daa769cc79d31af/configFile"
config files are different diff1.txt

dataset 4 /PPJet/Run2013A-PromptReco-v1/RECO
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/499e067670bb6ac99daa769cc79d31af/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/49c6156c6123f0a36c05e2f13579ebb9/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/eeafcd4106404a9d2098eebe72613f4d/configFile"
config files are different
499e067670bb6ac99daa769cc79d31af and 49c6156c6123f0a36c05e2f13579ebb9 diff2.txt
49c6156c6123f0a36c05e2f13579ebb9 and eeafcd4106404a9d2098eebe72613f4d diff3.txt
499e067670bb6ac99daa769cc79d31af and eeafcd4106404a9d2098eebe72613f4d diff4.txt

dataset 5 /PPFSQ/Run2013A-PromptReco-v1/RECO
"name": "franzoni_2013APPFSQ_5323_141216_160648_650"
Runs are different

[ datasets 6-10 have the same list of ConfigCacheID ]
dataset 6 /PAMuon/HIRun2013-PromptReco-v1/RECO
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696d1d210/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696e95555/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/7ac4f766600ad16bec37888d7d17d9ba/configFile"
[config files 1 and 2 are the same, 3 is different]
6b593589db484e02ac97c00696d1d210 and 7ac4f766600ad16bec37888d7d17d9ba diff5.txt

dataset 7 /PAMinBiasUPC/HIRun2013-PromptReco-v1/RECO
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696e95555/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696d1d210/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/7ac4f766600ad16bec37888d7d17d9ba/configFile",

daatset 8 /PAMinBias2/HIRun2013-PromptReco-v1/RECO
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696e95555/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/7ac4f766600ad16bec37888d7d17d9ba/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696d1d210/configFile"

dataset 9 /PAMinBias1/HIRun2013-PromptReco-v1/RECO
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696d1d210/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/7ac4f766600ad16bec37888d7d17d9ba/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696e95555/configFile",

dataset 10 /PAHighPt/HIRun2013-PromptReco-v1/RECO
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696d1d210/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/6b593589db484e02ac97c00696e95555/configFile",
"https://cmsweb.cern.ch:8443/couchdb/reqmgr_config_cache/7ac4f766600ad16bec37888d7d17d9ba/configFile"

[katilp]

We consider only config files that have --eventcontent RECO in the command-line string at the beginning (and in consequence, a process.RECOoutput output block).

For 1-5 check if there are any configs with --eventcontent RECO

For 6-10, prepare a cvs with a reqmgr query name
(we need to specify that input datasets are different: add an input dataset column)

[danaalsharif]

datasets 6-10.csv.
Spreadsheet link.

[katilp]

@danaalsharif would you add the same comment in the comment field for all five datasets in the spreadsheet?