-
Notifications
You must be signed in to change notification settings - Fork 12
Crab submission in HZZ branch #31
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: HZZ_Analysis
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,17 @@ | ||
| <FrameworkJobReport> | ||
| <ReadBranches> | ||
| </ReadBranches> | ||
| <PerformanceReport> | ||
| <PerformanceSummary Metric="StorageStatistics"> | ||
| <Metric Name="Parameter-untracked-bool-enabled" Value="true"/> | ||
| <Metric Name="Parameter-untracked-bool-stats" Value="true"/> | ||
| <Metric Name="Parameter-untracked-string-cacheHint" Value="application-only"/> | ||
| <Metric Name="Parameter-untracked-string-readHint" Value="auto-detect"/> | ||
| <Metric Name="ROOT-tfile-read-totalMegabytes" Value="0"/> | ||
| <Metric Name="ROOT-tfile-write-totalMegabytes" Value="0"/> | ||
| </PerformanceSummary> | ||
| </PerformanceReport> | ||
|
|
||
| <GeneratorInfo> | ||
| </GeneratorInfo> | ||
| </FrameworkJobReport> |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,13 @@ | ||
| #this fake PSET is needed for local test and for crab to figure the output filename | ||
| #you do not need to edit it unless you want to do a local test using a different input file than | ||
| #the one marked below | ||
| import FWCore.ParameterSet.Config as cms | ||
| process = cms.Process('NANO') | ||
| process.source = cms.Source("PoolSource", fileNames = cms.untracked.vstring(), | ||
| # lumisToProcess=cms.untracked.VLuminosityBlockRange("254231:1-254231:24") | ||
| ) | ||
| process.source.fileNames = [ 'root://cms-xrd-global.cern.ch//store/mc/RunIISummer16NanoAOD/TTJets_TuneCUETP8M1_13TeV-madgraphMLM-pythia8/NANOAODSIM/PUMoriond17_05Feb2018_94X_mcRun2_asymptotic_v2-v1/40000/2CE738F9-C212-E811-BD0E-EC0D9A8222CE.root' ##you can change only this line | ||
| ] | ||
| process.maxEvents = cms.untracked.PSet(input = cms.untracked.int32(111)) | ||
| process.output = cms.OutputModule("PoolOutputModule", fileName = cms.untracked.string('tree.root')) | ||
| process.out = cms.EndPath(process.output) |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,31 @@ | ||
| from WMCore.Configuration import Configuration | ||
| from CRABClient.UserUtilities import config | ||
| config = Configuration() | ||
|
|
||
| config.section_("General") | ||
| config.General.requestName = 'nanoAOD_testing_2' | ||
| config.General.workArea = '/afs/cern.ch/user/y/yujil/crabtest/CMSSW_10_6_30/src/PhysicsTools/NanoAODTools/python/postprocessing/analysis/nanoAOD_skim/crab_projects_sendPythonFolderFalse' | ||
| #config.General.transferLogs=True | ||
| config.General.transferOutputs = True | ||
| config.section_("JobType") | ||
| config.JobType.pluginName = 'Analysis' | ||
| config.JobType.psetName = 'PSet.py' | ||
| config.JobType.scriptExe = 'crab_script.sh' | ||
| config.JobType.inputFiles = ['post_proc.py','../../../../scripts/haddnano.py','keep_and_drop.txt','FrameworkJobReport.xml'] #hadd nano will not be needed once nano tools are in cmssw | ||
| #config.JobType.sendPythonFolder = True | ||
| config.JobType.allowUndistributedCMSSW = True | ||
| config.section_("Data") | ||
| config.Data.inputDataset = '/WplusTo2JWminusTo2LJJ_EWK_LO_aQGC_MJJ100PTJ10_TuneCP5_13TeV-madgraph-pythia8/RunIIAutumn18NanoAODv5-Nano1June2019_102X_upgrade2018_realistic_v19-v1/NANOAODSIM' | ||
|
Owner
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Utilize the sample list file (https://github.com/ram1123/nanoAOD_skim/blob/HZZ_Analysis/input_data_Files/sample_list_v9_2018.dat) so that it will submit all jobs in one go. |
||
| #config.Data.inputDBS = 'phys03' | ||
| config.Data.inputDBS = 'global' | ||
| config.Data.splitting = 'FileBased' | ||
| #config.Data.splitting = 'EventAwareLumiBased' | ||
| config.Data.unitsPerJob = 1 | ||
|
|
||
| config.Data.outLFNDirBase = '/store/user/yujil/newNTuple_UL' | ||
| #config.Data.outLFNDirBase = '/store/user/%s/NanoPostTemp' % (getUsernameFromSiteDB()) | ||
| config.Data.publication = False | ||
| config.Data.ignoreLocality = False | ||
| config.Data.outputDatasetTag = 'NanoTestPost' | ||
| config.section_("Site") | ||
| config.Site.storageSite = "T2_CN_Beijing" | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,32 @@ | ||
| #this is not mean to be run locally | ||
| # | ||
| echo Check if TTY | ||
| if [ "`tty`" != "not a tty" ]; then | ||
| echo "YOU SHOULD NOT RUN THIS IN INTERACTIVE, IT DELETES YOUR LOCAL FILES" | ||
| else | ||
|
|
||
| echo "ENV..................................." | ||
| env | ||
| echo "VOMS" | ||
| voms-proxy-info -all | ||
| echo "CMSSW BASE, python path, pwd" | ||
| echo $CMSSW_BASE | ||
| echo $PYTHON_PATH | ||
| echo $PWD | ||
| rm -rf $CMSSW_BASE/lib/ | ||
| rm -rf $CMSSW_BASE/src/ | ||
| rm -rf $CMSSW_BASE/module/ | ||
| rm -rf $CMSSW_BASE/python/ | ||
| mv lib $CMSSW_BASE/lib | ||
| mv src $CMSSW_BASE/src | ||
| mv module $CMSSW_BASE/module | ||
| mv python $CMSSW_BASE/python | ||
|
|
||
| echo Found Proxy in: $X509_USER_PROXY | ||
| cd $CMSSW_BASE/src/PhysicsTools/NanoAODTools/python/postprocessing/analysis/nanoAOD_skim | ||
| cp /srv/FrameworkJobReport.xml . | ||
|
Owner
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. why this line here?
Collaborator
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Because we need the HZZcppModule, which can not be imported in the default path of Crab jobs. |
||
| cmsenv | ||
| python post_proc.py $1 | ||
| cp tree*root /srv | ||
|
Owner
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. are you sure that the path should be
Collaborator
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Yes. I'm sure. This information is obtained from the crab job logs. |
||
| #python crab_script.py $1 | ||
| fi | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Give relative path or use the env var
CMSSW_BASE