ssh atlasgw.bnl.gov rterm -i cd $HOME mkdir Jamboree cd Jamboree mkdir 13.0.40Create a "requirements" file:
######################################################### set CMTSITE STANDALONE macro PROJ_RELEASE "latest" \ 13.0.40 "13.0.40" set SITEROOT /opt/usatlas/kit_rel/${PROJ_RELEASE} macro ATLAS_DIST_AREA ${SITEROOT} macro ATLAS_GROUP_AREA "/afs/cern.ch/atlas/groups/PAT/Tutorial/EventViewGroupArea/EVTags-13.0.40.323" macro ATLAS_TEST_AREA "" \ 13.0.40 "${HOME}/Jamboree/13.0.40" macro SITE_PROJECT_AREA ${SITEROOT} macro EXTERNAL_PROJECT_AREA ${SITEROOT} apply_tag oneTest apply_tag simpleTest apply_tag setupCMT apply_tag noCVSROOT use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA) set CVSROOT /afs/usatlas.bnl.gov/software/cvs macro setup_slc3compat "" \ gcc323 "/opt/usatlas/kit_rel/SLC3/setup_slc3compat" setup_script $(setup_slc3compat) set PATHENA_GRID_SETUP_SH /afs/usatlas.bnl.gov/lcg/current/etc/profile.d/grid_env.sh #############################################################Setup CMT:
source /afs/usatlas.bnl.gov/cernsw/contrib/CMT/v1r20p20070208/mgr/setup.sh cmt config
ssh lxplus.cern.ch cd public mkdir Jamboree cd Jamboree mkdir 13.0.40Create a "requirements" file:
############################################################# set CMTSITE CERN set SITEROOT /afs/cern.ch macro ATLAS_DIST_AREA ${SITEROOT}/atlas/software/dist macro ATLAS_GROUP_AREA "/afs/cern.ch/atlas/groups/PAT/Tutorial/EventViewGroupArea/EVTags-13.0.40.323" apply_tag simpleTest apply_tag oneTest macro ATLAS_TEST_AREA "" \ 13.0.40 "${HOME}/public/Jamboree/13.0.40" use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA) #############################################################Setup CMT:
source /afs/cern.ch/sw/contrib/CMT/v1r20p20070208/mgr/setup.sh cmt config
source setup.sh -tag=13.0.40,32,groupAreaCheck out Tools/Scripts package to setup your work area (easy way of checking out and compiling multiple packages)
cd 13.0.40 cmt co -r Scripts-00-01-14 Tools/ScriptsSetup work area and create run area:
./Tools/Scripts/share/setupWorkArea.py cd WorkArea/cmt cmt bro cmt config cmt bro gmake source setup.shCheck out PandaTools for pathena, cd to 13.0.40 directory:
cd ../.. cmt co PhysicsAnalysis/DistributedAnalysis/PandaToolsCheck out HighPtView package:
cmt co -r HighPtView-00-01-10 PhysicsAnalysis/HighPtPhys/HighPtViewCheck out EventViewConfiguration package:
cmt co -r EventViewConfiguration-00-01-13 PhysicsAnalysis/EventViewBuilder/EventViewConfigurationRun every time new packages checked out:
./Tools/Scripts/share/setupWorkArea.pyIt prints:
WorkAreaMgr : INFO ################################################################################ WorkAreaMgr : INFO Creating a WorkArea CMT package under: [/usatlas/u/nurcan/Jamboree/13.0.40] WorkAreaMgr : INFO Scanning [/usatlas/u/nurcan/Jamboree/13.0.40] WorkAreaMgr : INFO Found 4 packages in WorkArea WorkAreaMgr : INFO => 0 package(s) in suppression list WorkAreaMgr : INFO Generation of WorkArea/cmt/requirements done [OK] WorkAreaMgr : INFO ################################################################################Compile all packages from WorkArea:
cd WorkArea/cmt cmt bro cmt config cmt bro gmake source setup.shGo to run area and get the jobOption file from HighPtView package:
cd ../run get_files HighPtViewNtuple_topOptions.pyMake a jobOption file for details of the job, called MyJobOptions.py:
####################################################################### import os print os.environ["CMTPATH"] InserterConfiguration={} # Always need this line InserterConfiguration["Electron"]={} # Need such for every item you will modify InserterConfiguration["Electron"]["FullReco"]=[{"Name":"ElMedium"}] #DoTrigger=True TriggerView=True include("HighPtView/HighPtViewNtuple_topOptions.py") include("AthenaPoolCnvSvc/ReadAthenaPool_jobOptions.py") ServiceMgr.PoolSvc.SortReplicas=True from DBReplicaSvc.DBReplicaSvcConf import DBReplicaSvc ServiceMgr+=DBReplicaSvc() ServiceMgr.DBReplicaSvc.UseCOOLSQLite=False# fix for stream and DPDs by Attila InserterConfiguration.update({ "CommonParameters": { "DoPreselection":False, "CheckOverlap":False } }) #######################################################################
source /afs/usatlas.bnl.gov/lcg/current/etc/profile.d/grid_env.sh source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.sh.BNL
source /afs/cern.ch/project/gd/LCG-share/current/etc/profile.d/grid_env.sh source /afs/cern.ch/atlas/offline/external/GRID/ddm/endusers/setup.sh.CERN
fdr08_run1.0003051.StreamEgamma.merge.AOD.o1_r6_t1One can also list the replicas for a given dataset (from BNL and CERN):
source /afs/usatlas.bnl.gov/Grid/Don-Quijote/DQ2_0_3_client/dq2.sh dq2-list-dataset-replicas fdr08_run1.0003051.StreamEgamma.merge.AOD.o1_r6_t1 INCOMPLETE: DESY-ZN COMPLETE: BNLXRDHDD1,SARA-MATRIX_DATADISK,RAL-LCG2_DATADISK,IN2P3-CC_DATADISK, RALPP,SLACXRD,LIP-LISBON,TAIWAN-LCG2_DATADISK,NDGF-T1_DATADISK,IFICDISK,WISC, TOKYO-LCG2_DATADISK,MWT2_IU,LIV,ICL,PIC_DATADISK,BU_DDM,TIER0TAPE,INFN-T1_DATADISK, DESY-HH,JINR,CYF,IJST2,TRIUMF-LCG2_DATADISK,FZK-LCG2_DATADISK,TORON,PNPI,AGLT2_SRM, BNL-OSG2_DATADISK,SWT2_CPB,LNF,TW-FTT,OU,MWT2_UC
DDM Name | Analysis Queue Name |
SWT2_CPB | ANALY_SWT2_CPB |
OU | ANALY_OU_OCHEP_SWT2 |
AGLT2_SRM | ANALY_AGLT2 |
MWT2_UC | ANALY_MWT2 |
SLACXRD | ANALY_SLAC |
BU_DDM | ANALY_NET2 |
WISC | ANALY_GLOW-ATLAS |
pathena -c "Mode=['FullReco'];DetailLevel=['FullStandardAOD'];Branches= ['StacoTauRec']" MyJobOptions.py --inDS fdr08_run1.0003051.StreamEgamma.merge.AOD.o1_r6_t1 --outDS user.NurcanOzturk.HighPtView.StreamEgamma.Jamboree --nfiles 1 --site ANALY_SWT2_CPBHighPtView options:
Mode=['FullReco'];DetailLevel=['FullStandardAOD']; Branches= ['StacoTauRec']"pathena options:
Specify input dataset by --inDS Specify output dataset by --outDS Specify # of files to be run on by --nfiles 1 Specify the analysis queue name by --site siteNameThe following will be printed on the screen:
Your identity: /DC=org/DC=doegrids/OU=People/CN=Nurcan Ozturk 155817 Enter GRID pass phrase for this identity: Creating proxy ........................................... Done Your proxy is valid until: Mon Mar 17 21:00:48 2008 extracting run configuration ConfigExtractor > No Input ConfigExtractor > Output=AANT EVAANtupleDump0Stream AANT0 archive sources archive InstallArea post sources/jobO query files in dataset:fdr08_run1.0003051.StreamEgamma.merge.AOD.o1_r6_t1 submit =================== JobID : 8235 Status : 0 > build PandaID=8485091 > run PandaID=8485092
export DQ2_COPY_COMMAND='lcg-cp -v --vo atlas' dq2_get -rv user.NurcanOzturk.HighPtView.StreamEgamma.JamboreeThis copies the output files:
user.NurcanOzturk.HighPtView.StreamEgamma.Jamboree.AANT0._00002.root user.NurcanOzturk.HighPtView.StreamEgamma.Jamboree._8485092.log.tgzOpen the file in root and make some plots:
root user.NurcanOzturk.HighPtView.StreamEgamma.Jamboree.AANT0._00002.root root [1] FullRec0->GetListOfLeaves()->Print(); root [2] FullRec0->Draw("El_N", "El_N>0"); root [3] FullRec0->Draw("El_p_T", "El_N>0"); root [4] FullRec0->Draw("Jet_C4_N", "Jet_C4_N>0"); root [5] FullRec0->Draw("Jet_C4_p_T", "Jet_C4_N>0");
##################################################################### import os import commands inDSs = ['fdr08_run1.0003070.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003071.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003072.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003073.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003074.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003075.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003076.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003077.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003078.StreamMuon.merge.AOD.o1_r12_t1', 'fdr08_run1.0003079.StreamMuon.merge.AOD.o1_r12_t1' ] outDS = "user.LashkarKashif.fdr1.StreamMuon" comFirst = "pathena --outDS %s --inDS %s ../share/z_pt.py --site ANALY_OU_OCHEP_SWT2" comLater = "pathena --outDS %s --inDS %s --libDS LAST ../share/z_pt.py --site ANALY_OU_OCHEP_SWT2" for i,inDS in enumerate(inDSs): if i==0: os.system(comFirst % (outDS,inDS)) else: os.system(comLater % (outDS,inDS)) #####################################################################
dq2_ls user.AldenStradling.fdr08*HPTV_NOR (overlap removal off) dq2_ls user.AldenStradling.fdr08*HPTV_OR (overlap removal on)
Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.