r102 - 08 Jan 2015 - 12:34:33 - ShuweiYeYou are here: TWiki >  AtlasSoftware Web > AtlasSWReleases

AtlasSWReleases - Using ATLAS Software at BNL


Tools and services for ATLAS releases

Code repository

U.S. ATLAS Tier I Center maintains the read-only mirror of ATLAS SVN repository at SVNROOT=file:///usatlas/projects/svn. Follow this link for details.

LXR

The LXR cross-referencing tool allows to jump easily to the declaration of any global identifier.

Tag Collector

Tag Collector is a database of packages versions with a powerful web interface

Using CVMFS at BNL

ATLAS releases as well as many software are distributed on CVMFS. An alias cvmfs-setupATLAS has been defined for you to setup CVMFS at BNL. So you can set up Athena releases, ASG releases, ROOT, PandaClient, DQ2Client and FAX, etc on cvmfs. You can always run "printMenu" after having run cvmfs-setupATLAS to print the available menu for CVMFS:

% cvmfs-setupATLAS
% printMenu 
...Type localSetupAGIS to setup AGIS
...Type localSetupAtlantis to setup Atlantis
...Type localSetupDQ2Client to use DQ2 Client
...Type localSetupEmi to use emi
...Type localSetupFAX to use FAX
...Type localSetupGanga to use Ganga
...Type localSetupGcc to use alternate gcc
...Type localSetupPacman to use Pacman
...Type localSetupPandaClient to use Panda Client
...Type localSetupPyAMI to setup pyAMI
...Type localSetupPoD to setup Proof-on-Demand
...Type localSetupROOT to setup (standalone) ROOT
...Type localSetupDQ2Wrappers to setup DQ2Wrappers
...Type localSetupSFT to setup SFT packages
...Type localSetupXRootD to setup XRootD
...Type showVersions to show versions of installed software
...Type asetup to setup a release (changeASetup to change asetup version)
...Type rcSetup to setup an ASG release (changeRCSetup to change rcSetup ver.)
...Type diagnostics for diagnostic tools
...Type helpMe for more help
...Type printMenu to show this menu

Setup of Athena Releases

You can set up athena release using alias asetup after CVMFS setup:

  • Example-1 for setting up AtlasOffline 17.3.11: asetup 17.3.1,slc5.
  • Example-2 for setting up AtlasProduction 17.3.11.1: asetup 17.3.11.1,slc5.
  • Example-3 for setting up AtlasPhysics 17.3.11.1.2: asetup AtlasPhysics,17.3.11.1.2,slc5 or asetup 17.3.11.1.2,slc5.
  • Example-4 for setting up nightly 19.0.X.Y-VAL,rel_2: asetup 19.0.X.Y-VAL,rel_2.

Sometimes you may encounter error message "No release candidates found":

% asetup 17.3.11.1.2     
AtlasSetup(ERROR): No release candidates found in:
    /afs/cern.ch/atlas/software/builds/nightlies/dev/AtlasOffline
    /afs/cern.ch/atlas/software/builds/nightlies/dev/AtlasProduction

You can check if release 17.3.11.1.2 is available using command showVersions:

% showVersions athena | grep 17.3.11.1.2
  AtlasPhysics-17.3.11.1.2-i686-slc5-gcc43-opt
  AtlasPhysics-17.3.11.1.2-x86_64-slc5-gcc43-opt
which indicates that you need specify addition tag slc5 on SLC6 machine.

Setup of ROOT

You can check the available ROOT versions on CVMFS in following either way:

  1. showVersions root
  2. localSetupROOT -h

To set up ROOT-5.34.07 in 64-bit, you can run

localSetupROOT 5.34.07-x86_64-slc5-gcc43-opt

Setup of SFT packages

There are many SFT packages under CMVFS repository -/cvmfs/sft.cern.ch/= :

% ls /cvmfs/sft.cern.ch/lcg                 
app  dev  external  hepsoft  mapfile.ts  mapfile.txt

% ls /cvmfs/sft.cern.ch/lcg/app/releases
COOL  CORAL  LCGCMT  POOL  RELAX  ROOT

% ls /cvmfs/sft.cern.ch/lcg/external    
4suite                     OpenScientist    gccxml             pydot
AIDA                       POOL             gdb                pygraphics
[...]
HepMC                      bz2lib           libelf             rx
[...]
MCGenerators               cloog-ppl        mist               sqlite
[...]

Example of Setup of herwig++/HepMC in sft

First you need check what version is avaiable:

% cmtConf=x86_64-slc5-gcc43-opt
% showVersions sft --cmtConfig $cmtConf | grep herwig++
 MCGenerators/herwig++/2.3.1
 [...]
 MCGenerators/herwig++/2.5.2
 MCGenerators/herwig++/2.6.0
 MCGenerators_hepmc2.06.05/herwig++/2.4.2
 [...]
 MCGenerators_hepmc2.06.05/herwig++/2.6.0
 [...]
 MCGenerators_lcgcmt64/herwig++/2.6.1
 MCGenerators_lcgcmt64/herwig++/2.6.1a
 [...]

% showVersions sft --cmtConfig $cmtConf | grep HepMC   
 HepMC/2.03.11
 HepMC/2.06.03
 HepMC/2.06.04
 HepMC/2.06.05
 MCGenerators_hepmc2.06.05/phojet/1.12-HepMC

To set up herwig++/2.6.1a and HepMC/2.06.05, you can run:

% cvmfs-setupATLAS
% cmtConf=x86_64-slc5-gcc43-opt
% localSetupSFT --cmtConfig $cmtConf MCGenerators_lcgcmt64/herwig++/2.6.1a
% localSetupSFT --cmtConfig $cmtConf HepMC/2.06.05

Please refer to this page for details.

More Help on using Software in CVMFS

You can type "helpMe" to print many links for more help on using those software in CVMFS:

% helpMe

  First see: 
    https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase
  for ATLASLocalRootBase (the User Interface you are interacting with now !)

Other links below:
  Most of the help / references below refer to sourcing /afs/cern scripts; 
  there is no need to do this because all software is available locally and 
  can be accessed by the menu items after setupATLAS.

manageTier3SW
  For Tier3 admins (or if you want to install on your personal laptop/desktop)
    https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ManageTier3SW
  Help (eGroup):
    https://groups.cern.ch/group/atlas-adc-tier3-managers/default.aspx

Computing WorkBook
  A good place for getting started:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/WorkBook

Tutorials
  You can join these at CERN or do it on your own at your own pace !
  https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/ComputingTutorials
  https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/RegularComputingTutorial

AtlasSetup
  asetup and what it is / does:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/AtlasSetup
  Reference:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/AtlasSetupReference
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/hn-atlas-releaseKitProblem/default.aspx
    https://groups.cern.ch/group/hn-atlas-offlineSWHelp/default.aspx

AGIS 
  Documentation:
    http://atlas-agis.cern.ch/docs/latest/index.html

Atlantis 
  Reference:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/Atlantis
    http://cern.ch/atlantis/ 
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/hn-atlas-AtlantisDisplay/default.aspx

DQ2Client
  HowTo:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/DQ2ClientsHowTo
  TroubleShooting:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/DQ2ClientsTroubleshooting
  Tutorial:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/DQ2Tutorial
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/hn-atlas-dist-analysis-help/default.aspx

emi
  This is the new grid middleware that replaces gLite.

FAX
  Information 
    https://twiki.cern.ch/twiki/bin/view/AtlasComputing/AtlasXrootdSystems 
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/atlas-adc-federated-xrootd/default.aspx

Ganga
  FAQ:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/DAGangaFAQ
  Tutorial:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/FullGangaAtlasTutorial
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/hn-atlas-dist-analysis-help/default.aspx

PandaClient
  Information (see link to Documentation on individual tool)
    https://twiki.cern.ch/twiki/bin/view/PanDA/PandaTools
  FAQ:
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasComputing/PandaAthena#FAQ
  Monitor:
    http://panda.cern.ch:25980/server/pandamon/query
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/hn-atlas-dist-analysis-help/default.aspx

PoD (Proof-on-Demand)
  Information 
    http://pod.gsi.de/
    http://proof-on-demand.blogspot.com/
  Also see 
    https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase

pyAMI
  Note: If $HOME/.pyami/ami.cfg exists, username and password from there 
         will be used.  Otherwise you can use your voms proxy - simply type 
         voms-proxy-init (no need to setup anything else).
  Information 
    https://atlas-ami.cern.ch/AMI/pyAMI/
    https://atlas-ami.cern.ch/AMI/pyAMI/examples/commands.html
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/atlas-bookkeeping/default.aspx

rcSetup
  Information
    https://twiki.cern.ch/twiki/bin/viewauth/AtlasProtected/AnalysisRelease
  Help (eGroup - see forum description in links for usage):
    https://groups.cern.ch/group/hn-atlas-pathelp/default.aspx

Use SVN at BNL

All old releases at BNL have been updated to allow to use svn now.

Use SVN repository at CERN

If your account username at CERN is same as that at BNL, then you can simply define the env variable SVNROOT to svn+ssh://svn.cern.ch/reps/atlasoff. Otherwise, you need explicitly specify your CERN account name in SVNROOT in the format of svn+ssh://YourCERNName@svn.cern.ch/reps/atlasoff. There is another option to omit your CERN account name in SVNROOT, i.e., just to add the following lines in $HOME/.ssh/config:

Host svn.cern.ch
   GSSAPIAuthentication yes
   GSSAPIDelegateCredentials yes
   # GSSAPITrustDNS yes
   Protocol 2
   ForwardX11 no
   User YourCERNName

If you do not like to type password many times for each svn command, you can config your ssh and set up ssh agent to avoid that.

Use SVN repository mirror at BNL

Just define the env variable SVNROOT to file:///usatlas/projects/svn, or use command bnl_cmt instead cmt. Please be aware that the SVN repository at BNL is just a mirror of ATLAS SVN repository, and this mirror is available for checkouts only. The import and commit operations should be performed with CERN ATLAS SVN repository. Please visit here for details.

Test results

Relevant links

Questions and comments


Major updates:
-- TWikiAdminGroup - 20 Jun 2018

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback