AnalysisQueues

Background

• See the extensive discussion in AnalysisQueueP1
• See progress from Phase2 in AnalysisQueueP2

Phase3 schedule

• Complete specification for PBS-based analysis queues
• Setup analysis queues at each Tier2 site:
  • AGLT2 (ANALY_AGLT2)
  • MWT2 (ANALY_MWT2)
  • NET2 (ANALY_NET2)
  • SWT2_OU (ANALY_OU_OCHEP_SWT2)
  • SWT2_UTA (UTA-DPCC)
  • WT2 (ANALY_SLAC)
• Complete replication of analysis datasets to Tier2s
• Demonstrate ability to run analysis jobs routinely

Configuration Changes Needed for Sites

AGLT2

The AGLT2 cluster runs 64bit SLC4.5 with 32bit compatibility libraries.

• The kernel is 2.6.20-20UL5smp
• /etc/redhat-release --> Scientific Linux CERN SLC release 4.5 (Beryllium)

The necessary prescription for the successful completion of analysis tasks submitted by Nurcan was given by Fred Luehring's pointer to this Twiki page. All specified rpms and soft-links for "Build in 32 bit on SLC4/64 machine" were used.

MWT2

• setup for Condor-based analysis queue described here
• worker nodes are running 32-bit SLC4. All that was necessary for build-based analysis jobs was:

yum install compat-gcc-32 compat-gcc-32-c++

which provides /usr/bin/gcc32

NET2

We installed a

CentOS-4

superset called "BU Linux 4.5" and followed the instructions from here https://twiki.cern.ch/twiki/bin/view/Atlas/DAonSLC4. This didn't work, however. Then, following Patrick's suggestion we did

cmt_linux_version.sh

getting "slc4045" as an answer. We put

tag slc4045 slc4

in all of the

AtlasSettings/*/cmt/requirements

files and Nurcan's test passed.

SWT2

ANALY_OU_OCHEP_SWT2

This cluster runs 64bit RHEL4U3 and is installed via Platform OCS (ROCKS) v4.1.1. In addition, we added the following tweaks to our extend-compute.xml .

Compat RPMs:

<package>compat-gcc-32</package>
<package>compat-gcc-32-c++</package>

Soft links:

ln -s libXm.so.3 /usr/X11R6/lib/libXm.so
ln -s libjpeg.so.62 /usr/lib/libjpeg.so
ln -s libfreetype.so.6 /usr/lib/libfreetype.so
ln -s libg2c.so.0 /usr/lib/libg2c.so

Note that the other compat RPMs mentioned by Patrick for SWT2_CPB below were already part of the standard OCS installation, so we didn't need to include them.

In addition, we needed to add these lines to all ATLAS releases' AtlasSettings/*/cmt/requirements files:

tag rhel43  slc4
tag rhel45  slc4

ANALY_SWT2_CPB

This cluster runs 64bit SL4 and is installed via ROCKS (v4.3). We followed the guidelines available at: https://twiki.cern.ch/twiki/bin/view/Atlas/RPMcompatSLC4 to determine which RPM's might need to be installed and which links might need to be created. The result is that we added the following packages to our ROCKS configuration for the compute nodes:

<package>compat-libstdc++-33</package>
<package>compat-libstdc++-33.i386</package>
<package>compat-glibc</package>
<package>compat-glibc-headers</package>
<package>compat-gcc-32</package>
<package>compat-gcc-32-c++</package>

And created the four links mentioned in the page above in the post section of the configuration file:

cd /usr/lib
ln -s libjpeg.so.62 libjpeg.so
ln -s libfreetype.so.6 libfreetype.so
ln -s libg2c.so.0 libg2c.so
cd /usr/X11R6/lib
ln -s libXm.so.3 libXm.so

ANALY_UTA (DPCC)

This cluster is currently running 32bit RHEL3 and is managed via systemimager. No additional rpms or links have been required to date for the compilation/running of analysis jobs.

WT2

Same as ANALY_OU_OCHEP_SWT2 above

-- RobertGardner - 17 Oct 2007