r12 - 28 Mar 2008 - 11:57:25 - SaulYoussefYou are here: TWiki >  Admins Web > AnalysisQueues

AnalysisQueues

Background

Phase3 schedule

  • Complete specification for PBS-based analysis queues
  • Setup analysis queues at each Tier2 site:
    • AGLT2 (ANALY_AGLT2) DONE
    • MWT2 (ANALY_MWT2) DONE
    • NET2 (ANALY_NET2) DONE
    • SWT2_OU (ANALY_OU_OCHEP_SWT2) DONE
    • SWT2_UTA (UTA-DPCC) DONE
    • WT2 (ANALY_SLAC) DONE
  • Complete replication of analysis datasets to Tier2s
  • Demonstrate ability to run analysis jobs routinely

Configuration Changes Needed for Sites

AGLT2

The AGLT2 cluster runs 64bit SLC4.5 with 32bit compatibility libraries.
  • The kernel is 2.6.20-20UL5smp
  • /etc/redhat-release --> Scientific Linux CERN SLC release 4.5 (Beryllium)
The necessary prescription for the successful completion of analysis tasks submitted by Nurcan was given by Fred Luehring's pointer to this Twiki page. All specified rpms and soft-links for "Build in 32 bit on SLC4/64 machine" were used.

MWT2

  • setup for Condor-based analysis queue described here
  • worker nodes are running 32-bit SLC4. All that was necessary for build-based analysis jobs was:
yum install compat-gcc-32 compat-gcc-32-c++
which provides /usr/bin/gcc32

NET2

We installed a

CentOS-4
superset called "BU Linux 4.5" and followed the instructions from here https://twiki.cern.ch/twiki/bin/view/Atlas/DAonSLC4. This didn't work, however. Then, following Patrick's suggestion we did

cmt_linux_version.sh

getting "slc4045" as an answer. We put

tag slc4045 slc4

in all of the

AtlasSettings/*/cmt/requirements
files and Nurcan's test passed.

SWT2

ANALY_OU_OCHEP_SWT2

This cluster runs 64bit RHEL4U3 and is installed via Platform OCS (ROCKS) v4.1.1. In addition, we added the following tweaks to our extend-compute.xml .

Compat RPMs:

<package>compat-gcc-32</package>
<package>compat-gcc-32-c++</package>
Soft links:
ln -s libXm.so.3 /usr/X11R6/lib/libXm.so
ln -s libjpeg.so.62 /usr/lib/libjpeg.so
ln -s libfreetype.so.6 /usr/lib/libfreetype.so
ln -s libg2c.so.0 /usr/lib/libg2c.so

Note that the other compat RPMs mentioned by Patrick for SWT2_CPB below were already part of the standard OCS installation, so we didn't need to include them.

In addition, we needed to add these lines to all ATLAS releases' AtlasSettings/*/cmt/requirements files:

tag rhel43  slc4
tag rhel45  slc4

ANALY_SWT2_CPB

This cluster runs 64bit SL4 and is installed via ROCKS (v4.3). We followed the guidelines available at: https://twiki.cern.ch/twiki/bin/view/Atlas/RPMcompatSLC4 to determine which RPM's might need to be installed and which links might need to be created. The result is that we added the following packages to our ROCKS configuration for the compute nodes:
<package>compat-libstdc++-33</package>
<package>compat-libstdc++-33.i386</package>
<package>compat-glibc</package>
<package>compat-glibc-headers</package>
<package>compat-gcc-32</package>
<package>compat-gcc-32-c++</package>
And created the four links mentioned in the page above in the post section of the configuration file:
cd /usr/lib
ln -s libjpeg.so.62 libjpeg.so
ln -s libfreetype.so.6 libfreetype.so
ln -s libg2c.so.0 libg2c.so
cd /usr/X11R6/lib
ln -s libXm.so.3 libXm.so

ANALY_UTA (DPCC)

This cluster is currently running 32bit RHEL3 and is managed via systemimager. No additional rpms or links have been required to date for the compilation/running of analysis jobs.

WT2

Same as ANALY_OU_OCHEP_SWT2 above

-- RobertGardner - 17 Oct 2007

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback