r5 - 09 Apr 2010 - 11:14:41 - JoseCaballero? You are here: TWiki >  AtlasSoftware Web > NonAtlasJobs

Pilot submission for use in VOs other than Atlas


Motivation

Creation of a friendly user tool for panda job submission. Immediate applications include:

Getting ready

wget http://www.usatlas.bnl.gov/~caballer/panda/demo/sendjobs.tar 
tar xvf sendjobs.tar
cd sendjobs
source setup.(c)sh  

Options

  • njobs = number of jobs to be submitted
  • verbose = verbosity level
  • transformation = url with the payload (or job) to be executed by a pilot
  • computingSite = panda site to submit the job
  • prodSourceLabel = label to mark the job. This label will be used by the pilot to perform the matchmaking.
  • processingType = label to mark the job.
  • jobParameters = parameters sent to the job

Examples

$ ./sendJob.py --njobs 1 --computingSite TEST2 --transformation http://www.myserver.com/mytest.sh --prodSourceLabel user --cloud OSG
$ ./sendJob.py --njobs 1 --computingSite TEST2 --transformation http://www.myserver.com/mytest.sh --prodSourceLabel user --cloud OSG --jobParameters "a b c 1 2 3"

API

sendJob.py can be used as an API. An example of client file using it would look like
from sendJob import *
from taskbuffer.JobSpec import JobSpec

options = Options()
options.njobs = 3
options.verbose = 1

job = JobSpec()
job.transformation = "http://www.usatlas.bnl.gov/~caballer/panda/transformations/trivial_test.sh"
job.computingSite = "TEST2"
job.prodSourceLabel = "user"
job.jobParameters = "a b c 1 2 3"

submission = submissionAPI()

submission.options = options
submission.job = job

submission.makeJobList()
submission.submit()


Major updates:
-- TWikiAdminGroup - 23 Apr 2018

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments


zip sendjobs.tar (680.0K) | JoseCaballero? , 15 Dec 2009 - 15:17 |
 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback