April 2005 - jsdl-wg - lists.ogf.org

RE: JSDL Meeting
by Bill Harris 13 Apr '05

13 Apr '05

I apologize for fat fingering the meeting time to 7:00 AM instead of eight, no excuses just in a hurry. Meeting are scheduled for 8:00 AM mountain time every Tuesday in the future. Darren has asked that we reschedule for Wed this week so meeting time is 8 AM Mountain Wed April 13, 2005. Darren has sent out the issues list for discussion. my apologies again billh meeting tomorrow ........... information below telecomm only... Darren will be sending out web information William Harris Program Architect Oryx follow me - 800 281 6462 Inside cadence 88 202 6462 Cell Phone 801 301 2744 The contact details are: Dial In Numbers: Belgium - 0800-7053 Bezeq - 1-800-940-1786 France - 0800-903109 Germany - 0800-1815765 Hong Kong - 800-968932 Italy - 800874509 Japan - 00531123656 Korea-Tele - 00798-14-800-0512 Netherlands - 0800-0225447 Singapore - 800-1200766 Sweden - 020-7905043 Taiwan - 00801-13-8546 UK - 0800961294 US - 800-933-3594 --> ext 3000 pin: 6444 The telecom time is: wed April 13 this week 07:00 PST 08:00 MST 09:00 CST 10:00 EST 15:00 BST 16:00 CET 23:00 JST William Harris Program Architect Oryx follow me - 800 281 6462 Inside cadence 88 202 6462 Cell Phone 801 301 2744

3 2

POSIX UID/GID
by Donal K. Fellows 13 Apr '05

13 Apr '05

The telecon has decided to move the UID/GID bits from User to the POSIX version of Application (whatever that's called; I'm behind tracking the exact name of things right now). But a question has come up about the meaning of the content of these elements. It is obvious that they have to be able to accept usernames in their xsd:string content (and I'm aware of systems with spaces in usernames, even if this is not something I'd ever do myself) since they're how POSIX user identities are exposed to users normal. However, with names like they have, should they also accept numeric UIDs? I don't have a use case for this (it's a detail I'd want to always hide) and I'm not aware of anyone ever having a wholly numeric username. As I see it, we have three options: * Current name, user-name semantics * Current name, user-name-and-uid semantics * Change name (to UserName?), user-name semantics Which do people prefer? (GID handling should mirror UID handling) Donal.

3 3

JSDL: Telecon...
by Ali Anjomshoaa 13 Apr '05

13 Apr '05

...on the hour in 15 mins... Agenda: http://www-unix.gridforum.org/mail_archive/jsdl-wg/2005/04/msg00054.html Web: Subject: JSDL Meeting URL: https://www.livemeeting.com/cc/xangoit/join Meeting ID: JSDL Attendee Key: Wxx*}$Hk4 Role: Attendee Phone: --> ext 3000 pin: 6444 Belgium - 0800-7053 Bezeq - 1-800-940-1786 France - 0800-903109 Germany - 0800-1815765 Hong Kong - 800-968932 Italy - 800874509 Japan - 00531123656 Korea-Tele - 00798-14-800-0512 Netherlands - 0800-0225447 Singapore - 800-1200766 Sweden - 020-7905043 Taiwan - 00801-13-8546 UK - 0800961294 US - 800-933-3594 --> ext 3000 pin: 6444 Cheers, Ali -- ---------------------------------------------------- |epcc| - Ali Anjomshoaa EPCC, University of Edinburgh James Clerk Maxwell Building Mayfield Road E-mail: ali(a)epcc.ed.ac.uk Edinburgh EH9 3JZ Phone: + 44 (0) 131 651 3388 United Kingdom Fax: + 44 (0) 131 650 6555 -------------------------------------------------------------

1 0

telecon error "the meeting has ended"?
by Karl Czajkowski 12 Apr '05

12 Apr '05

I cannot seem to dial in using the call info sent earlier to the list... anyone know what is up? karl -- Karl Czajkowski karlcz(a)univa.com

1 0

Requirements and preferences on resources
by Massimo Sgaravatto - INFN Padova 12 Apr '05

12 Apr '05

Dear all I have just recently joined this mailing list, and so maybe the question that I am going to raise have already been discussed: my apologies if this is the case. My question concerns the Resource element ... It is not clear to me if/how it is possible to specify not only requirements, but also preferences on resources, for example to allow a smart brokering service to choose among multiple resources matching the resource requirements. If you are familiar with Condor, I am referring to something similar to Requirements and Rank of Condor classads Thanks Cheers, Massimo \\\|/// \\ ~ ~ // (/ @ @ /) -------oOOo-(_)-oOOo---------------------------------- Massimo Sgaravatto INFN Sezione di Padova Via Marzolo, 8 35131 Padova - Italy Tel: ++39 0498277047 Fax: ++39 0498277102 oooO E-mail: massimo.sgaravatto(a)pd.infn.it ( ) Oooo Home page: http://www.pd.infn.it/~sgaravat --------\ (----( )---------------------------------- \_) ) / (_/

2 1

RE: [jsdl-wg] JSDL: Telecons
by Bill Harris 11 Apr '05

11 Apr '05

meeting tomorrow ........... information below telecomm only... Darren will be sending out web information William Harris Program Architect Oryx follow me - 800 281 6462 Inside cadence 88 202 6462 Cell Phone 801 301 2744 The contact details are: Dial In Numbers: Belgium - 0800-7053 Bezeq - 1-800-940-1786 France - 0800-903109 Germany - 0800-1815765 Hong Kong - 800-968932 Italy - 800874509 Japan - 00531123656 Korea-Tele - 00798-14-800-0512 Netherlands - 0800-0225447 Singapore - 800-1200766 Sweden - 020-7905043 Taiwan - 00801-13-8546 UK - 0800961294 US - 800-933-3594 --> ext 3000 pin: 6444 The telecon time is: _every_Tuesday_ 07:00 PST 08:00 MST 09:00 CST 10:00 EST 15:00 BST 16:00 CET 23:00 JST

1 0

Tracker status values proposal
by Andreas Savva 11 Apr '05

11 Apr '05

This is a procedural proposal about the specification tracker settings: At the moment the tracker artifact status are the gridforge default: open, pending, closed. These cannot be changed but new values can be defined. I propose to augment them with the following values: resolved, fixed, deferred. The meaning of these values would be as follows: Open: the issue has been proposed by a member but not yet accepted by the WG. Pending: the issue has been accepted and is still pending resolution by the WG Resolved: The WG has decided and accepted a resolution, but the actions are still pending Fixed: The editor has completed the proposed actions, but the actions are awaiting verification. Closed: The issue has been resolved and is reflected in the work products of the WG. The completion of the changes must be reported by the primary editor and verified by the secondary editor (or other WG member). Deferred: The WG has decided that the issue has some merit but that it should not be addressed in the upcoming revision of the spec. And deferred items would later be moved to the post-v1 tracker. Note that all this is not my invention. I am 'stealing' it from the ogsa-wg trackers. (And those were in turn 'stolen' from the ogsi ones or other places ....) -- Andreas Savva Fujitsu Laboratories Ltd

6 12

my view on execution user and group
by Karl Czajkowski 08 Apr '05

08 Apr '05

The concrete use case I have from Globus is to indicate under which POSIX username a job should be executed. I see group (actually, default or primary group) as a reasonable extension of the concept, though we do not do that today. This use case is job configuration details, just like POSIX limits, environment variables, etc. It is important in situations where there is not a one-to-one mapping of global user identity (PKI subject) to local accounts for the GRAM service to apply, e.g. when a user has several role-specific accounts or temporary "scratch" accounts. Of course, such configuration values are subject to authorization checks in practice. I am not clear on whether this is the intended purpose of the existing user and group fields in the User section, but if it is not then I am not clear on what it is for at all... I admit my bias is towards thinking of the use of JSDL in distributed protocols like GRAM. I guess if we were to use it in the local "adapter" interface between the GRAM service and the local scheduler scripts, we might have a use for specifying the authenticated user name, which for GRAM would be a PKI subject name. This makes sense because the adapter scripts inherently trust GRAM; GRAM would reject the presence of such a field in the over-the-wire transmission of JSDL, since the user identification comes from the binding-level security mechanisms. I can see this kind of info belonging in a User section for the adapter case, but I still need the POSIX username in the executable section. karl -- Karl Czajkowski karlcz(a)univa.com

12 28

RE: [jsdl-wg] RE: [drmaa-wg] making a custom file path for output
by Rajic, Hrabri 06 Apr '05

06 Apr '05

Tricky. It would need to be XTSL like preprocessing on both the client side and on the compute side. I wonder if the differences between Grid and Compute Center would require any specializations. There is much more legacy stuff that DRMAA needs to address that GRAM. -Hrabri >-----Original Message----- >From: Donal K. Fellows [mailto:donal.k.fellows@manchester.ac.uk] >Sent: Wednesday, April 06, 2005 8:33 AM >To: JSDL WG >Cc: Rajic, Hrabri; DRMAA Working Group >Subject: Re: [jsdl-wg] RE: [drmaa-wg] making a custom file path for output > >Ali Anjomshoaa wrote: >> we discussed this issue at some length at GGF13 and were unsure as to how >> to proceed. We would like to be able to reference labeled attributes, but, >> I think we're still discussing how to implement this issue in the xsd >> schema depending on current tooling! >> >> I think, unfortunately, our choice of how we implement this in xsd will >> influence how we specify how to do this in the spec. Clearly this is not >> ideal and should be the other way round! > >> On Tue, 5 Apr 2005, Rajic, Hrabri wrote: >>>Placeholders would be special variables like home directory or job id ($ >>>sign prefixed below), which DRMAA could substitute in job attributes >>>like the output path: >>> >>>drmaa_set_attribute( $jt, DRMAA_OUTPUT_PATH, >>> $DRMAA_HOME_DIR/MY_APP/my_job_output.$DRMAA_JOB_ID.out" > >Hmm, I have to say that I don't like arbitrary substitutions in XML >content, especially in styles like this. (It's one of the bits I do not >care for about Ant, BTW.) But the way I'd handle such a problem is >through something like submitting the job through a service that applied >an XSLT substitution to the document before producing a doc with "ground >terms". If you see what I mean. > >In the specific case of wanting to have file arguments given to the >application made relative to one of our virtual filesystem concepts, >there is an argument to be made for some improvement of the JSDL spec. >At the moment, the only mechanisms we have for arguments are "relative >to the job working directory" or "absolute", neither of which are great >for this use-case. (The same argument applies to environment variables, >of course.) > >Does this brain-dump indicate the sort of area where we need to address >some kind of solution? Or are there other cases which will need more >refinement before we work out how to fix it all? > >Donal.

1 0

RE: [drmaa-wg] making a custom file path for output
by Ali Anjomshoaa 06 Apr '05

06 Apr '05

Hi Hrabri, we discussed this issue at some length at GGF13 and were unsure as to how to proceed. We would like to be able to reference labeled attributes, but, I think we're still discussing how to implement this issue in the xsd schema depending on current tooling! I think, unfortunately, our choice of how we implement this in xsd will influence how we specify how to do this in the spec. Clearly this is not ideal and should be the other way round! Watch the JSDL space and let us know how you do this in the end. Cheers and take care, Ali On Tue, 5 Apr 2005, Rajic, Hrabri wrote: > Hi Ali, > > Placeholders would be special variables like home directory or job id ($ > sign prefixed below), which DRMAA could substitute in job attributes > like the output path: > > drmaa_set_attribute( $jt, DRMAA_OUTPUT_PATH, > $DRMAA_HOME_DIR/MY_APP/my_job_output.$DRMAA_JOB_ID.out" > > > > -Hrabri > > >-----Original Message----- > >From: Ali Anjomshoaa [mailto:ali@epcc.ed.ac.uk] > >Sent: Tuesday, April 05, 2005 10:59 AM > >To: Rajic, Hrabri > >Cc: Andreas Haas; Tim Harsch; DRMAA Working Group > >Subject: RE: [drmaa-wg] making a custom file path for output > > > > > >Hi Guys, > > > >If you could give me a quick synopsis of what you consider placeholders > >and in what context, perhaps I can help from the JSDL perspective. > > > >Cheers, > > > >Ali > > > > > >On Tue, 5 Apr 2005, Rajic, Hrabri wrote: > > > >> Andreas, > >> > >> I would suggest we approach the question as two issues: > >> > >> 1) what are the global placeholders in DRMAA > >> 2) in which (string typed) job attributes the placeholders could be > used > >> > >> > >> Here are few questions that go with the above: > >> > >> How is JDSL handling placeholders - nice to know? > >> Do all major DRM systems support placeholders well? > >> Do we need a new error code indicating failure in resolving a > >> placeholder? Any other errors needed? > >> > >> -Hrabri > >> > >> > >> >-----Original Message----- > >> >From: owner-drmaa-wg(a)ggf.org [mailto:owner-drmaa-wg@ggf.org] On > Behalf > >> Of > >> >Andreas Haas > >> >Sent: Tuesday, April 05, 2005 7:37 AM > >> >To: Tim Harsch > >> >Cc: DRMAA Working Group > >> >Subject: Re: [drmaa-wg] making a custom file path for output > >> > > >> >Hi Tim, > >> > > >> >I fully agree there is a need for this. Please see > >> > > >> > http://forge.gridforum.org/tracker/?aid=805 > >> > > >> >I raised it's priority to P2. I believe that issue must > >> >be solved with resubitted DRMAA spec. > >> > > >> >Regards, > >> >Andreas > >> > > >> > > >> >On Mon, 4 Apr 2005, Tim Harsch wrote: > >> > > >> >> I'm sorry I wasn't clear. I guess the heart of my question is: > How > >> can > >> >> create an arbitrarty template for the file and path name? > >> Specifically > >> >what > >> >> constant tells the DRM to insert job id into that filename > template. > >> >> > >> >> Said in Perl psuedo form: > >> >> > >> >> drmaa_set_attribute( $jt, > >> >> $DRMAA_OUTPUT_PATH + > ":/tmp/my_job_output.$DRMAA_JOB_ID.out" > >> ); > >> >> > >> >> # with that code job outputs look like > >> >> /tmp/my_job_output.1.out > >> >> /tmp/my_job_output.2.out > >> >> /tmp/my_job_output.3.out > >> >> > >> >> # without that code job outputs look like > >> >> /home/harsch/script_name.o1 > >> >> /home/harsch/script_name.o2 > >> >> /home/harsch/script_name.o3 > >> >> > >> >> Is there a DRMAA_JOB_ID constant? > >> >> > >> >> ----- Original Message ----- > >> >> From: "Rajic, Hrabri" <hrabri.rajic(a)intel.com> > >> >> To: "DRMAA Working Group" <drmaa-wg(a)gridforum.org> > >> >> Sent: Monday, April 04, 2005 12:02 PM > >> >> Subject: RE: [drmaa-wg] making a custom file path for output > >> >> > >> >> > >> >> There is a simple solution, provided it works for you: > >> >> to rely on the shell to supply the home directory path instead of > >> DRMAA. > >> >> > >> >> -Hrabri > >> >> > >> >> > >> >> >-----Original Message----- > >> >> >From: owner-drmaa-wg(a)ggf.org [mailto:owner-drmaa-wg@ggf.org] On > >> Behalf > >> >> Of > >> >> >Tim Harsch > >> >> >Sent: Monday, April 04, 2005 1:19 PM > >> >> >To: DRMAA Working Group > >> >> >Subject: [drmaa-wg] making a custom file path for output > >> >> > > >> >> >Hi all, > >> >> > I have a requirement for the app I'm writing ( using > >> >> Schedule::DRMAAc ) > >> >> >which I'm trying to implement. > >> >> > > >> >> >Normally the output files from jobs go to home directory and are > of > >> the > >> >> >form > >> >> ><jobname>.o<jobid> > >> >> > > >> >> >I want to move the jobs to a subdir in /tmp, but retain the > <jobid> > >> in > >> >> the > >> >> >filename. I tried this: > >> >> > > >> >> > ( $job_error, $diagnosis ) = drmaa_set_attribute( $jt, > >> >> > $DRMAA_OUTPUT_PATH, > >> >> > ":" . $tmpdir . '/' . > >> >> > __PACKAGE__ . '.' . > >> >> > $DRMAA_PLACEHOLDER_INCR . > >> >> > ".out" ); > >> >> > > >> >> >... but PLACEHOLDER is only for parametric jobs, I've been > scanning > >> the > >> >> >docs > >> >> >and have not found a placeholder for job id. Any ideas on how I > >> could > >> >> >accomplish this task? > >> >> > > >> >> >A similar task would be to move the job output path without > changing > >> >> the > >> >> >filename format at all. How could I do that? > >> >> > >> >> > >> > >> > >> > > > >-- > > > > ---------------------------------------------------- |epcc| - > > Ali Anjomshoaa > > EPCC, University of Edinburgh > > James Clerk Maxwell Building > > Mayfield Road E-mail: ali(a)epcc.ed.ac.uk > > Edinburgh EH9 3JZ Phone: + 44 (0) 131 651 3388 > > United Kingdom Fax: + 44 (0) 131 650 6555 > > ------------------------------------------------------------- > > > -- ---------------------------------------------------- |epcc| - Ali Anjomshoaa EPCC, University of Edinburgh James Clerk Maxwell Building Mayfield Road E-mail: ali(a)epcc.ed.ac.uk Edinburgh EH9 3JZ Phone: + 44 (0) 131 651 3388 United Kingdom Fax: + 44 (0) 131 650 6555 -------------------------------------------------------------

3 3