March 2005 - jsdl-wg - lists.ogf.org

GGF13 Sessions' notes, Spec and Schema
by Ali Anjomshoaa 16 Mar '05

16 Mar '05

Andreas, all, The spec with comments and notes are now on GridForge under the GGF13 folder. The latest version of the Spec in under Session4 - clearly some tidying and refactoring required to make comments global etc. Many thanks for everyone's extremely useful input at the meeting. Hope you all stay tuned to help finish v1.0. Cheers and take care, Ali -- ---------------------------------------------------- |epcc| - Ali Anjomshoaa EPCC, University of Edinburgh James Clerk Maxwell Building Mayfield Road E-mail: ali(a)epcc.ed.ac.uk Edinburgh EH9 3JZ Phone: + 44 (0) 131 651 3388 United Kingdom Fax: + 44 (0) 131 650 6555 -------------------------------------------------------------

1 0

XSD Schema - latest
by Andrew Stephen McGough 16 Mar '05

16 Mar '05

All, Here is the latest XSD schema. Think I've got all the new stuff in that people wanted. I'll add it to sourceforge. steve.. -- -- ------------------------------------------------------------------------ Dr A. Stephen McGough http://www.doc.ic.ac.uk/~asm ------------------------------------------------------------------------ Technical Coordinator, London e-Science Centre, Imperial College London, Department of Computing, 180 Queen's Gate, London SW7 2BZ, UK tel: +44 (0)207-594-8409 fax: +44 (0)207-581-8024 ------------------------------------------------------------------------ Assistant Warden, West Wing, Beit Hall, Imperial College, Prince Consort Road, London, SW7 2BB tel: +44 (0)207-594-9910 ------------------------------------------------------------------------

5 9

this is just a test message
by Gene Rackow 14 Mar '05

14 Mar '05

testing testing.

1 0

jsdl specification 0.9.3. (draft 14)
by Andreas Savva 10 Mar '05

10 Mar '05

I uploaded a new version of the spec. with a number of additions and changes. Some are editorial; some content. Changes: - Moved IP statement to the back per GFD template - Adjusted style of appendices - Adjusted style of back end sections - Adjusted style of TOC - re-arranged sections - Minor changes to fix pseudo-schema multiplicity (missing '?') - Added a couple of references - Added pseudo-schema appendix (do we want to keep this or not) (michel) - added new units (michel) - added arguments/argument (michel) - added limits (donal) - changed id to sid (schema and spec need cross-checking) - added 'name' attribute to FileSystem - removed redundant 'Description' sections & changed name of jsdl:description type elements to Description in the spec (this was agreed some time back.) - added newer schema at the back. This is the one from gridforge and so not the absolute latest one yet. - added a first draft for the processtopology section; https://forge.gridforum.org/projects/jsdl-wg/document/draft-ggf-jsdl-spec/e… -- Andreas Savva Fujitsu Laboratories Ltd

3 5

jsdl:FileSystem
by Michel Drescher 09 Mar '05

09 Mar '05

Folks, while messing around with the schema, I just found a possible glitch: Last week, we defined the new attribute "sid" in the element jsdl:FileSystem. This attribute refers to a symbolic name for a filesystem to be made available (mounted) to the environment of the application. This implies 2 issues: a) If the mount point is site configurable (aka unknown to the JSDL document creator) then it is useless to specify a jsdl:MountPoint element. Therefore, jsdl:MountPoint should be optional, instead of mandatory (as it is now) b) We need to define the symbols that are allowed for this new attribute. I propose the following list for a starter: "jsdl:HOME" = The home directory of the jsdl:ExecutionUserID "jsdl:TMP" = A directory for temporary file storage (for the time of the execution) "jsdl:SPOOL" = A spool directory JSDL should allow creators to use their own symbols as long as they are defined in a different namespace. The base set of symbols defined in JSDL MUST be supported by all implementors. Comments, ideas, rants? :-) Cheers, Michel

2 1

Tracker renaming and new tracker
by Andreas Savva 08 Mar '05

08 Mar '05

I've created a new tracker for issues that fall out-of-scope of version 1: "JSDL-post-v1" https://forge.gridforum.org/tracker/index.php?func=browse&group_id=122&atid… and I renamed the JSDL specification tracker to "JSDL version 1" Andreas

1 0

Meeting minutes
by Darren Pulsipher 08 Mar '05

08 Mar '05

%PDF-1.4 %àáâã 3 0 obj << /Filter /FlateDecode /Length 624 >> stream xVQoÚ0~^~Åí-h!$ C]§¶£©šLd{âÅxMìÔ1 û÷;;¡µ©hPÀŸ|÷Ýå»ó''Êù|Ý®ßÜéeŠý^cÂEæ,öØA?hìzeÁªWûÃyrn¢%Þ¡Ñv8Ô»Î]a¢ãÎIBGÐ~;nš¿Û 2Ðž6úë&°YP¯°ýä©Æéðü`ú#Ç¹NaèA7úµ[óèÈàZ)ÊcJKðÃw"%å°tÅÀýýí²euºÎ3cëfv*KJìyÞ°ÌN¶Ø®Ž¿²àä.óë`ÞF&Ûreéëá²!n] enSÂ *¥°@SN`#€ÙâÂÚ`¬ñnSÏÿhº~Iz¶,§ëãÉZáòàseÁ¯ve<*d<¹ìNáð}ÿŒ:ÿûv¶0¿š,àìûuTÝOPáAJ2E@!E!Já1x@ ÓÉcŠô¡iÚ³Ø*HY#t#±b*€]$`ápÌwVMÅbäÝröCu|ÙG°yÑ\èyPQØZíšÖBØÔñ}XL!ŠÆi ª³R1ŸVU`#xàV€DwÁ!<[ ZtqìÓÅ9ObQ(Ü®þüŠcø€äÁXÂ q0QcIî#c=y0±fy07õãPÐ¿±û"FM <2$fK÷£Îkï9«)µŠMÓQÝjZr3ŠÔoë¡q þßa& endstream endobj 4 0 obj << /MediaBox [0 0 612 792] /Contents 3 0 R /Type /Page /Resources << /Font << /F1 2 0 R >> /ProcSet [/PDF /Text] >> /Parent 1 0 R >> endobj 6 0 obj << /Filter /FlateDecode /Length 503 >> stream x¥TÁn0œó£=D°vÙFJ«Ti#UÔfzhªÊgÁÁmÊöÒo¯ Þ(«Fâèyxóæyló$Ðg+HÓh M°Ì=ä.žÌ|ÈlÜ|¹ðqfš9î·à1x_xÙuŽÊ LÖnL I¡Øó¯€Âs8-îyêÞ¡g./Žùî±p(< "Ôn[ÃGêŸ¿@\»Ue3n@56pOÉîæUM€±Õ£Á»ÓQÏç<>šÔÆÈó8îû>ºvñ_ŸkâkÅh|{~¿;ÕWáX*Jh¯é(L.KÃD«§háÓ5ÅüÂ¬?!tÎôÌÔ0#ªêlÍÖi)Ìºí#v[ªègòËQŒ¬I[¡ xNßgRµ.\Tf¯owÓ44âÎ-)G3(Â¹up/¶@QÉ¡Ñ°ê/VbXèõŠ|¬Ò;ñO«Ï 6ð;£Hù ÞÂh'»í¶€¶{Òz®0ªìFŽšk";œRÌZûHÖòÝ®kËœÆJNþbô"IÓb,È×ÙQ¹4É¢ìÂ4U ÉêøXý÷6QKøyúüá(ìÏâ_4 endstream endobj 7 0 obj << /MediaBox [0 0 612 792] /Contents 6 0 R /Type /Page /Resources << /Font << /F1 2 0 R /F2 5 0 R >> /ProcSet [/PDF /Text] >> /Parent 1 0 R >> endobj 8 0 obj << /Type /Outlines /First 9 0 R /Count 1 /Last 9 0 R >> endobj 9 0 obj << /Dest [7 0 R /Fit] /Parent 8 0 R /Title (þÿ[ Text Slide A ]) >> endobj 5 0 obj << /Encoding /WinAnsiEncoding /Subtype /Type1 /BaseFont /Helvetica-Bold /Type /Font >> endobj 2 0 obj << /Encoding /WinAnsiEncoding /Subtype /Type1 /BaseFont /Helvetica /Type /Font >> endobj 1 0 obj << /Type /Pages /Count 2 /Kids [4 0 R 7 0 R] >> endobj 10 0 obj << /Pages 1 0 R /Outlines 8 0 R /Type /Catalog /PageMode /UseOutlines >> endobj 11 0 obj << /CreationDate (D:20050308065421-08'00') /Producer (þÿiText by lowagie.com $r0.80 based on paulo build 87$) >> endobj xref 0 12 0000000000 65535 f 0000001960 00000 n 0000001863 00000 n 0000000015 00000 n 0000000711 00000 n 0000001761 00000 n 0000000859 00000 n 0000001434 00000 n 0000001592 00000 n 0000001663 00000 n 0000002023 00000 n 0000002112 00000 n trailer << /Info 11 0 R /Size 12 /Root 10 0 R >> startxref 2295 %%EOF

1 0

Re: [jsdl-wg] TileSize and ProcessCount (fwd)
by Ali Anjomshoaa 08 Mar '05

08 Mar '05

Bounced ? -- ---------------------------------------------------- |epcc| - Ali Anjomshoaa EPCC, University of Edinburgh James Clerk Maxwell Building Mayfield Road E-mail: ali(a)epcc.ed.ac.uk Edinburgh EH9 3JZ Phone: + 44 (0) 131 651 3388 United Kingdom Fax: + 44 (0) 131 650 6555 ------------------------------------------------------------- ---------- Forwarded message ---------- Date: Wed, 02 Mar 2005 09:26:56 +0000 From: A S McGough <asm(a)doc.ic.ac.uk> Cc: jsdl-wg(a)gridforum.org Subject: Re: [jsdl-wg] TileSize and ProcessCount OK, Reading this thread (sorry for the use of the term...) it seems as though we have confusion between a number of different terms. Personally in this case I like to think in diagrams. Attached is the example ProcessCount = 12 TileSize = 4 From the document this suggests that we have 12 processes (not processors) in the job and that each set of 4 processes are allocated to a resource. Thus requiring 3 resources. Presumably if we request in the resource section that each resource must have at least 4 processors then each process _could_ be mapped down to a different processor. Is this correct? Are people happy with this? Does it describe all situations? I've attached a figure showing this - sorry it's so naff. steve.. Christopher Smith wrote: >Thanks for the clarification Andreas. I guess I need to do some reading up >on some of the changes. :-) > >-- Chris > > >On 1/3/05 18:41, "Andreas Savva" <andreas.savva(a)jp.fujitsu.com> wrote: > > > >>Hi Chris, >> >>Just to give you some background on why this is the way it is. >> >>At the last F2F after a lengthy discussion on topology and what it >>really means the group reached the conclusion that topology is part of >>the application definition rather than part of the hardware >>requirements. (That is, it is independent of the hardware resources to >>be allocated to the job and should be described separately and in terms >>that are not hardware specific.) >>So the topology tags describe the number of processes and their desired >>grouping/tiling and appear in the Application section rather than the >>Resource section. The Resource section (may) contains tags to describe >>the hardware resources required: CPUCount and ResourceCount. >> >>I have some doubts about the current definition (in particular I think >>we either overloaded the term 'Process' or we defined TileSize the wrong >>way). But I think it is easier to bash this out on a call or f2f (hand >>to hand? :-) at GGF13. >> >>Andreas >> >> >>Christopher Smith wrote: >> >> >>>Perhaps there are naming issues here, or there are too many terms defined >>>here. >>> >>>JSDL is only concerned with specifying the resource requirements for the >>>allocation request, not with how those resources end up being used (i.e. >>>using threads or processes). So the TileSize indicates how many cpus need to >>>be allocated as a unit within one OS image (i.e. a group of cpus), and the >>>CPUCount would tell you how many cpus are needed in total. I don't believe >>>you need any more. If the job chooses to use processes or threads is >>>independent of the allocation. >>> >>>So given this example: >>> >>> >>> >>> >>>>tasks per job=3 >>>>threads per task=4 >>>>processors per task=4 >>>> >>>> >>>> >>>TileSize = 4 >>>CPUCount = 12 >>> >>>This can translate to the PBS syntax "nodes=3:ppn=4" or the LSF syntax "-n >>>12 -R 'span[ptile=4]'", and I'm sure others as well. >>> >>>To the entity making the allocation, processes or threads doesn't matter. >>> >>>-- Chris >>> >>> >>> > > > > -- ------------------------------------------------------------------------ Dr A. Stephen McGough ------------------------------------------------------------------------ Research Associate, Imperial College London, Department of Computing, 180 Queen's Gate, London SW7 2BZ, UK tel: +44 (0)207-594-8310 fax: +44 (0)207-581-8024 ------------------------------------------------------------------------ Assistant Warden, West Wing, Beit Hall, Imperial College, Prince Consort Road, London, SW7 2BB tel: +44 (0)207-828-49910 ------------------------------------------------------------------------

1 0

Issues for the teleconference tomorrow
by Michel Drescher 08 Mar '05

08 Mar '05

Co-wranglers, I (again me...) have a list of questions (extracted from the mail of Karl Czajkowski mentioned last week): 1) Argument list handling in jsdl:Application Basically, the modeling of command line arguments in a whole string is ... cumbersome? I know, it works, but it looks ugly. Instead, I'd like to propose the following (in PseudoCode): <Application ... > ... <Arguments> <Arg order:xsd:positiveInteger>xsd:String</Arg> </Arguments>* ... </Application> Every content in the jsdl:Arg element would be converted to quoted strings if it contains whitespaces. Example: Consider an application "print.exe" that sends a file to a named print queue. The default queue is used when no print queue name is given. "print.exe -p dj720c example.txt" (1) "print.exe example.txt" (2) "print.exe 'C:\Program Files\Dummy\help.txt'" (3) The XML snippets could be as follows: ... <Arguments> (1) <Arg order="1">-p</Args> <Arg order="2">dj720c</Arg> <Arg order="3">example.txt</Arg> </Arguments> ... <Arguments> (2) <Arg order="3">example.txt</Arg> </Arguments> ... <Arguments> (3) <Arg order="2">C:\Program Files\Dummy\help.txt</Arg> </Arguments> ... Note: XML itself seem not to impose any order to elements with the same name contained in the same parent element. So we have to invent our own ordering mechanism (as done by the order attribute). 2) Versioning This topic might be slipped, so I would like to raise it again. Call me a nag bag, but is this superfluous information to contain "jsdl-1..1.xsd" in the namespace definitions? As an alternative, I propose the following namespace that also serves as a version identifier: "http://www.ggf.org/jsdl/2005/03/jsdl/" or "http://www.ggf.org/jsdl/2005/03/" where "http://www.ggf.org/" - is the shared domain of all GGF standards "jsdl/" - is the JSDL common domain "2005/03/" - is the version of the specification "jsdl/" (or sth. else) - is the sub-specification (if we want to think of any) 3) Storage/bandwidth units At the moment, we use a mixed set of units. SI defines two distinct sets of units: One based on 10, and one based on 2 (adopted by the IEC), having the 10 based units the normal prefix (like K, M, G, T, P and E) and the 2 based units the prefixes Ki, Mi(!), Gi, Ti, Pi and Ei. I propose to use the SI units. For JSDL2, I propose to switch to an OID based system for these kind of units. 4) Reservations What about the concept of resource reservations? Some initial thoughts: - Use reservation tokens in JSDL to refer to previously made reservations (with means out of scope of JSDL) - Incorporate/emend the job description with means to make reservations, so the reply to such a JSDL document would give the reservation token to put into another JSDL document to actually use the reserved resources 5) JSDL 2.0 issues list I would like to get some topics to be put as research/development candidate for JSDL2. 5.1) more structure for Java applications Quote from Karl's mail: >> -- more structure for java >> -- jar versus bytecode class >> -- native compiled java? >> -- like executable but java-style >> parameterization >> -- class w/ Main() to invoke >> -- language version >> -- external class dependencies? >> -- supported JVMs (java portability 50% myth) Cheers, Michel

6 8

meeting on the 8th sorry for the late reminder
by Bill Harris 08 Mar '05

08 Mar '05

You have been invited to attend a Microsoft Office Live Meeting. At the time of the meeting, click on the following link to attend. URL: http://www.placeware.com/cc/cadence/join?id=RWZ334&role=attend <http://www.placeware.com/cc/cadence/join?id=RWZ334&role=attend> Subject: JSDL Meeting When: Tuesday, Mar 8, 2005 7:00 AM (MST) Scheduled to Occur: Recurring Duration: 1 Hour 30 Minutes Audio Information: 1-800-933-3594 pin: 6444 Alternate Attend Instructions: Go to: http://www.placeware.com/cc/cadence/join <http://www.placeware.com/cc/cadence/join> Your Name: (enter your name) Meeting ID: RWZ334 Meeting Password: >Phone Numbers: >Belgium - 0800-7053 >Bezeq - 1-800-940-1786 >France - 0800-903109 >Germany - 0800-1815765 >Hong Kong - 800-968932 >Italy - 800874509 >Japan - 00531123656 >Korea-Tele - 00798-14-800-0512 >Netherlands - 0800-0225447 >Singapore - 800-1200766 >Sweden - 020-7905043 >Taiwan - 00801-13-8546 >UK - 0800961294 >US - 800-933-3594 William Harris Program Architect 150 West Civic Center Dr. Sandy, Utah 84070 Oryx follow me - 800 281 6462 Inside cadence 88 202 6462 Cell Phone 801 554 0187

1 0