- pgi-wg - lists.ogf.org

OGF PGI : Using GLUE 2.0 inside JSDL
by Etienne URBAH 09 Dec '10

09 Dec '10

Morris, Johannes and all, Concerning the usage of GLUE 2.0 inside JSDL : +------------------------+ | List of requirements | +------------------------+ I propose following list, which is extracted from chapter 4 of the 'PGI chart of priorities for the detailed specification of PGI requirements' at http://forge.gridforum.org/sf/go/doc16156 : For JSDL (apart SPMD, MPI and Application profile) -------------------------------------------------- 100 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD3 The Job Description document MUST reference all grid entities in conformance to the GLUE specification 112 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD17 Job Description document should offer a clear separation between resource requirements and application requirements (for example: suggest to put memory information into resource), e.g. improving the JSDL specification in this context (if necessary) 115 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD20 It must be possible to specify hardware characteristics (e.g. in terms of a benchmark value) corresponding to the indicated performance numbers For JSDL SPMD and MPI --------------------- 108 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD13 Job Description comes with support for requesting multi-processor Activities (for example: threads/node, network topology, task/core mappings, multi-threading and such like). For JSDL Application Profile ---------------------------- 34 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqAR1 An easy way of launching applications or pre-configured /pre-installed software w/o specifying location details. Installed/pre-configured ones should be exposed as well as part of the resource description. The available software should be exposed through the service and in turn be requestable for resource/applications statements in JSDL. E.g. extending the JSDL with "pre-configured sw pieces" and/or "software libraries", e.g. global namespace of this applications might be beneficial as well. , etc. 35 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqAR2 Application management, for example: pre-installed applications, abstract notion of the application (i.e. specify w/o executable locations) 113 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD18 Job Description document should offer a new re-usable structure to describe an executable composed as folder and filename +------------------------------------+ | Detailed work on requirement 100 | +------------------------------------+ 100 : http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD3 The Job Description document MUST reference all grid entities in conformance to the GLUE specification Rationale --------- Figure 1 of the 'Job Submission Description Language (JSDL) Specification, Version 1.0' at http://www.ogf.org/documents/GFD.136.pdf] clearly shows that, in order to work correctly, a 'Superscheduler, or Broker, or …' has to match client requirements expressed in the JSDL document to information provided by a Grid Information System. Therefore, it is essential that client requirements on entities described by GLUE use only GLUE classes and attributes. For XML purposes, I propose to use the 'glue' namespace specified at http://schemas.ggf.org/glue/2008/05/spec_2.0_d42_r01 JSDL elements clearly incompatible with GLUE 2.0 ------------------------------------------------ Searching for JSDL elements clearly incompatible with GLUE 2.0 at http://www.ogf.org/documents/GFD.147.pdf I have found following ones (but careful study by other persons could perhaps find other ones) : - JSDL 'ProcessorArchitectureEnumeration' specified in JSDL section 5.2.1 and used by the 'CPUArchitectureName' element specified in JSDL section 6.4.15 : The corresponding GLUE 2.0 enumeration is 'Platform_t' specified in GLUE 2.0 appendix B.26. While some JSDL values (such as 'powerpc' and 'sparc') match GLUE 2.0 values, some other JSDL values (such as 'x86_64', 'x86_32' and 'ia64') do NOT match GLUE 2.0 values (which are respectively 'amd64', 'i386' and 'itanium'). Therefore, I propose to deprecate JSDL 'ProcessorArchitectureEnumeration' and replace it with GLUE 2.0 'Platform_t' enumeration (for XML, inside the above described 'glue' namespace). - JSDL 'OperatingSystemTypeEnumeration' specified in JSDL section 5.2.3 and used by the 'OperatingSystemName' element specified in JSDL section 6.4.12 :\\ The corresponding GLUE 2.0 enumerations are 'OSFamily_t' specified in GLUE 2.0 appendix B.23 and 'OSName_t' specified in GLUE 2.0 appendix B.24.\\ GLUE 2.0 permits the client to specify the desired OS either through a vague requirement ('OSFamily' attribute) or through a precise requirement ('OSName' attribute).\\ Therefore, I propose to deprecate JSDL 'OperatingSystemTypeEnumeration' and replace it with the GLUE 2.0 'OSFamily_t' and 'OSName_t' enumerations (for XML, inside the above described 'glue' namespace). Practical usage of the 2 previous proposals permitting backward compatibility should be easily achieved using the JSDL 'other' value as described in JSDL section 4.3 'Semantics of the JSDL “other” Value'. Please study and criticize the above proposals. Do not hesitate to add comments and suggestions for improvements at http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD3 Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 1

Re: [Pgi-wg] Reminder & Agenda: PGI Telcon 2010-12-09; 3:30 pm CET
by Luigi Zangrando 09 Dec '10

09 Dec '10

Hi Morris, unfortunately today I cannot attend to the meeting because of a two days long INFN internal meeting. Cheers, Luigi On Thu, 9 Dec 2010 15:23:26 +0100, Morris Riedel wrote > Dear PGI team, > > just a gentle reminder about our usual telcon today. > > (1) > Telcon-System and Screen-Sharing > > http://webconf.vc.dfn.de/ogf-pgi-wg/ > > No login is required. Just enter as 'guest' with your real world name. > > (2) > Proposed agenda: > > (a) > JSDL Discussions > Focus setting > (Etienne and Morris) > > (b) > Other specification elements > (All) > > (c) > AOB > > Please feel free to add any other topic on the agenda that I may have > missed. > > Your co-chair, > Morris > > ------------------------------------------------------------ > Morris Riedel > Deputy Division Leader > Distributed Systems and Grid Computing Division > > Jülich Supercomputing Centre (JSC) > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel -- Open WebMail Project (http://openwebmail.org)

1 0

Re: [Pgi-wg] Reminder & Agenda: PGI Telcon 2010-12-09; 3:30 pm CET
by Steve Crouch 09 Dec '10

09 Dec '10

Apologies for not being able to join the call this afternoon, I have a report which urgently needs to be completed today. Cheers Steve On 09/12/2010 14:23, Morris Riedel wrote: > Dear PGI team, > > just a gentle reminder about our usual telcon today. > > > (1) > Telcon-System and Screen-Sharing > > http://webconf.vc.dfn.de/ogf-pgi-wg/ > > No login is required. Just enter as 'guest' with your real world name. > > > > (2) > Proposed agenda: > > (a) > JSDL Discussions > Focus setting > (Etienne and Morris) > > (b) > Other specification elements > (All) > > (c) > AOB > > Please feel free to add any other topic on the agenda that I may have > missed. > > > Your co-chair, > Morris > > > ------------------------------------------------------------ > Morris Riedel > Deputy Division Leader > Distributed Systems and Grid Computing Division > > Jülich Supercomputing Centre (JSC) > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel > > > > > > _______________________________________________ > Pgi-wg mailing list > Pgi-wg(a)ogf.org > http://www.ogf.org/mailman/listinfo/pgi-wg -- Dr Stephen Crouch, Software Architect, OMII-UK, School of Electronics and Computer Science, Room 4067, Level 4, Building 32, University of Southampton, Highfield, Southampton SO17 1BJ Tel: +44 (0)23 8059 8787 EMail: s.crouch(a)omii.ac.uk Fax: +44 (0)23 8059 3045 WWW: http://www.ecs.soton.ac.uk/~stc

1 0

Reminder & Agenda: PGI Telcon 2010-12-09; 3:30 pm CET
by Morris Riedel 09 Dec '10

09 Dec '10

Dear PGI team, just a gentle reminder about our usual telcon today. (1) Telcon-System and Screen-Sharing http://webconf.vc.dfn.de/ogf-pgi-wg/ No login is required. Just enter as 'guest' with your real world name. (2) Proposed agenda: (a) JSDL Discussions Focus setting (Etienne and Morris) (b) Other specification elements (All) (c) AOB Please feel free to add any other topic on the agenda that I may have missed. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel Deputy Division Leader Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel

1 0

Re: [Pgi-wg] Reminder & Agenda: PGI Telcon 2010-12-02; 3:30 pm CET
by Oxana Smirnova 02 Dec '10

02 Dec '10

Hi, > > Unfortunately, several people (Etienne, Luigi, Michaela, NDGFs?, etc.) already announced that they can't join. Indeed, all NDGF people are stuck in all-hands meeting (this includes Michaela and myself) Cheers, Oxana > > Therefore, we have only a brief call essentially synchronize with each other. > > > (1) > Telcon-System and Screen-Sharing > > http://webconf.vc.dfn.de/ogf-pgi-wg/ > > No login is required. Just enter as 'guest' with your real world name. > > > > (2) > Proposed agenda: > > (a) > Sync : Where are we? > > (b) > Call for comments : process thoughts Oxana > > (c) > Requirement Discussions (Etienne E-Mail) > (Etienne not available so call next week then) > > (d) > AOB > > Please feel free to add any other topic on the agenda that I may have > missed. > > > Your co-chair, > Morris > > ------------------------------------------------------------ > Morris Riedel > Deputy Division Leader > Distributed Systems and Grid Computing Division > > Jülich Supercomputing Centre (JSC) > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel > > > > > _______________________________________________ > Pgi-wg mailing list > Pgi-wg(a)ogf.org > http://www.ogf.org/mailman/listinfo/pgi-wg

1 0

Reminder & Agenda: PGI Telcon 2010-12-02; 3:30 pm CET
by Morris Riedel 02 Dec '10

02 Dec '10

Dear PGI team, just a gentle reminder about our usual telcon today. Unfortunately, several people (Etienne, Luigi, Michaela, NDGFs?, etc.) already announced that they can't join. Therefore, we have only a brief call essentially synchronize with each other. (1) Telcon-System and Screen-Sharing http://webconf.vc.dfn.de/ogf-pgi-wg/ No login is required. Just enter as 'guest' with your real world name. (2) Proposed agenda: (a) Sync : Where are we? (b) Call for comments : process thoughts Oxana (c) Requirement Discussions (Etienne E-Mail) (Etienne not available so call next week then) (d) AOB Please feel free to add any other topic on the agenda that I may have missed. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel Deputy Division Leader Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel

1 0

OGF PGI : I will probably NOT be available Thursday afternoon 02 December 2010
by Etienne URBAH 30 Nov '10

30 Nov '10

Morris and Johannes, Concerning OGF PGI : I will be on vacation from Wednesday 01 to Friday 03 December 2010. So, I will probably NOT be available Thursday afternoon 02 December 2010. If a telephone conference takes place, could you take minutes and publish them ? Thank you in advance. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

2 1

Re: [Pgi-wg] No PGI Telcon Today - Let's go and work
by Etienne URBAH 25 Nov '10

25 Nov '10

Morris, Johannes and all, No telcon today does NOT mean NO work : 1) In order to taking into account GLUE 2.0 Capability for Security, you can study my proposal of specification at http://forge.gridforum.org/sf/go/doc16157 and criticize it. 2) In order to taking into account GLUE 2.0 classes and attributes inside JSDL for : - Data staging, - SPMD and MPI, - Application Profile, - Any other topic which you like ... You can write down as input document : - the list of the relevant requirements, - proposals of specification. 3) If you think that the current requirements are unclear, badly expressed, inadequate or need improvements or comments in any way, you can : - Look at requirements wiki page at http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/Require… - Click on the link at the left of the requirement, - Edit the requirement detailed wiki page, - Write down you name, the current date and your comment or proposal. 4) If you think that the above topics are NOT the adequate priorities, you can study the 'PGI chart of priorities for the detailed specification of PGI requirements' at http://forge.gridforum.org/sf/go/doc16156 and criticize it. 5) You can connect to https://webconf.vc.dfn.de/ogf-pgi-wg/ to study the minutes of the 2 preceding telephone conferences. 6) You can study Oxana's proposal for 'PGI bylaws' in her mail dated 18 November 2010, and criticize it. Let's go and work ! Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Thu, 25/11/2010 15:24, Morris Riedel wrote: > Dear PGI team, > > unfortunately I'm unable to perform a PGI meeting today and had no chance to contact Johannes before. > > We will continue the discussions next week. > > Take care, > Morris > > ------------------------------------------------------------ > Morris Riedel > Deputy Division Leader > Distributed Systems and Grid Computing Division > > Jülich Supercomputing Centre (JSC) > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel

1 0

No PGI Telcon Today
by Morris Riedel 25 Nov '10

25 Nov '10

Dear PGI team, unfortunately I'm unable to perform a PGI meeting today and had no chance to contact Johannes before. We will continue the discussions next week. Take care, Morris ------------------------------------------------------------ Morris Riedel Deputy Division Leader Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel

1 0

OGF PGI - GLUE Capability for Security - First proposal of specification
by Etienne URBAH 24 Nov '10

24 Nov '10

Morris, Johannes and all, Inside OGF PGI, I am trying to perform pragmatic work and provide proposals. So, inside the attached 'Glue-Capability-For-Security.txt' file, I has written down a first proposal of specifications for extensions of the 'Capability_t' type of GLUE 2.0 taking into account requirements 1, 4, 163, 11 and 17. I hope that this proposal is understandable. Please criticize it, in order to improve it . Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

3 4