- jsdl-wg - lists.ogf.org

Next version of activity instance description
by Philipp Wieder 14 May '10

14 May '10

Dear All, please find a next version of the activity instance description at GF [1]. All major text is now added, a few minor things have to be added, but I wanted to submit a version so you have it early enough for discussion at the next telco. Most open issues are listed here [2], maybe some are already resolved the next time we talk. Best regards, Philipp. [1] https://forge.gridforum.org/sf/go/doc15395?nav=1 [2] https://forge.gridforum.org/sf/go/doc15976?nav=1

1 0

JSDL Teleconference - 28 April 2010 **12:00pm UTC**
by Andreas Savva 27 Apr '10

27 Apr '10

Agenda: 1. Agenda bashing & quick status update 2. Activity instance document specification - Preparing for submission to editor 3. Other business ===== Full call-in details ==== Date: 28 April 2010 Time: UTC: 12 PM EUROPE: UK 1 PM / Europe 2 PM US: EST 8 AM ASIA: JST 9 PM Duration: 1 hour Dial-in numbers (toll): US: +1 718 3541071 (New York) +1 408 9616509 (San Jose) UK: +44 207 3655269 (London) Germany: +49 (0)69 50070802 (Frankfurt) Japan: +81 3 3570 8225 (Tokyo) Other countries: http://tinyurl.com/eg48j User guide: http://tinyurl.com/qknrf Teleconference participant PIN: 4371991 Screen share: http://my.dimdim.com/jsdl -- Andreas Savva Fujitsu Laboratories Ltd

1 0

JSDL General Session Material (OGF28) available at ogf.org and GridForge
by Alexander Papaspyrou 15 Apr '10

15 Apr '10

All, after revising the minutes from the general session (thanks Andreas for your valuable comments), I uploaded them along with all slides from the presenters to both the session pages at http://www.ogf.org/gf/event_schedule/index.php?id=1969 and the usual GridForge location ("Documents/Meeting Materials and Minutes/OGF/GGF Meetings/OGF28") at http://forge.gridforum.org/sf/docman/do/listDocuments/projects.jsdl-wg/docm… Let me know if anything in the minutes or material-wise is missing Best, Alexander -- Alexander Papaspyrou alexander.papaspyrou(a)tu-dortmund.de

1 0

JSDL Teleconference - 14 April 2010 **12:00pm UTC**
by Andreas Savva 14 Apr '10

14 Apr '10

Agenda: 1. Agenda bashing & quick status update 2. OGF28 sessions review - Minutes approval, actions etc 3. Activity instance document specification - Status and work needed to submit the spec for public comment ===== Full call-in details ==== Date: 14 April 2010 Time: UTC: 12 PM EUROPE: UK 12 PM / Europe 1 PM US: EST 7 AM ASIA: JST 9 PM Duration: 1 hour Dial-in numbers (toll): US: +1 718 3541071 (New York) +1 408 9616509 (San Jose) UK: +44 207 3655269 (London) Germany: +49 (0)69 50070802 (Frankfurt) Japan: +81 3 3570 8225 (Tokyo) Other countries: http://tinyurl.com/eg48j User guide: http://tinyurl.com/qknrf Teleconference participant PIN: 4371991 Screen share: http://my.dimdim.com/jsdl

3 3

DCI Federation Protocol WG BoF at OGF28, Munich
by Alexander Papaspyrou 17 Mar '10

17 Mar '10

----- Apologies if you receive multiple copies of this message ----- All, on behalf of the D-Grid Initiative project "D-Grid Scheduler Interoperability" I would like to invite you to join a Birds-of-a-Feather session for a DCI Federation Protocol WG during the upcoming OGF in Munich. The overall topic is the chartering of the group for working on recommendations that allow the federated use of Distributed Computing Infrastructures across the borders of traditionally separate computing infrastructures. The session is currently scheduled for Wednesday, March 17, 10.30 a.m. Please note that, due to collisions with various other sessions and private meetings, this might be subject to change and rescheduled to Wednesday afternoon. A topic summary and session details can be found online at http://www.ogf.org/gf/event_schedule/index.php?id=2030 The agenda for the 90 minute session will be: - Walkthrough the project goals and status of DGSI and prospects for a standard - Collection of potential adopters - Formulation of a draft charter - AOB Feel free to contact me if you have any questions. For a very coarse overview, feel free to have a look at a presentation from the latest CloudScape conference on SlideShare (http://www.slideshare.net/alexanderpapaspyrou/federating-resource-exposure-…) Regards, -- Alexander Papaspyrou alexander.papaspyrou(a)tu-dortmund.de

1 1

Latest version of Activity Instance Description
by Philipp Wieder 16 Mar '10

16 Mar '10

Dear All, please find the latest Activity Instance Description spec. on GF: https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.jsdl-wg/…. It inlcudes the changes from today's session, much more wrt minutes is not necessary. Things to be clarified or added: - Section 4: do we want it - XML Snippet colours have to be adopted (ny me) - Sequence diagram example has to be added - Some references are missing - Security section missing The schemata will be updated soon. Best regards, Philipp.

1 0

Skype access for JSDL session #1
by Philipp Wieder 16 Mar '10

16 Mar '10

Dear All, in case you want to join the session via Skype, just let me know. Best regards, Philipp.

1 0

SPMD woes...
by Andre Merzky 09 Mar '10

09 Mar '10

Hia guys, I'd like to share some thoughts and discussion points from the SAGA group, in respect to the JSDL SPMD spec. Sorry for the long post... At the moment, SAGA has the following job description attributes to specify job multiplicity, which are derived from the JSDL core and JSDL SPMD extension: - SPMDVariation - MPI type etc. - TotalCPUCount - total number of CPUs required by the job - NumberOfProcesses - number of instances of the Executable that the consuming system MUST start - ProcessesPerHost - number of instances of the Executable that the consuming system MUST start per host. - ThreadsPerProcess - number of threads per process (i.e., per instance of the Executable There is not much discussion about SPMDVariation (anymore), but the others are appearently somewhat inconsistent: - processes can be started by the backend, threads can't, so why specify ThreadsPerProcess? How is it to be used by the backend? - hosts can have multiple CPUs - this is not reflected - CPUs can have multiple cores - this is not reflected - cores can have multiple hardware threads - this is not reflected, unless this is what is meant by 'ThreadsPerProcess'? In general, the attributes seem somewhat inconsistent, and not eay to use. Examples: limit the number of hosts to 2, no matter the number of CPUs NumberOfProcesses = 10 ProcessesPerHost = 5 // specify proc per resource limit the number of CPUs to 2, no matter the number of CPUs per host NumberOfProcesses = 10 TotalCPUCount = 2 // specify total resource num Also, there is no way to ensure that an application instance obtains exactly one CPU, unless one limits ProcessesPerHost to 1, which will waste significant resources on multi-CPU systems. I guess the problem really is that JSDL tries to stay out of the resource description business, and thats probably a wise decision. That is what Glue&Co are about to deal with. Nevertheless, the current specs are cumbersome from an *application* perspective. We are curently considering to change our attributes, to SPMDVariation NumberOfProcesses TotalNodeCount TotalSocketCount TotalCoreCount TotalHWThreadCount ProcessesPerNode ProcessesPerSocket (*) ProcessesPerCore ProcessesPerHWThread The 'ProcessesPerXYZ' attributes are here interpreted as upper limits: the backend MUST NOT start more processes per XYZ, but MAY start less. Those attributes are not fully translatable into the JSDL attributes, but map pretty well to other job descriptions so far. The typical use case for us would then boil down to SPMDVariation = MPI NumberOfProcesses = 32 ProcessesPerHWThread = 1 which seems to be what most users want. Other use cases we would be interested in, for example to start one additional IO process per node, would require more attributes and semantics than we are willing to introduce right now, like additional attribs: HWThreadsPerCore HWThreadsPerSocket HWThreadsPerNode CoresPerSocket CoresPerNode SocketsPerNode specification: SPMDVariation = MPI NumberOfProcesses = 32 + TotalNodeCount ProcessesPerNode = HWThreadsPerNode + 1 So, here is the biggie: Is JSDL at some point considering to revise the SPMD spec? If so, can we expect something along the lines above, or is that, aehem, 'out of scope'? If not, how would you propose to align the SAGA use cases with JSDL/Glue/..., so that we still end up with an implementable standards stack? We don't really want to invent our own schemas, as its most likely that it will not map to JSDL then - but we need to cater our use cases one way or the other... Best, Andre. (*) Socket basically stands for CPU, but is supposed to clarify we are not talking about cores. -- Nothing is ever easy.

2 2

JSDL Teleconference - 10 March 2010 **12:00pm UTC**
by Andreas Savva 09 Mar '10

09 Mar '10

Agenda: 1. Agenda bashing & quick status update - OGF28 session agendas, etc 2. Activity instance document schema [Please review and update your artifacts before the call if possible] - Tracker review: status of issues https://forge.gridforum.org/sf/go/projects.jsdl-wg/tracker.activity_schema - Discussion of updated draft and text review https://forge.gridforum.org/sf/go/doc15488?nav=1 3. Other business ===== Full call-in details ==== Date: 10 March 2010 Time: UTC: 12 PM EUROPE: UK 12 PM / Europe 1 PM US: EST 7 AM ASIA: JST 9 PM Duration: 1 hour Dial-in numbers (toll): US: +1 718 3541071 (New York) +1 408 9616509 (San Jose) UK: +44 207 3655269 (London) Germany: +49 (0)69 50070802 (Frankfurt) Japan: +81 3 3570 8225 (Tokyo) Other countries: http://tinyurl.com/eg48j User guide: http://tinyurl.com/qknrf Teleconference participant PIN: 4371991 Screen share: http://my.dimdim.com/jsdl

1 0

JSDL Teleconference - 3 March 2010 **12:00pm UTC**
by Andreas Savva 03 Mar '10

03 Mar '10

Agenda: 1. Agenda bashing & quick status update - OGF28 session agendas, etc 2. Activity instance document schema - Plan to OGF28 - Tracker review: status of issues https://forge.gridforum.org/sf/go/projects.jsdl-wg/tracker.activity_schema - Discussion of updated draft and text review https://forge.gridforum.org/sf/go/doc15488?nav=1 3. Other business - Last call before OGF28 is 10 March ===== Full call-in details ==== Date: 3 March 2010 Time: UTC: 12 PM EUROPE: UK 12 PM / Europe 1 PM US: EST 7 AM ASIA: JST 9 PM Duration: 1 hour Dial-in numbers (toll): US: +1 718 3541071 (New York) +1 408 9616509 (San Jose) UK: +44 207 3655269 (London) Germany: +49 (0)69 50070802 (Frankfurt) Japan: +81 3 3570 8225 (Tokyo) Other countries: http://tinyurl.com/eg48j User guide: http://tinyurl.com/qknrf Teleconference participant PIN: 4371991 Screen share: TBD

3 3