November 2011 - jsdl-wg - lists.ogf.org

Re: [jsdl-wg] Trackers, artefacts and assignees
by Michel Drescher 22 Nov '11

22 Nov '11

Hi Oxana, Thanks for notifying me. I have added Morris as a WG member so that you can assign artifacts to him. I have also created a provisional new tracker, "[PROVISIONAL] Feature requests" ( http://forge.gridforum.org/sf/tracker/do/listArtifacts/projects.jsdl-wg/tra…) where you can add the artefacts. I also moved the artifacts that Etienne created to that new tracker. Philip, can you please archive the rest of the trackers away? Cheers, Michel On 21 November 2011 22:46, Oxana Smirnova <oxana.smirnova(a)hep.lu.se> wrote: > Hi Michel, > > I see that GridForge is an impenetrable enigma :-) Still, where should I > create tracker artefacts? I can follow Etienne and create them in any > active tracker, but this looks ugly. > > There's another small problem: I can assign artefacts only to the JSDL WG > members, and Morris is not among them. > > Cheers, > Oxana > -- Stichting European Grid Initiative (EGI.eu) P.O. Box 41882, 1009 DB Amsterdam 140 Science Park, 1098 XG Amsterdam The Netherlands F: +31 (0)20 893 2007 M:+31 (0)6 303 726 55 Skype: michel.drescher.egi

1 0

Gridforge system change
by Michel Drescher 18 Nov '11

18 Nov '11

Hi Joel, For the JSDL Working Group, we are using Gridforge Tasks to organise our work (among other stuff). However, we (well, I) seem unable to change the task change approval behaviour to effectively not approve any changes at all; it always enables approval for the status and the end date (see http://forge.gridforum.org/sf/taskmgr/do/adminGeneralSettings/projects.jsdl… ) Can you change this for us please? We would like to disable approval at all for Tasks. Cheers, Michel -- Stichting European Grid Initiative (EGI.eu) P.O. Box 41882, 1009 DB Amsterdam 140 Science Park, 1098 XG Amsterdam The Netherlands F: +31 (0)20 893 2007 M:+31 (0)6 303 726 55 Skype: michel.drescher.egi

3 3

OGF JSDL : We need to define which incarnation (view) of the JSDL document we are trying to specify
by Etienne URBAH 17 Nov '11

17 Nov '11

Michel, Philipp and all, +------------------+ | JSDL Documents | +------------------+ Inside the OGF JSDL WG, we are trying to improve the specifications of the JSDL document. But during the lifetime of a job, there are at least 3 incarnations (or views) of its JSDL document : User JSDL Document ------------------ - This is the document provided by the user submitting the job. - The syntax of this document should permit abstraction and should provide flexibility. - In particular, it is advisable that this document permits : -- Static 'OR' operators for requirements as described at http://forge.ogf.org/sf/go/artf6522 -- Conditional requirements as described at http://forge.ogf.org/sf/go/artf6521 Contextualized JSDL Document ---------------------------- - Out of the User JSDL Document, a matchmaker service produces this Contextualized JSDL Document and submits it to an LRMS (Batch System), which has to understand and execute it. - Therefore, the matchmaker service must solve the flexibility of the User JSDL Document against available resources, and the produded Contextualized JSDL Document must be deterministic. - In particular, the Contextualized JSDL Document : -- may still contain static 'OR' operators for requirements as described at http://forge.ogf.org/sf/go/artf6522 -- should NOT contain conditional requirements as described at http://forge.ogf.org/sf/go/artf6521 Activity Document ----------------- - This Activity Document contains only timestamped history, logs, traces, ... about the job, for purposes of monitoring, forensics, security audits, stats, data mining, ... - Therefore, this Activity Document should contain the User JSDL Document and the Contextualized JSDL Document, but only as embedded text. - It is advisable that this Activity Document indicates, for each user requirement, if the matchmaker service or the LRMS (Batch system) was able to really fulfill this user requirement. +-------------------------------------+ | Target of the JSDL specifications | +-------------------------------------+ My personal opinion is : - The specifications of the Contextualized JSDL Document are already provided by each LRMS (Batch system), such as Condor, LSF, PBS, SGE, ... - The target of the JSDL specifications which we have to improve is the User JSDL Document. - We should also take into account the existence of the 2 other documents, and describe the impact of the JSDL specifications on them when relevant. +--------------+ | Conclusion | +--------------+ - Please study carefully the definitions which I gave above for the 3 documents. Do not hesitate to criticize and provide suggestions for improvements. - Please provide also your opinion on which document is the target of the JSDL specifications. Thank you in advance for your work. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Thu, 17/11/2011 15:36, Michel Drescher wrote: > > * The group discussed three "incarnations" of a JSDL document (or views): > > ** The document a user submits, that allows abstraction and flexibility > > ** The contextualised document, which a matchmaker service produced out of solving the flexibility in the submitted version against available resources > > ** The document that describes the current activity as an activity document (see activity schema) > > * Take this discussion out on the mailing list and ask for comments before deciding on scope. > > Project: JSDL-WG

1 0

Fwd: [glue-wg] GLUE 2.0 attributes for usage inside JSDL
by Michel Drescher 17 Nov '11

17 Nov '11

Dear all, Here is the Email thread concerning introducing XQuery expressions in JSDL. The respective document is:http://www.ggf.org/documents/GFD.137.pdf A presentation (by me I think) is: http://www.ogf.org/gf/event_schedule/?id=903 Cheers, Michel ---------- Forwarded message ---------- From: Sergio Andreozzi <sergio.andreozzi(a)egi.eu> Date: 16 November 2011 10:42 Subject: Fwd: [glue-wg] GLUE 2.0 attributes for usage inside JSDL To: Michel Drescher <michel.drescher(a)egi.eu> Hi Michel, The OGF doc is referenced below. Plus you can consider this presentation about extending JSDL with XQuery made by a guy you should know: http://www.ogf.org/gf/event_schedule/?id=903 :) Cheers, Sergio ---------- Forwarded message ---------- From: Sergio Andreozzi <sergio.andreozzi(a)egi.eu> Date: 21 September 2011 12:38 Subject: Re: [glue-wg] GLUE 2.0 attributes for usage inside JSDL To: Etienne URBAH <urbah(a)lal.in2p3.fr> Cc: "John-Paul F. NAVARRO" <navarro(a)mcs.anl.gov>, glue-wg(a)ogf.org, jsdl-wg(a)ogf.org Dear Etienne et Al., The issue of JSDL/GLUE integration was touched few times in the past. If the use case is to express requirements on GLUE-based information, I consider the approach taken in JSDL 1.0 not suitable for a more complex set of information such as coming from GLUE. When selecting a computing service for instance, you may want to express requirements on the characteristics of the endpoint, of the execution environment, of the application environment and on the share. For each computing service, you may have many instances of the subcomponents, but not all are associated. E.g. a certain computing share is defined on top of 2 of the 5 execution environments, so you need to match requirements on the execEnv, on the share and the fact that the two are "in relationships". In the past, we have discussed to have the option to express requirements using an XQuery expression embedded in the JSDL. While this is a generic approach and would make JSDL not depended on GLUE terms (which is a good option as giving more flexibility), it has the drawback of having the need to write queries that may be complex. To mitigate this, you could think about letting the users express requirements with a simple descriptive format from which a query can be generated automatically. See section 5.3 of this document as an example of XQuery expression based on an XML document describing computing resources based on a preliminary draft of GLUE 2 back in 2008: http://www.ggf.org/documents/GFD.137.pdf My recommendation is, before to make any final choice, test the solution on production use cases to verify the suitability. Kind regards, Sergio On 21 September 2011 11:27, Etienne URBAH <urbah(a)lal.in2p3.fr> wrote: > On Tue, 20/09/2011 17:09, Etienne URBAH wrote: >> >> Michael, >> >> Concerning the GLUE 2.0 attributes for usage inside JSDL, I suggest to >> look at following pages : >> >> http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD3 >> >> >> http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… >> >> >> Best regards. >> >> ----------------------------------------------------- >> Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS >> Bat 200 91898 ORSAY France >> Tel: +33 1 64 46 84 87 Skype: etienne.urbah >> Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr >> ----------------------------------------------------- > > > _______________________________________________ > glue-wg mailing list > glue-wg(a)ogf.org > http://www.ogf.org/mailman/listinfo/glue-wg > > -- Sergio Andreozzi - Policy Development Manager - EGI.eu http://www.egi.eu - skype:sergio.andreozzi.egi -- Sergio Andreozzi - Policy Development Manager - EGI.eu http://www.egi.eu - skype:sergio.andreozzi.egi -- Stichting European Grid Initiative (EGI.eu) P.O. Box 41882, 1009 DB Amsterdam 140 Science Park, 1098 XG Amsterdam The Netherlands F: +31 (0)20 893 2007 M:+31 (0)6 303 726 55 Skype: michel.drescher.egi

1 0

Minutes of today's call
by Michel Drescher 17 Nov '11

17 Nov '11

Dear all, Please find the minutes of today's call available at http://forge.gridforum.org/sf/go/doc16358?nav=1 Cheers, Michel -- Stichting European Grid Initiative (EGI.eu) P.O. Box 41882, 1009 DB Amsterdam 140 Science Park, 1098 XG Amsterdam The Netherlands F: +31 (0)20 893 2007 M:+31 (0)6 303 726 55 Skype: michel.drescher.egi

1 0

Invitation to next conference call
by Michel Drescher 17 Nov '11

17 Nov '11

Dear all, The JSDL WG will have a conference call on 17 November 13:30 - 14:30 UTC. For local timezone conversions please visit http://www.timeanddate.com/worldclock/meetingdetails.html?year=2011&month=1… The proposed agenda is attached to the respective calendar entry available at http://forge.gridforum.org/sf/linkedapplication/do/viewLinkedApplication/pr… Cheers, Michel -- Stichting European Grid Initiative (EGI.eu) P.O. Box 41882, 1009 DB Amsterdam 140 Science Park, 1098 XG Amsterdam The Netherlands F: +31 (0)20 893 2007 M:+31 (0)6 303 726 55 Skype: michel.drescher.egi

4 4

Re: [jsdl-wg] OGF JSDL : Task created: Digest JSDL Use Case document
by Etienne URBAH 17 Nov '11

17 Nov '11

Michel and Philipp, Concerning task1145: Digest JSDL Use Case document : Tracker artifacts ----------------- I have created the 4 following tracker artifacts : - http://forge.gridforum.org/sf/go/artf6519 : Study GLUE 2.0 Conceptual Model of the Computing Service - http://forge.gridforum.org/sf/go/artf6520 : Study, criticize and improve 'GLUE 2 Attributes for Use in JSDL' document - http://forge.gridforum.org/sf/go/artf6521 : Study feasibility, syntax and semantics of conditional requirements in JSDL - http://forge.gridforum.org/sf/go/artf6522 : Study feasibility, syntax and semantics of the OR relational operator for requirements in JSDL Can each member of the JSDL WG take a look at them ? New Tracker 'Workload from JSDL Use Case document' -------------------------------------------------- In order to gather these tracker artifacts, I would like to create a new Tracker named 'Workload from JSDL Use Case document', but I currently do NOT have the right to create new Trackers. Could you create this new Tracker yourself, or grant me this creation right ? For the moment, I have created the above tracker artifacts inside the 'Activity schema' Tracker, and I hope that I will be able to move them to the right Tracker soon. Thank you in advance for your help. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Thu, 10/11/2011 15:56, SourceForge Administrator wrote: > > Project: JSDL-WG > Folder: 2011 > > task1145: Digest JSDL Use Case document > > Description: Digest the JSDL Use case document (https://forge.gridforum.org/sf/go/doc16258?nav=1) into tracker artefacts. > > Created on 11/10/2011 by Michel Drescher > > > To view the Task, go to: > http://forge.ogf.org/sf/go/task1145

1 0

Consolidated minutes from PGI Lyon sessions
by Wieder, Philipp 16 Nov '11

16 Nov '11

Dear All, please find attached a consolidated list of what is important for JSDL from the outcomes of the PGI session in Lyon. Actually the idea was to compile this into tracker, but I think we need to discuss the implications on some lengthy discussions before we actually make trackers. Best regards, Philipp.

1 0

Invitation to today's conference call
by Michel Drescher 10 Nov '11

10 Nov '11

Dear all, The JSDL WG will have a conference call today at 13:30 - 14:30 UTC. For local timezone conversions please visit http://www.timeanddate.com/worldclock/meetingtime.html?iso=20111110&p2=48&p… The proposed agenda is attached to this Email. Cheers, Michel -- Stichting European Grid Initiative (EGI.eu) P.O. Box 41882, 1009 DB Amsterdam 140 Science Park, 1098 XG Amsterdam The Netherlands F: +31 (0)20 893 2007 M:+31 (0)6 303 726 55 Skype: michel.drescher.egi

2 1

Aggregate issue documentation
by Wieder, Philipp 10 Nov '11

10 Nov '11

Dear All, as decided at the last call we need to get up to speed re JSDL requirements. As a first step, please find a list of existing documents which carry relevant information: - The use case collection compiled by Mark [1]. - The GLUE Attributes for Use in JSDL document from Etienne [2] - The Genesis BES-JSDL Extensions document [3] - The PGI Input slides [4] Furthermore we have the JSDL feature request trackers [5], but I assume they are outdated. I think that a review of this material together with the discussions from Lyon should provide a good start for our new effort. In case you have more material, please let the group know. Best regards, Philipp. [1] Use case doc: https://forge.gridforum.org/sf/go/doc16258?nav=1 [2] JSDL/GLUE: https://forge.gridforum.org/sf/go/doc16186?nav=1 [3] BES/JSDL: https://forge.gridforum.org/sf/go/doc16290?nav=1 [4] PGI: https://forge.gridforum.org/sf/go/doc16293?nav=1 [5] https://forge.gridforum.org/sf/tracker/do/listArtifacts/projects.jsdl-wg/tr acker.jsdl_post_v1

1 0