- glue-wg - lists.ogf.org

GLUE WG teleconference reminder, Wednesday, May 16, 2012
by JP Navarro 17 May '12

17 May '12

Greetings Glue WG, Coordinates and agenda for tomorrow's GLUE WG teleconference follow: Coordinates: : Wednesday, May 16, 2012 : 15:00-16:00 PM Central European Time (CET), 9:00-10:00 AM US Eastern Time (EST) Teleconference and screen sharing: : https://webconf.vc.dfn.de/ogf-glue-wg/ (Adobe Connect) : Login as Guest using your real name Agenda: 1) Proposal by David Meredith to introduce Service and Endpoint substitution groups (20 minutes) Discussion points: a) What are the benefits for using substitution groups? b) Should we apply this design to Service and Endpoint elements only, or also to other key elements? c) Next steps: Integrate this proposal in the XML rendering document? Any other next steps? 2) Finalizing an XML rendering agreement (20 minutes) Discussion points: a) What are the benefits of globalizing elements? b) Which elements do we want to globalize, should we make all significant elements root elements? c) How to represent cross-references/associations for globalized elements? Background material: - Globalized schema: https://github.com/OGF-GLUE/XSD/blob/master/schema/GLUE2.xsd - TeraGrid/XSEDE schema: https://github.com/OGF-GLUE/XSD/blob/master/schema/teragrid_glue_2.0_r01.xsd 3) Other proposed/outstanding GLUE2 changes (10 minutes) a) EGI service name and type values. What is the goal? Where do we record agreements on Enumerated values? b) Are there other attributes that we need a consistent enumeration for? 4) Future meetings (10 minutes) OGF 35 in Delft, Sunday, June 17, 13:30-15:00, room 1.180 Other agenda items besides discussing each of the above 3 topics? Should we plan to hold more teleconferences? Teleconference to prepare for OGF 35 the week of May 29 thru June 1? See you tomorrow, Shiraz Memon JP Navarro

3 2

Re: [glue-wg] GLUE : Lifetime and persistence of the attributes of the 'Activity' entity
by Etienne URBAH 16 May '12

16 May '12

On Mon, 08/11/2010 18:32, Etienne URBAH wrote: > Balazs, Laurence, Sergio and all, > > > Inside the GLUE 2.0 information model, most entities are clearly > persistent : Once an entity has been created, it exists until it is > explicitly destroyed. > > > The exception is the 'Activity' entity, whose persistence is NOT clear. > In particular : > > > A) Chapter 5.11 'Activity' states : > For instance, a broker Service submits a Grid job to a selected > execution Service; upon completion the execution Service submits a > logging record to an accounting Service. Each of these Services may have > associated an instance of a Grid Activity related to the lifecycle of > the job within the service. All instances refer to the same conceptual > job submitted by the user. > > > B) Chapter 6.9 'ComputingActivity' does NOT mention persistence, but the > attributes of the 'ComputingActivity' entity have in fact various levels > of lifetime and persistence. For example : > > B.a) 'IDFromEndpoint', 'State', 'Error', 'Owner' and 'OtherMessages' > have a meaning as soon as the ComputingActivity has been accepted by the > endpoint, and should be kept in logging records with NO time limit. > > B.b) 'WaitingPosition' has a meaning ONLY during the time when the > ComputingActivity has been accepted by the ComputingManager. As soon as > execution is finished, this attribute has NO meaning anymore. > > B.c) 'LocalIDFromManager', 'LocalOwner' and 'ExecutionNode' have a > direct meaning only during the time when the ComputingActivity is really > executed by the ComputingManager. After the end of the execution, they > only have an historical meaning, permitting to retrieve logging records > inside the logs of the ComputingManager if needed. > > B.d) 'UsedTotalWallTime', 'UsedTotalCPUTime' and 'UsedMainMemory' have a > meaning as soon as the ComputingActivity has been accepted by the > ComputingManager, and should be kept in accounting records (following UR > GFD.98) with NO time limit. > > B.e) 'ExitCode' and 'ComputingManagerExitCode' have a meaning only at > the END of the execution of the ComputingActivity, and should be kept in > accounting records (following the 'Activity Instance Documents > Specification' proposal) with NO time limit. > > > C) Inside some implementations of grid middleware (notably gLite), the > Information System has been designed to optimally manage a limited > amount (a few MB) of information about the grid infrastructure, but NOT > all logging and accounting records generated by Activities. So, the > above mentioned attributes are NOT managed by the Information System, > but by separate services, with adequate lifetime and persistence : > > C.a) All attributes are managed directly by the ComputingService, but > only during the execution of the ComputingActivity. As soon as execution > is finished, the ComputingService forgets everything about the > ComputingActivity. > > C.b) All attributes which need persistence (as required for security > audits) are saved on due time by the ComputingService inside logging > and/or accounting records. Even after execution is finished, these > logging and/or accounting records can be queried through dedicated > logging and accounting services. > > > Finally, the current definition of the 'Activity' entity does NOT > satisfactorily address the question of the lifetime and persistence of > its attributes. > > > I imagine 2 solutions for addressing this question of lifetime and > persistence (as required for security audits) of the attributes of the > 'Activity' entity : > > > 1) Keep the current 'Activity' entity unchanged > ------------------------------------------------ > The first solution is to keep the current 'Activity' entity unchanged, > but clearly indicate that during its lifetime, any activity may be > managed by various services, with various persistence. In particular, > besides the service dedicated to its execution, each Activity should > also managed by logging and accounting services for the persistence of > its attributes. > > This first solution keeps the current information model unchanged, but > requires very precise coordination between the various services in order > to simultaneously manage the SAME entity. > > > 2) Split the current 'Activity' entity > --------------------------------------- > The second solution is to split the current 'Activity' entity into : > > - A 'TransientActivity' entity managed during the adequate time span by > the service dedicated to its execution, > > - An 'ActivityRecord' entity whose instances are all attributes > requiring persistence, with 2 attributes : > - Type : Activity description (JSDL), Log record, Accounting record, ... > - Value > > This second solution breaks the current information model, but handles > more clearly the lifetime of attributes, and is more flexible. > > > In both solutions, the 'Activity' entity is already managed at any time > by at least one service. Then, is it really necessary that the > Information Service ALSO has any knowledge of the ComputingActivity ? > This is an open question. > > > Thank you in advance for : > - studying this question of lifetime and persistence of the attributes > of the 'Activity' entity, > - providing explanations on points which I could misunderstand, > - studying my 2 proposed solutions, > - expressing your opinions. > > > Best regards. > > ----------------------------------------------------- > Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS > Bat 200 91898 ORSAY France > Tel: +33 1 64 46 84 87 Skype: etienne.urbah > Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr > ----------------------------------------------------- >

2 1

GLUE WG teleconference availability and topics
by JP Navarro 07 May '12

07 May '12

Greetings GLUE WG: Shiraz Memon and I would like to invite interested GLUE WG participants to a teleconference to discuss several outstanding topics, including: * David's proposal to introduce Service, Endpoint, and perhaps other substitution groups * Discuss possible consensus for an XML rendering * Are there any other proposed/outstanding GLUE 2 subject that need to be addressed? * Future teleconferences and possible OGF 35 working session Please mark your available for a teleconference on following poll. http://www.doodle.com/c6mex76unsspnufe Please also reply if you would like to propose additional topics for this meeting or other future meetings. We will prioritize if we end up with too much for a one hour meeting. Regards, JP ------------------------------------------------------------------------------ John-Paul Navarro (630) 252-1233 navarro(a)mcs.anl.gov http://www.mcs.anl.gov/~navarro Argonne National Laboratory Mathematics & Computer Science Division TCS Building 240, Office 4154 Argonne, IL 60439 GPG: 4EA9 C86B C0F0 113D 6306 98B7 3649 D6CB EFA8 4133

1 1

proposed changes to glue2 XSD
by david.meredith＠stfc.ac.uk 26 Apr '12

26 Apr '12

Hi everyone, As presented at the last Infosys workshop at the EGI/EMI conference (Munich), please find at the link below a proposal to introduce AbstractService and AbstractEndpoint elements into the glue2.xsd rendering. Please see the readme.txt file contained in the src.zip for details. Also included in the zip file is: - glue2.xsd (with the proposed modifications) - glue2GocdbExtensions.xsd (A schema that imports glue2.xsd and extends the AbstractService and AbstractEndpoint elements in order to define custom Service and Endpoint specialisations. These custom sub types inherit from the base abstract elements). - sample1.xml (an example that is constrained by both glue2.xsd and the extending schema) - sample2.xml (a second example). http://tools.ngs.ac.uk/ngstools/glue2proposal/src.zip Thanks in advance for considering the proposal. David Meredith ========================== David Meredith Scientific Computing Technology eScience Daresbury Laboratory Tel: +44 (0) 1925 603762 Fax: +44 (0) 1925 603100 (Site) Email: david.meredith(a)stfc.ac.uk Skype name: davidismeredith -- Scanned by iCritical.

2 2

proposed changes to glue2 XSD
by david.meredith＠stfc.ac.uk 16 Apr '12

16 Apr '12

Hi everyone, As presented at the last Infosys workshop at the EGI/EMI conference (Munich), please find at the link below a proposal to introduce AbstractService and AbstractEndpoint elements into the glue2.xsd rendering. Please see the readme.txt file contained in the src.zip for details. Also included in the zip file is: - glue2.xsd (with the proposed modifications) - glue2GocdbExtensions.xsd (A schema that imports glue2.xsd and extends the AbstractService and AbstractEndpoint elements in order to define custom Service and Endpoint specialisations. These custom sub types inherit from the base abstract elements). - sample1.xml (an example that is constrained by both glue2.xsd and the extending schema) - sample2.xml (a second example). http://tools.ngs.ac.uk/ngstools/glue2proposal/src.zip Thanks in advance for considering the proposal. David Meredith ========================== David Meredith Scientific Computing Technology eScience Daresbury Laboratory Tel: +44 (0) 1925 603762 Fax: +44 (0) 1925 603100 (Site) Email: david.meredith(a)stfc.ac.uk Skype name: davidismeredith -- Scanned by iCritical.

3 5

REMINDER: OGF34 Oxford PGI/BES/JSDL/GLUE2 Session Today - 1:30pm in Theatre A
by Morris Riedel 13 Mar '12

13 Mar '12

All, just a gentle reminder about our joint group session [1] across PGI/BES/JSDL & GLUE2 today: Tuesday, March 13 1:30 pm - 3:00 pm Location: Lecture Theatre A The session aims to resolve some issues in re-using the XML GLUE2 rendering by other specs such as PGI/JSDL profiles. Several experts of GLUE2 will attend the session! Some initial supporting material for the discussion with 'issues' for the PGI group can be found here [2]. A broad participation from the community and the different OGF groups is appreciated! Take care, Morris [1] http://www.ogf.org/gf/event_schedule/index.php?id=2429 [2] https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.jsdl-wg/… ------------------------------------------------------------ Morris Riedel Deputy Division Leader Federated Systems and Data (FSD) Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/SharedDocs/Personen/IAS/JSC/EN/staff/riedel_m.html

1 0

glue XSD schema questions.
by david.meredith＠stfc.ac.uk 22 Feb '12

22 Feb '12

Hi everyone, Laurence advised me to redirect the following questions to the glue list. Many thanks in advance, David 1) Is this the latest version of the XSD: https://forge.ogf.org/svn/repos/glue/XSD/trunk/schema/GLUE2.xsd 2) (Assuming this is the latest version) - In the GLUE2 specification doc it states "For Grid services requiring a richer set of attributes for the Endpoint, specific models MAY be derived by specializing from the Endpoint class and adding new properties or relationships". However, in the above GLUE2.xsd on line 170, the Service_t defines an 'Endpoint' element that can't be extended with a custom Endpoint specialisation because Endpoint must be of type 'glue:Endoint_t' (<element name="Endpoint" type="glue:Endpoint_t" minOccurs="0" maxOccurs="unbounded"/> ). The problem is that 'Endpoint_t' is not abstract and so can't be substituted with an Endpoint specialisation using a substitution group. Therefore, shouldn't the Endpoint element be defined as abstract? (so that Endpoint could serve as an extension point allowing Endpoint specialisations to be defined using an xsd:substitutionGroup) . E.g. something along the lines of the following (of course this can also be supplemented by also extending base complex types such as your EndpointBase_t): <xsd:element name="Endpoint" abstract="true"/> <xsd:element name="MyEndpoint" substitutionGroup="Endpoint"> Apologies if I have go this wrong or if I have referenced the wrong XSD (or if this question should be re-directed to someone else). Thanks for your help. David Ps, if it's useful, for a more concrete example see the JSDL-PS spec which allows custom sweep functions and parameters to be defined in JSDL (http://www.gridforum.org/documents/GFD.149.pdf) ========================== David Meredith Scientific Computing Technology eScience Daresbury Laboratory Tel: +44 (0) 1925 603762 Fax: +44 (0) 1925 603100 (Site) Email: david.meredith(a)stfc.ac.uk Skype name: davidismeredith -- Scanned by iCritical.

2 1

OGF 34
by stephen.burke＠stfc.ac.uk 09 Jan '12

09 Jan '12

Hi, Can anyone say if there will be any glue-related sessions at OGF 34? Given that it's in Oxford it would be quite easy for me to go if there is anything. Stephen -- Scanned by iCritical.

1 0

Re: [glue-wg] GLUE 2.0 attributes for usage inside JSDL
by Etienne URBAH 21 Sep '11

21 Sep '11

On Tue, 20/09/2011 17:09, Etienne URBAH wrote: > Michael, > > Concerning the GLUE 2.0 attributes for usage inside JSDL, I suggest to > look at following pages : > > http://forge.gridforum.org/sf/wiki/do/viewPage/projects.pgi-wg/wiki/ReqJD3 > > http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… > > > Best regards. > > ----------------------------------------------------- > Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS > Bat 200 91898 ORSAY France > Tel: +33 1 64 46 84 87 Skype: etienne.urbah > Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr > -----------------------------------------------------

2 1

Re: [glue-wg] EVO Booking : OGF preparation of PGI / BES / JSDL from Wed, 14 Sep 11 16:00 +0200 (CEST)
by Etienne URBAH 15 Sep '11

15 Sep '11

Philipp, Steven, Morris, Andrew and all, Concerning the EVO teleconference named 'OGF preparation of PGI / BES / JSDL' on Wednesday 14 September 2011 at 16h CEST (14h UTC) : - I remind everyone that it will be held this Wednesday at http://evo.caltech.edu/evoBeta/koala.jnlp?meeting=MsMiMI282BDMDe9l92Dt9s with password !!jsdlftw - The scope of the agenda is NOT limited to JSDL, but really encompasses BES / JSDL / GLUE / PGI. - Even if I have technical knowledge on all these subjects, I am NOT highly talented as group leader, and I would greatly prefer that the conference leader is a chair of one of the above OGF working groups. In particular, if one of them participates, I would suggest Steven NEWHOUSE, Morris RIEDEL or Andrew GRIMSHAW. - I am quite slow at taking notes, and I would be able to perform this task only if I am NOT the conference leader. Anyway, can anyone volunteer taking notes ? - As input material, I suggest to read 'Requirements for an improved Basic Execution Service (BES)' at http://forge.gridforum.org/sf/go/doc16306 Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Tue, 13/09/2011 20:29, philipp.wieder(a)tu-dortmund.de wrote: > Dear Etienne, > > thank you very much for setting this up. > > The agenda for tomorrow is brief: > - Assess status of input material for the whole day BES/JSDL/GLUE/PGI > session in Lyon (some material is already here [1]) > - Define tentative agenda for the respective session including > + Objectives > + Actions > + Responsibilities > + Roadmap > - Check availability for Lyon > - AOB > > Since I am traveling tomorrow I may not be able to join (I will try via a > mobile connection). Etienne, is it possible for you to lead the conference > in this case and take minutes? > > Best regards, Philipp. > > > [1] > https://forge.gridforum.org/sf/docman/do/listDocuments/projects.jsdl-wg/doc > man.root.background_docs.2011 > > Am 12.09.11 18:33 schrieb "Etienne URBAH" unter<urbah(a)lal.in2p3.fr>: > >> Philipp and all, >> >> Concerning the preparation of the PGI / BES / JSDL sessions at OGF 33 in >> Lyon next week : >> >> I booked an EVO teleconference named 'OGF preparation of PGI / BES / >> JSDL' for Wednesday 14 September 2011 at 16h CEST (14h UTC). >> >> BEWARE that EVO 2.8 fails on MS-Windows XP SP3 with Firefox 6.0.2 and >> Oracle Java 1.7.0, so that you may have to use EVO beta at >> http://evo.caltech.edu/evoBeta/ which I tested successfully. >> >> Access to the EVO teleconference will be provided at >> http://evo.caltech.edu/evoBeta/koala.jnlp?meeting=MsMiMI282BDMDe9l92Dt9s >> with password !!jsdlftw >> >> Thanks in advance to Philipp for providing the agenda. >> >> Best regards. >> >> ----------------------------------------------------- >> Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS >> Bat 200 91898 ORSAY France >> Tel: +33 1 64 46 84 87 Skype: etienne.urbah >> Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr >> ----------------------------------------------------- >> >> >> -------- Original Message -------- >> Subject: EVO Booking : OGF preparation of PGI / BES / JSDL from Wed, 14 >> Sep 11 16:00 +0200 (CEST) >> Date: Mon, 12 Sep 11 17:58:20 +0200 >> From: evosupport(a)vrvs.org >> To: urbah(a)lal.in2p3.fr >> >> Hello Etienne URBAH, >> You have BOOKED a meeting in EVO (http://evo.caltech.edu) >> >> Title: OGF preparation of PGI / BES / JSDL >> Description: Preparation of the PGI / BES / JSDL sessions at OGF 33 in >> Lyon next week >> Community: Universe >> Password: !!jsdlftw >> >> Meeting Access Information: >> - Meeting URL >> http://evo.caltech.edu/evoBeta/koala.jnlp?meeting=MsMiMI282BDMDe9l92Dt9s >> >> - Password: !!jsdlftw >> - Phone Bridge >> ID: 399 7332 >> Password: 0162 >> >> Central European Summer Time (+0200) >> Start 2011-09-14 16:00 >> End 2011-09-14 18:00 >> >> Japan Standard Time (+0900) >> Start 2011-09-14 23:00 >> End 2011-09-15 01:00 >> >> Eastern Daylight Time (-0400) >> Start 2011-09-14 10:00 >> End 2011-09-14 12:00 >> >> Pacific Daylight Time (-0700) >> Start 2011-09-14 07:00 >> End 2011-09-14 09:00 >> >> >> EVO Phone Bridge Telephone Numbers: >> --------------- >> - USA (Caltech, Pasadena, CA) >> +1 626 395 2112 >> >> - Switzerland (CERN, Geneva) >> +41 22 76 71400 >> >> - Slovakia (UPJS, Kosice) >> +421 55 234 2420 >> >> - Italy (INFN, several cities) >> http://server10.infn.it/video/index.php?page=telephone_numbers >> Enter '4000' to access the EVO bridge >> >> - Germany (DESY, Hamburg) >> +49 40 8998 1340 >> >> - USA (BNL, Upton, NY) >> +1 631 344 6100 >> >> - United Kingdom (University of Manchester) >> +44 161 306 6802 >> >> - Australia (ARCS) >> +61 >> Adelaide 08 8463 1011 >> Brisbane 07 3139 0705 >> Canberra 02 6112 8742 >> Hobart 03 623 70281 >> Melbourne 03 8685 8362 >> Perth 08 6461 6718 >> Sydney 02 8212 4591 >> >> - Netherlands (Nikhef, Amsterdam) >> +31 20 7165293 >> Dial '2' at the prompt >> >> - Canada (TRIUMF, Vancouver) >> +1 604 222 7700 >> >> - Czech Republic (CESNET, Prague) >> +420 95 007 2386 >> >> - USA (MIT, Cambridge, MA) >> +1 617 715 4691 >> >> - France (RAP, Paris) >> +33 144 27 81 50 >> >> >> - Skype (tm) (World-wide) >> evo.phone >> See: >> http://evo.caltech.edu/evoGate/Documentation/extclient/skype/skype.html >> >

2 3