- pgi-wg - lists.ogf.org

GIN Demonstrations at Supercomputing 2009
by Morris Riedel 17 Nov '09

17 Nov '09

Hi GIN folks, under the umbrella of the GIN community group serveral projects prepared demonstrations of interoperability / interoperation use cases for the Supercomputing 2009 Conference in Portland, Oregon, USA. In order to get an overview where demonstrations can be seen, I created a wiki page like last year: http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GINSuperCo… I would like to ask any GIN members that would like to demonstrate something in the context of interop* to edit this wiki page and put in your information. Please keep the structure as is in order to retain the overview. Thank you very much! Your co-chair, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

createActivity operation: lease
by Luigi Zangrando 15 Oct '09

15 Oct '09

Dear all, this mail starts the thread about the lease operation. Please have a look at the document INFN-TC-09-3.pdf (pp. 12, 15) available at link http://www.lnf.infn.it/sis/preprint/detail.php?id=5147 in which is described the concept of the lease mechanism in CREAM. best regards, Luigi

2 1

Meeting on 2009-10-09, 16:00 (CET) Notes
by Johannes Watzl 09 Oct '09

09 Oct '09

Dear all, please see the notes from today's meeting below. Best, Johannes Participants: Luigi, David, Johannes, Morris, Etienne 1) Look at the minutes from last time. 2) Discussion: createActivity action createMultiplteActivity David: ordinary JSDL? - means not going to a new JSDL -> meet in the middle David: SRM, SRB ftp, gridftp? Morris: ftp, gridftp still in scope SRB partly the same approach document initial version not covering data staging overall overview, two month out. only few comments from Etienne no crucial comments need for reference implementation PGI profile on top of BES 2.0 proceed with the reference implementation and get out with the PGI writings in parallel to the implementation parts from Andrew, parts from other standards Go to document: Execution port type: Any question to the execution port type interface? Continue with 2nd chapter: Action for Balazs and Morris: GLUE 2 tunings, exectution port type Action for Balazs and Morris: fault mechanism createActivity: discussing of possible fault parameter sweep not agree to transaction approach, not wanted currently browsing all epr Morris: postpone transaction go into the vector operation Luigi: transaction is not important at the moment all jobs are single jobs, not interested in grouping jobs at the moment no reason to change transaction Etienne: out of scope Morris: it is not only grouping - it is a bit more would not call out of scope - not every partner is represented today 2) createActivity operation stresses changeability of BES, OGSA-BES2.0 how much BES has to be tweaked to move to our approach in the reference implementation epr is there some problem with this? no data staging how could data staging work? extend a little bit partly covered by PGI service extend the usage of credentials Action for Morris: security aspects for credentials in data staging typical way of doing JSDL not invent something new provide more protocols hierarchical approach to provide more functionality data push from a client perspective users from ARC, gLite mentioned this partly related to the state model Action for Etienne: how much of the createActivity operation is covered by the state model? (client initiated data staging) other side effect: hold points continue operation postpone and continue operation keep out of the question now focus on different aspects figure of the process published (Morris) Action for Morris: createActivite figure of process should be delivered Action for Morris: ask Shahbaz dataurl createActivity Requests: fearly easy AGU JSDL working title quite a long discussion what activities are valid look behind the response JSDL element is dropped - no error other implementations return an error if dropped. have a look on Job description document validation XML valid or not? next level: check document according to the schema is the sematics the same as we understand? important to check the semantic services are not really supporting parts of description should have somewhere the information what kind of data staging information is provided agreed to have this list. how this can be nailed down Action to all: what is meant by service capabilities? link to GLUE2? influence? final discussion was what is understood by match making never ignore things if we take this JSDL doc - in the past simply ignored it leading to the point -> never a fault -> user thought everything is fine consensus: not ignore things any more submit state: Action for Etienne and Luigi: have a look at submit state email with answer email discussion will go on. Question to Lugi: last tbd in createactivity: lease? Luigi: each job has an attribute for basically the time to live of the job renewed by client as long the client and the service can talk when lease expires the job is removed from both sides Action for Luigi: email: Subject createActivity operation, lease start email thread AOB? Etienne: lease? what is the relationship with the timeline of the proxy Luigi: not related, but depends on the implementation proxy can be renewed and lease can also be renewed no true relationship between lease and proxy -> include in email. Actions for Johanens: action list also on email remember people before next meeting, tasks David: push Morris comments on BES -- _ _ _ _ _ _ Johannes Watzl |\/| |\ | |\/| Institut für Informatik / Dept. of CS | | | \| | | Ludwig-Maximilians-Universität München ======= TEAM ======= Oettingenstr. 67, 80538 Munich, Germany Room D0.5, Phone +49-89-2180-9162 Munich Network Management Team Email: watzl(a)nm.ifi.lmu.de Münchner Netz-Management Team http://www.nm.ifi.lmu.de/~watzl

2 1

Actions from 2009-10-09
by Johannes Watzl 09 Oct '09

09 Oct '09

Dear all, please see below the actions defined in the meeting today Best, Johannes - Action for Balazs and Morris: GLUE 2 tunings, exectution port type Action for Balazs and Morris: fault mechanism in the reference implementation epr - Action for Morris: security aspects for credentials in data staging - Action for Etienne: how much of the createActivity operation is covered by the state model? (client initiated data staging) - Action for Morris: createActivite figure of process should be delivered - Action for Morris: ask Shahbaz dataurl createActivity - Action to all: what is meant by service capabilities? link to GLUE2? influence? - Action for Etienne and Luigi: have a look at submit state email with answer email discussion will go on. - Action for Luigi: email: Subject createActivity operation, lease start email thread -- _ _ _ _ _ _ Johannes Watzl |\/| |\ | |\/| Institut für Informatik / Dept. of CS | | | \| | | Ludwig-Maximilians-Universität München ======= TEAM ======= Oettingenstr. 67, 80538 Munich, Germany Room D0.5, Phone +49-89-2180-9162 Munich Network Management Team Email: watzl(a)nm.ifi.lmu.de Münchner Netz-Management Team http://www.nm.ifi.lmu.de/~watzl

1 0

next teleconference: 16:00 (CET) Friday, 9th October
by Balazs Konya 09 Oct '09

09 Oct '09

Dear All, The next call is scheduled according to our usual timetable: 16:00 CET, Friday 9th October Proposed agenda: Continue the discussion of the AGU strawman document which was started on last Friday (btw, Johannes please send out the meeting notes). In particular the CreateActivity and ChangeStatusActivity operations will be discussed. The later will pull in the statemodel as well. The document is available from the gridforge, v0.36 has just been uploaded which contains minor editorial fixes: AGU Strawman_rendering http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… Call details (the usual hidefconferencing facility): Friday, 9th October at 16:00 CET (duration: 1 hour) via Skype call +9900827049931906 (free of charge) ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 regrds, Balazs -- Balázs Kónya NorduGrid Collaboration http://www.nordugrid.org Lund University balazs.konya(a)hep.lu.se High Energy Physics phone: +46 46 222 8049 BOX 118, S - 221 00 LUND, Sweden fax: +46 46 222 4015

3 3

next teleconference: 16:00 (CET) Friday, 2nd October
by Balazs Konya 01 Oct '09

01 Oct '09

Dear All, This is a reminder about the 2nd October, Friday PGI call where we are going to start the discussion of the v.035 of the Strawman rendering document: http://forge.ogf.org/sf/go/doc15628?nav=1 Call details (the usual hidefconferencing facility): Friday, 2nd October at 16:00 CET (duration: 1 hour) via Skype call +9900827049931906 (free of charge) ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 Regards, Balazs Konya Morris Riedel wrote on 2009-09-10: > Hi PGI team, > > we agreed in one of the last telcons to have a rather long comment period on > the PGI input documents mentioned below in my first e-mail from 31 of July. > > We also discussed to start the discussions from mid + end of September, > however, having not yet received any comments, we extend the group internal > comment period until start of October. But then it's really time to proceed > with our efforts. > > Hence, that means we should have the discussions about this PGI input > documents on.. > > 2nd October 16:00 CET > > Please plan accordingly and we encourage folks to provide extensive comments > in advance so that the telcons can run more effectively. > > Take care, Morris & Balázs > > -----Original Message----- From: pgi-wg-bounces(a)ogf.org > [mailto:pgi-wg-bounces@ogf.org] On Behalf Of Morris Riedel Sent: Friday, July > 31, 2009 12:30 PM To: pgi-wg(a)ogf.org Subject: [Pgi-wg] Update of some PGI > input documents > > Hi PGI team, > > some team members of the middlewares ARC, gLite, and UNICORE (AGU) found a > bit time to update their input documents to the PGI process: > > (1) To ensure an open process, we put the updated version into the PGI OGF > space: > > A) strawman_rendering (http://forge.ogf.org/sf/go/doc15628?nav=1) > > Note that the document has still some limitations such as: a) job state model > is not fully integrated and thus contradicts to the rest of the rendering > document since we also have some inputs for the discussion of it in the next > weeks b) some formatting glitches: e.g. would be nice to have section > headers, numbered, the table of content contain sections down to level 5. c) > agreements only between ARC, gLite and UNICORE while a broader consensus with > the other interested members of PGI is missing (i.e. GENESIS, EDGES) and to > be discussed d) still some open questions that should be discussed in the > broader PGI community > > B) strawman_functionality (http://forge.ogf.org/sf/go/doc15736?nav=1) > > Note that this document only got a minor update. > > C) agu_jsdl.xml (http://forge.ogf.org/sf/go/doc15737?nav=1) > > > Focused on needed functionality - not existing JSDL with extensions. > > > (2) Since we don't want to interrupt the currently ongoing fruitful state > model discussions, we expect to continue with them and would suggest that > members of PGI collect feedback about these updated documents over the next > weeks/vacation period. > > Once the state model has been reasonable stable we can work on the feedback > of the updated documents together and come to agreements between us all. > > (3) Since we don't like an emerging specification that is not really > implemented we are about to start a reference implementation of it that might > be demonstrated at OGF or other conferences, including its changes following > from the open discussion process among the broader PGI community. > > With kind regards, Morris Riedel Balazs Konya Moreno Marzolla -- Balázs Kónya NorduGrid Collaboration http://www.nordugrid.org Lund University balazs.konya(a)hep.lu.se High Energy Physics phone: +46 46 222 8049 BOX 118, S - 221 00 LUND, Sweden fax: +46 46 222 4015

1 0

Reminder: Update of some PGI input documents and comment period
by Morris Riedel 10 Sep '09

10 Sep '09

Hi PGI team, we agreed in one of the last telcons to have a rather long comment period on the PGI input documents mentioned below in my first e-mail from 31 of July. We also discussed to start the discussions from mid + end of September, however, having not yet received any comments, we extend the group internal comment period until start of October. But then it's really time to proceed with our efforts. Hence, that means we should have the discussions about this PGI input documents on.. 2nd October 16:00 CET Please plan accordingly and we encourage folks to provide extensive comments in advance so that the telcons can run more effectively. Take care, Morris & Balázs ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender) -----Original Message----- From: pgi-wg-bounces(a)ogf.org [mailto:pgi-wg-bounces@ogf.org] On Behalf Of Morris Riedel Sent: Friday, July 31, 2009 12:30 PM To: pgi-wg(a)ogf.org Subject: [Pgi-wg] Update of some PGI input documents Hi PGI team, some team members of the middlewares ARC, gLite, and UNICORE (AGU) found a bit time to update their input documents to the PGI process: (1) To ensure an open process, we put the updated version into the PGI OGF space: A) strawman_rendering (http://forge.ogf.org/sf/go/doc15628?nav=1) Note that the document has still some limitations such as: a) job state model is not fully integrated and thus contradicts to the rest of the rendering document since we also have some inputs for the discussion of it in the next weeks b) some formatting glitches: e.g. would be nice to have section headers, numbered, the table of content contain sections down to level 5. c) agreements only between ARC, gLite and UNICORE while a broader consensus with the other interested members of PGI is missing (i.e. GENESIS, EDGES) and to be discussed d) still some open questions that should be discussed in the broader PGI community B) strawman_functionality (http://forge.ogf.org/sf/go/doc15736?nav=1) Note that this document only got a minor update. C) agu_jsdl.xml (http://forge.ogf.org/sf/go/doc15737?nav=1) Focused on needed functionality - not existing JSDL with extensions. (2) Since we don't want to interrupt the currently ongoing fruitful state model discussions, we expect to continue with them and would suggest that members of PGI collect feedback about these updated documents over the next weeks/vacation period. Once the state model has been reasonable stable we can work on the feedback of the updated documents together and come to agreements between us all. (3) Since we don't like an emerging specification that is not really implemented we are about to start a reference implementation of it that might be demonstrated at OGF or other conferences, including its changes following from the open discussion process among the broader PGI community. With kind regards, Morris Riedel Balazs Konya Moreno Marzolla ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

Call Today?
by Mark Morgan 28 Aug '09

28 Aug '09

Haven't seen any email. Is there a call today? -Mark

2 1

Next teleconference: Wednesday, 5th August 2009
by Balazs Konya 14 Aug '09

14 Aug '09

Dear all, The next PGI teleconference will be held on Wednesday, 5th August at 16:00 CET (duration: 1 hour) Call-in details as follow: via Skype call +9900827049931906 (free of charge) ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 Agenda: 1) State model a) recent updates b) state model integration with the updated strawman rendering document (the announcement on the update of the rendering document http://forge.ogf.org/sf/go/doc15628 is copied below) 2) AOB a) changing the teleconferencing environment? b) PGI call schedule: Wednesdays or Fridays?, summer break? Feel free to propose additional topics for discussion. ----------------------- > Hi PGI team, > > some team members of the middlewares ARC, gLite, and UNICORE (AGU) found a > bit time to update their input documents to the PGI process: > > (1) > To ensure an open process, we put the updated version into the PGI OGF > space: > > A) strawman_rendering (http://forge.ogf.org/sf/go/doc15628?nav=1) > > Note that the document has still some limitations such as: > a) job state model is not fully integrated and thus contradicts to the rest > of the rendering document since we also have some inputs for the discussion > of it in the next weeks > b) some formatting glitches: e.g. would be nice to have section headers, > numbered, the table of content contain sections down to level 5. > c) agreements only between ARC, gLite and UNICORE while a broader consensus > with the other interested members of PGI is missing (i.e. GENESIS, EDGES) > and to be discussed > d) still some open questions that should be discussed in the broader PGI > community > > B) strawman_functionality (http://forge.ogf.org/sf/go/doc15736?nav=1) > > Note that this document only got a minor update. > > C) agu_jsdl.xml (http://forge.ogf.org/sf/go/doc15737?nav=1) > > Focused on needed functionality - not existing JSDL with extensions. > > (2) > Since we don't want to interrupt the currently ongoing fruitful state model > discussions, we expect to continue with them and would suggest that members > of PGI collect feedback about these updated documents over the next > weeks/vacation period. > > Once the state model has been reasonable stable we can work on the feedback > of the updated documents together and come to agreements between us all. > > > (3) > Since we don't like an emerging specification that is not really implemented > we are about to start a reference implementation of it that might be > demonstrated at OGF or other conferences, including its changes following > from the open discussion process among the broader PGI community. > > With kind regards, > Morris Riedel > Balazs Konya > Moreno Marzolla bye, Balazs -- Balázs Kónya NorduGrid Collaboration http://www.nordugrid.org Lund University balazs.konya(a)hep.lu.se High Energy Physics phone: +46 46 222 8049 BOX 118, S - 221 00 LUND, Sweden fax: +46 46 222 4015

3 3

Re: [Pgi-wg] No Telcon Today but Friday 16:00 CET
by Balazs Konya 13 Aug '09

13 Aug '09

Morris Riedel wrote: > Hi PGI team, > > I was informed that the participants of the last telcon agreed on next > meeting to be on Friday 16:00 CET, so there is no telcon today! Actually, it was decided that we return to the Friday 16pm (CET) schedule starting from this week. The regular PGI calls will be on Fridays and not on Wednesdays. bye, Balazs -- Balázs Kónya NorduGrid Collaboration http://www.nordugrid.org Lund University balazs.konya(a)hep.lu.se High Energy Physics phone: +46 46 222 8049 BOX 118, S - 221 00 LUND, Sweden fax: +46 46 222 4015

1 0