- pgi-wg - lists.ogf.org

Good call today
by Andrew Grimshaw 08 Jul '09

08 Jul '09

All, I felt that we made good progress today. I recollect two things: 1) We agreed on a high level state model - similar to BES but with two new states: pre and post processing, and a renaming of "running" to "delegated". 2) We also agreed that we will follow the BES model of only allowing state transitions between states at the same level, i.e., between high level. The only open question is about explicit transitions back to submitted, or whether it needs to go through finished/failed or something like that. We also discussed the existing (in the proposed diagram) substates, and some extensions, e.g., suspended as a substate of delegated. There are still many discussions on substates to go - but good progress! A

2 1

Next teleconference: tomorrow, wednesday july 8th
by Moreno Marzolla 08 Jul '09

08 Jul '09

Dear all, the next PGI teleconference will be held on wednesday july 8th at 16:00 CET (duration: 1 hour); apologies for the late notice. Call-in details as follow: via Skype call +9900827049931906 (free of charge) ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 Agenda: 1) State model 2) Status update on security 3) AOB Feel free to propose additional topics for discussion. Moreno. -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233 _______________________________________________ Pgi-wg mailing list Pgi-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/pgi-wg

2 1

OGF PGI - Document explaining my drawing of a PGI Job State Model
by Etienne URBAH 01 Jul '09

01 Jul '09

Moreno and all, Concerning my drawing of a PGI Job State Model : Thank you very much for today's telephone conference. From what I have understood, I have to write down a document explaining my drawing : - For each state in the main stream (at the left), add 1 or 2 'delayed' substates. - For each (sub)state, precisely explain : - why and how a job goes in and out of the state, - if notifications are sent to the User (if yes, describe the notification content), - which resources are considered by the Execution Service for the Job but not yet allocated, which are really allocated, and which are NOT. - Explain that the 'Delegated' state covers both : - Execution by a batch system belonging to the original grid infrastructure; in that case, the Execution Service must be able to give to the User the name of the batch queue (+ perhaps local job id), - Forwarding to the Execution Service of another grid infrastructure; in that case, the Execution Service must be able to give to the User the corresponding EPR. - Give examples of workflows : - Simple without User action (automatic stage-in and stage-out) - Complex with User actions (incomplete manual stage-in which has to be completed during a second manual stage-in, ...) If you have proposal for additional substates, or feel any need for further explanations, please let me know. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 3

Next teleconference: tomorrow, wednesday july 1st
by Moreno Marzolla 30 Jun '09

30 Jun '09

Dear all, the next PGI teleconference will be held on wednesday july 1st at 16:00 CET (duration: 1 hour). Call-in details as follow: via Skype call +9900827049931906 (free of charge) ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 Agenda: 1) State model description provided by Etienne: http://forge.gridforum.org/sf/go/doc15697?nav=1 2) Reworked requirements document. I am a bit late with this task (I promised to rewrite at least one of the requirements and circulate the new text to see whether it is acceptable), but I hope to circulate the text today or early tomorrow. Apologies for this delay. 3) AOB Feel free to propose additional topics for discussion. Moreno. -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233

1 0

Next teleconference: tomorrow, wednesday june 23rd
by Moreno Marzolla 23 Jun '09

23 Jun '09

Dear all, the next PGI teleconference will be held on wednesday june 23rd at 16:00 CET (duration: 1 hour). Call-in details as follow: via Skype call +9900827049931906 (free of charge) ordinary phone numbers (local rates) with the 9931906 conference number: Austria 0820 401 15470 Belgium 0703 57 134 France 0826 109 071 Germany +49 (0) 180 500 9527 Switzerland 0848 560 397 Agenda: 1) State model (http://forge.ogf.org/sf/go/doc15655?nav=1) 2) Requirements: see - "Execution Service Strawman" http://forge.ogf.org/sf/go/doc15590?nav=1 - "Comments on GES Strawman" http://forge.ogf.org/sf/go/doc15633?nav=1 - "GES realization via existing specifications" (which contains a distilled list of requirements) http://forge.ogf.org/sf/go/doc15630?nav=1 3) AOB Feel free to propose additional topics for discussion. Moreno. -- Moreno Marzolla INFN Sezione di Padova, via Marzolo 8, 35131 PADOVA, Italy EMail: moreno.marzolla(a)pd.infn.it Phone: +39 049 8277103 WWW : http://www.dsi.unive.it/~marzolla Fax : +39 049 8756233

1 1

Wednesday PGI Call
by David Wallom 19 Jun '09

19 Jun '09

Hi Morris, Balazs and Moreno, For the next PGI call on Wednesday can I suggest that we put in a concerted effort to complete the requirements document so that we are clear actually what we as a group are working towards satisfying. That can either be the completion of the longer version from Balazs or the shortened version from Andrew. Have a good weekend David

1 0

Re: [Pgi-wg] Call today?
by David Wallom 19 Jun '09

19 Jun '09

HI Morris. Why are the chairs discussing the progress of the group without the rest of the group, i.e. In open session? David On 19/06/2009 14:06, "Morris Riedel" <m.riedel(a)fz-juelich.de> wrote: > Hi Andrew, others, > > we have currently discussions among the chairs of how we continue with PGI > et al., therefore we continue the PGI calls hopefully on Wednesday and not > today. > > My apologies, > Morris > > > ------------------------------------------------------------ > Morris Riedel > SW - Engineer > Distributed Systems and Grid Computing Division > Jülich Supercomputing Centre (JSC) > Forschungszentrum Juelich > Wilhelm-Johnen-Str. 1 > D - 52425 Juelich > Germany > > Email: m.riedel(a)fz-juelich.de > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel > Phone: +49 2461 61 - 3651 > Fax: +49 2461 61 - 6656 > > Skype: MorrisRiedel > > "We work to better ourselves, and the rest of humanity" > > Sitz der Gesellschaft: Jülich > Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 > Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe > Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), > Dr. Ulrich Krafft (stellv. Vorsitzender) > > > From: pgi-wg-bounces(a)ogf.org [mailto:pgi-wg-bounces@ogf.org] On Behalf Of > Andrew Grimshaw > Sent: Friday, June 19, 2009 3:03 PM > To: pgi-wg(a)ogf.org > Subject: [Pgi-wg] Call today? > > > > > _______________________________________________ > Pgi-wg mailing list > Pgi-wg(a)ogf.org > http://www.ogf.org/mailman/listinfo/pgi-wg

3 3

Re: [Pgi-wg] Call today?
by David Wallom 19 Jun '09

19 Jun '09

Hi Morris, Am I to take it from this that you/balzas/moreno are not going to be participating in future, are you not considering yourselves aligned with where we are considering PGI should be going? Is there anyone else on this list that would like these discussions carried out in the open?? David On 19/06/2009 14:52, "Morris Riedel" <m.riedel(a)fz-juelich.de> wrote: > Hi David, > >> >- Why are the chairs discussing the progress of the group without the rest >> of the group, i.e. In open session? > > It basically breaks down to the question which chair can (and is willing to) > spend which time on which elements of PGItherefore rather personal > discussions among us in order to identify how we can bring forward PGI most > effectively! > > For now, I can certainly state that next Wednesday is a call as usual even > when I have to chair it ;-) > > Take care, > Morris > > > ------------------------------------------------------------ > Morris Riedel > SW - Engineer > Distributed Systems and Grid Computing Division > Jülich Supercomputing Centre (JSC) > Forschungszentrum Juelich > Wilhelm-Johnen-Str. 1 > D - 52425 Juelich > Germany > > Email: m.riedel(a)fz-juelich.de > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel > Phone: +49 2461 61 - 3651 > Fax: +49 2461 61 - 6656 > > Skype: MorrisRiedel > > "We work to better ourselves, and the rest of humanity" > > Sitz der Gesellschaft: Jülich > Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 > Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe > Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), > Dr. Ulrich Krafft (stellv. Vorsitzender) > > > From: David Wallom [mailto:david.wallom@oerc.ox.ac.uk] > Sent: Friday, June 19, 2009 3:48 PM > To: Riedel, Morris; 'Andrew Grimshaw'; pgi-wg(a)ogf.org > Cc: Steven Newhouse > Subject: Re: [Pgi-wg] Call today? > Importance: High > > HI Morris. > > Why are the chairs discussing the progress of the group without the rest of > the group, i.e. In open session? > > David > On 19/06/2009 14:06, "Morris Riedel" <m.riedel(a)fz-juelich.de> wrote: > Hi Andrew, others, > > we have currently discussions among the chairs of how we continue with PGI > et al., therefore we continue the PGI calls hopefully on Wednesday and not > today. > > My apologies, > Morris > > > ------------------------------------------------------------ > Morris Riedel > SW - Engineer > Distributed Systems and Grid Computing Division > Jülich Supercomputing Centre (JSC) > Forschungszentrum Juelich > Wilhelm-Johnen-Str. 1 > D - 52425 Juelich > Germany > > Email: m.riedel(a)fz-juelich.de > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel > Phone: +49 2461 61 - 3651 > Fax: +49 2461 61 - 6656 > > Skype: MorrisRiedel > > "We work to better ourselves, and the rest of humanity" > > Sitz der Gesellschaft: Jülich > Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 > Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe > Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), > Dr. Ulrich Krafft (stellv. Vorsitzender) > > > From: pgi-wg-bounces(a)ogf.org [mailto:pgi-wg-bounces@ogf.org] On Behalf Of > Andrew Grimshaw > Sent: Friday, June 19, 2009 3:03 PM > To: pgi-wg(a)ogf.org > Subject: [Pgi-wg] Call today? > > > > _______________________________________________ > Pgi-wg mailing list > Pgi-wg(a)ogf.org > http://www.ogf.org/mailman/listinfo/pgi-wg >

2 1

Call today?
by Andrew Grimshaw 19 Jun '09

19 Jun '09

2 1

Analysis results of PGI job state model
by m.riedel＠fz-juelich.de 11 Jun '09

11 Jun '09

Hi all, I try to summarize the analysis of the state model, which we took as a basis on the telcon: http://forge.ogf.org/sf/docman/do/downloadDocument/projects.pgi-wg/docman.r… (doc15655: PGI Job State Model (available as ZARGO, XMI and PNG) ) This state model is a good starting point for discussion, however an analysis reveal still a few uncertain points: (1) Data-staging is not indicated although required - in that context we might even distinguish between manual/auto data-staging states (2) A restart state/possibility/transition is required at least for failed jobs - in that context it might even worth to consider restarts of succesful jobs that might only operated on 'wrong data' manually provided by the end-user during stagings - benefit: keep descriptions of jobs (3) reflection of hiearchy: Initially in Geneva we agreed to have kind of an approach to get a hierarchical process update. In other words, once a job is delegated, we also want to know whether the job is in delegated:Running or delegated:Pending and such like. Hence, we need an approach of desribing hiearchies in the state model missing in the current version. We have an agreement between gLite, ARC, & UNICORE once these points are part of the state model. Did I forgot something? Please add your comments. Take care, Morris -------------------------------------------------------------------------------- Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Central Institute of Applied Mathematics Research Centre Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/zam/ZAMPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel 'We work to improve ourselves and the rest of mankind.' ------------------------------------------------------------------- ------------------------------------------------------------------- Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------- -------------------------------------------------------------------

2 2