May 2009 - pgi-wg - lists.ogf.org

Re: [Pgi-wg] PGI State Model for discussions (ppt)
by Aleksandr Konstantinov 29 May '09

29 May '09

On Friday 22 May 2009 12:49, Morris Riedel wrote: > Hi PGI team, > > as we discussed in going forward by discussing the state model I tried to > sketch a first version inside the powerpoint file I put on GridForge: > > http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/doc > man.root.input_documents.execution_service.state_model/doc15637 > > > Feel free to use it and make your changes that make it easier to discuss it > in the next telcons / per mailing lists. I have tried to draw a diagram similar to one we are having in ARC but extended a bit with possible use-cases I could think about. I think it makes superset of your diagram. A.K. > > I also put related work about other state models inside it (HPC-FSP & BES). > > Note that I created a sub-folder called state-model inside the Execution > Service folder for it. > > Finally, there are certainly some transitions/states that have to be > discussed (i.e. sub-states hierarchy), but this version might be a good > start. > > > Let's start with the discussion then, > Morris > > ------------------------------------------------------------ > Morris Riedel > SW - Engineer > Distributed Systems and Grid Computing Division > Jülich Supercomputing Centre (JSC) > Forschungszentrum Juelich > Wilhelm-Johnen-Str. 1 > D - 52425 Juelich > Germany > > Email: m.riedel(a)fz-juelich.de > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel > Phone: +49 2461 61 - 3651 > Fax: +49 2461 61 - 6656 > > Skype: MorrisRiedel > > "We work to better ourselves, and the rest of humanity" > > Sitz der Gesellschaft: Jülich > Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 > Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe > Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), > Dr. Ulrich Krafft (stellv. Vorsitzender) > >

4 8

Re: [Pgi-wg] PGI Job State Model for discussions (UML: zargo + xmi + png)
by Etienne URBAH 27 May '09

27 May '09

Hi Steven, Concerning my OGF PGI Job State Model (based on Aleksandr's) : The original data file is Version 1 (with comment 'ZARGO file created by ArgoUML'), available at http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… The ArgoUML tool is open source and available for Windows, Mac OS X and Linux at http://argouml.tigris.org/ Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Wed, 27 May 2009, Steven Newhouse wrote: > Hi Etienne, > > I would suggest you upload the original data file and provide a direct link to the UML tool so others can change the document and propose changes if required. > > Steven > > Dr Steven Newhouse > EGEE Technical Director > Contact Details: http://cern.ch/Steven.Newhouse > EGEE09 Conference 21-25 September, Barcelona - http://egee09.eu-egee.org/ > Call for Sessions - http://indico.cern.ch/conferenceDisplay.py?confId=55893 > > >> -----Original Message----- >> From: pgi-wg-bounces(a)ogf.org [mailto:pgi-wg-bounces@ogf.org] On Behalf >> Of Etienne URBAH >> Sent: 27 May 2009 15:04 >> To: Morris Riedel; aleksandr.konstantinov(a)fys.uio.no; pgi-wg(a)ogf.org >> Cc: edges-na3(a)mail.edges-grid.eu; lodygens(a)lal.in2p3.fr >> Subject: [Pgi-wg] PGI Job State Model for discussions (UML: zargo + xmi >> + png) >> >> Morris, Aleksandr and All, >> >> Concerning the OGF PGI Job State Model (based on Aleksandr's) : >> >> I agree that : - Pre-processing includes Automatic Stage-In. - Delegated includes Running. - Post-processing includes Automatic Stage-Out. >> >> I suggest that : >> >> - Pending should be renamed as Submitted >> >> - Deep internal states do NOT need to be exposed, but states requiring >> User action do. >> - Pre-processing Hold includes Manual Stage-In. - Post-processing Hold includes Manual Stage-Out. >> - Cancellation by the User and Failure detected by the Execution >> Service lead to the same result, so the same state. >> >> Therefore, using the free ArgoUML tool, I have created my own proposal, >> which is available at http://forge.gridforum.org/sf/go/doc15655?nav=1 >> with the ZARGO, XMI and PNG formats. >> >> Please criticize and improve it ! >> >> Best regards. >> >> ----------------------------------------------------- >> Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS >> Bat 200 91898 ORSAY France >> Tel: +33 1 64 46 84 87 Skype: etienne.urbah >> Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr >> ----------------------------------------------------- >> >> >> On Fri, 22 May 2009, Aleksandr Konstantinov wrote: >>> On Friday 22 May 2009 12:49, Morris Riedel wrote: >>>> Hi PGI team, >>>> >>>> as we discussed in going forward by discussing the state model I >>>> tried to sketch a first version inside the powerpoint file I put on >> GridForge: >>>> >> http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi >>>> -wg/doc >>>> man.root.input_documents.execution_service.state_model/doc15637 >>>> >>>> >>>> Feel free to use it and make your changes that make it easier to >>>> discuss it in the next telcons / per mailing lists. >>> I have tried to draw a diagram similar to one we are having in ARC >> but extended a bit with possible use-cases I could think about. >>> I think it makes superset of your diagram. >>> >>> >>> A.K. >>> >>> >>>> I also put related work about other state models inside it (HPC-FSP >> & BES). >>>> Note that I created a sub-folder called state-model inside the >>>> Execution Service folder for it. >>>> >>>> Finally, there are certainly some transitions/states that have to be >>>> discussed (i.e. sub-states hierarchy), but this version might be a >>>> good start. >>>> >>>> >>>> Let's start with the discussion then, Morris >>>> >>>> ------------------------------------------------------------ >>>> Morris Riedel >>>> SW - Engineer >>>> Distributed Systems and Grid Computing Division Jülich >> Supercomputing >>>> Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - >>>> 52425 Juelich Germany >>>> >>>> Email: m.riedel(a)fz-juelich.de >>>> Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel >>>> Phone: +49 2461 61 - 3651 >>>> Fax: +49 2461 61 - 6656 >>>> >>>> Skype: MorrisRiedel >

1 0

Promised document
by Andrew Grimshaw 26 May '09

26 May '09

Colleagues, Last week I promised to deliver a document for discussion tomorrow on how to use existing specification (and profiles on those specifications) to realize the requirements in the April 29 draft GES info document. Attached is a word file that sketches out the solution. The document is not intended to be published - it is to organize a discussion and give you insight into my proposed solution to the requirements. I have also carefully read the GES document and have a number of comments on that as well. I will be sending it later today or tomorrow. My comments on the GES are not necessary to understand the "realization" document. I also encourage you to read the ISV primer. Andrew

8 32

OGF PGI Security and Delegation : GFD.78 : Grid Security Infrastructure Message Specification
by Etienne URBAH 26 May '09

26 May '09

David and All, Concerning Security and Delegation : Many thanks to David GROEP for indicating that document GFD.78 'Grid Security Infrastructure Message Specification' provides very useful information. This document is available at http://www.ogf.org/documents/GFD.78.pdf I have also created a link to it inside http://forge.gridforum.org/sf/docman/do/listDocuments/projects.pgi-wg/docma… Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 0

FW: Reminder GIN on Wednesday Morning
by Morris Riedel 26 May '09

26 May '09

FYI: GIN... ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender) -----Original Message----- From: Morris Riedel [mailto:m.riedel@fz-juelich.de] Sent: Tuesday, May 26, 2009 3:50 PM To: 'gin(a)ogf.org' Subject: Reminder GIN on Wednesday Morning Hi GIN team, just a short reminder for the GIN session at OGF26: Wednesday, May 27 9:00 am - 10:30 am Grid Interoperation Now - Update & Applications ( Redbud) (90 mins) (GIN-CG) Group Discussion We have a couple of confirmed speakers for this session from the greater field of interoperability. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

Reminder PGI Session #2 Security Discussions
by Morris Riedel 26 May '09

26 May '09

Hi PGI team, just a small reminder that the second PGI session will be today as planned: Tuesday, May 26 3:30 pm - 5:00 pm Production Grid Infrastructure (PGI) Standard Working Session (2) ( Redbud) (90 mins) Morris Riedel (PGI-WG) Group Discussion It is planned to have discussions of how we can proceed with profiling/creating our planned security setups. With kind regards, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

PGI Session 1 shifted from Tue to Wed
by Morris Riedel 26 May '09

26 May '09

Hi PGI team, I asked Joel to shift the following session... Tuesday, May 26 1:30 pm - 3:00 pm Production Grid Infrastructure (PGI) Standard Working Session (1) ( Redbud) (90 mins) (PGI-WG) Group Discussion SRM Tuning/Profiling/etc. ... to the following spot... Wednesday, May 27 3:30 pm - 5:00 pm ... because many important participants of the GSM-WG (i.e. SRM) that are part of the data PGI discussions are unfortunately only able to attend OGF tomorrow (one-day-pass). The room is not confirmed yet, but will be announced as soon as I get the information from Joel. Sorry for the inconvenience and late notice. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

YAP - Yet Another Proposal
by Andrew Grimshaw 23 May '09

23 May '09

All, (Note: I started this email before the call - I will finish it but do not believe it will change any minds.) I think defining IDL's will lead to non-interoperation without significant work on wire format .. think CORBA and its failure until IIOP happened. That said, here is a concrete proposal. Start with BES AS IS Create a new porttype BES_Extensions that defines two new functions ActivityResonse [] CreateActivitySet(ActivityDocument []) - based upon the BES create activity The activity response is an EPR or a SOAP 1.1 fault message element Define a StateTransferElement to be a <EPR, Destination_state) where destination state is a string formatted as per the BES specification Define a TransitionResponse to be a <new_state_string | SOAP1.1 fault message) TransitionResponse [] StateTransfer (StateTransferElement []) Profile ActivityEndpoint porttype MUST support getResourceProperties MUST support RNS:list RNS:list MUST return a predefined set of <name, EPR> pairs that contain the job information people want, e.g., session_directory, status Then create a PGI-Basic-Profile Conformance targets MUST handle HPC-BP, HPC-FSE (implies MUST support BES 1.0 FactoryPortType and JSDL) MUST support BES-Extensions MUST return EPRs to resources that support ActivityEndpoint MUST support state model profiles for staging, suspend, whatever_you_want_to_call_the_states_for_ARC if corresponding mechanism is supported MUST support ActivityDocument element <StartInPending> MUST/MAY support notification - we can argue this out - I do not have a strong feeling - we support it, but we also poll I would suggest that we have a separate conformance claim supporting RNS directly. This leaves one big question: How to handle GLUE? For this to be answered requires that the specific elements of GLUE2 to be indentified. Keep in mind the BES authors anticipated GLUE finalizing at some point. That said we either simply add the desired GLUE XML attributes to the results returned from getFactoryAttributesDocument, create a new function that returns just the GLUE, or perhaps better yet support getResourceProperties (I'd recommend using OGSA-WSRF-BP, it is supported in Teragrid and caGrid in the US, also I think by Unicore, and by Genesis II) and return the GLUE XML as resource properties. A

4 4

No Sec-TelCon today
by Morris Riedel 22 May '09

22 May '09

Hi PGI team, we will have no security telcon today - instead we discuss next week at OGF26 a full session long about how to proceed with our proposed setups in standardization... Just4Info, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0

PGI State Model for discussions (ppt)
by Morris Riedel 22 May '09

22 May '09

Hi PGI team, as we discussed in going forward by discussing the state model I tried to sketch a first version inside the powerpoint file I put on GridForge: http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/doc man.root.input_documents.execution_service.state_model/doc15637 Feel free to use it and make your changes that make it easier to discuss it in the next telcons / per mailing lists. I also put related work about other state models inside it (HPC-FSP & BES). Note that I created a sub-folder called state-model inside the Execution Service folder for it. Finally, there are certainly some transitions/states that have to be discussed (i.e. sub-states hierarchy), but this version might be a good start. Let's start with the discussion then, Morris ------------------------------------------------------------ Morris Riedel SW - Engineer Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Forschungszentrum Juelich Wilhelm-Johnen-Str. 1 D - 52425 Juelich Germany Email: m.riedel(a)fz-juelich.de Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel Phone: +49 2461 61 - 3651 Fax: +49 2461 61 - 6656 Skype: MorrisRiedel "We work to better ourselves, and the rest of humanity" Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzende des Aufsichtsrats: MinDirig'in Bärbel Brumme-Bothe Vorstand: Prof. Dr. Achim Bachem (Vorsitzender), Dr. Ulrich Krafft (stellv. Vorsitzender)

1 0