- pgi-wg - lists.ogf.org

Reminder: Glossary Document Review - 3 days left
by Morris Riedel 19 Aug '10

19 Aug '10

Hi team, just a gentle reminder about reviewing our glossary document: http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do… # Review coverage, etc. - Only review by Oxana, not much comments # Glossary agreeements - Glossary document GFD in all cases except noted otherwise here. - we agreed to no duplication, refer to OGSA glossary - published in specific GFD... # Open Reviews - 10 days TBD: Morris review TBD: Tim review Although Tim and me are in charge any additional reviewer is welcome. According to the minutes above, the deadline would be Sunday 2010-08-22 so that Etienne can work on integrating feedback the next week starting on Monday. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel Deputy Division Leader Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel

1 0

Reminder & Agenda: PGI Telcon Today 2010-08-19; 3:30 pm CET
by Morris Riedel 19 Aug '10

19 Aug '10

Dear PGI team, today will be our usual telcon: (1) Telcon-System and Screen-Sharing http://webconf.vc.dfn.de/ogf-pgi-wg/ No login is required. Just enter as 'guest' with your real world name. (2) Proposed agenda: (a) Debrief notes from the last meeting (b) Debrief use case process, status, and review coverage, and feedback integration (c) Focus discussion: prioritization of use cases that drive 80% of the requirements (major 3-4 use cases) PLANNED AGREEMENT TODAY(!): Major 3-4 use cases that will be taken initially into account when we map the top PGI requirements to major use cases (d) Debrief glossary document & review process driven by Etienne (if time) (e) AOB Your co-chair, Morris ------------------------------------------------------------ Morris Riedel Deputy Division Leader Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel

1 0

OGF PGI - EDGI Use Cases
by Etienne URBAH 12 Aug '10

12 Aug '10

Ilya, Concerning OGF PGI Use Cases : Thank you very much for your valuable comments on following EDGI Use Cases : Enforce Security of a Production Service Grid --------------------------------------------- http://forge.gridforum.org/sf/go/doc16010?nav=1 - An 'Activity' is a 'Unit of work which is submitted to a Service via an Endpoint' (GLUE 2.0) - You are right, what needs to be frozen is NOT the physical resources processing work of the malicious User, but the ongoing activities created locally for the malicious User. Prepare Desktop Grid Version of Application ------------------------------------------- http://forge.gridforum.org/sf/go/doc16028?nav=1 - This Use Case is performed more easily if the Application already runs on the Service Grid, but this is NOT an absolute prerequisite. - Service Grids trust Users and PUSH activities, while Desktop Grids trust Applications and PULL activities. So, there is NO interoperability at all. Interoperation can be achieved only by using a Bridge specially designed for this purpose. This Bridge does NOT simply forward the activities from one Grid to another Grid, but it is a statefull server performing syntactic translations, activity buffering, activity concatenation or expansion, activity wrapping, ..., which I summarize as 'marshaling'. Detailed description of this Bridge is outside the scope of the Use Case : Only the Bridge Manager needs to have a detailed knowledge of it. The other Actors only need to know that this Bridge exists, and trust it. Marshal Activities from Service Grid to Desktop Grid ---------------------------------------------------- http://forge.gridforum.org/sf/go/doc16022?nav=1 - Same answers as for the previous Use Case. I will add all above explanations and corrections, and take into account most of your corrections about English. I am going this night on vacation for 10 days, so updating the EDGI Use Cases will take a little time. Thank you again. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 0

use case reviews
by Johannes Watzl 12 Aug '10

12 Aug '10

Hi David, we are discussing the pgi use case reviews at the moment. When will you be able to send yours? Cheers, Johannes -- _ _ _ _ _ _ Johannes Watzl |\/| |\ | |\/| Institut für Informatik / Dept. of CS | | | \| | | Ludwig-Maximilians-Universität München ======= TEAM ======= Oettingenstr. 67, 80538 Munich, Germany Room E 005, Phone +49-89-2180-9162 Munich Network Management Team Email: watzl(a)nm.ifi.lmu.de Münchner Netz-Management Team http://www.nm.ifi.lmu.de/~watzl

1 0

Re: [Pgi-wg] Reminder & Agenda: PGI Telcon Today 2010-08-12; 3:30 pm CET
by Tim Parkinson 12 Aug '10

12 Aug '10

I have another conference at 14:00BST which may both start late and run past 14:30 (15:30CEST) so I may join the call late. regards Tim Parkinson > -----Original Message----- > From: pgi-wg-bounces(a)ogf.org [mailto:pgi-wg-bounces@ogf.org] On Behalf > Of Morris Riedel > Sent: 12 August 2010 11:33 > To: pgi-wg(a)ogf.org > Cc: gin(a)ogf.org > Subject: [Pgi-wg] Reminder & Agenda: PGI Telcon Today 2010-08-12; 3:30 > pm CET > > Dear PGI team, > > today will be our usual telcon: > > > (1) > Telcon-System and Screen-Sharing > > http://webconf.vc.dfn.de/ogf-pgi-wg/ > > No login is required. Just enter as 'guest' with your real world name. > > > > (2) > Proposed agenda: > > (a) > Debrief notes from the last meeting > > (b) > Debrief use case process, status, and review coverage, and feedback > integration > > (c) > Debrief glossary document process driven by Etienne > > (d) > AOB > > > > Please feel free to add any other topic on the agenda that I may have > missed. > > > Your co-chair, > Morris > ------------------------------------------------------------ > Morris Riedel > Deputy Division Leader > Distributed Systems and Grid Computing Division > > Jülich Supercomputing Centre (JSC) > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel > >

1 0

OGF PGI - EDGI Use Cases
by Etienne URBAH 12 Aug '10

12 Aug '10

Tim, Concerning OGF PGI Use Cases : Thank you very much for your valuable comments on following EDGI Use Cases : Enforce Security of a Production Service Grid --------------------------------------------- http://forge.gridforum.org/sf/go/doc16010?nav=1 I have already taken into account all your comments. Prepare Desktop Grid Version of Application ------------------------------------------- http://forge.gridforum.org/sf/go/doc16028?nav=1 - I have already taken into account most of your comments, and I have kept the 3 others as comments. - Concerning 'encapsulation' : - Do you consider it to be a goal more than a principle ? - Why couldn't a business rule stress that encapsulation has to be enforced ? - Could you provide suggestions permitting to improve the readability and meaning of my sentences ? - Concerning the 'EGI Software Rollout process' : I was NOT aware of it. But I am very much interested at it. Could you provide me a link ? Thank you in advance for your answers. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr -----------------------------------------------------

1 0

Reminder & Agenda: PGI Telcon Today 2010-08-12; 3:30 pm CET
by Morris Riedel 12 Aug '10

12 Aug '10

Dear PGI team, today will be our usual telcon: (1) Telcon-System and Screen-Sharing http://webconf.vc.dfn.de/ogf-pgi-wg/ No login is required. Just enter as 'guest' with your real world name. (2) Proposed agenda: (a) Debrief notes from the last meeting (b) Debrief use case process, status, and review coverage, and feedback integration (c) Debrief glossary document process driven by Etienne (d) AOB Please feel free to add any other topic on the agenda that I may have missed. Your co-chair, Morris ------------------------------------------------------------ Morris Riedel Deputy Division Leader Distributed Systems and Grid Computing Division Jülich Supercomputing Centre (JSC) Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel

1 0

GROMACS use case refurbished
by Oxana Smirnova 06 Aug '10

06 Aug '10

Hi all, as was decided yesterday, I ported the GROMACS use case, taking into account Etienne's comments, into the new "template", see: http://forge.ogf.org/sf/go/doc16042 Etienne would probably like to review it again, as some of his comments were about the document structure, which obviously has changed dramatically. I kept the old ODT document commented by Etienne, and even its DOC version, though the latter is really obsolete and stale. Cheers, Oxana

2 1

Re: [Pgi-wg] [EGI Technical Forum 2010] Abstract 74: Standardization of Distributed Data Processing - Useful Standards and Interfaces
by Etienne URBAH 05 Aug '10

05 Aug '10

Steven, Concerning Abstract 74 for my poster proposed at the EGI Technical Forum 2010 : After logging in INDICO, I can read the content of my abstract, but the 'modify' button in NOT active (both on IE and Firefox). Therefore, I am providing the abstract in literary English below. This poster presents two UML diagrams concerning standards which may be useful for grid computing middleware, and interfaces which should be taken into account for proper design of grid middleware permitting operation in production. Selection and then widespread adoption of adequate standards would permit grid interoperability. The web page http://forge.gridforum.org/sf/go/doc15990?nav=1 contains a draft version of a first UML diagram presenting official and de facto standards which may be useful for the design of middleware permitting remote data processing (cloud computing) and distributed data processing (grid computing). The main point is that the GFD.147 recommendation of OGF, named GLUE Specification v. 2.0, permits to describe grid and cloud entities. This allows different GLUE compliant grids to discover and understand each other, so that this GLUE specification should be used as foundation for all other grid and cloud standards and recommendations for interoperability. The web page http://forge.gridforum.org/sf/go/doc15981?nav=1 contains a draft version of a second UML diagram presenting interfaces between Clients, Functionalities and Resources existing in remote data processing infrastructures (clouds) and in distributed data processing infrastructures (grids). This second diagram uses color coding, with grid and cloud functionalities and resources in green, interfaces permitting to access them in blue. Besides, official and de facto standards are inside square brackets. Final Users are scientists, which are interested only in 'payload' functionalities, like data, instruments, activities, and jobs, but grids and clouds require also 'support' functionalities, in particular information publication and discovery, security management, monitoring, logging and accounting. Therefore, interoperability requires to standardize all 'client interfaces' shown in blue, at the left. Grid and cloud functionalities are not independent of each other, but most functionalities require to access resources managed by other functionalities, in particular information items, security descriptors, logging records and accounting records. So, if we do not standardize 'backend' interfaces shown in blue, at the right, then different instances implementing the same functionality will not be able to correctly access required resources, and interoperability will not be achieved. Therefore, we have to standardize also these 'backend' interfaces. This task is huge, so we have assess, for each 'backend' interface, if standardization is really needed, and we have to prioritize, with following suggestions : Firstly, cloud and grid computing require information publication and discovery. For interoperability, we already have the GLUE specification as foundation, and we urgently need GLUE renderings, in particular for LDAP, XML, and SQL. Clients performing queries do not need that the information records are really kept in a relational database, but that queries may be expressed in a (perhaps limited) SQL syntax. Secondly, clouds and grids are valuable targets for criminal organizations, so that clouds and grids absolutely require high-grade security management, and interoperability between grids (an later clouds) require a common set of standards. We should confirm IGTF as Trust Anchor and SPG (formerly JSPG) for general security policies. For authentication, we should phase out GSI proxies in favor of RFC3820-compliant X509 proxies as soon as possible. For authorization, VOMS extensions of X509 proxies work correctly, but SAML assertions issued for example by VOMS servers also permit restrictions of authorization, and perhaps easier delegation. Thirdly, security audit absolutely requires log records for jobs and other activities which clients can submit. Interoperability between grids require that the format of the log records is standardized. We have no published standard yet, and we urgently need one. The JSDL working group of OGF is working on such a standard named 'Activity Instance Document Schema'. We should quickly assess if the draft available at http://forge.gridforum.org/sf/go/doc15395?nav=1 is appropriate. If yes, we should help the JSDL working group finalize it as an OGF recommendation, and implement it. Fourthly, accounting will become more and more important, as grid computing evolves from a research topic to a valuable commodity like cloud computing. The GFD.98 recommendation of OGF, named 'Usage Record - Format Recommendation', is already published. We should assess if this recommendation is appropriate, and if necessary, improve it, then implement it. By contrast, job management is used by very few other functionalities. As long as the four functionalities mentioned above are correctly implemented according to common standards, interoperation of job management between different clouds and grids could then be quickly achieved using bridges implementing an adequate adapter for each job management idiom, though perhaps with reduced scalability compared to full interoperability using the GDF.108 recommendation named 'OGSA® Basic Execution Service Version 1.0'. Now that I have finished, I thank Steven very much : This makes a good start for an academic paper. Best regards. ----------------------------------------------------- Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS Bat 200 91898 ORSAY France Tel: +33 1 64 46 84 87 Skype: etienne.urbah Mob: +33 6 22 30 53 27 mailto:urbah@lal.in2p3.fr ----------------------------------------------------- On Thu, 05/08/2010 15:42, Steven Newhouse wrote: > Dear Etienne, > > We would like to accept your poster but feel the abstract needs to be > revised to better reflect the proposed content. Can you please submit a > better abstract - one where the text is easier to read rather than a > series of bullet points - immediately. > > Thanks, > > Steven

1 0

Re: [Pgi-wg] DEISA/PRACE and EGEE/EGI Interoperabiltiy Use case Uploaded
by David Wallom 05 Aug '10

05 Aug '10

I have done this now I believe David On 05/08/2010 13:12, "Morris Riedel" <m.riedel(a)fz-juelich.de> wrote: > Thanks for this David! > >> -- -----Ursprüngliche Nachricht----- >> -- Von: pgi-wg-bounces(a)ogf.org [mailto:pgi-wg-bounces@ogf.org] Im Auftrag von >> David Wallom >> -- Gesendet: Donnerstag, 5. August 2010 13:34 >> -- An: pgi-wg(a)ogf.org >> -- Betreff: Re: [Pgi-wg] DEISA/PRACE and EGEE/EGI Interoperabiltiy Use case >> Uploaded >> -- >> -- Hi Morris, >> -- >> -- I am going to start a review on your use case within gridforge. I have >> most >> -- comments already thought out so shouldn't take too long. >> -- >> -- David >> -- >> -- >> -- On 05/08/2010 11:24, "Morris Riedel" <m.riedel(a)fz-juelich.de> wrote: >> -- >> -- > Hi PGI team, >> -- > >> -- >> -- TBD: DEISA/UNICORE scientific use case (Morris) >> -- > >> -- > sorry for being a little bit late with this, but I tried to be as >> precise as >> -- > possible with this use case. >> -- > >> -- > It is available in GridForge: >> -- > >> http://forge.gridforum.org/sf/docman/do/downloadDocument/projects.pgi-wg/do…>> a >> -- > n.root.input_documents.use_cases/doc16039 >> -- > >> -- > It would be nice if 1-2 could comment on this one. Thanks. >> -- > >> -- > Take care, >> -- > Morris >> -- > ------------------------------------------------------------ >> -- > Morris Riedel >> -- > Deputy Division Leader >> -- > Distributed Systems and Grid Computing Division >> -- > >> -- > Jülich Supercomputing Centre (JSC) >> -- > Info: http://www.fz-juelich.de/jsc/JSCPeople/riedel >> -- > >> -- > >> -- > >> -- > _______________________________________________ >> -- > Pgi-wg mailing list >> -- > Pgi-wg(a)ogf.org >> -- > http://www.ogf.org/mailman/listinfo/pgi-wg >> -- >> -- -- >> -- =================================== >> -- Dr David Wallom >> -- Technical Manager >> -- Oxford e-Research Centre >> -- University of Oxford >> -- Rm 160, 7 Keble Road >> -- Oxford >> -- OX1 3QG >> -- >> -- +44(0)1865 610601 >> -- =================================== >> -- >> -- >> -- _______________________________________________ >> -- Pgi-wg mailing list >> -- Pgi-wg(a)ogf.org >> -- http://www.ogf.org/mailman/listinfo/pgi-wg -- =================================== Dr David Wallom Technical Manager Oxford e-Research Centre University of Oxford Rm 160, 7 Keble Road Oxford OX1 3QG +44(0)1865 610601 ===================================

2 1