August 2007 - ogsa-wg - lists.ogf.org

Update OGSA roadmap v1.1 draft
by Hiro Kishimoto 14 Aug '07

14 Aug '07

Hi Chris, Thank you very much for very successful OGSA roadmap review session today. We are really close to its completion. I've uploaded updated roadmap draft onto GridForege as rev 021. Please take it from here and add the finishing touch on it. https://forge.gridforum.org/sf/go/doc13733 We will have really final review call on Aug. 27 (Monday). Thanks again, -- Hiro Kishimoto

2 3

EMS Architecture Scenarios v1.0+
by Steven Newhouse 13 Aug '07

13 Aug '07

Where should we go next with EMS Architecture Scenarios? The original document (http://www.ogf.org/documents/GFD.106.pdf) considered scenarios relating to job execution at a known endpoint, an endpoint selected through RSS type mechanisms, and execution requiring post/pre deployment steps. Open Issues (as I see them!): 1. Progress on defining EPS (as part of RSS) has been slow and AFAIK there has not been much progress towards its submission into the document process. There is however a draft from April of the specification and from June of WSDL/XSD files - http://forge.gridforum.org/sf/go/projects.ogsa-rss-wg/docman.root.current_d…. This may not matter as work has progressed on the content of RSS - namely the information model and the activity in the GLUE-WG. 2. Review of GLUE information model. The BES specification defined some minimal requirements we should ensure that these have been taken on board by the GLUE-WG team - see http://forge.ogf.org/sf/wiki/do/viewPage/projects.glue-wg/wiki/HomePage . Do we need more concrete scenarios from EMS to drive this... or are the GLUE scenarios sufficiently comprehensive? 3. Files (or more generally data?). The scenarios say nothing about file movement. The DMI-WG has progressed since then and has generated some scenarios that could for into a revision of this document. The latest draft (http://forge.gridforum.org/sf/docman/do/listDocuments/projects.ogsa-dmi-wg/…) and the some use cases (http://forge.gridforum.org/sf/go/doc14666?nav=1 and http://www.ogf.org/OGF19/materials/505/Including%20Data%20in%20Simple%20Job…) are a starting point. Even some sequence diagrams (see https://forge.gridforum.org/sf/sfmain/do/downloadAttachment/projects.rm-wg/… and https://forge.gridforum.org/sf/sfmain/do/downloadAttachment/projects.rm-wg/…) from RM/GLUE discussions that should be reviewed for diffs against the current scenarios. 4. Deployment and Provisioning. Are ACS and CDDLM dead? Should we refactor around work in the Reference Model WG and experience on lightweight deployment experience from UVa and GenesisII (BTW - I'm sure there are other groups who could contribute here). Generally, having scenarios in the current version of the document using specs that are not developing and/or not going to be adopted is a concern to me. There is IMHO a clear benefit in having these sequence diagrams to inform other groups & incorporate their thinking into a single cohesive document. This should be one of our principals for future versions - not to expand into a massive sequence diagram repository but to keep a narrow focus on incremental scenarios in the EMS space. This would be a useful reference for many groups and help to show how the work going on in individual WGs fits together. Steven PS - Many thanks to the those who's documents, emails and thoughts have been collected here!

3 3

Final review of OGSA Roadmap 1.1
by Christopher Jordan 11 Aug '07

11 Aug '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 At the next F2F session, we will begin reviewing of the OGSA Roadmap 1.1 document in preparation for submission to the OGF editors. If you get a chance, please review the latest draft of the Roadmap document, available at: https://forge.gridforum.org/sf/go/doc13733?nav=1 You may submit any comments you have to me ahead of time, or just bring notes to the session next week. Thanks. Chris Jordan Data Reliability Manager Digital Preservation Initiatives San Diego Supercomputer Center ctjordan(a)sdsc.edu 858.534.8347 http://del.icio.us/tensileacuity “Standards are like toothbrushes, everyone agrees that they’re a good idea but nobody wants to use anyone else’s.” -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) iD8DBQFGt7E9PCVtcXn6kg8RApLtAJ9Rx38ilUflQ34JYg9UsH7JzB/mkgCfQ+70 JzKRgMpZhTl1l66Qy+/fTmQ= =HyXa -----END PGP SIGNATURE-----

2 1

Integration of GLUE 2 and OGSA-BES
by Sergio Andreozzi 09 Aug '07

09 Aug '07

Hi everybody, in the context of the OMII-Europe project, we are preparing to contribute an implementation of GLUE 2 to be integrated into OGSA-BES implementations (info providers will be available for the OMII-Europe partners, nevertheless the work can be leveraged for other platforms). The idea is to implement the GLUE 2 specification draft that will be available by OGF 21. The aim is to have a prototype implementation to be showed during SuperComputing 2007. Here is a draft document of the possible implementation approaches. You are invited to have a look and contribute for suggestions: http://omii-europe.forge.cnaf.infn.it/jra2/glue/bes-glue-integration Last notice, I will be on holiday for the coming two weeks, therefore we will resume this topic starting from 27 Aug. Cheers, Sergio -- Sergio Andreozzi INFN-CNAF, Tel: +39 051 609 2860 Viale Berti Pichat, 6/2 Fax: +39 051 609 2746 40126 Bologna (Italy) Web: http://www.cnaf.infn.it/~andreozzi

1 0

[Reminder] Workflow (Steve McGough and Michel Drescher) @ 2007-08-09 09:00 - 10:00 ()
by Google Calendar 08 Aug '07

08 Aug '07

ogsa-wg(a)ogf.org, this is a reminder for Title: Workflow (Steve McGough and Michel Drescher) Time: 2007-08-09 09:00 - 10:00 (Central Time) Where: http://ogsa.glance.net/?key=0809 Calendar: Description: When: 10-11am EDT, 9-10am CDT, 7-8am PDT, 11pm-midnight JST, 3-4pm UK Dial-in numbers for Thursday: Free: +1-888-452-0308 Intl/Toll: +(210) 234-7446 PIN: 71815 See more information: - https://forge.gridforum.org/sf/go/wiki1715 Screen share service: URL: http://ogsa.glance.net/ Usage: https://forge.gridforum.org/sf/go/wiki1584 Note: ** OGF IPR POLICY APPLIES ** http://www.ogf.org/About/abt_policies.php 1) Early discussion Note taker assignment Roll call Agenda bashing *** Detailed agenda TBD *** Minutes approval - July 26: https://forge.gridforum.org/sf/go/doc14702 Action Item review AI-0511b: Michel to pulla workflow strawman poposal together AI-0614a: Steven Newhouse will check whether Windows Workflow can also be used with CCS / BES style services AI-0614d: Steve McGough will compile the list and put it on the wiki AI-0614e: Steve McGough will look for the workflow material from the Berlin GGF AI-0726a: Show typical/existing use cases for cyclic dependency declarations (spawned from AI-0508a, owner unspecified) You can view this event at http://www.google.com/calendar/event?action=VIEW&eid=aDE2NG10dWoyaThkYW5rYj… You are receiving this courtesy email at the account ogsa-wg(a)ogf.org because you are an attendee of this event. To stop receiving future notifications for this event, decline this event. Alternatively you can sign up for a Google Calendar account at http://www.google.com/calendar/ and control your notification settings for your entire calendar.

1 0

***SPAM*** Windows Workflow
by Steven Newhouse 07 Aug '07

07 Aug '07

AI-0614a: Steven Newhouse will check whether Windows Workflow can also be used with CCS / BES style services In under two days I was able to (from scratch) build some custom workflow activities to transfer files to/from a server over FTP and to use the HPCP web service to run a job on a cluster resource. This time also included gaining familiarity with the Visual Studio IDE, the Workflow builder components within that, oh and gaining familiarity with C#. From a developer perspective I'm obviously quite impressed! I did not really explore all of the different workflow activities that come provided (parallel, if/else, while, etc.) but the ones I did all seemed fairly straightforward to use. Its straightforward to give an activity properties and to specify these as customizations within a workflow. This allowed me to move a file from my workflow client to the HPC resource, to start a job on the resource, and to transfer back an output file. There are opportunities for simplifying this... e.g. parsing the JSDL file to extract out the transfer ins & outs. And to make the workflow more complex! There's a whole load of stuff on validation, hibernating/dehibernating running workflows, persistence, etc. that I did not explore. With a set of pre-defined configurable activities I see no reason why a technically competent person (not a programmer) could not use a preconfigured environment to build and run their own workflows. Steven PS: I am sure there are other equally excellent ways of doing this in other environments... my focus was on the Windows tooling.

2 1

[Invitation] Workflow (Steve McGough and Michel Drescher) @ 2007-08-09 09:00 - 10:00 ()
by Hiro Kishimoto 07 Aug '07

07 Aug '07

ogsa-wg(a)ogf.org, you are invited to Title: Workflow (Steve McGough and Michel Drescher) Time: 2007-08-09 09:00 - 10:00 (Central Time) Where: http://ogsa.glance.net/?key=0809 Calendar: Description: When: 10-11am EDT, 9-10am CDT, 7-8am PDT, 11pm-midnight JST, 3-4pm UK Dial-in numbers for Thursday: Free: +1-888-452-0308 Intl/Toll: +(210) 234-7446 PIN: 71815 See more information: - https://forge.gridforum.org/sf/go/wiki1715 Screen share service: URL: http://ogsa.glance.net/ Usage: https://forge.gridforum.org/sf/go/wiki1584 Note: ** OGF IPR POLICY APPLIES ** http://www.ogf.org/About/abt_policies.php 1) Early discussion Note taker assignment Roll call Agenda bashing *** Detailed agenda TBD *** Minutes approval - July 26: https://forge.gridforum.org/sf/go/doc14702 Action Item review AI-0511b: Michel to pulla workflow strawman poposal together AI-0614a: Steven Newhouse will check whether Windows Workflow can also be used with CCS / BES style services AI-0614d: Steve McGough will compile the list and put it on the wiki AI-0614e: Steve McGough will look for the workflow material from the Berlin GGF AI-0726a: Show typical/existing use cases for cyclic dependency declarations (spawned from AI-0508a, owner unspecified) You can view this event at http://www.google.com/calendar/event?action=VIEW&eid=aDE2NG10dWoyaThkYW5rYj… You are receiving this courtesy email at the account ogsa-wg(a)ogf.org because you are an attendee of this event. To stop receiving future notifications for this event, decline this event. Alternatively you can sign up for a Google Calendar account at http://www.google.com/calendar/ and control your notification settings for your entire calendar.

1 0

Teleconference minutes - 26 July 2007 - Workflow
by Hiro Kishimoto 07 Aug '07

07 Aug '07

Hi all, Draft workflow minutes from 26 July 2007 attached. It is also uploaded onto the GridForge. - https://forge.gridforum.org/sf/go/doc14702 Thanks, -- Hiro Kishimoto --------------------------------------------- OGSA Teleconference - 26 July 2007 - Workflow ============================================= * Participants Michel Drescher (Fujitsu) Chris Kantarjiev (Oracle) Fabio Benedetti (IBM) Bahare Rahmanzadeh Donal Fellows (UMAN) Hiro Kishimoto (Fujitsu) Andreas Savva (Fujitsu) ZackK Minutes: Hiro Kishimoto * Agenda bashing Michel proposes the following as today's session; - Open discussion - Donal report out about Taverna - Discuss a schedule * June 14 minutes accepted * New action item AI-0726a: Show typical/existing use cases for cyclic dependency declarations (spawned from AI-0508a, owner unspecified) * Action items review AI-0508a: Donal to get in contact with Taverna Drill use cases for cyclic dependency declarations Donal has sent out overview of Taverna to the list and also will explain at today's session. AI closed. Since "cyclic dependency" is not covered, new AI specific to "cyclic dependency" is created but no one takes charge of it. AI-0726a (new): Show typical/existing use cases for cyclic dependency declarations (spawned from AI-0508a, owner unspecified) AI-0511b: Michel to pull workflow strawman proposal together No progress, keep it open. AI-0614a: Steven Newhouse will check whether Windows Workflow can also be used with CCS / BES style services No progress, keep it open. AI-0614b: Andreas will put the initial presentation points on the wiki Done. AI-0614c: Andreas will put the initial questionnaire points on the wiki Done. AI-0614d: Steve McGough will compile the list and put it on the wiki This is a list for presentations. Keep it open. We will clarify at the August F2F. AI-0614e: Steve McGough will look for the workflow material from the Berlin GGF Keep it open. * Taverna workflows by Donal Fellows Taverna is not service oriented workflow but data oriented workflow. It is actually data & control oriented workflow. Taverna is scientific oriented, underneath medical or pharmaceuticals resource managements are expected to be free to use. There is no run time authorization mechanism. However a workflow should go through ethics committee and it requires human intervention. How much work will be necessary to Tavarna people adopt standards? It should not be BPEL, Taverna is very very different from BPEL. BPEL workflow document is easy to becomes very large but Taverna is much sophisticate than BPEL. Taverna has very unique view for how to model. They don't depend specific execution environment but use specific meta date. * Next step Donal thinks it is remote chance to succeed workflow standard. No one wants to achieve workflow interoperability. Chris Kantarjiev says interoperability is out of our scope. Donal agrees. Control job dependency is in-scope. Donal thinks it is rather components dependency. Exapmle is just run posix jobs. Donal thinks Steve wants to stay simple cases. Hiro says we work on community practice document as fast track. Consensus is "focus community practice document" (fast track). Job dependency (2nd track) should be postponed and focus community practice document. * OGF21 session plan OGSA-WG will request 5 sessions including workflow. If it is not necessary, we can cancel it later. Chris K, our AD, is ok to submit 5 session request. Hiro will do so shortly.

1 0

OGSA Roadmap Draft 19 uploaded
by Christopher Jordan 06 Aug '07

06 Aug '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Roadmap 1.1 draft v19 has been uploaded to Gridforge. This version includes new sections on the RSS specification, EAP material from Hiro, and two Information Model documents. It is close to a final draft, and I encourage interested parties to review it with an eye towards a near-final review during the F2F. Thanks. Chris Jordan Data Reliability Manager Digital Preservation Initiatives San Diego Supercomputer Center ctjordan(a)sdsc.edu 858.534.8347 http://del.icio.us/tensileacuity "Highways, office blocks, faces and street signs are perceived as if they were elements in a malfunctioning central nervous system." - J.G. Ballard -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) iD8DBQFGt6UsPCVtcXn6kg8RAumzAJ4tbb8kqRxdLf05/W7GTc3SsF/TJQCeN5p9 bFMoCmCv1+4Mff70R15b8NU= =T7AW -----END PGP SIGNATURE-----

1 0

[Reminder] Roadmap (Chris Jordan) @ 2007-08-06 18:00 - 19:00 ()
by Google Calendar 05 Aug '07

05 Aug '07

ogsa-wg(a)ogf.org, this is a reminder for Title: Roadmap (Chris Jordan) Time: 2007-08-06 18:00 - 19:00 (Central Time) Where: http://ogsa.glance.net/ Calendar: Description: When: 7-8pm EDT, 6-7pm CDT, 4-5pm PDT, 8-9am JST, midnight-1am UK The dial-in number for Monday; US: +1 718 3541071 (New York) or +1 408 9616509 (San Jose) UK: +44 (0)207 3655269 (London) Japan: +81 (0)3 3570 8225 (Tokyo) PIN: 4371991 See more information: - https://forge.gridforum.org/sf/go/wiki1715 Screen share service: URL: http://ogsa.glance.net/ Usage: https://forge.gridforum.org/sf/go/wiki1584 Note: ** OGF IPR POLICY APPLIES ** http://www.ogf.org/About/abt_policies.php 1) Early discussion Social study notification - https://forge.gridforum.org/sf/go/wiki1717 Note taker assignment Roll call Agenda bashing 2) roadmap document review (Chris) roadmap v1.1 draft - https://forge.gridforum.org/sf/go/doc13733 Issue Tracker - http://forge.ogf.org/short/ogsa-wg/roadmap11 Minutes approval July 9: https://forge.gridforum.org/sf/go/doc14660 Action Item review AI-0625a: Hiro will check number and status of the info model documents and send the information to Chris J (via tracker) You can view this event at http://www.google.com/calendar/event?action=VIEW&eid=bzNtdmNwajZ1NDFucmRyY2… You are receiving this courtesy email at the account ogsa-wg(a)ogf.org because you are an attendee of this event. To stop receiving future notifications for this event, decline this event. Alternatively you can sign up for a Google Calendar account at http://www.google.com/calendar/ and control your notification settings for your entire calendar.

1 0