June 2008 - ogsa-dmi-wg - lists.ogf.org

Updated "Tracker-Replacement-Sheet" v4 plus updated docments
by Michel Drescher 22 Jun '08

22 Jun '08

Folks, please find attached version 4 of the tracker replacement sheet; and the updated document drafts: - Functional Specification draft 62 - Plain WS rendering dicument draft 3 I haven't added the XML Schema and WSDL excerpts as this makes it easier for me to keep everything i synch. Cheers, Michel -- Michel Drescher Fujitsu Laboratories of Europe, Ltd. Hayes Park Central Hayes End Road Hayes, Middlesex UB4 8FE Reg. No. 4153469 +44 20 8606 4834 Michel.Drescher(a)uk.fujitsu.com

1 0

Notes from Today's Call.
by Mario Antonioletti 20 Jun '08

20 Jun '08

OGSA-DMI Telcon 20 June 2008 ============================ Present: Mario Antonioletti, EPCC Steven Newhouse, Microsoft Michel Drescher, Fujitsu Allen Luniewski, IBM +--- Actions: Actions from the last call: [Mario] Talk to Ravi about Globus DMI implementation. In progress. [Michel] Distribute WSDL, schema to the list for comment. Done. [Michel] Write a normative document for the WS-DL, schema and messages with help from friends. In progress. [Mario] Set up an ftp server for Michel/Steven. Done. +--- Implementation progress: Michel - has almost got a complete implementation of OGSA DMI, including support state lifetime but there are a couple of issues remaining. Stay alive time will have units in seconds. WS-Addressing actions and renaming the resume operation need to be fixed- other than that fine. Some of these will be fed back into the functional spec after the interop process has concluded. Steven - rebuilt the interface based on the current draft of the XML distributed by Michel. Steven has been communicating with Michel over any issues that arise. His DMI implementation can do file transfers based on ftp endpoints. Have to implement the transfer activity as a separate thread so that it can be monitored and actioned by the client. Mario reported that Ravi has been busy but he will try to do something. Michel is away from 26 June - 4th July, back in the office on the 7th of July. Steven hopes to get something up and running by then. Hopefully Ravi can come up with something on-line roundabout that time. Michel would like some of the stuff from the WSS namespace from Steven to put his DMI credentials in. Steven is going to send him something. Michel has been keeping an xls sheet with issues (because of issues with GridForge). More changes on the pipeline - three outstanding ones: Plain WS Rendering WS-Addressing Action values garbled. The WS-Addressing Action values for the DTF and DTI operations do not matching the DMI naming pattern. Michel will fix and produce some new WSDL. Specification 1.0 stayAliveTime ambiguous. The definition of the stayAliveTime is ambiguous - there is no unit defined. Does the value mean days? Minutes? Use seconds for lifetime - integer values should give plenty of scope for lifetime. Plain WS Rendering 1.0 Resume operation rendered as "restart" The Specification defines a "Resume" operation while the rendering uses "restart" as verb for this operation Operation to go back to being called resume. Michel's noted that his implementation is WSRF compliant and that he could use this for the WSRF rendering of OGSA-DMI. Date of next call will be decided at some future point. +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0

DMI Telcon
by Mario Antonioletti 20 Jun '08

20 Jun '08

Hi, This is a reminder that we are going to have another telcon this Friday. NOTE the new day - this change is to try and maximise the number of people that could attend. Please join us if you can. Call details (thanks to Steven): Date: 20th June 2008 When: 9:00am (PDT) 11:00am (CDT) 17:00pm (BST) PIN: 2719140 USA: +1 866 500 6738 (Toll: +1-203-480-8000) UK: +44 118 909 2000 Actions from the last call: [Mario] Talk to Ravi about Globus DMI implementation. In progress. [Michel] Distribute WSDL, schema to the list for comment. Done. [Michel] Write a normative document for the WS-DL, schema and messages with help from friends. In progress. [Mario] Set up an ftp server for Michel/Steven. Done. Discussion will continue on the implementations in progress. Mario +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

2 1

New issue found: "resume" operation rendered as "restart"
by Michel Drescher 18 Jun '08

18 Jun '08

Folks, as the subject says. I added this to the Excel sheet, which is attached in version 3. Cheers, Michel -- Michel Drescher Fujitsu Laboratories of Europe, Ltd. Hayes Park Central Hayes End Road Hayes, Middlesex UB4 8FE Reg. No. 4153469 +44 20 8606 4834 Michel.Drescher(a)uk.fujitsu.com

1 0

New issue found in Specification
by Michel Drescher 18 Jun '08

18 Jun '08

Folks, I found a new issue in the Specification regarding the "stayAliveTime". The spec does not define a unit - did we mean seconds? Minutes? Or Days? Added an issue to the tracker sheet which is attached in version 2. Cheers, Michel -- Michel Drescher Fujitsu Laboratories of Europe, Ltd. Hayes Park Central Hayes End Road Hayes, Middlesex UB4 8FE Reg. No. 4153469 +44 20 8606 4834 Michel.Drescher(a)uk.fujitsu.com

1 0

First plain WS rendering draft available
by Michel Drescher 17 Jun '08

17 Jun '08

Folks, please find attached five documents: a) OGSA-DMI Functional Specification 1.0 draft 60, continuing updating typos, small changes to syntax in XML Schema, etc. b) OGSA-DMI Plain Web Services Rendering 1.0 draft 1, which contains message definitions and the WSDL port type for plain WS c) dmi-draft-60.xsd the XML Schema for OGSA -DMI Fun Spec draft 60 d) dmi-messages-draft-1.xsd The first draft of WS messages for plain WS rendering of OGSA-DMI e) dmi-porttype-draft-1.wsdl ditto Cheers, Michel -- Michel Drescher Fujitsu Laboratories of Europe, Ltd. Hayes Park Central Hayes End Road Hayes, Middlesex UB4 8FE Reg. No. 4153469 +44 20 8606 4834 Michel.Drescher(a)uk.fujitsu.com

2 2

Functional Specification an OGF Proposed Recommendation
by Mario Antonioletti 13 Jun '08

13 Jun '08

Hi Folks, The OGSA-DMI Functional Specification 1.0 is now a proposed OGF recommendation: http://www.ogf.org/documents/GFD.134.pdf A big thanks to all those that contributed to this work. We are still looking for people to implement the different renderings for this document. For the first of these please see: http://www.ogf.org/pipermail/ogsa-dmi-wg/2008-June/000424.html If you would be interested in doing this please let us know - we'd love to hear from you .... Mario +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0

DMI Telcon Minutes
by Mario Antonioletti 11 Jun '08

11 Jun '08

DMI Telcon - 11 June 08 ======================= Present: Steven Newhouse, Microsoft Michel Drescher, Fujitsu Mario Antonioletti, EPCC Agenda: - OGF23 Review - Rendering documents - Implementations - Interop - Timetable +--- [Mario] Talk to Ravi about Globus DMI implementation. [Michel] Distribute WSDL, schema to the list for comment. [Michel] Write a normative document for the WS-DL, schema and messages with help from friends. [Mario] Set up an ftp server for Michel/Steven. - OGF23 Review Notes were sent out. - Rendering documents Getting quick convergence on the WSDL. Some interactions have been taking place between Steven and Michel. The important thing is to have normative XML going across the wire - tweak the XML Schema to do this. Some small changes have been made to the functional spec to keep things in line - mainly in the schema, WS-DL, etc. Typos fixes too. Michel will start to write the normative WSDL/Schema rendering document - with some help from his friends. - Implementations Michel has a DTF up and running that is halfway implemented. Have not done the other operations yet - can use this as the basis for testing. Steve making progress too. - Interop Don't need to worry about this now. - Timetable Things will be clearer once implementations are done. - AOB Calls will be moving to Fridays at 5pm (UK time). Starting from 20th June 2008 - no calls on the 27th or the 4th of July - schedule calls according to availability. Michel away from the 27th until the 4th of July. Steven is not available on the 4th of July. Mario will be unavailable from 26th to the 1st of July. +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0

DMI Telcon
by Mario Antonioletti 10 Jun '08

10 Jun '08

Hi, We are going to have another telcon tomorrow (Wednesday). Please join us if you can. Call details (thanks to Steven): Date: 11th June 2008 When: 9:00am (PDT) 11:00am (CDT) 17:00pm (BST) PIN: 2719140 USA: +1 866 500 6738 (Toll: +1-203-480-8000) UK: +44 118 909 2000 Possible items for discussion: - OGF23 Review - Rendering documents - Implementations - Interop - Timetable - Others? Speak to folks tomorrow, Mario +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. -- ogsa-dmi-wg mailing list ogsa-dmi-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/ogsa-dmi-wg

2 1

Notes from OGF23
by Mario Antonioletti 10 Jun '08

10 Jun '08

OGF23 - DMI Session - 2 June 2008 ================================= Notes: Mario Antonioletti Presentations available from: http://tinyurl.com/59yucb (if GridForge is up) Steven Newhouse gave an overview of the OGSA-DMI. Notes correspond to exceptions outside the presentation. DMI is now a proposed recommendation - the functional specification document for DMI is to be up at the OGF web site later this week. The document went to public comment at the last OGF - got some good comments - these have been addressed and the document was re-submitted. All that remains is to show that the DMI specification works. David Martin suggested that perhaps OGSA-DMI should give the document a final check to pick up any typos. Steven Newhouse countered by saying that he thinks it is not worth going through the spec until the final changes derived from the implementation phase are made. Steven described what an EPR (End Point Reference) is for people that are not familiar with the concept. The typical process for DMI: a client gets in touch with DTF (Data Transfer Factory) - it examines at the DEPRs given to it by the client and inspects these to see how data can be transferred from the source to the sink. This then creates an EPR for a Data Transfer Instance (DTI)- the client uses the DTI to get a status of the transfer. The DTI manages the transfer of data from the source to the sink. Mario asks where the data EPR comes from and as it happens Steven has a number of slides that shows where these are obtained from. In the first instance the expectation is that the DEPRs will be minted by the client in the absence of other mechanisms. ... Erwin asked about future work: is DMI thinking of managing bulk transfers. Response is that we can already specify bulk transports through the source or the sink - from source to sink but not from multiple sources to multiple sinks. Another use case was proposed - use metadata to discover data as opposed to supplying data EPR, then the DTF could use that to look for the data. The response: can use third parties to do that - feed a service metadata that then returns Data EPRs which can then be provided to a DTF. Michel Drescher takes over to talk about renderings and Interop. Currently only have a functional specification that only specifies the core behaviour. We are going to do two different renderings: plain WS (non-WSRF) rendering and a WSRF rendering. The WSRF rendering will be on top of the non-WSRF rendering (call it WS-I). With WSRF we could be OGSA-BP compliant which would give us more constraints - other issue is how WSRF compliant it is (how many of the optional operations should be supported?). Mario comments that as we are called OGSA-DMI maybe that implies that we should be OGSA-BP compliant. ... For the WSRF rendering the DMI Factory could have Resource Property Value Change Notification. Could do similar stuff for the DTI. Aligned to the Resource Management life cycle which fits in quite nicely. We already have some renderings available on GridForge. Still need to decide what WSRF rendering features we want and then define normative renderings, OGSA-DMI ask for a possible implementation from EGEE - no commitment as yet. Interop issues: security - disabled security for the ByteIO interop testing that Michel was involved in and this then happened successfully. DMI spec is silent on security other than for the access security token(s) that is\are passed - validating security is not the primary concern here - in previous interop tests security has been a major headache for as opposed to testing the specification. Can compose DMI with security but it makes specification validation difficult. Protocols used to verify the spec: ftp? Protocol security: is the same username password enough? Guideline should be to do as little as possible but as much as necessary. 4-way principle for validation: - my client vs my service - your client vs your service - my client vs your service - your client vs my service Do we want to move data between Microsoft and Fujitsu? Probably not. An aggressive time line is proposed - have something ready by the next OGF. David Martin asked about WS-I vs WSRF interoperability - WS-I vs WS-I implementations; WS-I vs WSRF; WSRF vs WSRF - this could be done. Some implementations will not support WSRF - Microsoft implementation will not be WSRF compliant; Fujitsu will be WSRF compliant. Could there be a compliant implementation that would not inter-operate? The WSRF stuff would be a superset of the WS-I stuff. The normative description in the functional spec is around shared data types. There are normative documents that will describe the WSRF/WS-I renderings. They will go through the recommendation track separately. The documents will be fairly short (excluding the XML/WSDL). Important to get this tested against these published documents. Get drafts of the rendering for comment for OGF24. Source/Sink - expect ftp server with user name and password; http as a source - could use a put for a sink ... maybe. Question as to whether GridFTP could be used because of certificate issues. Looking for implementors. Steven implemented 75% of the DMI spec in an afternoon so there is no massive barrier. Asked D-grid and Virginia explicitly if they might consider the OGSA-DMI spec. +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0