February 2010 - ogsa-dmi-wg

bulk copy strawman proposal
by david.meredith＠stfc.ac.uk 05 Mar '10

05 Mar '10

Hi folks, (To address my actions from the last DMI phone conf): As you are aware, I have been given the task to come up with a straw-man proposal for a 'bulk' data copy activity document prior to OGF that may/may not build upon on the DMI functional spec (for the purpose of describing multiple data copy operations across different sources and sinks). I would appreciate your views/preferences on the following salient points before I start this task (I also emailed Andreas and Donal from JSDL to canvas their opinions also - awaiting a reply). Anyhow, I guess the salient points as discussed in the paper that need an early decision are listed below (note, if you would like a copy of the cited paper please email me directly, I'll send you a copy since its awaiting final publication review): 1) The preferred format to pursue to describe the data source and sink? i.e. a) the jsdl inspired <mjsdl:DataTransfer/> element with nested <mjsdl:Source/> and <mjsdl:Target> elements (http://code.google.com/p/dtsproject/source/browse/trunk/dts-schema/src/ main/resources/minx-jsdl-example.xml ), or b) the DMI inspired <DataCopy/> element based on DEPRs as shown in Fig 4 in the paper. 2) Should we pursue the use of element references as discussed in Figure 5 in the paper to reduce XML repetition (i.e. support references in addition to the traditional in-line approach)? Potential referenced elements include; <Source/>, <Target /> (assuming option 1a), <DataERP/> (assuming option 1b), <TransferRequirement/>, <URIProperties/> and <Credentials/>. Some considerations: If option 1a) is preferred, do we further extend this so that it can be used to reference multiple alternative source/sink data locations akin to the dmi DEPR construct, i.e. allow multiple <mjsdl:Source/> and/or <mjsdl:Target/> data locations within a single <mjsdl:DataTransfer/>. In doing this, we actually define a construct very similar to the DEPR construct. Many thanks, Dave ---------------------------------------------- David Meredith STFC eScience Centre Daresbury Laboratory (A32) Warrington, Cheshire WA4 4AD email: david.meredith(a)stfc.ac.uk tel: +44 (0) 1925 603762 -- Scanned by iCritical.

2 1

Minutes from today's call
by Mario Antonioletti 24 Feb '10

24 Feb '10

OGSA DMI Telcon - 24 February 2010 ================================== Present: Mario Antonioletti, EPCC Steven Crouch, University of Southampton Peter Turner, University of Sydney Garson Galang, VeRSI David Meredith, STFC Shahbaz Memon, FZJ Agenda: o Agenda bashing o Actions review o Progress report o Proposed changes to the group o OGF28 o Planning Actions: [MAA] Look at Shahbaz's WSRF DMI rendering. [SM] Find out if adding xsd:any to all complex elements would have a negative impact. [DM] Add suggested changes to the text in the functional spec. [SC] Make introductions to get some DMI/JSDL interaction going. Contact Donald Fellows and Andreas Savva. Will pursue at OGF28. UNICORE also using JSDL. [DM] Come up with a straw man proposal for the bulk transfer operation. Taken over by DM from SM. SM will help to contribute. [DM] Mail the out the most salient points to the WG for discussion. [MAA/SM/DM/SC] Prepare slides for the OGF28 session. Completed Actions ---------------- [MAA] Give everybody on this call author privileges once on Grid Forge and joined the OGSA-DMI WG. I believe that I did this for all the people I could find that were subscribed on GridForge. Check if Steve is there. [DM] Reply to Allen's email. Retired. --- o Agenda bashing o Actions review o Progress report WSRF/WSI rendering for WS-I document still not been released to be published. Need to decide whether to publish the WS-I document after the bulk transfer document in case it has an impact. Have to consider the xsd:any extensions to the existing DMI specs and the bulk transfer straw man. DataMinx has been getting their implementation together and can feedback to the group. Aiming towards a first release at the end of February. Includes the back end JMS. MAA encouraged a completely pragmatic approach towards development of DataMinx and not to get tied up with spec stuff. MAA also think it is important to try to and keep UNICORE and Globus engaged to get them to work. A discussion followed of whether middlewares like GridSAM and OGSA-DAI could implement DMI. GridSAM could provide some functionality, OGSA-DAI could either act as a client to a DMI service or act as a source/sink of data. o OGF28 Have a 90 minute session. MAA, SC, DM & possibly SM. MAA report on the status of the group. SC/DM Future directions. Outline of the bulk transfer by then would be good. Discuss the messaging model - present the first version of the spec. Contact Donald Fellows, Andreas Savva - to be contacted by SC. MAA will try to talk to Ravi. Try to produce slides a week before OGF for feedback. Need to report to the data area meeting. o Proposed changes to the group MAA announced that he would be stepping down as chair from DMI. A possible replacement was SC. The group agreed that this would be a good choice. MAA would email the WG telling folks that he was resigning and that SC would be a good replacement. As the folks in the telcon had endorsed SC as a good choice really looking for objections or alternatives. o Planning Most of the planning runs up to OGF28 where more planning will be made. o AOB Skype call worked out well and will be used in the future. +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0

Resigning my chair.
by Mario Antonioletti 24 Feb '10

24 Feb '10

Hi, I am sad to have to say that due to change in work committments I will have to resign my OGSA-DMI Working Group chair. However, Steven Crouch from the University of Southampton will step up to take over the position. The work he is currently doing with the DataMinx people as well his involvement with the JSDL and OGSA-BES Working Groups means that OGSA DMI will be taken in the right directions and be made compatible with these other efforts. At this morning's call the group approved this change and this is your opportunity to dissent or offer yourself up as a chair if you would so like. If there is no dissent Steve would assume the chair role, replacing me, at OGF28. There are a number of outstanding things from my time as chair: o Plain WS rendering has gone through the OGF process and is ready to be published but have held off from doing this to see whether any changes are required from requirements input from the DataMinx folks. If these do not impact then this document can be published. o Interop experiences document from work done by Steven Newhouse and Michel Drescher - still needs to be typed up - my bad. May be impacted by changes required in the previous point. Shahbaz is currently determining the changes that would be required on the WSDL/Schema. Hopefully this can be done before OGF. If there is no impact then these two points can be moved forward. Shahbaz is also working on a WSRF rendering of the spec. Dave Meredith hopes to get an outline version of a bulk data transfer out by OGF28. Anyhow, that gives you an outline of where the group has been and where it is going. I will remain in place until OGF28 and, unless there are objections, Steve Crouch will take the chair role at OGF28 and take the group forward together with his fellow chairs Shahbaz Memon and Ravi Madduri. Mario +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0

Proposed agenda for skype call on 24 of Feb
by Mario Antonioletti 23 Feb '10

23 Feb '10

Hi, Ok, here is a possible agenda for the call at 8am GMT on the 24th of February: o Agenda bashing o Actions review o Porgress report o Proposed changes to the group o OGF28 o Planning If you would like another item added please let the list know. As far as I can tell the outstanding actions are: Actions: -------- [MAA] Give everybody on this call author privileges once on Grid Forge and joined the OGSA-DMI WG. I believe that I did this for all the people I could find that were subscribed on GridForge. [MAA] Look at Shahbaz's WSRF DMI rendering. [SM] Find out if adding xsd:any to all complex elements would have a negative impact. [DM] Add suggested changes to the text in the functional spec. [SC] Make introductions to get some DMI/JSDL interaction going. [DM] Reply to Allen's email. [SM] Come up with a straw man proposal for the bulk transfer operation. +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0

DMI Skype Call?
by Mario Antonioletti 22 Feb '10

22 Feb '10

Hi, Would folks be available for a skype call next Tuesday at 8am (GMT) time? If not available at this time could you suggest an alternative? If folks can think of a better means of doing a call other than skype then interested to hear that too. If we get a quorum then I will post an agenda. If you would like to join send me your skype id. Have to be finished by 9am GMT as I have another meeting. Let me know, Mario +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+ -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

4 4