June 2006 - ogsa-d-wg - lists.ogf.org

RE: [ogsa-d-wg] New version of architecture document
by Dave Berry 03 Jul '06

03 Jul '06

It occurs to me that some of the issues covered by the WS-DAI properties are perhaps worthy of more general discussion in the architecture: 1. Derived data resources. WS-DAI has properties that show whether updates to a child are reflected in the parent and vice-versa. I think we mention derived data in passing; we could say more about it and treat it more consistently. 2. Concurrent access and local transaction support. ByteIO deliberately says nothing about concurrent access; we should at least mention this. Possible we should consider these issues across all data services? The discussion of distributed transactions in 3.9 should mention the WS-DAI support for local transactions. 3. The WS-DAI CoreResource interface handles mapping from abstract names to addresses. We need to understand how this relates to the OGSA naming scheme. 4. WS-DAI defines properties for the name of a resource and a human-readable description of the resource. These seem reasonably generic properties - we (or even the OGSA WG) might want to consider whether they are more widely useful. (Or perhaps we should ask the DAIS WG to explain why they are necessary in WS-DAI if they are not needed anywhere else). Finally, I note that section 11.3 mentions enhanced access operations that would ease the federation of a data resource. This is worth a forward mention from the data access section itself. Dave. -----Original Message----- From: owner-ogsa-d-wg(a)ggf.org [mailto:owner-ogsa-d-wg@ggf.org] On Behalf Of Dave Berry Sent: 29 June 2006 23:34 To: ogsa-d-wg(a)gridforum.org Subject: [ogsa-d-wg] New version of architecture document I've uploaded a new version of the architecture document - https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.ogsa- d-wg/docman.root.working_drafts/doc13621/2. Changes: - I've moved some generic description out of the data access section into the introductory sections. - I've tidied the data access section. At least, I think it's tidier; please could the authors take a look and tell me what I've messed up? - I've made the discussion of policies and agreements more consistent throughout the document. This includes moving a list of example policies from the federation section into section 2. - I've tidied the glossary, removing unused items and ensuring that certain other terms are used consistently in the text. Note: where I've copied chunks of text from one place to another, I switched off change tracking because such large deletions and additions don't tell you much. Instead, I've highlighted the text in yellow where it now appears. Still to do (at least): - Add a discussion of interfaces to the data caching section. - Ditto for the replication section. - Revise the metadata catalog section. - Tidy the appendix list of standards. I'm about to go on holiday for a week, so these tasks won't get done for a while. Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA Tel: +44 131 651 4039

2 1

New version of architecture document
by Dave Berry 29 Jun '06

29 Jun '06

I've uploaded a new version of the architecture document - https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.ogsa- d-wg/docman.root.working_drafts/doc13621/2. Changes: - I've moved some generic description out of the data access section into the introductory sections. - I've tidied the data access section. At least, I think it's tidier; please could the authors take a look and tell me what I've messed up? - I've made the discussion of policies and agreements more consistent throughout the document. This includes moving a list of example policies from the federation section into section 2. - I've tidied the glossary, removing unused items and ensuring that certain other terms are used consistently in the text. Note: where I've copied chunks of text from one place to another, I switched off change tracking because such large deletions and additions don't tell you much. Instead, I've highlighted the text in yellow where it now appears. Still to do (at least): - Add a discussion of interfaces to the data caching section. - Ditto for the replication section. - Revise the metadata catalog section. - Tidy the appendix list of standards. I'm about to go on holiday for a week, so these tasks won't get done for a while. Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA Tel: +44 131 651 4039

1 0

No telcon next week
by Dave Berry 28 Jun '06

28 Jun '06

There will not be a telcon of the OGSA Data WG next week (July 5th). I attach this week's minutes, which are also on GridForge at http://tinyurl.com/nbekd. Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA +44 131 651 4039

1 0

Agenda for July 28th telcon
by Dave Berry 26 Jun '06

26 Jun '06

The next teleconference of the OGSA Data Architecture working group will be held on Wednesday June 28th, 2006 at the usual time of 8:00am Pacific / 11:00am Eastern / 4:00pm UK / 5:00pm Europe. We will review the latest draft of the architecture document, which can be found at https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.ogsa- d-wg/docman.root.working_drafts/doc13621/1 Here is the teleconference information: UK dialin: 0845 245 0224 US dialin: 1 866 838 0046 Intl dialin: +44 1452 542309 Passcode: 275359 Draft agenda for the June 28th teleconference: 1) Early discussion (5 minutes) Note taker assignment Roll call Minutes Approval (attached) Agenda bashing 2) Action report (5 minutes) - Dave and Allen to schedule 2 sessions at GGF 18. - All WG members to review latest version of architecture document. - Stephen to ask Luc's provenance team why they have chosen a separate provenance store. - Chris to finsh GFS scenario - Dave to contact OGSA WG about the dates in the roadmap document. - Stephen to carry on chasing Luc about the provenance scenario. - Stephen & Dave to review scenarios doc from a storage perspective. - Dave to draft metadata catalog scenario & services (cf. SRB) - Ann to check the Access section for suitability for file replication. - Section authors review security aspects of their sections. 3) Review of architecture document (45 minutes) 4) Wrap up (5 minutes) Topics for future meetings - July 5: No call? - July 12: ? Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA +44 131 651 4039

1 0

Definition of "data set"
by Dave Berry 21 Jun '06

21 Jun '06

The glossary in the OGSA Data Architecture document currently defines "data set" as: "An encoding of data in a syntax suitable for externalisation outside of a data service, for example communication to/from a data service. Examples include a WebRowSet encoding of an SQL query result set, a JPEG encoded byte array, and a ZIP encoded byte array of a set of files." Is this correct? I'm not convinced that we use the term consistently to mean this - sometimes we just seem to mean a defined set of data items on a resource. We may need to check each occurrence of the term (there aren't too many). Best wishes, Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA +44 131 651 4039

3 2

OGSA-Data call minutes 6/21
by Christopher T. Jordan 21 Jun '06

21 Jun '06

Attendees: Chris Jordan, Allen Luniewski, Stephen Davey, Mike Behrens, Mario Antonioletti Short call, only agenda item being GGF18 planning Dave Berry will attend, Allen and Chris may attend. Both the Architecture and Scenarios documents are expected to be ready for public comment by GGF18. Therefore, it was agreed that we should schedule two sessions, one for each document. Action for Dave and Allen to schedule 2 sessions at GGF 18. Action for all WG members to review latest version of architecture document. Action for Chris to finish fiddling with GFS Scenario. Tentative plan for call next week, agenda: Discuss latest changes to Architecture document. Any other items for next weeks call? -- Chris Jordan HPC Systems Engineer San Diego Supercomputer Center ctjordan(a)sdsc.edu 858.534.8347

1 0

New version of Arch document
by Dave Berry 21 Jun '06

21 Jun '06

All, I've put a new version of the architecture document on GridForge at https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.ogsa- d-wg/docman.root.working_drafts/doc13621/1. This version addresses most of the issues raised by our recent review. I've also attempted to address the issues raised by some of the comments in the document itself - see the attached text file. I would appreciate any feedback on these changes (especially with regard to whether I can now delete the relevant comments). The changes in this version are primarily in the introductory and background sections. I still want to do more work on the technical sections, in particular spending more time on the interface outlines. Best wishes, Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA +44 131 651 4039

1 0

This week's telcon will start 30 minutes late.
by Dave Berry 19 Jun '06

19 Jun '06

Chris and I will attempt to call in from HPDC in Paris. UK dialin: 0845 245 0224 US dialin: 1 866 838 0046 Intl dialin: +44 1452 542309 Passcode: 275359 Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA +44 131 651 4039

1 0

RE: [ogsa-d-wg] June 14th telcon - data scenarios v0.13
by Stephen Davey 13 Jun '06

13 Jun '06

Hi, In preparation for the review of the data scenarios document tomorrow I have attached the latest version v0.13. I'll try to put this version on GridForge as well. It contains the Data Provenance Scenario & Grid File System Scenario, but these are currently work in progress. At present v0.13 does not include any updates based on the comments sent recently by Allen and Mario. But we can discuss these during the telcon. Cheers, Stephen. -------------------------- Stephen Davey, National e-Science Centre, Edinburgh, UK. -----Original Message----- From: owner-ogsa-d-wg(a)ggf.org [mailto:owner-ogsa-d-wg@ggf.org] On Behalf Of Dave Berry Sent: 12 June 2006 18:36 To: ogsa-d-wg(a)gridforum.org Subject: [ogsa-d-wg] Agenda for June 14th telcon The next teleconference of the OGSA Data Architecture working group will be held on Wednesday June 14th, 2006 at the usual time of 8:00am Pacific / 11:00am Eastern / 4:00pm UK / 5:00pm Europe. We will review the scenarios document, which can be found at https://forge.gridforum.org/sf/go/doc13591?nav=1. Here is the teleconference information: UK dialin: 0845 245 0224 US dialin: 1 866 838 0046 Intl dialin: +44 1452 542309 Passcode: 275359 Draft agenda for the June 14th teleconference: 1) Early discussion (5 minutes) Note taker assignment Roll call Minutes Approval (attached) Agenda bashing 2) Action report (5 minutes) - Stephen to ask Luc's provenance team why they have chosen a separate provenance store. - Chris to continue work on GFS scenario - Dave to contact OGSA WG about the dates in the roadmap document. - Stephen to carry on chasing Luc about the provenance scenario. - Stephen & Dave to review scenarios doc from a storage perspective. - Dave to draft metadata catalog scenario & services (cf. SRB) - Ann to check the Access section for suitability for file replication. - Section authors review security aspects of their sections. 3) Review of scenarios document (45 minutes) 4) Wrap up (5 minutes) Topics for future meetings - June 21: Short call (half an hour later). Review arch doc? - June 28: Provenance? - July 5: No call? - July 12: ? Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA Tel: +44 131 651 4039

2 1

RE: [ogsa-d-wg] June 14th telcon - comments on scenarios
by Stephen Davey 13 Jun '06

13 Jun '06

Hi again, For reference I have attached the comments made on versions v0.11 & v0.12 by Allen and Mario respectively. Version v0.13 hasn't changed that much recently, just the addition of 2 new scenarios, so all the comments should still be relevant. Cheers, Stephen. -------------------------- Stephen Davey, National e-Science Centre, Edinburgh, UK. -----Original Message----- From: owner-ogsa-d-wg(a)ggf.org [mailto:owner-ogsa-d-wg@ggf.org] On Behalf Of Dave Berry Sent: 12 June 2006 18:36 To: ogsa-d-wg(a)gridforum.org Subject: [ogsa-d-wg] Agenda for June 14th telcon The next teleconference of the OGSA Data Architecture working group will be held on Wednesday June 14th, 2006 at the usual time of 8:00am Pacific / 11:00am Eastern / 4:00pm UK / 5:00pm Europe. We will review the scenarios document, which can be found at https://forge.gridforum.org/sf/go/doc13591?nav=1. Here is the teleconference information: UK dialin: 0845 245 0224 US dialin: 1 866 838 0046 Intl dialin: +44 1452 542309 Passcode: 275359 Draft agenda for the June 14th teleconference: 1) Early discussion (5 minutes) Note taker assignment Roll call Minutes Approval (attached) Agenda bashing 2) Action report (5 minutes) - Stephen to ask Luc's provenance team why they have chosen a separate provenance store. - Chris to continue work on GFS scenario - Dave to contact OGSA WG about the dates in the roadmap document. - Stephen to carry on chasing Luc about the provenance scenario. - Stephen & Dave to review scenarios doc from a storage perspective. - Dave to draft metadata catalog scenario & services (cf. SRB) - Ann to check the Access section for suitability for file replication. - Section authors review security aspects of their sections. 3) Review of scenarios document (45 minutes) 4) Wrap up (5 minutes) Topics for future meetings - June 21: Short call (half an hour later). Review arch doc? - June 28: Provenance? - July 5: No call? - July 12: ? Dave Berry Deputy Director, Research & E-infrastructure Development National e-Science Centre, 15 South College Street Edinburgh, EH8 9AA Tel: +44 131 651 4039

1 0