- ogsa-d-wg - lists.ogf.org

International Provenance and Annotation Workshop 2006
by Dave Berry 24 Jan '06

24 Jan '06

Please find attached a call for papers for IPAW 06. Dave Berry Research Manager, National e-Science Centre 15 South College St., Edinburgh Tel: +44 131 6514039

1 0

RE: [ogsa-d-wg] The big picture
by Stephen Davey 23 Jan '06

23 Jan '06

Hi Dave, I think the pictures give a nice illustration of the basic structure. On the 2 diagrams you have a line going directly from the Storage Service to the Stored Resources Service. Should this line actually go via an interface on one or other of the services? Cheers, Stephen. -----Original Message----- From: owner-ogsa-d-wg(a)ggf.org [mailto:owner-ogsa-d-wg@ggf.org] On Behalf Of Dave Berry Sent: 22 January 2006 16:37 To: ogsa-d-wg(a)gridforum.org Subject: [ogsa-d-wg] The big picture Dear All, I've been asked to provide a diagram that shows the "big picture" of the OGSA Data Architecture. This would be used in the OGSA 1.5 document and in the overview section of our document(s), and perhaps also in powerpoint presentations. I've come up with the pair of diagrams and associated text in the attachment. Please take a look. Best wishes, Dave Berry Research Manager, National e-Science Centre 15 South College St., Edinburgh Tel: +44 131 6514039

2 1

The big picture
by Dave Berry 23 Jan '06

23 Jan '06

Dear All, I've been asked to provide a diagram that shows the "big picture" of the OGSA Data Architecture. This would be used in the OGSA 1.5 document and in the overview section of our document(s), and perhaps also in powerpoint presentations. I've come up with the pair of diagrams and associated text in the attachment. Please take a look. Best wishes, Dave Berry Research Manager, National e-Science Centre 15 South College St., Edinburgh Tel: +44 131 6514039

2 1

Telcon agenda for January 25th - Gap analysis
by Dave Berry 22 Jan '06

22 Jan '06

Dear All, The next teleconference of the OGSA Data Architecture working group will be held on Wednesday, January 25th, 2006 at the usual time of 8:00am Pacific / 11:00am Eastern / 4:00pm UK / 5:00pm Europe. In this telcon we will review the presentation that Allen & I prepared for this week's OGSA F2F, which includes a gap analysis of the data architecture (http://tinyurl.com/bpujm) Please contribute your ideas and suggestions. Here is the updated teleconference information: UK dialin: 0845 245 0224 US dialin: 1 866 838 0046 Intl dialin: +44 1452 542309 Passcode: 275359 Agenda for the January 25th teleconference: 1) Early discussion (5 minutes) Note taker assignment Roll call Minutes Approval (http://tinyurl.com/7uoyd) Agenda bashing 2) Action report (5 minutes) - Dave to check dates for submitting documents for GGF16 [We've missed it] - Allen to work on an integration pass, including a scoping section. - Dave to investigate Skype or phone for OGSA Data session at F2F. [Done] - Ann to check the Access section for suitability for file replication. - Mario to update the Access section and make text available for comment. - Section authors to add security notes to their sections. - Everyone to talk with your contacts to get more participation in this WG. - Allen/Dave to contact David Martin & Hiro Kishimoto to get reviewers & expert participation. 3) Progress & planning update (5 minutes) Report of F2F meeting Update on document writing, links with other WGs, plans for telcons up to GGF16. 4) Review of F2F presentation (40 minutes) Overview of architecture document. Identify gaps that need to be addressed. Clarify scope. etc. 5) Wrap up (5 minutes) Next meetings: Feb 1st: Feb 8th: Feb 13th-16th: GGF16 in Athens Dave Berry Research Manager, National e-Science Centre 15 South College St., Edinburgh Tel: +44 131 6514039

1 0

Notes from ByteIO F2F 20060119 Sunnyvale
by neil p chue hong 19 Jan '06

19 Jan '06

The presentations and minutes are available on GridForge: http://forge.gridforum.org/docman2/ViewCategory.php?group_id=154&category_id =1210&filtertype=basic ByteIO F2F Minutes 19/1/06 - Fujitsu, Sunnyvale ------------------ Mark Morgan Neil Chue Hong Andrew Grimshaw Steve McGough Dave Berry Fred Brisard? Darren Pulsipher Andreas Savva Dave Snelling Hiro Kishimoto Allen Lunieski Started session by screening www.405themovie.com - played using ByteIO (DIME/FTP) to access the file. Cool! Dave: Does the interface simplifies if you remove strided read? - Yes Andreas: Does long mean 64 bits? - Yes Hiro: Why is the return type of seekWrite void? What if there is an error? - An error would throw a fault ?: Why is seekOrigin a URI? - Essentially have defined three qnames as URIs, rather than a URI as a generic locator. Could do as an enum, but noone has complained with this approach. Hiro: what happens if someone seekWrites backwards. - This can fail, if the stream does not allow it, but may work if the stream supports it. Andreas: Do you write zeroes if seekWriting backwards? - You pass over the data unchanged, if going past end of stream. Is implemented similar to UNIX, i.e. bytes to pad are undefined. - Does the document specify the semantics for this clearly? Check this. Currently in GFSG review. Will revise the docs as go through PC comments. DEMO: demonstrated FTP interface using ByteIO (easy to get Windows to interface with it) and a set of command line utilities. EPCC addresses uses lowlevel Java functions to a particular URL but will write a different address in the <To> field which means the MS client cannot use this. Looking at <To> field and using it as a despatcher. Service is at http://foobar/blah/byteio <EPR> <To>http://byteio/?/ResourceName</To> </EPR> There is no information in the To field to point it to the service. We'll look at this and try for interop at GGF16. GFSG is working on a template for interop documents. We should work with them (Steve Pickles?) Does GFSG have a template for experience documents - what should they contain? Dave B: you're using URIs to define transfer mechanisms. Does OGSA as a whole have a policy on the use of URIs? e.g. what happens if we use URIs to identify transfer messages elsewhere? Dave S: If you are using ByteIO as a mechanism, then you should use the ByteIO one. If not, there is no problem with having a plethora of mechanism definitions. Dave B: recommend OGSA create a central list of mechanisms Neil: just now, think it's better to just let groups own the lists, when other groups need them refer back to OGSA. Only problem is when two groups overlap. This needs coordination. Dave B: e.g. DMIS should refer to byteio mechanisms and add a GridFTP transfer mechanism. Andreas: which version are you using of e.g. MTOM, DIME. We need to define this properly in the document, and also support this in the URI defining the transfer mechanism. Final words: - Give comments on the spec - next is interop between the three implementations - what do we need to write in an interop and experiences document? -- Neil P Chue Hong | T: [+44] (0)131 650 5957 Project Manager, EPCC | F: [+44] (0)131 650 6555 Rm 2409, JCMB, Mayfield Rd. | E: N.ChueHong(a)epcc.ed.ac.uk Edinburgh, EH9 3JZ, UK | W: http://www.epcc.ed.ac.uk BT MeetMe: http://tinyurl.com/8mwhd - Code: 14712935# "A film is like a battleground. It's love, hate, action, violence, death - in a word, emotion." - Sam Fuller

1 0

FW: HPDC Workshop on Next-Generation Distributed Data Management
by Dave Berry 15 Jan '06

15 Jan '06

FYI. _____ From: Ann Chervenak [mailto:annc@ISI.EDU] Sent: 13 January 2006 23:24 To: undisclosed-recipients Subject: CFP: HPDC Workshop on Next-Generation Distributed Data Management HPDC Workshop on Next-Generation Distributed Data Management http://www.isi.edu/~annc/distributedDataWorkshop.html <http://www.isi.edu/%7Eannc/distributedDataWorkshop.html> June 20, 2006 Paris, France Distributed data management is a challenging problem in high performance computing environments, and the difficulty of managing scientific and commercial data sets will increase as they scale to terabytes and petabytes in the coming years. In conjunction with HPDC, we will hold a one-day workshop that will gather together researchers and industry participants to discuss future trends for distributed data management in HPDC environments. We invite short papers (maximum 6 pages) of two types: position papers that discuss the authors' vision for trends or developments in data management in the three to five year timeframe or papers that describe innovative algorithms, tools or services for distributed data management. Topics of interest include, but are not limited to: * Peer-to-peer approaches to data discovery and data storage * Distributed Metadata management * Services for generating and maintaining provenance information * Techniques for replica management, including consistency of replicas * Algorithms for data placement, prefetching, staging, proactive replication * Federation of diverse databases, data mediation services * Distributed query processing * Virtualization of data resources * Interaction of data management with execution environments, including workflow management services, virtual machines * Validation of correctness of distributed data * Publish/subscribe systems * Advanced data transfer techniques * Namespace management, globally unique naming * Support for streaming data Important dates: * Position papers due: February 28, 2006 (Tuesday) * Program committee discussion: March 23, 2006 (Thursday) * Notification of acceptance of papers: March 27, 2006 (Monday) * Final papers due: April 14, 2006 (Friday) Submission: We will be using the HPDC conference submission site. Submission instructions to follow on workshop web site. Workshop organizers/co-chairs: Ann Chervenak, USC Information Sciences Institute (annc(a)isi.edu) Dave Berry, National UK e-Science Center (daveb(a)nesc.ac.uk) Neil P. Chue Hong, EPCC, University of Edinburgh (N.ChueHong(a)epcc.ed.ac.uk) Program committee: Gagan Agrawal, Ohio State Bill Allcock, Argonne National Laboratory Chaitan Baru, SDSC Karan Bhatia, SDSC Dieter Gawlick, Oracle Pilar Herrero, UPM Tahsin Kurc, Ohio State Allen Luniewski, IBM Andre Merzky, Zuse Institute Berlin Reagan Moore, SDSC Beth Plale, Indiana University Osamu Tatebe, AIST Kurt Stockinger, Lawrence Berkeley National Laboratory Stratis Viglas, U. Edinburgh

1 0

FW: [dais-wg] Request for Comments and Volunteers. (fwd)
by Dave Berry 13 Jan '06

13 Jan '06

Reagan Moore has given us a list of all the SRB access commands. These will be a useful check as to whether our architecture provides all the necessary functionality. (Although I expect these commands to map to various different parts of our architecture, not just our data access section). Dave. -----Original Message----- From: Mario Antonioletti [mailto:mario@epcc.ed.ac.uk] Sent: 12 January 2006 07:41 To: Dave Berry; Allen Luniewski Subject: Re: [dais-wg] Request for Comments and Volunteers. (fwd) Of course it helps if you guys get a copy of what Regan has added. +----------------------------------------------------------------------- + |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ || +----------------------------------------------------------------------- + ---------- Forwarded message ---------- Date: Wed, 11 Jan 2006 14:36:02 -0800 From: Reagan Moore <moore(a)sdsc.edu> To: Mario Antonioletti <mario(a)epcc.ed.ac.uk> Subject: Re: [dais-wg] Request for Comments and Volunteers. Mario: I added to the document the set of data access commands (74 in total) used by the Storage Resource Broker data grid to manage distributed shared collections. These commands go beyond simple data access, and include commands needed to minimize network latencies, manage distributed data, and federate independent data grids. The desire is to broaden the goals of the proposed data access mechanisms to make them relevant to a large number of established international data grids. A standard interface that is not able to support the operations provided by existing data grids will artificially restrict itself. Note that the functionality of the commands that are listed is required to support a diverse set of applications ranging from data grids to digital libraries to preservation environments. Reagan Moore > Hi, > Please find enclosed an updated (but not yet finished) version of a > Data > Access setion that is being prepared as a contribution to the OGSA Data > Archtecture document. The document is still a bit rough so my apologies for > that. I would like people who might want to help write > this section (and contribute to the OGSA Data document in general). > In particular: > > - I need someone to put some proper content in the ByteIO section. > - Folks to review and put forward their requirements/comments. > - DAIS folks to read the DAIS part and make sure it makes sense. > > This is a work in progress. Thanks in advance for any input you may > have or any bits that you may wish to contribute. > > Mario > > +----------------------------------------------------------------------- + > |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | > |Tel:0131 650 > |5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | > +----------------------------------------------------------------------- + > > Content-Type: APPLICATION/msword; name=DataAccess2.doc > Content-ID: <Pine.SOC.4.63.0601111855110.27083(a)garnet.epcc.ed.ac.uk> > Content-Description: > Content-Disposition: attachment; filename=DataAccess2.doc > > Attachment converted: Macintosh HD:DataAccess2.doc (WDBN/<IC>) > (0040EF21)

1 0

RE: [ogsa-d-wg] Telcon details for Monday's F2F - with passcode
by Dave Berry 13 Jan '06

13 Jan '06

I forgot to include the passcode. USA: 1 866 838 0046 UK: 0845 245 0224 International: +44 1452 542309 Passcode: 275359 The meeting is scheduled for 9-12.30 and 1.30-5.00, US Pacific time. Dave.

1 0

Telcon details for Monday's F2F
by Dave Berry 13 Jan '06

13 Jan '06

All, We have arranged a phone bridge for Monday's OGSA Data F2F. To join, please call the following telcon number: USA: 1 866 838 0046 UK: 0845 245 0224 International: +44 1452 542309 The meeting is scheduled for 9-12.30 and 1.30-5.00, US Pacific time. Dave Berry Research Manager, National e-Science Centre 15 South College St., Edinburgh Tel: +44 131 6514039

1 0

Request for Comments and Volunteers.
by Mario Antonioletti 11 Jan '06

11 Jan '06

Hi, Please find enclosed an updated (but not yet finished) version of a Data Access setion that is being prepared as a contribution to the OGSA Data Archtecture document. The document is still a bit rough so my apologies for that. I would like people who might want to help write this section (and contribute to the OGSA Data document in general). In particular: - I need someone to put some proper content in the ByteIO section. - Folks to review and put forward their requirements/comments. - DAIS folks to read the DAIS part and make sure it makes sense. This is a work in progress. Thanks in advance for any input you may have or any bits that you may wish to contribute. Mario +-----------------------------------------------------------------------+ |Mario Antonioletti:EPCC,JCMB,The King's Buildings,Edinburgh EH9 3JZ. | |Tel:0131 650 5141|mario@epcc.ed.ac.uk|http://www.epcc.ed.ac.uk/~mario/ | +-----------------------------------------------------------------------+

1 0