- dfdl-wg - lists.ogf.org

DFDL Regular Expression proposal
by Alan Powell 09 Apr '08

09 Apr '08

Attached is the proposal for the regular expression syntax used to determine element length. Highlights Based on the XML Schema regular expression subset used by WebSphere Message Broker. Only applies to representation = text Uses LengthPattern property rather than decorated syntax to distinguish from literals and regular expressions as it is only used in one place, this avoids everywhere else having to escape the decoration character and we are running out of decoration characters. Assumes the pattern is converted to the data code page before matching against the data stream. Comments and improvements as soon as possible please. Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

3 2

Agenda for today's call (9th April)
by Steve Hanson 09 Apr '08

09 Apr '08

Plenty to consider today... - OGF23 - the call for participation deadline is Friday, April 11. - Possible F2F in UK - Review decimals supplement - Review regular expression proposal - Review latest Calculated Values proposal - Forward references (for nil indicator path, occurs path, length path) Regards, Steve Steve Hanson WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Fw: [wg-all] OGF23 Deadlines Approaching
by Steve Hanson 09 Apr '08

09 Apr '08

Fyi Regards, Steve Steve Hanson WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 ----- Forwarded by Steve Hanson/UK/IBM on 09/04/2008 10:22 ----- "Julie Wulf-Knoerzer" <wulf(a)ogf.org> Sent by: wg-all-bounces(a)ogf.org 04/04/2008 03:18 To <wg-all(a)ogf.org> cc Subject [wg-all] OGF23 Deadlines Approaching 1. Call For Participation (final week) 2. Registration (final week for early rate) 3. Hotel Reservations 4. Student Scholarships 5. Group Chair Scheduling 6. Sponsorship Opportunities ++++ 1. OGF23 Call For Participation The OGF23 CFP deadline is Friday, April 11. As with previous OGF events, we are soliciting proposals for content that supports our mission of accelerating grid adoption in both research and industry. While all proposed content related to grid technology and usage is welcome, content related to the following topics is being particularly sought: -OGF Specification Adoption -Digital Repositories -Data Management in a Grid Environment The complete CFP can be viewed at http://www.ogf.org/OGF23/cfp.php. 2. OGF23 Registration Register today to take advantage of OGF23?s Early Registration rate which expires on Friday, April11! Registration is available by fax, phone or online. For complete details and to register, please visit http://ogf.org/OGF23/registration.php. 3. OGF23 Hotel Reservations OGF has secured a block of sleeping rooms at the Barcelo Sans Hotel (meeting location). Reservations must be made on or before May 15, to receive the discounted rate. Due to the busy travel season in June, attendees are encouraged to book as early as possible. Reservations can be made via fax, by calling the hotel directly (be sure to reference ?OGF23?), or online via http://www.ogf.org/OGF23/lodging.php. 4. OGF23 Student Scholarships A limited number of student scholarships are available for qualifying students. Hosted by OGF, OGF-Europe and CoreGRID, the OGF23 student scholarship program provides a unique opportunity for students to participate in OGF program sessions and group sessions as well as network with distinguished community participants and leaders. Application details and eligibility requirements can be found at http://ogf.org/OGF23/students.php. 5. Group Chair Scheduling OGF Group Chair session scheduling will remain open until April 21. Session scheduling and document details along with a link to the online session request site can be accessed via http://ogf.org/OGF23/chairinfo.php. 6. Sponsorship Opportunities Sponsoring OGF events provides numerous opportunities for your organization to gain greater visibility and recognition as a Grid leader in our global community. Please review the sponsor prospectus at http://ogf.org/OGF23/sponsor.php and consider sponsoring OGF23. +++++++++++++ About OGF23 The global grid community will gather for Open Grid Forum?s twenty-third event in Barcelona, Spain on 2-6 June, 2008, strategically placed in easy reach of many European & global experts. Hosted by the Barcelona Supercomputing Center, OGF23 is also the first international event where the recently EU-funded OGF-EUROPE project, will play a primary organizing role in the overall event and the program. This project focuses on mobilizing and integrating communities on grid standards & best practices. During a portion of the week (3-5 June), the EU-funded BEinGRID project will be co-locating its "Industry Days" event which includes results of their business experiments using grid technologies. BEinGRID will also show numerous demonstrations of grid deployments in various commercial environments. A small commercial exhibition will also be an important part of this multi-faceted event. -- The wg-all mailing list is an umbrella list for all OGF mailing lists. If you are subscribed to any OGF mailing list, you will receive mails to wg-all. You can unsubscribe from this list on http://www.ogf.org/cgi-bin/perl/unsubscribe-wg-all.pl wg-all mailing list wg-all(a)ogf.org http://www.ogf.org/mailman/listinfo/wg-all Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 02 Apr 2008
by Ian W Parkinson 03 Apr '08

03 Apr '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 16:00 GMT, 2 Apr 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Ian Parkinson (IBM) Alan Powell (IBM) 1. Calculated Values Mike has distributed a revised calculated values section. Alan has replied with some comments which will be incorporated. 2. Nil, Defaults and Optional Elements The working group reviewed Alan's revised treatment of nil, defaults and optional elements, based on some discussions which took place within IBM. The following points were touched upon: The "nullKind" property has a possible value "xpath", this has changed to be "nullIndicator" When "nullIndicator" used, the associated descriptions of "nullIndicatorPath" and "nullIndicatorIndex" are not clear, and may not describe the intended use of these properties. They currently allow the null indicator to be any data type, and the null indicator value is compared against the "nullValues" list. The group opted to change this so that the null indicator must be xs:boolean, logical value "true" meaning that the field is null (no comparison against "nullValues"). Also it was decided to limit the "nullIndicatorPath" to a path XPath, and not a full expression, to allow inversion of the XPath on output. When "nullIndicator" used and unparsing, it is not obvious what bytes to write into a nil field - in principle, the minimum length of the field is filled with either fillByte or padChar. However, if an optional variable length field may be zero bytes long, we may not be able to distinguish between fields which are present but nil, and fields which are not present. Just as we disallow strings with a default value to have minLength="0", we could disallow potentially zero-length nillable elements. The specification should follow the convention established by XML Schema, and refer to 'nil' rather than 'null'. The "useNullValueForDefault" property presently only has meaning during unparse, and Steve felt this was asymmetric with parsing, where to get a missing element to have the value NULL in the infoset, you use an empty string as a null value. Mike observed an important symmetry in the ordinary case where the element is present but nil in either the source document during parse, or the source InfoSet during unparse, in that the nullValues list is used in both cases. After discussion, the group agreed that the property should be renamed to "useNilForDefault" and honoured for both parse and unparse. The format of the "nullValues" list is awkward, but it does allow all possible values to be represented. Alan will consider adding an 'empty string' entity to the set of defined DFDL entities. 3. Scoping Rules Steve suggested that DFDL could simplify its scoping rules, by treating all properties on elements, simpleTypes and sequences as if they were set with scope "hereOnly"; and giving scope applicability to properties on complexType definitions. This may, in particular, simplify DFDL tooling. This might require users to introduce an element and complexType definition into the middle of a structure purely for scoping purposes, however Mike suggested we allow scope-applicable properties to also be set on (named) model group definitions. This enables a model group definition and associated group reference to be used in the middle of a structure, instead of an element and complexType, which does not affect the infoset. Steve and Mike to think further on this subject, it sounds a promising simplification. 4. Other business Simplification: Steve asked Mike to consider whether we could remove the occursSeparator property. If an array has a separator, this can be achieved by wrapping the array in a sequence, which we already have to do if the array (as a whole) has an initiator or terminator. This provides a consistent rule - array has markup, array needs sequence wrapper. Mike agreed this was a desired simplification. Steve to write up proposal. Simplification: Steve asked Mike whether it would be possible to remove the occursStopValue property as it could be considered a terminator of an enclosing group. Mike pointed out that if the stop value is literal value that's fine, but not when it's logical value. Agreed that we could remove occursStopKind and always treat occursStopValue as logical value. Steve to write up proposal. Steve has distributed a new revision of the Decimal supplement, and is looking for feedback. Next weeks meeting should include a discussion of the Decimal supplement, and of Mike's work on calculated values. Meeting closed, 17:15 GMT Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Agenda for DFDL WG call - 02-04-2008
by Alan Powell 02 Apr '08

02 Apr '08

Proposed agenda for todays call Outstanding specification work items valueCalc - discuss mikes doc null/default/optionals Review changes and questions distributed by Alan. UML description of Schema Components Complete Property Precedence - Completed Variable Markup - The IBM team will attempt to refine Steve's earlier proposal to allow variable markup, planned for inclusion in draft 32, Regular Expressions for Lengths - no progress Update supplements - Discuss Steve's decimal supplement updates Assertions, Descriminators and Choice- Status Speculative Parsing - No progress. Property Reordering - No progress. Other Items Steve proposal on arrays and sequences Steve's proposal on scoping rules. Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

No WG meeting, 26th March
by Ian W Parkinson 26 Mar '08

26 Mar '08

Hi all, We've cancelled the DFDL WG call today due to lack of participants. I think we've been caught out by daylight savings time! Just to confirm, next week's call is scheduled for: Wednesday 2nd April, 4pm GMT -- that's 12pm Eastern Daylight Time and 5pm British Summer Time. These should be the usual local times. The USA is already on daylight savings; the UK starts daylight savings time this coming weekend. Cheers, Ian Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: 2008-03-26 Call
by Mike Beckerle 26 Mar '08

26 Mar '08

I apologize for not sending out an agenda in advance. I did manage to call in to this; however, the "call leader never activated the call" L. As per prior email, I did use this time to do my primary v32 deliverable. .mikeb

1 0

DFDL: Minutes from OGF WG call, 19 Mar 2008
by Ian W Parkinson 20 Mar '08

20 Mar '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 17:00 GMT, 19 Mar 2008 Attendees Steve Hanson (IBM) Ian Parkinson (IBM) Alan Powell (IBM) Apologies Mike Beckerle (Oco) 1. Outstanding specification work items The group is presently working towards draft 32 of the DFDL specification, with a revised target date of 31st March. The meeting reviewed status of the items planned for draft 32: valueCalc Mike is progressing this. Date required. null/default/optionals Alan is working on this and hopes to complete by the end of next week, for inclusion in draft 32. UML description of Schema Components Simon's revised diagrams were reviewed during last week's DFDL working group call. The overall "Schema" diagram will be included in draft 32, and the "Informal Overview" diagram will be included in a DFDL Primer document. Property Precedence - Completed, for inclusion in draft 32. Variable Markup - The IBM team will attempt to refine Steve's earlier proposal to allow variable markup, planned for inclusion in draft 32, Regular Expressions for Lengths - Alan to draft, planned for inclusion in draft 32. Update supplements - We currently have three supplements to update, on date/time, decimals, and text processing. Mike had previously suggested the use of a pattern language to describe non-text decimals (like we have for text decimals with dfdl:textNumberFormat). Steve will prepare a draft language for non-text decimals, to see if it is an improvement over equivalent set of properties. Assertions, Descriminators and Choice - After previous discussions, this is now in a position to be prepared for inclusion in draft 32. Having pushed the previous work on this, Suman will be asked to write this up. Date required. Speculative Parsing - The IBM team is reviewing the speculative parsing behaviour of existing IBM parsing technology, to see whether the same algorithms are appropriate for DFDL. Alan will take a first attempt at writing up the proposed DFDL behaviour for inclusion in the specification, possibly using pseudo-code. Property Reordering - No progress. The subsequent draft, 33, will be targetted for April 30th. Actions Mike, Suman - please confirm whether you are happy with the work items, and provide/correct dates listed below. Meeting closed, 17:45 GMT Attachment - Revised specification delivery plan Draft 32: valueCalc (Mike) - ??, 2008 *in progress* Remaining aspects of null/default/optionals (Alan) - Mar 31, 2008 2-level description of schema components, including UML (Simon) - * done* Property precedence for writing (Steve) - *done* Variable markup (Steve) - Mar 31, 2008 Regular expressions for lengths - Mar 31, 2008 (Alan) Bring supplements up-to-date (Steve) - Mar 31, 2008 Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) Draft 33: Escape schemes (Ian P) - Apr 30, 2008 String XML type (Ian P) - Apr 30, 2008 Variables - ??, 2008 (Mike) Selectors (Suman) - Apr 30, 2008 Improvements on property descriptions - ??, 2008 (All - split TBD) Envelopes and Payloads (Steve) - Apr 30, 2008 Extraneous to spec: Develop Schema for DFDL xsd (Suman) - Apr 30, 2008 Develop Schema for Schema DFDL Subset xsd (Suman) - Apr 30, 2008 (might not be needed) Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 12 Mar 2008 *** UPDATED ***
by Ian W Parkinson 20 Mar '08

20 Mar '08

All, Simon provided some feedback on last week's minutes, which is reflected in the updated minutes below. Thanks to Simon (and apologies for taking a full week to redistribute these). Please note these are the minutes from last week, I will distribute the minutes from yesteday's meeting shortly. Cheers, Ian Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 17:00 GMT, 12 Mar 2008 Attendees Simon Parker (PolarLake) Ian Parkinson (IBM) Alan Powell (IBM) Apologies Mike Beckerle (Oco) Steve Hanson (IBM) Suman Kalia (IBM) 1. UML Descriptions of Schema Components Followng recent reviews, Simon has distributed simplified versions of his schema component diagrams. This now uses a single diagram to describe the subset of XML schema on which DFDL is based. Colour distinguishes elements that can appear in XML schema documents from internal supporting constructs. A second diagram is used to provide an informal overview of the language. Simon has updated this to use the same wording and style as the formal diagram, but suggested the group may prefer the existing diagram in the current DFDL specification draft. Simon raised a question regarding the relationship of "Term" and "Particle" - his diagrams allow for a Term that is not part of a Particle, and he wondered whether this was correct. The diagrams are otherwise ready to drop into the specification, but Simon will distribute source files which can be edited in UMLet, in case any further changes are necessary. 2. Other business As per his recent email to the DFDL-WG mailing list, Simon and PolarLake are stepping back from active participation in the DFDL working group, though Simon will continue to monitor the DFDL-WG mailing list informally. On behalf of the group, Alan thanked Simon for his participation, and confirmed that Simon and PolarLake would still like to be listed as contributors to the final draft of the DFDL specification. Meeting closed, 17:25 GMT Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Call today is at 5pm GMT so that's 1pm EST (not 12pm)
by Steve Hanson 19 Mar '08

19 Mar '08

Regards, Steve Steve Hanson WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848

1 0