- dfdl-wg - lists.ogf.org

DFDL: Minutes from OGF WG call, 19 Mar 2008
by Ian W Parkinson 20 Mar '08

20 Mar '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 17:00 GMT, 19 Mar 2008 Attendees Steve Hanson (IBM) Ian Parkinson (IBM) Alan Powell (IBM) Apologies Mike Beckerle (Oco) 1. Outstanding specification work items The group is presently working towards draft 32 of the DFDL specification, with a revised target date of 31st March. The meeting reviewed status of the items planned for draft 32: valueCalc Mike is progressing this. Date required. null/default/optionals Alan is working on this and hopes to complete by the end of next week, for inclusion in draft 32. UML description of Schema Components Simon's revised diagrams were reviewed during last week's DFDL working group call. The overall "Schema" diagram will be included in draft 32, and the "Informal Overview" diagram will be included in a DFDL Primer document. Property Precedence - Completed, for inclusion in draft 32. Variable Markup - The IBM team will attempt to refine Steve's earlier proposal to allow variable markup, planned for inclusion in draft 32, Regular Expressions for Lengths - Alan to draft, planned for inclusion in draft 32. Update supplements - We currently have three supplements to update, on date/time, decimals, and text processing. Mike had previously suggested the use of a pattern language to describe non-text decimals (like we have for text decimals with dfdl:textNumberFormat). Steve will prepare a draft language for non-text decimals, to see if it is an improvement over equivalent set of properties. Assertions, Descriminators and Choice - After previous discussions, this is now in a position to be prepared for inclusion in draft 32. Having pushed the previous work on this, Suman will be asked to write this up. Date required. Speculative Parsing - The IBM team is reviewing the speculative parsing behaviour of existing IBM parsing technology, to see whether the same algorithms are appropriate for DFDL. Alan will take a first attempt at writing up the proposed DFDL behaviour for inclusion in the specification, possibly using pseudo-code. Property Reordering - No progress. The subsequent draft, 33, will be targetted for April 30th. Actions Mike, Suman - please confirm whether you are happy with the work items, and provide/correct dates listed below. Meeting closed, 17:45 GMT Attachment - Revised specification delivery plan Draft 32: valueCalc (Mike) - ??, 2008 *in progress* Remaining aspects of null/default/optionals (Alan) - Mar 31, 2008 2-level description of schema components, including UML (Simon) - * done* Property precedence for writing (Steve) - *done* Variable markup (Steve) - Mar 31, 2008 Regular expressions for lengths - Mar 31, 2008 (Alan) Bring supplements up-to-date (Steve) - Mar 31, 2008 Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) Draft 33: Escape schemes (Ian P) - Apr 30, 2008 String XML type (Ian P) - Apr 30, 2008 Variables - ??, 2008 (Mike) Selectors (Suman) - Apr 30, 2008 Improvements on property descriptions - ??, 2008 (All - split TBD) Envelopes and Payloads (Steve) - Apr 30, 2008 Extraneous to spec: Develop Schema for DFDL xsd (Suman) - Apr 30, 2008 Develop Schema for Schema DFDL Subset xsd (Suman) - Apr 30, 2008 (might not be needed) Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 12 Mar 2008 *** UPDATED ***
by Ian W Parkinson 20 Mar '08

20 Mar '08

All, Simon provided some feedback on last week's minutes, which is reflected in the updated minutes below. Thanks to Simon (and apologies for taking a full week to redistribute these). Please note these are the minutes from last week, I will distribute the minutes from yesteday's meeting shortly. Cheers, Ian Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 17:00 GMT, 12 Mar 2008 Attendees Simon Parker (PolarLake) Ian Parkinson (IBM) Alan Powell (IBM) Apologies Mike Beckerle (Oco) Steve Hanson (IBM) Suman Kalia (IBM) 1. UML Descriptions of Schema Components Followng recent reviews, Simon has distributed simplified versions of his schema component diagrams. This now uses a single diagram to describe the subset of XML schema on which DFDL is based. Colour distinguishes elements that can appear in XML schema documents from internal supporting constructs. A second diagram is used to provide an informal overview of the language. Simon has updated this to use the same wording and style as the formal diagram, but suggested the group may prefer the existing diagram in the current DFDL specification draft. Simon raised a question regarding the relationship of "Term" and "Particle" - his diagrams allow for a Term that is not part of a Particle, and he wondered whether this was correct. The diagrams are otherwise ready to drop into the specification, but Simon will distribute source files which can be edited in UMLet, in case any further changes are necessary. 2. Other business As per his recent email to the DFDL-WG mailing list, Simon and PolarLake are stepping back from active participation in the DFDL working group, though Simon will continue to monitor the DFDL-WG mailing list informally. On behalf of the group, Alan thanked Simon for his participation, and confirmed that Simon and PolarLake would still like to be listed as contributors to the final draft of the DFDL specification. Meeting closed, 17:25 GMT Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Call today is at 5pm GMT so that's 1pm EST (not 12pm)
by Steve Hanson 19 Mar '08

19 Mar '08

Regards, Steve Steve Hanson WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848

1 0

DFDL: MikeB will not make the call on 3/19
by Mike Beckerle 17 Mar '08

17 Mar '08

On vacation.

2 1

DFDL: Minutes from OGF WG call, 12 Mar 2008
by Ian W Parkinson 13 Mar '08

13 Mar '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 17:00 GMT, 12 Mar 2008 Attendees Simon Parker (PolarLake) Ian Parkinson (IBM) Alan Powell (IBM) Apologies Mike Beckerle (Oco) Steve Hanson (IBM) Suman Kalia (IBM) 1. UML Descriptions of Schema Components Followng recent reviews, Simon has distributed simplified versions of his schema component diagrams. This now uses a single diagram to describe the entire DFDL language. Concepts found in XML schema (XSD) are colored yellow, to distinguish from concepts that would not be found in XML schema, which are left white. A second diagram is used to provide an informal overview of the language. Simon has updated this to use the same wording and style as the formal diagram, but suggested the group may prefer the existing diagram in the current DFDL specification draft. Simon raised a question regarding the relationship of "Term" and "Particle" - his diagrams allow for a Term that is not part of a Particle, and he wondered whether this was correct. The diagrams are otherwise ready to drop into the specification, but Simon will distribute source files which can be edited in UMLet, in case any further changes are necessary. 2. Other business As per his recent email to the DFDL-WG mailing list, Simon and PolarLake are stepping back from active participation in the DFDL working group, though Simon will continue to monitor the DFDL-WG mailing list informally. On behalf of the group, Alan thanked Simon for his participation, and confirmed that Simon and PolarLake would still like to be listed as contributors to the final draft of the DFDL specification. Meeting closed, 17:25 GMT Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Diagram tool and originals
by Simon Parker 12 Mar '08

12 Mar '08

I used the UMLet (www.umlet.com) Eclipse plugin to compose the diagrams. Here are the source files for the diagrams in dfdl_schema_abstract_data_model.5.doc Use them as you see fit. I'll continue to lurk in the mailing list. If I can help with a quick answer, just ask. Regards, Simon Simon Parker Software Consultant PolarLake 80 Harcourt Street Dublin 2, Ireland Phone +353 1 449-1075 Fax +353 1 449-1011 Web http://www.polarlake.com/ The information transmitted in this email is intended for the addressee only and may contain confidential and/or privileged material. Any review, retransmission, dissemination, reliance upon or other use of this information by persons or entities other than the addressee is prohibited. If you think, for any reason, that this message may have been addressed to you in error, we would ask you to notify the sender immediately by return email and delete the material. PolarLake Limited | Registered in Dublin, Ireland | Number 357324 | Registered office as above.

1 0

DFDL schema abstract data model 5
by Simon Parker 12 Mar '08

12 Mar '08

Good afternoon, gentlemen. As I hoped, it has been possible to combine the three views into one diagram. There are no intentional changes in the terminology or meaning. I've also merged the content of the illustration from the specification with the new style and terms to produce an informal overview diagram. PolarLake has decided that this domain is 'not strategic', and the company will no longer support my participation in the working group. I remain interested in the standard and the group, and I was quite prepared to continue for as long as it takes, but my arguments did not prevail. I already have as many personal projects as I can manage. It would be unrealistic to offer more of my own time, so I must reluctantly withdraw from the group and leave you to work on without me. It has been a pleasure to meet you all. I wish you success in your efforts. Simon Simon Parker Software Consultant PolarLake 80 Harcourt Street Dublin 2, Ireland Phone +353 1 449-1075 Fax +353 1 449-1011 Web http://www.polarlake.com/ The information transmitted in this email is intended for the addressee only and may contain confidential and/or privileged material. Any review, retransmission, dissemination, reliance upon or other use of this information by persons or entities other than the addressee is prohibited. If you think, for any reason, that this message may have been addressed to you in error, we would ask you to notify the sender immediately by return email and delete the material. PolarLake Limited | Registered in Dublin, Ireland | Number 357324 | Registered office as above.

1 0

DFDL: MikeB unable to make call this week
by Mike Beckerle 11 Mar '08

11 Mar '08

Sorry folks, I am on customer engagement and unable to make the call this week. .mike

1 0

DFDL: Minutes from OGF WG call, 05 Mar 2008
by Ian W Parkinson 06 Mar '08

06 Mar '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 17:00 GMT, 05 Mar 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Ian Parkinson (IBM) Apologies Alan Powell (IBM), Simon Parker (PolarLake) 1. Discriminator Expressions Recent discussions on the DFDL-WG email list need to be written up for inclusion in the specification. It would be useful, as discussed, to automatically generate discriminators when converting COBOL copybooks, C structs etc. to DFDL schemas. As Mike observed, this will be difficult as copybooks and header files do not typically contain enough information to generate descriminators. 2. UML diagrams Steve is happier with the proposed UML diagrams now that they have been simplified. We had previously decided to include, in the specification, just the diagram showing the supported subset of XML schema. Now the diagrams are simplified, Simon is planning to attempt to combine the three current diagrams into a single diagram. Mike suggested a difficulty with these diagrams; some concepts (for example, element references) are not treated as real components in XML schema but are used, by DFDL, as part of the scoping rules. 3. valueCalc examples Mike has distributed a set of Powerpoint slides giving examples of calculated values, and thanks the group for the feedback. He will add an additional example showing output length calculation. 4. Remaining specification work The plan for draft 32 need to be adjusted as we have now missed many of the planned dates. Steve's 'unparser property precedence' item is complete; and the discussion on assertions and discriminators has made good progress, and need final write-up by Suman. Work on speculative parsing still needs to be assigned an owner, probably from IBM's WTX team. With regard to speculative parsing, Steve wondered whether this might affect the ability of an implementation to implement optimisations such as lazy parsing. Although this remains an implementation detail and not a subject to be covered by the DFDL specification, we will need to describe aspects of the behaviour of speculative parsing to be able to define uncertainty resolution in DFDL. Mike will include a review of the list of outstanding work items in the agenda for next week's DFDL-WG call. Meeting closed, 17:35 GMT Ian Parkinson WebSphere ESB Development Mail Point 211, Hursley Park, Hursley, Winchester, SO21 2JN, UK Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

WG call this week
by Alan Powell 05 Mar '08

05 Mar '08

I will not be able to make the call this week Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1