- dfdl-wg - lists.ogf.org

DFDL: Minutes from OGF WG call, 08 October 2008
by Alan Powell 13 Oct '08

13 Oct '08

Weekly Working Group Conference Call 13:00 GMT, 08 October 2008 Attendees Steve Hanson (IBM) Alan Powell (IBM) Apologies Mike Beckerle (Oco) 1. Decimal Supplement Previous decimal discussions had not covered syntax for defineTextNumberFormat and textNumberformat. Based on defineFormat/Format pattern defineTextNumberFormat annotation defines a named reusable number format <dfdl:defineTextNumberFormat name=?myNumFormat?> <dfdl:textNumberFormat decimalseparator="." /> </dfdl:defineTextNumberFormat> Note: does not have baseFormat= as nesting not required. textNumberFormat annotation contains the properties that define the numberformat. <dfdl:textNumberFormat decimalseparator="." /> textNumberFomatRef references a defineTextNumberFormat from an element declaration. <xs:element name="foo" type="xs:int" > <xs:annotation><xs:appinfo source=?http://www.ogf.org/dfdl/?> <dfdl:format representation="text" numberFormat=?text" textNumberFormatRef="myNumFormat"/> </xs:appinfo></xs:annotation> </xs:element> and has normal short and long form dfdl:textNumberFormatReference="myNumFormat" <dfdl:property name=textNumberFormatRef> "myNumFormat" </dfdl:property> Note: we decide not to follow the defineFormat/Format pattern of having the reference on the textNumberFormat as this wouldn't have allowed a short form and the normal form would be verbose. <dfdl:format representation="text" numberFormat=?text" > <dfdl:textNumberFormat ref="myNumFormat" /> </dfdl:format> Possible extension: As an extension textNumberFormat can also be in-line <xs:element name="foo" type="xs:int" > <xs:annotation><xs:appinfo source=?http://www.ogf.org/dfdl/?> <dfdl:format representation="text" numberFormat=?text" > <dfdl:textNumberFormat pattern='####' decimalseparator="." /> </dfdl:format> </xs:appinfo></xs:annotation> </xs:element> Scoping: In-line numberFormats override any textNumberFormatRefernce on the element or in scope. The textNumberFormat is considered as a single scheme and is overriden as a whole. Properties within textNumberFormat cannot be overridden separately 2. packedDecimalSignCodes packedDecimalSignCodes behaviour depends on NumberCheckPolicy but NumberCheckPolicy is defined in textNumberFormat which isn't applicable to binary numbers Not resolved. 3. NumberFormat Decided to split NumberFormat into textNumberRepresentation (text, zoned) and binaryNumberRepresentation(binary, bcd, packed) so there is a simple property decision tree based off representation 4. AOB Will discuss End of Data next week Next call 15st Oct Meeting closed, 14:05 GMT Actions raised at this meeting No Action 018 SH: Resolve packedDecimalSignCodes use of NumberCheckPolicy 019 MB: review defineTextNumberFormat as above Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 8/10: All issued resolved and added to spec except padding variable length. 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 8/10: added but problems with defineNumeberFormat identified and discussed 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 24/9: add calendar binary formats to actions 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 016 AP: add hidden changes to spec 017 All: Review EndOfData changes Actions closed at this meeting: No Action 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Re: [DFDL-WG] DFDL: Minutes from OGF WG call, 24 September 2008
by Alan Powell 25 Sep '08

25 Sep '08

Steve See bleow Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 From: Steve Hanson/UK/IBM To: Alan Powell/UK/IBM@IBMGB Cc: dfdl-wg(a)ogf.org, dfdl-wg-bounces(a)ogf.org Date: 25/09/2008 10:02 Subject: Re: [DFDL-WG] DFDL: Minutes from OGF WG call, 24 September 2008 Hi Alan 27 OccursKind for delimited arrays. occurskind = delimited had been removed in error and will be put back. occurskind renamed to occursLenghtKind -> Why occursLengthKind ? I prefer plain occursKind, because: a) There will be confusion with length. b) Symmetry: we have length & lengthKind, occurs & occursKind AWP>> I got the change wrong. At the F2F we agreed occursCount and occursCountKind 7 padding AP has done more investigation and main deficiency vs WTX is lack of support for pad to miminum length for variable length items. Agreed to add this. Will use minLength facet for strings and the number pattern for Text numbers. -> What about Text date/times? AWP>> We already have an action to sort out Text calendars/dates Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Alan Powell/UK/IBM@IBMGB Sent by: dfdl-wg-bounces(a)ogf.org 24/09/2008 17:32 To dfdl-wg(a)ogf.org cc Subject [DFDL-WG] DFDL: Minutes from OGF WG call, 24 September 2008 Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 24 September 2008 Attendees Mike Beckerle (Oco) Alan Powell (IBM) Apologies Steve Hanson (IBM) 1. Physical to Logical type conversions. Discussed table distributed by AP Simple type text (+ xml) binary String n/a Float ?? FloatFormat: IEEE, IBM390Hex Double ?? FloatFormat: IEEE, IBM390Hex Decimal/Integer NumberFormat: text, zoned NumberFormat: packed, BCD Long, Int, Short, Byte, NumberFormat: text, zoned NumberFormat: packed, BCD, twosComplement, binary UnsignedLong, Unsignedint, Unsignedshort, Unsignedbyte NumberFormat: text, zoned NumberFormat: packed, BCD, binary DateTime Date Time Duration Boolean HexBinary Agreed to keep FloatFormat rather than FloatBinaryFormat and not to have NumberTextFormat and NumberBinaryFormat. Reduces the number of properties. No need to add text to floatFormat Add NumberFormat Binary to do the 'normal' cases ie twoscomplement for signed types and unsigned binary for unsigned types. Remove twoscomplement. Can add other signed formats like onescomplement later when supported Keep zoned for unsigned text even though it will produce the same output as text but it also limits the allowable NumberPattern. Remove BCD from Long etc Need to investigate calendar/date text and binary formats. Add to existing action 2. WTX unresolved items. Last weeks decisions: 3,4 agreed to drop textCharacterSize and DBCSOnly from dfdl V1 7 Padding; deferred pending proposal from IBM (WTX) 9 Add zeroRequiredOnInput to meet WTX requirement - resolved 17 finalTerminatorCanBeMissing, finalPostFixSeparatorCanBeMissing. Agreed to drop these properties and change the default syntax of terminator and postFixSeparator to be optional on parsing the last element of a sequence but always written on unparsing. Continued this weeks: 20 unordered sequence does not necessarily need initiator, speculative parsing can work it out too. Discussed relaxing initiator restriction and infoset order Decided to add enum unorderedInitiated to sequenceKind for unordered initiated item and change unordered to be resolved by speculative parsing sequenceKind Enum Valid values are "ordered", "unordered" "unorderedInitiated" This property cannot have an expression used to compute its value. When "ordered", this property means that the contained items of the sequence will be encountered in the same order that they appear in the schema, which is called schema-definition-order. When "unordered", this property means that the items of the sequence will be encountered in any order. When "unorderedInitiated", this property means that the items of the sequence will be encountered in any order, but each item must have an initiator Annotation: dfdl:sequence The infoset order for unordered and unorderedInitiated is the order in the datastream. 25. ChoiceKind fixed or variable These are still needed. Decided to leave choiceKind as a single property but change fixed and variable longestLength and variableLength 27 OccursKind for delimited arrays. occurskind = delimited had been removed in error and will be put back. occurskind renamed to occursLenghtKind 7 padding AP has done more investigation and main deficiency vs WTX is lack of support for pad to miminum length for variable length items. Agreed to add this. Will use minLength facet for strings and the number pattern for Text numbers. 4. AOB Will discuss End of Data next week Next call 1st Oct Meeting closed, 14:05 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 24/9: add calendar binary formats to actions 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 016 AP: add hidden changes to spec 017 All: Review EndOfData changes 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 24 September 2008
by Alan Powell 25 Sep '08

25 Sep '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 24 September 2008 Attendees Mike Beckerle (Oco) Alan Powell (IBM) Apologies Steve Hanson (IBM) 1. Physical to Logical type conversions. Discussed table distributed by AP Simple type text (+ xml) binary String n/a Float ?? FloatFormat: IEEE, IBM390Hex Double ?? FloatFormat: IEEE, IBM390Hex Decimal/Integer NumberFormat: text, zoned NumberFormat: packed, BCD Long, Int, Short, Byte, NumberFormat: text, zoned NumberFormat: packed, BCD, twosComplement, binary UnsignedLong, Unsignedint, Unsignedshort, Unsignedbyte NumberFormat: text, zoned NumberFormat: packed, BCD, binary DateTime Date Time Duration Boolean HexBinary Agreed to keep FloatFormat rather than FloatBinaryFormat and not to have NumberTextFormat and NumberBinaryFormat. Reduces the number of properties. No need to add text to floatFormat Add NumberFormat Binary to do the 'normal' cases ie twoscomplement for signed types and unsigned binary for unsigned types. Remove twoscomplement. Can add other signed formats like onescomplement later when supported Keep zoned for unsigned text even though it will produce the same output as text but it also limits the allowable NumberPattern. Remove BCD from Long etc Need to investigate calendar/date text and binary formats. Add to existing action 2. WTX unresolved items. Last weeks decisions: 3,4 agreed to drop textCharacterSize and DBCSOnly from dfdl V1 7 Padding; deferred pending proposal from IBM (WTX) 9 Add zeroRequiredOnInput to meet WTX requirement - resolved 17 finalTerminatorCanBeMissing, finalPostFixSeparatorCanBeMissing. Agreed to drop these properties and change the default syntax of terminator and postFixSeparator to be optional on parsing the last element of a sequence but always written on unparsing. Continued this weeks: 20 unordered sequence does not necessarily need initiator, speculative parsing can work it out too. Discussed relaxing initiator restriction and infoset order Decided to add enum unorderedInitiated to sequenceKind for unordered initiated item and change unordered to be resolved by speculative parsing sequenceKind Enum Valid values are "ordered", "unordered" "unorderedInitiated" This property cannot have an expression used to compute its value. When "ordered", this property means that the contained items of the sequence will be encountered in the same order that they appear in the schema, which is called schema-definition-order. When "unordered", this property means that the items of the sequence will be encountered in any order. When "unorderedInitiated", this property means that the items of the sequence will be encountered in any order, but each item must have an initiator Annotation: dfdl:sequence The infoset order for unordered and unorderedInitiated is the order in the datastream. 25. ChoiceKind fixed or variable These are still needed. Decided to leave choiceKind as a single property but change fixed and variable longestLength and variableLength 27 OccursKind for delimited arrays. occurskind = delimited had been removed in error and will be put back. occurskind renamed to occursLenghtKind 7 padding AP has done more investigation and main deficiency vs WTX is lack of support for pad to miminum length for variable length items. Agreed to add this. Will use minLength facet for strings and the number pattern for Text numbers. 4. AOB Will discuss End of Data next week Next call 1st Oct Meeting closed, 14:05 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 24/9: add calendar binary formats to actions 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 016 AP: add hidden changes to spec 017 All: Review EndOfData changes 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1

OGF DFDL Working Group weekly call
by Steve Hanson 19 Sep '08

19 Sep '08

Alan - I will be with Volvo for most of Wednesday. Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 17 September 2008
by Alan Powell 17 Sep '08

17 Sep '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 17 September 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Alan Powell (IBM) 1. Visit actions Actions updated below 2. Hidden proposal Agreed to adopt proposal for hidden element to be a reference to a group. Decided not to have dfdlHidden=true on referenced group/sequence be more composable. 3. WTX unresolved items. 3,4 agreed to drop textCharacterSize and DBCSOnly from dfdl V1 7 Padding; deferred pending proposal from IBM (WTX) 9 Add PadRequiredOnInput to meet WTX requirement - resolved 17 finalTerminatorCanBeMissing, finalPostFixSeparatorCanBeMissing. Agreed to drop these properties and change the default syntax of terminator and postFixSeparator to be optional on parsing the last element of a sequence but always written on unparsing. remaining items to be discussed on next call. 4. AOB Next call 24th Sept Meeting closed, 14:05 GMT Actions raised at this meeting No Action 016 AP: add hidden changes to spec 017 All: Review EndOfData changes Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Agenda for OGF WG call, 17 September 2008
by Alan Powell 17 Sep '08

17 Sep '08

Suggested agenda 1. Visit Actions 2. Hidden proposal 3. WTX unresolved items. - Most important is 7 - padding variable length fields. WTX proposal attached 4. AOB. Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 ----- Forwarded by Alan Powell/UK/IBM on 17/09/2008 11:24 ----- From: Steve Hanson/UK/IBM@IBMGB To: dfdl-wg(a)ogf.org Date: 10/09/2008 18:24 Subject: [DFDL-WG] Fw: DFDL: Minutes from OGF WG call, 10 September 2008 Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 10 September 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Apologies: Alan Powell (IBM) 1. Visit actions Actions updated below 2. AOB Next call 17th Sept Meeting closed, 13:40 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 007 AP: enum + expression wording 13/8: no progress 10/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 015 AP: removed extended floats 10/9: No update Actions closed at this meeting: No Action 009 SH: propose algorithm unparse length lengthKind=implicit decimal type/binary representation 13/8: AP has incorporated into lengthkind document. Done 10/9: Closed 010 AP: Document Fixed length string truncation property 13/8: done 10/9: Closed 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Fw: DFDL: Minutes from OGF WG call, 10 September 2008
by Steve Hanson 16 Sep '08

16 Sep '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 10 September 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Apologies: Alan Powell (IBM) 1. Visit actions Actions updated below 2. AOB Next call 17th Sept Meeting closed, 13:40 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 007 AP: enum + expression wording 13/8: no progress 10/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 015 AP: removed extended floats 10/9: No update Actions closed at this meeting: No Action 009 SH: propose algorithm unparse length lengthKind=implicit decimal type/binary representation 13/8: AP has incorporated into lengthkind document. Done 10/9: Closed 010 AP: Document Fixed length string truncation property 13/8: done 10/9: Closed 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1

Can't make the call this week
by Alan Powell 10 Sep '08

10 Sep '08

I'm afraid I cannot make the WG call this week but I suggest you go ahead anyway as we haven't had one for a while. Will someone please take the minutes and send them to me. Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1

Cancelled: OGF DFDL Working Group weekly call
by Steve Hanson 02 Sep '08

02 Sep '08

Mike B away

1 0

DFDL: Minutes from OGF WG call, 13 August 2008
by Alan Powell 15 Aug '08

15 Aug '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 13 August 2008 Attendees Mike Beckerle (Oco) Alan Powell (IBM) Apologies: Steve Hanson (IBM) 1. Update to Decimal supplement Wrong updated document was distributed in with the agenda. Correct one will be sent. decimalCalenderScheme needs updating. Action created Property Name Description decimalCalendarScheme Indicates that decimal calendars are described by a defined calendar scheme. An anonymous calendar scheme can be specified as a child element of the annotation element. See Section TBD Error! Reference source not found.. 2. Discuss lengthKind issues New Lengthkind document was distributed and discussion continued from last call Decided dfdl will do minimal type conversion of binary numbers. Decimal and integer can have only have packed decimal or BCD numberFormat. Int, short, long, byte can only have 2sComplement. MB didn't like endOfBitstream property as if is nit composable. Decided to separate EoD from delimited again and have special meaning that EOD on the last item of a top level sequence means endOfBitstream. MB to provide description and examples of use. Need to revisit the EndOfData property name. MB not happy with lengthKind=pattern on binary fields. Would like use cases. Decided not to support extended float (128 bit) until XML provides an simple type that matches. MB agreed to use numberpattern with stated restrictions to calculated implict lengths of number/text fields. Discussion of what to do if conlficts with TotalDigits. Could decide not to support totalDigits. max/min/Inclusive/exclusive for validation only. 3. Hidden proposal Not discussed 4. Unresolved WTX issues Not discussed 5. AOB SH and AP away w/o 18 & 25 Aug. MB away w/o 1 Sept. Next call 10th Sept Meeting closed, 14:30 GMT Actions raised at this meeting No Action 012 ??: Update decimalCalendarScheme 013 MB: Description and use cases for EndofData syntax 014 SH: Use cases for lengthKind pattern on binary fields. 015 AP: removed extended floats Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 007 AP: enum + expression wording 13/8: no progress 009 SH: propose algorithm unparse length lengthKind=implicit decimal type/binary representation 13/8: AP has incorporated into lengthkind document. Done 010 AP: Document Fixed length string truncation property 13/8: done 011 SH: Update decimal supplement 13/8: Editorial changes needed. 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0