- dfdl-wg - lists.ogf.org

DFDL: Minutes from OGF WG call, 15 October 2008
by Alan Powell 15 Oct '08

15 Oct '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 15 October 2008 Attendees Mike Beckerle (Oco) Alan Powell (IBM) Apologies Steve Hanson (IBM) 1. Decimal Supplement MB had reviewed last weeks proposal. Did not like scoping rules which are different from normal scoping rules. Agreed to not allow in-line syntax so no need for scoping rules. 2.Unordered Choice infoset order Previous call had decided infoset should be in order of data. SH pointed out that validation will fail unless sequenced data is in schema order. Agreed to change back to schema order. Document that data order can be achieved using an array of choice. Discussed changing to Schema 1.1 for updated syntax of xs:all which provides erquired syntax. Felt that is was too late to change now but IBM will talk to Sandy Gao to assess impact. 3. Selectors Discussed SKK's note and SH reply. Suggest simple syntax where ONE of the format statement on an item is used. Format which matching the selector will be be used otherwise if NONEof the format selectors match, the format with NO selector specified will be used. To be consistent ony ONE format statement will be allowed in a defineFormat. 4. Padding Agreed to restrict padding to string text variable length with minlength facet. No need for an extra property. 4. AOB Will discuss End of Data next week Next call 22st Oct AP will be away for the next 2 weeks. Meeting closed, 13:45 GMT Actions raised at this meeting No Action 022 SH: Talk to Sandy Gao to asses use of schema 1.1 Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 15/10: All updateds complete excpet minlength 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 15/10: SH to talk to Sandy 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 15/10: spec updated. closed 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 24/9: add calendar binary formats to actions 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 15/10: spec updated. closed 016 AP: add hidden changes to spec 017 All: Review EndOfData changes 018 AP: Agree padding to minimum length 15/10: agreed needs documenting 019 AP: document defineTextNumber etc 020 SH: resolve packedDecimalSignCodes behaviour depends on NumberCheckPolicy 021 AP: Document textNumberRepresenation and binaryNumberRepresentation 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 08 October 2008
by Alan Powell 13 Oct '08

13 Oct '08

Weekly Working Group Conference Call 13:00 GMT, 08 October 2008 Attendees Steve Hanson (IBM) Alan Powell (IBM) Apologies Mike Beckerle (Oco) 1. Decimal Supplement Previous decimal discussions had not covered syntax for defineTextNumberFormat and textNumberformat. Based on defineFormat/Format pattern defineTextNumberFormat annotation defines a named reusable number format <dfdl:defineTextNumberFormat name=?myNumFormat?> <dfdl:textNumberFormat decimalseparator="." /> </dfdl:defineTextNumberFormat> Note: does not have baseFormat= as nesting not required. textNumberFormat annotation contains the properties that define the numberformat. <dfdl:textNumberFormat decimalseparator="." /> textNumberFomatRef references a defineTextNumberFormat from an element declaration. <xs:element name="foo" type="xs:int" > <xs:annotation><xs:appinfo source=?http://www.ogf.org/dfdl/?> <dfdl:format representation="text" numberFormat=?text" textNumberFormatRef="myNumFormat"/> </xs:appinfo></xs:annotation> </xs:element> and has normal short and long form dfdl:textNumberFormatReference="myNumFormat" <dfdl:property name=textNumberFormatRef> "myNumFormat" </dfdl:property> Note: we decide not to follow the defineFormat/Format pattern of having the reference on the textNumberFormat as this wouldn't have allowed a short form and the normal form would be verbose. <dfdl:format representation="text" numberFormat=?text" > <dfdl:textNumberFormat ref="myNumFormat" /> </dfdl:format> Possible extension: As an extension textNumberFormat can also be in-line <xs:element name="foo" type="xs:int" > <xs:annotation><xs:appinfo source=?http://www.ogf.org/dfdl/?> <dfdl:format representation="text" numberFormat=?text" > <dfdl:textNumberFormat pattern='####' decimalseparator="." /> </dfdl:format> </xs:appinfo></xs:annotation> </xs:element> Scoping: In-line numberFormats override any textNumberFormatRefernce on the element or in scope. The textNumberFormat is considered as a single scheme and is overriden as a whole. Properties within textNumberFormat cannot be overridden separately 2. packedDecimalSignCodes packedDecimalSignCodes behaviour depends on NumberCheckPolicy but NumberCheckPolicy is defined in textNumberFormat which isn't applicable to binary numbers Not resolved. 3. NumberFormat Decided to split NumberFormat into textNumberRepresentation (text, zoned) and binaryNumberRepresentation(binary, bcd, packed) so there is a simple property decision tree based off representation 4. AOB Will discuss End of Data next week Next call 15st Oct Meeting closed, 14:05 GMT Actions raised at this meeting No Action 018 SH: Resolve packedDecimalSignCodes use of NumberCheckPolicy 019 MB: review defineTextNumberFormat as above Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 8/10: All issued resolved and added to spec except padding variable length. 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 8/10: added but problems with defineNumeberFormat identified and discussed 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 24/9: add calendar binary formats to actions 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 016 AP: add hidden changes to spec 017 All: Review EndOfData changes Actions closed at this meeting: No Action 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Re: [DFDL-WG] DFDL: Minutes from OGF WG call, 24 September 2008
by Alan Powell 25 Sep '08

25 Sep '08

Steve See bleow Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 From: Steve Hanson/UK/IBM To: Alan Powell/UK/IBM@IBMGB Cc: dfdl-wg(a)ogf.org, dfdl-wg-bounces(a)ogf.org Date: 25/09/2008 10:02 Subject: Re: [DFDL-WG] DFDL: Minutes from OGF WG call, 24 September 2008 Hi Alan 27 OccursKind for delimited arrays. occurskind = delimited had been removed in error and will be put back. occurskind renamed to occursLenghtKind -> Why occursLengthKind ? I prefer plain occursKind, because: a) There will be confusion with length. b) Symmetry: we have length & lengthKind, occurs & occursKind AWP>> I got the change wrong. At the F2F we agreed occursCount and occursCountKind 7 padding AP has done more investigation and main deficiency vs WTX is lack of support for pad to miminum length for variable length items. Agreed to add this. Will use minLength facet for strings and the number pattern for Text numbers. -> What about Text date/times? AWP>> We already have an action to sort out Text calendars/dates Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Alan Powell/UK/IBM@IBMGB Sent by: dfdl-wg-bounces(a)ogf.org 24/09/2008 17:32 To dfdl-wg(a)ogf.org cc Subject [DFDL-WG] DFDL: Minutes from OGF WG call, 24 September 2008 Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 24 September 2008 Attendees Mike Beckerle (Oco) Alan Powell (IBM) Apologies Steve Hanson (IBM) 1. Physical to Logical type conversions. Discussed table distributed by AP Simple type text (+ xml) binary String n/a Float ?? FloatFormat: IEEE, IBM390Hex Double ?? FloatFormat: IEEE, IBM390Hex Decimal/Integer NumberFormat: text, zoned NumberFormat: packed, BCD Long, Int, Short, Byte, NumberFormat: text, zoned NumberFormat: packed, BCD, twosComplement, binary UnsignedLong, Unsignedint, Unsignedshort, Unsignedbyte NumberFormat: text, zoned NumberFormat: packed, BCD, binary DateTime Date Time Duration Boolean HexBinary Agreed to keep FloatFormat rather than FloatBinaryFormat and not to have NumberTextFormat and NumberBinaryFormat. Reduces the number of properties. No need to add text to floatFormat Add NumberFormat Binary to do the 'normal' cases ie twoscomplement for signed types and unsigned binary for unsigned types. Remove twoscomplement. Can add other signed formats like onescomplement later when supported Keep zoned for unsigned text even though it will produce the same output as text but it also limits the allowable NumberPattern. Remove BCD from Long etc Need to investigate calendar/date text and binary formats. Add to existing action 2. WTX unresolved items. Last weeks decisions: 3,4 agreed to drop textCharacterSize and DBCSOnly from dfdl V1 7 Padding; deferred pending proposal from IBM (WTX) 9 Add zeroRequiredOnInput to meet WTX requirement - resolved 17 finalTerminatorCanBeMissing, finalPostFixSeparatorCanBeMissing. Agreed to drop these properties and change the default syntax of terminator and postFixSeparator to be optional on parsing the last element of a sequence but always written on unparsing. Continued this weeks: 20 unordered sequence does not necessarily need initiator, speculative parsing can work it out too. Discussed relaxing initiator restriction and infoset order Decided to add enum unorderedInitiated to sequenceKind for unordered initiated item and change unordered to be resolved by speculative parsing sequenceKind Enum Valid values are "ordered", "unordered" "unorderedInitiated" This property cannot have an expression used to compute its value. When "ordered", this property means that the contained items of the sequence will be encountered in the same order that they appear in the schema, which is called schema-definition-order. When "unordered", this property means that the items of the sequence will be encountered in any order. When "unorderedInitiated", this property means that the items of the sequence will be encountered in any order, but each item must have an initiator Annotation: dfdl:sequence The infoset order for unordered and unorderedInitiated is the order in the datastream. 25. ChoiceKind fixed or variable These are still needed. Decided to leave choiceKind as a single property but change fixed and variable longestLength and variableLength 27 OccursKind for delimited arrays. occurskind = delimited had been removed in error and will be put back. occurskind renamed to occursLenghtKind 7 padding AP has done more investigation and main deficiency vs WTX is lack of support for pad to miminum length for variable length items. Agreed to add this. Will use minLength facet for strings and the number pattern for Text numbers. 4. AOB Will discuss End of Data next week Next call 1st Oct Meeting closed, 14:05 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 24/9: add calendar binary formats to actions 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 016 AP: add hidden changes to spec 017 All: Review EndOfData changes 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 24 September 2008
by Alan Powell 25 Sep '08

25 Sep '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 24 September 2008 Attendees Mike Beckerle (Oco) Alan Powell (IBM) Apologies Steve Hanson (IBM) 1. Physical to Logical type conversions. Discussed table distributed by AP Simple type text (+ xml) binary String n/a Float ?? FloatFormat: IEEE, IBM390Hex Double ?? FloatFormat: IEEE, IBM390Hex Decimal/Integer NumberFormat: text, zoned NumberFormat: packed, BCD Long, Int, Short, Byte, NumberFormat: text, zoned NumberFormat: packed, BCD, twosComplement, binary UnsignedLong, Unsignedint, Unsignedshort, Unsignedbyte NumberFormat: text, zoned NumberFormat: packed, BCD, binary DateTime Date Time Duration Boolean HexBinary Agreed to keep FloatFormat rather than FloatBinaryFormat and not to have NumberTextFormat and NumberBinaryFormat. Reduces the number of properties. No need to add text to floatFormat Add NumberFormat Binary to do the 'normal' cases ie twoscomplement for signed types and unsigned binary for unsigned types. Remove twoscomplement. Can add other signed formats like onescomplement later when supported Keep zoned for unsigned text even though it will produce the same output as text but it also limits the allowable NumberPattern. Remove BCD from Long etc Need to investigate calendar/date text and binary formats. Add to existing action 2. WTX unresolved items. Last weeks decisions: 3,4 agreed to drop textCharacterSize and DBCSOnly from dfdl V1 7 Padding; deferred pending proposal from IBM (WTX) 9 Add zeroRequiredOnInput to meet WTX requirement - resolved 17 finalTerminatorCanBeMissing, finalPostFixSeparatorCanBeMissing. Agreed to drop these properties and change the default syntax of terminator and postFixSeparator to be optional on parsing the last element of a sequence but always written on unparsing. Continued this weeks: 20 unordered sequence does not necessarily need initiator, speculative parsing can work it out too. Discussed relaxing initiator restriction and infoset order Decided to add enum unorderedInitiated to sequenceKind for unordered initiated item and change unordered to be resolved by speculative parsing sequenceKind Enum Valid values are "ordered", "unordered" "unorderedInitiated" This property cannot have an expression used to compute its value. When "ordered", this property means that the contained items of the sequence will be encountered in the same order that they appear in the schema, which is called schema-definition-order. When "unordered", this property means that the items of the sequence will be encountered in any order. When "unorderedInitiated", this property means that the items of the sequence will be encountered in any order, but each item must have an initiator Annotation: dfdl:sequence The infoset order for unordered and unorderedInitiated is the order in the datastream. 25. ChoiceKind fixed or variable These are still needed. Decided to leave choiceKind as a single property but change fixed and variable longestLength and variableLength 27 OccursKind for delimited arrays. occurskind = delimited had been removed in error and will be put back. occurskind renamed to occursLenghtKind 7 padding AP has done more investigation and main deficiency vs WTX is lack of support for pad to miminum length for variable length items. Agreed to add this. Will use minLength facet for strings and the number pattern for Text numbers. 4. AOB Will discuss End of Data next week Next call 1st Oct Meeting closed, 14:05 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 24/9: add calendar binary formats to actions 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 016 AP: add hidden changes to spec 017 All: Review EndOfData changes 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1

OGF DFDL Working Group weekly call
by Steve Hanson 19 Sep '08

19 Sep '08

Alan - I will be with Volvo for most of Wednesday. Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Minutes from OGF WG call, 17 September 2008
by Alan Powell 17 Sep '08

17 Sep '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 17 September 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Alan Powell (IBM) 1. Visit actions Actions updated below 2. Hidden proposal Agreed to adopt proposal for hidden element to be a reference to a group. Decided not to have dfdlHidden=true on referenced group/sequence be more composable. 3. WTX unresolved items. 3,4 agreed to drop textCharacterSize and DBCSOnly from dfdl V1 7 Padding; deferred pending proposal from IBM (WTX) 9 Add PadRequiredOnInput to meet WTX requirement - resolved 17 finalTerminatorCanBeMissing, finalPostFixSeparatorCanBeMissing. Agreed to drop these properties and change the default syntax of terminator and postFixSeparator to be optional on parsing the last element of a sequence but always written on unparsing. remaining items to be discussed on next call. 4. AOB Next call 24th Sept Meeting closed, 14:05 GMT Actions raised at this meeting No Action 016 AP: add hidden changes to spec 017 All: Review EndOfData changes Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 17/9: Doc distributed and partially discussed 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 17/9: Proposal agreed 007 AP: enum + expression wording 13/8: no progress 10/9: No update 17/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 17/9: No update 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 17/9: No update 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 17/9: No update 015 AP: removed extended floats 10/9: No update 17/9: No update 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Agenda for OGF WG call, 17 September 2008
by Alan Powell 17 Sep '08

17 Sep '08

Suggested agenda 1. Visit Actions 2. Hidden proposal 3. WTX unresolved items. - Most important is 7 - padding variable length fields. WTX proposal attached 4. AOB. Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 ----- Forwarded by Alan Powell/UK/IBM on 17/09/2008 11:24 ----- From: Steve Hanson/UK/IBM@IBMGB To: dfdl-wg(a)ogf.org Date: 10/09/2008 18:24 Subject: [DFDL-WG] Fw: DFDL: Minutes from OGF WG call, 10 September 2008 Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 10 September 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Apologies: Alan Powell (IBM) 1. Visit actions Actions updated below 2. AOB Next call 17th Sept Meeting closed, 13:40 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 007 AP: enum + expression wording 13/8: no progress 10/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 015 AP: removed extended floats 10/9: No update Actions closed at this meeting: No Action 009 SH: propose algorithm unparse length lengthKind=implicit decimal type/binary representation 13/8: AP has incorporated into lengthkind document. Done 10/9: Closed 010 AP: Document Fixed length string truncation property 13/8: done 10/9: Closed 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Fw: DFDL: Minutes from OGF WG call, 10 September 2008
by Steve Hanson 16 Sep '08

16 Sep '08

Open Grid Forum: Data Format Description Language Working Group Weekly Working Group Conference Call 13:00 GMT, 10 September 2008 Attendees Mike Beckerle (Oco) Steve Hanson (IBM) Apologies: Alan Powell (IBM) 1. Visit actions Actions updated below 2. AOB Next call 17th Sept Meeting closed, 13:40 GMT Actions raised at this meeting No Action Current Actions: No Action 003 AP: Update spec from WTX document 13/8: All resolved issues have been added to spec. Remaining unresolved items need discussion 10/9: Alan will pull out the remaining unresolved items and circulate for discussion next week 004 MB: Mike will also author a new section in response to comments from Sandy Gao and Suman Kalia, explicitly connecting syntax with DFDL semantics 16/7: no progress 10/9: Mike not convinced this is necessary. Steve to talk to Sandy to see if it is needed for any IBM implementation that extends the existing XML parsing framework 006 SH: Distribute hidden proposal 16/7: Done. MB to review 13/8: MB to review 10/9: Mike has located this and will review 007 AP: enum + expression wording 13/8: no progress 10/9: No update 011 SH: Update decimal supplement 13/8: Editorial changes needed. 10/9: Alan to incorporate into main spec 012 ??: Update decimalCalendarScheme 10/9: Not allocated yet 013 MB: Description and use cases for EndofData syntax 10/9: Steve didn't receive this mail, he now has and will review 014 SH: Use cases for lengthKind pattern on binary fields. 10/9: Not done 015 AP: removed extended floats 10/9: No update Actions closed at this meeting: No Action 009 SH: propose algorithm unparse length lengthKind=implicit decimal type/binary representation 13/8: AP has incorporated into lengthkind document. Done 10/9: Closed 010 AP: Document Fixed length string truncation property 13/8: done 10/9: Closed 033 Work items: No Item 001 String XML type (Ian P) - Apr 30, 2008 002 Escape schemes (Ian P) - Apr 30, 2008 003 Variables - ??, 2008 (Mike) 004 Selectors (Suman) - Apr 30, 2008 005 Improvements on property descriptions - ??, 2008 (All - split TBD) 006 Envelopes and Payloads (Steve) - Apr 30, 2008 007 (from draft 32) valueCalc (Mike) - ??, 2008 *Mostly complete* 008 (from draft 32) Property precedence for writing (Steve) - *complete but under review* 009 (from draft 32) Variable markup (Steve) - Mar 31, 2008 *proposal needs writing up* 010 (from draft 32) Assertions, discriminators and choice, including discussion of timing option (Suman) - Mar 31, 2008 * in progress * 011 (from draft 32) How speculative parsing works (combining choice and variable-occurence - currently these are separate) ??, 2008 (IBM) * in progress * 012 (from draft 32) Reordering the properties discussion: move representation earlier, improve flow of topics ??, 2008 (Alan) * not started * 013 (from F2F) New scoping rules 014 (from F2F) Occurs, OccurSeparator changes 015 (from F2F) choices and Output (Mike) 016 (from F2F) xpath forward references (Alan) *complete* 017 (IBM WTX review) Minor agreed updates (Alan) *complete* 018 (IBM WTX review) Review generateNewLine (Alan) *complete* 020 (IBM WTX review) Special value for zero seen eg 'zero'. (Steve) 021 (IBM WTX review) 'EndOfData' changes (Alan) 022 (IBM WTX review) Unresolvable choices - infoset changes *complete* 023 (IBM WTX review) separatorKind=?prefix? ?infix? or ?postfix? (Alan) 024 (IBM WTX review) StopValue clarification (Alan) 025 Augmented infoset and unparsing (Alan) Regards Steve Hanson Programming Model Architect WebSphere Message Brokers Hursley, UK Internet: smh(a)uk.ibm.com Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1

Can't make the call this week
by Alan Powell 10 Sep '08

10 Sep '08

I'm afraid I cannot make the WG call this week but I suggest you go ahead anyway as we haven't had one for a while. Will someone please take the minutes and send them to me. Alan Powell MP 211, IBM UK Labs, Hursley, Winchester, SO21 2JN, England Notes Id: Alan Powell/UK/IBM email: alan_powell(a)uk.ibm.com Tel: +44 (0)1962 815073 Fax: +44 (0)1962 816898 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1

Cancelled: OGF DFDL Working Group weekly call
by Steve Hanson 02 Sep '08

02 Sep '08

Mike B away

1 0