- dfdl-wg - lists.ogf.org

Fw: [wg-all] OGF28 Registration is now open!
by Steve Hanson 27 Jan '10

27 Jan '10

----- Forwarded by Steve Hanson/UK/IBM on 27/01/2010 16:19 ----- From: Joel Replogle <replogle(a)ogf.org> To: Steve Hanson/UK/IBM@IBMGB Date: 27/01/2010 16:04 Subject: Re: [wg-all] OGF28 Registration is now open! Hi Steve - All the group sessions were accepted, including DFDL. We are working on the schedule and hope to have a draft soon for review. Thanks, Joel From: Joel Replogle <replogle(a)ogf.org> To: wg-all(a)ogf.org Date: 27/01/2010 05:47 Subject: [wg-all] OGF28 Registration is now open! Sent by: wg-all-bounces(a)ogf.org All - I'm pleased to announce that registration for OGF28 is now open! OGF28 will be held at the Ludwig-Maximilians-Universität München in Munich, Germany on March 15-19, 2010. The theme is "The Future of Distributed Computing Infrastructures (DCI)" and will prove to be the premier event relating to DCI, Clouds and Grids in Europe this spring. To register, please visit: http://www.ogf.org/OGF28/registration.php or go directly to the registration site: http://www.interplan.de/reg/2010/OGF10/ See you in Munich! Joel -------------------------------------------------------------------- Joel Replogle Executive Director, Open Grid Forum replogle(a)ogf.org http://www.ogf.org -- The wg-all mailing list is an umbrella list for all OGF mailing lists. If you are subscribed to any OGF mailing list, you will receive mails to wg-all. You can unsubscribe from this list on http://www.ogf.org/cgi-bin/perl/unsubscribe-wg-all.pl wg-all mailing list wg-all(a)ogf.org http://www.ogf.org/mailman/listinfo/wg-all Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -------------------------------------------------------------------- Joel Replogle Executive Director, Open Grid Forum replogle(a)ogf.org http://www.ogf.org Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Uncertainty and Discriminators
by Alan Powell 27 Jan '10

27 Jan '10

There was quite a lot of overlap between the Discriminators document and the previous Resolving Uncertainty document so I merged the two together and incorporated Suman's and Steve's comment. It is a bit of a rushed job but should help the discussion. I didn't have time for examples. Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com ----- Forwarded by Alan Powell/UK/IBM on 27/01/2010 12:10 ----- From: Alan Powell/UK/IBM@IBMGB To: dfdl-wg(a)ogf.org Date: 26/01/2010 12:59 Subject: [DFDL-WG] Fw: discriminators - such as it is Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com ----- Forwarded by Alan Powell/UK/IBM on 26/01/2010 12:59 ----- From: Mike Beckerle <mbeckerle.dfdl(a)gmail.com> To: Alan Powell/UK/IBM@IBMGB Cc: Steve Hanson/UK/IBM@IBMGB Date: 21/01/2010 16:12 Subject: discriminators - such as it is Alan, This is where I am with discriminators. I won't have an opportunity to work on this again for a bit, and it's close, though not perfect. In particular, there's a numbered list of points here, and the order of those points is probably not right. ...mikeb Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU [attachment "dfdl-discriminators.doc" deleted by Alan Powell/UK/IBM] -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

2 1

Fw: Fw: discriminators - such as it is
by Suman Kalia 26 Jan '10

26 Jan '10

- some comments / clarifications.. Suman Kalia IBM Toronto Lab WMB Toolkit Architect and Development Lead WebSphere Business Integration Application Connectivity Tools http://www.ibm.com/developerworks/websphere/zones/businessintegration/wmb.h… Tel : 905-413-3923 T/L 969-3923 Fax : 905-413-4850 T/L 969-4850 Internet ID : kalia(a)ca.ibm.com ----- Forwarded by Suman Kalia/Toronto/IBM on 01/26/2010 06:12 PM ----- From: Alan Powell <alan_powell(a)uk.ibm.com> To: dfdl-wg(a)ogf.org Date: 01/26/2010 08:01 AM Subject: [DFDL-WG] Fw: discriminators - such as it is Sent by: dfdl-wg-bounces(a)ogf.org Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com ----- Forwarded by Alan Powell/UK/IBM on 26/01/2010 12:59 ----- From: Mike Beckerle <mbeckerle.dfdl(a)gmail.com> To: Alan Powell/UK/IBM@IBMGB Cc: Steve Hanson/UK/IBM@IBMGB Date: 21/01/2010 16:12 Subject: discriminators - such as it is Alan, This is where I am with discriminators. I won't have an opportunity to work on this again for a bit, and it's close, though not perfect. In particular, there's a numbered list of points here, and the order of those points is probably not right. ...mikeb Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg

1 0

Fw: Draft 038 available - update
by Alan Powell 26 Jan '10

26 Jan '10

To make it easier to identify changes in this draft I have extended the change history table and uploaded a new version. This is the only change. The new version can be access from the same link below. Latest entry at the top please Version Author/ Contributor History Date(yyyy-mm-dd) 038 Mike Beckerle Alan Powell Steve Hanson Changes from IBM implementation team review. See tracker items Changes from Steve Hansonerle review Changes from Mike Beckerle review Changed binaryFloatRepresentation to binaryFloatRep added implicit alignment table changed 'know length' to specified length' Significant changes to length section. Added lengthUnit='bits' Added resolving points of uncertainty and discriminators Removes occursCountKind 'useAvailableSpace' Case of enumerations. We should follow the XSDL convention which is that enumerations are case sensitive Restrictions on use of 'special' entities in regular expressions lengthKind=Pattern will use its dfdl:encoding property Last 'postFix' separator is not optional Terminators are mandatory. Added dfdl:documentFinalTerminatorCanBeMissing dfdl:documentFinalSeparatorCanBeMissing Added missingValueInitiatorPolicy (but not complete yet) 2010-01-05 Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com ----- Forwarded by Alan Powell/UK/IBM on 26/01/2010 17:28 ----- From: Alan Powell/UK/IBM@IBMGB To: dfdl-wg(a)ogf.org Date: 22/01/2010 17:47 Subject: [DFDL-WG] Draft 038 available All DFDL V1 draft 038 is available at http://forge.gridforum.org/sf/go/doc15851?nav=1 There are many changes as a result of the review of draft 037. Documents responding to the comments are attached. Some issues are still being resolved. There have been significant changes to the Length section that should be thoroughly reviewed. This draft should be the last one before the draft we submit to OGF. I do not think that it is ready for submission. 038 Mike Beckerle Alan Powell Steve Hanson Changes from IBM implementation team review. See tracker items Changes from Steve Hanson review Changes from Mike Beckerle review Changed binaryFloatRepresentation to binaryFloatRep added implicit alignment table changed 'know length' to specified length' Significant changes to length section. Added lengthUnit='bits' Added resolving points of uncertainty and discriminators but not complete Removed occursCountKind 'useAvailableSpace' 2010-01-05 Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU [attachment "V37_Implementation Team v1.doc" deleted by Alan Powell/UK/IBM] [attachment "ogf-dfdl-v1.0-Core-037.final.MB.Comments.doc" deleted by Alan Powell/UK/IBM] [attachment "ogf-dfdl-v1.0-Core-037.final.SH.Comments.doc" deleted by Alan Powell/UK/IBM] -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Fw: Agenda for OGF DFDL WG call 27 January 2010- 13:00 UK (8:00 ET)
by Alan Powell 26 Jan '10

26 Jan '10

As not many made the extra call today we will use the same agenda. On todays call we discussed the discriminator document. Alan will update it for this call. Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com ----- Forwarded by Alan Powell/UK/IBM on 26/01/2010 17:08 ----- From: Alan Powell/UK/IBM@IBMGB To: dfdl-wg(a)ogf.org Date: 26/01/2010 12:11 Subject: [DFDL-WG] Agenda for OGF DFDL WG call 26 January 2010- 13:00 UK (8:00 ET) 1. Discriminators Review Mikes writeup 2. Unparsing lengthKind=Pattern Representation text binary String unpadded length Not applicable Float unpadded length 32 Double unpadded length 64 Decimal/Integer unpadded length Minimum number of bytes to represent significant digits and sign Long, UnsignedLong unpadded length packed/bcd : as decimal binary: 64 Int, Unsignedint unpadded length packed/bcd : as decimal binary: 32 Short, Unsignedshort unpadded length packed/bcd : as decimal binary: 16 Byte, Unsignedbyte unpadded length packed/bcd : as decimal binary: 8 DateTime unpadded length packed/bcd : as decimal binarySeconds: 32, binaryMilliseconds:64 Date unpadded length packed/bcd : as decimal binarySeconds: 32, binaryMilliseconds:64 Time unpadded length packed/bcd : as decimal binarySeconds: 32, binaryMilliseconds:64 Boolean Length of textBooleanTrue or textBooleanFalse 32 HexBinary Not applicable Length of infoset value 3. TLog 4 Action 071 Semantics of length=0, nil handling and defaults. 5. Go through Actions 6. Draft 037 review issues - Case of enumerations. We should follow the XSDL convention which is that enumerations are case sensitive - dfdl:lengthKind='Pattern scannability: A complex element with lengthKind=Pattern will use its dfdl:encoding property as the encoding when scanning its children irrespective of the child's encoding property. Go through unanswered issues in Mike's comments doecumnet 7 Review Schedule OGF prereview is confirmed to take about 4 weeks assuming no document updates are required. We are behind schedule to be available for public review by March. Draft 038 will be available at the end of this week. Activity Schedule Who Complete Action items - 18 Dec 2009 WG Complete Spec Write up work items ? 23 Dec 2009 AP Restructure and complete specification - 23 Dec 2009 AP Issue Draft 038 23 Dec 2009 WG review WG review 7 Dec ? 08 Jan 2010 WG Incorporate review comments 4 Jan - 29 Jan 2010 AP + Issue Draft 039 15 Jan 2010 Incorporate review comments 4 Jan - 29 Jan 2010 AP + Issue Draft 040 29 Jan 2010 Initial OGF Editor Review Initial Editor review 1 Feb - 1 Mar 2010 OGF Initial GFSG review 1 Feb - 1 Mar 2010 Issue Draft 041 1 Mar 2010 OGF Public Comment period (60 days) 1 Mar - 30 Apr 2010 OGF OGF 28 Munich 15-19 March 2010 Incorporate comments Incorporate comments 28 May 2010 Issue Draft 042 28 May 2010 Final OGF Editor Review Final Editor review June 2010 OGF final GFSG review June 2010 Issue Final specification 30 June 2010 Publish proposed recommendation 1 July 2010 Grid recommendation process 1 Jan - 1 April 2011 Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- dfdl-wg mailing list dfdl-wg(a)ogf.org http://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Fw: discriminators - such as it is
by Alan Powell 26 Jan '10

26 Jan '10

Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com ----- Forwarded by Alan Powell/UK/IBM on 26/01/2010 12:59 ----- From: Mike Beckerle <mbeckerle.dfdl(a)gmail.com> To: Alan Powell/UK/IBM@IBMGB Cc: Steve Hanson/UK/IBM@IBMGB Date: 21/01/2010 16:12 Subject: discriminators - such as it is Alan, This is where I am with discriminators. I won't have an opportunity to work on this again for a bit, and it's close, though not perfect. In particular, there's a numbered list of points here, and the order of those points is probably not right. ...mikeb Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: Action 071
by Steve Hanson 26 Jan '10

26 Jan '10

Proposal as per last week's minutes: We should be consistent with the similar property for missing separators. So I've changed the enums too - now 'require' and 'suppress', Also changed unparsing behaviour - we must honour the property - the existing behaviour of always writing the initiator means we can not successfully re-parse if writing empty content and enum is 'suppress'. When reading, assume that section 15.13 has been updated to include complex as well as simple elements. missingValueInitiatorPolicy Enum Valid values ‘require', ‘suppress' Specifies whether to expect an initiator when an element is missing. Ignored unless dfdl:initiator is specified and is not "" (empty string). 'require' - Indicates that the dfdl:initiator followed by empty content is the required syntax to indicate that the element is missing. 'suppress' - Indicates that empty content is the required syntax to indicate that the element is missing. The presence of an initiator implies that real content must follow. Use of ‘suppress’ implies an ordered sequence. If used on an initiated element of an unordered group it is a schema definition error. If the element is required, defaulting occurs as defined above. This property also applies on unparsing, when the data to be written (after nil value and default value processing) is empty content. Annotation: dfdl:element We should similarly change the enums for nilValueInitiatorPolicy to 'require' and 'suppress'. And we should back out work item 071 which suggests changing dfdl:separatorPolicy enumeration from 'require' to 'always'. That means 'always' is matched with 'suppress' - but always is not a verb. Unparsing. Which branch of a choice do we output when a complex element is required but missing from the infoset? I think it should be the first branch of the choice that does not result in a processing error. Regards Steve Hanson Programming Model Architect, WebSphere Message Broker, OGF DFDL WG Co-Chair, Hursley, UK, Internet: smh(a)uk.ibm.com, Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

DFDL: TLOG proposal
by Steve Hanson 26 Jan '10

26 Jan '10

As per minutes from last week's call - here is proposal for TLOG after more research. TLOG The individual fields are a mixture of ASCII strings, proprietary packed decimals, and the occasional pure binary data. All fields are delimited by a separator. Fields of all types can be fixed length or variable length with a maximum. Pure binary data is preceded by a field giving the actual length. All lengths in bytes. Packed decimals. Like a packed decimal in the IBM sense. These can carry negative numbers but use a leading xD sign nibble. No sign nibble if positive or unsigned. Odd number of digits (including sign if present) are padded with xF nibble. This is best illustrated using examples. 1234 => x12x34 123 => xF1x23 -1234 => xFDx12x34 -123 => xD1x23 Proposal 1) The 'variable length with a maximum' can not be handled using a post-timing assertion, because assertions only apply on parsing. Given that IBM MRM allows you to model this case, I think we should allow dfdl:length & dfdl:lengthUnits to be specified when dfdl:lengthKind is 'delimited' or 'pattern'. Extraction during parse is still by scanning. If the physical representation exceeds that length after extraction, it is a processing error. Similarly when unparsing, if the physical representation exceeds that length prior to output, it is a processing error. 2) dfdl:binaryNumberRep is extended with another value 'tlog'. Associated property dfdl:binaryDecimalVirtualPoint is applicable. Associated property dfdl:binaryPackedSignCodes is not applicable, there being only xD to indicate negative numbers, and no distinct nibbles for unsigned or zero. 3) dfdl:lengthKind 'delimited' is permitted for numbers when dfdl:representation is 'binary' and dfdl:binaryNumberRep is 'packed' or 'bcd' or 'tlog' because it is possible to know in advance the range of bytes being used, and therefore to choose suitable delimiters. Regards Steve Hanson Programming Model Architect, WebSphere Message Broker, OGF DFDL WG Co-Chair, Hursley, UK, Internet: smh(a)uk.ibm.com, Phone (+44)/(0) 1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Agenda for OGF DFDL WG call 26 January 2010- 13:00 UK (8:00 ET)
by Alan Powell 26 Jan '10

26 Jan '10

1. Discriminators Review Mikes writeup 2. Unparsing lengthKind=Pattern Representation text binary String unpadded length Not applicable Float unpadded length 32 Double unpadded length 64 Decimal/Integer unpadded length Minimum number of bytes to represent significant digits and sign Long, UnsignedLong unpadded length packed/bcd : as decimal binary: 64 Int, Unsignedint unpadded length packed/bcd : as decimal binary: 32 Short, Unsignedshort unpadded length packed/bcd : as decimal binary: 16 Byte, Unsignedbyte unpadded length packed/bcd : as decimal binary: 8 DateTime unpadded length packed/bcd : as decimal binarySeconds: 32, binaryMilliseconds:64 Date unpadded length packed/bcd : as decimal binarySeconds: 32, binaryMilliseconds:64 Time unpadded length packed/bcd : as decimal binarySeconds: 32, binaryMilliseconds:64 Boolean Length of textBooleanTrue or textBooleanFalse 32 HexBinary Not applicable Length of infoset value 3. TLog 4 Action 071 Semantics of length=0, nil handling and defaults. 5. Go through Actions 6. Draft 037 review issues - Case of enumerations. We should follow the XSDL convention which is that enumerations are case sensitive - dfdl:lengthKind='Pattern scannability: A complex element with lengthKind=Pattern will use its dfdl:encoding property as the encoding when scanning its children irrespective of the child's encoding property. Go through unanswered issues in Mike's comments doecumnet 7 Review Schedule OGF prereview is confirmed to take about 4 weeks assuming no document updates are required. We are behind schedule to be available for public review by March. Draft 038 will be available at the end of this week. Activity Schedule Who Complete Action items - 18 Dec 2009 WG Complete Spec Write up work items ? 23 Dec 2009 AP Restructure and complete specification - 23 Dec 2009 AP Issue Draft 038 23 Dec 2009 WG review WG review 7 Dec ? 08 Jan 2010 WG Incorporate review comments 4 Jan - 29 Jan 2010 AP + Issue Draft 039 15 Jan 2010 Incorporate review comments 4 Jan - 29 Jan 2010 AP + Issue Draft 040 29 Jan 2010 Initial OGF Editor Review Initial Editor review 1 Feb - 1 Mar 2010 OGF Initial GFSG review 1 Feb - 1 Mar 2010 Issue Draft 041 1 Mar 2010 OGF Public Comment period (60 days) 1 Mar - 30 Apr 2010 OGF OGF 28 Munich 15-19 March 2010 Incorporate comments Incorporate comments 28 May 2010 Issue Draft 042 28 May 2010 Final OGF Editor Review Final Editor review June 2010 OGF final GFSG review June 2010 Issue Final specification 30 June 2010 Publish proposed recommendation 1 July 2010 Grid recommendation process 1 Jan - 1 April 2011 Regards Alan Powell Development - MQSeries, Message Broker, ESB IBM Software Group, Application and Integration Middleware Software ------------------------------------------------------------------------------------------------------------------------------------------- IBM MP211, Hursley Park Hursley, SO21 2JN United Kingdom Phone: +44-1962-815073 e-mail: alan_powell(a)uk.ibm.com Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Invitation: OGF DFDL Working Group extra call (26 Jan 13:00 GMT in Participant Passcode: 8190865 )
by Steve Hanson 26 Jan '10

26 Jan '10

1 0