- dfdl-wg - lists.ogf.org

pointers and offsets - BDDL
by Mike Beckerle 30 Aug '19

30 Aug '19

This is a link to a format description language (proprietary) which mentions a pointers/offsets capability. http://www.binarydom.com/sdk/doc/bddl.shtml We may want to review this w.r.t. DFDL capabilities being considered in this area. There aren't too many of these to draw from in standardization. I am trying to get the Tresys one (which is not part of Daffodil) into form where we can describe it here also. Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | www.tresys.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php>

1 0

Action 313: Plus '+' sign and lax textNumberCheckPolicy
by Mike Beckerle 30 Aug '19

30 Aug '19

Looks like ICU changed behavior.... From: Steve Lawrence <slawrence(a)apache.org> Sent: Thursday, August 29, 2019 1:30 PM To: users(a)daffodil.apache.org Subject: Re: Plus '+' sign and lax textNumberCheckPolicy - was: Re: How to model a fixed-length integer that may be padded with space on the left? I think this is a difference in ICU version? A little grepping through ICU source, I found a change [1] to their number parsing logic in Dec 2017: + if (!isStrict) { + parser.addMatcher(WhitespaceMatcher.getInstance()); + parser.addMatcher(new PlusSignMatcher()); + } That looks to me like a change to make it so plus signs are always matched in lax/lenient mode regardless of the pattern (Daffodils current behavior). A couple minor changes have been made to that section, but nothing that allows you to turn if off if lenient is on. It's hard to tell in the git history what release that was in, but it looks like around version 61, which is relatively new (Daffodil is on version 62). Also, the latest version of DecimalFormatProperties.java (looks to be an internal implementation, so no online javadocs), has javadocs that states that plus signs are always allowed in lenient/lax mode [2]. I think this is a change in ICU behavior in newer versions. - Steve [1] https://github.com/unicode-org/icu/commit/68340c8464bd988477d6c88f46f9dfe45… [2] https://github.com/unicode-org/icu/blob/master/icu4j/main/classes/core/src/…

2 1

Cancelled: OGF DFDL Working Group call
by Steve Hanson 29 Aug '19

29 Aug '19

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Latest OGF DFDL WG Call Minutes
by Steve Hanson 29 Aug '19

29 Aug '19

Please find minutes from the latest call at https://redmine.ogf.org/projects/dfdl-wg/news Next call is 4 weeks time - Sept 26th. Regards Steve Hanson IBM Hybrid Integration Architect, IBM DFDL, Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890

1 0

OGF DFDL Working Group call
by Steve Hanson 29 Aug '19

29 Aug '19

1 0

clarification needed: textNumberCheckPolicy lax includes lax-ness about plus signs.
by Mike Beckerle 29 Aug '19

29 Aug '19

Excerpt from daffodil users mailing list indicates that the discussion of how "lax" textNumberCheckPolicy="lax" is w.r.t. plus signs on numbers. ------------------------------ > If you set textNumberCheckPolicy="lax", then > we do ignore leading plus signs in the data The DFDL specification doesn't seem to say that a leading plus sign is ignored. Here's what it says: If 'lax' and dfdl:textNumberRep is 'standard' then grouping separators are ignored, leading and trailing whitespace is ignored, leading zeros are ignored and quoted characters may be omitted. Nothing about ignoring plus signs in that. Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | www.tresys.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php>

2 1

Agenda for OGF DFDL WG Call
by Steve Hanson 29 Aug '19

29 Aug '19

Please find agenda for today's call on Redmine at https://redmine.ogf.org/dmsf_files/13593?download= Regards Steve Hanson IBM Hybrid Integration Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890

1 0

Confirmed: OGF DFDL Working Group call (29 Aug 16:00 GDT in https:/ibm.webex.com/meet/smh)
by Steve Hanson 29 Aug '19

29 Aug '19

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

BLOB - binary large object proposal - updated
by Mike Beckerle 29 Aug '19

29 Aug '19

This concept, ,which has been discussed before, is in high demand in the Daffodil user community to enable DFDL to be used to parse image file formats. The use case is to provide uniform image-metadata access without getting bogged down in the large byte-array that makes up most of the file and would be very large (and pointless) if rendered into XML or JSON. So our proposal, (which will get turned into an official Experimental feature document), has been simplified and revised and is described here: https://cwiki.apache.org/confluence/display/DAFFODIL/Proposal%3A+Binary+Lar… Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | www.tresys.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php>

3 5

Cancelled: OGF DFDL Working Group call
by Steve Hanson 08 Aug '19

08 Aug '19

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0