- dfdl-wg - lists.ogf.org

Re: [DFDL-WG] Proposed feature: lookup tables via simple type unions
by Steve Hanson 12 Sep '18

12 Sep '18

Hi Mike I have taken a look at your revised proposal at https://cwiki.apache.org/confluence/display/DAFFODIL/Proposal%3A+Features+t… . Can you augment the example with use of the simple type by an element? I think this might highlight a problem. Today we allow the DFDL representation properties for a simple element to be split across the element declaration and the (hierarchy) of simple types. Your proposal is allowing the rep type of an element to be other than the allowed set for the simple type of the element. This prevents the combination of rep properties across the element and the simple type. In fact, it means that all type dependent rep properties would have to be carried by the rep type. That's not going to work because of scoping rules - you can't just switch off property applicability. Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday From: Steve Hanson/UK/IBM To: Mike Beckerle <mbeckerle.dfdl(a)gmail.com> Cc: "dfdl-wg(a)ogf.org" <dfdl-wg(a)ogf.org> Date: 04/04/2017 13:42 Subject: Re: [DFDL-WG] Proposed feature: lookup tables via simple type unions Although signed-up to Confluence I couldn't see a way to comment on the proposal there. I'm not comfortable with the proposal. 1) It relies upon validation being enabled, which is an optional feature. There is a long-held principle that switching on validation does not change the behaviour of a parse, but this will do exactly that. [unionMemberSchema] String. For simple element information items, this member contains an SCD reference to the member of the union that matched the value of the element. Empty if validation is not enabled. Empty if the element's type is not a union. 2) DFDL does not allow the concept of an annotation on a simple type that is a union member. We would be allowing that, but with a completely disjoint property set. Unions; the memberTypes must be derived from the same simple type. DFDL annotations are not permitted on union members 3) The proposal does not help the case where I am not using unions but still would like enums translated into meaningful strings, a far more common situation. I think this processing is best left to either an independent post-parse step or a parser extension via a set of non-DFDL annotations. Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 From: Mike Beckerle <mbeckerle.dfdl(a)gmail.com> To: "dfdl-wg(a)ogf.org" <dfdl-wg(a)ogf.org> Date: 22/02/2017 17:38 Subject: [DFDL-WG] Proposed feature: lookup tables via simple type unions Sent by: "dfdl-wg" <dfdl-wg-bounces(a)ogf.org> A write up of the proposal, which we are prototyping in Daffodil, is here: https://opensource.ncsa.illinois.edu/confluence/display/DFDL/Enumerations+a… This is needed by a number of data formats we are working with where there are large enumerations having as many as 2000 members. Often these enumerations are a mixture where single values correspond to some enumerated strings, and ranges of values correspond to others. Using expressions to translate representation integers into strings is infeasible, as no constant-time case-statement-like construct is available in DFDL. Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | www.tresys.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy -- dfdl-wg mailing list dfdl-wg(a)ogf.org https://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Apache Daffodil (Incubating) release 2.2.0
by Mike Beckerle 05 Sep '18

05 Sep '18

The Apache Daffodil (incubating) community is pleased to announce the release of version 2.2.0. Release notes and downloads are available at: https://daffodil.apache.org/releases/2.2.0/ Daffodil is an open source implementation of the DFDL (Data Format Description Language) specification that uses DFDL schemas to parse fixed format data into an infoset, which is most commonly represented as either XML or JSON. This allows the use of well-established XML or JSON technologies and libraries to consume, inspect, and manipulate fixed format data in existing solutions. Daffodil is also capable of the reverse by serializing or "unparsing" an XML or JSON infoset back to the original data format. For more information about Daffodil visit: https://daffodil.apache.org/ Regards, The Apache Daffodil Team Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | www.tresys.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php>

1 0

Latest OGF DFDL WG Call Minutes
by Steve Hanson 04 Sep '18

04 Sep '18

Please find minutes from the latest call at https://redmine.ogf.org/projects/dfdl-wg/news Regards Steve Hanson IBM Hybrid Integration Architect, IBM DFDL, Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890

1 0

Agenda for next OGF DFDL WG Call
by Steve Hanson 04 Sep '18

04 Sep '18

Please find agenda for call on Redmine at https://redmine.ogf.org/dmsf_files/13579?download= Regards Steve Hanson IBM Hybrid Integration Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890

1 0

Confirmed: OGF DFDL Working Group Call (4 Sep 15:00 GDT)
by Steve Hanson 04 Sep '18

04 Sep '18

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Cancelled: OGF DFDL Working Group Call
by Steve Hanson 21 Aug '18

21 Aug '18

1 0

Latest OGF DFDL WG Call Minutes
by Steve Hanson 16 Aug '18

16 Aug '18

Please find minutes from the latest call at https://redmine.ogf.org/projects/dfdl-wg/news Regards Steve Hanson IBM Hybrid Integration Architect, IBM DFDL, Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890

1 0

Updated Errata doc - Experience 4 doc - with addition to Erratum 5.32
by Mike Beckerle 15 Aug '18

15 Aug '18

Per recent email threads - another place was found that needed the same change as detailed in Erratum 5.32, so that was just augmented to also specify the same change. (The issue of nil representation being empty string requires %ES; or %WSP*; alone. (The latter having been omitted in now two identified places.) Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | www.tresys.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php>

2 1

Agenda for next OGF DFDL WG Call
by Steve Hanson 06 Aug '18

06 Aug '18

Please find agenda for call on Redmine at https://redmine.ogf.org/dmsf_files/13578?download= Regards Steve Hanson IBM Hybrid Integration Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890

1 0

OGF DFDL Working Group Call
by Steve Hanson 06 Aug '18

06 Aug '18

1 0