- dfdl-wg - lists.ogf.org

Obsolete OGF DFDL page
by Mike Beckerle 27 Jul '21

27 Jul '21

We need to fix this page, as the links are all to GFD.207 (obsolete) https://www.ogf.org/ogf/doku.php/standards/dfdl/dfdl Mike Beckerle | OGF DFDL Workgroup Co-Chair | Owl Cyber Defense | www.owlcyberdefense.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php>

1 1

Action 322 - embedded XML and JSON
by Steve Hanson 09 Jul '21

09 Jul '21

Embedded XML and JSON Apache Daffodil seeing requests for embedded XML strings. z/TPF seeing requests for embedded JSON objects. This was something that was originally a candidate for DFDL 1.0 but was dropped. New action 322 raised to investigate for DFDL 2.0. Investigation has shown that dfdl:representation="xml" for String types was the way this was to be achieved. See table, taken from draft 033 of the spec (Dec 2008). Property Name Description representation String Valid values are dependent on logical type. Number: ‘text, ‘binary’ String: ‘text'(implied), ‘xml’ Calendar: ‘text, ‘binary’ Boolean: ‘text, ‘binary’ Opaque: ‘binary’ Note that for type String, the representation is always assumed to be 'text' so only the value 'xml' for representation has any effect on how String type elements are processed. Annotation: dfdl:element (all simple types) In draft 034, the 'xml' option had been struck through. I've trawled the WG call minutes from that time but can't find a mention of its removal. Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Latest OGF DFDL WG Call Minutes
by Steve Hanson 08 Jul '21

08 Jul '21

Please find minutes from the latest call at https://github.com/OpenGridForum/DFDL/wiki/DFDL-Workgroup-News. Next call is 2nd September due to vacation. Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday

1 0

Cancelled: OGF DFDL Working Group Call
by Steve Hanson 08 Jul '21

08 Jul '21

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Cancelled: OGF DFDL Working Group Call
by Steve Hanson 08 Jul '21

08 Jul '21

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Cancelled: OGF DFDL Working Group Call
by Steve Hanson 08 Jul '21

08 Jul '21

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Agenda for OGF DFDL WG Call
by Steve Hanson 08 Jul '21

08 Jul '21

Please find agenda for next call on GitHub at https://github.com/OpenGridForum/DFDL/blob/master/calls/2021-07-08_DFDL-WG-… Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday

1 0

Confirmed: OGF DFDL Working Group Call (8 Jul 16:00 GDT in https:/ibm.webex.com/meet/smh)
by Steve Hanson 08 Jul '21

08 Jul '21

Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0

Clarification needed " .[1] " expression on an array element
by Mike Beckerle 30 Jun '21

30 Jun '21

Apache Daffodil has this bug report: https://issues.apache.org/jira/browse/DAFFODIL-2182 It calls for getting clarification from the DFDL WG. Suppose I have an array element named "a" and it contains an assert. The assert expression can contain the subexpression " .[1] " Section 18 does say predicates (i.e., the square brackets) are only used for indexing arrays. It says it is an SDE if the predicate value doesn't evaluate to an integer index. But it does not say that one cannot put the predicate brackets on scalars, context elements, relative path steps, etc., however, this can only be meaningful if the predicate value evaluates to 1. The grammar given for the expression language explicitly does allow " .[1] " to be syntactically allowed. The question is does the ".[1]" mean: (a) the whole array, so that ".[1]" refers to the first element of the array, so equivalent to "../a[1]" (b) the current element, so equivalent to "../a[dfdl:occursIndex()]" (c) SDE the expression is illegal as "." is never an array, and only arrays can be indexed with predicates. I believe (b) is consistent with XPath behavior for XML documents. An online XPath tool verifies this. That means the only way to refer to other array element items in the infoset is to reference the array itself via ../a[N]. This has the drawback of not being polymorphic - the array element name must be used as a path step. That may well be livable as a restriction. -mikeb Mike Beckerle | OGF DFDL Workgroup Co-Chair | Owl Cyber Defense | www.owlcyberdefense.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php>

2 1

Re: [DFDL-WG] DFDL4S Library - version 1.7.0 Released
by Steve Hanson 30 Jun '21

30 Jun '21

Hi Marcos Guidelines here https://github.com/OpenGridForum/DFDL/blob/master/docs/current/gwdi-experim… Best thing to do is follow the example of other experimental feature documents (but not the errata ones) for example: https://github.com/OpenGridForum/DFDL/blob/master/docs/current/gwde-dfdl-ex… Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday From: "Marcos Bento (external)" <Marcos.Bento(a)esa.int> To: "Steve Hanson" <smh(a)uk.ibm.com> Cc: "DFDL-WG" <dfdl-wg(a)ogf.org> Date: 29/06/2021 17:11 Subject: [EXTERNAL] Re: [DFDL-WG] DFDL4S Library - version 1.7.0 Released Hi Steve, This release indeed has developments related to action 287, but we only plan to put the new features into "action" with the upcoming version of S2G (which is the data visualiser that makes most use of DFDL4S). Up until the ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi Steve, This release indeed has developments related to action 287, but we only plan to put the new features into "action" with the upcoming version of S2G (which is the data visualiser that makes most use of DFDL4S). Up until the next release of the S2G we should have some news regarding a preparing an 'experimental feature' document. I'm not sure exactly what is needed for such a proposal, so some guidance on that process would be welcome. --Marcos On Tue, Jun 29, 2021 at 11:58 AM Steve Hanson <smh(a)uk.ibm.com> wrote: Hi Marcos Congratulations on your new release! Does it include the XPath wildcard support which the WG had been tracking under action 287? I think we agreed that it would appear as an 'experimental feature' at some point? Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday From: "Marcos Bento (external)" <Marcos.Bento(a)esa.int> To: DFDL-WG <dfdl-wg(a)ogf.org> Date: 23/06/2021 17:28 Subject: [EXTERNAL] [DFDL-WG] DFDL4S Library - version 1.7.0 Released Sent by: "dfdl-wg" <dfdl-wg-bounces(a)ogf.org> As mentioned in one of the last DFDL calls, the latest DFDL4S release is available and enables support for dfdl:defineVariable and dfdl:newVariableInstance. Check out the complete list of improvements/bug fixes below. --Marcos This email contains graphics, so if you don't see them, view it in your browser New Release Announcement DFDL4S Library - version 1.7.0 Released Dear User, Please be informed that version 1.7.0 of the DFDL4S Library has been released and is available for download at the following URL: http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download The Release Notes can be found here. The following is a summary of the changes this version. New Functionality and Improvements Added support for DFDL variables (dfdl:defineVariable and dfdl:newVariableInstance) Added support for Reporting capabilities (including CRC/Reed-Solomon) Added support to checking CRC and apply Reed-Solomon Error Correction Aligned implementation of occursCountKind=”fixed” with DFDL standard Added support for paths to array elements Bug Fixes Corrected faulty instantiation of DataSize objects (C++ only) Corrected trimming in StorageInFile detected during Transfer Frame to ISP transformation Corrected evaluation of non-integer values in length fields Best Regards The DFDL4S Support Team -- HE Space for ESA - European Space Agency Marcos Bento Mission Analysis & Software Engineer Mission Analysis Office System Support Division Earth Observation Projects Department Directorate of Earth Observation Programmes ESTEC Keplerlaan 1, PO Box 299 NL-2200 AG Noordwijk, The Netherlands marcos.bento(a)esa.int | www.esa.int T +31 71 565 3749 This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo(a)esa.int) -- dfdl-wg mailing list dfdl-wg(a)ogf.org https://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo(a)esa.int) Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

1 0