DFDL4S Library - version 1.7.0 Released

As mentioned in one of the last DFDL calls, the latest DFDL4S release is available and enables support for dfdl:defineVariable and dfdl:newVariableInstance. Check out the complete list of improvements/bug fixes below. --Marcos This email contains graphics, so if you don't see them, view it in your browser <http://eop-cfi.esa.int/index.php?option=com_acymailing&ctrl=archive&task=view&mailid=97&key=Dela74Bn&subid=1849-dXhV8m5pam0SJJ&tmpl=component> New Release Announcement DFDL4S Library - version 1.7.0 Released Dear User, Please be informed that version 1.7.0 of the DFDL4S Library has been released and is available for download at the following URL: http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download The Release Notes can be found here <http://eop-cfi.esa.int/Repo/PUBLIC/DOCUMENTATION/APPLICATIONS/DFDL4S/dfdl4s-1.7.0-release%20notes_1.0.pdf>. The following is a summary of the changes this version. *New Functionality and Improvements* - Added support for DFDL variables (dfdl:defineVariable and dfdl:newVariableInstance) - Added support for Reporting capabilities (including CRC/Reed-Solomon) - Added support to checking CRC and apply Reed-Solomon Error Correction - Aligned implementation of occursCountKind=”fixed” with DFDL standard - Added support for paths to array elements *Bug Fixes * - Corrected faulty instantiation of DataSize objects (C++ only) - Corrected trimming in StorageInFile detected during Transfer Frame to ISP transformation - Corrected evaluation of non-integer values in length fields Best Regards The DFDL4S Support Team [image: Powered by AcyMailing] <https://www.acyba.com/?utm_source=acymailing&utm_medium=e-mail&utm_content=img&utm_campaign=powered-by> -- *HE Space for ESA - European Space Agency* *Marcos Bento* Mission Analysis & Software Engineer Mission Analysis Office System Support Division Earth Observation Projects Department Directorate of Earth Observation Programmes *ESTEC* Keplerlaan 1, PO Box 299 NL-2200 AG Noordwijk, The Netherlands marcos.bento@esa.int | www.esa.int T +31 71 565 3749 This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo@esa.int).

Thanks, Marcos! At some point can you consider updating the references in the Developer’s Manuals to DFDL to the most recent published version (https://www.ogf.org/documents/GFD.240.pdf) at your convenience and as appropriate, please? Thanks, Alan On Jun 23, 2021, at 11:29 AM, Marcos Bento (external) <Marcos.Bento@esa.int> wrote: As mentioned in one of the last DFDL calls, the latest DFDL4S release is available and enables support for dfdl:defineVariable and dfdl:newVariableInstance. Check out the complete list of improvements/bug fixes below. --Marcos This email contains graphics, so if you don't see them, view it in your browser<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Feop-cfi.esa.int%2Findex.php%3Foption%3Dcom_acymailing%26ctrl%3Darchive%26task%3Dview%26mailid%3D97%26key%3DDela74Bn%26subid%3D1849-dXhV8m5pam0SJJ%26tmpl%3Dcomponent&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397914583%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=%2FlgJ%2BkMLRyRZw8y3BPgWP0eceUPRIL%2BukeE9EBXxvJ0%3D&reserved=0> <message_icon.png> New Release Announcement DFDL4S Library - version 1.7.0 Released Dear User, Please be informed that version 1.7.0 of the DFDL4S Library has been released and is available for download at the following URL: http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Feop-cfi.esa.int%2Findex.php%2Fapplications%2Fdfdl4s%2Fdfdl4s-download&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397914583%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=WxrNEfLQ2M0lLi3GUUh2qqtLIr%2FIZQbwAKvsXSvWdGk%3D&reserved=0> The Release Notes can be found here<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Feop-cfi.esa.int%2FRepo%2FPUBLIC%2FDOCUMENTATION%2FAPPLICATIONS%2FDFDL4S%2Fdfdl4s-1.7.0-release%2520notes_1.0.pdf&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397924575%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=c3QhMM9vYLhR0MpjqDD5cI%2FbeEJ04kZ7PXUSa9QfpKY%3D&reserved=0>. The following is a summary of the changes this version. New Functionality and Improvements * Added support for DFDL variables (dfdl:defineVariable and dfdl:newVariableInstance) * Added support for Reporting capabilities (including CRC/Reed-Solomon) * Added support to checking CRC and apply Reed-Solomon Error Correction * Aligned implementation of occursCountKind=”fixed” with DFDL standard * Added support for paths to array elements Bug Fixes * Corrected faulty instantiation of DataSize objects (C++ only) * Corrected trimming in StorageInFile detected during Transfer Frame to ISP transformation * Corrected evaluation of non-integer values in length fields Best Regards The DFDL4S Support Team <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.acyba.com%2F%3Futm_source%3Dacymailing%26utm_medium%3De-mail%26utm_content%3Dimg%26utm_campaign%3Dpowered-by&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397924575%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=EqDfWi6LppLKPz5%2BAJMRXFYJep8rYRisAjbAGeCVjRw%3D&reserved=0> <poweredby.png> -- HE Space for ESA - European Space Agency Marcos Bento Mission Analysis & Software Engineer Mission Analysis Office System Support Division Earth Observation Projects Department Directorate of Earth Observation Programmes ESTEC Keplerlaan 1, PO Box 299 NL-2200 AG Noordwijk, The Netherlands marcos.bento@esa.int<mailto:marcos.bento@esa.int> | www.esa.int<https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.esa.int%2F&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397934575%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=thImgP6Nss9UeGyUBUzVjesCnjPRhlo1%2BA1%2F3PtI4JM%3D&reserved=0> T +31 71 565 3749 This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo@esa.int). -- dfdl-wg mailing list dfdl-wg@ogf.org https://www.ogf.org/mailman/listinfo/dfdl-wg

Good point, Alan. Thank you for the heads up. I've raised the issue to be fixed, if not before, with the next release. Kind regards, --Marcos On Wed, Jun 23, 2021 at 6:44 PM Sill, Alan <Alan.Sill@ttu.edu> wrote:
Thanks, Marcos!
At some point can you consider updating the references in the Developer’s Manuals to DFDL to the most recent published version ( https://www.ogf.org/documents/GFD.240.pdf) at your convenience and as appropriate, please?
Thanks, Alan
On Jun 23, 2021, at 11:29 AM, Marcos Bento (external) < Marcos.Bento@esa.int> wrote:
As mentioned in one of the last DFDL calls, the latest DFDL4S release is available and enables support for dfdl:defineVariable and dfdl:newVariableInstance. Check out the complete list of improvements/bug fixes below.
--Marcos
This email contains graphics, so if you don't see them, view it in your browser <https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Feop-cfi.esa.int%2Findex.php%3Foption%3Dcom_acymailing%26ctrl%3Darchive%26task%3Dview%26mailid%3D97%26key%3DDela74Bn%26subid%3D1849-dXhV8m5pam0SJJ%26tmpl%3Dcomponent&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397914583%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=%2FlgJ%2BkMLRyRZw8y3BPgWP0eceUPRIL%2BukeE9EBXxvJ0%3D&reserved=0>
<message_icon.png> New Release Announcement DFDL4S Library - version 1.7.0 Released Dear User,
Please be informed that version 1.7.0 of the DFDL4S Library has been released and is available for download at the following URL: http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download <https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Feop-cfi.esa.int%2Findex.php%2Fapplications%2Fdfdl4s%2Fdfdl4s-download&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397914583%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=WxrNEfLQ2M0lLi3GUUh2qqtLIr%2FIZQbwAKvsXSvWdGk%3D&reserved=0>
The Release Notes can be found here <https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Feop-cfi.esa.int%2FRepo%2FPUBLIC%2FDOCUMENTATION%2FAPPLICATIONS%2FDFDL4S%2Fdfdl4s-1.7.0-release%2520notes_1.0.pdf&data=04%7C01%7Calan.sill%40ttu.edu%7C706adfa35a344f65105d08d93663ffc8%7C178a51bf8b2049ffb65556245d5c173c%7C0%7C1%7C637600625397924575%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=c3QhMM9vYLhR0MpjqDD5cI%2FbeEJ04kZ7PXUSa9QfpKY%3D&reserved=0>. The following is a summary of the changes this version.
*New Functionality and Improvements*
- Added support for DFDL variables (dfdl:defineVariable and dfdl:newVariableInstance) - Added support for Reporting capabilities (including CRC/Reed-Solomon) - Added support to checking CRC and apply Reed-Solomon Error Correction - Aligned implementation of occursCountKind=”fixed” with DFDL standard - Added support for paths to array elements
*Bug Fixes *
- Corrected faulty instantiation of DataSize objects (C++ only) - Corrected trimming in StorageInFile detected during Transfer Frame to ISP transformation - Corrected evaluation of non-integer values in length fields
Best Regards
The DFDL4S Support Team
<poweredby.png>
This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo@esa.int).

Excellent and congratulations on the release. I will have to study your CRC approach. This goes beyond what DFDL specifies, but we have the same requirement and have been considering some design points for Apache Daffodil to create experimental features. Mike Beckerle | OGF DFDL Workgroup Co-Chair | Owl Cyber Defense | www.owlcyberdefense.com Please note: Contributions to the DFDL Workgroup's email discussions are subject to the OGF Intellectual Property Policy <http://www.ogf.org/About/abt_policies.php> On Wed, Jun 23, 2021 at 12:28 PM Marcos Bento (external) < Marcos.Bento@esa.int> wrote:
As mentioned in one of the last DFDL calls, the latest DFDL4S release is available and enables support for dfdl:defineVariable and dfdl:newVariableInstance. Check out the complete list of improvements/bug fixes below.
--Marcos
This email contains graphics, so if you don't see them, view it in your browser <http://eop-cfi.esa.int/index.php?option=com_acymailing&ctrl=archive&task=view&mailid=97&key=Dela74Bn&subid=1849-dXhV8m5pam0SJJ&tmpl=component>
New Release Announcement DFDL4S Library - version 1.7.0 Released Dear User,
Please be informed that version 1.7.0 of the DFDL4S Library has been released and is available for download at the following URL: http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download
The Release Notes can be found here <http://eop-cfi.esa.int/Repo/PUBLIC/DOCUMENTATION/APPLICATIONS/DFDL4S/dfdl4s-1.7.0-release%20notes_1.0.pdf>. The following is a summary of the changes this version.
*New Functionality and Improvements*
- Added support for DFDL variables (dfdl:defineVariable and dfdl:newVariableInstance) - Added support for Reporting capabilities (including CRC/Reed-Solomon) - Added support to checking CRC and apply Reed-Solomon Error Correction - Aligned implementation of occursCountKind=”fixed” with DFDL standard - Added support for paths to array elements
*Bug Fixes *
- Corrected faulty instantiation of DataSize objects (C++ only) - Corrected trimming in StorageInFile detected during Transfer Frame to ISP transformation - Corrected evaluation of non-integer values in length fields
Best Regards
The DFDL4S Support Team
[image: Powered by AcyMailing] <https://www.acyba.com/?utm_source=acymailing&utm_medium=e-mail&utm_content=img&utm_campaign=powered-by>
-- *HE Space for ESA - European Space Agency*
*Marcos Bento* Mission Analysis & Software Engineer Mission Analysis Office System Support Division Earth Observation Projects Department Directorate of Earth Observation Programmes
*ESTEC* Keplerlaan 1, PO Box 299 NL-2200 AG Noordwijk, The Netherlands marcos.bento@esa.int | www.esa.int T +31 71 565 3749
This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo@esa.int).
-- dfdl-wg mailing list dfdl-wg@ogf.org https://www.ogf.org/mailman/listinfo/dfdl-wg

Hi Marcos Congratulations on your new release! Does it include the XPath wildcard support which the WG had been tracking under action 287? I think we agreed that it would appear as an 'experimental feature' at some point? Regards Steve Hanson IBM Hybrid Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh@uk.ibm.com tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday From: "Marcos Bento (external)" <Marcos.Bento@esa.int> To: DFDL-WG <dfdl-wg@ogf.org> Date: 23/06/2021 17:28 Subject: [EXTERNAL] [DFDL-WG] DFDL4S Library - version 1.7.0 Released Sent by: "dfdl-wg" <dfdl-wg-bounces@ogf.org> As mentioned in one of the last DFDL calls, the latest DFDL4S release is available and enables support for dfdl:defineVariable and dfdl:newVariableInstance. Check out the complete list of improvements/bug fixes below. --Marcos This email contains graphics, so if you don't see them, view it in your browser New Release Announcement DFDL4S Library - version 1.7.0 Released Dear User, Please be informed that version 1.7.0 of the DFDL4S Library has been released and is available for download at the following URL: http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download The Release Notes can be found here. The following is a summary of the changes this version. New Functionality and Improvements Added support for DFDL variables (dfdl:defineVariable and dfdl:newVariableInstance) Added support for Reporting capabilities (including CRC/Reed-Solomon) Added support to checking CRC and apply Reed-Solomon Error Correction Aligned implementation of occursCountKind=”fixed” with DFDL standard Added support for paths to array elements Bug Fixes Corrected faulty instantiation of DataSize objects (C++ only) Corrected trimming in StorageInFile detected during Transfer Frame to ISP transformation Corrected evaluation of non-integer values in length fields Best Regards The DFDL4S Support Team -- HE Space for ESA - European Space Agency Marcos Bento Mission Analysis & Software Engineer Mission Analysis Office System Support Division Earth Observation Projects Department Directorate of Earth Observation Programmes ESTEC Keplerlaan 1, PO Box 299 NL-2200 AG Noordwijk, The Netherlands marcos.bento@esa.int | www.esa.int T +31 71 565 3749 This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo@esa.int). -- dfdl-wg mailing list dfdl-wg@ogf.org https://www.ogf.org/mailman/listinfo/dfdl-wg Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Hi Steve, This release indeed has developments related to action 287, but we only plan to put the new features into "action" with the upcoming version of S2G (which is the data visualiser that makes most use of DFDL4S). Up until the next release of the S2G we should have some news regarding a preparing an 'experimental feature' document. I'm not sure exactly what is needed for such a proposal, so some guidance on that process would be welcome. --Marcos On Tue, Jun 29, 2021 at 11:58 AM Steve Hanson <smh@uk.ibm.com> wrote:
Hi Marcos
Congratulations on your new release!
Does it include the XPath wildcard support which the WG had been tracking under action 287? I think we agreed that it would appear as an 'experimental feature' at some point?
Regards
Steve Hanson
IBM Hybrid Integration, Hursley, UK Architect, *IBM DFDL* <http://www.ibm.com/developerworks/library/se-dfdl/index.html> Co-Chair, *OGF DFDL Working Group* <http://www.ogf.org/dfdl/> *smh@uk.ibm.com* <smh@uk.ibm.com> tel:+44-1962-815848 mob:+44-7717-378890 Note: I work Tuesday to Friday
From: "Marcos Bento (external)" <Marcos.Bento@esa.int> To: DFDL-WG <dfdl-wg@ogf.org> Date: 23/06/2021 17:28 Subject: [EXTERNAL] [DFDL-WG] DFDL4S Library - version 1.7.0 Released Sent by: "dfdl-wg" <dfdl-wg-bounces@ogf.org> ------------------------------
As mentioned in one of the last DFDL calls, the latest DFDL4S release is available and enables support for dfdl:defineVariable and dfdl:newVariableInstance. Check out the complete list of improvements/bug fixes below.
--Marcos
*This email contains graphics, so if you don't see them, view it in your browser* <http://eop-cfi.esa.int/index.php?option=com_acymailing&ctrl=archive&task=view&mailid=97&key=Dela74Bn&subid=1849-dXhV8m5pam0SJJ&tmpl=component>
*New Release Announcement* *DFDL4S Library - version 1.7.0 Released* *Dear User,*
Please be informed that version 1.7.0 of the DFDL4S Library has been released and is available for download at the following URL:
*http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download* <http://eop-cfi.esa.int/index.php/applications/dfdl4s/dfdl4s-download>
The Release Notes can be found *here* <http://eop-cfi.esa.int/Repo/PUBLIC/DOCUMENTATION/APPLICATIONS/DFDL4S/dfdl4s-1.7.0-release%20notes_1.0.pdf>. The following is a summary of the changes this version.
*New Functionality and Improvements*
- Added support for DFDL variables (dfdl:defineVariable and dfdl:newVariableInstance) - Added support for Reporting capabilities (including CRC/Reed-Solomon) - Added support to checking CRC and apply Reed-Solomon Error Correction - Aligned implementation of occursCountKind=”fixed” with DFDL standard - Added support for paths to array elements
*Bug Fixes *
- Corrected faulty instantiation of DataSize objects (C++ only) - Corrected trimming in StorageInFile detected during Transfer Frame to ISP transformation - Corrected evaluation of non-integer values in length fields
Best Regards
The DFDL4S Support Team
[image: Powered by AcyMailing] <https://www.acyba.com/?utm_source=acymailing&utm_medium=e-mail&utm_content=img&utm_campaign=powered-by>
-- *HE Space for ESA - European Space Agency*
* Marcos Bento* Mission Analysis & Software Engineer Mission Analysis Office System Support Division Earth Observation Projects Department Directorate of Earth Observation Programmes
* ESTEC* Keplerlaan 1, PO Box 299 NL-2200 AG Noordwijk, The Netherlands *marcos.bento@esa.int* <marcos.bento@esa.int> | *www.esa.int* <http://www.esa.int> T +31 71 565 3749 This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo@esa.int).
-- dfdl-wg mailing list dfdl-wg@ogf.org https://www.ogf.org/mailman/listinfo/dfdl-wg
Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
This message is intended only for the recipient(s) named above. It may contain proprietary information and/or protected content. Any unauthorised disclosure, use, retention or dissemination is prohibited. If you have received this e-mail in error, please notify the sender immediately. ESA applies appropriate organisational measures to protect personal data, in case of data privacy queries, please contact the ESA Data Protection Officer (dpo@esa.int).
participants (4)
-
Marcos Bento (external)
-
Mike Beckerle
-
Sill, Alan
-
Steve Hanson